[2025-09-15T04:01:14.824583] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-15T04:01:14.825220] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-15T04:01:14.825292] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-15T04:01:14.826314] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-15T04:01:14.826387] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-15T04:01:15.179030] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-15T04:01:15.179402] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-15T04:01:17.357613] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T04:01:17.368063] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-15T04:01:19.461448] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T04:01:19.473468] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-15T04:01:22.015240] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-15T04:01:22.026509] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-15T04:01:24.273716] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T04:01:24.285986] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-15T04:01:26.587191] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-15T04:01:26.598276] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-15T04:01:29.042362] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-15T04:01:29.055596] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-15T04:01:31.255286] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-15T04:01:31.267287] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-15T04:01:33.542137] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-15T04:01:33.569686] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-15T04:01:33.569951] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-15T04:01:33.961178] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-15T04:01:33.961446] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-15T04:01:33.963448] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-15T04:01:33.963543] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-15T04:01:33.968109] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 40393 (keeping 150 days of data) [2025-09-15T04:01:34.289190] [DEBUG] [LOCAL ] IBM: Primary data saved (40393 records). [2025-09-15T04:01:34.289434] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-15T04:01:34.290032] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-15T04:01:34.349493] [DEBUG] [LOCAL ] IBM: Loaded 40393 existing records from primary storage. [2025-09-15T04:01:34.349736] [INFO ] [MAIN ] IBM: Loaded 40393 primary data records. [2025-09-15T04:01:34.635458] [DEBUG] [MAIN ] IBM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-15T04:01:34.636304] [INFO ] [MAIN ] IBM: Generated 1352 derivative records from 40393 primary records. [2025-09-15T04:01:34.636391] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-15T04:01:34.648710] [DEBUG] [LOCAL ] IBM: Derivative data saved (1352 records). [2025-09-15T04:01:34.648789] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-15T17:00:01.582544] [INFO ] [MAIN ] Using last completed trading day: 2025-09-15 [2025-09-15T17:00:01.582790] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-15T17:00:01.582886] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-15T17:00:01.582965] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-15T17:00:03.273153] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-09-15T17:00:03.273359] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-15T17:00:03.273590] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-15T17:00:03.274533] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-09-15T17:00:03.274585] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-15T17:00:03.274617] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-15T17:00:03.274700] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-15T17:00:03.274869] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-15T17:00:03.275252] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-15T17:00:03.275290] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-15T17:00:03.275480] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-15T17:00:03.275540] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-09-15T17:00:03.275579] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-15T17:00:03.275611] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-15T17:00:03.298471] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ARGD.csv (symbol ARGD no longer active). [2025-09-15T17:00:03.303539] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-15T17:00:03.325718] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ARGD.csv (symbol ARGD no longer active). [2025-09-15T17:00:03.332890] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-15T17:00:03.333031] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-15T17:00:03.333093] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-15T17:00:03.333145] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-15T17:00:03.333587] [WARN ] [STATE ] State set to: RUNNING [2025-09-15T17:00:03.333821] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-15T17:00:03.334691] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-15T17:00:03.334762] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-15T17:00:03.334820] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-09-15T17:00:03.334869] [INFO ] [MAIN ] Running in parallel mode [2025-09-15T17:00:03.335151] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-09-15T17:00:03.885350] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:03.996868] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.071988] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.132553] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.133902] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-15T17:00:04.133956] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-15T17:00:04.134169] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-15T17:00:04.134231] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-15T17:00:04.140668] [DEBUG] [LOCAL ] AACT: Loaded 8258 existing records from primary storage. [2025-09-15T17:00:04.140342] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-15T17:00:04.140871] [INFO ] [MAIN ] AACT: Loaded 8258 existing records. [2025-09-15T17:00:04.146177] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-15T17:00:04.562441] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:04.599990] [DEBUG] [LOCAL ] A: Loaded 38079 existing records from primary storage. [2025-09-15T17:00:04.617899] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-15T17:00:04.638145] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-15T17:00:04.617739] [INFO ] [MAIN ] A: Loaded 38079 existing records. [2025-09-15T17:00:04.661282] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-15T17:00:04.739716] [DEBUG] [LOCAL ] AA: Loaded 40362 existing records from primary storage. [2025-09-15T17:00:04.738556] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-15T17:00:04.781179] [INFO ] [MAIN ] AA: Loaded 40362 existing records. [2025-09-15T17:00:05.195889] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:05.250850] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:05.257744] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-15T17:00:05.292619] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-15T17:00:05.377299] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-15T17:00:05.377731] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:05.432234] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-15T17:00:05.416120] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-15T17:00:05.450117] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-15T17:00:05.469285] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-15T17:00:05.505381] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-15T17:00:05.535170] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-15T17:00:05.825818] [INFO ] [REMOTE ] AACT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:05.854371] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-15T17:00:05.868581] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:00:05.882220] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-15T17:00:06.237334] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T17:00:06.260631] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-15T17:00:06.447526] [INFO ] [REMOTE ] AA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:06.451116] [INFO ] [REMOTE ] A: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:06.447727] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T17:00:06.451511] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-15T17:00:06.453776] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-15T17:00:06.452672] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-15T17:00:06.804506] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-15T17:00:06.805592] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-15T17:00:06.849256] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:00:06.851050] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-15T17:00:07.091736] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T17:00:07.093021] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-15T17:00:07.377306] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-15T17:00:07.378517] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-15T17:00:07.478059] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T17:00:07.480956] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-15T17:00:07.646731] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-15T17:00:07.647759] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-15T17:00:08.025569] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:00:08.035855] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-15T17:00:08.244973] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:00:08.248861] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-15T17:00:08.317856] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T17:00:08.319419] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-15T17:00:08.359723] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T17:00:08.370721] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-15T17:00:08.746618] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T17:00:08.750491] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-15T17:00:08.755853] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T17:00:08.756707] [INFO ] [REMOTE ] AAM: Full fetch complete (708 records). [2025-09-15T17:00:08.756818] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-15T17:00:08.954015] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T17:00:08.954251] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:08.954320] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:08.954378] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-15T17:00:08.954453] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-15T17:00:08.954504] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-15T17:00:08.954553] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-15T17:00:08.954678] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAM took 5.5s. Estimated remaining: 3h 41m 47s. Rate: 10.7 symbols/min [2025-09-15T17:00:09.140482] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:09.162805] [DEBUG] [LOCAL ] AAMI: Loaded 18336 existing records from primary storage. [2025-09-15T17:00:09.162968] [INFO ] [MAIN ] AAMI: Loaded 18336 existing records. [2025-09-15T17:00:09.350114] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:09.350397] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-15T17:00:09.350456] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-15T17:00:09.351015] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-09-15T17:00:09.351073] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-15T17:00:09.547902] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:00:09.656008] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-15T17:00:09.777744] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:09.778208] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-15T17:00:09.813387] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:00:09.824108] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-15T17:00:09.986857] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:00:09.998833] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-15T17:00:10.397466] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T17:00:10.401219] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-15T17:00:10.426763] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:00:10.431063] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-15T17:00:11.239942] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:00:11.245078] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-15T17:00:11.252046] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T17:00:11.254337] [INFO ] [REMOTE ] AACT: Full fetch complete (9479 records). [2025-09-15T17:00:11.254433] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-15T17:00:11.642664] [DEBUG] [VALIDATOR ] AACT: All expected trading days are present. [2025-09-15T17:00:11.642814] [DEBUG] [VALIDATOR ] AACT: Primary data validation passed. [2025-09-15T17:00:11.643048] [INFO ] [MAIN ] AACT: Fetched primary data is valid. [2025-09-15T17:00:11.643154] [DEBUG] [LOCAL ] AACT: Saving primary data. [2025-09-15T17:00:11.643883] [DEBUG] [LOCAL ] AACT: Trimmed 9479 records to 7894 (keeping 150 days of data) [2025-09-15T17:00:11.696749] [DEBUG] [LOCAL ] AACT: Primary data saved (7894 records). [2025-09-15T17:00:11.696971] [INFO ] [MAIN ] AACT: Full history saved. [2025-09-15T17:00:11.697545] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AACT took 8.3s. Estimated remaining: 2h 44m 57s. Rate: 14.3 symbols/min [2025-09-15T17:00:11.849001] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T17:00:11.925272] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-15T17:00:11.924954] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:12.049057] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:00:12.062162] [DEBUG] [LOCAL ] AAP: Loaded 39164 existing records from primary storage. [2025-09-15T17:00:12.062795] [INFO ] [MAIN ] AAP: Loaded 39164 existing records. [2025-09-15T17:00:12.111227] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-15T17:00:12.272684] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:12.273191] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-15T17:00:12.273267] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-15T17:00:12.282345] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-15T17:00:12.297762] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-15T17:00:12.305907] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:00:12.417773] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-15T17:00:12.777280] [INFO ] [REMOTE ] AAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:12.777700] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-15T17:00:14.154158] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:00:14.160592] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-15T17:00:14.549740] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-15T17:00:14.561537] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-15T17:00:14.693143] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-15T17:00:14.707598] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-15T17:00:14.874071] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-15T17:00:14.883988] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-15T17:00:15.661222] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:00:15.666388] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-15T17:00:16.164707] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:00:16.175250] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-15T17:00:16.742972] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T17:00:16.754033] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-15T17:00:17.669971] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:00:17.681960] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-15T17:00:18.115478] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T17:00:18.122382] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-15T17:00:18.306514] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (3.42 seconds). [2025-09-15T17:00:18.317494] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-15T17:00:19.052462] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:00:19.058003] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-15T17:00:19.225907] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:00:19.236802] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-15T17:00:19.456265] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-15T17:00:19.468742] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-15T17:00:19.604790] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T17:00:19.615989] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-15T17:00:20.208535] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:00:20.212476] [INFO ] [REMOTE ] AAMI: Full fetch complete (25858 records). [2025-09-15T17:00:20.212627] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-15T17:00:20.213339] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:20.213428] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:20.213468] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:20.213521] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-15T17:00:20.213583] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-15T17:00:20.213623] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-15T17:00:20.213937] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-09-15T17:00:20.214045] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAMI took 11.3s. Estimated remaining: 3h 41m 52s. Rate: 10.7 symbols/min [2025-09-15T17:00:20.398365] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:20.441908] [DEBUG] [LOCAL ] AAT: Loaded 22768 existing records from primary storage. [2025-09-15T17:00:20.442080] [INFO ] [MAIN ] AAT: Loaded 22768 existing records. [2025-09-15T17:00:20.634820] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:20.635206] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-15T17:00:20.635264] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-15T17:00:20.635895] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-15T17:00:20.635948] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-15T17:00:20.999011] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:20.999397] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-15T17:00:21.121156] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:00:21.133078] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-15T17:00:21.274373] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:00:21.289138] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-15T17:00:21.352472] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-15T17:00:21.358284] [INFO ] [REMOTE ] A: Full fetch complete (54915 records). [2025-09-15T17:00:21.358447] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-15T17:00:21.359361] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:21.359446] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:21.359482] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:21.359523] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-15T17:00:21.359585] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-15T17:00:21.359625] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-15T17:00:21.359914] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-15T17:00:21.360214] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. A took 18.0s. Estimated remaining: 2h 57m 37s. Rate: 13.3 symbols/min [2025-09-15T17:00:21.537796] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:21.538054] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-15T17:00:21.538099] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-15T17:00:21.538234] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-15T17:00:21.538274] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-15T17:00:21.538315] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-15T17:00:21.538349] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-15T17:00:21.912261] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:21.912601] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-15T17:00:22.069063] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:00:22.075260] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-15T17:00:22.144425] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.144802] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-15T17:00:22.145385] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-15T17:00:22.347748] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.348199] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-15T17:00:22.348921] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-15T17:00:22.504589] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:00:22.517560] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-15T17:00:22.586195] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.586447] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-15T17:00:22.586847] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-15T17:00:22.787639] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.788082] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-15T17:00:22.788712] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-15T17:00:22.854268] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:00:22.860255] [INFO ] [REMOTE ] AA: Full fetch complete (57864 records). [2025-09-15T17:00:22.860383] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-15T17:00:22.863521] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:22.863607] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:22.863665] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:22.863716] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-15T17:00:22.863794] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-15T17:00:22.863872] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-15T17:00:22.864189] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-09-15T17:00:22.864480] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 19.5s. Estimated remaining: 2h 33m 54s. Rate: 15.4 symbols/min [2025-09-15T17:00:23.040422] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:23.061659] [DEBUG] [LOCAL ] AB: Loaded 18396 existing records from primary storage. [2025-09-15T17:00:23.061817] [INFO ] [MAIN ] AB: Loaded 18396 existing records. [2025-09-15T17:00:23.254959] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:23.255662] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-15T17:00:23.255913] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-15T17:00:23.262351] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-15T17:00:23.274572] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-15T17:00:23.309845] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:00:23.390215] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-15T17:00:23.424827] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:00:23.461797] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-15T17:00:23.669501] [INFO ] [REMOTE ] AB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:23.669875] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-15T17:00:23.951023] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T17:00:23.953828] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-15T17:00:24.119882] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:00:24.131422] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-15T17:00:24.377037] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:00:24.385789] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-15T17:00:24.637793] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:00:24.641699] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-15T17:00:24.897091] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T17:00:24.906208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-15T17:00:25.309737] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:00:25.331164] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:00:25.338252] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-15T17:00:25.340157] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-15T17:00:25.690520] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:00:25.693177] [INFO ] [REMOTE ] AAUC: Full fetch complete (6395 records). [2025-09-15T17:00:25.693281] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-15T17:00:25.884511] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 68 unique days, need 150 days [2025-09-15T17:00:25.885469] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:25.885543] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:25.885606] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-15T17:00:25.885733] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-15T17:00:25.885798] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-15T17:00:25.885855] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-15T17:00:25.885950] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAUC took 4.5s. Estimated remaining: 2h 28m 1s. Rate: 16.0 symbols/min [2025-09-15T17:00:26.070349] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:26.124813] [DEBUG] [LOCAL ] ABBV: Loaded 40433 existing records from primary storage. [2025-09-15T17:00:26.124981] [INFO ] [MAIN ] ABBV: Loaded 40433 existing records. [2025-09-15T17:00:26.310114] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:26.310497] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-15T17:00:26.310587] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-15T17:00:26.318717] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-15T17:00:26.326475] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-15T17:00:26.378969] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:00:26.429814] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-15T17:00:26.750171] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:00:26.756658] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:26.761613] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-15T17:00:26.765071] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T17:00:26.765318] [INFO ] [REMOTE ] AAP: Full fetch complete (56333 records). [2025-09-15T17:00:26.774900] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-15T17:00:26.775949] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-15T17:00:26.776333] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:26.776447] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:26.776494] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:26.776540] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-15T17:00:26.776598] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-15T17:00:26.776655] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-15T17:00:26.777484] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-15T17:00:26.777579] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 15.1s. Estimated remaining: 2h 11m 50s. Rate: 17.9 symbols/min [2025-09-15T17:00:26.948733] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:26.970223] [DEBUG] [LOCAL ] ABCB: Loaded 22109 existing records from primary storage. [2025-09-15T17:00:26.970354] [INFO ] [MAIN ] ABCB: Loaded 22109 existing records. [2025-09-15T17:00:27.147184] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:27.147433] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-15T17:00:27.147479] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-15T17:00:27.147998] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-15T17:00:27.148047] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-15T17:00:27.504366] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:27.504819] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-15T17:00:28.172517] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:00:28.180078] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-15T17:00:28.285146] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:00:28.293903] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-15T17:00:28.396391] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:00:28.406542] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-15T17:00:28.519828] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:00:28.525945] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-15T17:00:28.984812] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:00:28.991605] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-15T17:00:29.162424] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:00:29.168710] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-15T17:00:29.647675] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:00:29.655512] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-15T17:00:29.818173] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:00:29.823029] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-15T17:00:29.930488] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:00:29.933761] [INFO ] [REMOTE ] AAT: Full fetch complete (32803 records). [2025-09-15T17:00:29.933857] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-15T17:00:29.934498] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:29.934579] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:29.934618] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:29.934679] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-15T17:00:29.934757] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-15T17:00:29.934798] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-15T17:00:29.935031] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-15T17:00:29.935152] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AAT took 9.7s. Estimated remaining: 2h 10m 50s. Rate: 18.0 symbols/min [2025-09-15T17:00:30.104555] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:30.158555] [DEBUG] [LOCAL ] ABEV: Loaded 40061 existing records from primary storage. [2025-09-15T17:00:30.158748] [INFO ] [MAIN ] ABEV: Loaded 40061 existing records. [2025-09-15T17:00:30.410224] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:30.412507] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:00:30.412842] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-15T17:00:30.412950] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-15T17:00:30.424831] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-15T17:00:30.425812] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-15T17:00:30.425880] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-15T17:00:30.795831] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:30.796508] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-15T17:00:30.820140] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:00:30.829089] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-15T17:00:30.853249] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:00:30.861751] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-15T17:00:31.791894] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T17:00:31.798709] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-15T17:00:31.848252] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:00:31.853767] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-15T17:00:32.302777] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T17:00:32.318568] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-15T17:00:32.372740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:00:32.392997] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-15T17:00:33.025565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:00:33.035402] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-15T17:00:33.085013] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:00:33.090591] [INFO ] [REMOTE ] AB: Full fetch complete (33568 records). [2025-09-15T17:00:33.090875] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-15T17:00:33.577104] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-15T17:00:33.577206] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-15T17:00:33.577610] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-15T17:00:33.577690] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-15T17:00:33.578884] [DEBUG] [LOCAL ] AB: Trimmed 33568 records to 17717 (keeping 150 days of data) [2025-09-15T17:00:33.698773] [DEBUG] [LOCAL ] AB: Primary data saved (17717 records). [2025-09-15T17:00:33.699014] [INFO ] [MAIN ] AB: Full history saved. [2025-09-15T17:00:33.699147] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. AB took 10.8s. Estimated remaining: 2h 12m 42s. Rate: 17.8 symbols/min [2025-09-15T17:00:33.888459] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:33.905267] [DEBUG] [LOCAL ] ABG: Loaded 13231 existing records from primary storage. [2025-09-15T17:00:33.905435] [INFO ] [MAIN ] ABG: Loaded 13231 existing records. [2025-09-15T17:00:34.097670] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:34.098370] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-15T17:00:34.098553] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-15T17:00:34.099299] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-15T17:00:34.099535] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-15T17:00:34.314279] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:00:34.315791] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-15T17:00:34.430785] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-15T17:00:34.482976] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-15T17:00:34.573027] [INFO ] [REMOTE ] ABG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:34.573558] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-15T17:00:34.607180] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-15T17:00:34.618930] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-15T17:00:35.372741] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:00:35.376695] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-15T17:00:35.740068] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:00:35.749264] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-15T17:00:36.210751] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:00:36.216130] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-15T17:00:36.299132] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T17:00:36.311439] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-15T17:00:36.394013] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:00:36.405192] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-15T17:00:36.474626] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T17:00:36.478668] [INFO ] [REMOTE ] ABCB: Full fetch complete (33187 records). [2025-09-15T17:00:36.478827] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-15T17:00:36.850585] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-15T17:00:36.850702] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-15T17:00:36.851080] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-15T17:00:36.851202] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-15T17:00:36.852323] [DEBUG] [LOCAL ] ABCB: Trimmed 33187 records to 21569 (keeping 150 days of data) [2025-09-15T17:00:37.001059] [DEBUG] [LOCAL ] ABCB: Primary data saved (21569 records). [2025-09-15T17:00:37.001210] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-15T17:00:37.001308] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABCB took 10.2s. Estimated remaining: 2h 12m 22s. Rate: 17.8 symbols/min [2025-09-15T17:00:37.170305] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:37.193617] [DEBUG] [LOCAL ] ABM: Loaded 23534 existing records from primary storage. [2025-09-15T17:00:37.193782] [INFO ] [MAIN ] ABM: Loaded 23534 existing records. [2025-09-15T17:00:37.372157] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:37.372682] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-15T17:00:37.372846] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-15T17:00:37.373483] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-15T17:00:37.373538] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-15T17:00:37.516190] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:00:37.574942] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-15T17:00:37.775028] [INFO ] [REMOTE ] ABM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:37.776164] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-15T17:00:37.964529] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T17:00:37.976446] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-15T17:00:38.008590] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:00:38.022096] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-15T17:00:38.240155] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T17:00:38.243938] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-15T17:00:38.767211] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T17:00:38.772346] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-15T17:00:38.874820] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:00:38.878741] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-15T17:00:39.201591] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:00:39.213157] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-15T17:00:39.632634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:00:39.644523] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-15T17:00:39.912457] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:00:39.918178] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-15T17:00:40.068376] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:00:40.075512] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-15T17:00:40.602517] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:00:40.608103] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-15T17:00:40.714408] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:00:40.726084] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-15T17:00:41.254596] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:00:41.263733] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-15T17:00:41.322971] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:00:41.325920] [INFO ] [REMOTE ] ABG: Full fetch complete (20389 records). [2025-09-15T17:00:41.326049] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-15T17:00:41.785593] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-15T17:00:41.822056] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-15T17:00:41.822399] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-15T17:00:41.822903] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-15T17:00:41.822987] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-15T17:00:41.824089] [DEBUG] [LOCAL ] ABG: Trimmed 20389 records to 12853 (keeping 150 days of data) [2025-09-15T17:00:41.824852] [INFO ] [REMOTE ] ABBV: Full fetch complete (58363 records). [2025-09-15T17:00:41.825301] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-15T17:00:42.332186] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-15T17:00:42.331922] [DEBUG] [LOCAL ] ABG: Primary data saved (12853 records). [2025-09-15T17:00:42.332468] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-15T17:00:42.333374] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-15T17:00:42.333274] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-15T17:00:42.333629] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABG took 8.6s. Estimated remaining: 2h 19m 20s. Rate: 16.9 symbols/min [2025-09-15T17:00:42.334119] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-15T17:00:42.397483] [DEBUG] [LOCAL ] ABBV: Trimmed 58363 records to 39654 (keeping 150 days of data) [2025-09-15T17:00:42.470292] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:00:42.609240] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-15T17:00:42.645892] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:42.693127] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T17:00:42.718497] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-15T17:00:42.746623] [DEBUG] [LOCAL ] ABR: Loaded 39178 existing records from primary storage. [2025-09-15T17:00:42.747759] [INFO ] [MAIN ] ABR: Loaded 39178 existing records. [2025-09-15T17:00:43.040555] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:43.044101] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-15T17:00:43.044775] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-15T17:00:43.046931] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-15T17:00:43.047634] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-15T17:00:43.448407] [INFO ] [REMOTE ] ABR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:43.449483] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-15T17:00:43.463286] [DEBUG] [LOCAL ] ABBV: Primary data saved (39654 records). [2025-09-15T17:00:43.463424] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-15T17:00:43.463517] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABBV took 17.6s. Estimated remaining: 2h 11m 22s. Rate: 17.9 symbols/min [2025-09-15T17:00:43.647732] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:43.690825] [DEBUG] [LOCAL ] ABT: Loaded 40373 existing records from primary storage. [2025-09-15T17:00:43.691017] [INFO ] [MAIN ] ABT: Loaded 40373 existing records. [2025-09-15T17:00:43.861553] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:00:43.906665] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:43.907075] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-15T17:00:43.907331] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-15T17:00:43.907407] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-15T17:00:43.909275] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-15T17:00:43.909332] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-15T17:00:44.326412] [INFO ] [REMOTE ] ABT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:44.329037] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-15T17:00:44.328654] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T17:00:44.336711] [INFO ] [REMOTE ] ABEV: Full fetch complete (57894 records). [2025-09-15T17:00:44.336832] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-15T17:00:44.743658] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-15T17:00:44.743753] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-15T17:00:44.744416] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-15T17:00:44.744477] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-15T17:00:44.747214] [DEBUG] [LOCAL ] ABEV: Trimmed 57894 records to 39288 (keeping 150 days of data) [2025-09-15T17:00:44.986326] [DEBUG] [LOCAL ] ABEV: Primary data saved (39288 records). [2025-09-15T17:00:44.986498] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-15T17:00:44.986600] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABEV took 15.1s. Estimated remaining: 2h 5m 49s. Rate: 18.7 symbols/min [2025-09-15T17:00:45.162137] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:45.181018] [DEBUG] [LOCAL ] ACA: Loaded 17137 existing records from primary storage. [2025-09-15T17:00:45.181161] [INFO ] [MAIN ] ACA: Loaded 17137 existing records. [2025-09-15T17:00:45.387159] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:00:45.387367] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:45.395585] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-15T17:00:45.395918] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-15T17:00:45.396334] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-15T17:00:45.396460] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-15T17:00:45.397568] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-15T17:00:45.779700] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-15T17:00:45.816998] [INFO ] [REMOTE ] ACA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:45.817969] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-15T17:00:45.817742] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-15T17:00:46.132367] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T17:00:46.142967] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-15T17:00:46.718916] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:00:46.726268] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-15T17:00:46.807114] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T17:00:46.812444] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-15T17:00:47.278831] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:00:47.289622] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-15T17:00:47.866796] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T17:00:47.873317] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-15T17:00:47.962471] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:00:47.967223] [INFO ] [REMOTE ] ABM: Full fetch complete (34159 records). [2025-09-15T17:00:47.967336] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-15T17:00:48.344063] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-15T17:00:48.344246] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-15T17:00:48.344779] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-15T17:00:48.344849] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-15T17:00:48.346085] [DEBUG] [LOCAL ] ABM: Trimmed 34159 records to 23119 (keeping 150 days of data) [2025-09-15T17:00:48.485007] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-15T17:00:48.507283] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-15T17:00:48.547970] [DEBUG] [LOCAL ] ABM: Primary data saved (23119 records). [2025-09-15T17:00:48.548156] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-15T17:00:48.548294] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABM took 11.5s. Estimated remaining: 2h 6m 46s. Rate: 18.6 symbols/min [2025-09-15T17:00:48.743707] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:48.765585] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:00:48.772186] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-15T17:00:48.795450] [DEBUG] [LOCAL ] ACCO: Loaded 27964 existing records from primary storage. [2025-09-15T17:00:48.795628] [INFO ] [MAIN ] ACCO: Loaded 27964 existing records. [2025-09-15T17:00:48.977384] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:48.977769] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-15T17:00:48.977834] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-15T17:00:48.991989] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-15T17:00:49.010514] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-15T17:00:49.080707] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T17:00:49.131677] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-15T17:00:49.388240] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:49.388606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-15T17:00:49.914055] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:00:49.920147] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-15T17:00:50.251157] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:00:50.262885] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-15T17:00:50.521935] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:00:50.529817] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-15T17:00:50.703802] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:00:50.715853] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-15T17:00:50.890946] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:00:50.896363] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-15T17:00:51.664996] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:00:51.676696] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-15T17:00:51.831896] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:00:51.841045] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-15T17:00:51.978286] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:00:51.983981] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-15T17:00:52.558480] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T17:00:52.569922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-15T17:00:52.692889] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T17:00:52.699291] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-15T17:00:52.902344] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:00:53.169264] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:00:53.257852] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-15T17:00:53.402843] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:00:53.405361] [INFO ] [REMOTE ] ACA: Full fetch complete (26548 records). [2025-09-15T17:00:53.405438] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-15T17:00:53.801382] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-15T17:00:53.801485] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-15T17:00:53.801972] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-15T17:00:53.802036] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-15T17:00:53.802850] [DEBUG] [LOCAL ] ACA: Trimmed 26548 records to 16627 (keeping 150 days of data) [2025-09-15T17:00:53.906438] [DEBUG] [LOCAL ] ACA: Primary data saved (16627 records). [2025-09-15T17:00:53.906614] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-15T17:00:53.906738] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ACA took 8.9s. Estimated remaining: 2h 12m 16s. Rate: 17.8 symbols/min [2025-09-15T17:00:54.059035] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-15T17:00:54.082428] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:54.104869] [DEBUG] [LOCAL ] ACEL: Loaded 19768 existing records from primary storage. [2025-09-15T17:00:54.105025] [INFO ] [MAIN ] ACEL: Loaded 19768 existing records. [2025-09-15T17:00:54.266969] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:00:54.332611] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:54.332884] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-15T17:00:54.332933] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-15T17:00:54.333424] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-15T17:00:54.333472] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-15T17:00:54.696749] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:54.857914] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-15T17:00:55.142358] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:00:55.286661] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:00:55.657984] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-15T17:00:56.310273] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:00:56.457908] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-15T17:00:56.755399] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:00:57.257884] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-15T17:00:57.376074] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:00:58.058123] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-15T17:00:58.230065] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:00:58.857901] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-15T17:00:58.937156] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:00:59.657883] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-15T17:01:00.457915] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-15T17:01:00.954622] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:01:01.009193] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:01:01.257899] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-15T17:01:02.057938] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-15T17:01:02.151414] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:01:02.857947] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-15T17:01:03.040391] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:01:03.044681] [INFO ] [REMOTE ] ACCO: Full fetch complete (41515 records). [2025-09-15T17:01:03.044788] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-15T17:01:03.456130] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-15T17:01:03.456228] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-15T17:01:03.456757] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-15T17:01:03.456815] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-15T17:01:03.458014] [DEBUG] [LOCAL ] ACCO: Trimmed 41515 records to 27389 (keeping 150 days of data) [2025-09-15T17:01:03.631186] [DEBUG] [LOCAL ] ACCO: Primary data saved (27389 records). [2025-09-15T17:01:03.631348] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-15T17:01:03.631469] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ACCO took 15.1s. Estimated remaining: 2h 27m 47s. Rate: 15.9 symbols/min [2025-09-15T17:01:03.665094] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-15T17:01:03.817142] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:03.835758] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:01:03.842447] [INFO ] [REMOTE ] ABT: Full fetch complete (58289 records). [2025-09-15T17:01:03.842631] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-15T17:01:04.179909] [DEBUG] [LOCAL ] ACHR: Loaded 40558 existing records from primary storage. [2025-09-15T17:01:04.180253] [INFO ] [MAIN ] ACHR: Loaded 40558 existing records. [2025-09-15T17:01:04.380344] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-15T17:01:04.380615] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-15T17:01:04.381685] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-15T17:01:04.387260] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-15T17:01:04.465276] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:01:04.493859] [DEBUG] [LOCAL ] ABT: Trimmed 58289 records to 39593 (keeping 150 days of data) [2025-09-15T17:01:04.488016] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:04.495710] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-15T17:01:04.495829] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-15T17:01:04.496356] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-15T17:01:04.557491] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-15T17:01:04.557797] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-15T17:01:04.998662] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:05.146852] [DEBUG] [LOCAL ] ABT: Primary data saved (39593 records). [2025-09-15T17:01:05.147032] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-15T17:01:05.151575] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ABT took 21.7s. Estimated remaining: 2h 22m 33s. Rate: 16.5 symbols/min [2025-09-15T17:01:05.267688] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-15T17:01:05.357800] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:05.407629] [DEBUG] [LOCAL ] ACI: Loaded 40065 existing records from primary storage. [2025-09-15T17:01:05.407958] [INFO ] [MAIN ] ACI: Loaded 40065 existing records. [2025-09-15T17:01:05.587086] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:05.587434] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-15T17:01:05.592837] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-15T17:01:05.601435] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-15T17:01:05.601550] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-15T17:01:05.635310] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T17:01:05.709590] [INFO ] [REMOTE ] ABR: Full fetch complete (56754 records). [2025-09-15T17:01:05.713571] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-15T17:01:06.056755] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T17:01:06.152030] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-15T17:01:06.308405] [INFO ] [REMOTE ] ACI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:06.461986] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-15T17:01:06.462078] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-15T17:01:06.462802] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-15T17:01:06.462870] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-15T17:01:06.464255] [DEBUG] [LOCAL ] ABR: Trimmed 56754 records to 38398 (keeping 150 days of data) [2025-09-15T17:01:06.711169] [DEBUG] [LOCAL ] ABR: Primary data saved (38398 records). [2025-09-15T17:01:06.711331] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-15T17:01:06.711443] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ABR took 24.4s. Estimated remaining: 2h 17m 58s. Rate: 17.0 symbols/min [2025-09-15T17:01:06.862762] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-15T17:01:06.896241] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:06.935924] [DEBUG] [LOCAL ] ACM: Loaded 31709 existing records from primary storage. [2025-09-15T17:01:06.936081] [INFO ] [MAIN ] ACM: Loaded 31709 existing records. [2025-09-15T17:01:07.129294] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:07.129616] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-15T17:01:07.129709] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-15T17:01:07.130478] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-15T17:01:07.130533] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-15T17:01:07.558390] [INFO ] [REMOTE ] ACM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:07.575680] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:01:07.657890] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-15T17:01:07.698913] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T17:01:08.457906] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-15T17:01:08.569224] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:01:09.214407] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:01:09.258285] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-15T17:01:09.262840] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:01:10.057887] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-15T17:01:10.857894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-15T17:01:11.204871] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:01:11.622297] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-15T17:01:11.657857] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-15T17:01:12.457931] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-15T17:01:12.838351] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T17:01:13.257955] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-15T17:01:13.419604] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:01:13.423206] [INFO ] [REMOTE ] ACEL: Full fetch complete (30093 records). [2025-09-15T17:01:13.423319] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-15T17:01:13.424180] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:13.424295] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:13.424335] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:13.424384] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-15T17:01:13.424453] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-15T17:01:13.424493] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-15T17:01:13.425196] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-15T17:01:13.425322] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACEL took 19.5s. Estimated remaining: 2h 24m 29s. Rate: 16.3 symbols/min [2025-09-15T17:01:13.609000] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:13.654843] [DEBUG] [LOCAL ] ACN: Loaded 40185 existing records from primary storage. [2025-09-15T17:01:13.655009] [INFO ] [MAIN ] ACN: Loaded 40185 existing records. [2025-09-15T17:01:13.840458] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:13.840770] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-15T17:01:13.840825] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-15T17:01:13.841827] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-15T17:01:13.841889] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-15T17:01:14.070485] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-15T17:01:14.215728] [INFO ] [REMOTE ] ACN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:14.248557] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-15T17:01:14.788423] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:01:14.857834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-15T17:01:15.621295] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:01:15.657825] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-15T17:01:16.203808] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:01:16.457881] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-15T17:01:17.257882] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-15T17:01:17.334862] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:01:18.057887] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-15T17:01:18.405575] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T17:01:18.857935] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-15T17:01:19.201022] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T17:01:19.666089] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-15T17:01:19.672028] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:01:20.457884] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-15T17:01:21.006018] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-15T17:01:21.243827] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:01:21.257813] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-15T17:01:21.649342] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:01:22.057921] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-15T17:01:22.857883] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-15T17:01:23.049660] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:01:23.657928] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-15T17:01:24.425612] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-15T17:01:24.457847] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-15T17:01:24.828904] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:01:24.870342] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:01:25.257894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-15T17:01:26.057937] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-15T17:01:26.615431] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-15T17:01:26.726255] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:01:26.731816] [INFO ] [REMOTE ] ACI: Full fetch complete (57478 records). [2025-09-15T17:01:26.731963] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-15T17:01:26.732889] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:26.732990] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:26.733029] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:26.733068] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-15T17:01:26.733145] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-09-15T17:01:26.733192] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-09-15T17:01:26.733427] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-09-15T17:01:26.734107] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 21.6s. Estimated remaining: 2h 43m 15s. Rate: 14.4 symbols/min [2025-09-15T17:01:26.863037] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-15T17:01:26.915003] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:26.939953] [DEBUG] [LOCAL ] ACP: Loaded 23365 existing records from primary storage. [2025-09-15T17:01:26.940109] [INFO ] [MAIN ] ACP: Loaded 23365 existing records. [2025-09-15T17:01:27.119067] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:27.119322] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-15T17:01:27.119372] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-15T17:01:27.119939] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-15T17:01:27.119990] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-15T17:01:27.482110] [INFO ] [REMOTE ] ACP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:27.661048] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-15T17:01:27.668685] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:01:28.457906] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-15T17:01:29.235297] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T17:01:29.257863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-15T17:01:29.404061] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-15T17:01:30.000877] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T17:01:30.006034] [INFO ] [REMOTE ] ACM: Full fetch complete (47160 records). [2025-09-15T17:01:30.006151] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-15T17:01:30.068617] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-15T17:01:30.393192] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-15T17:01:30.393285] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-15T17:01:30.394009] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-15T17:01:30.394062] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-15T17:01:30.395609] [DEBUG] [LOCAL ] ACM: Trimmed 47160 records to 31167 (keeping 150 days of data) [2025-09-15T17:01:30.604065] [DEBUG] [LOCAL ] ACM: Primary data saved (31167 records). [2025-09-15T17:01:30.604239] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-15T17:01:30.604930] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACM took 23.9s. Estimated remaining: 2h 42m 38s. Rate: 14.4 symbols/min [2025-09-15T17:01:30.787583] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:30.796401] [DEBUG] [LOCAL ] ACR: Loaded 4230 existing records from primary storage. [2025-09-15T17:01:30.796558] [INFO ] [MAIN ] ACR: Loaded 4230 existing records. [2025-09-15T17:01:30.866727] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-15T17:01:30.985339] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:30.985597] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-15T17:01:30.985666] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-15T17:01:30.985949] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-15T17:01:30.986005] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-15T17:01:31.376852] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:31.409419] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T17:01:31.657876] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-15T17:01:32.213517] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:01:32.295374] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-15T17:01:32.457877] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-15T17:01:33.257883] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-15T17:01:33.493054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T17:01:33.816282] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T17:01:34.057880] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-15T17:01:34.337231] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:01:34.344771] [INFO ] [REMOTE ] ACHR: Full fetch complete (58498 records). [2025-09-15T17:01:34.345014] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-15T17:01:34.772267] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-15T17:01:34.772380] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-15T17:01:34.773050] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-15T17:01:34.773101] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-15T17:01:34.774948] [DEBUG] [LOCAL ] ACHR: Trimmed 58498 records to 39778 (keeping 150 days of data) [2025-09-15T17:01:34.871857] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-15T17:01:34.899056] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T17:01:35.044572] [DEBUG] [LOCAL ] ACHR: Primary data saved (39778 records). [2025-09-15T17:01:35.044786] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-15T17:01:35.046002] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACHR took 31.4s. Estimated remaining: 2h 43m 4s. Rate: 14.4 symbols/min [2025-09-15T17:01:35.219711] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:35.245889] [DEBUG] [LOCAL ] ACRE: Loaded 24833 existing records from primary storage. [2025-09-15T17:01:35.246068] [INFO ] [MAIN ] ACRE: Loaded 24833 existing records. [2025-09-15T17:01:35.428033] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:35.428307] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-15T17:01:35.428356] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-15T17:01:35.429056] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-15T17:01:35.429112] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-15T17:01:35.663136] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-15T17:01:35.799038] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:36.222894] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:01:36.457877] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-15T17:01:36.470915] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T17:01:37.257944] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-15T17:01:37.545584] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:01:37.859330] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:01:38.057908] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-15T17:01:38.857909] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-15T17:01:39.501485] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:01:39.558279] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:01:39.563621] [INFO ] [REMOTE ] ACN: Full fetch complete (57629 records). [2025-09-15T17:01:39.563742] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-15T17:01:39.564479] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:39.564559] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:39.564596] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:39.564634] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-15T17:01:39.564715] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-15T17:01:39.564752] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-09-15T17:01:39.565001] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-09-15T17:01:39.566105] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACN took 26.1s. Estimated remaining: 2h 43m 36s. Rate: 14.3 symbols/min [2025-09-15T17:01:39.663057] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-15T17:01:39.737353] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:39.746435] [DEBUG] [LOCAL ] ACV: Loaded 4645 existing records from primary storage. [2025-09-15T17:01:39.746574] [INFO ] [MAIN ] ACV: Loaded 4645 existing records. [2025-09-15T17:01:39.925888] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:39.926197] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-15T17:01:39.926244] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-15T17:01:39.926481] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-15T17:01:39.926530] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-15T17:01:40.274031] [INFO ] [REMOTE ] ACV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:40.388152] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T17:01:40.457857] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-15T17:01:41.251268] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T17:01:41.257816] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-15T17:01:41.700782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T17:01:42.057884] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-15T17:01:42.630969] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:01:42.857892] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-15T17:01:43.657924] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-15T17:01:44.363042] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:01:44.457982] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-15T17:01:44.471511] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:01:44.473254] [INFO ] [REMOTE ] ACR: Full fetch complete (7064 records). [2025-09-15T17:01:44.473366] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-15T17:01:44.473995] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:44.474100] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:44.474155] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:44.474217] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-15T17:01:44.474295] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-09-15T17:01:44.474333] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-09-15T17:01:44.474977] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-09-15T17:01:44.475441] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACR took 13.9s. Estimated remaining: 2h 44m 42s. Rate: 14.2 symbols/min [2025-09-15T17:01:44.767919] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:44.833480] [DEBUG] [LOCAL ] ACVA: Loaded 36553 existing records from primary storage. [2025-09-15T17:01:44.833765] [INFO ] [MAIN ] ACVA: Loaded 36553 existing records. [2025-09-15T17:01:45.101876] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:45.102344] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-15T17:01:45.102426] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-15T17:01:45.103506] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-15T17:01:45.103595] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-15T17:01:45.262996] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-15T17:01:45.545773] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:45.570295] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:01:46.058044] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-15T17:01:46.079467] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T17:01:46.857934] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-15T17:01:47.448542] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T17:01:47.477834] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:01:47.657902] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-15T17:01:48.457841] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-15T17:01:48.861092] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:01:49.257930] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-15T17:01:50.057885] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-15T17:01:50.198695] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:01:50.263010] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T17:01:50.451126] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T17:01:50.857923] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-15T17:01:51.631055] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:01:51.657886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-15T17:01:52.457945] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-15T17:01:52.913949] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:01:53.257916] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-15T17:01:53.871711] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:01:54.057919] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-15T17:01:54.809045] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:01:54.857913] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-15T17:01:55.229272] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:01:55.459357] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:01:55.657900] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-15T17:01:56.457919] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-15T17:01:57.222443] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:01:57.257912] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-15T17:01:57.937998] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:01:58.057934] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-15T17:01:58.181296] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:01:58.184749] [INFO ] [REMOTE ] ACP: Full fetch complete (34448 records). [2025-09-15T17:01:58.184824] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-15T17:01:58.551402] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-15T17:01:58.551490] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-15T17:01:58.551895] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-15T17:01:58.551991] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-15T17:01:58.552978] [DEBUG] [LOCAL ] ACP: Trimmed 34448 records to 22894 (keeping 150 days of data) [2025-09-15T17:01:58.693325] [DEBUG] [LOCAL ] ACP: Primary data saved (22894 records). [2025-09-15T17:01:58.693493] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-15T17:01:58.693621] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACP took 32.0s. Estimated remaining: 3h 0m 16s. Rate: 13.0 symbols/min [2025-09-15T17:01:58.874424] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-15T17:01:58.879385] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:58.880830] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-15T17:01:58.880893] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-15T17:01:58.881048] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-15T17:01:58.881093] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-15T17:01:58.881175] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-15T17:01:58.881259] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-15T17:01:59.281369] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:59.529813] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:01:59.612788] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:01:59.614687] [INFO ] [REMOTE ] ACV: Full fetch complete (7402 records). [2025-09-15T17:01:59.614807] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-15T17:01:59.663005] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-15T17:01:59.996327] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-15T17:01:59.996411] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-15T17:01:59.996597] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-15T17:01:59.996636] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-15T17:01:59.997121] [DEBUG] [LOCAL ] ACV: Trimmed 7402 records to 4587 (keeping 150 days of data) [2025-09-15T17:02:00.039581] [DEBUG] [LOCAL ] ACV: Primary data saved (4587 records). [2025-09-15T17:02:00.039805] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-15T17:02:00.039945] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACV took 20.5s. Estimated remaining: 2h 55m 17s. Rate: 13.4 symbols/min [2025-09-15T17:02:00.238144] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:00.278577] [DEBUG] [LOCAL ] ADC: Loaded 35023 existing records from primary storage. [2025-09-15T17:02:00.278746] [INFO ] [MAIN ] ADC: Loaded 35023 existing records. [2025-09-15T17:02:00.463194] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:00.463293] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-15T17:02:00.464920] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-15T17:02:00.464981] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-15T17:02:00.465965] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-15T17:02:00.466038] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-15T17:02:00.829434] [INFO ] [REMOTE ] ADC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:00.894486] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:02:01.257917] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-15T17:02:02.057877] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-15T17:02:02.213130] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:02:02.304336] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:02:02.857915] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-15T17:02:03.061847] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:03.062200] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-15T17:02:03.254629] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:02:03.657945] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-15T17:02:04.457896] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-15T17:02:04.978304] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:02:05.257911] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-15T17:02:05.813093] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:02:06.057928] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-15T17:02:06.345746] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:02:06.350301] [INFO ] [REMOTE ] ACRE: Full fetch complete (37084 records). [2025-09-15T17:02:06.350472] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-15T17:02:06.351309] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:06.351466] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:06.351539] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:06.351612] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-15T17:02:06.351706] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-15T17:02:06.351752] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-09-15T17:02:06.352020] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-09-15T17:02:06.352126] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACRE took 31.3s. Estimated remaining: 2h 57m 51s. Rate: 13.2 symbols/min [2025-09-15T17:02:06.537050] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:06.564868] [DEBUG] [LOCAL ] ADCT: Loaded 25869 existing records from primary storage. [2025-09-15T17:02:06.565026] [INFO ] [MAIN ] ADCT: Loaded 25869 existing records. [2025-09-15T17:02:06.748929] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:06.749274] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-15T17:02:06.749342] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-15T17:02:06.749882] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-15T17:02:06.749933] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-15T17:02:06.859176] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-15T17:02:07.186696] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:07.657881] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-15T17:02:07.761739] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:02:07.857937] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:07.858215] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-15T17:02:08.339672] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:02:08.457927] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-15T17:02:09.257876] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-15T17:02:10.057882] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-15T17:02:10.085047] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:02:10.090807] [INFO ] [REMOTE ] ACVA: Full fetch complete (53599 records). [2025-09-15T17:02:10.090907] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-15T17:02:10.256781] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:10.288118] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-15T17:02:10.492020] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-15T17:02:10.492114] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-15T17:02:10.492710] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-15T17:02:10.492763] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-15T17:02:10.498450] [DEBUG] [LOCAL ] ACVA: Trimmed 53599 records to 35821 (keeping 150 days of data) [2025-09-15T17:02:10.727026] [DEBUG] [LOCAL ] ACVA: Primary data saved (35821 records). [2025-09-15T17:02:10.727180] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-15T17:02:10.727976] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACVA took 26.3s. Estimated remaining: 2h 57m 31s. Rate: 13.2 symbols/min [2025-09-15T17:02:10.858237] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-15T17:02:10.937391] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:02:10.938997] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:11.001712] [DEBUG] [LOCAL ] ADM: Loaded 40170 existing records from primary storage. [2025-09-15T17:02:11.001883] [INFO ] [MAIN ] ADM: Loaded 40170 existing records. [2025-09-15T17:02:11.180165] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:11.180452] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-15T17:02:11.180502] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-15T17:02:11.181423] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-15T17:02:11.181476] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-15T17:02:11.251404] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:11.287421] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-15T17:02:11.545423] [INFO ] [REMOTE ] ADM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:11.657885] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-15T17:02:12.457869] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-15T17:02:12.662905] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:12.663289] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-15T17:02:13.257893] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-15T17:02:13.397036] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T17:02:14.057880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-15T17:02:14.832717] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:02:14.857845] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-15T17:02:15.058194] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:15.058551] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-15T17:02:15.657919] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-15T17:02:15.772523] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:02:16.457880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-15T17:02:16.892742] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:02:17.257893] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-15T17:02:18.057905] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-15T17:02:18.221501] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:02:18.366695] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T17:02:18.857876] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-15T17:02:19.582962] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:02:19.657866] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-15T17:02:19.979404] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:02:20.457872] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-15T17:02:20.775028] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:02:21.257920] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-15T17:02:21.794595] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:02:22.057926] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-15T17:02:22.769584] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:02:22.857828] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-15T17:02:22.867141] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:02:22.869945] [INFO ] [REMOTE ] AD: Full fetch complete (4768 records). [2025-09-15T17:02:22.870017] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-15T17:02:23.049286] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 24 unique days, need 150 days [2025-09-15T17:02:23.049532] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:23.049591] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:23.049635] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-15T17:02:23.049717] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-15T17:02:23.049755] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-15T17:02:23.049806] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-15T17:02:23.049875] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. AD took 24.4s. Estimated remaining: 3h 7m 54s. Rate: 12.5 symbols/min [2025-09-15T17:02:23.219624] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:23.259749] [DEBUG] [LOCAL ] ADNT: Loaded 35484 existing records from primary storage. [2025-09-15T17:02:23.259899] [INFO ] [MAIN ] ADNT: Loaded 35484 existing records. [2025-09-15T17:02:23.440926] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:23.441199] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-15T17:02:23.441267] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-15T17:02:23.442042] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-15T17:02:23.442094] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-15T17:02:23.666355] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-15T17:02:23.807579] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:24.457879] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-15T17:02:24.735593] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T17:02:24.959144] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:02:24.965140] [INFO ] [REMOTE ] ADC: Full fetch complete (50697 records). [2025-09-15T17:02:24.965257] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-15T17:02:25.263335] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-15T17:02:25.356380] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-15T17:02:25.356472] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-15T17:02:25.357009] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-15T17:02:25.357058] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-15T17:02:25.358535] [DEBUG] [LOCAL ] ADC: Trimmed 50697 records to 34268 (keeping 150 days of data) [2025-09-15T17:02:25.593869] [DEBUG] [LOCAL ] ADC: Primary data saved (34268 records). [2025-09-15T17:02:25.594082] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-15T17:02:25.595229] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 25.6s. Estimated remaining: 3h 4m 52s. Rate: 12.7 symbols/min [2025-09-15T17:02:25.771264] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:25.807611] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:02:25.855518] [DEBUG] [LOCAL ] ADT: Loaded 40255 existing records from primary storage. [2025-09-15T17:02:25.855694] [INFO ] [MAIN ] ADT: Loaded 40255 existing records. [2025-09-15T17:02:26.037716] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:26.038069] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-15T17:02:26.038143] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-15T17:02:26.039042] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-15T17:02:26.039111] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-15T17:02:26.062979] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-15T17:02:26.416202] [INFO ] [REMOTE ] ADT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:26.857940] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-15T17:02:27.225413] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-15T17:02:27.664104] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-15T17:02:27.670338] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:02:28.183126] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:02:28.457905] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-15T17:02:28.969227] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:02:29.257889] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-15T17:02:30.057880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-15T17:02:30.258904] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T17:02:30.565305] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:02:30.857885] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-15T17:02:31.535452] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:02:31.657879] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-15T17:02:32.457924] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-15T17:02:32.607115] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:02:33.257875] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-15T17:02:33.476509] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T17:02:33.557635] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T17:02:33.563897] [INFO ] [REMOTE ] ADM: Full fetch complete (58069 records). [2025-09-15T17:02:33.564057] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-15T17:02:33.965497] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-15T17:02:33.965596] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-15T17:02:33.966190] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-15T17:02:33.966253] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-15T17:02:33.967754] [DEBUG] [LOCAL ] ADM: Trimmed 58069 records to 39393 (keeping 150 days of data) [2025-09-15T17:02:34.068852] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-15T17:02:34.230532] [DEBUG] [LOCAL ] ADM: Primary data saved (39393 records). [2025-09-15T17:02:34.230713] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-15T17:02:34.231499] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADM took 23.5s. Estimated remaining: 3h 9m 41s. Rate: 12.3 symbols/min [2025-09-15T17:02:34.406350] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:34.433666] [DEBUG] [LOCAL ] ADX: Loaded 20648 existing records from primary storage. [2025-09-15T17:02:34.433812] [INFO ] [MAIN ] ADX: Loaded 20648 existing records. [2025-09-15T17:02:34.649432] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:02:34.654147] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:34.666091] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-15T17:02:34.666193] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-15T17:02:34.667027] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-15T17:02:34.667094] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-15T17:02:34.863154] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-15T17:02:35.039899] [INFO ] [REMOTE ] ADX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:35.496492] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:02:35.657897] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-15T17:02:36.347140] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:02:36.457919] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-15T17:02:36.793204] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:02:36.799492] [INFO ] [REMOTE ] ADCT: Full fetch complete (36614 records). [2025-09-15T17:02:36.799737] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-15T17:02:37.188104] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-15T17:02:37.188199] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-15T17:02:37.188615] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-15T17:02:37.188692] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-15T17:02:37.189817] [DEBUG] [LOCAL ] ADCT: Trimmed 36614 records to 25686 (keeping 150 days of data) [2025-09-15T17:02:37.284717] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-15T17:02:37.354524] [DEBUG] [LOCAL ] ADCT: Primary data saved (25686 records). [2025-09-15T17:02:37.354765] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-15T17:02:37.354875] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADCT took 31.0s. Estimated remaining: 3h 7m 28s. Rate: 12.5 symbols/min [2025-09-15T17:02:37.530078] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:37.577222] [DEBUG] [LOCAL ] AEE: Loaded 37637 existing records from primary storage. [2025-09-15T17:02:37.577416] [INFO ] [MAIN ] AEE: Loaded 37637 existing records. [2025-09-15T17:02:37.831164] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:37.831536] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-15T17:02:37.831617] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-15T17:02:37.833177] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-15T17:02:37.833271] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-15T17:02:38.063229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-15T17:02:38.477088] [INFO ] [REMOTE ] AEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:38.481316] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-15T17:02:38.857932] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-15T17:02:38.930151] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:02:38.980289] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:02:39.657887] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-15T17:02:40.464663] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-15T17:02:40.482556] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:02:40.572606] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T17:02:41.257902] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-15T17:02:41.797758] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:02:42.057900] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-15T17:02:42.469581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:02:42.857879] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-15T17:02:43.670617] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-15T17:02:43.676995] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:02:44.313965] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:02:44.457853] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-15T17:02:44.897797] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:02:45.257887] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-15T17:02:45.792344] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:02:45.797108] [INFO ] [REMOTE ] ADNT: Full fetch complete (51160 records). [2025-09-15T17:02:45.797226] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-15T17:02:45.797946] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:45.798029] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:45.798068] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:45.798116] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-15T17:02:45.798203] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-15T17:02:45.798244] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-15T17:02:45.798616] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-15T17:02:45.803090] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADNT took 22.8s. Estimated remaining: 3h 11m 41s. Rate: 12.2 symbols/min [2025-09-15T17:02:45.973861] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:45.987390] [DEBUG] [LOCAL ] AEFC: Loaded 5954 existing records from primary storage. [2025-09-15T17:02:45.987526] [INFO ] [MAIN ] AEFC: Loaded 5954 existing records. [2025-09-15T17:02:46.062962] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-15T17:02:46.166590] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:46.166853] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-15T17:02:46.166936] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-15T17:02:46.167186] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-15T17:02:46.167230] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-15T17:02:46.531482] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:46.857909] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-15T17:02:46.955918] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:02:47.398439] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:02:47.657887] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-15T17:02:47.710797] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:02:48.457883] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-15T17:02:49.262045] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-15T17:02:49.268658] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:02:49.675954] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:02:50.057910] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-15T17:02:50.548592] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:02:50.857888] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-15T17:02:51.547249] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:02:51.657910] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-15T17:02:52.457875] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-15T17:02:52.662118] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T17:02:52.668483] [INFO ] [REMOTE ] ADT: Full fetch complete (58077 records). [2025-09-15T17:02:52.668586] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-15T17:02:53.056128] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-15T17:02:53.056212] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-15T17:02:53.056792] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-15T17:02:53.056837] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-15T17:02:53.058130] [DEBUG] [LOCAL ] ADT: Trimmed 58077 records to 39482 (keeping 150 days of data) [2025-09-15T17:02:53.274504] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-15T17:02:53.286823] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:02:53.321160] [DEBUG] [LOCAL ] ADT: Primary data saved (39482 records). [2025-09-15T17:02:53.321397] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-15T17:02:53.323751] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 27.7s. Estimated remaining: 3h 14m 34s. Rate: 12.0 symbols/min [2025-09-15T17:02:53.520250] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:53.552317] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:02:53.602269] [DEBUG] [LOCAL ] AEG: Loaded 37400 existing records from primary storage. [2025-09-15T17:02:53.602436] [INFO ] [MAIN ] AEG: Loaded 37400 existing records. [2025-09-15T17:02:53.788916] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:53.789185] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-15T17:02:53.789231] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-15T17:02:53.790109] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-15T17:02:53.790172] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-15T17:02:54.063077] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-15T17:02:54.159565] [INFO ] [REMOTE ] AEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:54.608107] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T17:02:54.857918] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-15T17:02:55.354416] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:02:55.657925] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-15T17:02:55.692788] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:02:56.457880] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-15T17:02:56.924511] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:02:57.257899] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-15T17:02:57.347778] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:02:58.057913] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-15T17:02:58.537823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:02:58.543196] [INFO ] [REMOTE ] AEE: Full fetch complete (54606 records). [2025-09-15T17:02:58.543345] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-15T17:02:58.544091] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:58.544177] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:58.544229] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:58.544310] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-15T17:02:58.544389] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-15T17:02:58.544442] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-15T17:02:58.544856] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-15T17:02:58.544984] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEE took 21.2s. Estimated remaining: 3h 14m 44s. Rate: 12.0 symbols/min [2025-09-15T17:02:58.727174] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:58.774290] [DEBUG] [LOCAL ] AEM: Loaded 40246 existing records from primary storage. [2025-09-15T17:02:58.774489] [INFO ] [MAIN ] AEM: Loaded 40246 existing records. [2025-09-15T17:02:58.865803] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-15T17:02:58.973549] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:58.973896] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-15T17:02:58.973961] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-15T17:02:58.975252] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-15T17:02:58.975388] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-15T17:02:59.346080] [INFO ] [REMOTE ] AEM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:59.367633] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:02:59.657884] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-15T17:03:00.113737] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:03:00.457889] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-15T17:03:00.768610] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T17:03:01.257866] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-15T17:03:02.057927] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-15T17:03:02.793099] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T17:03:02.857921] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-15T17:03:03.657940] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-15T17:03:04.397104] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-15T17:03:04.417714] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-15T17:03:04.421586] [INFO ] [REMOTE ] ADX: Full fetch complete (30755 records). [2025-09-15T17:03:04.421794] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-15T17:03:04.467457] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-15T17:03:04.756903] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T17:03:04.819270] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-15T17:03:04.819364] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-15T17:03:04.819797] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-15T17:03:04.819842] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-15T17:03:04.820687] [DEBUG] [LOCAL ] ADX: Trimmed 30755 records to 20404 (keeping 150 days of data) [2025-09-15T17:03:04.949615] [DEBUG] [LOCAL ] ADX: Primary data saved (20404 records). [2025-09-15T17:03:04.949769] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-15T17:03:04.949857] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. ADX took 30.7s. Estimated remaining: 3h 16m 10s. Rate: 11.9 symbols/min [2025-09-15T17:03:05.125932] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:05.167574] [DEBUG] [LOCAL ] AEO: Loaded 40310 existing records from primary storage. [2025-09-15T17:03:05.167749] [INFO ] [MAIN ] AEO: Loaded 40310 existing records. [2025-09-15T17:03:05.265383] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-15T17:03:05.345682] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:05.345928] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-15T17:03:05.345975] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-15T17:03:05.346973] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-15T17:03:05.347026] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-15T17:03:05.733056] [INFO ] [REMOTE ] AEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:05.748558] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T17:03:05.769160] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T17:03:06.057892] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-15T17:03:06.632194] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T17:03:06.857884] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-15T17:03:07.540927] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:03:07.657919] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-15T17:03:08.148624] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:03:08.457877] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-15T17:03:08.543889] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:03:09.257881] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-15T17:03:10.063080] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-15T17:03:10.080632] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:03:10.858050] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-15T17:03:11.174017] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:03:11.352952] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:03:11.446520] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:03:11.447753] [INFO ] [REMOTE ] AEFC: Full fetch complete (9434 records). [2025-09-15T17:03:11.447820] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-15T17:03:11.683221] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-15T17:03:11.880925] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-15T17:03:11.881016] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-15T17:03:11.881215] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-15T17:03:11.881259] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-15T17:03:11.881733] [DEBUG] [LOCAL ] AEFC: Trimmed 9434 records to 5866 (keeping 150 days of data) [2025-09-15T17:03:11.919334] [DEBUG] [LOCAL ] AEFC: Primary data saved (5866 records). [2025-09-15T17:03:11.919489] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-15T17:03:11.919583] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEFC took 26.1s. Estimated remaining: 3h 18m 6s. Rate: 11.8 symbols/min [2025-09-15T17:03:12.457917] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-15T17:03:13.257933] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-15T17:03:15.089556] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-15T17:03:15.110972] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-15T17:03:15.129213] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:03:15.140244] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-15T17:03:15.189394] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-15T17:03:15.657880] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-15T17:03:16.789412] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:03:16.801703] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-15T17:03:16.958565] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T17:03:16.964034] [INFO ] [REMOTE ] AEG: Full fetch complete (53645 records). [2025-09-15T17:03:16.964141] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-15T17:03:17.348290] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-15T17:03:17.348435] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-15T17:03:17.349060] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-15T17:03:17.349111] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-15T17:03:17.350464] [DEBUG] [LOCAL ] AEG: Trimmed 53645 records to 36681 (keeping 150 days of data) [2025-09-15T17:03:17.484981] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:03:17.499806] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-15T17:03:17.621220] [DEBUG] [LOCAL ] AEG: Primary data saved (36681 records). [2025-09-15T17:03:17.621361] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-15T17:03:17.622382] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 24.3s. Estimated remaining: 3h 18m 38s. Rate: 11.7 symbols/min [2025-09-15T17:03:18.456787] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:03:18.469090] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-15T17:03:19.266149] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:03:19.277355] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-15T17:03:20.418219] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T17:03:20.429720] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-15T17:03:21.397886] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:03:21.409813] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-15T17:03:21.875616] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:03:21.882036] [INFO ] [REMOTE ] AEM: Full fetch complete (58134 records). [2025-09-15T17:03:21.882203] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-15T17:03:22.273328] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-15T17:03:22.273441] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-15T17:03:22.274075] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-15T17:03:22.274138] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-15T17:03:22.275915] [DEBUG] [LOCAL ] AEM: Trimmed 58134 records to 39467 (keeping 150 days of data) [2025-09-15T17:03:22.534046] [DEBUG] [LOCAL ] AEM: Primary data saved (39467 records). [2025-09-15T17:03:22.534207] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-15T17:03:22.537173] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEM took 24.0s. Estimated remaining: 3h 18m 21s. Rate: 11.7 symbols/min [2025-09-15T17:03:23.130005] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:03:23.142196] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-15T17:03:24.887070] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T17:03:24.893682] [INFO ] [REMOTE ] AEO: Full fetch complete (58195 records). [2025-09-15T17:03:24.893835] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-15T17:03:25.286824] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-15T17:03:25.286928] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-15T17:03:25.287558] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-15T17:03:25.287607] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-15T17:03:25.289170] [DEBUG] [LOCAL ] AEO: Trimmed 58195 records to 39531 (keeping 150 days of data) [2025-09-15T17:03:25.549613] [DEBUG] [LOCAL ] AEO: Primary data saved (39531 records). [2025-09-15T17:03:25.549817] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-15T17:03:25.552061] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AEO took 20.6s. Estimated remaining: 3h 16m 14s. Rate: 11.9 symbols/min [2025-09-15T17:03:26.298714] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.319257] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.347882] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.345572] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.363092] [DEBUG] [LOCAL ] AFB: Loaded 8175 existing records from primary storage. [2025-09-15T17:03:26.363321] [INFO ] [MAIN ] AFB: Loaded 8175 existing records. [2025-09-15T17:03:26.555486] [DEBUG] [LOCAL ] AER: Loaded 36323 existing records from primary storage. [2025-09-15T17:03:26.585815] [INFO ] [MAIN ] AER: Loaded 36323 existing records. [2025-09-15T17:03:26.660225] [DEBUG] [LOCAL ] AESI: Loaded 37122 existing records from primary storage. [2025-09-15T17:03:26.652390] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:26.697938] [DEBUG] [LOCAL ] AES: Loaded 40415 existing records from primary storage. [2025-09-15T17:03:26.722461] [INFO ] [MAIN ] AES: Loaded 40415 existing records. [2025-09-15T17:03:26.696953] [INFO ] [MAIN ] AESI: Loaded 37122 existing records. [2025-09-15T17:03:26.722851] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-15T17:03:26.733356] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-15T17:03:26.877841] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-15T17:03:26.913844] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-15T17:03:27.202595] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.340413] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.384377] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.384447] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.395054] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-15T17:03:27.395158] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-15T17:03:27.401266] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.406841] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-15T17:03:27.412275] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.428861] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-15T17:03:27.412065] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-15T17:03:27.424599] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-15T17:03:27.429237] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-15T17:03:27.482884] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-15T17:03:27.516736] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-15T17:03:28.199798] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.342185] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-15T17:03:28.631411] [INFO ] [REMOTE ] AER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.663564] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-15T17:03:28.748507] [INFO ] [REMOTE ] AESI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.764434] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-15T17:03:28.819380] [INFO ] [REMOTE ] AES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.819701] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-15T17:03:29.172218] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:03:29.174957] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-15T17:03:29.973917] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:03:29.977365] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-15T17:03:30.292633] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:03:30.304254] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-15T17:03:30.353214] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:03:30.368629] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-15T17:03:30.431705] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:03:30.443941] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-15T17:03:30.844667] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T17:03:30.850404] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-15T17:03:31.309761] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T17:03:31.313500] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-15T17:03:31.527546] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:03:31.542431] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-15T17:03:31.781446] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:03:31.786280] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-15T17:03:31.827603] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:03:31.997736] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:03:32.389626] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T17:03:32.457935] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-15T17:03:33.162866] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:03:33.183121] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:03:33.257853] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-15T17:03:34.057951] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-15T17:03:34.491661] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:03:34.857881] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-15T17:03:35.657878] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-15T17:03:35.988912] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T17:03:36.030839] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T17:03:36.457920] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-15T17:03:37.103510] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:03:37.257901] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-15T17:03:37.959330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:03:37.976143] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:03:37.978106] [INFO ] [REMOTE ] AFB: Full fetch complete (12378 records). [2025-09-15T17:03:37.978201] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-15T17:03:38.062993] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-15T17:03:38.385414] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-15T17:03:38.385513] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-15T17:03:38.386031] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-15T17:03:38.386088] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-15T17:03:38.386769] [DEBUG] [LOCAL ] AFB: Trimmed 12378 records to 7849 (keeping 150 days of data) [2025-09-15T17:03:38.441313] [DEBUG] [LOCAL ] AFB: Primary data saved (7849 records). [2025-09-15T17:03:38.441482] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-15T17:03:38.441613] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AFB took 12.9s. Estimated remaining: 3h 23m 34s. Rate: 11.4 symbols/min [2025-09-15T17:03:38.637491] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:38.663966] [DEBUG] [LOCAL ] AFG: Loaded 23793 existing records from primary storage. [2025-09-15T17:03:38.664119] [INFO ] [MAIN ] AFG: Loaded 23793 existing records. [2025-09-15T17:03:38.860992] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-15T17:03:38.861237] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:38.862697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-15T17:03:38.862771] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-15T17:03:38.863575] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-15T17:03:38.863680] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-15T17:03:39.264556] [INFO ] [REMOTE ] AFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:39.657932] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-15T17:03:39.868240] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:03:40.457886] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-15T17:03:40.529899] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:03:41.257901] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-15T17:03:41.405249] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:03:41.628589] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T17:03:42.057900] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-15T17:03:42.530068] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:03:42.535848] [INFO ] [REMOTE ] AESI: Full fetch complete (53886 records). [2025-09-15T17:03:42.535954] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-15T17:03:42.863111] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-15T17:03:42.937448] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-15T17:03:42.937538] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-15T17:03:42.938173] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-15T17:03:42.938232] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-15T17:03:42.939792] [DEBUG] [LOCAL ] AESI: Trimmed 53886 records to 36439 (keeping 150 days of data) [2025-09-15T17:03:43.185866] [DEBUG] [LOCAL ] AESI: Primary data saved (36439 records). [2025-09-15T17:03:43.186027] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-15T17:03:43.186140] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AESI took 17.6s. Estimated remaining: 3h 23m 1s. Rate: 11.5 symbols/min [2025-09-15T17:03:43.359290] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:43.362894] [DEBUG] [LOCAL ] AFGB: Loaded 1672 existing records from primary storage. [2025-09-15T17:03:43.362973] [INFO ] [MAIN ] AFGB: Loaded 1672 existing records. [2025-09-15T17:03:43.547797] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:43.548247] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-15T17:03:43.548337] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-15T17:03:43.548688] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-15T17:03:43.548745] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-15T17:03:43.658036] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-15T17:03:43.743988] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:03:43.954042] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:44.457903] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-15T17:03:44.560368] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:03:45.257841] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-15T17:03:45.339805] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:03:45.602698] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:03:46.057900] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-15T17:03:46.566107] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:03:46.857846] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-15T17:03:46.934702] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:03:47.657877] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-15T17:03:48.060192] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:03:48.067457] [INFO ] [REMOTE ] AER: Full fetch complete (53135 records). [2025-09-15T17:03:48.067635] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-15T17:03:48.464239] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-15T17:03:48.469591] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-15T17:03:48.469708] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-15T17:03:48.470883] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-15T17:03:48.471073] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-15T17:03:48.472985] [DEBUG] [LOCAL ] AER: Trimmed 53135 records to 35563 (keeping 150 days of data) [2025-09-15T17:03:48.709364] [DEBUG] [LOCAL ] AER: Primary data saved (35563 records). [2025-09-15T17:03:48.709521] [INFO ] [MAIN ] AER: Full history saved. [2025-09-15T17:03:48.709613] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AER took 23.2s. Estimated remaining: 3h 23m 11s. Rate: 11.4 symbols/min [2025-09-15T17:03:48.881033] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:48.884864] [DEBUG] [LOCAL ] AFGC: Loaded 2041 existing records from primary storage. [2025-09-15T17:03:48.884941] [INFO ] [MAIN ] AFGC: Loaded 2041 existing records. [2025-09-15T17:03:49.046141] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:03:49.072454] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:49.073916] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-15T17:03:49.073979] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-15T17:03:49.074178] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-15T17:03:49.074226] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-15T17:03:49.263016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-15T17:03:49.440334] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:49.497128] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:03:50.057879] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-15T17:03:50.307149] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:03:50.588704] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:03:50.857990] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-15T17:03:51.657935] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-15T17:03:52.457912] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-15T17:03:52.671608] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:03:52.864198] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:03:52.864339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:03:53.257885] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-15T17:03:53.838282] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:03:54.057940] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-15T17:03:54.546823] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:03:54.857917] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-15T17:03:55.309279] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:03:55.657908] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-15T17:03:56.457906] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-15T17:03:57.050235] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:03:57.257880] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-15T17:03:57.658428] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T17:03:57.822672] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:03:57.828623] [INFO ] [REMOTE ] AES: Full fetch complete (58353 records). [2025-09-15T17:03:57.828774] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-15T17:03:58.063014] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-15T17:03:58.224262] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-15T17:03:58.224353] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-15T17:03:58.225176] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-15T17:03:58.225240] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-15T17:03:58.226718] [DEBUG] [LOCAL ] AES: Trimmed 58353 records to 39635 (keeping 150 days of data) [2025-09-15T17:03:58.444446] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:03:58.478305] [DEBUG] [LOCAL ] AES: Primary data saved (39635 records). [2025-09-15T17:03:58.478457] [INFO ] [MAIN ] AES: Full history saved. [2025-09-15T17:03:58.478562] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AES took 32.9s. Estimated remaining: 3h 27m 5s. Rate: 11.2 symbols/min [2025-09-15T17:03:58.648093] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:58.651363] [DEBUG] [LOCAL ] AFGD: Loaded 1355 existing records from primary storage. [2025-09-15T17:03:58.651441] [INFO ] [MAIN ] AFGD: Loaded 1355 existing records. [2025-09-15T17:03:58.863439] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-15T17:03:58.868021] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:58.869267] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-15T17:03:58.869316] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-15T17:03:58.869489] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-15T17:03:58.869533] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-15T17:03:59.223248] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:59.427617] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:03:59.657888] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-15T17:04:00.457876] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-15T17:04:00.627467] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:04:01.021498] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T17:04:01.257871] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-15T17:04:01.905361] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:04:02.057919] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-15T17:04:02.857925] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-15T17:04:03.033502] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:04:03.042885] [INFO ] [REMOTE ] AFG: Full fetch complete (35770 records). [2025-09-15T17:04:03.043116] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-15T17:04:03.321693] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T17:04:03.446414] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-15T17:04:03.446501] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-15T17:04:03.446988] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-15T17:04:03.447035] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-15T17:04:03.448055] [DEBUG] [LOCAL ] AFG: Trimmed 35770 records to 23462 (keeping 150 days of data) [2025-09-15T17:04:03.599997] [DEBUG] [LOCAL ] AFG: Primary data saved (23462 records). [2025-09-15T17:04:03.600138] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-15T17:04:03.600250] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AFG took 25.2s. Estimated remaining: 3h 26m 48s. Rate: 11.2 symbols/min [2025-09-15T17:04:03.663124] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-15T17:04:03.771798] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:03.775585] [DEBUG] [LOCAL ] AFGE: Loaded 1893 existing records from primary storage. [2025-09-15T17:04:03.775681] [INFO ] [MAIN ] AFGE: Loaded 1893 existing records. [2025-09-15T17:04:03.952778] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:03.953039] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-15T17:04:03.953134] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-15T17:04:03.953315] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-15T17:04:03.953360] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-15T17:04:04.247444] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T17:04:04.341163] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:04.457883] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-15T17:04:05.006429] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T17:04:05.257909] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-15T17:04:05.572844] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T17:04:06.057877] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-15T17:04:06.483932] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T17:04:06.857914] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-15T17:04:07.497132] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:04:07.498143] [INFO ] [REMOTE ] AFGC: Full fetch complete (2692 records). [2025-09-15T17:04:07.498422] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-15T17:04:07.683429] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-15T17:04:07.879255] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-15T17:04:07.879353] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-15T17:04:07.879480] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-15T17:04:07.879520] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-15T17:04:07.879928] [DEBUG] [LOCAL ] AFGC: Trimmed 2692 records to 2025 (keeping 150 days of data) [2025-09-15T17:04:07.894061] [DEBUG] [LOCAL ] AFGC: Primary data saved (2025 records). [2025-09-15T17:04:07.894175] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-15T17:04:07.894285] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 19.2s. Estimated remaining: 3h 25m 50s. Rate: 11.3 symbols/min [2025-09-15T17:04:08.077620] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:08.140787] [DEBUG] [LOCAL ] AFL: Loaded 39995 existing records from primary storage. [2025-09-15T17:04:08.140964] [INFO ] [MAIN ] AFL: Loaded 39995 existing records. [2025-09-15T17:04:08.245549] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T17:04:08.359928] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:08.360230] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-15T17:04:08.360279] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-15T17:04:08.361494] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-15T17:04:08.361549] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-15T17:04:08.463417] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-15T17:04:08.723951] [INFO ] [REMOTE ] AFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:08.783500] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:04:09.257905] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-15T17:04:09.667348] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T17:04:10.057905] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-15T17:04:10.476686] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:04:10.857874] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-15T17:04:11.283787] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:04:11.657870] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-15T17:04:11.974355] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T17:04:12.457904] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-15T17:04:12.896406] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:04:13.257874] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-15T17:04:13.708962] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:04:14.057878] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-15T17:04:14.582611] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T17:04:14.583560] [INFO ] [REMOTE ] AFGD: Full fetch complete (2025 records). [2025-09-15T17:04:14.583631] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-15T17:04:14.584042] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:04:14.584137] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:04:14.584195] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:04:14.584244] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-15T17:04:14.584315] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-15T17:04:14.584354] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-09-15T17:04:14.584636] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-09-15T17:04:14.584750] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGD took 16.1s. Estimated remaining: 3h 26m 53s. Rate: 11.2 symbols/min [2025-09-15T17:04:14.766249] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:14.812143] [DEBUG] [LOCAL ] AG: Loaded 40385 existing records from primary storage. [2025-09-15T17:04:14.812324] [INFO ] [MAIN ] AG: Loaded 40385 existing records. [2025-09-15T17:04:14.864172] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-15T17:04:14.990906] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:14.991235] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-15T17:04:14.991297] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-15T17:04:14.992200] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-15T17:04:14.992255] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-15T17:04:15.363596] [INFO ] [REMOTE ] AG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:15.366625] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:04:15.657896] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-15T17:04:16.214292] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T17:04:16.215225] [INFO ] [REMOTE ] AFGB: Full fetch complete (2647 records). [2025-09-15T17:04:16.215297] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-15T17:04:16.463000] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-15T17:04:16.591465] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-15T17:04:16.591555] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-15T17:04:16.591676] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-15T17:04:16.591719] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-15T17:04:16.592187] [DEBUG] [LOCAL ] AFGB: Trimmed 2647 records to 1640 (keeping 150 days of data) [2025-09-15T17:04:16.605804] [DEBUG] [LOCAL ] AFGB: Primary data saved (1640 records). [2025-09-15T17:04:16.605889] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-15T17:04:16.605981] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGB took 33.4s. Estimated remaining: 3h 24m 7s. Rate: 11.4 symbols/min [2025-09-15T17:04:16.779921] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:16.833057] [DEBUG] [LOCAL ] AGCO: Loaded 31794 existing records from primary storage. [2025-09-15T17:04:16.833225] [INFO ] [MAIN ] AGCO: Loaded 31794 existing records. [2025-09-15T17:04:17.016812] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:17.017088] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-15T17:04:17.017135] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-15T17:04:17.017966] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-15T17:04:17.018034] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-15T17:04:17.263581] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-15T17:04:17.390953] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:18.057912] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-15T17:04:18.239706] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:04:18.375250] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:04:18.857844] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-15T17:04:18.888194] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:04:19.318885] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T17:04:19.657881] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-15T17:04:20.138759] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:04:20.457890] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-15T17:04:21.257873] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-15T17:04:22.048519] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:04:22.057810] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-15T17:04:22.857896] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-15T17:04:23.113183] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T17:04:23.501664] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:04:23.657901] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-15T17:04:24.315573] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:04:24.457874] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-15T17:04:25.257900] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-15T17:04:25.689895] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T17:04:26.060191] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-15T17:04:26.067852] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:04:26.379562] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:04:26.857919] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-15T17:04:27.657874] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-15T17:04:27.876035] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T17:04:28.151715] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:04:28.152552] [INFO ] [REMOTE ] AFGE: Full fetch complete (2654 records). [2025-09-15T17:04:28.152622] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-15T17:04:28.478058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-15T17:04:28.515452] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-15T17:04:28.515578] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-15T17:04:28.515704] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-15T17:04:28.515763] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-15T17:04:28.516193] [DEBUG] [LOCAL ] AFGE: Trimmed 2654 records to 1879 (keeping 150 days of data) [2025-09-15T17:04:28.528705] [DEBUG] [LOCAL ] AFGE: Primary data saved (1879 records). [2025-09-15T17:04:28.528798] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-15T17:04:28.528875] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGE took 24.9s. Estimated remaining: 3h 29m 16s. Rate: 11.1 symbols/min [2025-09-15T17:04:28.667380] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:04:28.763484] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:28.779416] [DEBUG] [LOCAL ] AGD: Loaded 13696 existing records from primary storage. [2025-09-15T17:04:28.779555] [INFO ] [MAIN ] AGD: Loaded 13696 existing records. [2025-09-15T17:04:28.956573] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:28.956905] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-15T17:04:28.956972] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-15T17:04:28.957552] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-15T17:04:28.957617] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-15T17:04:29.269764] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-15T17:04:29.308326] [INFO ] [REMOTE ] AGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:29.700972] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:04:30.057891] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-15T17:04:30.633484] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:04:30.857854] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-15T17:04:31.040406] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:04:31.657931] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-15T17:04:32.457914] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-15T17:04:32.969612] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T17:04:33.092340] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:04:33.257907] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-15T17:04:33.943397] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:04:34.057985] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-15T17:04:34.857944] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-15T17:04:35.373118] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:04:35.657925] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-15T17:04:35.724230] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:04:36.118569] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:04:36.314230] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:04:36.457974] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-15T17:04:37.257884] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-15T17:04:37.857086] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:04:38.058052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-15T17:04:38.857904] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-15T17:04:39.069996] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T17:04:39.076725] [INFO ] [REMOTE ] AFL: Full fetch complete (57754 records). [2025-09-15T17:04:39.077057] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-15T17:04:39.449143] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:04:39.463962] [INFO ] [REMOTE ] AGCO: Full fetch complete (46547 records). [2025-09-15T17:04:39.485286] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-15T17:04:39.661479] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-15T17:04:39.671976] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-15T17:04:39.661320] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-15T17:04:39.688661] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-15T17:04:39.702798] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-15T17:04:39.702679] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T17:04:39.847186] [DEBUG] [LOCAL ] AFL: Trimmed 57754 records to 39216 (keeping 150 days of data) [2025-09-15T17:04:40.116218] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-15T17:04:40.117229] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-15T17:04:40.118177] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-15T17:04:40.118462] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-15T17:04:40.122543] [DEBUG] [LOCAL ] AGCO: Trimmed 46547 records to 31094 (keeping 150 days of data) [2025-09-15T17:04:40.464542] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-15T17:04:40.471266] [DEBUG] [LOCAL ] AFL: Primary data saved (39216 records). [2025-09-15T17:04:40.471859] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-15T17:04:40.475915] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 32.6s. Estimated remaining: 3h 34m 14s. Rate: 10.8 symbols/min [2025-09-15T17:04:40.652737] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:40.667527] [DEBUG] [LOCAL ] AGCO: Primary data saved (31094 records). [2025-09-15T17:04:40.667712] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-15T17:04:40.670684] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGCO took 24.1s. Estimated remaining: 3h 30m 5s. Rate: 11.0 symbols/min [2025-09-15T17:04:40.863961] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:40.864798] [DEBUG] [LOCAL ] AGI: Loaded 40181 existing records from primary storage. [2025-09-15T17:04:40.865099] [INFO ] [MAIN ] AGI: Loaded 40181 existing records. [2025-09-15T17:04:41.053958] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:41.054267] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-15T17:04:41.054330] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-15T17:04:41.055610] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-15T17:04:41.055697] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-15T17:04:41.188333] [DEBUG] [LOCAL ] AGL: Loaded 39444 existing records from primary storage. [2025-09-15T17:04:41.198688] [INFO ] [MAIN ] AGL: Loaded 39444 existing records. [2025-09-15T17:04:41.552336] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:41.615682] [INFO ] [REMOTE ] AGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:41.622724] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-15T17:04:41.622407] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-15T17:04:41.623963] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:04:41.624020] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-15T17:04:41.630989] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-15T17:04:41.631058] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-15T17:04:41.869081] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-15T17:04:42.037917] [INFO ] [REMOTE ] AGL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:42.057819] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-15T17:04:42.857833] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-15T17:04:42.908604] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:04:43.334198] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:04:43.657886] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-15T17:04:44.457956] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-15T17:04:44.850753] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:04:44.877492] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-15T17:04:44.883478] [INFO ] [REMOTE ] AG: Full fetch complete (58316 records). [2025-09-15T17:04:44.883620] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-15T17:04:45.264911] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-15T17:04:45.268061] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-15T17:04:45.269206] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-15T17:04:45.269834] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-15T17:04:45.269883] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-15T17:04:45.271352] [DEBUG] [LOCAL ] AG: Trimmed 58316 records to 39606 (keeping 150 days of data) [2025-09-15T17:04:45.525591] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:04:45.545339] [DEBUG] [LOCAL ] AG: Primary data saved (39606 records). [2025-09-15T17:04:45.545487] [INFO ] [MAIN ] AG: Full history saved. [2025-09-15T17:04:45.547689] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AG took 31.0s. Estimated remaining: 3h 29m 35s. Rate: 11.1 symbols/min [2025-09-15T17:04:45.717534] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:45.729457] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-15T17:04:45.729594] [INFO ] [MAIN ] AGM: Loaded 8023 existing records. [2025-09-15T17:04:45.907830] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:45.908097] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-15T17:04:45.908143] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-15T17:04:45.908449] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-15T17:04:45.908494] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-15T17:04:46.062205] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-15T17:04:46.273790] [INFO ] [REMOTE ] AGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:46.857935] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-15T17:04:46.937346] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:04:47.442598] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T17:04:47.655608] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:04:47.657807] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-15T17:04:48.330401] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T17:04:48.457904] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-15T17:04:49.257884] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-15T17:04:49.999892] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:04:50.057825] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-15T17:04:50.219698] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:04:50.857893] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-15T17:04:51.349451] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:04:51.657891] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-15T17:04:52.457912] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-15T17:04:52.757005] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:04:53.053495] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:04:53.178961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:04:53.257828] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-15T17:04:54.057885] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-15T17:04:54.477083] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:04:54.857884] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-15T17:04:55.040441] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:04:55.518853] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:04:55.657872] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-15T17:04:56.284931] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:04:56.457868] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-15T17:04:56.941624] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:04:57.257865] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-15T17:04:57.841358] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:04:57.842876] [INFO ] [REMOTE ] AGM: Full fetch complete (10274 records). [2025-09-15T17:04:57.842943] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-15T17:04:58.062988] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-15T17:04:58.198448] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-15T17:04:58.198529] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-15T17:04:58.198748] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-15T17:04:58.198790] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-15T17:04:58.199256] [DEBUG] [LOCAL ] AGM: Trimmed 10274 records to 7961 (keeping 150 days of data) [2025-09-15T17:04:58.250293] [DEBUG] [LOCAL ] AGM: Primary data saved (7961 records). [2025-09-15T17:04:58.250416] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-15T17:04:58.250500] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGM took 12.7s. Estimated remaining: 3h 34m 47s. Rate: 10.8 symbols/min [2025-09-15T17:04:58.424746] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:58.445872] [DEBUG] [LOCAL ] AGO: Loaded 20744 existing records from primary storage. [2025-09-15T17:04:58.446006] [INFO ] [MAIN ] AGO: Loaded 20744 existing records. [2025-09-15T17:04:58.619293] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:58.619595] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-15T17:04:58.619670] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-15T17:04:58.620274] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-15T17:04:58.620324] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-15T17:04:58.867220] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-15T17:04:58.971433] [INFO ] [REMOTE ] AGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:59.516847] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:04:59.523060] [INFO ] [REMOTE ] AGL: Full fetch complete (56914 records). [2025-09-15T17:04:59.523223] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-15T17:04:59.668468] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-15T17:04:59.933170] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-15T17:04:59.934606] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:04:59.934665] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-15T17:04:59.939629] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-15T17:04:59.939846] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-15T17:04:59.941613] [DEBUG] [LOCAL ] AGL: Trimmed 56914 records to 38685 (keeping 150 days of data) [2025-09-15T17:05:00.169890] [DEBUG] [LOCAL ] AGL: Primary data saved (38685 records). [2025-09-15T17:05:00.170055] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-15T17:05:00.170146] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGL took 19.5s. Estimated remaining: 3h 32m 5s. Rate: 10.9 symbols/min [2025-09-15T17:05:00.340534] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:00.364526] [DEBUG] [LOCAL ] AGRO: Loaded 24450 existing records from primary storage. [2025-09-15T17:05:00.364677] [INFO ] [MAIN ] AGRO: Loaded 24450 existing records. [2025-09-15T17:05:00.463214] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-15T17:05:00.547245] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:00.547981] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-15T17:05:00.548038] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-15T17:05:00.548953] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-15T17:05:00.549040] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-15T17:05:00.914358] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:00.915621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:05:01.257941] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-15T17:05:02.057878] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-15T17:05:02.546845] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T17:05:02.575050] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:05:02.857880] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-15T17:05:03.587562] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:05:03.657869] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-15T17:05:03.700116] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:05:03.703332] [INFO ] [REMOTE ] AGD: Full fetch complete (18666 records). [2025-09-15T17:05:03.703664] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-15T17:05:04.099741] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-15T17:05:04.099840] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-15T17:05:04.100132] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-15T17:05:04.100185] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-15T17:05:04.100940] [DEBUG] [LOCAL ] AGD: Trimmed 18666 records to 13602 (keeping 150 days of data) [2025-09-15T17:05:04.191428] [DEBUG] [LOCAL ] AGD: Primary data saved (13602 records). [2025-09-15T17:05:04.191824] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-15T17:05:04.191977] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGD took 35.7s. Estimated remaining: 3h 30m 58s. Rate: 11.0 symbols/min [2025-09-15T17:05:04.378870] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:04.406307] [DEBUG] [LOCAL ] AGX: Loaded 25055 existing records from primary storage. [2025-09-15T17:05:04.406485] [INFO ] [MAIN ] AGX: Loaded 25055 existing records. [2025-09-15T17:05:04.466320] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-15T17:05:04.610046] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:04.610270] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-15T17:05:04.610318] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-15T17:05:04.611013] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-15T17:05:04.611064] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-15T17:05:04.974957] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:05.000926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:05:05.257876] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-15T17:05:05.966492] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:05:06.057884] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-15T17:05:06.147263] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:05:06.857934] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-15T17:05:07.657873] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-15T17:05:08.057863] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T17:05:08.091434] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:05:08.457884] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-15T17:05:09.144548] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:05:09.180266] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:05:09.257876] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-15T17:05:10.057928] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-15T17:05:10.588267] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:05:10.857873] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-15T17:05:11.129554] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:05:11.657923] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-15T17:05:12.397900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:05:12.457849] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-15T17:05:12.652730] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:05:13.257871] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-15T17:05:13.341661] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T17:05:14.057846] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-15T17:05:14.081284] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:05:14.857878] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-15T17:05:14.886400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T17:05:14.889610] [INFO ] [REMOTE ] AGO: Full fetch complete (30363 records). [2025-09-15T17:05:14.889743] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-15T17:05:15.265083] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-15T17:05:15.265191] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-15T17:05:15.265568] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-15T17:05:15.265612] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-15T17:05:15.266426] [DEBUG] [LOCAL ] AGO: Trimmed 30363 records to 20242 (keeping 150 days of data) [2025-09-15T17:05:15.396080] [DEBUG] [LOCAL ] AGO: Primary data saved (20242 records). [2025-09-15T17:05:15.396243] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-15T17:05:15.396359] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 17.1s. Estimated remaining: 3h 34m 49s. Rate: 10.8 symbols/min [2025-09-15T17:05:15.566130] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:15.597708] [DEBUG] [LOCAL ] AHH: Loaded 30344 existing records from primary storage. [2025-09-15T17:05:15.597876] [INFO ] [MAIN ] AHH: Loaded 30344 existing records. [2025-09-15T17:05:15.663251] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-15T17:05:15.775169] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:15.775407] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-15T17:05:15.775452] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-15T17:05:15.776107] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-15T17:05:15.776159] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-15T17:05:16.130764] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:16.150372] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:05:16.457875] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-15T17:05:16.786852] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:05:17.257889] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-15T17:05:18.042731] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:05:18.057820] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-15T17:05:18.150717] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:05:18.857879] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-15T17:05:19.007249] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:05:19.011063] [INFO ] [REMOTE ] AGRO: Full fetch complete (37485 records). [2025-09-15T17:05:19.011193] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-15T17:05:19.399440] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-15T17:05:19.399520] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-15T17:05:19.399951] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-15T17:05:19.400003] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-15T17:05:19.400877] [DEBUG] [LOCAL ] AGRO: Trimmed 37485 records to 23968 (keeping 150 days of data) [2025-09-15T17:05:19.542157] [DEBUG] [LOCAL ] AGRO: Primary data saved (23968 records). [2025-09-15T17:05:19.542296] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-15T17:05:19.542390] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGRO took 19.4s. Estimated remaining: 3h 33m 46s. Rate: 10.8 symbols/min [2025-09-15T17:05:19.663071] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-15T17:05:19.733183] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:19.733373] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-15T17:05:19.733418] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-15T17:05:19.733545] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-15T17:05:19.733583] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-15T17:05:19.733624] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-15T17:05:19.733678] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-15T17:05:20.086269] [INFO ] [REMOTE ] AHL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:20.457930] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-15T17:05:20.459011] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:05:20.467852] [INFO ] [REMOTE ] AGI: Full fetch complete (58059 records). [2025-09-15T17:05:20.467977] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-15T17:05:20.849503] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-15T17:05:20.849586] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-15T17:05:20.850178] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-15T17:05:20.850224] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-15T17:05:20.851497] [DEBUG] [LOCAL ] AGI: Trimmed 58059 records to 39404 (keeping 150 days of data) [2025-09-15T17:05:20.990572] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:05:21.136992] [DEBUG] [LOCAL ] AGI: Primary data saved (39404 records). [2025-09-15T17:05:21.137151] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-15T17:05:21.138498] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AGI took 40.7s. Estimated remaining: 3h 31m 3s. Rate: 11.0 symbols/min [2025-09-15T17:05:21.262940] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-15T17:05:21.308636] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:21.351298] [DEBUG] [LOCAL ] AHR: Loaded 37011 existing records from primary storage. [2025-09-15T17:05:21.351448] [INFO ] [MAIN ] AHR: Loaded 37011 existing records. [2025-09-15T17:05:21.527459] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:21.533003] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:21.533310] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-15T17:05:21.534680] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-15T17:05:21.534741] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-15T17:05:21.535570] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-15T17:05:21.535621] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-15T17:05:21.902512] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:22.015954] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:05:22.057830] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-15T17:05:22.857862] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-15T17:05:23.308038] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:05:23.657884] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-15T17:05:24.449419] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:05:24.458227] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-15T17:05:24.645834] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:24.646146] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-15T17:05:24.874370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:05:25.257914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-15T17:05:26.057930] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-15T17:05:26.538707] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:05:26.857893] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-15T17:05:27.271357] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:05:27.657926] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-15T17:05:28.029066] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:05:28.457927] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-15T17:05:28.783825] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:05:29.257890] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-15T17:05:29.460403] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:29.460744] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-15T17:05:30.057895] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-15T17:05:30.150717] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:05:30.809515] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:05:30.857826] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-15T17:05:31.657877] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-15T17:05:31.787432] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:05:32.457880] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-15T17:05:32.748762] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:05:33.257899] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-15T17:05:33.363962] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:05:34.057907] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-15T17:05:34.731561] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:05:34.857880] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-15T17:05:34.905020] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T17:05:35.657927] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-15T17:05:36.202377] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:05:36.457919] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-15T17:05:36.844617] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:05:37.257899] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-15T17:05:37.884976] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:05:38.057994] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-15T17:05:38.518162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:05:38.524992] [INFO ] [REMOTE ] AHH: Full fetch complete (45199 records). [2025-09-15T17:05:38.525254] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-15T17:05:38.868498] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-15T17:05:39.000166] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-15T17:05:39.000251] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-15T17:05:39.000886] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-15T17:05:39.000941] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-15T17:05:39.002223] [DEBUG] [LOCAL ] AHH: Trimmed 45199 records to 29529 (keeping 150 days of data) [2025-09-15T17:05:39.184983] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:05:39.203145] [DEBUG] [LOCAL ] AHH: Primary data saved (29529 records). [2025-09-15T17:05:39.203279] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-15T17:05:39.204917] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AHH took 23.8s. Estimated remaining: 3h 39m 10s. Rate: 10.5 symbols/min [2025-09-15T17:05:39.373506] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:39.381527] [DEBUG] [LOCAL ] AHT: Loaded 4581 existing records from primary storage. [2025-09-15T17:05:39.381687] [INFO ] [MAIN ] AHT: Loaded 4581 existing records. [2025-09-15T17:05:39.562086] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:39.562428] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-15T17:05:39.562490] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-15T17:05:39.562778] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-15T17:05:39.562847] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-15T17:05:39.667404] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-15T17:05:39.926706] [INFO ] [REMOTE ] AHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:40.106987] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T17:05:40.457869] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-15T17:05:40.704459] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:05:40.709115] [INFO ] [REMOTE ] AHL: Full fetch complete (15664 records). [2025-09-15T17:05:40.709228] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-15T17:05:40.907226] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-15T17:05:40.907685] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:05:40.907745] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:05:40.907796] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-15T17:05:40.907872] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-15T17:05:40.907929] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-15T17:05:40.907984] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-15T17:05:40.908072] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AHL took 21.4s. Estimated remaining: 3h 36m 31s. Rate: 10.7 symbols/min [2025-09-15T17:05:41.099550] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T17:05:41.134705] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:41.178050] [DEBUG] [LOCAL ] AI: Loaded 40507 existing records from primary storage. [2025-09-15T17:05:41.178249] [INFO ] [MAIN ] AI: Loaded 40507 existing records. [2025-09-15T17:05:41.263066] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-15T17:05:41.366375] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:41.366601] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-15T17:05:41.366668] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-15T17:05:41.367618] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-15T17:05:41.367710] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-15T17:05:41.730730] [INFO ] [REMOTE ] AI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:42.057891] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-15T17:05:42.242407] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:05:42.246458] [INFO ] [REMOTE ] AGX: Full fetch complete (36487 records). [2025-09-15T17:05:42.246545] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-15T17:05:42.616016] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-15T17:05:42.616100] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-15T17:05:42.616701] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-15T17:05:42.616753] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-15T17:05:42.617913] [DEBUG] [LOCAL ] AGX: Trimmed 36487 records to 24492 (keeping 150 days of data) [2025-09-15T17:05:42.778126] [DEBUG] [LOCAL ] AGX: Primary data saved (24492 records). [2025-09-15T17:05:42.778263] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-15T17:05:42.778356] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AGX took 38.6s. Estimated remaining: 3h 34m 3s. Rate: 10.8 symbols/min [2025-09-15T17:05:42.863078] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-15T17:05:42.954541] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:42.994525] [DEBUG] [LOCAL ] AIG: Loaded 40230 existing records from primary storage. [2025-09-15T17:05:42.994701] [INFO ] [MAIN ] AIG: Loaded 40230 existing records. [2025-09-15T17:05:43.169659] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:43.169901] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-15T17:05:43.169946] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-15T17:05:43.170848] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-15T17:05:43.170901] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-15T17:05:43.484672] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T17:05:43.541187] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:43.619903] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:05:43.657834] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-15T17:05:44.457910] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-15T17:05:44.701158] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:05:44.707355] [INFO ] [REMOTE ] AHR: Full fetch complete (53653 records). [2025-09-15T17:05:44.707469] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-15T17:05:45.089927] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-15T17:05:45.090010] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-15T17:05:45.090573] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-15T17:05:45.090656] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-15T17:05:45.091882] [DEBUG] [LOCAL ] AHR: Trimmed 53653 records to 36372 (keeping 150 days of data) [2025-09-15T17:05:45.263864] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-15T17:05:45.320794] [DEBUG] [LOCAL ] AHR: Primary data saved (36372 records). [2025-09-15T17:05:45.320928] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-15T17:05:45.321013] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHR took 24.2s. Estimated remaining: 3h 32m 5s. Rate: 10.9 symbols/min [2025-09-15T17:05:45.500555] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:45.500803] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-15T17:05:45.500842] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-15T17:05:45.500968] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-15T17:05:45.501007] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-15T17:05:45.501047] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-15T17:05:45.501080] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-15T17:05:45.861897] [INFO ] [REMOTE ] AII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:46.057880] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-15T17:05:46.256806] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:46.257123] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-15T17:05:46.780703] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:05:46.866230] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-15T17:05:46.887163] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T17:05:47.608612] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:05:47.657882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-15T17:05:48.457886] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-15T17:05:49.257838] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-15T17:05:49.300591] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:05:49.476933] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:49.477301] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-15T17:05:50.057874] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-15T17:05:50.195789] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:05:50.594259] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:05:50.857868] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-15T17:05:51.401775] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:05:51.657871] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-15T17:05:52.270280] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:05:52.457882] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-15T17:05:53.257900] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-15T17:05:53.778937] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:05:53.977859] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:05:54.057868] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-15T17:05:54.857877] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-15T17:05:55.657830] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-15T17:05:55.864380] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:55.865179] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-15T17:05:56.205452] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:05:56.247307] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T17:05:56.457917] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-15T17:05:57.257902] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-15T17:05:57.967073] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:05:57.968514] [INFO ] [REMOTE ] AHT: Full fetch complete (6637 records). [2025-09-15T17:05:57.968582] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-15T17:05:58.067551] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-15T17:05:58.331798] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-15T17:05:58.331878] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-15T17:05:58.332082] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-15T17:05:58.332127] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-15T17:05:58.332556] [DEBUG] [LOCAL ] AHT: Trimmed 6637 records to 4581 (keeping 150 days of data) [2025-09-15T17:05:58.364702] [DEBUG] [LOCAL ] AHT: Primary data saved (4581 records). [2025-09-15T17:05:58.364822] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-15T17:05:58.364930] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHT took 19.2s. Estimated remaining: 3h 36m 35s. Rate: 10.6 symbols/min [2025-09-15T17:05:58.532522] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:58.556603] [DEBUG] [LOCAL ] AIN: Loaded 18249 existing records from primary storage. [2025-09-15T17:05:58.556763] [INFO ] [MAIN ] AIN: Loaded 18249 existing records. [2025-09-15T17:05:58.736034] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:58.736409] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-15T17:05:58.736465] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-15T17:05:58.746914] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-15T17:05:58.761485] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-15T17:05:58.841601] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-15T17:05:58.865055] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-15T17:05:59.148691] [INFO ] [REMOTE ] AIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:59.656769] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:05:59.666525] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-15T17:05:59.869751] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:06:00.457909] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-15T17:06:01.257881] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-15T17:06:02.059144] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-15T17:06:02.062223] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-15T17:06:02.464131] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T17:06:02.857891] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-15T17:06:02.981944] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T17:06:03.657874] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-15T17:06:03.958619] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T17:06:04.457881] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-15T17:06:04.969223] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T17:06:05.004910] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:06:05.257888] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-15T17:06:05.986104] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-15T17:06:06.057882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-15T17:06:06.814359] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:06:06.820370] [INFO ] [REMOTE ] AIG: Full fetch complete (58153 records). [2025-09-15T17:06:06.820508] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-15T17:06:06.863823] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-15T17:06:07.207994] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-15T17:06:07.208100] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-15T17:06:07.208772] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-15T17:06:07.208823] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-15T17:06:07.210123] [DEBUG] [LOCAL ] AIG: Trimmed 58153 records to 39454 (keeping 150 days of data) [2025-09-15T17:06:07.456040] [DEBUG] [LOCAL ] AIG: Primary data saved (39454 records). [2025-09-15T17:06:07.456203] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-15T17:06:07.456804] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AIG took 24.7s. Estimated remaining: 3h 38m 34s. Rate: 10.5 symbols/min [2025-09-15T17:06:07.634835] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:07.644365] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:06:07.654960] [DEBUG] [LOCAL ] AIO: Loaded 9333 existing records from primary storage. [2025-09-15T17:06:07.655137] [INFO ] [MAIN ] AIO: Loaded 9333 existing records. [2025-09-15T17:06:07.666438] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-15T17:06:07.834531] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:07.834777] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-15T17:06:07.834832] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-15T17:06:07.835212] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-15T17:06:07.835259] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-15T17:06:08.193749] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:08.250697] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T17:06:08.463182] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-15T17:06:08.472478] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:06:09.163613] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:06:09.165826] [INFO ] [REMOTE ] AII: Full fetch complete (9454 records). [2025-09-15T17:06:09.165898] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-15T17:06:09.263048] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-15T17:06:09.350982] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-15T17:06:09.351268] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:06:09.351327] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:06:09.351374] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-15T17:06:09.351442] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-15T17:06:09.351480] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-15T17:06:09.351525] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-15T17:06:09.351589] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AII took 24.0s. Estimated remaining: 3h 36m 14s. Rate: 10.7 symbols/min [2025-09-15T17:06:09.527685] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:09.548665] [DEBUG] [LOCAL ] AIR: Loaded 19592 existing records from primary storage. [2025-09-15T17:06:09.548787] [INFO ] [MAIN ] AIR: Loaded 19592 existing records. [2025-09-15T17:06:09.730834] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:09.731123] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-15T17:06:09.731171] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-15T17:06:09.732093] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-15T17:06:09.732146] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-15T17:06:10.060193] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-15T17:06:10.078305] [INFO ] [REMOTE ] AIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:10.106923] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T17:06:10.857892] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-15T17:06:11.234744] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:06:11.657883] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-15T17:06:12.457892] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-15T17:06:12.549524] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:06:13.198100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-15T17:06:13.204118] [INFO ] [REMOTE ] AI: Full fetch complete (58428 records). [2025-09-15T17:06:13.204268] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-15T17:06:13.270258] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-15T17:06:13.600405] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-15T17:06:13.600500] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-15T17:06:13.601197] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-15T17:06:13.601260] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-15T17:06:13.602708] [DEBUG] [LOCAL ] AI: Trimmed 58428 records to 39727 (keeping 150 days of data) [2025-09-15T17:06:13.672418] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:06:13.867936] [DEBUG] [LOCAL ] AI: Primary data saved (39727 records). [2025-09-15T17:06:13.868101] [INFO ] [MAIN ] AI: Full history saved. [2025-09-15T17:06:13.868198] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AI took 33.0s. Estimated remaining: 3h 35m 29s. Rate: 10.7 symbols/min [2025-09-15T17:06:14.039691] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:14.060966] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-15T17:06:14.061565] [DEBUG] [LOCAL ] AIT: Loaded 20843 existing records from primary storage. [2025-09-15T17:06:14.063005] [INFO ] [MAIN ] AIT: Loaded 20843 existing records. [2025-09-15T17:06:14.243117] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:14.243365] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-15T17:06:14.243413] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-15T17:06:14.244453] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-15T17:06:14.244510] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-15T17:06:14.605192] [INFO ] [REMOTE ] AIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:14.622000] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:06:14.857872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-15T17:06:14.996275] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:06:15.657875] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-15T17:06:16.457878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-15T17:06:16.781116] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:06:16.904742] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:06:17.257837] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-15T17:06:17.447477] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:06:18.057872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-15T17:06:18.162323] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:06:18.857878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-15T17:06:18.920460] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:06:19.657879] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-15T17:06:19.716769] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:06:20.457849] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-15T17:06:20.593022] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:06:21.069878] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:06:21.257877] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-15T17:06:22.057870] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-15T17:06:22.660345] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:06:22.721201] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T17:06:22.857853] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-15T17:06:23.657880] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-15T17:06:24.117571] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:06:24.457867] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-15T17:06:24.871169] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:06:25.257879] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-15T17:06:25.513819] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:06:25.516804] [INFO ] [REMOTE ] AIN: Full fetch complete (26035 records). [2025-09-15T17:06:25.516883] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-15T17:06:25.883398] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-15T17:06:25.883483] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-15T17:06:25.883829] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-15T17:06:25.883876] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-15T17:06:25.884753] [DEBUG] [LOCAL ] AIN: Trimmed 26035 records to 17889 (keeping 150 days of data) [2025-09-15T17:06:26.009297] [DEBUG] [LOCAL ] AIN: Primary data saved (17889 records). [2025-09-15T17:06:26.009462] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-15T17:06:26.009551] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIN took 27.6s. Estimated remaining: 3h 39m 8s. Rate: 10.5 symbols/min [2025-09-15T17:06:26.063728] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-15T17:06:26.181920] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:26.209833] [DEBUG] [LOCAL ] AIV: Loaded 30028 existing records from primary storage. [2025-09-15T17:06:26.209975] [INFO ] [MAIN ] AIV: Loaded 30028 existing records. [2025-09-15T17:06:26.388268] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:26.388658] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-15T17:06:26.388742] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-15T17:06:26.389806] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-15T17:06:26.389862] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-15T17:06:26.521628] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:06:26.781769] [INFO ] [REMOTE ] AIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:26.857841] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-15T17:06:27.381375] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:06:27.657904] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-15T17:06:28.463072] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-15T17:06:28.470078] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:06:28.878081] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T17:06:29.047604] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:06:29.049490] [INFO ] [REMOTE ] AIO: Full fetch complete (14710 records). [2025-09-15T17:06:29.049577] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-15T17:06:29.266937] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-15T17:06:29.422403] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-15T17:06:29.422480] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-15T17:06:29.422722] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-15T17:06:29.422763] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-15T17:06:29.423246] [DEBUG] [LOCAL ] AIO: Trimmed 14710 records to 9165 (keeping 150 days of data) [2025-09-15T17:06:29.481241] [DEBUG] [LOCAL ] AIO: Primary data saved (9165 records). [2025-09-15T17:06:29.481405] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-15T17:06:29.481501] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIO took 22.0s. Estimated remaining: 3h 37m 47s. Rate: 10.6 symbols/min [2025-09-15T17:06:29.649258] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:29.672812] [DEBUG] [LOCAL ] AIZ: Loaded 22672 existing records from primary storage. [2025-09-15T17:06:29.672963] [INFO ] [MAIN ] AIZ: Loaded 22672 existing records. [2025-09-15T17:06:29.849838] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:29.850113] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-15T17:06:29.850159] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-15T17:06:29.851173] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-15T17:06:29.851237] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-15T17:06:30.063099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-15T17:06:30.206082] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:30.477762] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T17:06:30.857879] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-15T17:06:31.078313] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:06:31.660366] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-15T17:06:31.664606] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:06:31.669667] [INFO ] [REMOTE ] AIR: Full fetch complete (28611 records). [2025-09-15T17:06:31.669872] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-15T17:06:32.247722] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-15T17:06:32.247822] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-15T17:06:32.248255] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-15T17:06:32.248306] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-15T17:06:32.249493] [DEBUG] [LOCAL ] AIR: Trimmed 28611 records to 19182 (keeping 150 days of data) [2025-09-15T17:06:32.374801] [DEBUG] [LOCAL ] AIR: Primary data saved (19182 records). [2025-09-15T17:06:32.374965] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-15T17:06:32.375060] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 23.0s. Estimated remaining: 3h 36m 8s. Rate: 10.6 symbols/min [2025-09-15T17:06:32.462972] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-15T17:06:32.553712] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:32.558357] [DEBUG] [LOCAL ] AIZN: Loaded 2657 existing records from primary storage. [2025-09-15T17:06:32.558455] [INFO ] [MAIN ] AIZN: Loaded 2657 existing records. [2025-09-15T17:06:32.735456] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:32.735722] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-15T17:06:32.735773] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-15T17:06:32.736002] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-15T17:06:32.736048] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-15T17:06:33.110322] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:33.121225] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:06:33.257867] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-15T17:06:33.846849] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T17:06:34.057875] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-15T17:06:34.857885] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-15T17:06:35.059267] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:06:35.657948] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-15T17:06:35.720762] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:06:35.796226] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:06:36.457882] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-15T17:06:36.608131] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:06:37.257876] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-15T17:06:37.406963] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T17:06:37.835435] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:06:38.057886] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-15T17:06:38.857907] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-15T17:06:39.061753] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:06:39.657879] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-15T17:06:40.338015] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:06:40.457832] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-15T17:06:40.527951] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:06:41.257879] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-15T17:06:41.663532] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:06:41.902740] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:06:42.057924] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-15T17:06:42.857892] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-15T17:06:43.073416] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T17:06:43.076278] [INFO ] [REMOTE ] AIT: Full fetch complete (30534 records). [2025-09-15T17:06:43.076427] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-15T17:06:43.447603] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-15T17:06:43.447705] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-15T17:06:43.448082] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-15T17:06:43.448123] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-15T17:06:43.448965] [DEBUG] [LOCAL ] AIT: Trimmed 30534 records to 20259 (keeping 150 days of data) [2025-09-15T17:06:43.585791] [DEBUG] [LOCAL ] AIT: Primary data saved (20259 records). [2025-09-15T17:06:43.585931] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-15T17:06:43.586019] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 29.7s. Estimated remaining: 3h 39m 5s. Rate: 10.5 symbols/min [2025-09-15T17:06:43.663081] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-15T17:06:43.763819] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:43.764007] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-09-15T17:06:43.764046] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-09-15T17:06:43.764170] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-15T17:06:43.764215] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-15T17:06:43.764256] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-15T17:06:43.764291] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-15T17:06:44.127383] [INFO ] [REMOTE ] AJG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:44.222588] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:06:44.457880] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-15T17:06:45.257920] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-15T17:06:45.537460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:06:45.787144] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:06:46.021075] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:06:46.057899] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-15T17:06:46.857941] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-15T17:06:47.191103] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:06:47.657884] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-15T17:06:48.035817] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:06:48.202754] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T17:06:48.457891] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-15T17:06:49.257890] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-15T17:06:49.607764] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T17:06:50.057888] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-15T17:06:50.858009] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-15T17:06:50.979933] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:06:50.984958] [INFO ] [REMOTE ] AIV: Full fetch complete (43495 records). [2025-09-15T17:06:50.985075] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-15T17:06:51.356357] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-15T17:06:51.356468] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-15T17:06:51.356943] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-15T17:06:51.356989] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-15T17:06:51.358011] [DEBUG] [LOCAL ] AIV: Trimmed 43495 records to 29479 (keeping 150 days of data) [2025-09-15T17:06:51.527092] [DEBUG] [LOCAL ] AIV: Primary data saved (29479 records). [2025-09-15T17:06:51.527326] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-15T17:06:51.527502] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIV took 25.5s. Estimated remaining: 3h 40m 12s. Rate: 10.4 symbols/min [2025-09-15T17:06:51.668716] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-15T17:06:51.700000] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:51.700196] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-15T17:06:51.700234] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-15T17:06:51.700354] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-15T17:06:51.700392] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-15T17:06:51.700437] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-15T17:06:51.700469] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-15T17:06:52.091527] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:52.100690] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:06:52.102450] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T17:06:52.123880] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:06:52.127172] [INFO ] [REMOTE ] AIZ: Full fetch complete (33287 records). [2025-09-15T17:06:52.127256] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-15T17:06:52.467573] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-15T17:06:52.495842] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-15T17:06:52.495922] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-15T17:06:52.496325] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-15T17:06:52.496367] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-15T17:06:52.497124] [DEBUG] [LOCAL ] AIZ: Trimmed 33287 records to 22213 (keeping 150 days of data) [2025-09-15T17:06:52.642535] [DEBUG] [LOCAL ] AIZ: Primary data saved (22213 records). [2025-09-15T17:06:52.642693] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-15T17:06:52.642785] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZ took 23.2s. Estimated remaining: 3h 37m 38s. Rate: 10.6 symbols/min [2025-09-15T17:06:52.812636] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:52.812857] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-09-15T17:06:52.812896] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-09-15T17:06:52.813045] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-15T17:06:52.813085] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-15T17:06:52.813128] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-15T17:06:52.813163] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-15T17:06:53.161889] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:06:53.183269] [INFO ] [REMOTE ] AKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:53.257881] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-15T17:06:54.057901] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-15T17:06:54.519932] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:06:54.609442] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:06:54.857878] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-15T17:06:55.657888] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-15T17:06:56.471137] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-15T17:06:56.474336] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T17:06:56.879594] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:06:57.090435] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:06:57.257911] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-15T17:06:58.057871] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-15T17:06:58.495123] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:06:58.857891] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-15T17:06:59.408919] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:06:59.657848] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-15T17:06:59.991480] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T17:07:00.134393] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:07:00.457870] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-15T17:07:00.894008] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:07:01.257905] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-15T17:07:02.057936] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-15T17:07:02.477180] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:07:02.857918] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-15T17:07:03.116549] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T17:07:03.279579] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:07:03.657864] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-15T17:07:04.167824] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:07:04.457886] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-15T17:07:04.879286] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T17:07:04.880029] [INFO ] [REMOTE ] AKA: Full fetch complete (1771 records). [2025-09-15T17:07:04.880098] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-15T17:07:05.060058] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T17:07:05.060268] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:07:05.060319] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:07:05.060363] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-15T17:07:05.060422] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-15T17:07:05.060468] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-15T17:07:05.060509] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-15T17:07:05.060569] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AKA took 13.5s. Estimated remaining: 3h 41m 4s. Rate: 10.4 symbols/min [2025-09-15T17:07:05.227333] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:05.227525] [DEBUG] [LOCAL ] AL: No existing data file found in primary storage. [2025-09-15T17:07:05.227563] [WARN ] [MAIN ] AL: No existing data found, performing full refresh instead. [2025-09-15T17:07:05.227705] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-15T17:07:05.227746] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-15T17:07:05.227792] [DEBUG] [LOCAL ] AL: No primary data file found to delete. [2025-09-15T17:07:05.227825] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-15T17:07:05.262981] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-15T17:07:05.588383] [INFO ] [REMOTE ] AL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:05.851524] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:07:05.852545] [INFO ] [REMOTE ] AIZN: Full fetch complete (4200 records). [2025-09-15T17:07:05.852614] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-15T17:07:06.062971] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-15T17:07:06.207722] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-15T17:07:06.207803] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-15T17:07:06.207971] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-15T17:07:06.208021] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-15T17:07:06.208384] [DEBUG] [LOCAL ] AIZN: Trimmed 4200 records to 2612 (keeping 150 days of data) [2025-09-15T17:07:06.224994] [DEBUG] [LOCAL ] AIZN: Primary data saved (2612 records). [2025-09-15T17:07:06.225057] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-15T17:07:06.225154] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AIZN took 33.8s. Estimated remaining: 3h 38m 35s. Rate: 10.5 symbols/min [2025-09-15T17:07:06.399617] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:06.451127] [DEBUG] [LOCAL ] ALB: Loaded 40199 existing records from primary storage. [2025-09-15T17:07:06.451292] [INFO ] [MAIN ] ALB: Loaded 40199 existing records. [2025-09-15T17:07:06.629758] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:06.630100] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-15T17:07:06.630149] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-15T17:07:06.631502] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-15T17:07:06.631556] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-15T17:07:06.868974] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-15T17:07:06.987003] [INFO ] [REMOTE ] ALB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:07.657877] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-15T17:07:07.750720] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:07:08.288817] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:07:08.457880] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-15T17:07:08.822164] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:07:09.257876] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-15T17:07:09.787415] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:07:09.792598] [INFO ] [REMOTE ] AJG: Full fetch complete (51487 records). [2025-09-15T17:07:09.792710] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-15T17:07:10.064580] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-15T17:07:10.188545] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-15T17:07:10.188718] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-15T17:07:10.189493] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-15T17:07:10.189558] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-15T17:07:10.191369] [DEBUG] [LOCAL ] AJG: Trimmed 51487 records to 34227 (keeping 150 days of data) [2025-09-15T17:07:10.442141] [DEBUG] [LOCAL ] AJG: Primary data saved (34227 records). [2025-09-15T17:07:10.442378] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-15T17:07:10.442510] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 26.9s. Estimated remaining: 3h 37m 44s. Rate: 10.5 symbols/min [2025-09-15T17:07:10.624885] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:10.667698] [DEBUG] [LOCAL ] ALC: Loaded 38195 existing records from primary storage. [2025-09-15T17:07:10.667941] [INFO ] [MAIN ] ALC: Loaded 38195 existing records. [2025-09-15T17:07:10.855848] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:10.856293] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-15T17:07:10.856468] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-15T17:07:10.857551] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-15T17:07:10.857612] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-15T17:07:10.869062] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-15T17:07:11.054957] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:07:11.270283] [INFO ] [REMOTE ] ALC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:11.657862] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-15T17:07:11.758497] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:07:11.992256] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T17:07:12.457876] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-15T17:07:13.058721] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:07:13.257910] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-15T17:07:13.638046] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:07:14.057883] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-15T17:07:14.402676] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:07:14.857885] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-15T17:07:15.315554] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:07:15.657875] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-15T17:07:16.457901] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-15T17:07:16.538164] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:07:17.257894] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-15T17:07:17.424396] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T17:07:17.773175] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:07:18.057877] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-15T17:07:18.616871] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:07:18.857858] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-15T17:07:19.657833] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-15T17:07:19.757303] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:07:20.060400] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:07:20.457865] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-15T17:07:21.049044] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:07:21.257863] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-15T17:07:22.062946] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-15T17:07:22.086334] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:07:22.611631] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:07:22.857899] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-15T17:07:23.301436] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:07:23.657912] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-15T17:07:23.942833] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:07:23.949688] [INFO ] [REMOTE ] AKR: Full fetch complete (49401 records). [2025-09-15T17:07:23.949901] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-15T17:07:24.388611] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-15T17:07:24.388792] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-15T17:07:24.389729] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-15T17:07:24.389838] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-15T17:07:24.391548] [DEBUG] [LOCAL ] AKR: Trimmed 49401 records to 33836 (keeping 150 days of data) [2025-09-15T17:07:24.458277] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-15T17:07:24.686972] [DEBUG] [LOCAL ] AKR: Primary data saved (33836 records). [2025-09-15T17:07:24.687260] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-15T17:07:24.687402] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 32.0s. Estimated remaining: 3h 41m 56s. Rate: 10.3 symbols/min [2025-09-15T17:07:24.966460] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:25.007679] [DEBUG] [LOCAL ] ALE: Loaded 22557 existing records from primary storage. [2025-09-15T17:07:25.008031] [INFO ] [MAIN ] ALE: Loaded 22557 existing records. [2025-09-15T17:07:25.221225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:07:25.269325] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-15T17:07:25.309990] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:25.312625] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-15T17:07:25.312770] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-15T17:07:25.313492] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-15T17:07:25.313554] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-15T17:07:25.723793] [INFO ] [REMOTE ] ALE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:26.057928] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-15T17:07:26.355993] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T17:07:26.539686] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:07:26.857986] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-15T17:07:27.411015] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:07:27.657896] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-15T17:07:28.457886] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-15T17:07:28.690883] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:07:28.899020] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:07:28.904942] [INFO ] [REMOTE ] ALC: Full fetch complete (55364 records). [2025-09-15T17:07:28.905043] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-15T17:07:29.281106] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-15T17:07:29.300498] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-15T17:07:29.300568] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-15T17:07:29.301189] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-15T17:07:29.301238] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-15T17:07:29.302701] [DEBUG] [LOCAL ] ALC: Trimmed 55364 records to 37480 (keeping 150 days of data) [2025-09-15T17:07:29.434365] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:07:29.561222] [DEBUG] [LOCAL ] ALC: Primary data saved (37480 records). [2025-09-15T17:07:29.561404] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-15T17:07:29.561531] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. ALC took 19.1s. Estimated remaining: 3h 41m 22s. Rate: 10.4 symbols/min [2025-09-15T17:07:30.057873] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-15T17:07:30.417498] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:07:30.857937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-15T17:07:31.578473] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:07:31.657875] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-15T17:07:32.107978] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T17:07:32.457940] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-15T17:07:33.160371] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:07:33.166617] [INFO ] [REMOTE ] AL: Full fetch complete (47533 records). [2025-09-15T17:07:33.166820] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-15T17:07:33.268850] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-15T17:07:33.601071] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-15T17:07:33.601179] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-15T17:07:33.601745] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-15T17:07:33.601792] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-15T17:07:33.603126] [DEBUG] [LOCAL ] AL: Trimmed 47533 records to 32168 (keeping 150 days of data) [2025-09-15T17:07:33.802944] [DEBUG] [LOCAL ] AL: Primary data saved (32168 records). [2025-09-15T17:07:33.803107] [INFO ] [MAIN ] AL: Full history saved. [2025-09-15T17:07:33.803189] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. AL took 28.7s. Estimated remaining: 3h 40m 31s. Rate: 10.4 symbols/min [2025-09-15T17:07:34.452103] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T17:07:34.457966] [INFO ] [REMOTE ] ALB: Full fetch complete (57873 records). [2025-09-15T17:07:34.458091] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-15T17:07:34.840173] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-15T17:07:34.840301] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-15T17:07:34.841028] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-15T17:07:34.841085] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-15T17:07:34.858948] [DEBUG] [LOCAL ] ALB: Trimmed 57873 records to 39419 (keeping 150 days of data) [2025-09-15T17:07:34.859701] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:07:34.867136] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-15T17:07:35.132494] [DEBUG] [LOCAL ] ALB: Primary data saved (39419 records). [2025-09-15T17:07:35.132775] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-15T17:07:35.134741] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALB took 28.9s. Estimated remaining: 3h 38m 16s. Rate: 10.5 symbols/min [2025-09-15T17:07:35.620693] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:07:35.626863] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-15T17:07:36.376152] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:07:36.381833] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-15T17:07:37.749129] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:07:37.757170] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-15T17:07:39.160048] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:07:39.171244] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-15T17:07:40.496285] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:07:40.500251] [INFO ] [REMOTE ] ALE: Full fetch complete (31892 records). [2025-09-15T17:07:40.500375] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-15T17:07:40.870472] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-15T17:07:40.870555] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-15T17:07:40.870978] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-15T17:07:40.871024] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-15T17:07:40.871787] [DEBUG] [LOCAL ] ALE: Trimmed 31892 records to 22355 (keeping 150 days of data) [2025-09-15T17:07:41.010317] [DEBUG] [LOCAL ] ALE: Primary data saved (22355 records). [2025-09-15T17:07:41.010454] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-15T17:07:41.010546] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 16.3s. Estimated remaining: 3h 38m 15s. Rate: 10.5 symbols/min [2025-09-15T17:07:41.550892] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.600344] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.683904] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.717066] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.730380] [DEBUG] [LOCAL ] ALG: Loaded 7527 existing records from primary storage. [2025-09-15T17:07:41.730685] [INFO ] [MAIN ] ALG: Loaded 7527 existing records. [2025-09-15T17:07:41.790343] [DEBUG] [LOCAL ] ALEX: Loaded 22143 existing records from primary storage. [2025-09-15T17:07:41.817631] [INFO ] [MAIN ] ALEX: Loaded 22143 existing records. [2025-09-15T17:07:42.071828] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.099378] [DEBUG] [LOCAL ] ALK: Loaded 39879 existing records from primary storage. [2025-09-15T17:07:42.114818] [DEBUG] [LOCAL ] ALIT: Loaded 39630 existing records from primary storage. [2025-09-15T17:07:42.115179] [INFO ] [MAIN ] ALIT: Loaded 39630 existing records. [2025-09-15T17:07:42.114977] [INFO ] [MAIN ] ALK: Loaded 39879 existing records. [2025-09-15T17:07:42.115099] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.227322] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.237670] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-15T17:07:42.273288] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-15T17:07:42.292107] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-15T17:07:42.312705] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.336284] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-15T17:07:42.384054] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-15T17:07:42.518135] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-15T17:07:42.518043] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.620101] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.656112] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.650923] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-15T17:07:42.689014] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-15T17:07:42.688977] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.704441] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-15T17:07:42.719817] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-15T17:07:42.807805] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-15T17:07:42.833062] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-15T17:07:43.360786] [INFO ] [REMOTE ] ALG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.405532] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-15T17:07:43.686636] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.728701] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-15T17:07:43.911563] [INFO ] [REMOTE ] ALK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.929087] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-15T17:07:43.932719] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.933695] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-15T17:07:44.105220] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T17:07:44.107951] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-15T17:07:44.600735] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T17:07:44.605889] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-15T17:07:45.101309] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:07:45.104749] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-15T17:07:45.585968] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:07:45.596030] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-15T17:07:45.632925] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:07:45.643832] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-15T17:07:45.673890] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:07:45.682634] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-15T17:07:45.692696] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:07:46.057897] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-15T17:07:46.600489] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:07:46.815909] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:07:46.857819] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-15T17:07:47.247017] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:07:47.291069] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:07:47.596398] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T17:07:47.657830] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-15T17:07:48.457918] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-15T17:07:48.973107] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:07:49.257933] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-15T17:07:49.530538] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:07:50.057871] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-15T17:07:50.575971] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:07:50.608761] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:07:50.857916] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-15T17:07:51.657937] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-15T17:07:52.249389] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T17:07:52.389428] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T17:07:52.457859] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-15T17:07:53.257892] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-15T17:07:53.818909] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:07:54.057887] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-15T17:07:54.808836] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:07:54.857845] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-15T17:07:55.661613] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-15T17:07:55.668188] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:07:56.103144] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:07:56.374633] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:07:56.457881] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-15T17:07:57.257877] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-15T17:07:57.713385] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:07:58.057934] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-15T17:07:58.866848] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-15T17:07:58.869213] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T17:07:58.958677] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:07:59.565340] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:07:59.566779] [INFO ] [REMOTE ] ALG: Full fetch complete (11795 records). [2025-09-15T17:07:59.566849] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-15T17:07:59.665356] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-15T17:07:59.939240] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-15T17:07:59.939351] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-15T17:07:59.939849] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-15T17:07:59.939903] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-15T17:07:59.941037] [DEBUG] [LOCAL ] ALG: Trimmed 11795 records to 7302 (keeping 150 days of data) [2025-09-15T17:08:00.006814] [DEBUG] [LOCAL ] ALG: Primary data saved (7302 records). [2025-09-15T17:08:00.007047] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-15T17:08:00.007218] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALG took 19.0s. Estimated remaining: 3h 44m 25s. Rate: 10.2 symbols/min [2025-09-15T17:08:00.184429] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:00.233892] [DEBUG] [LOCAL ] ALL: Loaded 37481 existing records from primary storage. [2025-09-15T17:08:00.234096] [INFO ] [MAIN ] ALL: Loaded 37481 existing records. [2025-09-15T17:08:00.419247] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:00.419586] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-15T17:08:00.419637] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-15T17:08:00.420776] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-15T17:08:00.420839] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-15T17:08:00.463866] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-15T17:08:00.795503] [INFO ] [REMOTE ] ALL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:01.257942] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-15T17:08:01.295177] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:08:01.302792] [INFO ] [REMOTE ] ALIT: Full fetch complete (57361 records). [2025-09-15T17:08:01.302989] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-15T17:08:01.695745] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-15T17:08:01.695882] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-15T17:08:01.696840] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-15T17:08:01.696920] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-15T17:08:01.699289] [DEBUG] [LOCAL ] ALIT: Trimmed 57361 records to 38839 (keeping 150 days of data) [2025-09-15T17:08:01.818496] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:08:01.825875] [INFO ] [REMOTE ] ALEX: Full fetch complete (33576 records). [2025-09-15T17:08:01.826633] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-15T17:08:02.066221] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-15T17:08:02.262376] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-15T17:08:02.263044] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-15T17:08:02.264108] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-15T17:08:02.264209] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-15T17:08:02.269134] [DEBUG] [LOCAL ] ALEX: Trimmed 33576 records to 21778 (keeping 150 days of data) [2025-09-15T17:08:02.540468] [DEBUG] [LOCAL ] ALEX: Primary data saved (21778 records). [2025-09-15T17:08:02.541468] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-15T17:08:02.542155] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALEX took 21.5s. Estimated remaining: 3h 42m 45s. Rate: 10.3 symbols/min [2025-09-15T17:08:02.747909] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:02.786529] [DEBUG] [LOCAL ] ALIT: Primary data saved (38839 records). [2025-09-15T17:08:02.787254] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-15T17:08:02.789247] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALIT took 21.8s. Estimated remaining: 3h 40m 5s. Rate: 10.4 symbols/min [2025-09-15T17:08:02.790818] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:08:02.868062] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-15T17:08:03.005826] [DEBUG] [LOCAL ] ALLE: Loaded 33449 existing records from primary storage. [2025-09-15T17:08:03.004153] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:03.006679] [INFO ] [MAIN ] ALLE: Loaded 33449 existing records. [2025-09-15T17:08:03.217000] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:03.217366] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-15T17:08:03.217416] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-15T17:08:03.218303] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-15T17:08:03.218359] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-15T17:08:03.365238] [DEBUG] [LOCAL ] ALLY: Loaded 40000 existing records from primary storage. [2025-09-15T17:08:03.400934] [INFO ] [MAIN ] ALLY: Loaded 40000 existing records. [2025-09-15T17:08:03.806418] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:03.807624] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-15T17:08:03.807349] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:03.808909] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-15T17:08:03.808975] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-15T17:08:03.810057] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-15T17:08:03.810132] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-15T17:08:04.192234] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:04.228848] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-15T17:08:04.375810] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:08:04.457868] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-15T17:08:05.111535] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:08:05.257882] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-15T17:08:06.057889] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-15T17:08:06.235687] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:08:06.857895] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-15T17:08:07.010843] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:08:07.518479] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:08:07.657912] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-15T17:08:08.457891] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-15T17:08:08.487135] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:08:08.832383] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:08:08.838621] [INFO ] [REMOTE ] ALK: Full fetch complete (57648 records). [2025-09-15T17:08:08.838778] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-15T17:08:09.224461] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-15T17:08:09.224545] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-15T17:08:09.225221] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-15T17:08:09.225278] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-15T17:08:09.226797] [DEBUG] [LOCAL ] ALK: Trimmed 57648 records to 39100 (keeping 150 days of data) [2025-09-15T17:08:09.286806] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-15T17:08:09.490163] [DEBUG] [LOCAL ] ALK: Primary data saved (39100 records). [2025-09-15T17:08:09.490409] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-15T17:08:09.490542] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALK took 28.5s. Estimated remaining: 3h 40m 25s. Rate: 10.4 symbols/min [2025-09-15T17:08:09.686290] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:09.723540] [DEBUG] [LOCAL ] ALSN: Loaded 32125 existing records from primary storage. [2025-09-15T17:08:09.723809] [INFO ] [MAIN ] ALSN: Loaded 32125 existing records. [2025-09-15T17:08:09.908014] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:09.908370] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-15T17:08:09.908469] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-15T17:08:09.909407] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-15T17:08:09.909460] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-15T17:08:10.063095] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-15T17:08:10.289263] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:10.361589] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:08:10.857868] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-15T17:08:11.178458] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:08:11.642722] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:08:11.657810] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-15T17:08:11.944110] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T17:08:12.457904] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-15T17:08:12.955520] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:08:13.257889] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-15T17:08:14.057896] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-15T17:08:14.100303] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:08:14.576304] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:08:14.857877] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-15T17:08:15.468749] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:08:15.657894] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-15T17:08:16.441475] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:08:16.457838] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-15T17:08:16.822730] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T17:08:17.257944] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-15T17:08:17.802231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:08:17.810254] [INFO ] [REMOTE ] ALL: Full fetch complete (54490 records). [2025-09-15T17:08:17.810430] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-15T17:08:18.066910] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-15T17:08:18.243244] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-15T17:08:18.243346] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-15T17:08:18.244051] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-15T17:08:18.244112] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-15T17:08:18.245431] [DEBUG] [LOCAL ] ALL: Trimmed 54490 records to 36718 (keeping 150 days of data) [2025-09-15T17:08:18.493290] [DEBUG] [LOCAL ] ALL: Primary data saved (36718 records). [2025-09-15T17:08:18.493445] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-15T17:08:18.494318] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALL took 18.5s. Estimated remaining: 3h 41m 45s. Rate: 10.3 symbols/min [2025-09-15T17:08:18.668924] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:18.688066] [DEBUG] [LOCAL ] ALTG: Loaded 17492 existing records from primary storage. [2025-09-15T17:08:18.688208] [INFO ] [MAIN ] ALTG: Loaded 17492 existing records. [2025-09-15T17:08:18.864304] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-15T17:08:18.869167] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:18.870558] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-15T17:08:18.870677] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-15T17:08:18.881889] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-15T17:08:18.901059] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-15T17:08:18.961267] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:08:19.272423] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:19.626698] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T17:08:19.657874] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-15T17:08:20.093699] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:08:20.457890] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-15T17:08:21.082595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:08:21.144077] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:08:21.257851] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-15T17:08:22.057859] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-15T17:08:22.188138] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:08:22.857888] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-15T17:08:23.532765] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:08:23.657915] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-15T17:08:23.907725] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:08:24.445050] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:08:24.457819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-15T17:08:25.137621] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T17:08:25.257940] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-15T17:08:26.057907] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-15T17:08:26.515135] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:08:26.848254] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:08:26.857819] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-15T17:08:27.657910] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-15T17:08:28.458473] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:08:28.458570] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-15T17:08:28.990279] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:08:28.996231] [INFO ] [REMOTE ] ALLE: Full fetch complete (49500 records). [2025-09-15T17:08:28.996557] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-15T17:08:29.262996] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-15T17:08:29.416019] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-15T17:08:29.416229] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-15T17:08:29.416865] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-15T17:08:29.416933] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-15T17:08:29.438714] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:08:29.438939] [DEBUG] [LOCAL ] ALLE: Trimmed 49500 records to 32812 (keeping 150 days of data) [2025-09-15T17:08:29.664093] [DEBUG] [LOCAL ] ALLE: Primary data saved (32812 records). [2025-09-15T17:08:29.664261] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-15T17:08:29.664360] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLE took 27.1s. Estimated remaining: 3h 44m 1s. Rate: 10.2 symbols/min [2025-09-15T17:08:29.839113] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:29.848964] [DEBUG] [LOCAL ] ALUR: Loaded 7481 existing records from primary storage. [2025-09-15T17:08:29.849113] [INFO ] [MAIN ] ALUR: Loaded 7481 existing records. [2025-09-15T17:08:30.031168] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:30.031478] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-15T17:08:30.031524] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-15T17:08:30.031923] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-15T17:08:30.031971] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-15T17:08:30.063082] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-15T17:08:30.388032] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:30.789166] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:08:30.857902] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-15T17:08:31.657848] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-15T17:08:31.754900] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:08:32.370670] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:08:32.457836] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-15T17:08:32.615689] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:08:33.257929] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-15T17:08:33.652625] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T17:08:33.657910] [INFO ] [REMOTE ] ALSN: Full fetch complete (47488 records). [2025-09-15T17:08:33.658047] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-15T17:08:34.032890] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-15T17:08:34.032978] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-15T17:08:34.033492] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-15T17:08:34.033539] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-15T17:08:34.034563] [DEBUG] [LOCAL ] ALSN: Trimmed 47488 records to 31418 (keeping 150 days of data) [2025-09-15T17:08:34.093556] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-15T17:08:34.240329] [DEBUG] [LOCAL ] ALSN: Primary data saved (31418 records). [2025-09-15T17:08:34.240510] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-15T17:08:34.244342] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALSN took 24.8s. Estimated remaining: 3h 43m 21s. Rate: 10.2 symbols/min [2025-09-15T17:08:34.431821] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:34.468864] [DEBUG] [LOCAL ] ALV: Loaded 31582 existing records from primary storage. [2025-09-15T17:08:34.469057] [INFO ] [MAIN ] ALV: Loaded 31582 existing records. [2025-09-15T17:08:34.649376] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:34.649767] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-15T17:08:34.649902] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-15T17:08:34.650826] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-15T17:08:34.650880] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-15T17:08:34.859377] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-15T17:08:34.974707] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:08:35.070018] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:35.102611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:08:35.105624] [INFO ] [REMOTE ] ALTG: Full fetch complete (25913 records). [2025-09-15T17:08:35.105758] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-15T17:08:35.106224] [FATAL] [VALIDATOR ] ALTG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:08:35.106302] [FATAL] [MAIN ] ALTG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:08:35.106338] [WARN ] [MAIN ] ALTG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:08:35.106383] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-15T17:08:35.106442] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-09-15T17:08:35.106483] [INFO ] [LOCAL ] ALTG: Starting deletion of derivative data. [2025-09-15T17:08:35.106869] [DEBUG] [LOCAL ] ALTG: Deleted derivative data file. [2025-09-15T17:08:35.106953] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALTG took 16.6s. Estimated remaining: 3h 41m 5s. Rate: 10.3 symbols/min [2025-09-15T17:08:35.282774] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:35.289576] [DEBUG] [LOCAL ] ALX: Loaded 5134 existing records from primary storage. [2025-09-15T17:08:35.289690] [INFO ] [MAIN ] ALX: Loaded 5134 existing records. [2025-09-15T17:08:35.465658] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:35.465929] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-15T17:08:35.465976] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-15T17:08:35.466301] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-15T17:08:35.466349] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-15T17:08:35.663075] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-15T17:08:35.818711] [INFO ] [REMOTE ] ALX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:35.975633] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:08:36.457894] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-15T17:08:36.933249] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:08:37.040982] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:08:37.257874] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-15T17:08:38.057897] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-15T17:08:38.547570] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:08:38.626887] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:08:38.632624] [INFO ] [REMOTE ] ALLY: Full fetch complete (57840 records). [2025-09-15T17:08:38.632750] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-15T17:08:38.862988] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-15T17:08:39.022800] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-15T17:08:39.022887] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-15T17:08:39.023508] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-15T17:08:39.023550] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-15T17:08:39.024809] [DEBUG] [LOCAL ] ALLY: Trimmed 57840 records to 39217 (keeping 150 days of data) [2025-09-15T17:08:39.270563] [DEBUG] [LOCAL ] ALLY: Primary data saved (39217 records). [2025-09-15T17:08:39.270738] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-15T17:08:39.273084] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 36.5s. Estimated remaining: 3h 40m 17s. Rate: 10.4 symbols/min [2025-09-15T17:08:39.450455] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:39.494928] [DEBUG] [LOCAL ] AM: Loaded 39021 existing records from primary storage. [2025-09-15T17:08:39.495111] [INFO ] [MAIN ] AM: Loaded 39021 existing records. [2025-09-15T17:08:39.666145] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-15T17:08:39.671455] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:39.671718] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-15T17:08:39.671775] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-15T17:08:39.672813] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-15T17:08:39.672865] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-15T17:08:39.972636] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:08:40.040925] [INFO ] [REMOTE ] AM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:40.217835] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:08:40.457920] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-15T17:08:41.029536] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:08:41.257904] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-15T17:08:42.057863] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-15T17:08:42.336694] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:08:42.633979] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:08:42.857870] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-15T17:08:43.657951] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-15T17:08:44.422758] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:08:44.457866] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-15T17:08:44.542528] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:08:45.257883] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-15T17:08:45.912878] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:08:46.057847] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-15T17:08:46.273613] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:08:46.857873] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-15T17:08:47.550565] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:08:47.657902] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-15T17:08:47.885352] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T17:08:48.457885] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-15T17:08:49.195471] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:08:49.257855] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-15T17:08:49.295513] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:08:50.057933] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-15T17:08:50.671419] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:08:50.749931] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T17:08:50.857863] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-15T17:08:51.657940] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-15T17:08:52.377832] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:08:52.457888] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-15T17:08:53.017429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:08:53.062135] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T17:08:53.063545] [INFO ] [REMOTE ] ALX: Full fetch complete (5893 records). [2025-09-15T17:08:53.063615] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-15T17:08:53.263029] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-15T17:08:53.445375] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-15T17:08:53.445474] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-15T17:08:53.445720] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-15T17:08:53.445767] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-15T17:08:53.446347] [DEBUG] [LOCAL ] ALX: Trimmed 5893 records to 5174 (keeping 150 days of data) [2025-09-15T17:08:53.480150] [DEBUG] [LOCAL ] ALX: Primary data saved (5174 records). [2025-09-15T17:08:53.480285] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-15T17:08:53.480377] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALX took 18.4s. Estimated remaining: 3h 43m 44s. Rate: 10.2 symbols/min [2025-09-15T17:08:53.648708] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:53.675601] [DEBUG] [LOCAL ] AMBC: Loaded 27132 existing records from primary storage. [2025-09-15T17:08:53.675792] [INFO ] [MAIN ] AMBC: Loaded 27132 existing records. [2025-09-15T17:08:53.855386] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:53.855685] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-15T17:08:53.855743] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-15T17:08:53.856442] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-15T17:08:53.856491] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-15T17:08:54.017523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T17:08:54.067139] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-15T17:08:54.222171] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:54.857876] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-15T17:08:55.528904] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:08:55.657830] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-15T17:08:55.677467] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:08:56.457885] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-15T17:08:57.119359] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:08:57.257896] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-15T17:08:57.548003] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:08:58.057874] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-15T17:08:58.852107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:08:58.862043] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-15T17:08:59.181959] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:08:59.615957] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:08:59.617187] [INFO ] [REMOTE ] ALUR: Full fetch complete (13202 records). [2025-09-15T17:08:59.617298] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-15T17:08:59.663109] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-15T17:08:59.973834] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-15T17:08:59.973919] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-15T17:08:59.974165] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-15T17:08:59.974205] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-15T17:08:59.974804] [DEBUG] [LOCAL ] ALUR: Trimmed 13202 records to 7335 (keeping 150 days of data) [2025-09-15T17:09:00.019272] [DEBUG] [LOCAL ] ALUR: Primary data saved (7335 records). [2025-09-15T17:09:00.019437] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-15T17:09:00.019525] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 30.4s. Estimated remaining: 3h 43m 55s. Rate: 10.2 symbols/min [2025-09-15T17:09:00.190552] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:00.224851] [DEBUG] [LOCAL ] AMBP: Loaded 34048 existing records from primary storage. [2025-09-15T17:09:00.224997] [INFO ] [MAIN ] AMBP: Loaded 34048 existing records. [2025-09-15T17:09:00.403683] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:00.403988] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-15T17:09:00.404042] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-15T17:09:00.405107] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-15T17:09:00.405169] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-15T17:09:00.467055] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-15T17:09:00.759462] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:01.257914] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-15T17:09:01.422064] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T17:09:01.969825] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:09:02.057894] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-15T17:09:02.857876] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-15T17:09:03.657894] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-15T17:09:03.771001] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T17:09:04.457886] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-15T17:09:04.827416] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-15T17:09:05.257993] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-15T17:09:05.737004] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T17:09:06.057999] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-15T17:09:06.105497] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-09-15T17:09:06.112346] [INFO ] [REMOTE ] ALV: Full fetch complete (46880 records). [2025-09-15T17:09:06.112555] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-15T17:09:06.515139] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-15T17:09:06.515414] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-15T17:09:06.516192] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-15T17:09:06.516363] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-15T17:09:06.540677] [DEBUG] [LOCAL ] ALV: Trimmed 46880 records to 30747 (keeping 150 days of data) [2025-09-15T17:09:06.542579] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:09:06.680351] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:09:06.793903] [DEBUG] [LOCAL ] ALV: Primary data saved (30747 records). [2025-09-15T17:09:06.794063] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-15T17:09:06.794869] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALV took 32.6s. Estimated remaining: 3h 44m 11s. Rate: 10.2 symbols/min [2025-09-15T17:09:06.862976] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-15T17:09:06.971562] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:06.971768] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-15T17:09:06.971808] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-15T17:09:06.971933] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-15T17:09:06.971974] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-15T17:09:06.972017] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-15T17:09:06.972052] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-15T17:09:07.340838] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:07.657946] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-15T17:09:07.696245] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:09:07.702567] [INFO ] [REMOTE ] AM: Full fetch complete (56829 records). [2025-09-15T17:09:07.702743] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-15T17:09:08.100169] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-15T17:09:08.100278] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-15T17:09:08.100888] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-15T17:09:08.100934] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-15T17:09:08.102345] [DEBUG] [LOCAL ] AM: Trimmed 56829 records to 38259 (keeping 150 days of data) [2025-09-15T17:09:08.335557] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:09:08.371396] [DEBUG] [LOCAL ] AM: Primary data saved (38259 records). [2025-09-15T17:09:08.371558] [INFO ] [MAIN ] AM: Full history saved. [2025-09-15T17:09:08.371676] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. AM took 29.1s. Estimated remaining: 3h 42m 19s. Rate: 10.2 symbols/min [2025-09-15T17:09:08.467696] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-15T17:09:08.542726] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:08.584356] [DEBUG] [LOCAL ] AMC: Loaded 40510 existing records from primary storage. [2025-09-15T17:09:08.584527] [INFO ] [MAIN ] AMC: Loaded 40510 existing records. [2025-09-15T17:09:08.707610] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:08.746854] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-15T17:09:08.766871] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:08.767107] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-15T17:09:08.767153] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-15T17:09:08.768613] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-15T17:09:08.768685] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-15T17:09:09.183362] [INFO ] [REMOTE ] AMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:09.212954] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:09.257873] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-15T17:09:10.057894] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-15T17:09:10.258070] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:10.258410] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-15T17:09:10.857882] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-15T17:09:11.033246] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:09:11.657880] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-15T17:09:12.457889] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-15T17:09:13.063953] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-15T17:09:13.257883] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-15T17:09:13.495100] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:13.495431] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-15T17:09:14.057891] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-15T17:09:14.281794] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-15T17:09:14.282444] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:14.293744] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-15T17:09:14.327274] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:09:14.857864] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-15T17:09:15.657882] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-15T17:09:15.868388] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:09:15.872051] [INFO ] [REMOTE ] AMBC: Full fetch complete (40596 records). [2025-09-15T17:09:15.872138] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-15T17:09:16.245153] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-15T17:09:16.245243] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-15T17:09:16.245837] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-15T17:09:16.245881] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-15T17:09:16.246763] [DEBUG] [LOCAL ] AMBC: Trimmed 40596 records to 26441 (keeping 150 days of data) [2025-09-15T17:09:16.400835] [DEBUG] [LOCAL ] AMBC: Primary data saved (26441 records). [2025-09-15T17:09:16.400993] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-15T17:09:16.401090] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBC took 22.9s. Estimated remaining: 3h 43m 5s. Rate: 10.2 symbols/min [2025-09-15T17:09:16.465362] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-15T17:09:16.573221] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:16.614382] [DEBUG] [LOCAL ] AMCR: Loaded 40412 existing records from primary storage. [2025-09-15T17:09:16.614533] [INFO ] [MAIN ] AMCR: Loaded 40412 existing records. [2025-09-15T17:09:16.728514] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:16.759201] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-15T17:09:16.793182] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:16.793433] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-15T17:09:16.793480] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-15T17:09:16.794811] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-15T17:09:16.794865] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-15T17:09:17.147766] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:17.234262] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:09:17.257826] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-15T17:09:18.057873] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-15T17:09:18.630685] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:09:18.857856] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-15T17:09:18.948545] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:09:19.657870] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-15T17:09:20.402572] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:09:20.457826] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-15T17:09:21.257936] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-15T17:09:21.328425] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:09:21.359877] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:09:21.363141] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6874 records). [2025-09-15T17:09:21.363219] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-15T17:09:21.553323] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 33 unique days, need 150 days [2025-09-15T17:09:21.553630] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:09:21.553701] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:09:21.553753] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-15T17:09:21.553824] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-15T17:09:21.553866] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-15T17:09:21.553910] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-15T17:09:21.553970] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AMBQ took 14.8s. Estimated remaining: 3h 42m 42s. Rate: 10.2 symbols/min [2025-09-15T17:09:21.723192] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:21.766524] [DEBUG] [LOCAL ] AME: Loaded 36349 existing records from primary storage. [2025-09-15T17:09:21.766698] [INFO ] [MAIN ] AME: Loaded 36349 existing records. [2025-09-15T17:09:21.944971] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:21.945252] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-15T17:09:21.945299] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-15T17:09:21.946721] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-15T17:09:21.946777] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-15T17:09:22.063015] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-15T17:09:22.325839] [INFO ] [REMOTE ] AME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:22.780952] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:09:22.857853] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-15T17:09:23.657879] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-15T17:09:24.457916] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-15T17:09:24.798417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-15T17:09:25.257930] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-15T17:09:25.514861] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-15T17:09:25.676040] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T17:09:25.844857] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:09:26.057872] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-15T17:09:26.857923] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-15T17:09:27.460690] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:09:27.657934] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-15T17:09:27.756077] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T17:09:28.458004] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-15T17:09:28.660415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:09:29.223398] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:09:29.257918] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-15T17:09:30.057893] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-15T17:09:30.570375] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:09:30.607556] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-15T17:09:30.857887] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-15T17:09:31.139895] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:09:31.145700] [INFO ] [REMOTE ] AMBP: Full fetch complete (49434 records). [2025-09-15T17:09:31.145868] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-15T17:09:31.563865] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-15T17:09:31.563952] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-15T17:09:31.564470] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-15T17:09:31.564513] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-15T17:09:31.566221] [DEBUG] [LOCAL ] AMBP: Trimmed 49434 records to 33476 (keeping 150 days of data) [2025-09-15T17:09:31.657972] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-15T17:09:31.769182] [DEBUG] [LOCAL ] AMBP: Primary data saved (33476 records). [2025-09-15T17:09:31.769330] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-15T17:09:31.769414] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBP took 31.7s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-15T17:09:31.955556] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:31.974062] [DEBUG] [LOCAL ] AMG: Loaded 14731 existing records from primary storage. [2025-09-15T17:09:31.974209] [INFO ] [MAIN ] AMG: Loaded 14731 existing records. [2025-09-15T17:09:32.162693] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:32.163069] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-15T17:09:32.163186] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-15T17:09:32.163945] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-15T17:09:32.164010] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-15T17:09:32.373015] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:09:32.463106] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-15T17:09:32.568170] [INFO ] [REMOTE ] AMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:33.262964] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-15T17:09:33.283005] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:09:34.057933] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-15T17:09:34.563194] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T17:09:34.715535] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-15T17:09:34.857837] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-15T17:09:35.544476] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:09:35.657878] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-15T17:09:36.457904] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-15T17:09:37.271605] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-15T17:09:37.276395] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-15T17:09:37.310386] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:09:37.371608] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:09:38.057899] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-15T17:09:38.493208] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T17:09:38.857864] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-15T17:09:39.597293] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T17:09:39.603283] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-15T17:09:39.603440] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-15T17:09:39.666901] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-15T17:09:39.991566] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-15T17:09:39.991675] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-15T17:09:39.992289] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-15T17:09:39.992341] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-15T17:09:39.995068] [DEBUG] [LOCAL ] AMCR: Trimmed 58347 records to 39632 (keeping 150 days of data) [2025-09-15T17:09:40.248402] [DEBUG] [LOCAL ] AMCR: Primary data saved (39632 records). [2025-09-15T17:09:40.248563] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-15T17:09:40.249319] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMCR took 23.8s. Estimated remaining: 3h 45m 13s. Rate: 10.1 symbols/min [2025-09-15T17:09:40.417995] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:40.462053] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-15T17:09:40.463701] [DEBUG] [LOCAL ] AMH: Loaded 38783 existing records from primary storage. [2025-09-15T17:09:40.463777] [INFO ] [MAIN ] AMH: Loaded 38783 existing records. [2025-09-15T17:09:40.641699] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:40.641908] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-15T17:09:40.641997] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-15T17:09:40.643166] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-15T17:09:40.643218] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-15T17:09:40.998143] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:41.014262] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-15T17:09:41.020805] [INFO ] [REMOTE ] AMC: Full fetch complete (58432 records). [2025-09-15T17:09:41.020978] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-15T17:09:41.265505] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-15T17:09:41.423990] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-15T17:09:41.424139] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-15T17:09:41.424819] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-15T17:09:41.425201] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-15T17:09:41.427320] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T17:09:41.435467] [DEBUG] [LOCAL ] AMC: Trimmed 58432 records to 39733 (keeping 150 days of data) [2025-09-15T17:09:41.436085] [INFO ] [REMOTE ] AME: Full fetch complete (52753 records). [2025-09-15T17:09:41.436595] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-15T17:09:41.570152] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:09:41.983339] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-15T17:09:41.986822] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-15T17:09:41.987561] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-15T17:09:41.987670] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-15T17:09:42.045190] [DEBUG] [LOCAL ] AME: Trimmed 52753 records to 35658 (keeping 150 days of data) [2025-09-15T17:09:42.075622] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-15T17:09:42.294676] [DEBUG] [LOCAL ] AMC: Primary data saved (39733 records). [2025-09-15T17:09:42.306028] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-15T17:09:42.328793] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMC took 34.0s. Estimated remaining: 3h 43m 37s. Rate: 10.2 symbols/min [2025-09-15T17:09:42.528071] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:42.547990] [DEBUG] [LOCAL ] AME: Primary data saved (35658 records). [2025-09-15T17:09:42.548174] [INFO ] [MAIN ] AME: Full history saved. [2025-09-15T17:09:42.548516] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 21.0s. Estimated remaining: 3h 41m 21s. Rate: 10.3 symbols/min [2025-09-15T17:09:42.738181] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:42.738941] [DEBUG] [LOCAL ] AMN: Loaded 31538 existing records from primary storage. [2025-09-15T17:09:42.739288] [INFO ] [MAIN ] AMN: Loaded 31538 existing records. [2025-09-15T17:09:42.927465] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:42.928036] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-15T17:09:42.928132] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-15T17:09:42.936697] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-15T17:09:42.936926] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-15T17:09:42.937315] [DEBUG] [LOCAL ] AMP: Loaded 23565 existing records from primary storage. [2025-09-15T17:09:42.968736] [INFO ] [MAIN ] AMP: Loaded 23565 existing records. [2025-09-15T17:09:43.401356] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:43.439869] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-15T17:09:43.455536] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-15T17:09:43.531479] [INFO ] [REMOTE ] AMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:43.532085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-15T17:09:43.525983] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T17:09:43.531605] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-15T17:09:43.543133] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-15T17:09:43.672737] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-15T17:09:43.715828] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:09:43.927579] [INFO ] [REMOTE ] AMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:44.457912] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-15T17:09:44.621004] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:09:45.257932] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-15T17:09:45.404340] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T17:09:45.558626] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:09:46.057909] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-15T17:09:46.857855] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-15T17:09:46.887372] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:09:46.916202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:09:47.657924] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-15T17:09:48.369605] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:09:48.421766] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:48.457831] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-15T17:09:49.257881] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-15T17:09:50.005577] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:09:50.057819] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-15T17:09:50.402613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:09:50.857871] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-15T17:09:51.376426] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:09:51.657889] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-15T17:09:51.999626] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:09:52.457907] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-15T17:09:53.213596] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:53.257823] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-15T17:09:54.057885] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-15T17:09:54.059702] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:09:54.428472] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:09:54.726119] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T17:09:54.857888] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-15T17:09:55.657869] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-15T17:09:55.839255] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:09:56.388626] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:09:56.457852] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-15T17:09:57.229594] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:09:57.232658] [INFO ] [REMOTE ] AMG: Full fetch complete (22479 records). [2025-09-15T17:09:57.232756] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-15T17:09:57.263940] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-15T17:09:57.633192] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-15T17:09:57.633285] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-15T17:09:57.633663] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-15T17:09:57.633710] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-15T17:09:57.634461] [DEBUG] [LOCAL ] AMG: Trimmed 22479 records to 14410 (keeping 150 days of data) [2025-09-15T17:09:57.730864] [DEBUG] [LOCAL ] AMG: Primary data saved (14410 records). [2025-09-15T17:09:57.731006] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-15T17:09:57.731089] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 26.0s. Estimated remaining: 3h 44m 47s. Rate: 10.1 symbols/min [2025-09-15T17:09:57.899587] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:57.941630] [DEBUG] [LOCAL ] AMPX: Loaded 39319 existing records from primary storage. [2025-09-15T17:09:57.941799] [INFO ] [MAIN ] AMPX: Loaded 39319 existing records. [2025-09-15T17:09:58.063124] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-15T17:09:58.130413] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:58.130690] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-15T17:09:58.130747] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-15T17:09:58.132064] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-15T17:09:58.132116] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-15T17:09:58.478915] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:58.579405] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:09:58.857927] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-15T17:09:59.660604] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-15T17:09:59.663204] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:10:00.457873] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-15T17:10:00.607987] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:10:01.257966] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-15T17:10:01.331588] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T17:10:01.716020] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:10:02.057896] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-15T17:10:02.622510] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:10:02.633857] [INFO ] [REMOTE ] AMH: Full fetch complete (56146 records). [2025-09-15T17:10:02.634110] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-15T17:10:02.863081] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-15T17:10:03.048877] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-15T17:10:03.049020] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-15T17:10:03.049744] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-15T17:10:03.049834] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-15T17:10:03.051189] [DEBUG] [LOCAL ] AMH: Trimmed 56146 records to 38075 (keeping 150 days of data) [2025-09-15T17:10:03.166470] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:10:03.316208] [DEBUG] [LOCAL ] AMH: Primary data saved (38075 records). [2025-09-15T17:10:03.316382] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-15T17:10:03.317846] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMH took 23.1s. Estimated remaining: 3h 44m 33s. Rate: 10.1 symbols/min [2025-09-15T17:10:03.494877] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:03.528742] [DEBUG] [LOCAL ] AMPY: Loaded 28357 existing records from primary storage. [2025-09-15T17:10:03.528993] [INFO ] [MAIN ] AMPY: Loaded 28357 existing records. [2025-09-15T17:10:03.676006] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-15T17:10:03.720598] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:03.720951] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-15T17:10:03.721005] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-15T17:10:03.721923] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-15T17:10:03.721985] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-15T17:10:04.104789] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:04.119085] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:10:04.124220] [INFO ] [REMOTE ] AMN: Full fetch complete (46274 records). [2025-09-15T17:10:04.124363] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-15T17:10:04.473432] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-15T17:10:04.526940] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-15T17:10:04.527093] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-15T17:10:04.527805] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-15T17:10:04.527859] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-15T17:10:04.529374] [DEBUG] [LOCAL ] AMN: Trimmed 46274 records to 31022 (keeping 150 days of data) [2025-09-15T17:10:04.731815] [DEBUG] [LOCAL ] AMN: Primary data saved (31022 records). [2025-09-15T17:10:04.732027] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-15T17:10:04.732143] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 22.4s. Estimated remaining: 3h 42m 46s. Rate: 10.2 symbols/min [2025-09-15T17:10:04.914278] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:04.946332] [DEBUG] [LOCAL ] AMR: Loaded 21672 existing records from primary storage. [2025-09-15T17:10:04.946544] [INFO ] [MAIN ] AMR: Loaded 21672 existing records. [2025-09-15T17:10:05.170080] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:05.170503] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-15T17:10:05.170553] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-15T17:10:05.171562] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-15T17:10:05.171619] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-15T17:10:05.267167] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-15T17:10:05.575693] [INFO ] [REMOTE ] AMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:05.631165] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T17:10:05.910892] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:10:06.044625] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:10:06.057813] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-15T17:10:06.857886] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-15T17:10:07.393325] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:10:07.657845] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-15T17:10:08.118232] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:10:08.457879] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-15T17:10:09.201174] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:10:09.257892] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-15T17:10:09.630871] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:10:10.057875] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-15T17:10:10.841405] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:10:10.857822] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-15T17:10:11.322693] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:10:11.327666] [INFO ] [REMOTE ] AMP: Full fetch complete (35726 records). [2025-09-15T17:10:11.327861] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-15T17:10:11.664341] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-15T17:10:11.695093] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-15T17:10:11.695172] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-15T17:10:11.695634] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-15T17:10:11.695692] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-15T17:10:11.696457] [DEBUG] [LOCAL ] AMP: Trimmed 35726 records to 23065 (keeping 150 days of data) [2025-09-15T17:10:11.850819] [DEBUG] [LOCAL ] AMP: Primary data saved (23065 records). [2025-09-15T17:10:11.850959] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-15T17:10:11.851043] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 29.3s. Estimated remaining: 3h 43m 7s. Rate: 10.2 symbols/min [2025-09-15T17:10:12.056811] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:12.084176] [DEBUG] [LOCAL ] AMRC: Loaded 28206 existing records from primary storage. [2025-09-15T17:10:12.084298] [INFO ] [MAIN ] AMRC: Loaded 28206 existing records. [2025-09-15T17:10:12.257037] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:12.257288] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-15T17:10:12.257332] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-15T17:10:12.258255] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-15T17:10:12.258306] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-15T17:10:12.463210] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-15T17:10:12.613493] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:12.664115] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:10:12.687608] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:10:13.257876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-15T17:10:14.017713] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:10:14.057877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-15T17:10:14.225417] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T17:10:14.857874] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-15T17:10:15.517473] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:10:15.657854] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-15T17:10:15.753808] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:10:16.457869] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-15T17:10:16.809489] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:10:17.257881] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-15T17:10:17.443279] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:10:18.057866] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-15T17:10:18.857865] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-15T17:10:19.181154] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:10:19.310312] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T17:10:19.657894] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-15T17:10:20.091408] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:10:20.457866] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-15T17:10:20.652237] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:10:20.655619] [INFO ] [REMOTE ] AMPY: Full fetch complete (39603 records). [2025-09-15T17:10:20.655731] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-15T17:10:21.035784] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-15T17:10:21.035869] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-15T17:10:21.036321] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-15T17:10:21.036363] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-15T17:10:21.037286] [DEBUG] [LOCAL ] AMPY: Trimmed 39603 records to 27646 (keeping 150 days of data) [2025-09-15T17:10:21.200458] [DEBUG] [LOCAL ] AMPY: Primary data saved (27646 records). [2025-09-15T17:10:21.200605] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-15T17:10:21.200712] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMPY took 17.9s. Estimated remaining: 3h 44m 16s. Rate: 10.1 symbols/min [2025-09-15T17:10:21.264554] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-15T17:10:21.374584] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:21.374782] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-15T17:10:21.374825] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-15T17:10:21.374978] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-15T17:10:21.375030] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-15T17:10:21.375108] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-15T17:10:21.375144] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-15T17:10:21.773910] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:21.817197] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:10:22.057964] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-15T17:10:22.857925] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-15T17:10:23.062522] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:23.083806] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-15T17:10:23.086655] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:10:23.427715] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:10:23.657896] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-15T17:10:24.457928] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-15T17:10:24.576304] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:10:25.257897] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-15T17:10:26.057890] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-15T17:10:26.297540] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:10:26.517512] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T17:10:26.524496] [INFO ] [REMOTE ] AMPX: Full fetch complete (56234 records). [2025-09-15T17:10:26.524630] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-15T17:10:26.868430] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-15T17:10:26.921272] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-15T17:10:26.921352] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-15T17:10:26.921960] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-15T17:10:26.922004] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-15T17:10:26.923414] [DEBUG] [LOCAL ] AMPX: Trimmed 56234 records to 38648 (keeping 150 days of data) [2025-09-15T17:10:27.116965] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:10:27.177968] [DEBUG] [LOCAL ] AMPX: Primary data saved (38648 records). [2025-09-15T17:10:27.178122] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-15T17:10:27.178212] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPX took 29.4s. Estimated remaining: 3h 44m 11s. Rate: 10.1 symbols/min [2025-09-15T17:10:27.346824] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:27.385788] [DEBUG] [LOCAL ] AMT: Loaded 39337 existing records from primary storage. [2025-09-15T17:10:27.385937] [INFO ] [MAIN ] AMT: Loaded 39337 existing records. [2025-09-15T17:10:27.570112] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:27.570377] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-15T17:10:27.570425] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-15T17:10:27.572049] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-15T17:10:27.572109] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-15T17:10:27.663428] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-15T17:10:27.935071] [INFO ] [REMOTE ] AMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:28.033260] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:10:28.457936] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-15T17:10:28.857674] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:10:29.257943] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-15T17:10:29.457509] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:29.457898] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-15T17:10:29.877340] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:10:30.057885] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-15T17:10:30.857886] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-15T17:10:31.054112] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:31.054424] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-15T17:10:31.568899] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:10:31.657876] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-15T17:10:31.853449] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:31.853819] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-15T17:10:32.457869] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-15T17:10:33.257845] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-15T17:10:33.733036] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:10:34.057876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-15T17:10:34.333253] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:10:34.857906] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-15T17:10:35.337710] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:10:35.342128] [INFO ] [REMOTE ] AMRC: Full fetch complete (41313 records). [2025-09-15T17:10:35.342210] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-15T17:10:35.668989] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-15T17:10:35.715310] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-15T17:10:35.715380] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-15T17:10:35.715853] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-15T17:10:35.715895] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-15T17:10:35.716778] [DEBUG] [LOCAL ] AMRC: Trimmed 41313 records to 27480 (keeping 150 days of data) [2025-09-15T17:10:35.891636] [DEBUG] [LOCAL ] AMRC: Primary data saved (27480 records). [2025-09-15T17:10:35.891838] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-15T17:10:35.891961] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRC took 24.0s. Estimated remaining: 3h 45m 4s. Rate: 10.1 symbols/min [2025-09-15T17:10:36.075751] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:36.094788] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:10:36.116098] [DEBUG] [LOCAL ] AMTB: Loaded 15567 existing records from primary storage. [2025-09-15T17:10:36.116323] [INFO ] [MAIN ] AMTB: Loaded 15567 existing records. [2025-09-15T17:10:36.289873] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:36.290181] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-15T17:10:36.290270] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-15T17:10:36.291029] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-15T17:10:36.291080] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-15T17:10:36.466331] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-15T17:10:36.656339] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:37.257921] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-15T17:10:37.360241] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:10:38.057925] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-15T17:10:38.512540] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:10:38.530830] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:10:38.534096] [INFO ] [REMOTE ] AMR: Full fetch complete (31775 records). [2025-09-15T17:10:38.534171] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-15T17:10:38.862924] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-15T17:10:38.903846] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-15T17:10:38.903908] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-15T17:10:38.904298] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-15T17:10:38.904336] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-15T17:10:38.905336] [DEBUG] [LOCAL ] AMR: Trimmed 31775 records to 21277 (keeping 150 days of data) [2025-09-15T17:10:39.041139] [DEBUG] [LOCAL ] AMR: Primary data saved (21277 records). [2025-09-15T17:10:39.041382] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-15T17:10:39.041518] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMR took 34.3s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-15T17:10:39.211910] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:39.216732] [DEBUG] [LOCAL ] AMTD: Loaded 2827 existing records from primary storage. [2025-09-15T17:10:39.216811] [INFO ] [MAIN ] AMTD: Loaded 2827 existing records. [2025-09-15T17:10:39.391271] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:39.391530] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-15T17:10:39.391576] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-15T17:10:39.391833] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-15T17:10:39.391882] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-15T17:10:39.662291] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-15T17:10:39.745380] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:39.758153] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T17:10:39.792128] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T17:10:40.457910] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-15T17:10:41.257861] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-15T17:10:41.633848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T17:10:42.015101] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:10:42.057818] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-15T17:10:42.186744] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:10:42.192435] [INFO ] [REMOTE ] AMRZ: Full fetch complete (22255 records). [2025-09-15T17:10:42.192578] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-15T17:10:42.378984] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 59 unique days, need 150 days [2025-09-15T17:10:42.379365] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:10:42.379437] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:10:42.379504] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-15T17:10:42.379570] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-15T17:10:42.379609] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-15T17:10:42.379680] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-15T17:10:42.379744] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMRZ took 21.2s. Estimated remaining: 3h 42m 59s. Rate: 10.1 symbols/min [2025-09-15T17:10:42.554896] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:42.592039] [DEBUG] [LOCAL ] AMTM: Loaded 37905 existing records from primary storage. [2025-09-15T17:10:42.592187] [INFO ] [MAIN ] AMTM: Loaded 37905 existing records. [2025-09-15T17:10:42.769244] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:42.769569] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-15T17:10:42.769663] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-15T17:10:42.771168] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-15T17:10:42.771225] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-15T17:10:42.863002] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-15T17:10:43.145439] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:43.147068] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:10:43.657868] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-15T17:10:44.308529] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:10:44.457871] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-15T17:10:44.735859] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:10:44.941743] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T17:10:45.257874] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-15T17:10:45.997693] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:10:46.057826] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-15T17:10:46.857897] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-15T17:10:46.977919] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T17:10:47.657934] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-15T17:10:48.347179] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:10:48.371937] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T17:10:48.457870] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-15T17:10:49.257923] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-15T17:10:49.405782] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:10:49.407895] [INFO ] [REMOTE ] AMTB: Full fetch complete (22445 records). [2025-09-15T17:10:49.407968] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-15T17:10:49.774154] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-15T17:10:49.774241] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-15T17:10:49.774586] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-15T17:10:49.774627] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-15T17:10:49.775412] [DEBUG] [LOCAL ] AMTB: Trimmed 22445 records to 15250 (keeping 150 days of data) [2025-09-15T17:10:49.869551] [DEBUG] [LOCAL ] AMTB: Primary data saved (15250 records). [2025-09-15T17:10:49.869731] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-15T17:10:49.869823] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTB took 14.0s. Estimated remaining: 3h 43m 25s. Rate: 10.1 symbols/min [2025-09-15T17:10:50.047949] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:50.056566] [DEBUG] [LOCAL ] AMWL: Loaded 6581 existing records from primary storage. [2025-09-15T17:10:50.056692] [INFO ] [MAIN ] AMWL: Loaded 6581 existing records. [2025-09-15T17:10:50.067915] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-15T17:10:50.243739] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:50.244111] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-15T17:10:50.244166] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-15T17:10:50.244675] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-15T17:10:50.244749] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-15T17:10:50.606180] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:50.609791] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T17:10:50.675588] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:10:50.857878] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-15T17:10:51.657874] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-15T17:10:51.744508] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:10:52.038297] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:10:52.457885] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-15T17:10:52.812054] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:10:53.257926] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-15T17:10:54.057878] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-15T17:10:54.857880] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-15T17:10:55.216351] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T17:10:55.222494] [INFO ] [REMOTE ] AMT: Full fetch complete (57030 records). [2025-09-15T17:10:55.222628] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-15T17:10:55.510738] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:10:55.626339] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-15T17:10:55.626430] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-15T17:10:55.627032] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-15T17:10:55.627077] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-15T17:10:55.628450] [DEBUG] [LOCAL ] AMT: Trimmed 57030 records to 38572 (keeping 150 days of data) [2025-09-15T17:10:55.689749] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-15T17:10:55.791836] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:10:55.918158] [DEBUG] [LOCAL ] AMT: Primary data saved (38572 records). [2025-09-15T17:10:55.918338] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-15T17:10:55.918480] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMT took 28.7s. Estimated remaining: 3h 43m 22s. Rate: 10.1 symbols/min [2025-09-15T17:10:56.087751] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:56.127468] [DEBUG] [LOCAL ] AMX: Loaded 36855 existing records from primary storage. [2025-09-15T17:10:56.127625] [INFO ] [MAIN ] AMX: Loaded 36855 existing records. [2025-09-15T17:10:56.262007] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T17:10:56.315773] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:56.316025] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-15T17:10:56.316073] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-15T17:10:56.317616] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-15T17:10:56.317700] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-15T17:10:56.466116] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-15T17:10:56.697916] [INFO ] [REMOTE ] AMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:57.032735] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:10:57.257924] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-15T17:10:57.825893] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:10:58.057922] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-15T17:10:58.857949] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-15T17:10:59.598045] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:10:59.657849] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-15T17:10:59.803248] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:11:00.157120] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:11:00.457876] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-15T17:11:01.164302] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:11:01.257827] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-15T17:11:02.057865] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-15T17:11:02.266204] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:11:02.857875] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-15T17:11:03.332779] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:11:03.612912] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:11:03.614164] [INFO ] [REMOTE ] AMTD: Full fetch complete (3756 records). [2025-09-15T17:11:03.614262] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-15T17:11:03.663077] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-15T17:11:03.973486] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-15T17:11:03.973577] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-15T17:11:03.973733] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-15T17:11:03.973776] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-15T17:11:03.974151] [DEBUG] [LOCAL ] AMTD: Trimmed 3756 records to 2875 (keeping 150 days of data) [2025-09-15T17:11:03.992164] [DEBUG] [LOCAL ] AMTD: Primary data saved (2875 records). [2025-09-15T17:11:03.992297] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-15T17:11:03.992415] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTD took 25.0s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-15T17:11:04.176437] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:04.202129] [DEBUG] [LOCAL ] AN: Loaded 23541 existing records from primary storage. [2025-09-15T17:11:04.202290] [INFO ] [MAIN ] AN: Loaded 23541 existing records. [2025-09-15T17:11:04.377733] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:04.377989] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-15T17:11:04.378035] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-15T17:11:04.379027] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-15T17:11:04.379082] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-15T17:11:04.462948] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-15T17:11:04.733145] [INFO ] [REMOTE ] AN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:05.205101] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:11:05.257909] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-15T17:11:06.024528] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:11:06.057827] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-15T17:11:06.326919] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:11:06.857900] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-15T17:11:07.579737] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:11:07.657867] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-15T17:11:07.718403] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:11:08.457869] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-15T17:11:08.849825] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:11:09.257877] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-15T17:11:10.057887] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-15T17:11:10.230125] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:11:10.458610] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:11:10.769734] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:11:10.771456] [INFO ] [REMOTE ] AMWL: Full fetch complete (10123 records). [2025-09-15T17:11:10.771527] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-15T17:11:10.862975] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-15T17:11:11.155433] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-15T17:11:11.155548] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-15T17:11:11.155960] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-15T17:11:11.156022] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-15T17:11:11.156560] [DEBUG] [LOCAL ] AMWL: Trimmed 10123 records to 6494 (keeping 150 days of data) [2025-09-15T17:11:11.195434] [DEBUG] [LOCAL ] AMWL: Primary data saved (6494 records). [2025-09-15T17:11:11.195561] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-15T17:11:11.195688] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMWL took 21.3s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-15T17:11:11.309222] [DEBUG] [REMOTE ] AMTM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-15T17:11:11.341471] [WARN ] [REMOTE ] AMTM: No data returned for month 2025-07 [2025-09-15T17:11:11.375296] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:11.417992] [DEBUG] [LOCAL ] ANET: Loaded 40506 existing records from primary storage. [2025-09-15T17:11:11.418186] [INFO ] [MAIN ] ANET: Loaded 40506 existing records. [2025-09-15T17:11:11.594424] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:11.594710] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-15T17:11:11.594761] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-15T17:11:11.596338] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-15T17:11:11.596395] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-15T17:11:11.662952] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-15T17:11:11.945142] [INFO ] [REMOTE ] ANET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:12.457879] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-15T17:11:12.679373] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T17:11:13.257867] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-15T17:11:14.057923] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-15T17:11:14.276057] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:11:14.538783] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T17:11:14.857937] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-15T17:11:15.456346] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:11:15.657896] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-15T17:11:16.397906] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:11:16.457837] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-15T17:11:17.119134] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:11:17.257871] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-15T17:11:18.057932] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-15T17:11:18.382537] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:11:18.547398] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:11:18.552767] [INFO ] [REMOTE ] AMTM: Full fetch complete (47373 records). [2025-09-15T17:11:18.552860] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-15T17:11:18.739214] [WARN ] [VALIDATOR ] AMTM: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-15T17:11:18.739811] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:11:18.739870] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:11:18.739911] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-15T17:11:18.739980] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-15T17:11:18.740031] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-09-15T17:11:18.740414] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-09-15T17:11:18.740920] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMTM took 36.4s. Estimated remaining: 3h 44m 44s. Rate: 10.0 symbols/min [2025-09-15T17:11:18.863029] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-15T17:11:18.913241] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:18.958463] [DEBUG] [LOCAL ] ANF: Loaded 39151 existing records from primary storage. [2025-09-15T17:11:18.958608] [INFO ] [MAIN ] ANF: Loaded 39151 existing records. [2025-09-15T17:11:19.138033] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:19.138472] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-15T17:11:19.138529] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-15T17:11:19.145368] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-15T17:11:19.153168] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-15T17:11:19.159960] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:11:19.544548] [INFO ] [REMOTE ] ANF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:19.657830] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-15T17:11:20.280070] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T17:11:20.457849] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-15T17:11:21.003246] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:11:21.007223] [INFO ] [REMOTE ] AN: Full fetch complete (36021 records). [2025-09-15T17:11:21.007360] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-15T17:11:21.263054] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-15T17:11:21.389606] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-15T17:11:21.389727] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-15T17:11:21.390230] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-15T17:11:21.390273] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-15T17:11:21.391336] [DEBUG] [LOCAL ] AN: Trimmed 36021 records to 23001 (keeping 150 days of data) [2025-09-15T17:11:21.534367] [DEBUG] [LOCAL ] AN: Primary data saved (23001 records). [2025-09-15T17:11:21.534512] [INFO ] [MAIN ] AN: Full history saved. [2025-09-15T17:11:21.534619] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 17.5s. Estimated remaining: 3h 43m 35s. Rate: 10.1 symbols/min [2025-09-15T17:11:21.739674] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:11:21.741061] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:21.750544] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-15T17:11:21.750705] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-15T17:11:21.750849] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-15T17:11:21.750897] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-15T17:11:21.750948] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-15T17:11:21.750985] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-15T17:11:22.062940] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-15T17:11:22.115677] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:22.742321] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:11:22.857866] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-15T17:11:23.660942] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-15T17:11:23.664905] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:11:23.866712] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:23.867050] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-15T17:11:24.294066] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:11:24.457936] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-15T17:11:25.257892] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-15T17:11:25.962262] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:11:26.057880] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-15T17:11:26.857878] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-15T17:11:27.059786] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:27.060077] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-15T17:11:27.394991] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T17:11:27.657887] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-15T17:11:27.892620] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:11:28.457888] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-15T17:11:28.661423] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:28.661760] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-15T17:11:29.117750] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:11:29.257883] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-15T17:11:30.057880] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-15T17:11:30.737842] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T17:11:30.857917] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-15T17:11:31.657892] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-15T17:11:32.154773] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:11:32.160231] [INFO ] [REMOTE ] AMX: Full fetch complete (53244 records). [2025-09-15T17:11:32.160363] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-15T17:11:32.462465] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-15T17:11:32.550055] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-15T17:11:32.550197] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-15T17:11:32.550783] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-15T17:11:32.550924] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-15T17:11:32.552371] [DEBUG] [LOCAL ] AMX: Trimmed 53244 records to 36088 (keeping 150 days of data) [2025-09-15T17:11:32.680521] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-15T17:11:32.773109] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:32.796334] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-15T17:11:32.823701] [DEBUG] [LOCAL ] AMX: Primary data saved (36088 records). [2025-09-15T17:11:32.823887] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-15T17:11:32.823983] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 36.9s. Estimated remaining: 3h 45m 14s. Rate: 10.0 symbols/min [2025-09-15T17:11:32.997852] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:33.013403] [DEBUG] [LOCAL ] ANRO: Loaded 13852 existing records from primary storage. [2025-09-15T17:11:33.013551] [INFO ] [MAIN ] ANRO: Loaded 13852 existing records. [2025-09-15T17:11:33.199955] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:33.200318] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-15T17:11:33.200371] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-15T17:11:33.211422] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-15T17:11:33.225738] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-15T17:11:33.259842] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-15T17:11:33.333665] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:11:33.522177] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:33.522705] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-15T17:11:33.597310] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:34.057876] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-15T17:11:34.857890] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-15T17:11:35.051930] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:35.052239] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-15T17:11:35.657836] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-15T17:11:35.714885] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T17:11:36.457912] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-15T17:11:37.205706] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:11:37.257828] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-15T17:11:37.387612] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T17:11:38.057890] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-15T17:11:38.238852] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:38.239160] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-15T17:11:38.719223] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T17:11:38.727844] [INFO ] [REMOTE ] ANF: Full fetch complete (56859 records). [2025-09-15T17:11:38.728030] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-15T17:11:38.869753] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-15T17:11:39.116901] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-15T17:11:39.116999] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-15T17:11:39.117615] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-15T17:11:39.117703] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-15T17:11:39.119132] [DEBUG] [LOCAL ] ANF: Trimmed 56859 records to 38417 (keeping 150 days of data) [2025-09-15T17:11:39.363466] [DEBUG] [LOCAL ] ANF: Primary data saved (38417 records). [2025-09-15T17:11:39.363680] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-15T17:11:39.364302] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANF took 20.6s. Estimated remaining: 3h 45m 19s. Rate: 10.0 symbols/min [2025-09-15T17:11:39.536516] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:39.559469] [DEBUG] [LOCAL ] ANVS: Loaded 17780 existing records from primary storage. [2025-09-15T17:11:39.559611] [INFO ] [MAIN ] ANVS: Loaded 17780 existing records. [2025-09-15T17:11:39.659853] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-15T17:11:39.737175] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:39.737410] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-15T17:11:39.737458] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-15T17:11:39.738345] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-15T17:11:39.738397] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-15T17:11:40.092347] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:40.111784] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:11:40.455604] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:11:40.457472] [INFO ] [REMOTE ] ANGX: Full fetch complete (979 records). [2025-09-15T17:11:40.457541] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-15T17:11:40.463052] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-15T17:11:40.643408] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-15T17:11:40.643629] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:11:40.643723] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:11:40.643798] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-15T17:11:40.643863] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-15T17:11:40.643902] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-15T17:11:40.643953] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-15T17:11:40.644030] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. ANGX took 19.1s. Estimated remaining: 3h 43m 42s. Rate: 10.1 symbols/min [2025-09-15T17:11:41.257875] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-15T17:11:42.057933] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-15T17:11:42.444779] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:11:42.857925] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-15T17:11:42.913376] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:11:43.104784] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-15T17:11:43.657881] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-15T17:11:43.715687] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:11:44.457901] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-15T17:11:45.216945] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:11:45.257920] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-15T17:11:45.513954] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:11:46.062976] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-15T17:11:46.072811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:11:46.857871] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-15T17:11:47.159020] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:11:47.657934] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-15T17:11:48.381721] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:11:48.457909] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-15T17:11:48.547091] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:11:48.552986] [INFO ] [REMOTE ] ANET: Full fetch complete (58446 records). [2025-09-15T17:11:48.553089] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-15T17:11:48.934327] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-15T17:11:48.934418] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-15T17:11:48.935084] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-15T17:11:48.935133] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-15T17:11:48.936372] [DEBUG] [LOCAL ] ANET: Trimmed 58446 records to 39726 (keeping 150 days of data) [2025-09-15T17:11:49.041797] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:11:49.195791] [DEBUG] [LOCAL ] ANET: Primary data saved (39726 records). [2025-09-15T17:11:49.195950] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-15T17:11:49.196437] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANET took 38.0s. Estimated remaining: 3h 44m 25s. Rate: 10.0 symbols/min [2025-09-15T17:11:49.257913] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-15T17:11:50.057898] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-15T17:11:50.082343] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:11:50.857933] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-15T17:11:50.920078] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:11:50.921990] [INFO ] [REMOTE ] ANRO: Full fetch complete (22612 records). [2025-09-15T17:11:50.922190] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-15T17:11:51.285672] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-15T17:11:51.285768] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-15T17:11:51.286124] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-15T17:11:51.286165] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-15T17:11:51.287378] [DEBUG] [LOCAL ] ANRO: Trimmed 22612 records to 13456 (keeping 150 days of data) [2025-09-15T17:11:51.367996] [DEBUG] [LOCAL ] ANRO: Primary data saved (13456 records). [2025-09-15T17:11:51.368161] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-15T17:11:51.368274] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 18.5s. Estimated remaining: 3h 43m 7s. Rate: 10.1 symbols/min [2025-09-15T17:11:51.828099] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:11:51.834559] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-15T17:11:52.995312] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:11:53.001190] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-15T17:11:53.963258] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:11:53.967848] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-15T17:11:54.803392] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:11:54.805885] [INFO ] [REMOTE ] ANVS: Full fetch complete (26600 records). [2025-09-15T17:11:54.805999] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-15T17:11:55.181535] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-15T17:11:55.181677] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-15T17:11:55.182032] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-15T17:11:55.182073] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-15T17:11:55.182912] [DEBUG] [LOCAL ] ANVS: Trimmed 26600 records to 17585 (keeping 150 days of data) [2025-09-15T17:11:55.300180] [DEBUG] [LOCAL ] ANVS: Primary data saved (17585 records). [2025-09-15T17:11:55.300475] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-15T17:11:55.300603] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANVS took 15.9s. Estimated remaining: 3h 42m 23s. Rate: 10.1 symbols/min [2025-09-15T17:11:55.988843] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.045863] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.046219] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-15T17:11:56.052853] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.047222] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.053947] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-15T17:11:56.057372] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-15T17:11:56.057457] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-15T17:11:56.057508] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-15T17:11:56.057544] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-15T17:11:56.176402] [DEBUG] [LOCAL ] AOMR: Loaded 12788 existing records from primary storage. [2025-09-15T17:11:56.203968] [INFO ] [MAIN ] AOMR: Loaded 12788 existing records. [2025-09-15T17:11:56.401335] [DEBUG] [LOCAL ] AOD: Loaded 22575 existing records from primary storage. [2025-09-15T17:11:56.450449] [INFO ] [MAIN ] AOD: Loaded 22575 existing records. [2025-09-15T17:11:56.600057] [DEBUG] [LOCAL ] AON: Loaded 34078 existing records from primary storage. [2025-09-15T17:11:56.626192] [INFO ] [MAIN ] AON: Loaded 34078 existing records. [2025-09-15T17:11:56.889314] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:56.921167] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:56.967146] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-15T17:11:56.977631] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.040672] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-15T17:11:57.092810] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:57.086563] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:57.094547] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.094742] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.094927] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-15T17:11:57.094871] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-15T17:11:57.095054] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-15T17:11:57.095216] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-15T17:11:57.106441] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-15T17:11:57.130524] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-15T17:11:57.106309] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-15T17:11:57.193990] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-15T17:11:57.395745] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:57.478154] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-15T17:11:57.570761] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-15T17:11:58.057894] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.079479] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:58.099389] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-15T17:11:58.099568] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-15T17:11:58.127847] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-15T17:11:58.242214] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.259027] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-15T17:11:58.262219] [INFO ] [REMOTE ] AOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.263243] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-15T17:11:58.437281] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:58.437700] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-15T17:11:58.857891] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-15T17:11:58.952037] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:11:59.143473] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T17:11:59.380381] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:11:59.657841] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-15T17:11:59.967875] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:12:00.457919] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-15T17:12:00.520195] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:12:01.017072] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:12:01.257875] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-15T17:12:02.057889] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-15T17:12:02.857920] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-15T17:12:03.596532] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:12:03.657913] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-15T17:12:04.457868] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-15T17:12:04.577257] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:12:04.617123] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-15T17:12:04.745774] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:12:05.146850] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:12:05.257879] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-15T17:12:06.057942] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-15T17:12:06.251412] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:12:06.857852] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-15T17:12:07.039477] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:12:07.657958] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-15T17:12:07.723929] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:12:08.457956] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-15T17:12:08.820522] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T17:12:08.821662] [INFO ] [REMOTE ] AOMD: Full fetch complete (1673 records). [2025-09-15T17:12:08.821743] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-15T17:12:09.016692] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 77 unique days, need 150 days [2025-09-15T17:12:09.016888] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:12:09.016934] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:12:09.016978] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-15T17:12:09.017307] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-15T17:12:09.017575] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-15T17:12:09.017638] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-15T17:12:09.017828] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 13.7s. Estimated remaining: 3h 44m 42s. Rate: 10.0 symbols/min [2025-09-15T17:12:09.201005] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:09.226754] [DEBUG] [LOCAL ] AORT: Loaded 21896 existing records from primary storage. [2025-09-15T17:12:09.226908] [INFO ] [MAIN ] AORT: Loaded 21896 existing records. [2025-09-15T17:12:09.262950] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-15T17:12:09.420915] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:09.421236] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-15T17:12:09.421398] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-15T17:12:09.422450] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-15T17:12:09.422544] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-15T17:12:09.629762] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T17:12:09.823561] [INFO ] [REMOTE ] AORT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:10.057907] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-15T17:12:10.267584] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:12:10.857885] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-15T17:12:11.629468] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T17:12:11.657819] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-15T17:12:11.773182] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T17:12:12.457873] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-15T17:12:12.831611] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:12:12.834074] [INFO ] [REMOTE ] AOMR: Full fetch complete (19001 records). [2025-09-15T17:12:12.834156] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-15T17:12:13.199767] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-15T17:12:13.199846] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-15T17:12:13.200147] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-15T17:12:13.200195] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-15T17:12:13.200780] [DEBUG] [LOCAL ] AOMR: Trimmed 19001 records to 12648 (keeping 150 days of data) [2025-09-15T17:12:13.258495] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-15T17:12:13.279918] [DEBUG] [LOCAL ] AOMR: Primary data saved (12648 records). [2025-09-15T17:12:13.280018] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-15T17:12:13.280115] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOMR took 18.0s. Estimated remaining: 3h 44m 4s. Rate: 10.0 symbols/min [2025-09-15T17:12:13.447214] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:13.487508] [DEBUG] [LOCAL ] AOS: Loaded 37044 existing records from primary storage. [2025-09-15T17:12:13.487671] [INFO ] [MAIN ] AOS: Loaded 37044 existing records. [2025-09-15T17:12:13.665041] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:13.665295] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-15T17:12:13.665341] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-15T17:12:13.666850] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-15T17:12:13.666904] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-15T17:12:14.064946] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-15T17:12:14.109326] [INFO ] [REMOTE ] AOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:14.398804] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T17:12:14.857900] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-15T17:12:15.005520] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:12:15.177600] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T17:12:15.657870] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-15T17:12:16.341953] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:12:16.457889] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-15T17:12:16.761244] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T17:12:17.257867] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-15T17:12:17.664345] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:12:18.057867] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-15T17:12:18.562716] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:12:18.857891] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-15T17:12:19.621917] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:12:19.657841] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-15T17:12:20.036734] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:12:20.457943] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-15T17:12:21.041525] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T17:12:21.046460] [INFO ] [REMOTE ] AON: Full fetch complete (49473 records). [2025-09-15T17:12:21.046563] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-15T17:12:21.263674] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-15T17:12:21.430770] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-15T17:12:21.430845] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-15T17:12:21.431363] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-15T17:12:21.431406] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-15T17:12:21.432418] [DEBUG] [LOCAL ] AON: Trimmed 49473 records to 33409 (keeping 150 days of data) [2025-09-15T17:12:21.646929] [DEBUG] [LOCAL ] AON: Primary data saved (33409 records). [2025-09-15T17:12:21.647070] [INFO ] [MAIN ] AON: Full history saved. [2025-09-15T17:12:21.647154] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. AON took 26.3s. Estimated remaining: 3h 44m 42s. Rate: 10.0 symbols/min [2025-09-15T17:12:21.815963] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:21.836446] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:12:21.846389] [DEBUG] [LOCAL ] AP: Loaded 5808 existing records from primary storage. [2025-09-15T17:12:21.846488] [INFO ] [MAIN ] AP: Loaded 5808 existing records. [2025-09-15T17:12:22.019977] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:22.020234] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-15T17:12:22.020287] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-15T17:12:22.020610] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-15T17:12:22.020685] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-15T17:12:22.063000] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-15T17:12:22.381934] [INFO ] [REMOTE ] AP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:22.398079] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:12:22.857864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-15T17:12:23.657894] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-15T17:12:23.877633] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:12:24.457887] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-15T17:12:24.791715] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T17:12:24.905293] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:12:25.257879] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-15T17:12:25.436311] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:12:25.439720] [INFO ] [REMOTE ] AOD: Full fetch complete (32679 records). [2025-09-15T17:12:25.439796] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-15T17:12:25.440310] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:12:25.440387] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:12:25.440424] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:12:25.440463] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-15T17:12:25.440540] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-15T17:12:25.440589] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-09-15T17:12:25.440927] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-09-15T17:12:25.441009] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOD took 30.1s. Estimated remaining: 3h 43m 56s. Rate: 10.0 symbols/min [2025-09-15T17:12:25.612636] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:25.632552] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:12:25.643954] [DEBUG] [LOCAL ] APAM: Loaded 27241 existing records from primary storage. [2025-09-15T17:12:25.644057] [INFO ] [MAIN ] APAM: Loaded 27241 existing records. [2025-09-15T17:12:25.819702] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:25.819951] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-15T17:12:25.819997] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-15T17:12:25.821116] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-15T17:12:25.821169] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-15T17:12:26.063058] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-15T17:12:26.176386] [INFO ] [REMOTE ] APAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:26.857878] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-15T17:12:27.567370] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:12:27.657900] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-15T17:12:27.970101] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:12:28.457926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-15T17:12:28.602506] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:12:28.607313] [INFO ] [REMOTE ] AORT: Full fetch complete (32543 records). [2025-09-15T17:12:28.607478] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-15T17:12:28.997560] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-15T17:12:28.997706] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-15T17:12:28.998297] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-15T17:12:28.998358] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-15T17:12:28.999721] [DEBUG] [LOCAL ] AORT: Trimmed 32543 records to 21502 (keeping 150 days of data) [2025-09-15T17:12:29.126048] [DEBUG] [LOCAL ] AORT: Primary data saved (21502 records). [2025-09-15T17:12:29.126193] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-15T17:12:29.126278] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AORT took 20.1s. Estimated remaining: 3h 43m 8s. Rate: 10.1 symbols/min [2025-09-15T17:12:29.270140] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-15T17:12:29.304015] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:29.340116] [DEBUG] [LOCAL ] APD: Loaded 33825 existing records from primary storage. [2025-09-15T17:12:29.340296] [INFO ] [MAIN ] APD: Loaded 33825 existing records. [2025-09-15T17:12:29.516189] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:29.516460] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-15T17:12:29.516508] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-15T17:12:29.518006] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-15T17:12:29.518063] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-15T17:12:29.872241] [INFO ] [REMOTE ] APD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:29.947022] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:12:29.993589] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:12:30.057888] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-15T17:12:30.857916] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-15T17:12:30.996860] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:12:31.358549] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:12:31.657886] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-15T17:12:32.457892] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-15T17:12:32.977397] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:12:33.257917] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-15T17:12:33.781869] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:12:33.909978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:12:34.057930] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-15T17:12:34.857921] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-15T17:12:35.657831] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-15T17:12:35.711600] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:12:36.050251] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:12:36.457869] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-15T17:12:36.754950] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:12:37.257887] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-15T17:12:37.901072] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:12:38.057911] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-15T17:12:38.848888] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:12:38.860039] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-15T17:12:39.508001] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:12:39.546525] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:12:39.657902] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-15T17:12:40.457927] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-15T17:12:41.257888] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-15T17:12:41.326202] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:12:41.760916] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:12:42.057893] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-15T17:12:42.318188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:12:42.857907] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-15T17:12:43.292329] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:12:43.657880] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-15T17:12:44.380771] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:12:44.457857] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-15T17:12:44.916203] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:12:44.922390] [INFO ] [REMOTE ] AOS: Full fetch complete (53745 records). [2025-09-15T17:12:44.922514] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-15T17:12:45.260960] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-15T17:12:45.310951] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-15T17:12:45.311054] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-15T17:12:45.311738] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-15T17:12:45.311796] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-15T17:12:45.313306] [DEBUG] [LOCAL ] AOS: Trimmed 53745 records to 36309 (keeping 150 days of data) [2025-09-15T17:12:45.541938] [DEBUG] [LOCAL ] AOS: Primary data saved (36309 records). [2025-09-15T17:12:45.542089] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-15T17:12:45.542177] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AOS took 32.3s. Estimated remaining: 3h 46m 8s. Rate: 9.9 symbols/min [2025-09-15T17:12:45.714541] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:45.751210] [DEBUG] [LOCAL ] APG: Loaded 38148 existing records from primary storage. [2025-09-15T17:12:45.751384] [INFO ] [MAIN ] APG: Loaded 38148 existing records. [2025-09-15T17:12:45.937866] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:45.938667] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-15T17:12:45.938726] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-15T17:12:45.940378] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-15T17:12:45.940438] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-15T17:12:46.059583] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-15T17:12:46.345174] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T17:12:46.351146] [INFO ] [REMOTE ] APG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:46.743625] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:12:46.809162] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:12:46.857833] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-15T17:12:47.657889] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-15T17:12:48.180508] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:12:48.252636] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:12:48.254002] [INFO ] [REMOTE ] AP: Full fetch complete (7010 records). [2025-09-15T17:12:48.254074] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-15T17:12:48.462991] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-15T17:12:48.619521] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-15T17:12:48.619602] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-15T17:12:48.619812] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-15T17:12:48.619858] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-15T17:12:48.620291] [DEBUG] [LOCAL ] AP: Trimmed 7010 records to 5760 (keeping 150 days of data) [2025-09-15T17:12:48.654484] [DEBUG] [LOCAL ] AP: Primary data saved (5760 records). [2025-09-15T17:12:48.654602] [INFO ] [MAIN ] AP: Full history saved. [2025-09-15T17:12:48.654701] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AP took 27.0s. Estimated remaining: 3h 45m 11s. Rate: 10.0 symbols/min [2025-09-15T17:12:48.831479] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:48.878954] [DEBUG] [LOCAL ] APH: Loaded 40431 existing records from primary storage. [2025-09-15T17:12:48.879174] [INFO ] [MAIN ] APH: Loaded 40431 existing records. [2025-09-15T17:12:49.058901] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:49.059189] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-15T17:12:49.059252] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-15T17:12:49.060814] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-15T17:12:49.060867] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-15T17:12:49.263154] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-15T17:12:49.420466] [INFO ] [REMOTE ] APH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:49.499248] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:12:49.503382] [INFO ] [REMOTE ] APAM: Full fetch complete (39961 records). [2025-09-15T17:12:49.503469] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-15T17:12:49.889899] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-15T17:12:49.889999] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-15T17:12:49.890545] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-15T17:12:49.890591] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-15T17:12:49.891634] [DEBUG] [LOCAL ] APAM: Trimmed 39961 records to 26710 (keeping 150 days of data) [2025-09-15T17:12:50.058116] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-15T17:12:50.069323] [DEBUG] [LOCAL ] APAM: Primary data saved (26710 records). [2025-09-15T17:12:50.069858] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-15T17:12:50.069964] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. APAM took 24.6s. Estimated remaining: 3h 43m 44s. Rate: 10.0 symbols/min [2025-09-15T17:12:50.239168] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:50.281740] [DEBUG] [LOCAL ] APLE: Loaded 39120 existing records from primary storage. [2025-09-15T17:12:50.281889] [INFO ] [MAIN ] APLE: Loaded 39120 existing records. [2025-09-15T17:12:50.456659] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:50.456949] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-15T17:12:50.456996] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-15T17:12:50.458697] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-15T17:12:50.458753] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-15T17:12:50.814111] [INFO ] [REMOTE ] APLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:50.857862] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-15T17:12:51.026126] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:12:51.657925] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-15T17:12:51.980463] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:12:52.164144] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:12:52.457935] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-15T17:12:52.947905] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:12:53.257913] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-15T17:12:54.057927] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-15T17:12:54.351816] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:12:54.743141] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:12:54.857897] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-15T17:12:55.656249] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:12:55.665566] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-15T17:12:56.295470] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:12:56.457881] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-15T17:12:57.232966] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:12:57.257815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-15T17:12:57.750925] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:12:58.057876] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-15T17:12:58.579634] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:12:58.857927] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-15T17:12:59.465260] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:12:59.469924] [INFO ] [REMOTE ] APD: Full fetch complete (49708 records). [2025-09-15T17:12:59.470044] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-15T17:12:59.665621] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-15T17:12:59.865926] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-15T17:12:59.866036] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-15T17:12:59.866607] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-15T17:12:59.866666] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-15T17:12:59.868003] [DEBUG] [LOCAL ] APD: Trimmed 49708 records to 33036 (keeping 150 days of data) [2025-09-15T17:13:00.079961] [DEBUG] [LOCAL ] APD: Primary data saved (33036 records). [2025-09-15T17:13:00.080109] [INFO ] [MAIN ] APD: Full history saved. [2025-09-15T17:13:00.080841] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APD took 31.0s. Estimated remaining: 3h 44m 48s. Rate: 10.0 symbols/min [2025-09-15T17:13:00.252350] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:00.286193] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:13:00.332289] [DEBUG] [LOCAL ] APO: Loaded 40146 existing records from primary storage. [2025-09-15T17:13:00.332452] [INFO ] [MAIN ] APO: Loaded 40146 existing records. [2025-09-15T17:13:00.462930] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-15T17:13:00.514129] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:00.514398] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-15T17:13:00.514458] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-15T17:13:00.516199] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-15T17:13:00.516255] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-15T17:13:00.873609] [INFO ] [REMOTE ] APO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:01.257856] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-15T17:13:01.352495] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:13:02.057889] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-15T17:13:02.115488] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:13:02.857874] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-15T17:13:03.098344] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:13:03.657848] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-15T17:13:03.691834] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:13:04.457871] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-15T17:13:04.554553] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:13:04.899030] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:13:05.257895] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-15T17:13:06.057898] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-15T17:13:06.399854] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T17:13:06.767752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T17:13:06.857893] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-15T17:13:07.294595] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:13:07.300567] [INFO ] [REMOTE ] APG: Full fetch complete (54474 records). [2025-09-15T17:13:07.300730] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-15T17:13:07.661910] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-15T17:13:07.698566] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-15T17:13:07.698673] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-15T17:13:07.699290] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-15T17:13:07.699344] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-15T17:13:07.700615] [DEBUG] [LOCAL ] APG: Trimmed 54474 records to 37503 (keeping 150 days of data) [2025-09-15T17:13:07.930894] [DEBUG] [LOCAL ] APG: Primary data saved (37503 records). [2025-09-15T17:13:07.931048] [INFO ] [MAIN ] APG: Full history saved. [2025-09-15T17:13:07.931140] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 22.4s. Estimated remaining: 3h 45m 13s. Rate: 9.9 symbols/min [2025-09-15T17:13:08.102208] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:08.109487] [DEBUG] [LOCAL ] APOS: Loaded 5346 existing records from primary storage. [2025-09-15T17:13:08.109627] [INFO ] [MAIN ] APOS: Loaded 5346 existing records. [2025-09-15T17:13:08.294040] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:08.294326] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-15T17:13:08.294375] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-15T17:13:08.294755] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-15T17:13:08.294807] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-15T17:13:08.468274] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-15T17:13:08.656589] [INFO ] [REMOTE ] APOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:08.687009] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:13:09.130701] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:13:09.257940] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-15T17:13:10.057849] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-15T17:13:10.144742] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:13:10.494291] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T17:13:10.857884] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-15T17:13:11.572958] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:13:11.655843] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:13:11.665764] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-15T17:13:12.231581] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:13:12.457873] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-15T17:13:13.257901] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-15T17:13:13.951905] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:13:14.057875] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-15T17:13:14.114478] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:13:14.120096] [INFO ] [REMOTE ] APLE: Full fetch complete (56350 records). [2025-09-15T17:13:14.120196] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-15T17:13:14.499097] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-15T17:13:14.499222] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-15T17:13:14.499833] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-15T17:13:14.499878] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-15T17:13:14.501021] [DEBUG] [LOCAL ] APLE: Trimmed 56350 records to 38334 (keeping 150 days of data) [2025-09-15T17:13:14.741743] [DEBUG] [LOCAL ] APLE: Primary data saved (38334 records). [2025-09-15T17:13:14.741898] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-15T17:13:14.744509] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 24.7s. Estimated remaining: 3h 45m 20s. Rate: 9.9 symbols/min [2025-09-15T17:13:14.860334] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-15T17:13:14.877349] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:13:14.937207] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:14.981813] [DEBUG] [LOCAL ] APTV: Loaded 39109 existing records from primary storage. [2025-09-15T17:13:14.982102] [INFO ] [MAIN ] APTV: Loaded 39109 existing records. [2025-09-15T17:13:15.174030] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:15.174430] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-15T17:13:15.174486] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-15T17:13:15.176299] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-15T17:13:15.176362] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-15T17:13:15.570008] [INFO ] [REMOTE ] APTV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:15.657879] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-15T17:13:16.135185] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T17:13:16.457887] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-15T17:13:17.077055] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-15T17:13:17.257920] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-15T17:13:17.994859] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:13:18.057851] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-15T17:13:18.857946] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-15T17:13:19.233844] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T17:13:19.515446] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:13:19.657923] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-15T17:13:20.457949] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-15T17:13:20.768952] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T17:13:21.141910] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:13:21.142737] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:13:21.257858] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-15T17:13:22.057896] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-15T17:13:22.857889] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-15T17:13:23.166795] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T17:13:23.531753] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:13:23.541714] [INFO ] [REMOTE ] APH: Full fetch complete (58371 records). [2025-09-15T17:13:23.541870] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-15T17:13:23.662976] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-15T17:13:23.926390] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-15T17:13:23.926488] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-15T17:13:23.927135] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-15T17:13:23.927185] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-15T17:13:23.928599] [DEBUG] [LOCAL ] APH: Trimmed 58371 records to 39651 (keeping 150 days of data) [2025-09-15T17:13:24.187275] [DEBUG] [LOCAL ] APH: Primary data saved (39651 records). [2025-09-15T17:13:24.187443] [INFO ] [MAIN ] APH: Full history saved. [2025-09-15T17:13:24.188238] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APH took 35.5s. Estimated remaining: 3h 46m 12s. Rate: 9.9 symbols/min [2025-09-15T17:13:24.359834] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:24.400120] [DEBUG] [LOCAL ] AQN: Loaded 38906 existing records from primary storage. [2025-09-15T17:13:24.400267] [INFO ] [MAIN ] AQN: Loaded 38906 existing records. [2025-09-15T17:13:24.467965] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-15T17:13:24.579450] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:24.579790] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-15T17:13:24.579911] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-15T17:13:24.581253] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-15T17:13:24.581319] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-15T17:13:24.890591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T17:13:24.977961] [INFO ] [REMOTE ] AQN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:24.990878] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T17:13:24.992298] [INFO ] [REMOTE ] APOS: Full fetch complete (8098 records). [2025-09-15T17:13:24.992368] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-15T17:13:25.263199] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-15T17:13:25.344137] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-15T17:13:25.344219] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-15T17:13:25.344427] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-15T17:13:25.344465] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-15T17:13:25.344892] [DEBUG] [LOCAL ] APOS: Trimmed 8098 records to 5181 (keeping 150 days of data) [2025-09-15T17:13:25.378439] [DEBUG] [LOCAL ] APOS: Primary data saved (5181 records). [2025-09-15T17:13:25.378609] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-15T17:13:25.378725] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APOS took 17.4s. Estimated remaining: 3h 44m 44s. Rate: 9.9 symbols/min [2025-09-15T17:13:25.545468] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:25.549855] [DEBUG] [LOCAL ] AQNB: Loaded 2963 existing records from primary storage. [2025-09-15T17:13:25.549932] [INFO ] [MAIN ] AQNB: Loaded 2963 existing records. [2025-09-15T17:13:25.731078] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:25.731445] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-15T17:13:25.731555] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-15T17:13:25.731824] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-15T17:13:25.731895] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-15T17:13:25.848743] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-15T17:13:25.909789] [INFO ] [REMOTE ] APO: Full fetch complete (58025 records). [2025-09-15T17:13:25.971193] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-15T17:13:26.074347] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-15T17:13:26.214340] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:26.518984] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-15T17:13:26.519102] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-15T17:13:26.520166] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-15T17:13:26.520260] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-15T17:13:26.523490] [DEBUG] [LOCAL ] APO: Trimmed 58025 records to 39369 (keeping 150 days of data) [2025-09-15T17:13:26.663145] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:13:26.830017] [DEBUG] [LOCAL ] APO: Primary data saved (39369 records). [2025-09-15T17:13:26.830173] [INFO ] [MAIN ] APO: Full history saved. [2025-09-15T17:13:26.830726] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 26.7s. Estimated remaining: 3h 43m 22s. Rate: 10.0 symbols/min [2025-09-15T17:13:26.862956] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-15T17:13:27.007075] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:27.049496] [DEBUG] [LOCAL ] AR: Loaded 40342 existing records from primary storage. [2025-09-15T17:13:27.049688] [INFO ] [MAIN ] AR: Loaded 40342 existing records. [2025-09-15T17:13:27.224817] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:27.229976] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-15T17:13:27.230066] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-15T17:13:27.231441] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-15T17:13:27.231497] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-15T17:13:27.515336] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:13:27.591281] [INFO ] [REMOTE ] AR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:27.657885] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-15T17:13:27.914265] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T17:13:28.457878] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-15T17:13:28.797269] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:13:29.073320] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:13:29.257919] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-15T17:13:30.057878] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-15T17:13:30.857881] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-15T17:13:31.061770] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:13:31.211992] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-15T17:13:31.519395] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:13:31.657892] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-15T17:13:32.457933] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-15T17:13:33.173564] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:13:33.257824] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-15T17:13:34.057876] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-15T17:13:34.221164] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:13:34.386533] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T17:13:34.556163] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:13:34.857915] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-15T17:13:35.657900] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-15T17:13:36.259294] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:13:36.457883] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-15T17:13:36.519430] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:13:37.257881] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-15T17:13:38.057869] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-15T17:13:38.284047] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T17:13:38.482499] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:13:38.857888] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-15T17:13:38.946409] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:13:39.657906] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-15T17:13:40.198485] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:13:40.457857] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-15T17:13:41.080624] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:13:41.257873] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-15T17:13:41.900145] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:13:42.057899] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-15T17:13:42.625969] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:13:42.631812] [INFO ] [REMOTE ] APTV: Full fetch complete (56896 records). [2025-09-15T17:13:42.631933] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-15T17:13:42.863057] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-15T17:13:43.020373] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-15T17:13:43.020468] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-15T17:13:43.021102] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-15T17:13:43.021151] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-15T17:13:43.022753] [DEBUG] [LOCAL ] APTV: Trimmed 56896 records to 38330 (keeping 150 days of data) [2025-09-15T17:13:43.264636] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:13:43.299175] [DEBUG] [LOCAL ] APTV: Primary data saved (38330 records). [2025-09-15T17:13:43.299302] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-15T17:13:43.299409] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APTV took 28.6s. Estimated remaining: 3h 46m 9s. Rate: 9.9 symbols/min [2025-09-15T17:13:43.465600] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:43.500222] [DEBUG] [LOCAL ] ARCO: Loaded 33598 existing records from primary storage. [2025-09-15T17:13:43.500362] [INFO ] [MAIN ] ARCO: Loaded 33598 existing records. [2025-09-15T17:13:43.672818] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-15T17:13:43.677279] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:43.678162] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-15T17:13:43.678210] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-15T17:13:43.679942] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-15T17:13:43.680000] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-15T17:13:44.043778] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:44.457915] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-15T17:13:44.741448] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T17:13:44.814981] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T17:13:45.060856] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:13:45.066469] [INFO ] [REMOTE ] AQN: Full fetch complete (56594 records). [2025-09-15T17:13:45.066571] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-15T17:13:45.267280] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-15T17:13:45.457130] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-15T17:13:45.457245] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-15T17:13:45.458427] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-15T17:13:45.458487] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-15T17:13:45.460287] [DEBUG] [LOCAL ] AQN: Trimmed 56594 records to 38142 (keeping 150 days of data) [2025-09-15T17:13:45.720511] [DEBUG] [LOCAL ] AQN: Primary data saved (38142 records). [2025-09-15T17:13:45.720855] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-15T17:13:45.721441] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. AQN took 21.5s. Estimated remaining: 3h 45m 3s. Rate: 9.9 symbols/min [2025-09-15T17:13:45.893806] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:45.908747] [DEBUG] [LOCAL ] ARDC: Loaded 10479 existing records from primary storage. [2025-09-15T17:13:45.908891] [INFO ] [MAIN ] ARDC: Loaded 10479 existing records. [2025-09-15T17:13:46.063075] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-15T17:13:46.094295] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:46.094603] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-15T17:13:46.094696] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-15T17:13:46.095383] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-15T17:13:46.095442] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-15T17:13:46.464119] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:46.780763] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:13:46.782024] [INFO ] [REMOTE ] AQNB: Full fetch complete (4399 records). [2025-09-15T17:13:46.782099] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-15T17:13:46.863085] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-15T17:13:47.147296] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-15T17:13:47.147478] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-15T17:13:47.147796] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-15T17:13:47.147889] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-15T17:13:47.148585] [DEBUG] [LOCAL ] AQNB: Trimmed 4399 records to 2896 (keeping 150 days of data) [2025-09-15T17:13:47.196755] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T17:13:47.211756] [DEBUG] [LOCAL ] AQNB: Primary data saved (2896 records). [2025-09-15T17:13:47.211878] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-15T17:13:47.212009] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQNB took 21.8s. Estimated remaining: 3h 43m 43s. Rate: 10.0 symbols/min [2025-09-15T17:13:47.415996] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:47.443505] [DEBUG] [LOCAL ] ARDT: Loaded 20242 existing records from primary storage. [2025-09-15T17:13:47.443709] [INFO ] [MAIN ] ARDT: Loaded 20242 existing records. [2025-09-15T17:13:47.617340] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:47.617567] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-15T17:13:47.617612] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-15T17:13:47.618434] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-15T17:13:47.618486] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-15T17:13:47.663193] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-15T17:13:47.970560] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:48.453261] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:13:48.461588] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-15T17:13:48.731296] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:13:49.257873] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-15T17:13:49.483527] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T17:13:50.057950] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-15T17:13:50.335632] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:13:50.857904] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-15T17:13:51.657914] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-15T17:13:51.860828] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T17:13:51.963124] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T17:13:52.251855] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:13:52.457937] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-15T17:13:53.176955] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:13:53.257855] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-15T17:13:53.776633] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:13:54.057893] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-15T17:13:54.702352] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:13:54.857892] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-15T17:13:55.657884] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-15T17:13:56.423456] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:13:56.457931] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-15T17:13:57.037957] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:13:57.257929] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-15T17:13:57.553257] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:13:58.057857] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-15T17:13:58.460198] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:13:58.857847] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-15T17:13:59.657876] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-15T17:13:59.839309] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:14:00.079452] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:14:00.457877] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-15T17:14:00.478396] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T17:14:01.257880] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-15T17:14:01.504276] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:14:02.057921] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-15T17:14:02.060820] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:14:02.857890] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-15T17:14:03.657913] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-15T17:14:03.893382] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:14:03.985054] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T17:14:03.990999] [INFO ] [REMOTE ] AR: Full fetch complete (58261 records). [2025-09-15T17:14:03.991104] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-15T17:14:04.368512] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-15T17:14:04.368599] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-15T17:14:04.369210] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-15T17:14:04.369284] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-15T17:14:04.370615] [DEBUG] [LOCAL ] AR: Trimmed 58261 records to 39562 (keeping 150 days of data) [2025-09-15T17:14:04.463753] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-15T17:14:04.624458] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:14:04.630543] [DEBUG] [LOCAL ] AR: Primary data saved (39562 records). [2025-09-15T17:14:04.632981] [INFO ] [MAIN ] AR: Full history saved. [2025-09-15T17:14:04.633995] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AR took 37.8s. Estimated remaining: 3h 46m 41s. Rate: 9.8 symbols/min [2025-09-15T17:14:04.634421] [INFO ] [REMOTE ] ARDC: Full fetch complete (16039 records). [2025-09-15T17:14:04.646343] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-15T17:14:04.951114] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:05.195045] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-15T17:14:05.195152] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-15T17:14:05.195460] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-15T17:14:05.195499] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-15T17:14:05.196038] [DEBUG] [LOCAL ] ARDC: Trimmed 16039 records to 10313 (keeping 150 days of data) [2025-09-15T17:14:05.258145] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-15T17:14:05.258026] [DEBUG] [LOCAL ] ARE: Loaded 38314 existing records from primary storage. [2025-09-15T17:14:05.259197] [INFO ] [MAIN ] ARE: Loaded 38314 existing records. [2025-09-15T17:14:05.448254] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:05.449324] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-15T17:14:05.450291] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-15T17:14:05.453655] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-15T17:14:05.455012] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-15T17:14:05.563967] [DEBUG] [LOCAL ] ARDC: Primary data saved (10313 records). [2025-09-15T17:14:05.575030] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-15T17:14:05.592358] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. ARDC took 19.9s. Estimated remaining: 3h 45m 12s. Rate: 9.9 symbols/min [2025-09-15T17:14:06.004376] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:06.027945] [INFO ] [REMOTE ] ARE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:06.030374] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:14:06.058409] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-15T17:14:06.076115] [DEBUG] [LOCAL ] ARES: Loaded 36960 existing records from primary storage. [2025-09-15T17:14:06.076266] [INFO ] [MAIN ] ARES: Loaded 36960 existing records. [2025-09-15T17:14:06.255611] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:06.255916] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-15T17:14:06.255963] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-15T17:14:06.257572] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-15T17:14:06.257626] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-15T17:14:06.614454] [INFO ] [REMOTE ] ARES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:06.641040] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:14:06.857883] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-15T17:14:07.401239] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:14:07.657871] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-15T17:14:08.457854] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-15T17:14:08.543539] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:14:08.758485] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:14:08.762400] [INFO ] [REMOTE ] ARDT: Full fetch complete (31384 records). [2025-09-15T17:14:08.762629] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-15T17:14:09.157167] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-15T17:14:09.157304] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-15T17:14:09.157899] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-15T17:14:09.158039] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-15T17:14:09.159384] [DEBUG] [LOCAL ] ARDT: Trimmed 31384 records to 19778 (keeping 150 days of data) [2025-09-15T17:14:09.260541] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-15T17:14:09.289265] [DEBUG] [LOCAL ] ARDT: Primary data saved (19778 records). [2025-09-15T17:14:09.289564] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-15T17:14:09.289685] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARDT took 22.1s. Estimated remaining: 3h 44m 29s. Rate: 9.9 symbols/min [2025-09-15T17:14:09.461365] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:09.496394] [DEBUG] [LOCAL ] ARI: Loaded 32487 existing records from primary storage. [2025-09-15T17:14:09.496575] [INFO ] [MAIN ] ARI: Loaded 32487 existing records. [2025-09-15T17:14:09.681602] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:09.681899] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-15T17:14:09.681947] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-15T17:14:09.683108] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-15T17:14:09.683161] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-15T17:14:10.040720] [INFO ] [REMOTE ] ARI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:10.067530] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-15T17:14:10.073686] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:14:10.857936] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-15T17:14:11.093159] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:14:11.380001] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:14:11.657858] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-15T17:14:12.093939] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:14:12.101945] [INFO ] [REMOTE ] ARCO: Full fetch complete (48559 records). [2025-09-15T17:14:12.102062] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-15T17:14:12.463118] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-15T17:14:12.521256] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-15T17:14:12.521378] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-15T17:14:12.522054] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-15T17:14:12.522114] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-15T17:14:12.523635] [DEBUG] [LOCAL ] ARCO: Trimmed 48559 records to 32872 (keeping 150 days of data) [2025-09-15T17:14:12.745820] [DEBUG] [LOCAL ] ARCO: Primary data saved (32872 records). [2025-09-15T17:14:12.745995] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-15T17:14:12.746095] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARCO took 29.4s. Estimated remaining: 3h 43m 42s. Rate: 10.0 symbols/min [2025-09-15T17:14:13.022964] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:13.064234] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T17:14:13.121024] [DEBUG] [LOCAL ] ARIS: Loaded 31143 existing records from primary storage. [2025-09-15T17:14:13.121235] [INFO ] [MAIN ] ARIS: Loaded 31143 existing records. [2025-09-15T17:14:13.266681] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-15T17:14:13.404849] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:13.405299] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-15T17:14:13.405353] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-15T17:14:13.407066] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-15T17:14:13.407149] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-15T17:14:13.843662] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:14.057887] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-15T17:14:14.138923] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:14:14.857960] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-15T17:14:14.890432] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:14:15.251283] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:14:15.657904] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-15T17:14:16.457906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-15T17:14:16.612815] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:14:17.257883] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-15T17:14:17.426947] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:14:17.600225] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:14:18.057891] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-15T17:14:18.857921] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-15T17:14:19.098589] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:14:19.379106] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:14:19.657887] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-15T17:14:20.329338] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:14:20.457859] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-15T17:14:21.070352] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:14:21.257869] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-15T17:14:22.028258] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:14:22.057834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-15T17:14:22.783534] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:14:22.857877] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-15T17:14:23.230691] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:14:23.657941] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-15T17:14:23.903421] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:14:24.457875] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-15T17:14:25.150151] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T17:14:25.257891] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-15T17:14:25.947888] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:14:26.057884] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-15T17:14:26.729343] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:14:26.857895] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-15T17:14:27.378617] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:14:27.657903] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-15T17:14:28.340206] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:14:28.347027] [INFO ] [REMOTE ] ARI: Full fetch complete (46867 records). [2025-09-15T17:14:28.347132] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-15T17:14:28.462941] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-15T17:14:28.729390] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-15T17:14:28.729482] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-15T17:14:28.730025] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-15T17:14:28.730078] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-15T17:14:28.731193] [DEBUG] [LOCAL ] ARI: Trimmed 46867 records to 31741 (keeping 150 days of data) [2025-09-15T17:14:28.963986] [DEBUG] [LOCAL ] ARI: Primary data saved (31741 records). [2025-09-15T17:14:28.965543] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:14:28.965921] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-15T17:14:28.966128] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARI took 19.7s. Estimated remaining: 3h 46m 16s. Rate: 9.8 symbols/min [2025-09-15T17:14:29.162340] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:29.202733] [DEBUG] [LOCAL ] ARLO: Loaded 32823 existing records from primary storage. [2025-09-15T17:14:29.202960] [INFO ] [MAIN ] ARLO: Loaded 32823 existing records. [2025-09-15T17:14:29.267153] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-15T17:14:29.391159] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:29.391586] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-15T17:14:29.391663] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-15T17:14:29.393379] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-15T17:14:29.393435] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-15T17:14:29.765364] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:29.966896] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:14:29.972664] [INFO ] [REMOTE ] ARE: Full fetch complete (54854 records). [2025-09-15T17:14:29.972838] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-15T17:14:30.063133] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-15T17:14:30.370932] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-15T17:14:30.371037] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-15T17:14:30.371674] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-15T17:14:30.371721] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-15T17:14:30.373177] [DEBUG] [LOCAL ] ARE: Trimmed 54854 records to 37553 (keeping 150 days of data) [2025-09-15T17:14:30.606908] [DEBUG] [LOCAL ] ARE: Primary data saved (37553 records). [2025-09-15T17:14:30.607072] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-15T17:14:30.607178] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARE took 26.0s. Estimated remaining: 3h 45m 0s. Rate: 9.9 symbols/min [2025-09-15T17:14:30.789518] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:30.826870] [DEBUG] [LOCAL ] ARMK: Loaded 37720 existing records from primary storage. [2025-09-15T17:14:30.827017] [INFO ] [MAIN ] ARMK: Loaded 37720 existing records. [2025-09-15T17:14:30.869572] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-15T17:14:31.013678] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:31.014094] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-15T17:14:31.014148] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-15T17:14:31.015984] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-15T17:14:31.016122] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-15T17:14:31.152628] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:14:31.435939] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:31.459420] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:14:31.657895] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-15T17:14:32.443955] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:14:32.457827] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-15T17:14:32.896294] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:14:33.257882] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-15T17:14:33.737042] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:14:34.057869] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-15T17:14:34.865200] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-15T17:14:34.869903] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:14:35.110981] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:14:35.116838] [INFO ] [REMOTE ] ARIS: Full fetch complete (45524 records). [2025-09-15T17:14:35.116986] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-15T17:14:35.509458] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-15T17:14:35.509566] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-15T17:14:35.510306] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-15T17:14:35.510353] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-15T17:14:35.511887] [DEBUG] [LOCAL ] ARIS: Trimmed 45524 records to 30434 (keeping 150 days of data) [2025-09-15T17:14:35.668181] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-15T17:14:35.705225] [DEBUG] [LOCAL ] ARIS: Primary data saved (30434 records). [2025-09-15T17:14:35.705375] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-15T17:14:35.705499] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARIS took 23.0s. Estimated remaining: 3h 44m 39s. Rate: 9.9 symbols/min [2025-09-15T17:14:35.876201] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:35.917170] [DEBUG] [LOCAL ] AROC: Loaded 36498 existing records from primary storage. [2025-09-15T17:14:35.917341] [INFO ] [MAIN ] AROC: Loaded 36498 existing records. [2025-09-15T17:14:36.095299] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:36.095587] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-15T17:14:36.095639] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-15T17:14:36.097100] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-15T17:14:36.097154] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-15T17:14:36.460814] [INFO ] [REMOTE ] AROC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:36.460962] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-15T17:14:36.515512] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:14:37.075505] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:14:37.081028] [INFO ] [REMOTE ] ARES: Full fetch complete (53938 records). [2025-09-15T17:14:37.081145] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-15T17:14:37.271234] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-15T17:14:37.473019] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-15T17:14:37.473123] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-15T17:14:37.473819] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-15T17:14:37.473873] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-15T17:14:37.475303] [DEBUG] [LOCAL ] ARES: Trimmed 53938 records to 36190 (keeping 150 days of data) [2025-09-15T17:14:37.723170] [DEBUG] [LOCAL ] ARES: Primary data saved (36190 records). [2025-09-15T17:14:37.723346] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-15T17:14:37.723446] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARES took 32.1s. Estimated remaining: 3h 43m 31s. Rate: 9.9 symbols/min [2025-09-15T17:14:37.923780] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:37.925484] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:14:37.973991] [DEBUG] [LOCAL ] ARR: Loaded 39076 existing records from primary storage. [2025-09-15T17:14:37.974162] [INFO ] [MAIN ] ARR: Loaded 39076 existing records. [2025-09-15T17:14:38.065711] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-15T17:14:38.162634] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:38.162993] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-15T17:14:38.163047] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-15T17:14:38.164889] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-15T17:14:38.164982] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-15T17:14:38.541804] [INFO ] [REMOTE ] ARR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:38.759834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:14:38.857914] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-15T17:14:39.657893] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-15T17:14:39.829306] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T17:14:40.088303] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:14:40.457883] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-15T17:14:41.257849] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-15T17:14:41.576849] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:14:41.883836] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:14:42.057868] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-15T17:14:42.508676] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:14:42.857870] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-15T17:14:43.186973] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:14:43.657894] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-15T17:14:43.867609] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:14:44.457912] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-15T17:14:44.999961] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:14:45.257876] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-15T17:14:46.057953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-15T17:14:46.095342] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T17:14:46.699607] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:14:46.857901] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-15T17:14:47.657884] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-15T17:14:47.740312] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:14:48.035560] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:14:48.457903] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-15T17:14:49.257878] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-15T17:14:49.440434] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:14:49.988066] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:14:49.993529] [INFO ] [REMOTE ] ARLO: Full fetch complete (47560 records). [2025-09-15T17:14:49.993806] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-15T17:14:50.063058] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-15T17:14:50.407500] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-15T17:14:50.407588] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-15T17:14:50.408152] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-15T17:14:50.408197] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-15T17:14:50.409477] [DEBUG] [LOCAL ] ARLO: Trimmed 47560 records to 32320 (keeping 150 days of data) [2025-09-15T17:14:50.611387] [DEBUG] [LOCAL ] ARLO: Primary data saved (32320 records). [2025-09-15T17:14:50.611533] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-15T17:14:50.611618] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 21.6s. Estimated remaining: 3h 45m 10s. Rate: 9.9 symbols/min [2025-09-15T17:14:50.788756] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:50.813599] [DEBUG] [LOCAL ] ARW: Loaded 24276 existing records from primary storage. [2025-09-15T17:14:50.813762] [INFO ] [MAIN ] ARW: Loaded 24276 existing records. [2025-09-15T17:14:50.867612] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-15T17:14:51.020895] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:14:51.035469] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:51.036268] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-15T17:14:51.036322] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-15T17:14:51.037269] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-15T17:14:51.037328] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-15T17:14:51.393943] [INFO ] [REMOTE ] ARW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:51.657872] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-15T17:14:51.828175] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:14:52.457958] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-15T17:14:52.496328] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:14:53.012899] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:14:53.257870] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-15T17:14:54.057899] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-15T17:14:54.271175] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:14:54.770727] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:14:54.857949] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-15T17:14:55.534143] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:14:55.542190] [INFO ] [REMOTE ] AROC: Full fetch complete (53242 records). [2025-09-15T17:14:55.542374] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-15T17:14:55.662959] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-15T17:14:55.927738] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-15T17:14:55.927822] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-15T17:14:55.928373] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-15T17:14:55.928416] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-15T17:14:55.929956] [DEBUG] [LOCAL ] AROC: Trimmed 53242 records to 35804 (keeping 150 days of data) [2025-09-15T17:14:56.150075] [DEBUG] [LOCAL ] AROC: Primary data saved (35804 records). [2025-09-15T17:14:56.150221] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-15T17:14:56.151229] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. AROC took 20.4s. Estimated remaining: 3h 44m 55s. Rate: 9.9 symbols/min [2025-09-15T17:14:56.326079] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:56.326370] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-15T17:14:56.326445] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-15T17:14:56.326689] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-15T17:14:56.326796] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-15T17:14:56.326853] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-15T17:14:56.326899] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-15T17:14:56.460797] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-15T17:14:56.726748] [INFO ] [REMOTE ] ARX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:56.728664] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T17:14:57.257963] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-15T17:14:57.516837] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:14:57.628091] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:14:58.057935] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-15T17:14:58.855823] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:14:58.865401] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-15T17:14:59.077581] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:14:59.077924] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-15T17:14:59.657902] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-15T17:14:59.972213] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T17:15:00.457897] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-15T17:15:01.257879] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-15T17:15:01.377182] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:15:01.382958] [INFO ] [REMOTE ] ARMK: Full fetch complete (54672 records). [2025-09-15T17:15:01.383120] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-15T17:15:01.840814] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-15T17:15:01.840917] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-15T17:15:01.841548] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-15T17:15:01.841605] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-15T17:15:01.843157] [DEBUG] [LOCAL ] ARMK: Trimmed 54672 records to 37030 (keeping 150 days of data) [2025-09-15T17:15:02.060221] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-15T17:15:02.090869] [DEBUG] [LOCAL ] ARMK: Primary data saved (37030 records). [2025-09-15T17:15:02.091039] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-15T17:15:02.091579] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARMK took 31.5s. Estimated remaining: 3h 44m 47s. Rate: 9.9 symbols/min [2025-09-15T17:15:02.284793] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:02.328826] [DEBUG] [LOCAL ] AS: Loaded 39972 existing records from primary storage. [2025-09-15T17:15:02.329018] [INFO ] [MAIN ] AS: Loaded 39972 existing records. [2025-09-15T17:15:02.519742] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:02.520602] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-15T17:15:02.554171] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-15T17:15:02.556595] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T17:15:02.556670] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-15T17:15:02.568472] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-15T17:15:02.862973] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-15T17:15:02.977430] [INFO ] [REMOTE ] AS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:03.657919] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-15T17:15:03.805451] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:03.805698] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-15T17:15:04.457878] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-15T17:15:04.529415] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (3.27 seconds). [2025-09-15T17:15:04.779100] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:04.779406] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-15T17:15:04.995055] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-15T17:15:05.257895] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-15T17:15:05.694581] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T17:15:06.057938] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-15T17:15:06.857912] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-15T17:15:06.945862] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:15:06.952043] [INFO ] [REMOTE ] ARR: Full fetch complete (56608 records). [2025-09-15T17:15:06.952199] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-15T17:15:07.082098] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:07.118123] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-15T17:15:07.360406] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-15T17:15:07.360505] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-15T17:15:07.361117] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-15T17:15:07.361172] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-15T17:15:07.362660] [DEBUG] [LOCAL ] ARR: Trimmed 56608 records to 38305 (keeping 150 days of data) [2025-09-15T17:15:07.613875] [DEBUG] [LOCAL ] ARR: Primary data saved (38305 records). [2025-09-15T17:15:07.614039] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-15T17:15:07.614811] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARR took 29.9s. Estimated remaining: 3h 44m 33s. Rate: 9.9 symbols/min [2025-09-15T17:15:07.667724] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-15T17:15:07.817024] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:07.855602] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:15:07.872227] [DEBUG] [LOCAL ] ASA: Loaded 10448 existing records from primary storage. [2025-09-15T17:15:07.872386] [INFO ] [MAIN ] ASA: Loaded 10448 existing records. [2025-09-15T17:15:08.053417] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:08.053728] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-15T17:15:08.053779] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-15T17:15:08.054205] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-15T17:15:08.054260] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-15T17:15:08.425461] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:08.457883] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-15T17:15:09.003598] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:15:09.257942] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-15T17:15:09.918827] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:15:10.057940] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-15T17:15:10.242086] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:15:10.803493] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:15:10.857886] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-15T17:15:11.657876] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-15T17:15:12.106113] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:12.106457] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-15T17:15:12.457881] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-15T17:15:13.257932] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-15T17:15:13.571665] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-15T17:15:13.895412] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:15:14.028963] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:15:14.057847] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-15T17:15:14.857906] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-15T17:15:14.942566] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:15:14.946899] [INFO ] [REMOTE ] ARW: Full fetch complete (36058 records). [2025-09-15T17:15:14.947019] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-15T17:15:15.314871] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-15T17:15:15.314958] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-15T17:15:15.315358] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-15T17:15:15.315410] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-15T17:15:15.316940] [DEBUG] [LOCAL ] ARW: Trimmed 36058 records to 23693 (keeping 150 days of data) [2025-09-15T17:15:15.462193] [DEBUG] [LOCAL ] ARW: Primary data saved (23693 records). [2025-09-15T17:15:15.462323] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-15T17:15:15.462439] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 24.9s. Estimated remaining: 3h 44m 53s. Rate: 9.9 symbols/min [2025-09-15T17:15:15.633762] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:15.659473] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-15T17:15:15.678138] [DEBUG] [LOCAL ] ASAN: Loaded 39578 existing records from primary storage. [2025-09-15T17:15:15.678276] [INFO ] [MAIN ] ASAN: Loaded 39578 existing records. [2025-09-15T17:15:15.857003] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:15.857274] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-15T17:15:15.857323] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-15T17:15:15.858933] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-15T17:15:15.858989] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-15T17:15:16.206095] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:16.262696] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:15:16.343198] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:15:16.457811] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-15T17:15:17.257911] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-15T17:15:17.712550] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:15:18.057969] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-15T17:15:18.198047] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:15:18.817786] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:15:18.857866] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-15T17:15:19.576984] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:15:19.657878] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-15T17:15:20.437092] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T17:15:20.457845] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-15T17:15:21.257913] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-15T17:15:22.057868] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-15T17:15:22.226529] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:15:22.857867] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-15T17:15:23.011973] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:15:23.657915] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-15T17:15:23.958844] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:15:24.457889] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-15T17:15:25.077770] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-15T17:15:25.083931] [INFO ] [REMOTE ] AS: Full fetch complete (57679 records). [2025-09-15T17:15:25.084114] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-15T17:15:25.269937] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-15T17:15:25.498203] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-15T17:15:25.498356] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-15T17:15:25.499183] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-15T17:15:25.499438] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-15T17:15:25.513038] [DEBUG] [LOCAL ] AS: Trimmed 57679 records to 39205 (keeping 150 days of data) [2025-09-15T17:15:25.514734] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:15:25.520241] [INFO ] [REMOTE ] ARX: Full fetch complete (11666 records). [2025-09-15T17:15:25.520356] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-15T17:15:25.804218] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-15T17:15:25.805599] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:15:25.806267] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:15:25.807030] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-15T17:15:25.807944] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-15T17:15:25.808313] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-15T17:15:25.808909] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-15T17:15:25.809581] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARX took 29.7s. Estimated remaining: 3h 45m 50s. Rate: 9.8 symbols/min [2025-09-15T17:15:25.913161] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T17:15:26.052237] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:26.058105] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-15T17:15:26.192986] [DEBUG] [LOCAL ] ASB: Loaded 36945 existing records from primary storage. [2025-09-15T17:15:26.194586] [INFO ] [MAIN ] ASB: Loaded 36945 existing records. [2025-09-15T17:15:26.389738] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:26.391679] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-15T17:15:26.392155] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-15T17:15:26.410824] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:15:26.411291] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-15T17:15:26.415248] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-15T17:15:26.689527] [DEBUG] [LOCAL ] AS: Primary data saved (39205 records). [2025-09-15T17:15:26.706211] [INFO ] [MAIN ] AS: Full history saved. [2025-09-15T17:15:26.725207] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. AS took 24.6s. Estimated remaining: 3h 44m 28s. Rate: 9.9 symbols/min [2025-09-15T17:15:26.876394] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-15T17:15:26.905757] [INFO ] [REMOTE ] ASB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:26.977831] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:26.989171] [DEBUG] [LOCAL ] ASBA: Loaded 2556 existing records from primary storage. [2025-09-15T17:15:26.989289] [INFO ] [MAIN ] ASBA: Loaded 2556 existing records. [2025-09-15T17:15:27.168778] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:27.169059] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-15T17:15:27.169106] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-15T17:15:27.169332] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-15T17:15:27.169377] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-15T17:15:27.534227] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:27.591427] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:15:27.630037] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:15:27.633152] [INFO ] [REMOTE ] ASA: Full fetch complete (14281 records). [2025-09-15T17:15:27.633237] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-15T17:15:27.663161] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-15T17:15:28.004990] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-15T17:15:28.005076] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-15T17:15:28.005428] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-15T17:15:28.005468] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-15T17:15:28.006038] [DEBUG] [LOCAL ] ASA: Trimmed 14281 records to 10287 (keeping 150 days of data) [2025-09-15T17:15:28.074054] [DEBUG] [LOCAL ] ASA: Primary data saved (10287 records). [2025-09-15T17:15:28.074213] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-15T17:15:28.074306] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASA took 20.5s. Estimated remaining: 3h 43m 14s. Rate: 9.9 symbols/min [2025-09-15T17:15:28.246628] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:28.278794] [DEBUG] [LOCAL ] ASC: Loaded 28033 existing records from primary storage. [2025-09-15T17:15:28.278950] [INFO ] [MAIN ] ASC: Loaded 28033 existing records. [2025-09-15T17:15:28.380844] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:15:28.465209] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-15T17:15:28.465559] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:28.466875] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-15T17:15:28.466942] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-15T17:15:28.468089] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-15T17:15:28.468139] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-15T17:15:28.818044] [INFO ] [REMOTE ] ASC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:28.897858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:15:29.257916] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-15T17:15:29.791105] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:15:30.057913] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-15T17:15:30.857908] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-15T17:15:31.223855] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:15:31.657919] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-15T17:15:32.378791] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:15:32.457832] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-15T17:15:33.017022] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:15:33.257872] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-15T17:15:34.057846] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-15T17:15:34.299407] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T17:15:34.383368] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:15:34.857884] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-15T17:15:35.657878] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-15T17:15:35.816171] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:15:36.082548] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:15:36.428909] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:15:36.457828] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-15T17:15:37.257906] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-15T17:15:38.040967] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:15:38.057852] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-15T17:15:38.475426] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:15:38.857898] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-15T17:15:39.657881] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-15T17:15:39.699078] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:15:39.705230] [INFO ] [REMOTE ] ASAN: Full fetch complete (57366 records). [2025-09-15T17:15:39.705374] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-15T17:15:40.105497] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-15T17:15:40.105582] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-15T17:15:40.106250] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-15T17:15:40.106313] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-15T17:15:40.107593] [DEBUG] [LOCAL ] ASAN: Trimmed 57366 records to 38828 (keeping 150 days of data) [2025-09-15T17:15:40.358785] [DEBUG] [LOCAL ] ASAN: Primary data saved (38828 records). [2025-09-15T17:15:40.358940] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-15T17:15:40.359038] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASAN took 24.9s. Estimated remaining: 3h 44m 37s. Rate: 9.9 symbols/min [2025-09-15T17:15:40.464263] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-15T17:15:40.572664] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:15:40.575023] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:40.603266] [DEBUG] [LOCAL ] ASG: Loaded 14539 existing records from primary storage. [2025-09-15T17:15:40.603416] [INFO ] [MAIN ] ASG: Loaded 14539 existing records. [2025-09-15T17:15:40.787834] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:40.788096] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-15T17:15:40.788146] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-15T17:15:40.788678] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-15T17:15:40.788751] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-15T17:15:41.086119] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:15:41.168419] [INFO ] [REMOTE ] ASG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:41.194773] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:15:41.257863] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-15T17:15:42.057901] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-15T17:15:42.608272] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T17:15:42.656763] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:15:42.857877] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-15T17:15:43.657878] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-15T17:15:44.428306] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:15:44.457832] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-15T17:15:44.750993] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:15:45.257893] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-15T17:15:46.057944] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-15T17:15:46.143529] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:15:46.444185] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T17:15:46.565750] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:15:46.857906] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-15T17:15:47.657889] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-15T17:15:48.464294] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-15T17:15:48.467444] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T17:15:48.471576] [INFO ] [REMOTE ] ASC: Full fetch complete (42045 records). [2025-09-15T17:15:48.471681] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-15T17:15:48.864661] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-15T17:15:48.865233] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-15T17:15:48.865769] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-15T17:15:48.866217] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:15:48.866314] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-15T17:15:48.871824] [DEBUG] [LOCAL ] ASC: Trimmed 42045 records to 27506 (keeping 150 days of data) [2025-09-15T17:15:49.040053] [DEBUG] [LOCAL ] ASC: Primary data saved (27506 records). [2025-09-15T17:15:49.040174] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-15T17:15:49.040255] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASC took 21.0s. Estimated remaining: 3h 45m 8s. Rate: 9.8 symbols/min [2025-09-15T17:15:49.211135] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:49.213502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:15:49.214673] [INFO ] [REMOTE ] ASBA: Full fetch complete (3752 records). [2025-09-15T17:15:49.214741] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-15T17:15:49.263189] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-15T17:15:49.422368] [DEBUG] [LOCAL ] ASGI: Loaded 16822 existing records from primary storage. [2025-09-15T17:15:49.476937] [INFO ] [MAIN ] ASGI: Loaded 16822 existing records. [2025-09-15T17:15:49.790741] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:49.790930] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-15T17:15:49.791084] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-15T17:15:49.791166] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-15T17:15:49.791316] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-15T17:15:49.791366] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-15T17:15:49.791418] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-15T17:15:49.791917] [DEBUG] [LOCAL ] ASBA: Trimmed 3752 records to 2512 (keeping 150 days of data) [2025-09-15T17:15:49.799094] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-15T17:15:49.800438] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-15T17:15:49.920969] [DEBUG] [LOCAL ] ASBA: Primary data saved (2512 records). [2025-09-15T17:15:49.931313] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-15T17:15:49.959856] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASBA took 23.2s. Estimated remaining: 3h 43m 49s. Rate: 9.9 symbols/min [2025-09-15T17:15:50.072120] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-15T17:15:50.283635] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:50.338735] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:50.366719] [DEBUG] [LOCAL ] ASGN: Loaded 26592 existing records from primary storage. [2025-09-15T17:15:50.366884] [INFO ] [MAIN ] ASGN: Loaded 26592 existing records. [2025-09-15T17:15:50.543664] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:50.543909] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-15T17:15:50.543956] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-15T17:15:50.545239] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-15T17:15:50.545299] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-15T17:15:50.876789] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-15T17:15:50.909725] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:50.967237] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:15:51.002602] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:15:51.657913] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-15T17:15:52.056492] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:15:52.457931] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-15T17:15:53.112251] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:15:53.257880] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-15T17:15:54.057873] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-15T17:15:54.117761] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:15:54.787468] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:15:54.793356] [INFO ] [REMOTE ] ASB: Full fetch complete (53972 records). [2025-09-15T17:15:54.793479] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-15T17:15:54.862986] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-15T17:15:55.198490] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-15T17:15:55.199089] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-15T17:15:55.199504] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:15:55.200172] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-15T17:15:55.204334] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-15T17:15:55.206017] [DEBUG] [LOCAL ] ASB: Trimmed 53972 records to 36181 (keeping 150 days of data) [2025-09-15T17:15:55.434611] [DEBUG] [LOCAL ] ASB: Primary data saved (36181 records). [2025-09-15T17:15:55.434783] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-15T17:15:55.437067] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASB took 29.6s. Estimated remaining: 3h 43m 34s. Rate: 9.9 symbols/min [2025-09-15T17:15:55.657887] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-15T17:15:56.095107] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:15:56.390923] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:15:56.457890] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-15T17:15:57.257878] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-15T17:15:57.762572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:15:58.057892] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-15T17:15:58.350495] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:15:58.857951] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-15T17:15:59.328362] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:15:59.505308] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T17:15:59.657981] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-15T17:16:00.457968] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-15T17:16:00.894598] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:16:01.257873] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-15T17:16:01.536754] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:16:01.947352] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:16:02.057917] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-15T17:16:02.857912] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-15T17:16:03.221257] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:16:03.581558] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:16:03.657868] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-15T17:16:04.336420] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:16:04.457874] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-15T17:16:05.257882] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-15T17:16:06.057855] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-15T17:16:06.273165] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:16:06.387414] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:16:06.863396] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-15T17:16:06.865478] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:16:06.868828] [INFO ] [REMOTE ] ASG: Full fetch complete (23113 records). [2025-09-15T17:16:06.869016] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-15T17:16:07.254407] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-15T17:16:07.254527] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-15T17:16:07.254940] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-15T17:16:07.254987] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-15T17:16:07.255664] [DEBUG] [LOCAL ] ASG: Trimmed 23113 records to 14252 (keeping 150 days of data) [2025-09-15T17:16:07.337756] [DEBUG] [LOCAL ] ASG: Primary data saved (14252 records). [2025-09-15T17:16:07.337903] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-15T17:16:07.338011] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 27.0s. Estimated remaining: 3h 44m 50s. Rate: 9.8 symbols/min [2025-09-15T17:16:07.657886] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-15T17:16:08.113818] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:16:08.118130] [INFO ] [REMOTE ] ASGN: Full fetch complete (39745 records). [2025-09-15T17:16:08.118289] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-15T17:16:08.530678] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-15T17:16:08.530794] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-15T17:16:08.531292] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-15T17:16:08.531345] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-15T17:16:08.532526] [DEBUG] [LOCAL ] ASGN: Trimmed 39745 records to 26147 (keeping 150 days of data) [2025-09-15T17:16:08.692753] [DEBUG] [LOCAL ] ASGN: Primary data saved (26147 records). [2025-09-15T17:16:08.692923] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-15T17:16:08.693027] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 18.7s. Estimated remaining: 3h 43m 38s. Rate: 9.9 symbols/min [2025-09-15T17:16:08.770952] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:16:08.777932] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-15T17:16:09.472362] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T17:16:09.477927] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-15T17:16:10.288942] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:16:10.291857] [INFO ] [REMOTE ] ASGI: Full fetch complete (23807 records). [2025-09-15T17:16:10.291962] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-15T17:16:10.292555] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:10.292672] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:10.292713] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:10.292751] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-15T17:16:10.292811] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-09-15T17:16:10.292875] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-09-15T17:16:10.293256] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-09-15T17:16:10.293349] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGI took 21.3s. Estimated remaining: 3h 42m 30s. Rate: 9.9 symbols/min [2025-09-15T17:16:10.900733] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:10.940427] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.022483] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.063290] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.072383] [DEBUG] [LOCAL ] ASR: Loaded 7112 existing records from primary storage. [2025-09-15T17:16:11.072684] [INFO ] [MAIN ] ASR: Loaded 7112 existing records. [2025-09-15T17:16:11.154041] [DEBUG] [LOCAL ] ASIX: Loaded 17222 existing records from primary storage. [2025-09-15T17:16:11.194994] [INFO ] [MAIN ] ASIX: Loaded 17222 existing records. [2025-09-15T17:16:11.388101] [DEBUG] [LOCAL ] ASH: Loaded 27620 existing records from primary storage. [2025-09-15T17:16:11.407672] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:11.413680] [INFO ] [MAIN ] ASH: Loaded 27620 existing records. [2025-09-15T17:16:11.522212] [DEBUG] [LOCAL ] ASPN: Loaded 37369 existing records from primary storage. [2025-09-15T17:16:11.567090] [INFO ] [MAIN ] ASPN: Loaded 37369 existing records. [2025-09-15T17:16:11.567006] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-15T17:16:11.581090] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-15T17:16:11.580978] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:11.646428] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-15T17:16:11.635609] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-15T17:16:11.701022] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-15T17:16:11.701161] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-15T17:16:11.800372] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-15T17:16:11.825123] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-15T17:16:11.815310] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:12.017720] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-15T17:16:12.101207] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-15T17:16:12.101113] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:12.101574] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-15T17:16:12.122456] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-15T17:16:12.189708] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-15T17:16:12.210326] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-15T17:16:12.246707] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-15T17:16:12.277760] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-15T17:16:13.018121] [INFO ] [REMOTE ] ASR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.007347] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.059137] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-15T17:16:13.096045] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-15T17:16:13.365059] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.376920] [INFO ] [REMOTE ] ASH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.377249] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-15T17:16:13.377474] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-15T17:16:14.163391] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:16:14.167153] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-15T17:16:14.533087] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:16:14.545042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-15T17:16:15.012672] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T17:16:15.014782] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-15T17:16:15.218738] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T17:16:15.283323] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:16:15.657820] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-15T17:16:15.668059] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:16:15.891984] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:16:16.457834] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-15T17:16:16.847268] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:16:17.257944] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-15T17:16:17.900710] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T17:16:18.057785] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-15T17:16:18.083308] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:16:18.531471] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:16:18.857913] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-15T17:16:19.610287] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:16:19.657867] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-15T17:16:20.311808] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:16:20.457875] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-15T17:16:21.257853] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-15T17:16:21.278110] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:16:22.057971] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-15T17:16:22.298515] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:16:22.857912] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-15T17:16:23.657926] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-15T17:16:23.747269] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:16:23.982469] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:16:24.095853] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:16:24.457933] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-15T17:16:25.257878] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-15T17:16:25.765332] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:16:26.057932] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-15T17:16:26.857845] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-15T17:16:26.981825] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:16:26.983437] [INFO ] [REMOTE ] ASR: Full fetch complete (9548 records). [2025-09-15T17:16:26.983506] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-15T17:16:26.984001] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:26.984078] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:26.984114] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:26.984215] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-15T17:16:26.984293] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-15T17:16:26.984336] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-15T17:16:26.984587] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-15T17:16:26.984684] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASR took 16.7s. Estimated remaining: 3h 44m 50s. Rate: 9.8 symbols/min [2025-09-15T17:16:27.162339] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:27.204137] [DEBUG] [LOCAL ] ASX: Loaded 39787 existing records from primary storage. [2025-09-15T17:16:27.204317] [INFO ] [MAIN ] ASX: Loaded 39787 existing records. [2025-09-15T17:16:27.396075] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:27.396665] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-15T17:16:27.396773] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-15T17:16:27.443261] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-15T17:16:27.463017] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-15T17:16:27.542746] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-15T17:16:27.660847] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-15T17:16:27.893486] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:28.002912] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T17:16:28.457924] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-15T17:16:28.867811] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:16:29.257926] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-15T17:16:30.057887] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-15T17:16:30.308403] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:16:30.701358] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:16:30.857906] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-15T17:16:31.207951] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:16:31.211149] [INFO ] [REMOTE ] ASIX: Full fetch complete (23842 records). [2025-09-15T17:16:31.211250] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-15T17:16:31.588572] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-15T17:16:31.588691] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-15T17:16:31.589059] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-15T17:16:31.589105] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-15T17:16:31.590048] [DEBUG] [LOCAL ] ASIX: Trimmed 23842 records to 16877 (keeping 150 days of data) [2025-09-15T17:16:31.681066] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-15T17:16:31.714839] [DEBUG] [LOCAL ] ASIX: Primary data saved (16877 records). [2025-09-15T17:16:31.715035] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-15T17:16:31.715153] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 21.4s. Estimated remaining: 3h 44m 25s. Rate: 9.8 symbols/min [2025-09-15T17:16:31.901240] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:31.937007] [DEBUG] [LOCAL ] ATEN: Loaded 29040 existing records from primary storage. [2025-09-15T17:16:31.937176] [INFO ] [MAIN ] ATEN: Loaded 29040 existing records. [2025-09-15T17:16:32.132882] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:32.133167] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-15T17:16:32.133218] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-15T17:16:32.134691] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-15T17:16:32.134751] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-15T17:16:32.466308] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-15T17:16:32.508257] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:32.570360] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:16:33.002970] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:16:33.257889] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-15T17:16:34.057905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-15T17:16:34.294095] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:16:34.367915] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:16:34.857954] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-15T17:16:35.156051] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:16:35.159804] [INFO ] [REMOTE ] ASH: Full fetch complete (41296 records). [2025-09-15T17:16:35.159918] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-15T17:16:35.160566] [FATAL] [VALIDATOR ] ASH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:35.160669] [FATAL] [MAIN ] ASH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:35.160708] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:35.160746] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-15T17:16:35.160806] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-15T17:16:35.160841] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-09-15T17:16:35.161084] [DEBUG] [LOCAL ] ASH: Deleted derivative data file. [2025-09-15T17:16:35.161188] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 24.9s. Estimated remaining: 3h 43m 43s. Rate: 9.9 symbols/min [2025-09-15T17:16:35.331925] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:35.357326] [DEBUG] [LOCAL ] ATGE: Loaded 23587 existing records from primary storage. [2025-09-15T17:16:35.357476] [INFO ] [MAIN ] ATGE: Loaded 23587 existing records. [2025-09-15T17:16:35.533317] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:35.533586] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-15T17:16:35.533632] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-15T17:16:35.534811] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-15T17:16:35.534882] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-15T17:16:35.663128] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-15T17:16:35.913199] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:36.457941] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-15T17:16:36.512593] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:16:36.899547] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:16:37.257865] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-15T17:16:38.057969] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-15T17:16:38.342480] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T17:16:38.456423] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:16:38.857870] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-15T17:16:39.517836] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:16:39.657876] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-15T17:16:40.457937] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-15T17:16:40.627993] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:16:41.123668] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:16:41.257902] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-15T17:16:41.714466] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:16:42.057875] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-15T17:16:42.315419] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:16:42.858006] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-15T17:16:43.418682] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:16:43.657869] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-15T17:16:44.457869] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-15T17:16:44.667738] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T17:16:45.155579] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:16:45.257862] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-15T17:16:45.798293] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:16:45.803355] [INFO ] [REMOTE ] ASPN: Full fetch complete (53977 records). [2025-09-15T17:16:45.803458] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-15T17:16:45.804222] [FATAL] [VALIDATOR ] ASPN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:45.804308] [FATAL] [MAIN ] ASPN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:45.804346] [WARN ] [MAIN ] ASPN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:45.804384] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-15T17:16:45.804442] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-15T17:16:45.804479] [INFO ] [LOCAL ] ASPN: Starting deletion of derivative data. [2025-09-15T17:16:45.804731] [DEBUG] [LOCAL ] ASPN: Deleted derivative data file. [2025-09-15T17:16:45.805084] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASPN took 35.5s. Estimated remaining: 3h 44m 38s. Rate: 9.8 symbols/min [2025-09-15T17:16:45.978464] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:46.003082] [DEBUG] [LOCAL ] ATHM: Loaded 23577 existing records from primary storage. [2025-09-15T17:16:46.003250] [INFO ] [MAIN ] ATHM: Loaded 23577 existing records. [2025-09-15T17:16:46.068280] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-15T17:16:46.189866] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:46.190167] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-15T17:16:46.190215] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-15T17:16:46.191496] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-15T17:16:46.191562] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-15T17:16:46.551019] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:46.676171] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:16:46.857875] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-15T17:16:47.233564] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:16:47.657879] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-15T17:16:48.248802] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:16:48.253144] [INFO ] [REMOTE ] ATEN: Full fetch complete (43694 records). [2025-09-15T17:16:48.253245] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-15T17:16:48.463819] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-15T17:16:48.653129] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-15T17:16:48.653259] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-15T17:16:48.654077] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-15T17:16:48.654154] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-15T17:16:48.655694] [DEBUG] [LOCAL ] ATEN: Trimmed 43694 records to 28427 (keeping 150 days of data) [2025-09-15T17:16:48.792049] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:16:48.878850] [DEBUG] [LOCAL ] ATEN: Primary data saved (28427 records). [2025-09-15T17:16:48.879026] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-15T17:16:48.879124] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATEN took 17.2s. Estimated remaining: 3h 43m 52s. Rate: 9.8 symbols/min [2025-09-15T17:16:49.046717] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:49.053985] [DEBUG] [LOCAL ] ATHS: Loaded 5007 existing records from primary storage. [2025-09-15T17:16:49.054106] [INFO ] [MAIN ] ATHS: Loaded 5007 existing records. [2025-09-15T17:16:49.227710] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:49.227982] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-15T17:16:49.228028] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-15T17:16:49.228343] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-15T17:16:49.228395] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-15T17:16:49.263182] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-15T17:16:49.605047] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:50.057926] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-15T17:16:50.446354] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T17:16:50.485534] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:16:50.857895] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-15T17:16:51.577767] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:16:51.657887] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-15T17:16:52.457899] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-15T17:16:52.658159] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:16:52.794046] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:16:53.057399] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:16:53.257898] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-15T17:16:54.057882] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-15T17:16:54.857895] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-15T17:16:54.999383] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:16:55.049907] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T17:16:55.055713] [INFO ] [REMOTE ] ASX: Full fetch complete (57160 records). [2025-09-15T17:16:55.055837] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-15T17:16:55.056713] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:55.056815] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:55.056858] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:55.056907] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-15T17:16:55.056968] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-15T17:16:55.057005] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-09-15T17:16:55.057287] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-09-15T17:16:55.058763] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ASX took 28.1s. Estimated remaining: 3h 43m 47s. Rate: 9.8 symbols/min [2025-09-15T17:16:55.239938] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:55.285660] [DEBUG] [LOCAL ] ATI: Loaded 39009 existing records from primary storage. [2025-09-15T17:16:55.285837] [INFO ] [MAIN ] ATI: Loaded 39009 existing records. [2025-09-15T17:16:55.466319] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:55.466599] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-15T17:16:55.466668] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-15T17:16:55.468334] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-15T17:16:55.468400] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-15T17:16:55.666112] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-15T17:16:55.845137] [INFO ] [REMOTE ] ATI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:55.863827] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:16:56.457871] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-15T17:16:56.998993] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T17:16:57.257901] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-15T17:16:57.296013] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:16:58.057872] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-15T17:16:58.561382] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:16:58.605883] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:16:58.857883] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-15T17:16:59.657828] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-15T17:17:00.118533] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:17:00.457899] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-15T17:17:00.884616] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:17:01.257883] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-15T17:17:01.325601] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:17:02.057876] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-15T17:17:02.169634] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:17:02.172911] [INFO ] [REMOTE ] ATGE: Full fetch complete (35276 records). [2025-09-15T17:17:02.172998] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-15T17:17:02.558588] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-15T17:17:02.558766] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-15T17:17:02.559435] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-15T17:17:02.559507] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-15T17:17:02.560918] [DEBUG] [LOCAL ] ATGE: Trimmed 35276 records to 22888 (keeping 150 days of data) [2025-09-15T17:17:02.717143] [DEBUG] [LOCAL ] ATGE: Primary data saved (22888 records). [2025-09-15T17:17:02.717344] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-15T17:17:02.717453] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 27.6s. Estimated remaining: 3h 44m 1s. Rate: 9.8 symbols/min [2025-09-15T17:17:02.863814] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-15T17:17:02.897530] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:02.928091] [DEBUG] [LOCAL ] ATKR: Loaded 25920 existing records from primary storage. [2025-09-15T17:17:02.928304] [INFO ] [MAIN ] ATKR: Loaded 25920 existing records. [2025-09-15T17:17:03.123172] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:03.123512] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-15T17:17:03.123565] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-15T17:17:03.125278] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-15T17:17:03.125341] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-15T17:17:03.494746] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:03.503947] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T17:17:03.663327] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-15T17:17:03.677486] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:17:04.457859] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-15T17:17:04.965445] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:17:05.085482] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T17:17:05.257869] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-15T17:17:05.955981] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:17:05.957247] [INFO ] [REMOTE ] ATHS: Full fetch complete (7679 records). [2025-09-15T17:17:05.957318] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-15T17:17:05.957729] [FATAL] [VALIDATOR ] ATHS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:17:05.957810] [FATAL] [MAIN ] ATHS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:17:05.957850] [WARN ] [MAIN ] ATHS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:17:05.957909] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-15T17:17:05.957973] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-15T17:17:05.958011] [INFO ] [LOCAL ] ATHS: Starting deletion of derivative data. [2025-09-15T17:17:05.958251] [DEBUG] [LOCAL ] ATHS: Deleted derivative data file. [2025-09-15T17:17:05.958330] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHS took 17.1s. Estimated remaining: 3h 43m 18s. Rate: 9.9 symbols/min [2025-09-15T17:17:06.062691] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-15T17:17:06.134085] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:06.169309] [DEBUG] [LOCAL ] ATMU: Loaded 28868 existing records from primary storage. [2025-09-15T17:17:06.169480] [INFO ] [MAIN ] ATMU: Loaded 28868 existing records. [2025-09-15T17:17:06.345182] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:06.345448] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-15T17:17:06.345496] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-15T17:17:06.347080] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-15T17:17:06.347137] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-15T17:17:06.705354] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:06.857893] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-15T17:17:07.635086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:17:07.657920] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-15T17:17:08.384173] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:17:08.457892] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-15T17:17:08.587510] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:17:09.257924] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-15T17:17:09.855258] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:17:10.057874] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-15T17:17:10.264124] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:17:10.857889] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-15T17:17:11.603448] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:17:11.657910] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-15T17:17:12.295446] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:17:12.457896] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-15T17:17:13.257836] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-15T17:17:13.474953] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T17:17:13.635962] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:17:14.057951] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-15T17:17:14.654939] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:17:14.857883] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-15T17:17:15.095558] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:17:15.098572] [INFO ] [REMOTE ] ATHM: Full fetch complete (37046 records). [2025-09-15T17:17:15.098687] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-15T17:17:15.470779] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-15T17:17:15.470862] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-15T17:17:15.471313] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-15T17:17:15.471356] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-15T17:17:15.472268] [DEBUG] [LOCAL ] ATHM: Trimmed 37046 records to 22614 (keeping 150 days of data) [2025-09-15T17:17:15.611475] [DEBUG] [LOCAL ] ATHM: Primary data saved (22614 records). [2025-09-15T17:17:15.611615] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-15T17:17:15.611749] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHM took 29.8s. Estimated remaining: 3h 43m 58s. Rate: 9.8 symbols/min [2025-09-15T17:17:15.663016] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-15T17:17:15.789638] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:15.832410] [DEBUG] [LOCAL ] ATO: Loaded 31430 existing records from primary storage. [2025-09-15T17:17:15.844113] [INFO ] [MAIN ] ATO: Loaded 31430 existing records. [2025-09-15T17:17:15.876856] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:17:16.029473] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:16.029753] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-15T17:17:16.029801] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-15T17:17:16.031306] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-15T17:17:16.031359] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-15T17:17:16.389880] [INFO ] [REMOTE ] ATO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:16.457874] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-15T17:17:17.100890] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:17:17.257869] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-15T17:17:18.057937] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-15T17:17:18.185681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:17:18.716521] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:17:18.857870] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-15T17:17:19.564951] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:17:19.657849] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-15T17:17:20.457908] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-15T17:17:20.676179] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:17:20.948172] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:17:21.257923] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-15T17:17:21.740274] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T17:17:22.057930] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-15T17:17:22.857934] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-15T17:17:22.901816] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:17:23.028956] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:17:23.657895] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-15T17:17:23.829552] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:17:23.834247] [INFO ] [REMOTE ] ATMU: Full fetch complete (42993 records). [2025-09-15T17:17:23.834449] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-15T17:17:23.835153] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:17:23.835242] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:17:23.835289] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:17:23.835338] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-15T17:17:23.835406] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-15T17:17:23.835459] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-09-15T17:17:23.835706] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-09-15T17:17:23.835803] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATMU took 17.9s. Estimated remaining: 3h 44m 19s. Rate: 9.8 symbols/min [2025-09-15T17:17:24.017961] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:24.050089] [DEBUG] [LOCAL ] ATR: Loaded 23237 existing records from primary storage. [2025-09-15T17:17:24.050236] [INFO ] [MAIN ] ATR: Loaded 23237 existing records. [2025-09-15T17:17:24.234176] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:24.234576] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-15T17:17:24.234633] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-15T17:17:24.235407] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-15T17:17:24.235457] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-15T17:17:24.463046] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-15T17:17:24.599272] [INFO ] [REMOTE ] ATR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:24.981764] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:17:25.257902] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-15T17:17:25.935892] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:17:26.057887] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-15T17:17:26.857929] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-15T17:17:26.889322] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:17:27.449128] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:17:27.455090] [INFO ] [REMOTE ] ATI: Full fetch complete (56286 records). [2025-09-15T17:17:27.455258] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-15T17:17:27.667843] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-15T17:17:27.840080] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-15T17:17:27.840158] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-15T17:17:27.840763] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-15T17:17:27.840819] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-15T17:17:27.842002] [DEBUG] [LOCAL ] ATI: Trimmed 56286 records to 38269 (keeping 150 days of data) [2025-09-15T17:17:27.981166] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:17:28.098155] [DEBUG] [LOCAL ] ATI: Primary data saved (38269 records). [2025-09-15T17:17:28.098296] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-15T17:17:28.099409] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATI took 33.0s. Estimated remaining: 3h 43m 49s. Rate: 9.8 symbols/min [2025-09-15T17:17:28.266719] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:28.282772] [DEBUG] [LOCAL ] ATS: Loaded 13232 existing records from primary storage. [2025-09-15T17:17:28.282901] [INFO ] [MAIN ] ATS: Loaded 13232 existing records. [2025-09-15T17:17:28.466525] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-15T17:17:28.471992] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:28.473111] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-15T17:17:28.473166] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-15T17:17:28.473732] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-15T17:17:28.473815] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-15T17:17:28.859566] [INFO ] [REMOTE ] ATS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:29.097971] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:17:29.257877] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-15T17:17:29.903611] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:17:30.057895] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-15T17:17:30.521455] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:30.857935] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-15T17:17:31.299134] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:17:31.515810] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T17:17:31.657938] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-15T17:17:32.457968] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-15T17:17:32.914188] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:33.257884] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-15T17:17:33.516691] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:17:34.057875] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-15T17:17:34.218422] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:17:34.857894] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-15T17:17:35.406098] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:17:35.657941] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-15T17:17:36.054510] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:17:36.457907] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-15T17:17:36.627547] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:17:37.257900] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-15T17:17:37.440505] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:17:37.444898] [INFO ] [REMOTE ] ATKR: Full fetch complete (39895 records). [2025-09-15T17:17:37.445021] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-15T17:17:37.817845] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-15T17:17:37.817931] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-15T17:17:37.818411] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-15T17:17:37.818453] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-15T17:17:37.819465] [DEBUG] [LOCAL ] ATKR: Trimmed 39895 records to 25276 (keeping 150 days of data) [2025-09-15T17:17:37.983274] [DEBUG] [LOCAL ] ATKR: Primary data saved (25276 records). [2025-09-15T17:17:37.983426] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-15T17:17:37.983523] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATKR took 35.3s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-15T17:17:38.062990] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-15T17:17:38.156675] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:38.198004] [DEBUG] [LOCAL ] ATUS: Loaded 37778 existing records from primary storage. [2025-09-15T17:17:38.198204] [INFO ] [MAIN ] ATUS: Loaded 37778 existing records. [2025-09-15T17:17:38.386248] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:38.386765] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-15T17:17:38.386909] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-15T17:17:38.388400] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-15T17:17:38.388513] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-15T17:17:38.515327] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:38.794477] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:38.857940] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-15T17:17:39.568541] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:17:39.657836] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-15T17:17:39.952388] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:17:40.457910] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-15T17:17:40.905912] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:17:40.910498] [INFO ] [REMOTE ] ATO: Full fetch complete (45734 records). [2025-09-15T17:17:40.910606] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-15T17:17:41.270280] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-15T17:17:41.294193] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-15T17:17:41.294326] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-15T17:17:41.295089] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-15T17:17:41.295281] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-15T17:17:41.296748] [DEBUG] [LOCAL ] ATO: Trimmed 45734 records to 30687 (keeping 150 days of data) [2025-09-15T17:17:41.506131] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:17:41.530257] [DEBUG] [LOCAL ] ATO: Primary data saved (30687 records). [2025-09-15T17:17:41.530465] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-15T17:17:41.531090] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATO took 25.9s. Estimated remaining: 3h 43m 52s. Rate: 9.8 symbols/min [2025-09-15T17:17:41.708447] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:41.750679] [DEBUG] [LOCAL ] AU: Loaded 39866 existing records from primary storage. [2025-09-15T17:17:41.750852] [INFO ] [MAIN ] AU: Loaded 39866 existing records. [2025-09-15T17:17:41.937401] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:41.937783] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-15T17:17:41.937834] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-15T17:17:41.939560] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-15T17:17:41.939830] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-15T17:17:42.062998] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-15T17:17:42.296826] [INFO ] [REMOTE ] AU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:42.510084] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:17:42.857881] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-15T17:17:43.412726] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:17:43.416686] [INFO ] [REMOTE ] ATR: Full fetch complete (33428 records). [2025-09-15T17:17:43.416778] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-15T17:17:43.667928] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-15T17:17:43.790206] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-15T17:17:43.790288] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-15T17:17:43.790750] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-15T17:17:43.790799] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-15T17:17:43.791673] [DEBUG] [LOCAL ] ATR: Trimmed 33428 records to 22944 (keeping 150 days of data) [2025-09-15T17:17:43.903680] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:17:43.959930] [DEBUG] [LOCAL ] ATR: Primary data saved (22944 records). [2025-09-15T17:17:43.960107] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-15T17:17:43.960210] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 20.1s. Estimated remaining: 3h 42m 60s. Rate: 9.8 symbols/min [2025-09-15T17:17:44.139711] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:44.177528] [DEBUG] [LOCAL ] AUB: Loaded 34357 existing records from primary storage. [2025-09-15T17:17:44.177712] [INFO ] [MAIN ] AUB: Loaded 34357 existing records. [2025-09-15T17:17:44.362928] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:44.363206] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-15T17:17:44.363253] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-15T17:17:44.364364] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-15T17:17:44.364416] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-15T17:17:44.462983] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-15T17:17:44.724064] [INFO ] [REMOTE ] AUB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:44.942038] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:17:45.257942] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-15T17:17:46.057908] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-15T17:17:46.510459] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T17:17:46.814338] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:17:46.857821] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-15T17:17:47.635837] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:17:47.657840] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-15T17:17:48.059339] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:17:48.457869] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-15T17:17:49.257900] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-15T17:17:49.608027] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T17:17:49.696737] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:17:50.057872] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-15T17:17:50.613321] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:17:50.857878] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-15T17:17:51.657887] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-15T17:17:51.709138] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:17:52.262039] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:17:52.457846] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-15T17:17:52.491757] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:17:53.257889] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-15T17:17:53.972535] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:17:54.057894] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-15T17:17:54.857895] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-15T17:17:55.359249] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:17:55.397334] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T17:17:55.657877] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-15T17:17:55.919246] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:17:56.457895] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-15T17:17:57.257963] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-15T17:17:57.351316] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:17:58.057898] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-15T17:17:58.205980] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T17:17:58.857834] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-15T17:17:58.919378] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:17:59.024986] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:17:59.657880] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-15T17:18:00.457879] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-15T17:18:00.904344] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T17:18:00.953162] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-15T17:18:01.257924] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-15T17:18:02.057889] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-15T17:18:02.150084] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:18:02.155881] [INFO ] [REMOTE ] ATUS: Full fetch complete (53510 records). [2025-09-15T17:18:02.156043] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-15T17:18:02.565429] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-15T17:18:02.565530] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-15T17:18:02.566126] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-15T17:18:02.566174] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-15T17:18:02.567511] [DEBUG] [LOCAL ] ATUS: Trimmed 53510 records to 37048 (keeping 150 days of data) [2025-09-15T17:18:02.790379] [DEBUG] [LOCAL ] ATUS: Primary data saved (37048 records). [2025-09-15T17:18:02.790539] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-15T17:18:02.791924] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATUS took 24.8s. Estimated remaining: 3h 45m 33s. Rate: 9.7 symbols/min [2025-09-15T17:18:02.864520] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-15T17:18:02.971174] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:02.977380] [DEBUG] [LOCAL ] AUNA: Loaded 3632 existing records from primary storage. [2025-09-15T17:18:02.977489] [INFO ] [MAIN ] AUNA: Loaded 3632 existing records. [2025-09-15T17:18:03.153852] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:03.154119] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-15T17:18:03.154165] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-15T17:18:03.154382] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-15T17:18:03.154426] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-15T17:18:03.525886] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:03.657895] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-15T17:18:03.774794] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-15T17:18:03.779658] [INFO ] [REMOTE ] AUB: Full fetch complete (50210 records). [2025-09-15T17:18:03.779762] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-15T17:18:04.157258] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-15T17:18:04.157359] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-15T17:18:04.157945] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-15T17:18:04.157995] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-15T17:18:04.159314] [DEBUG] [LOCAL ] AUB: Trimmed 50210 records to 33612 (keeping 150 days of data) [2025-09-15T17:18:04.415634] [DEBUG] [LOCAL ] AUB: Primary data saved (33612 records). [2025-09-15T17:18:04.415871] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-15T17:18:04.416016] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. AUB took 20.5s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-15T17:18:04.639814] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:04.685742] [DEBUG] [LOCAL ] AVA: Loaded 29173 existing records from primary storage. [2025-09-15T17:18:04.685944] [INFO ] [MAIN ] AVA: Loaded 29173 existing records. [2025-09-15T17:18:04.973909] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:04.974338] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-15T17:18:04.974408] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-15T17:18:04.945038] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:18:04.979919] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-15T17:18:04.980093] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-15T17:18:04.979830] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-15T17:18:05.173370] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-15T17:18:05.259699] [INFO ] [REMOTE ] ATS: Full fetch complete (19574 records). [2025-09-15T17:18:05.274093] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-15T17:18:05.664526] [INFO ] [REMOTE ] AVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:05.707941] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-15T17:18:05.773063] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T17:18:05.882864] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-15T17:18:05.883078] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-15T17:18:05.883337] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-15T17:18:05.883408] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-15T17:18:05.884021] [DEBUG] [LOCAL ] ATS: Trimmed 19574 records to 12990 (keeping 150 days of data) [2025-09-15T17:18:05.973471] [DEBUG] [LOCAL ] ATS: Primary data saved (12990 records). [2025-09-15T17:18:05.973632] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-15T17:18:05.973739] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. ATS took 37.9s. Estimated remaining: 3h 43m 28s. Rate: 9.8 symbols/min [2025-09-15T17:18:06.063089] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-15T17:18:06.143486] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:06.150272] [DEBUG] [LOCAL ] AVAL: Loaded 6001 existing records from primary storage. [2025-09-15T17:18:06.150362] [INFO ] [MAIN ] AVAL: Loaded 6001 existing records. [2025-09-15T17:18:06.326507] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:06.326919] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-15T17:18:06.327017] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-15T17:18:06.327374] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-15T17:18:06.327508] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-15T17:18:06.514346] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T17:18:06.670702] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (4.61 seconds). [2025-09-15T17:18:06.734577] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:06.857839] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-15T17:18:06.919947] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:18:07.657879] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-15T17:18:08.457870] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-15T17:18:08.723457] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:18:09.022019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T17:18:09.082620] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T17:18:09.257876] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-15T17:18:10.057872] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-15T17:18:10.633043] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T17:18:10.658380] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:18:10.857827] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-15T17:18:11.657865] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-15T17:18:12.457866] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-15T17:18:12.922377] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:18:13.257851] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-15T17:18:13.311899] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T17:18:13.646237] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:18:14.057897] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-15T17:18:14.857933] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-15T17:18:14.958290] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:18:15.130101] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T17:18:15.136140] [INFO ] [REMOTE ] AU: Full fetch complete (57430 records). [2025-09-15T17:18:15.136252] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-15T17:18:15.446773] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T17:18:15.520984] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-15T17:18:15.521057] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-15T17:18:15.521656] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-15T17:18:15.521699] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-15T17:18:15.522816] [DEBUG] [LOCAL ] AU: Trimmed 57430 records to 39087 (keeping 150 days of data) [2025-09-15T17:18:15.704015] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-15T17:18:15.775512] [DEBUG] [LOCAL ] AU: Primary data saved (39087 records). [2025-09-15T17:18:15.775691] [INFO ] [MAIN ] AU: Full history saved. [2025-09-15T17:18:15.776000] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 34.2s. Estimated remaining: 3h 44m 7s. Rate: 9.8 symbols/min [2025-09-15T17:18:15.950421] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:15.984599] [DEBUG] [LOCAL ] AVB: Loaded 31412 existing records from primary storage. [2025-09-15T17:18:15.984794] [INFO ] [MAIN ] AVB: Loaded 31412 existing records. [2025-09-15T17:18:16.159601] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:16.159867] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-15T17:18:16.159913] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-15T17:18:16.161227] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-15T17:18:16.161286] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-15T17:18:16.419360] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:18:16.462967] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-15T17:18:16.531583] [INFO ] [REMOTE ] AVB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:17.124329] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T17:18:17.257937] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-15T17:18:18.057892] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-15T17:18:18.452907] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:18:18.857968] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-15T17:18:19.465141] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T17:18:19.466548] [INFO ] [REMOTE ] AUNA: Full fetch complete (5179 records). [2025-09-15T17:18:19.466657] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-15T17:18:19.668053] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-15T17:18:19.836122] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-15T17:18:19.836261] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-15T17:18:19.836450] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-15T17:18:19.836527] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-15T17:18:19.837149] [DEBUG] [LOCAL ] AUNA: Trimmed 5179 records to 3616 (keeping 150 days of data) [2025-09-15T17:18:19.884969] [DEBUG] [LOCAL ] AUNA: Primary data saved (3616 records). [2025-09-15T17:18:19.884333] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:18:19.885173] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-15T17:18:19.892943] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 17.1s. Estimated remaining: 3h 43m 36s. Rate: 9.8 symbols/min [2025-09-15T17:18:20.061023] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:20.061219] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-15T17:18:20.061258] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-15T17:18:20.061375] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-15T17:18:20.061413] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-15T17:18:20.061452] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-15T17:18:20.061485] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-15T17:18:20.317204] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:18:20.452424] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:20.457850] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-15T17:18:21.257885] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-15T17:18:21.469833] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:21.470135] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-15T17:18:22.065712] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-15T17:18:22.070973] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:18:22.347156] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:22.347453] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-15T17:18:22.857871] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-15T17:18:23.657872] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-15T17:18:24.440221] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:18:24.457852] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-15T17:18:24.631964] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:18:25.257929] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-15T17:18:25.805146] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:18:25.809750] [INFO ] [REMOTE ] AVA: Full fetch complete (42852 records). [2025-09-15T17:18:25.809892] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-15T17:18:26.063056] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-15T17:18:26.199918] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-15T17:18:26.200004] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-15T17:18:26.200515] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-15T17:18:26.200558] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-15T17:18:26.201538] [DEBUG] [LOCAL ] AVA: Trimmed 42852 records to 28643 (keeping 150 days of data) [2025-09-15T17:18:26.379737] [DEBUG] [LOCAL ] AVA: Primary data saved (28643 records). [2025-09-15T17:18:26.379887] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-15T17:18:26.379975] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVA took 22.0s. Estimated remaining: 3h 43m 34s. Rate: 9.8 symbols/min [2025-09-15T17:18:26.550798] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:26.568193] [DEBUG] [LOCAL ] AVD: Loaded 16581 existing records from primary storage. [2025-09-15T17:18:26.568353] [INFO ] [MAIN ] AVD: Loaded 16581 existing records. [2025-09-15T17:18:26.742991] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:18:26.766214] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:26.766625] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-15T17:18:26.766786] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-15T17:18:26.767741] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-15T17:18:26.767802] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-15T17:18:26.858778] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-15T17:18:27.104894] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T17:18:27.210110] [INFO ] [REMOTE ] AVD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:27.541455] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:18:27.542900] [INFO ] [REMOTE ] AVAL: Full fetch complete (11020 records). [2025-09-15T17:18:27.542981] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-15T17:18:27.662983] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-15T17:18:27.919226] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-15T17:18:27.919329] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-15T17:18:27.919746] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-15T17:18:27.919818] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-15T17:18:27.920388] [DEBUG] [LOCAL ] AVAL: Trimmed 11020 records to 5769 (keeping 150 days of data) [2025-09-15T17:18:27.954747] [DEBUG] [LOCAL ] AVAL: Primary data saved (5769 records). [2025-09-15T17:18:27.954864] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-15T17:18:27.954963] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVAL took 22.0s. Estimated remaining: 3h 42m 33s. Rate: 9.8 symbols/min [2025-09-15T17:18:28.123437] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:28.137689] [DEBUG] [LOCAL ] AVK: Loaded 13507 existing records from primary storage. [2025-09-15T17:18:28.137820] [INFO ] [MAIN ] AVK: Loaded 13507 existing records. [2025-09-15T17:18:28.314794] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:28.315093] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-15T17:18:28.315145] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-15T17:18:28.315811] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-15T17:18:28.315867] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-15T17:18:28.463267] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-15T17:18:28.672677] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:28.723536] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:28.723917] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-15T17:18:29.257923] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-15T17:18:29.439762] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:18:29.449775] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:29.450882] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-15T17:18:30.057901] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-15T17:18:30.297187] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:30.297494] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-15T17:18:30.857883] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-15T17:18:31.657923] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-15T17:18:31.849797] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:31.850131] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-15T17:18:32.361713] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:18:32.457930] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-15T17:18:33.257936] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-15T17:18:33.690724] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:18:33.990028] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:18:34.057869] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-15T17:18:34.857873] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-15T17:18:35.038488] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:18:35.040573] [INFO ] [REMOTE ] AVBC: Full fetch complete (3974 records). [2025-09-15T17:18:35.040678] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-15T17:18:35.220333] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 31 unique days, need 150 days [2025-09-15T17:18:35.220566] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:18:35.220626] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:18:35.220687] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-15T17:18:35.220755] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-15T17:18:35.220804] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-15T17:18:35.220856] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-15T17:18:35.220923] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVBC took 15.3s. Estimated remaining: 3h 42m 41s. Rate: 9.8 symbols/min [2025-09-15T17:18:35.391084] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:35.418369] [DEBUG] [LOCAL ] AVNS: Loaded 25223 existing records from primary storage. [2025-09-15T17:18:35.418535] [INFO ] [MAIN ] AVNS: Loaded 25223 existing records. [2025-09-15T17:18:35.598217] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:35.598457] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-15T17:18:35.598508] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-15T17:18:35.599236] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-15T17:18:35.599289] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-15T17:18:35.663007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-15T17:18:35.969335] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:35.970502] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:18:36.457872] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-15T17:18:36.526305] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:18:37.257869] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-15T17:18:37.681518] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:18:38.057910] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-15T17:18:38.388436] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:18:38.857888] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-15T17:18:38.944820] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T17:18:39.657884] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-15T17:18:40.036735] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:18:40.457897] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-15T17:18:40.915702] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T17:18:41.162956] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:18:41.257874] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-15T17:18:42.057879] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-15T17:18:42.358136] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:18:42.820118] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:18:42.857875] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-15T17:18:43.657881] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-15T17:18:43.872237] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T17:18:44.457862] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-15T17:18:44.600772] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:18:45.257927] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-15T17:18:45.504229] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:18:46.057902] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-15T17:18:46.857885] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-15T17:18:46.906955] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:18:46.968148] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:18:47.657867] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-15T17:18:48.119875] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:18:48.457917] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-15T17:18:48.676175] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T17:18:49.257904] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-15T17:18:49.705549] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:18:50.057917] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-15T17:18:50.382096] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:18:50.594437] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:18:50.857871] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-15T17:18:51.657878] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-15T17:18:52.022417] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:18:52.376042] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:18:52.457875] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-15T17:18:53.257968] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-15T17:18:53.409617] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:18:54.057880] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-15T17:18:54.208813] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:18:54.214504] [INFO ] [REMOTE ] AVNS: Full fetch complete (36259 records). [2025-09-15T17:18:54.214734] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-15T17:18:54.600494] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-15T17:18:54.600598] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-15T17:18:54.601232] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-15T17:18:54.601303] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-15T17:18:54.602456] [DEBUG] [LOCAL ] AVNS: Trimmed 36259 records to 24755 (keeping 150 days of data) [2025-09-15T17:18:54.752300] [DEBUG] [LOCAL ] AVNS: Primary data saved (24755 records). [2025-09-15T17:18:54.752523] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-15T17:18:54.752665] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVNS took 19.5s. Estimated remaining: 3h 45m 15s. Rate: 9.7 symbols/min [2025-09-15T17:18:54.858629] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-15T17:18:54.933165] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:54.964964] [DEBUG] [LOCAL ] AVNT: Loaded 29154 existing records from primary storage. [2025-09-15T17:18:54.965106] [INFO ] [MAIN ] AVNT: Loaded 29154 existing records. [2025-09-15T17:18:55.142876] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:55.143312] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-15T17:18:55.150817] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-15T17:18:55.152615] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-15T17:18:55.152537] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:18:55.152738] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-15T17:18:55.203865] [INFO ] [REMOTE ] AVD: Full fetch complete (24763 records). [2025-09-15T17:18:55.237332] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-15T17:18:55.660333] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-15T17:18:55.744910] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:55.924605] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-15T17:18:55.924712] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-15T17:18:55.925077] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-15T17:18:55.925122] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-15T17:18:55.926003] [DEBUG] [LOCAL ] AVD: Trimmed 24763 records to 16275 (keeping 150 days of data) [2025-09-15T17:18:56.018665] [DEBUG] [LOCAL ] AVD: Primary data saved (16275 records). [2025-09-15T17:18:56.018831] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-15T17:18:56.018921] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 29.6s. Estimated remaining: 3h 44m 11s. Rate: 9.7 symbols/min [2025-09-15T17:18:56.201826] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:56.216451] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:18:56.221355] [INFO ] [REMOTE ] AVB: Full fetch complete (44670 records). [2025-09-15T17:18:56.221557] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-15T17:18:56.473571] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-15T17:18:56.509662] [DEBUG] [LOCAL ] AVTR: Loaded 40334 existing records from primary storage. [2025-09-15T17:18:56.526533] [INFO ] [MAIN ] AVTR: Loaded 40334 existing records. [2025-09-15T17:18:56.872966] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-15T17:18:56.880387] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:56.880971] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-15T17:18:56.882071] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-15T17:18:56.881249] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-15T17:18:56.882189] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-15T17:18:56.882265] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-15T17:18:56.890922] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-15T17:18:56.892379] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:18:56.892505] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-15T17:18:56.901621] [INFO ] [REMOTE ] AVK: Full fetch complete (19692 records). [2025-09-15T17:18:56.909867] [DEBUG] [LOCAL ] AVB: Trimmed 44670 records to 30819 (keeping 150 days of data) [2025-09-15T17:18:56.925520] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-15T17:18:57.981509] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:57.993062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-15T17:18:58.122073] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-15T17:18:58.122464] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-15T17:18:58.123148] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-15T17:18:58.123955] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-15T17:18:58.135171] [DEBUG] [LOCAL ] AVK: Trimmed 19692 records to 13357 (keeping 150 days of data) [2025-09-15T17:18:58.156631] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:18:58.204389] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-15T17:18:58.326791] [DEBUG] [LOCAL ] AVB: Primary data saved (30819 records). [2025-09-15T17:18:58.328098] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-15T17:18:58.328537] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVB took 42.6s. Estimated remaining: 3h 43m 19s. Rate: 9.8 symbols/min [2025-09-15T17:18:58.517786] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:58.521888] [DEBUG] [LOCAL ] AVK: Primary data saved (13357 records). [2025-09-15T17:18:58.522221] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-15T17:18:58.522338] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVK took 30.6s. Estimated remaining: 3h 42m 3s. Rate: 9.8 symbols/min [2025-09-15T17:18:58.706007] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:58.716897] [DEBUG] [LOCAL ] AVY: Loaded 27556 existing records from primary storage. [2025-09-15T17:18:58.717135] [INFO ] [MAIN ] AVY: Loaded 27556 existing records. [2025-09-15T17:18:58.882082] [DEBUG] [LOCAL ] AWF: Loaded 17314 existing records from primary storage. [2025-09-15T17:18:58.890880] [INFO ] [MAIN ] AWF: Loaded 17314 existing records. [2025-09-15T17:18:58.989773] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:59.016181] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-15T17:18:59.021913] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-15T17:18:59.073420] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-15T17:18:59.092435] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-15T17:18:59.092352] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:59.097754] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-15T17:18:59.150354] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-15T17:18:59.176233] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-15T17:18:59.193468] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-15T17:18:59.807783] [INFO ] [REMOTE ] AVY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:59.814823] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-15T17:18:59.906443] [INFO ] [REMOTE ] AWF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:59.907384] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-15T17:18:59.942990] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:18:59.968822] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-15T17:19:00.457906] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-15T17:19:01.088548] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:19:01.215994] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:19:01.257861] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-15T17:19:02.057863] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-15T17:19:02.384348] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T17:19:02.464676] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:19:02.857867] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-15T17:19:03.400839] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:19:03.657907] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-15T17:19:04.349555] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:19:04.457887] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-15T17:19:04.742960] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:19:05.257891] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-15T17:19:05.832160] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:19:06.057868] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-15T17:19:06.652517] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:19:06.857890] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-15T17:19:07.516698] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:19:07.581480] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:19:07.657874] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-15T17:19:08.283387] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:19:08.457875] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-15T17:19:09.225508] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:19:09.257874] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-15T17:19:10.057869] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-15T17:19:10.730437] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:19:10.857955] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-15T17:19:11.375765] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:19:11.657875] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-15T17:19:11.806352] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:19:12.427553] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:19:12.430437] [INFO ] [REMOTE ] AWF: Full fetch complete (26374 records). [2025-09-15T17:19:12.430526] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-15T17:19:12.431325] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:19:12.431422] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:19:12.431480] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:19:12.431535] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-15T17:19:12.431615] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-15T17:19:12.431676] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-09-15T17:19:12.432141] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-09-15T17:19:12.432239] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AWF took 13.9s. Estimated remaining: 3h 43m 28s. Rate: 9.8 symbols/min [2025-09-15T17:19:12.467180] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-15T17:19:12.627720] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:12.654078] [DEBUG] [LOCAL ] AWI: Loaded 19432 existing records from primary storage. [2025-09-15T17:19:12.654273] [INFO ] [MAIN ] AWI: Loaded 19432 existing records. [2025-09-15T17:19:12.838286] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:12.838635] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-15T17:19:12.838707] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-15T17:19:12.839575] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-15T17:19:12.839629] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-15T17:19:13.206299] [INFO ] [REMOTE ] AWI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:13.257928] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-15T17:19:14.057910] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-15T17:19:14.127960] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:19:14.709434] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:19:14.857881] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-15T17:19:15.555134] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:19:15.657890] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-15T17:19:15.868528] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T17:19:16.457880] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-15T17:19:17.208096] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:19:17.257915] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-15T17:19:17.704406] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:19:18.057928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-15T17:19:18.840263] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:19:18.857814] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-15T17:19:19.075529] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:19:19.657923] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-15T17:19:20.263107] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:19:20.272663] [INFO ] [REMOTE ] AVTR: Full fetch complete (58235 records). [2025-09-15T17:19:20.272865] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-15T17:19:20.467860] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-15T17:19:20.660543] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-15T17:19:20.660632] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-15T17:19:20.661288] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-15T17:19:20.661341] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-15T17:19:20.662695] [DEBUG] [LOCAL ] AVTR: Trimmed 58235 records to 39554 (keeping 150 days of data) [2025-09-15T17:19:20.913454] [DEBUG] [LOCAL ] AVTR: Primary data saved (39554 records). [2025-09-15T17:19:20.913681] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-15T17:19:20.913814] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 24.9s. Estimated remaining: 3h 43m 49s. Rate: 9.7 symbols/min [2025-09-15T17:19:21.080533] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:21.121872] [DEBUG] [LOCAL ] AWK: Loaded 36312 existing records from primary storage. [2025-09-15T17:19:21.122032] [INFO ] [MAIN ] AWK: Loaded 36312 existing records. [2025-09-15T17:19:21.262837] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-15T17:19:21.302871] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:21.303342] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-15T17:19:21.303461] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-15T17:19:21.305172] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-15T17:19:21.305236] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-15T17:19:21.436664] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:19:21.769567] [INFO ] [REMOTE ] AWK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:21.780416] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:19:21.785024] [INFO ] [REMOTE ] AVY: Full fetch complete (40901 records). [2025-09-15T17:19:21.785148] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-15T17:19:21.785828] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:19:21.785910] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:19:21.785960] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:19:21.786003] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-15T17:19:21.786071] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-15T17:19:21.786149] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-09-15T17:19:21.786381] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-09-15T17:19:21.786478] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 23.5s. Estimated remaining: 3h 42m 42s. Rate: 9.8 symbols/min [2025-09-15T17:19:21.957718] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:21.975501] [DEBUG] [LOCAL ] AWP: Loaded 16752 existing records from primary storage. [2025-09-15T17:19:21.975636] [INFO ] [MAIN ] AWP: Loaded 16752 existing records. [2025-09-15T17:19:22.066806] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-15T17:19:22.155437] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:22.155709] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-15T17:19:22.155761] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-15T17:19:22.156406] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-15T17:19:22.156469] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-15T17:19:22.529093] [INFO ] [REMOTE ] AWP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:22.548015] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:19:22.857897] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-15T17:19:23.631556] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:19:23.657833] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-15T17:19:24.457857] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-15T17:19:24.511935] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:19:25.263246] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-15T17:19:25.287139] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:19:25.315247] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:19:26.057891] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-15T17:19:26.460557] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:19:26.857877] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-15T17:19:27.335581] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:19:27.340269] [INFO ] [REMOTE ] AVNT: Full fetch complete (43026 records). [2025-09-15T17:19:27.340385] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-15T17:19:27.662983] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-15T17:19:27.730454] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-15T17:19:27.730540] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-15T17:19:27.731077] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-15T17:19:27.731133] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-15T17:19:27.732303] [DEBUG] [LOCAL ] AVNT: Trimmed 43026 records to 28547 (keeping 150 days of data) [2025-09-15T17:19:27.918816] [DEBUG] [LOCAL ] AVNT: Primary data saved (28547 records). [2025-09-15T17:19:27.918974] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-15T17:19:27.919076] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AVNT took 33.2s. Estimated remaining: 3h 42m 36s. Rate: 9.8 symbols/min [2025-09-15T17:19:28.092857] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:28.111390] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:19:28.130166] [DEBUG] [LOCAL ] AWR: Loaded 16385 existing records from primary storage. [2025-09-15T17:19:28.130371] [INFO ] [MAIN ] AWR: Loaded 16385 existing records. [2025-09-15T17:19:28.321301] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:28.321627] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-15T17:19:28.321698] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-15T17:19:28.323464] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-15T17:19:28.323524] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-15T17:19:28.464952] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-15T17:19:28.681156] [INFO ] [REMOTE ] AWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:28.694220] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:19:29.257894] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-15T17:19:29.672394] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:19:30.057889] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-15T17:19:30.583593] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T17:19:30.857883] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-15T17:19:31.021167] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:19:31.657905] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-15T17:19:32.434925] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:19:32.458072] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-15T17:19:32.464088] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:19:33.257905] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-15T17:19:33.954855] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:19:34.057834] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-15T17:19:34.077725] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:19:34.857878] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-15T17:19:35.010997] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:19:35.657934] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-15T17:19:36.423522] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:19:36.457821] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-15T17:19:36.485668] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:19:37.257882] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-15T17:19:38.057896] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-15T17:19:38.124852] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:19:38.184319] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:19:38.857917] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-15T17:19:39.404838] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:19:39.657875] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-15T17:19:40.457850] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-15T17:19:40.501090] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:19:40.506765] [INFO ] [REMOTE ] AWK: Full fetch complete (53226 records). [2025-09-15T17:19:40.506961] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-15T17:19:40.903050] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-15T17:19:40.903580] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-15T17:19:40.903875] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:19:40.904452] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-15T17:19:40.907374] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-15T17:19:40.907999] [INFO ] [REMOTE ] AWI: Full fetch complete (28507 records). [2025-09-15T17:19:40.908264] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-15T17:19:40.940112] [DEBUG] [LOCAL ] AWK: Trimmed 53226 records to 35633 (keeping 150 days of data) [2025-09-15T17:19:41.259603] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-15T17:19:41.443805] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-15T17:19:41.444148] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-15T17:19:41.446980] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-15T17:19:41.448429] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-15T17:19:41.459605] [DEBUG] [LOCAL ] AWI: Trimmed 28507 records to 18971 (keeping 150 days of data) [2025-09-15T17:19:41.588964] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:19:41.721181] [DEBUG] [LOCAL ] AWK: Primary data saved (35633 records). [2025-09-15T17:19:41.721819] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-15T17:19:41.722137] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWK took 20.8s. Estimated remaining: 3h 43m 57s. Rate: 9.7 symbols/min [2025-09-15T17:19:41.907946] [DEBUG] [LOCAL ] AWI: Primary data saved (18971 records). [2025-09-15T17:19:41.911207] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-15T17:19:41.911353] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWI took 29.5s. Estimated remaining: 3h 42m 43s. Rate: 9.8 symbols/min [2025-09-15T17:19:41.911107] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:42.061296] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-15T17:19:42.094557] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:42.103851] [DEBUG] [LOCAL ] AX: Loaded 20596 existing records from primary storage. [2025-09-15T17:19:42.104084] [INFO ] [MAIN ] AX: Loaded 20596 existing records. [2025-09-15T17:19:42.293269] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:42.293577] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-15T17:19:42.293633] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-15T17:19:42.295687] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-15T17:19:42.296372] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-15T17:19:42.402551] [DEBUG] [LOCAL ] AXL: Loaded 37892 existing records from primary storage. [2025-09-15T17:19:42.413737] [INFO ] [MAIN ] AXL: Loaded 37892 existing records. [2025-09-15T17:19:42.705621] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:19:42.819268] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:42.836228] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-15T17:19:42.841438] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-15T17:19:42.860581] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-15T17:19:42.866338] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-15T17:19:42.903063] [INFO ] [REMOTE ] AX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:42.903331] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-15T17:19:43.267708] [INFO ] [REMOTE ] AXL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:43.284331] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:19:43.657931] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-15T17:19:44.007488] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:19:44.457878] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-15T17:19:45.174830] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:19:45.257847] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-15T17:19:45.439407] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:19:46.057881] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-15T17:19:46.254502] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:19:46.857871] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-15T17:19:47.009929] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:19:47.657881] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-15T17:19:48.233917] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:19:48.457858] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-15T17:19:48.767008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:19:49.257889] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-15T17:19:49.759935] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:19:50.058121] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-15T17:19:50.857951] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-15T17:19:50.982786] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:19:51.119064] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:19:51.657864] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-15T17:19:51.828434] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:19:52.457919] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-15T17:19:53.229712] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T17:19:53.257879] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-15T17:19:53.296457] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T17:19:54.057909] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-15T17:19:54.479855] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:19:54.857873] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-15T17:19:55.486209] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:19:55.657882] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-15T17:19:56.052499] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T17:19:56.055682] [INFO ] [REMOTE ] AWR: Full fetch complete (24215 records). [2025-09-15T17:19:56.055770] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-15T17:19:56.436046] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-15T17:19:56.436178] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-15T17:19:56.436673] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-15T17:19:56.436779] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-15T17:19:56.438097] [DEBUG] [LOCAL ] AWR: Trimmed 24215 records to 16093 (keeping 150 days of data) [2025-09-15T17:19:56.490236] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-15T17:19:56.557001] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:19:56.563608] [INFO ] [REMOTE ] AWP: Full fetch complete (23908 records). [2025-09-15T17:19:56.564404] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-15T17:19:56.709069] [DEBUG] [LOCAL ] AWR: Primary data saved (16093 records). [2025-09-15T17:19:56.744560] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-15T17:19:56.762184] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWR took 28.8s. Estimated remaining: 3h 44m 15s. Rate: 9.7 symbols/min [2025-09-15T17:19:57.150298] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:57.177762] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-15T17:19:57.177881] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-15T17:19:57.178289] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-15T17:19:57.178355] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-15T17:19:57.179518] [DEBUG] [LOCAL ] AWP: Trimmed 23908 records to 16615 (keeping 150 days of data) [2025-09-15T17:19:57.258325] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-15T17:19:57.310972] [DEBUG] [LOCAL ] AWP: Primary data saved (16615 records). [2025-09-15T17:19:57.313009] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-15T17:19:57.313192] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWP took 35.5s. Estimated remaining: 3h 43m 6s. Rate: 9.7 symbols/min [2025-09-15T17:19:57.312873] [DEBUG] [LOCAL ] AXP: Loaded 40062 existing records from primary storage. [2025-09-15T17:19:57.313607] [INFO ] [MAIN ] AXP: Loaded 40062 existing records. [2025-09-15T17:19:57.675992] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:57.707228] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:57.708463] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-15T17:19:57.711767] [DEBUG] [LOCAL ] AXR: Loaded 2176 existing records from primary storage. [2025-09-15T17:19:57.711856] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-15T17:19:57.712219] [INFO ] [MAIN ] AXR: Loaded 2176 existing records. [2025-09-15T17:19:57.717520] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-15T17:19:57.729700] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-15T17:19:58.082326] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:58.098625] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-15T17:19:58.110134] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-15T17:19:58.112628] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T17:19:58.118087] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-15T17:19:58.130088] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-15T17:19:58.211414] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-15T17:19:58.736044] [INFO ] [REMOTE ] AXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:58.831961] [INFO ] [REMOTE ] AXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:58.859403] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-15T17:19:58.866096] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:19:59.341130] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:19:59.344705] [INFO ] [REMOTE ] AX: Full fetch complete (31207 records). [2025-09-15T17:19:59.344840] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-15T17:19:59.478923] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T17:19:59.662997] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-15T17:19:59.731114] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-15T17:19:59.731203] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-15T17:19:59.731611] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-15T17:19:59.731670] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-15T17:19:59.732589] [DEBUG] [LOCAL ] AX: Trimmed 31207 records to 20149 (keeping 150 days of data) [2025-09-15T17:19:59.855377] [DEBUG] [LOCAL ] AX: Primary data saved (20149 records). [2025-09-15T17:19:59.855509] [INFO ] [MAIN ] AX: Full history saved. [2025-09-15T17:19:59.855596] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 18.1s. Estimated remaining: 3h 42m 20s. Rate: 9.8 symbols/min [2025-09-15T17:20:00.033572] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:00.069727] [DEBUG] [LOCAL ] AXS: Loaded 28568 existing records from primary storage. [2025-09-15T17:20:00.069913] [INFO ] [MAIN ] AXS: Loaded 28568 existing records. [2025-09-15T17:20:00.248343] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:00.248599] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-15T17:20:00.248662] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-15T17:20:00.250828] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-15T17:20:00.250886] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-15T17:20:00.464123] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-15T17:20:00.599802] [INFO ] [REMOTE ] AXS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:01.257887] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-15T17:20:01.597665] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:20:02.057894] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-15T17:20:02.382938] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:20:02.430013] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:20:02.493007] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:20:02.857885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-15T17:20:03.657930] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-15T17:20:04.333264] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:20:04.457879] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-15T17:20:05.257883] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-15T17:20:05.637767] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:20:05.824752] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-15T17:20:06.057873] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-15T17:20:06.843761] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:20:06.849788] [INFO ] [REMOTE ] AXL: Full fetch complete (55030 records). [2025-09-15T17:20:06.849964] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-15T17:20:06.863949] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-15T17:20:07.235479] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-15T17:20:07.235578] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-15T17:20:07.236198] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-15T17:20:07.236247] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-15T17:20:07.237547] [DEBUG] [LOCAL ] AXL: Trimmed 55030 records to 37150 (keeping 150 days of data) [2025-09-15T17:20:07.432252] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:20:07.462982] [DEBUG] [LOCAL ] AXL: Primary data saved (37150 records). [2025-09-15T17:20:07.463151] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-15T17:20:07.463890] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 25.6s. Estimated remaining: 3h 42m 30s. Rate: 9.8 symbols/min [2025-09-15T17:20:07.637422] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:07.660522] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-15T17:20:07.678151] [DEBUG] [LOCAL ] AXTA: Loaded 39189 existing records from primary storage. [2025-09-15T17:20:07.678290] [INFO ] [MAIN ] AXTA: Loaded 39189 existing records. [2025-09-15T17:20:07.868944] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:07.869254] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-15T17:20:07.869310] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-15T17:20:07.870155] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-15T17:20:07.870206] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-15T17:20:08.224150] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:08.428392] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-15T17:20:08.457835] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-15T17:20:08.660772] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:20:09.257905] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-15T17:20:10.057928] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-15T17:20:10.313768] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:20:10.363413] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T17:20:10.658957] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:20:10.857868] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-15T17:20:11.381979] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:20:11.657910] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-15T17:20:12.457925] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-15T17:20:13.184876] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:20:13.257851] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-15T17:20:13.824553] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:20:14.057902] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-15T17:20:14.391018] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T17:20:14.857872] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-15T17:20:15.413412] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:20:15.657869] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-15T17:20:16.327856] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:20:16.457872] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-15T17:20:16.831404] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-15T17:20:17.257911] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-15T17:20:17.398247] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:20:17.700938] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:20:18.057999] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-15T17:20:18.611607] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:20:18.612717] [INFO ] [REMOTE ] AXR: Full fetch complete (3338 records). [2025-09-15T17:20:18.612790] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-15T17:20:18.863057] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-15T17:20:18.973656] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-15T17:20:18.973733] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-15T17:20:18.973841] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-15T17:20:18.973877] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-15T17:20:18.974220] [DEBUG] [LOCAL ] AXR: Trimmed 3338 records to 2129 (keeping 150 days of data) [2025-09-15T17:20:18.987479] [DEBUG] [LOCAL ] AXR: Primary data saved (2129 records). [2025-09-15T17:20:18.987538] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-15T17:20:18.987617] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 21.7s. Estimated remaining: 3h 43m 23s. Rate: 9.7 symbols/min [2025-09-15T17:20:19.657897] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-15T17:20:20.457867] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-15T17:20:21.039465] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-15T17:20:21.182805] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:20:21.257905] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-15T17:20:21.766401] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:20:21.771011] [INFO ] [REMOTE ] AXS: Full fetch complete (41426 records). [2025-09-15T17:20:21.771153] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-15T17:20:22.063892] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-15T17:20:22.158353] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-15T17:20:22.158461] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-15T17:20:22.159161] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-15T17:20:22.159212] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-15T17:20:22.160433] [DEBUG] [LOCAL ] AXS: Trimmed 41426 records to 28095 (keeping 150 days of data) [2025-09-15T17:20:22.338469] [DEBUG] [LOCAL ] AXS: Primary data saved (28095 records). [2025-09-15T17:20:22.338634] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-15T17:20:22.338781] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXS took 22.5s. Estimated remaining: 3h 42m 46s. Rate: 9.7 symbols/min [2025-09-15T17:20:23.031102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:20:23.042361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-15T17:20:23.753107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:20:23.763941] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-15T17:20:24.717470] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:20:24.722971] [INFO ] [REMOTE ] AXP: Full fetch complete (57478 records). [2025-09-15T17:20:24.723113] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-15T17:20:24.724016] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:20:24.724111] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:20:24.724149] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:20:24.724187] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-15T17:20:24.724248] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-15T17:20:24.724296] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-09-15T17:20:24.724696] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-09-15T17:20:24.726083] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 28.0s. Estimated remaining: 3h 41m 59s. Rate: 9.8 symbols/min [2025-09-15T17:20:25.274869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:20:25.286844] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-15T17:20:26.946317] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T17:20:26.958796] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-15T17:20:28.329150] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:20:28.334777] [INFO ] [REMOTE ] AXTA: Full fetch complete (56563 records). [2025-09-15T17:20:28.334883] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-15T17:20:28.720625] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-15T17:20:28.720738] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-15T17:20:28.721342] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-15T17:20:28.721384] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-15T17:20:28.722762] [DEBUG] [LOCAL ] AXTA: Trimmed 56563 records to 38451 (keeping 150 days of data) [2025-09-15T17:20:28.952570] [DEBUG] [LOCAL ] AXTA: Primary data saved (38451 records). [2025-09-15T17:20:28.952770] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-15T17:20:28.953498] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 21.5s. Estimated remaining: 3h 41m 32s. Rate: 9.8 symbols/min [2025-09-15T17:20:29.608419] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.621138] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.617698] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.621317] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-15T17:20:29.643887] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-15T17:20:29.645967] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-15T17:20:29.646052] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-15T17:20:29.646110] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-15T17:20:29.646163] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-15T17:20:29.652346] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.745254] [DEBUG] [LOCAL ] AZO: Loaded 7902 existing records from primary storage. [2025-09-15T17:20:29.756891] [INFO ] [MAIN ] AZO: Loaded 7902 existing records. [2025-09-15T17:20:29.875469] [DEBUG] [LOCAL ] AZZ: Loaded 16871 existing records from primary storage. [2025-09-15T17:20:29.901420] [INFO ] [MAIN ] AZZ: Loaded 16871 existing records. [2025-09-15T17:20:30.056811] [DEBUG] [LOCAL ] AYI: Loaded 17957 existing records from primary storage. [2025-09-15T17:20:30.208166] [INFO ] [MAIN ] AYI: Loaded 17957 existing records. [2025-09-15T17:20:30.235014] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.339887] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.455511] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.443429] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-15T17:20:30.490447] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.504834] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-15T17:20:30.523858] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-15T17:20:30.543661] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-15T17:20:30.533684] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-15T17:20:30.584471] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-15T17:20:30.579279] [INFO ] [REMOTE ] B: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:30.647359] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-15T17:20:30.701578] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.860837] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.910893] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-15T17:20:30.953422] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:30.983311] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-15T17:20:31.017215] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-15T17:20:31.025062] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-15T17:20:31.101046] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-15T17:20:31.412007] [INFO ] [REMOTE ] AZO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.437344] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-15T17:20:31.467813] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:31.570713] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-15T17:20:31.595680] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-15T17:20:31.643802] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.669872] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-15T17:20:31.768280] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.768583] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-15T17:20:31.886432] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:31.886718] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-15T17:20:31.887128] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-15T17:20:32.479384] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T17:20:32.481608] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-15T17:20:32.803054] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:20:32.807593] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-15T17:20:33.040932] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:20:33.118833] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:20:33.243806] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:20:33.257861] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-15T17:20:33.626249] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:20:34.057879] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-15T17:20:34.857891] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-15T17:20:35.001378] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:20:35.228117] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T17:20:35.533009] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:20:35.657867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-15T17:20:36.458078] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-15T17:20:36.734460] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:20:37.010470] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T17:20:37.257916] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-15T17:20:38.057934] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-15T17:20:38.080316] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:20:38.857876] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-15T17:20:39.132312] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:20:39.584296] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:20:39.657896] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-15T17:20:40.457898] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-15T17:20:40.500981] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:20:41.257904] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-15T17:20:42.057879] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-15T17:20:42.473082] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:20:42.621429] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-15T17:20:42.857897] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-15T17:20:43.599092] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:20:43.657830] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-15T17:20:44.457840] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-15T17:20:44.741240] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T17:20:44.847869] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T17:20:45.257875] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-15T17:20:45.379590] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:20:46.057926] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-15T17:20:46.541772] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:20:46.857874] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-15T17:20:46.869411] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:20:46.871050] [INFO ] [REMOTE ] AZO: Full fetch complete (12168 records). [2025-09-15T17:20:46.871119] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-15T17:20:47.230413] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-15T17:20:47.230495] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-15T17:20:47.230780] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-15T17:20:47.230833] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-15T17:20:47.231312] [DEBUG] [LOCAL ] AZO: Trimmed 12168 records to 7801 (keeping 150 days of data) [2025-09-15T17:20:47.280700] [DEBUG] [LOCAL ] AZO: Primary data saved (7801 records). [2025-09-15T17:20:47.280798] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-15T17:20:47.280879] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. AZO took 18.3s. Estimated remaining: 3h 43m 37s. Rate: 9.7 symbols/min [2025-09-15T17:20:47.448710] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:47.448921] [DEBUG] [LOCAL ] BA: No existing data file found in primary storage. [2025-09-15T17:20:47.448960] [WARN ] [MAIN ] BA: No existing data found, performing full refresh instead. [2025-09-15T17:20:47.449078] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-15T17:20:47.449116] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-15T17:20:47.449157] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-09-15T17:20:47.449189] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-15T17:20:47.665747] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-15T17:20:47.818067] [INFO ] [REMOTE ] BA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:47.940702] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:20:48.457875] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-15T17:20:49.257831] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-15T17:20:49.501796] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:20:49.505607] [INFO ] [REMOTE ] AZZ: Full fetch complete (23997 records). [2025-09-15T17:20:49.505722] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-15T17:20:49.882967] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-15T17:20:49.883141] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-15T17:20:49.883532] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-15T17:20:49.883607] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-15T17:20:49.899917] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T17:20:49.900076] [DEBUG] [LOCAL ] AZZ: Trimmed 23997 records to 16542 (keeping 150 days of data) [2025-09-15T17:20:49.906706] [INFO ] [REMOTE ] B: Full fetch complete (34240 records). [2025-09-15T17:20:49.906838] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-15T17:20:50.061719] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-15T17:20:50.182887] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-15T17:20:50.185222] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:20:50.185901] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:20:50.186476] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-15T17:20:50.186910] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-15T17:20:50.187527] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-15T17:20:50.188430] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-15T17:20:50.189136] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. B took 21.2s. Estimated remaining: 3h 42m 56s. Rate: 9.7 symbols/min [2025-09-15T17:20:50.383099] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:50.402832] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:20:50.416440] [DEBUG] [LOCAL ] AZZ: Primary data saved (16542 records). [2025-09-15T17:20:50.416583] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-15T17:20:50.416711] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZZ took 21.5s. Estimated remaining: 3h 41m 46s. Rate: 9.8 symbols/min [2025-09-15T17:20:50.625361] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:50.626322] [DEBUG] [LOCAL ] BABA: Loaded 40560 existing records from primary storage. [2025-09-15T17:20:50.626751] [INFO ] [MAIN ] BABA: Loaded 40560 existing records. [2025-09-15T17:20:50.818631] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:50.828117] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-15T17:20:50.828209] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-15T17:20:50.829525] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-15T17:20:50.829594] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-15T17:20:50.862462] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-15T17:20:50.952844] [DEBUG] [LOCAL ] BAC: Loaded 40548 existing records from primary storage. [2025-09-15T17:20:50.958724] [INFO ] [MAIN ] BAC: Loaded 40548 existing records. [2025-09-15T17:20:51.331002] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:51.356989] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-15T17:20:51.381745] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-15T17:20:51.405083] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-15T17:20:51.409416] [INFO ] [REMOTE ] BABA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:51.409557] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-15T17:20:51.674319] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-15T17:20:51.804953] [INFO ] [REMOTE ] BAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:51.915922] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:20:52.087121] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T17:20:52.457887] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-15T17:20:53.257884] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-15T17:20:53.748167] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T17:20:54.057935] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-15T17:20:54.682610] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:20:54.857987] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-15T17:20:55.149230] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T17:20:55.657910] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-15T17:20:56.133395] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:20:56.457889] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-15T17:20:57.257876] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-15T17:20:57.356124] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:20:57.359237] [INFO ] [REMOTE ] AYI: Full fetch complete (27630 records). [2025-09-15T17:20:57.359376] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-15T17:20:57.779672] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-15T17:20:57.779989] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-15T17:20:57.780588] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-15T17:20:57.780728] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-15T17:20:57.783928] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-15T17:20:57.796990] [DEBUG] [LOCAL ] AYI: Trimmed 27630 records to 17494 (keeping 150 days of data) [2025-09-15T17:20:57.912054] [DEBUG] [LOCAL ] AYI: Primary data saved (17494 records). [2025-09-15T17:20:57.912367] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-15T17:20:57.912462] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 29.0s. Estimated remaining: 3h 41m 55s. Rate: 9.8 symbols/min [2025-09-15T17:20:58.065108] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-15T17:20:58.075679] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-15T17:20:58.146071] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:58.187050] [DEBUG] [LOCAL ] BAH: Loaded 38796 existing records from primary storage. [2025-09-15T17:20:58.187204] [INFO ] [MAIN ] BAH: Loaded 38796 existing records. [2025-09-15T17:20:58.362875] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:58.363114] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-15T17:20:58.363159] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-15T17:20:58.364182] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-15T17:20:58.364241] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-15T17:20:58.718903] [INFO ] [REMOTE ] BAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:58.857899] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-15T17:20:59.657907] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-15T17:20:59.852183] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-15T17:21:00.459724] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-15T17:21:00.465876] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-15T17:21:01.178090] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-15T17:21:01.257833] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-15T17:21:02.041185] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-15T17:21:02.057825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-15T17:21:02.857928] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-15T17:21:04.138501] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (3.68 seconds). [2025-09-15T17:21:04.151401] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-15T17:21:04.363501] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-15T17:21:04.457868] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-15T17:21:04.626505] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T17:21:05.257909] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-15T17:21:05.554007] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-15T17:21:06.057880] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-15T17:21:06.104063] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T17:21:06.626275] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T17:21:06.858792] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-15T17:21:06.865726] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:21:07.657891] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-15T17:21:08.181333] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:21:08.457889] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-15T17:21:09.257881] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-15T17:21:09.314675] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-15T17:21:10.035971] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T17:21:10.057827] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-15T17:21:10.511664] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T17:21:10.862943] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-15T17:21:10.883593] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:21:11.657924] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-15T17:21:12.457850] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-15T17:21:12.571933] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-15T17:21:13.257919] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-15T17:21:13.804357] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-15T17:21:13.810695] [INFO ] [REMOTE ] BA: Full fetch complete (58471 records). [2025-09-15T17:21:13.810846] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-15T17:21:14.214557] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-15T17:21:14.214701] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-15T17:21:14.215637] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-15T17:21:14.215775] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-15T17:21:14.218307] [DEBUG] [LOCAL ] BA: Trimmed 58471 records to 39751 (keeping 150 days of data) [2025-09-15T17:21:14.363698] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (3.50 seconds). [2025-09-15T17:21:14.379959] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-15T17:21:14.526297] [DEBUG] [LOCAL ] BA: Primary data saved (39751 records). [2025-09-15T17:21:14.526445] [INFO ] [MAIN ] BA: Full history saved. [2025-09-15T17:21:14.526541] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 27.2s. Estimated remaining: 3h 43m 39s. Rate: 9.7 symbols/min [2025-09-15T17:21:14.701384] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:14.728588] [DEBUG] [LOCAL ] BAK: Loaded 29310 existing records from primary storage. [2025-09-15T17:21:14.728759] [INFO ] [MAIN ] BAK: Loaded 29310 existing records. [2025-09-15T17:21:14.904431] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:14.904682] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-15T17:21:14.904757] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-15T17:21:14.905492] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-15T17:21:14.905549] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-15T17:21:15.260464] [INFO ] [REMOTE ] BAK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:15.261007] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-15T17:21:15.302375] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-15T17:21:15.657966] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-15T17:21:16.066246] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-15T17:21:16.072770] [INFO ] [REMOTE ] BABA: Full fetch complete (58500 records). [2025-09-15T17:21:16.072928] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-15T17:21:16.469192] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-15T17:21:16.469279] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-15T17:21:16.469906] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-15T17:21:16.469953] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-15T17:21:16.471245] [DEBUG] [LOCAL ] BABA: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T17:21:16.741037] [DEBUG] [LOCAL ] BABA: Primary data saved (39780 records). [2025-09-15T17:21:16.741242] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-15T17:21:16.742103] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BABA took 26.6s. Estimated remaining: 3h 42m 51s. Rate: 9.7 symbols/min [2025-09-15T17:21:16.920335] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:16.967858] [DEBUG] [LOCAL ] BALL: Loaded 38898 existing records from primary storage. [2025-09-15T17:21:16.968003] [INFO ] [MAIN ] BALL: Loaded 38898 existing records. [2025-09-15T17:21:17.154162] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:17.154732] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-15T17:21:17.155219] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-15T17:21:17.156442] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-15T17:21:17.156976] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-15T17:21:17.431549] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T17:21:17.455133] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-15T17:21:17.465177] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-15T17:21:17.543345] [INFO ] [REMOTE ] BAC: Full fetch complete (58488 records). [2025-09-15T17:21:17.570291] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-15T17:21:17.593146] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:21:17.671861] [INFO ] [REMOTE ] BALL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:17.705620] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-15T17:21:18.031249] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-15T17:21:18.031330] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-15T17:21:18.031952] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-15T17:21:18.031996] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-15T17:21:18.033262] [DEBUG] [LOCAL ] BAC: Trimmed 58488 records to 39768 (keeping 150 days of data) [2025-09-15T17:21:18.092276] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-15T17:21:18.292169] [DEBUG] [LOCAL ] BAC: Primary data saved (39768 records). [2025-09-15T17:21:18.292396] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-15T17:21:18.293207] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 27.9s. Estimated remaining: 3h 41m 56s. Rate: 9.7 symbols/min [2025-09-15T17:21:18.469116] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:18.469294] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-15T17:21:18.469334] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-15T17:21:18.469494] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-15T17:21:18.469542] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-15T17:21:18.469586] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-15T17:21:18.469621] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-15T17:21:18.872261] [INFO ] [REMOTE ] BALY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:18.872746] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-15T17:21:18.897352] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T17:21:19.655915] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T17:21:19.665844] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-15T17:21:19.705902] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:21:19.780713] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:21:20.457876] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-15T17:21:21.152862] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:21:21.257884] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-15T17:21:21.812487] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:21:21.818469] [INFO ] [REMOTE ] BAH: Full fetch complete (56419 records). [2025-09-15T17:21:21.818590] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-15T17:21:22.067815] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-15T17:21:22.225477] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-15T17:21:22.225586] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-15T17:21:22.226217] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-15T17:21:22.226280] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-15T17:21:22.228123] [DEBUG] [LOCAL ] BAH: Trimmed 56419 records to 38077 (keeping 150 days of data) [2025-09-15T17:21:22.361102] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:21:22.524098] [DEBUG] [LOCAL ] BAH: Primary data saved (38077 records). [2025-09-15T17:21:22.524265] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-15T17:21:22.524619] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAH took 24.6s. Estimated remaining: 3h 41m 30s. Rate: 9.8 symbols/min [2025-09-15T17:21:22.699984] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:22.746520] [DEBUG] [LOCAL ] BAM: Loaded 38990 existing records from primary storage. [2025-09-15T17:21:22.746788] [INFO ] [MAIN ] BAM: Loaded 38990 existing records. [2025-09-15T17:21:22.863040] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-15T17:21:22.932600] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:22.932948] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-15T17:21:22.933012] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-15T17:21:22.933998] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-15T17:21:22.934073] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-15T17:21:23.291134] [INFO ] [REMOTE ] BAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:23.550377] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:21:23.657928] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-15T17:21:23.678343] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:21:24.457925] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-15T17:21:25.035737] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:21:25.049676] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:21:25.257914] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-15T17:21:26.057975] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-15T17:21:26.857928] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-15T17:21:27.564790] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-15T17:21:27.614224] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:21:27.657811] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:21:27.657923] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-15T17:21:28.457881] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-15T17:21:29.007999] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:21:29.257920] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-15T17:21:29.867360] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:21:30.057891] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-15T17:21:30.685941] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:21:30.857891] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-15T17:21:30.925868] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:21:31.657889] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-15T17:21:32.272095] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:21:32.276772] [INFO ] [REMOTE ] BAK: Full fetch complete (42223 records). [2025-09-15T17:21:32.276943] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-15T17:21:32.458066] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-15T17:21:32.659928] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-15T17:21:32.660016] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-15T17:21:32.660490] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-15T17:21:32.660542] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-15T17:21:32.661504] [DEBUG] [LOCAL ] BAK: Trimmed 42223 records to 28792 (keeping 150 days of data) [2025-09-15T17:21:32.829375] [DEBUG] [LOCAL ] BAK: Primary data saved (28792 records). [2025-09-15T17:21:32.829525] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-15T17:21:32.829611] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 18.3s. Estimated remaining: 3h 42m 7s. Rate: 9.7 symbols/min [2025-09-15T17:21:33.007184] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:33.052941] [DEBUG] [LOCAL ] BANC: Loaded 38316 existing records from primary storage. [2025-09-15T17:21:33.053099] [INFO ] [MAIN ] BANC: Loaded 38316 existing records. [2025-09-15T17:21:33.230385] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:33.230676] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-15T17:21:33.230726] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-15T17:21:33.231751] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-15T17:21:33.231806] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-15T17:21:33.262932] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-15T17:21:33.596942] [INFO ] [REMOTE ] BANC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:33.625623] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T17:21:34.057874] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-15T17:21:34.092605] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T17:21:34.137566] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:21:34.857889] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-15T17:21:35.381819] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:21:35.657908] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-15T17:21:36.232625] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:21:36.377679] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T17:21:36.457890] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-15T17:21:37.257887] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-15T17:21:37.909306] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T17:21:38.057914] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-15T17:21:38.731338] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:21:38.733277] [INFO ] [REMOTE ] BALY: Full fetch complete (9100 records). [2025-09-15T17:21:38.733388] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-15T17:21:38.862940] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-15T17:21:39.131673] [DEBUG] [VALIDATOR ] BALY: All expected trading days are present. [2025-09-15T17:21:39.131796] [DEBUG] [VALIDATOR ] BALY: Primary data validation passed. [2025-09-15T17:21:39.132179] [INFO ] [MAIN ] BALY: Fetched primary data is valid. [2025-09-15T17:21:39.132350] [DEBUG] [LOCAL ] BALY: Saving primary data. [2025-09-15T17:21:39.133144] [DEBUG] [LOCAL ] BALY: Trimmed 9100 records to 7145 (keeping 150 days of data) [2025-09-15T17:21:39.198399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:21:39.218970] [DEBUG] [LOCAL ] BALY: Primary data saved (7145 records). [2025-09-15T17:21:39.219117] [INFO ] [MAIN ] BALY: Full history saved. [2025-09-15T17:21:39.219196] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALY took 20.9s. Estimated remaining: 3h 42m 3s. Rate: 9.7 symbols/min [2025-09-15T17:21:39.384601] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:39.410220] [DEBUG] [LOCAL ] BAP: Loaded 19263 existing records from primary storage. [2025-09-15T17:21:39.410371] [INFO ] [MAIN ] BAP: Loaded 19263 existing records. [2025-09-15T17:21:39.590010] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:39.590309] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-15T17:21:39.590357] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-15T17:21:39.590979] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-15T17:21:39.591050] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-15T17:21:39.663195] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-15T17:21:39.957848] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:40.457900] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-15T17:21:40.616601] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:21:40.890085] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:21:41.257882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-15T17:21:41.435070] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:21:42.057948] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-15T17:21:42.857877] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-15T17:21:43.042007] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:21:43.070804] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:21:43.657899] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-15T17:21:44.457949] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-15T17:21:44.569758] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:21:44.682409] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:21:45.257875] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-15T17:21:45.932207] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:21:46.057845] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-15T17:21:46.663079] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:21:46.857886] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-15T17:21:47.383635] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:21:47.657873] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-15T17:21:47.851048] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:21:48.457921] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-15T17:21:48.880118] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:21:49.257867] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-15T17:21:49.931797] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:21:49.937539] [INFO ] [REMOTE ] BAM: Full fetch complete (56537 records). [2025-09-15T17:21:49.937672] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-15T17:21:50.062986] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-15T17:21:50.318456] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-15T17:21:50.318541] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-15T17:21:50.319136] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-15T17:21:50.319182] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-15T17:21:50.320340] [DEBUG] [LOCAL ] BAM: Trimmed 56537 records to 38250 (keeping 150 days of data) [2025-09-15T17:21:50.441535] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:21:50.449850] [INFO ] [REMOTE ] BALL: Full fetch complete (56479 records). [2025-09-15T17:21:50.454806] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-15T17:21:50.889275] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-15T17:21:50.938250] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-15T17:21:50.939100] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-15T17:21:50.941373] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-15T17:21:50.941715] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-15T17:21:50.947752] [DEBUG] [LOCAL ] BALL: Trimmed 56479 records to 38150 (keeping 150 days of data) [2025-09-15T17:21:51.182807] [DEBUG] [LOCAL ] BAM: Primary data saved (38250 records). [2025-09-15T17:21:51.184514] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-15T17:21:51.185448] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BAM took 28.7s. Estimated remaining: 3h 42m 56s. Rate: 9.7 symbols/min [2025-09-15T17:21:51.384534] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:51.396377] [DEBUG] [LOCAL ] BALL: Primary data saved (38150 records). [2025-09-15T17:21:51.396602] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-15T17:21:51.397724] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BALL took 34.7s. Estimated remaining: 3h 41m 49s. Rate: 9.7 symbols/min [2025-09-15T17:21:51.593638] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:51.596205] [DEBUG] [LOCAL ] BARK: Loaded 28961 existing records from primary storage. [2025-09-15T17:21:51.596416] [INFO ] [MAIN ] BARK: Loaded 28961 existing records. [2025-09-15T17:21:51.794117] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:51.794495] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-15T17:21:51.794591] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-15T17:21:51.795398] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-15T17:21:51.795453] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-15T17:21:51.915381] [DEBUG] [LOCAL ] BAX: Loaded 40292 existing records from primary storage. [2025-09-15T17:21:51.968457] [INFO ] [MAIN ] BAX: Loaded 40292 existing records. [2025-09-15T17:21:51.995184] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T17:21:52.171876] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-15T17:21:52.376494] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:52.380336] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-15T17:21:52.398039] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:52.398440] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-15T17:21:52.404828] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-15T17:21:52.413893] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-15T17:21:52.471025] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-15T17:21:52.470896] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:21:52.770310] [INFO ] [REMOTE ] BAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:53.257893] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-15T17:21:53.585498] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:21:53.807147] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T17:21:54.057934] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-15T17:21:54.548865] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:21:54.857893] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-15T17:21:55.063162] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:21:55.657908] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-15T17:21:56.457952] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-15T17:21:56.567368] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:21:56.953839] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:21:56.963413] [INFO ] [REMOTE ] BANC: Full fetch complete (55603 records). [2025-09-15T17:21:56.963630] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-15T17:21:57.265382] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-15T17:21:57.405026] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-15T17:21:57.405158] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-15T17:21:57.405765] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-15T17:21:57.405823] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-15T17:21:57.420970] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:21:57.426446] [DEBUG] [LOCAL ] BANC: Trimmed 55603 records to 37542 (keeping 150 days of data) [2025-09-15T17:21:57.657487] [DEBUG] [LOCAL ] BANC: Primary data saved (37542 records). [2025-09-15T17:21:57.657635] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-15T17:21:57.659726] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BANC took 24.8s. Estimated remaining: 3h 41m 44s. Rate: 9.7 symbols/min [2025-09-15T17:21:57.826553] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:57.867225] [DEBUG] [LOCAL ] BB: Loaded 39734 existing records from primary storage. [2025-09-15T17:21:57.867369] [INFO ] [MAIN ] BB: Loaded 39734 existing records. [2025-09-15T17:21:58.045087] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:58.045346] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-15T17:21:58.045391] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-15T17:21:58.046290] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-15T17:21:58.046341] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-15T17:21:58.066493] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-15T17:21:58.394078] [INFO ] [REMOTE ] BB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:58.857898] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-15T17:21:59.101082] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:21:59.153784] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:21:59.657877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-15T17:22:00.457895] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-15T17:22:00.783810] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T17:22:00.815760] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:22:01.257881] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-15T17:22:01.419620] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:22:01.423383] [INFO ] [REMOTE ] BAP: Full fetch complete (28650 records). [2025-09-15T17:22:01.423545] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-15T17:22:01.822208] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-15T17:22:01.822297] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-15T17:22:01.822702] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-15T17:22:01.822764] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-15T17:22:01.823591] [DEBUG] [LOCAL ] BAP: Trimmed 28650 records to 18874 (keeping 150 days of data) [2025-09-15T17:22:01.944447] [DEBUG] [LOCAL ] BAP: Primary data saved (18874 records). [2025-09-15T17:22:01.944610] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-15T17:22:01.944757] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BAP took 22.7s. Estimated remaining: 3h 41m 19s. Rate: 9.7 symbols/min [2025-09-15T17:22:02.063075] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-15T17:22:02.123285] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:02.168979] [DEBUG] [LOCAL ] BBAI: Loaded 40560 existing records from primary storage. [2025-09-15T17:22:02.169134] [INFO ] [MAIN ] BBAI: Loaded 40560 existing records. [2025-09-15T17:22:02.354903] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:02.355184] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-15T17:22:02.355234] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-15T17:22:02.356229] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-15T17:22:02.356284] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-15T17:22:02.734068] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:02.822052] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:22:02.857821] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-15T17:22:03.323432] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:22:03.657874] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-15T17:22:04.283873] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:22:04.457869] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-15T17:22:05.257877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-15T17:22:05.345440] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:22:06.057868] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-15T17:22:06.318714] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:22:06.857883] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-15T17:22:06.933535] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T17:22:07.657884] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-15T17:22:07.815424] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:22:07.903672] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:22:08.457853] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-15T17:22:09.257888] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-15T17:22:09.457448] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:22:10.057891] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-15T17:22:10.272178] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:22:10.276131] [INFO ] [REMOTE ] BARK: Full fetch complete (41914 records). [2025-09-15T17:22:10.276237] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-15T17:22:10.276906] [FATAL] [VALIDATOR ] BARK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:22:10.276990] [FATAL] [MAIN ] BARK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:22:10.277053] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:22:10.277105] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-15T17:22:10.277168] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-15T17:22:10.277207] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-09-15T17:22:10.277501] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-09-15T17:22:10.277586] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 19.1s. Estimated remaining: 3h 41m 34s. Rate: 9.7 symbols/min [2025-09-15T17:22:10.461029] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:10.525740] [DEBUG] [LOCAL ] BBAR: Loaded 31093 existing records from primary storage. [2025-09-15T17:22:10.527340] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-15T17:22:10.538116] [INFO ] [MAIN ] BBAR: Loaded 31093 existing records. [2025-09-15T17:22:10.722639] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:10.722926] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-15T17:22:10.722976] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-15T17:22:10.723905] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-15T17:22:10.723959] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-15T17:22:10.866914] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-15T17:22:11.092565] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:11.647376] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:22:11.657881] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-15T17:22:12.457861] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-15T17:22:13.127905] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:22:13.257856] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-15T17:22:13.332729] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-15T17:22:14.057926] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-15T17:22:14.236432] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T17:22:14.754588] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:22:14.857825] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-15T17:22:15.657919] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-15T17:22:16.462983] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-15T17:22:16.484434] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-15T17:22:16.552381] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:22:17.257913] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-15T17:22:18.059145] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-15T17:22:18.059062] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T17:22:18.336430] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:22:18.857865] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-15T17:22:19.044100] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-15T17:22:19.657898] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-15T17:22:19.887529] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:22:20.265436] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:22:20.457866] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-15T17:22:21.257874] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-15T17:22:21.595718] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:22:21.602495] [INFO ] [REMOTE ] BAX: Full fetch complete (57770 records). [2025-09-15T17:22:21.602853] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-15T17:22:21.604089] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:22:21.604218] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:22:21.604265] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:22:21.604341] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-15T17:22:21.604440] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-15T17:22:21.604483] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-09-15T17:22:21.604916] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-09-15T17:22:21.605039] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 30.2s. Estimated remaining: 3h 42m 19s. Rate: 9.7 symbols/min [2025-09-15T17:22:21.794782] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:21.840690] [DEBUG] [LOCAL ] BBD: Loaded 40069 existing records from primary storage. [2025-09-15T17:22:21.841083] [INFO ] [MAIN ] BBD: Loaded 40069 existing records. [2025-09-15T17:22:22.031284] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:22.059272] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-15T17:22:22.060065] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-15T17:22:22.063462] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-15T17:22:22.063703] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-15T17:22:22.075303] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-15T17:22:22.075413] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-15T17:22:22.472294] [INFO ] [REMOTE ] BBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:22.641734] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:22:22.857884] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-15T17:22:23.479329] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:22:23.485363] [INFO ] [REMOTE ] BB: Full fetch complete (57614 records). [2025-09-15T17:22:23.485490] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-15T17:22:23.664744] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-15T17:22:23.876574] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-15T17:22:23.876790] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-15T17:22:23.877507] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-15T17:22:23.877565] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-15T17:22:23.878838] [DEBUG] [LOCAL ] BB: Trimmed 57614 records to 38976 (keeping 150 days of data) [2025-09-15T17:22:24.113032] [DEBUG] [LOCAL ] BB: Primary data saved (38976 records). [2025-09-15T17:22:24.113186] [INFO ] [MAIN ] BB: Full history saved. [2025-09-15T17:22:24.114114] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 26.5s. Estimated remaining: 3h 41m 37s. Rate: 9.7 symbols/min [2025-09-15T17:22:24.294359] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:24.319461] [DEBUG] [LOCAL ] BBDC: Loaded 23732 existing records from primary storage. [2025-09-15T17:22:24.319667] [INFO ] [MAIN ] BBDC: Loaded 23732 existing records. [2025-09-15T17:22:24.463157] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-15T17:22:24.505549] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:24.506087] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-15T17:22:24.506157] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-15T17:22:24.507039] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-15T17:22:24.507095] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-15T17:22:24.727735] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T17:22:24.921251] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:24.978131] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:22:25.257898] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-15T17:22:26.057927] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-15T17:22:26.516502] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:22:26.857903] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-15T17:22:26.958769] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-15T17:22:27.225856] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:22:27.657935] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-15T17:22:28.366732] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:22:28.457870] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-15T17:22:29.257916] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-15T17:22:29.877552] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-15T17:22:29.923664] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:22:29.928730] [INFO ] [REMOTE ] BBAR: Full fetch complete (44682 records). [2025-09-15T17:22:29.928821] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-15T17:22:30.070604] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-15T17:22:30.304437] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-15T17:22:30.304521] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-15T17:22:30.305055] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-15T17:22:30.305101] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-15T17:22:30.306128] [DEBUG] [LOCAL ] BBAR: Trimmed 44682 records to 30538 (keeping 150 days of data) [2025-09-15T17:22:30.506364] [DEBUG] [LOCAL ] BBAR: Primary data saved (30538 records). [2025-09-15T17:22:30.506519] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-15T17:22:30.506860] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBAR took 20.2s. Estimated remaining: 3h 41m 33s. Rate: 9.7 symbols/min [2025-09-15T17:22:30.685343] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:30.691332] [DEBUG] [LOCAL ] BBDO: Loaded 3603 existing records from primary storage. [2025-09-15T17:22:30.691451] [INFO ] [MAIN ] BBDO: Loaded 3603 existing records. [2025-09-15T17:22:30.870025] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-15T17:22:30.874359] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:30.875704] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-15T17:22:30.875759] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-15T17:22:30.875999] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-15T17:22:30.876045] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-15T17:22:31.263312] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:31.294077] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-15T17:22:31.657914] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-15T17:22:31.844963] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T17:22:32.193835] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:22:32.457876] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-15T17:22:32.487195] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-15T17:22:32.493736] [INFO ] [REMOTE ] BBAI: Full fetch complete (58500 records). [2025-09-15T17:22:32.493831] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-15T17:22:32.872112] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-15T17:22:32.872210] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-15T17:22:32.872843] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-15T17:22:32.872888] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-15T17:22:32.874098] [DEBUG] [LOCAL ] BBAI: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T17:22:33.122400] [DEBUG] [LOCAL ] BBAI: Primary data saved (39780 records). [2025-09-15T17:22:33.122594] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-15T17:22:33.123289] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAI took 31.2s. Estimated remaining: 3h 40m 51s. Rate: 9.7 symbols/min [2025-09-15T17:22:33.263093] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-15T17:22:33.313029] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:33.329667] [DEBUG] [LOCAL ] BBN: Loaded 13604 existing records from primary storage. [2025-09-15T17:22:33.329819] [INFO ] [MAIN ] BBN: Loaded 13604 existing records. [2025-09-15T17:22:33.506045] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:33.506334] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-15T17:22:33.506382] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-15T17:22:33.506946] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-15T17:22:33.507001] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-15T17:22:33.866905] [INFO ] [REMOTE ] BBN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:34.057846] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-15T17:22:34.174108] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T17:22:34.322608] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:22:34.683298] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:22:34.857876] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-15T17:22:35.657946] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-15T17:22:35.780997] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T17:22:36.457879] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-15T17:22:37.149762] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:22:37.257892] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-15T17:22:37.309873] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:22:38.057911] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-15T17:22:38.762112] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:22:38.857871] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-15T17:22:39.657849] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-15T17:22:39.733527] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:22:39.797910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:22:40.133264] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:22:40.457875] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-15T17:22:41.042290] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:22:41.258060] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-15T17:22:42.057882] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-15T17:22:42.606524] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T17:22:42.693618] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T17:22:42.857876] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-15T17:22:43.593115] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:22:43.657860] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-15T17:22:44.457890] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-15T17:22:45.257903] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-15T17:22:45.440058] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:22:45.447586] [INFO ] [REMOTE ] BBD: Full fetch complete (57836 records). [2025-09-15T17:22:45.447951] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-15T17:22:45.845366] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-15T17:22:45.845493] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-15T17:22:45.846422] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-15T17:22:45.846594] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-15T17:22:45.866293] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:22:45.873364] [DEBUG] [LOCAL ] BBD: Trimmed 57836 records to 39316 (keeping 150 days of data) [2025-09-15T17:22:46.079768] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-15T17:22:46.114194] [DEBUG] [LOCAL ] BBD: Primary data saved (39316 records). [2025-09-15T17:22:46.114350] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-15T17:22:46.114884] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 24.5s. Estimated remaining: 3h 41m 52s. Rate: 9.7 symbols/min [2025-09-15T17:22:46.290869] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:46.296333] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-15T17:22:46.304038] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-15T17:22:46.304533] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:22:46.304941] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-15T17:22:46.309660] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-15T17:22:46.310051] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-15T17:22:46.310096] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-15T17:22:46.669209] [INFO ] [REMOTE ] BBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:46.857884] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-15T17:22:47.071746] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:47.072059] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-15T17:22:47.363023] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:22:47.367794] [INFO ] [REMOTE ] BBDC: Full fetch complete (36836 records). [2025-09-15T17:22:47.367892] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-15T17:22:47.663089] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-15T17:22:47.744739] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-15T17:22:47.744824] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-15T17:22:47.745299] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-15T17:22:47.745340] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-15T17:22:47.746246] [DEBUG] [LOCAL ] BBDC: Trimmed 36836 records to 23228 (keeping 150 days of data) [2025-09-15T17:22:47.900544] [DEBUG] [LOCAL ] BBDC: Primary data saved (23228 records). [2025-09-15T17:22:47.900733] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-15T17:22:47.900835] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBDC took 23.8s. Estimated remaining: 3h 41m 3s. Rate: 9.7 symbols/min [2025-09-15T17:22:48.072729] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:48.078095] [DEBUG] [LOCAL ] BBU: Loaded 3202 existing records from primary storage. [2025-09-15T17:22:48.078196] [INFO ] [MAIN ] BBU: Loaded 3202 existing records. [2025-09-15T17:22:48.264357] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:48.264666] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-15T17:22:48.264740] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-15T17:22:48.265021] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-15T17:22:48.265073] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-15T17:22:48.468247] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-15T17:22:48.648776] [INFO ] [REMOTE ] BBU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:48.972438] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:48.972879] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-15T17:22:48.985431] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:22:49.257901] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-15T17:22:49.663820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T17:22:50.057899] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-15T17:22:50.256819] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:50.257235] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-15T17:22:50.857887] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-15T17:22:51.478256] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:22:51.657908] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-15T17:22:52.187446] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T17:22:52.457930] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-15T17:22:53.012667] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:22:53.013594] [INFO ] [REMOTE ] BBDO: Full fetch complete (5497 records). [2025-09-15T17:22:53.013680] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-15T17:22:53.262977] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-15T17:22:53.364467] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-15T17:22:53.364538] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-15T17:22:53.364720] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-15T17:22:53.364763] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-15T17:22:53.365128] [DEBUG] [LOCAL ] BBDO: Trimmed 5497 records to 3549 (keeping 150 days of data) [2025-09-15T17:22:53.386225] [DEBUG] [LOCAL ] BBDO: Primary data saved (3549 records). [2025-09-15T17:22:53.386296] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-15T17:22:53.386367] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBDO took 22.9s. Estimated remaining: 3h 40m 50s. Rate: 9.7 symbols/min [2025-09-15T17:22:53.554194] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:53.570965] [DEBUG] [LOCAL ] BBUC: Loaded 9469 existing records from primary storage. [2025-09-15T17:22:53.571117] [INFO ] [MAIN ] BBUC: Loaded 9469 existing records. [2025-09-15T17:22:53.753269] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:53.753563] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-15T17:22:53.753627] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-15T17:22:53.754138] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-15T17:22:53.754213] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-15T17:22:53.864585] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T17:22:54.062956] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-15T17:22:54.127584] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:54.752547] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:22:54.857825] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-15T17:22:55.657883] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-15T17:22:55.894234] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:22:56.457903] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-15T17:22:56.546939] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:22:57.100381] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:22:57.257836] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-15T17:22:58.057882] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-15T17:22:58.196881] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:22:58.591735] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:22:58.857958] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-15T17:22:59.309948] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:22:59.657888] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-15T17:23:00.311925] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:23:00.457870] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-15T17:23:01.124632] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T17:23:01.257878] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-15T17:23:01.760478] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T17:23:02.057875] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-15T17:23:02.857883] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-15T17:23:03.657932] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-15T17:23:03.944165] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:23:03.946871] [INFO ] [REMOTE ] BBN: Full fetch complete (19512 records). [2025-09-15T17:23:03.946965] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-15T17:23:04.284232] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T17:23:04.375405] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-15T17:23:04.375532] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-15T17:23:04.375968] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-15T17:23:04.376084] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-15T17:23:04.384800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:23:04.385091] [DEBUG] [LOCAL ] BBN: Trimmed 19512 records to 13404 (keeping 150 days of data) [2025-09-15T17:23:04.461420] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-15T17:23:04.486633] [DEBUG] [LOCAL ] BBN: Primary data saved (13404 records). [2025-09-15T17:23:04.486801] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-15T17:23:04.486898] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBN took 31.4s. Estimated remaining: 3h 41m 31s. Rate: 9.7 symbols/min [2025-09-15T17:23:04.660416] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:04.701352] [DEBUG] [LOCAL ] BBVA: Loaded 36749 existing records from primary storage. [2025-09-15T17:23:04.701501] [INFO ] [MAIN ] BBVA: Loaded 36749 existing records. [2025-09-15T17:23:04.884051] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:04.884322] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-15T17:23:04.884369] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-15T17:23:04.885251] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-15T17:23:04.885311] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-15T17:23:05.194772] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:23:05.264038] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-15T17:23:05.277927] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:05.924746] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:23:05.925983] [INFO ] [REMOTE ] BBU: Full fetch complete (4377 records). [2025-09-15T17:23:05.926057] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-15T17:23:05.926582] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:23:05.926711] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:05.926776] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:05.926839] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-15T17:23:05.926919] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-15T17:23:05.927078] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-09-15T17:23:05.927377] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-09-15T17:23:05.927465] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBU took 18.0s. Estimated remaining: 3h 40m 40s. Rate: 9.7 symbols/min [2025-09-15T17:23:06.064838] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-15T17:23:06.095464] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:06.114793] [DEBUG] [LOCAL ] BBW: Loaded 19034 existing records from primary storage. [2025-09-15T17:23:06.114942] [INFO ] [MAIN ] BBW: Loaded 19034 existing records. [2025-09-15T17:23:06.293069] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:06.297090] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:06.297446] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-15T17:23:06.297596] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-15T17:23:06.298005] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-15T17:23:06.298604] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-15T17:23:06.298684] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-15T17:23:06.649104] [INFO ] [REMOTE ] BBW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:06.857881] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-15T17:23:07.657920] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-15T17:23:07.856938] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:23:07.862992] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:07.863301] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-15T17:23:08.457933] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-15T17:23:09.257889] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:23:09.257957] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-15T17:23:10.057928] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-15T17:23:10.534809] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:10.535127] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-15T17:23:10.552677] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:23:10.857872] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-15T17:23:11.048565] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:11.048947] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-15T17:23:11.657894] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-15T17:23:12.457886] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-15T17:23:13.257831] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-15T17:23:13.297364] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:23:13.335603] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T17:23:14.057940] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-15T17:23:14.175988] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:23:14.857884] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-15T17:23:15.212594] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:23:15.217147] [INFO ] [REMOTE ] BBT: Full fetch complete (3064 records). [2025-09-15T17:23:15.217225] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-15T17:23:15.397449] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 10 unique days, need 150 days [2025-09-15T17:23:15.397719] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:15.397801] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:15.397871] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-15T17:23:15.397945] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-15T17:23:15.397983] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-15T17:23:15.398025] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-15T17:23:15.398100] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBT took 29.3s. Estimated remaining: 3h 41m 5s. Rate: 9.7 symbols/min [2025-09-15T17:23:15.572170] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:15.627949] [DEBUG] [LOCAL ] BBWI: Loaded 40331 existing records from primary storage. [2025-09-15T17:23:15.628125] [INFO ] [MAIN ] BBWI: Loaded 40331 existing records. [2025-09-15T17:23:15.662973] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-15T17:23:15.811853] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:15.812381] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-15T17:23:15.812497] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-15T17:23:15.818708] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-15T17:23:15.827443] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-15T17:23:15.852703] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:23:16.190401] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:16.457911] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-15T17:23:16.977973] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:23:17.257941] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-15T17:23:17.334116] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:23:17.337286] [INFO ] [REMOTE ] BBUC: Full fetch complete (14120 records). [2025-09-15T17:23:17.337474] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-15T17:23:17.701420] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-15T17:23:17.701540] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-15T17:23:17.701984] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-15T17:23:17.702198] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-15T17:23:17.703627] [DEBUG] [LOCAL ] BBUC: Trimmed 14120 records to 9248 (keeping 150 days of data) [2025-09-15T17:23:17.765198] [DEBUG] [LOCAL ] BBUC: Primary data saved (9248 records). [2025-09-15T17:23:17.765366] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-15T17:23:17.765489] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBUC took 24.4s. Estimated remaining: 3h 40m 22s. Rate: 9.7 symbols/min [2025-09-15T17:23:17.934054] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:17.978172] [DEBUG] [LOCAL ] BBY: Loaded 40251 existing records from primary storage. [2025-09-15T17:23:17.978349] [INFO ] [MAIN ] BBY: Loaded 40251 existing records. [2025-09-15T17:23:18.058431] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-15T17:23:18.166227] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:18.166582] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-15T17:23:18.166665] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-15T17:23:18.175064] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-15T17:23:18.188715] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-15T17:23:18.260721] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T17:23:18.551103] [INFO ] [REMOTE ] BBY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:18.857876] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-15T17:23:19.657942] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-15T17:23:19.813231] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:23:19.841923] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:23:20.457907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-15T17:23:21.082036] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:23:21.257868] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-15T17:23:22.023517] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:23:22.057893] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-15T17:23:22.579800] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:23:22.857905] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-15T17:23:23.251108] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T17:23:23.657934] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-15T17:23:24.450354] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:23:24.459389] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-15T17:23:24.643451] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:23:24.647504] [INFO ] [REMOTE ] BBW: Full fetch complete (28462 records). [2025-09-15T17:23:24.647584] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-15T17:23:25.015760] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-15T17:23:25.015837] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-15T17:23:25.016206] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-15T17:23:25.016246] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-15T17:23:25.016974] [DEBUG] [LOCAL ] BBW: Trimmed 28462 records to 18611 (keeping 150 days of data) [2025-09-15T17:23:25.135844] [DEBUG] [LOCAL ] BBW: Primary data saved (18611 records). [2025-09-15T17:23:25.135994] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-15T17:23:25.136095] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBW took 19.2s. Estimated remaining: 3h 40m 28s. Rate: 9.7 symbols/min [2025-09-15T17:23:25.262942] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-15T17:23:25.321335] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:25.365566] [DEBUG] [LOCAL ] BC: Loaded 33445 existing records from primary storage. [2025-09-15T17:23:25.365764] [INFO ] [MAIN ] BC: Loaded 33445 existing records. [2025-09-15T17:23:25.541707] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:25.541982] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-15T17:23:25.542037] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-15T17:23:25.543020] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-15T17:23:25.543071] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-15T17:23:25.892110] [INFO ] [REMOTE ] BC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:26.012517] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:23:26.057848] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-15T17:23:26.857923] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-15T17:23:26.991725] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:23:27.658005] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-15T17:23:27.896364] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:23:28.144994] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:23:28.457877] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-15T17:23:29.042214] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:23:29.257951] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-15T17:23:29.694547] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:23:30.057917] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-15T17:23:30.857954] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-15T17:23:31.069130] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T17:23:31.398717] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:23:31.657936] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-15T17:23:32.457958] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-15T17:23:32.616303] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:23:33.258351] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-15T17:23:33.265487] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:23:33.620515] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:23:34.057927] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-15T17:23:34.857881] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-15T17:23:34.951007] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:23:35.264036] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:23:35.657891] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-15T17:23:36.457907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-15T17:23:36.651824] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:23:37.227626] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:23:37.257826] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-15T17:23:37.741728] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:23:37.747753] [INFO ] [REMOTE ] BBVA: Full fetch complete (53886 records). [2025-09-15T17:23:37.747859] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-15T17:23:38.063020] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-15T17:23:38.123833] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-15T17:23:38.123911] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-15T17:23:38.124488] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-15T17:23:38.124540] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-15T17:23:38.125901] [DEBUG] [LOCAL ] BBVA: Trimmed 53886 records to 36011 (keeping 150 days of data) [2025-09-15T17:23:38.350374] [DEBUG] [LOCAL ] BBVA: Primary data saved (36011 records). [2025-09-15T17:23:38.350539] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-15T17:23:38.353036] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBVA took 33.9s. Estimated remaining: 3h 41m 28s. Rate: 9.7 symbols/min [2025-09-15T17:23:38.522823] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:38.552237] [DEBUG] [LOCAL ] BCAT: Loaded 25422 existing records from primary storage. [2025-09-15T17:23:38.552388] [INFO ] [MAIN ] BCAT: Loaded 25422 existing records. [2025-09-15T17:23:38.726833] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:38.727107] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-15T17:23:38.727153] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-15T17:23:38.727848] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-15T17:23:38.727900] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-15T17:23:38.865598] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-15T17:23:39.081568] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:39.113145] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:23:39.210858] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T17:23:39.657884] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-15T17:23:40.457891] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-15T17:23:40.939771] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T17:23:40.967892] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:23:40.974017] [INFO ] [REMOTE ] BBWI: Full fetch complete (58231 records). [2025-09-15T17:23:40.974165] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-15T17:23:41.266370] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-15T17:23:41.363187] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-15T17:23:41.363314] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-15T17:23:41.364023] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-15T17:23:41.364074] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-15T17:23:41.365474] [DEBUG] [LOCAL ] BBWI: Trimmed 58231 records to 39551 (keeping 150 days of data) [2025-09-15T17:23:41.617550] [DEBUG] [LOCAL ] BBWI: Primary data saved (39551 records). [2025-09-15T17:23:41.617730] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-15T17:23:41.619459] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 26.2s. Estimated remaining: 3h 40m 54s. Rate: 9.7 symbols/min [2025-09-15T17:23:41.790888] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:41.812728] [DEBUG] [LOCAL ] BCC: Loaded 20555 existing records from primary storage. [2025-09-15T17:23:41.812915] [INFO ] [MAIN ] BCC: Loaded 20555 existing records. [2025-09-15T17:23:41.993994] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:41.994342] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-15T17:23:41.994417] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-15T17:23:42.001413] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-15T17:23:42.013045] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-15T17:23:42.070272] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-15T17:23:42.081262] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:23:42.392599] [INFO ] [REMOTE ] BCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:42.681092] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:23:42.857938] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-15T17:23:43.112185] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:23:43.117075] [INFO ] [REMOTE ] BC: Full fetch complete (48513 records). [2025-09-15T17:23:43.117204] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-15T17:23:43.666519] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-15T17:23:43.670491] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-15T17:23:43.670601] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-15T17:23:43.671350] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-15T17:23:43.671433] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-15T17:23:43.672973] [DEBUG] [LOCAL ] BC: Trimmed 48513 records to 32606 (keeping 150 days of data) [2025-09-15T17:23:43.923754] [DEBUG] [LOCAL ] BC: Primary data saved (32606 records). [2025-09-15T17:23:43.923919] [INFO ] [MAIN ] BC: Full history saved. [2025-09-15T17:23:43.924014] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BC took 18.8s. Estimated remaining: 3h 40m 11s. Rate: 9.7 symbols/min [2025-09-15T17:23:44.110141] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:44.149474] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:23:44.203217] [DEBUG] [LOCAL ] BCE: Loaded 39338 existing records from primary storage. [2025-09-15T17:23:44.203392] [INFO ] [MAIN ] BCE: Loaded 39338 existing records. [2025-09-15T17:23:44.378686] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:44.378920] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-15T17:23:44.378965] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-15T17:23:44.380061] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-15T17:23:44.380114] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-15T17:23:44.468077] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-15T17:23:44.730753] [INFO ] [REMOTE ] BCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:45.067316] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:23:45.257880] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-15T17:23:45.418438] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T17:23:46.057871] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-15T17:23:46.857905] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-15T17:23:46.974329] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T17:23:47.467488] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:23:47.657910] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-15T17:23:47.842784] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:23:48.457909] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-15T17:23:49.014097] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:23:49.257947] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-15T17:23:49.772278] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:23:50.057876] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-15T17:23:50.197071] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:23:50.857943] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-15T17:23:51.284300] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:23:51.657936] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-15T17:23:52.290138] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:23:52.298347] [INFO ] [REMOTE ] BBY: Full fetch complete (57694 records). [2025-09-15T17:23:52.298549] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-15T17:23:52.299529] [FATAL] [VALIDATOR ] BBY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:23:52.299674] [FATAL] [MAIN ] BBY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:52.299740] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:52.299805] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-15T17:23:52.299942] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-09-15T17:23:52.300006] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-09-15T17:23:52.300364] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-09-15T17:23:52.300856] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BBY took 34.5s. Estimated remaining: 3h 40m 26s. Rate: 9.7 symbols/min [2025-09-15T17:23:52.473059] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-15T17:23:52.510240] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:52.537569] [DEBUG] [LOCAL ] BCH: Loaded 21766 existing records from primary storage. [2025-09-15T17:23:52.538002] [INFO ] [MAIN ] BCH: Loaded 21766 existing records. [2025-09-15T17:23:52.714599] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:52.714912] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-15T17:23:52.714960] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-15T17:23:52.715573] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-15T17:23:52.715625] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-15T17:23:53.066536] [INFO ] [REMOTE ] BCH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:53.257884] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-15T17:23:53.394543] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:23:53.882779] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T17:23:54.057884] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-15T17:23:54.086418] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:23:54.857913] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-15T17:23:55.657898] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-15T17:23:55.816757] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:23:56.246990] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:23:56.457894] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-15T17:23:56.515550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:23:57.257920] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-15T17:23:58.057927] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-15T17:23:58.209706] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:23:58.416356] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-15T17:23:58.857880] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-15T17:23:58.959978] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:23:59.657847] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-15T17:24:00.120759] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:24:00.457885] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-15T17:24:01.070699] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:24:01.257892] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-15T17:24:02.057876] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-15T17:24:02.419916] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T17:24:02.492988] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:24:02.857865] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-15T17:24:03.657881] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-15T17:24:04.306330] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-15T17:24:04.457853] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-15T17:24:04.752948] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:24:05.208070] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-15T17:24:05.257832] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-15T17:24:05.346630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T17:24:05.349861] [INFO ] [REMOTE ] BCC: Full fetch complete (31023 records). [2025-09-15T17:24:05.349946] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-15T17:24:05.711903] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-15T17:24:05.711984] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-15T17:24:05.712385] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-15T17:24:05.712425] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-15T17:24:05.713261] [DEBUG] [LOCAL ] BCC: Trimmed 31023 records to 20178 (keeping 150 days of data) [2025-09-15T17:24:05.845608] [DEBUG] [LOCAL ] BCC: Primary data saved (20178 records). [2025-09-15T17:24:05.845776] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-15T17:24:05.845867] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCC took 24.2s. Estimated remaining: 3h 41m 27s. Rate: 9.6 symbols/min [2025-09-15T17:24:06.017595] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:06.038105] [DEBUG] [LOCAL ] BCO: Loaded 19472 existing records from primary storage. [2025-09-15T17:24:06.038284] [INFO ] [MAIN ] BCO: Loaded 19472 existing records. [2025-09-15T17:24:06.063012] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-15T17:24:06.218767] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:06.218999] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-15T17:24:06.219043] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-15T17:24:06.219725] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-15T17:24:06.219776] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-15T17:24:06.588070] [INFO ] [REMOTE ] BCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:06.857886] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-15T17:24:07.010611] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T17:24:07.121980] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:24:07.657875] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-15T17:24:07.748434] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:24:08.457940] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-15T17:24:08.681597] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:24:09.257883] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-15T17:24:09.878527] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:24:09.884390] [INFO ] [REMOTE ] BCE: Full fetch complete (57001 records). [2025-09-15T17:24:09.884515] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-15T17:24:10.061614] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-15T17:24:10.272269] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-15T17:24:10.272372] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-15T17:24:10.273061] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-15T17:24:10.273116] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-15T17:24:10.274454] [DEBUG] [LOCAL ] BCE: Trimmed 57001 records to 38550 (keeping 150 days of data) [2025-09-15T17:24:10.395146] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:24:10.544160] [DEBUG] [LOCAL ] BCE: Primary data saved (38550 records). [2025-09-15T17:24:10.544501] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-15T17:24:10.546034] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCE took 26.6s. Estimated remaining: 3h 41m 7s. Rate: 9.7 symbols/min [2025-09-15T17:24:10.716207] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:10.759823] [DEBUG] [LOCAL ] BCS: Loaded 40235 existing records from primary storage. [2025-09-15T17:24:10.759968] [INFO ] [MAIN ] BCS: Loaded 40235 existing records. [2025-09-15T17:24:10.860707] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-15T17:24:10.947522] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:10.947863] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-15T17:24:10.947917] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-15T17:24:10.949089] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-15T17:24:10.949149] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-15T17:24:11.308733] [INFO ] [REMOTE ] BCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:11.320243] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:24:11.324611] [INFO ] [REMOTE ] BCAT: Full fetch complete (37512 records). [2025-09-15T17:24:11.324832] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-15T17:24:11.664000] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-15T17:24:11.704084] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-15T17:24:11.704181] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-15T17:24:11.704743] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-15T17:24:11.704793] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-15T17:24:11.705945] [DEBUG] [LOCAL ] BCAT: Trimmed 37512 records to 25058 (keeping 150 days of data) [2025-09-15T17:24:11.873554] [DEBUG] [LOCAL ] BCAT: Primary data saved (25058 records). [2025-09-15T17:24:11.873711] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-15T17:24:11.873798] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCAT took 33.5s. Estimated remaining: 3h 40m 16s. Rate: 9.7 symbols/min [2025-09-15T17:24:12.051168] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:12.071158] [DEBUG] [LOCAL ] BCSF: Loaded 19447 existing records from primary storage. [2025-09-15T17:24:12.071293] [INFO ] [MAIN ] BCSF: Loaded 19447 existing records. [2025-09-15T17:24:12.247339] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:12.247717] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-15T17:24:12.247818] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-15T17:24:12.248390] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-15T17:24:12.248441] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-15T17:24:12.461881] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-15T17:24:12.526683] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:24:12.678269] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:13.194322] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:24:13.257866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-15T17:24:14.057914] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-15T17:24:14.337770] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:24:14.341303] [INFO ] [REMOTE ] BCH: Full fetch complete (31906 records). [2025-09-15T17:24:14.341395] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-15T17:24:14.740481] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-15T17:24:14.740584] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-15T17:24:14.741081] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-15T17:24:14.741130] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-15T17:24:14.742102] [DEBUG] [LOCAL ] BCH: Trimmed 31906 records to 21393 (keeping 150 days of data) [2025-09-15T17:24:14.858354] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-15T17:24:14.889750] [DEBUG] [LOCAL ] BCH: Primary data saved (21393 records). [2025-09-15T17:24:14.889874] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-15T17:24:14.889958] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCH took 22.6s. Estimated remaining: 3h 39m 41s. Rate: 9.7 symbols/min [2025-09-15T17:24:15.078789] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:15.095507] [DEBUG] [LOCAL ] BCX: Loaded 15656 existing records from primary storage. [2025-09-15T17:24:15.095662] [INFO ] [MAIN ] BCX: Loaded 15656 existing records. [2025-09-15T17:24:15.295603] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:15.312104] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T17:24:15.310856] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-15T17:24:15.322926] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-15T17:24:15.323996] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-15T17:24:15.324064] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-15T17:24:15.661933] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-15T17:24:15.715017] [INFO ] [REMOTE ] BCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:15.719047] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:24:15.747196] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:24:16.457892] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-15T17:24:17.257893] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-15T17:24:17.375048] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:24:17.575808] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:24:18.057887] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-15T17:24:18.329001] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:24:18.775883] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:24:18.857939] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-15T17:24:19.657871] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-15T17:24:20.006518] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T17:24:20.457837] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-15T17:24:20.506551] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:24:21.257868] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-15T17:24:21.619904] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T17:24:22.057874] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-15T17:24:22.857845] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-15T17:24:23.016636] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:24:23.038668] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T17:24:23.478240] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:24:23.657883] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-15T17:24:24.457879] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-15T17:24:25.257891] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-15T17:24:26.057986] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-15T17:24:26.252827] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T17:24:26.423767] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T17:24:26.583487] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-15T17:24:26.857873] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-15T17:24:26.924331] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:24:27.598792] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:24:27.657891] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-15T17:24:28.457924] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-15T17:24:28.799186] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:24:29.257892] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-15T17:24:29.532844] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T17:24:30.025377] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:24:30.028372] [INFO ] [REMOTE ] BCO: Full fetch complete (28707 records). [2025-09-15T17:24:30.028481] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-15T17:24:30.062934] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-15T17:24:30.402341] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-15T17:24:30.402427] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-15T17:24:30.402906] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-15T17:24:30.402956] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-15T17:24:30.403657] [DEBUG] [LOCAL ] BCO: Trimmed 28707 records to 19118 (keeping 150 days of data) [2025-09-15T17:24:30.521312] [DEBUG] [LOCAL ] BCO: Primary data saved (19118 records). [2025-09-15T17:24:30.521452] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-15T17:24:30.521552] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 24.7s. Estimated remaining: 3h 41m 1s. Rate: 9.7 symbols/min [2025-09-15T17:24:30.688978] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:30.707585] [DEBUG] [LOCAL ] BDC: Loaded 17994 existing records from primary storage. [2025-09-15T17:24:30.707720] [INFO ] [MAIN ] BDC: Loaded 17994 existing records. [2025-09-15T17:24:30.877396] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-15T17:24:30.881699] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:30.882634] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-15T17:24:30.882703] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-15T17:24:30.883217] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-15T17:24:30.883335] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-15T17:24:31.236964] [INFO ] [REMOTE ] BDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:31.657893] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-15T17:24:32.049767] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T17:24:32.141244] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:24:32.457884] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-15T17:24:32.916139] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:24:33.257880] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-15T17:24:34.057837] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-15T17:24:34.376676] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:24:34.395589] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:24:34.398763] [INFO ] [REMOTE ] BCSF: Full fetch complete (29645 records). [2025-09-15T17:24:34.398835] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-15T17:24:34.763509] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-15T17:24:34.763582] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-15T17:24:34.763977] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-15T17:24:34.764020] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-15T17:24:34.764775] [DEBUG] [LOCAL ] BCSF: Trimmed 29645 records to 19270 (keeping 150 days of data) [2025-09-15T17:24:34.858247] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-15T17:24:34.888282] [DEBUG] [LOCAL ] BCSF: Primary data saved (19270 records). [2025-09-15T17:24:34.888441] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-15T17:24:34.888561] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCSF took 23.0s. Estimated remaining: 3h 40m 38s. Rate: 9.7 symbols/min [2025-09-15T17:24:34.909676] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:24:35.657909] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-15T17:24:35.809720] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:24:36.457835] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-15T17:24:36.570434] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:24:37.257915] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-15T17:24:38.057857] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-15T17:24:38.183637] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:24:38.189115] [INFO ] [REMOTE ] BCS: Full fetch complete (57740 records). [2025-09-15T17:24:38.189218] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-15T17:24:38.190054] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:24:38.190138] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:24:38.190176] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:24:38.190235] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-15T17:24:38.190301] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-15T17:24:38.190350] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-15T17:24:38.190692] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-15T17:24:38.191682] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCS took 27.6s. Estimated remaining: 3h 40m 6s. Rate: 9.7 symbols/min [2025-09-15T17:24:38.421119] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:24:38.806803] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:24:38.809406] [INFO ] [REMOTE ] BCX: Full fetch complete (24201 records). [2025-09-15T17:24:38.809493] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-15T17:24:38.866892] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-15T17:24:39.200455] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-15T17:24:39.200534] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-15T17:24:39.200939] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-15T17:24:39.201019] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-15T17:24:39.201684] [DEBUG] [LOCAL ] BCX: Trimmed 24201 records to 15307 (keeping 150 days of data) [2025-09-15T17:24:39.293654] [DEBUG] [LOCAL ] BCX: Primary data saved (15307 records). [2025-09-15T17:24:39.293794] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-15T17:24:39.293884] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCX took 24.4s. Estimated remaining: 3h 39m 14s. Rate: 9.7 symbols/min [2025-09-15T17:24:39.967362] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:24:39.972449] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-15T17:24:41.241146] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:24:41.247102] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-15T17:24:42.457566] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:24:42.463541] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-15T17:24:43.667370] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:24:43.670303] [INFO ] [REMOTE ] BDC: Full fetch complete (27326 records). [2025-09-15T17:24:43.670397] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-15T17:24:44.050008] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-15T17:24:44.050114] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-15T17:24:44.050710] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-15T17:24:44.050766] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-15T17:24:44.051810] [DEBUG] [LOCAL ] BDC: Trimmed 27326 records to 17657 (keeping 150 days of data) [2025-09-15T17:24:44.175459] [DEBUG] [LOCAL ] BDC: Primary data saved (17657 records). [2025-09-15T17:24:44.175732] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-15T17:24:44.175901] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 13.7s. Estimated remaining: 3h 38m 56s. Rate: 9.7 symbols/min [2025-09-15T17:24:44.857398] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.912367] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.937604] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.939088] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.964927] [DEBUG] [LOCAL ] BDJ: Loaded 21798 existing records from primary storage. [2025-09-15T17:24:44.976766] [INFO ] [MAIN ] BDJ: Loaded 21798 existing records. [2025-09-15T17:24:45.135340] [DEBUG] [LOCAL ] BE: Loaded 40401 existing records from primary storage. [2025-09-15T17:24:45.214785] [DEBUG] [LOCAL ] BDX: Loaded 39715 existing records from primary storage. [2025-09-15T17:24:45.213947] [INFO ] [MAIN ] BE: Loaded 40401 existing records. [2025-09-15T17:24:45.226307] [INFO ] [MAIN ] BDX: Loaded 39715 existing records. [2025-09-15T17:24:45.215423] [DEBUG] [LOCAL ] BDN: Loaded 35556 existing records from primary storage. [2025-09-15T17:24:45.214178] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.236039] [INFO ] [MAIN ] BDN: Loaded 35556 existing records. [2025-09-15T17:24:45.339820] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.439553] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-15T17:24:45.525207] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-15T17:24:45.597019] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-15T17:24:45.640614] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.772813] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.793489] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.844500] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-15T17:24:45.882570] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.882715] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.896854] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-15T17:24:45.897144] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-15T17:24:45.897110] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.897202] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-15T17:24:45.942269] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-15T17:24:46.023010] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-15T17:24:46.028198] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-15T17:24:46.039033] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-15T17:24:46.105281] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-15T17:24:46.681865] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:46.706335] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-15T17:24:47.063034] [INFO ] [REMOTE ] BE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.074774] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-15T17:24:47.189115] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.214904] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-15T17:24:47.254317] [INFO ] [REMOTE ] BDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.254693] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-15T17:24:48.108421] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:24:48.114421] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-15T17:24:48.723075] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:24:48.732971] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-15T17:24:48.773044] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:24:48.784116] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-15T17:24:48.815767] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:24:48.825678] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-15T17:24:49.305431] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:24:49.311807] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-15T17:24:50.176621] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:24:50.187200] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-15T17:24:50.391034] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:24:50.402505] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-15T17:24:50.500090] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:24:50.609177] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:24:50.857930] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-15T17:24:51.496176] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T17:24:51.657884] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-15T17:24:52.165360] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:24:52.457934] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-15T17:24:52.542158] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:24:52.868754] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:24:53.257909] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-15T17:24:53.675300] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:24:54.057945] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-15T17:24:54.857873] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-15T17:24:55.265217] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:24:55.474212] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T17:24:55.657897] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-15T17:24:56.460210] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-15T17:24:56.468901] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:24:56.850990] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:24:57.257946] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-15T17:24:58.069417] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-15T17:24:58.075730] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:24:58.857848] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-15T17:24:59.134600] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:24:59.573716] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:24:59.657915] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-15T17:25:00.457890] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-15T17:25:00.749524] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:25:00.855428] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:25:01.257887] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-15T17:25:02.057923] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-15T17:25:02.142715] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T17:25:02.857877] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-15T17:25:02.873573] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:25:02.879290] [INFO ] [REMOTE ] BDN: Full fetch complete (51744 records). [2025-09-15T17:25:02.879414] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-15T17:25:03.292069] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-15T17:25:03.292208] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-15T17:25:03.292850] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-15T17:25:03.292907] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-15T17:25:03.299508] [DEBUG] [LOCAL ] BDN: Trimmed 51744 records to 34811 (keeping 150 days of data) [2025-09-15T17:25:03.309909] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:25:03.517582] [DEBUG] [LOCAL ] BDN: Primary data saved (34811 records). [2025-09-15T17:25:03.517766] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-15T17:25:03.517855] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 19.3s. Estimated remaining: 3h 40m 46s. Rate: 9.6 symbols/min [2025-09-15T17:25:03.668344] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-15T17:25:03.694576] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:03.694853] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-15T17:25:03.694919] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-15T17:25:03.695297] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-15T17:25:03.695343] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-15T17:25:03.695383] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-15T17:25:03.695423] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-15T17:25:04.050680] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:04.418629] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:25:04.427072] [INFO ] [REMOTE ] BDX: Full fetch complete (56920 records). [2025-09-15T17:25:04.427223] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-15T17:25:04.462965] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-15T17:25:04.829238] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-15T17:25:04.829394] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-15T17:25:04.830119] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-15T17:25:04.830189] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-15T17:25:04.856528] [DEBUG] [LOCAL ] BDX: Trimmed 56920 records to 38949 (keeping 150 days of data) [2025-09-15T17:25:04.856359] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:25:04.964974] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:25:05.127516] [DEBUG] [LOCAL ] BDX: Primary data saved (38949 records). [2025-09-15T17:25:05.127697] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-15T17:25:05.127804] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDX took 20.9s. Estimated remaining: 3h 39m 60s. Rate: 9.7 symbols/min [2025-09-15T17:25:05.273328] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-15T17:25:05.307445] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:05.347308] [DEBUG] [LOCAL ] BEKE: Loaded 40023 existing records from primary storage. [2025-09-15T17:25:05.347464] [INFO ] [MAIN ] BEKE: Loaded 40023 existing records. [2025-09-15T17:25:05.528878] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:05.529151] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-15T17:25:05.529200] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-15T17:25:05.530222] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-15T17:25:05.530275] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-15T17:25:05.888283] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:06.057965] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-15T17:25:06.382256] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:25:06.857960] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-15T17:25:07.101522] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:25:07.273507] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:25:07.657976] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-15T17:25:08.457923] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-15T17:25:09.257898] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-15T17:25:09.550338] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T17:25:09.556826] [INFO ] [REMOTE ] BE: Full fetch complete (58322 records). [2025-09-15T17:25:09.556960] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-15T17:25:09.647939] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T17:25:09.949147] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-15T17:25:09.949227] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-15T17:25:09.949854] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-15T17:25:09.949898] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-15T17:25:09.951194] [DEBUG] [LOCAL ] BE: Trimmed 58322 records to 39622 (keeping 150 days of data) [2025-09-15T17:25:10.057984] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-15T17:25:10.224518] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T17:25:10.256296] [DEBUG] [LOCAL ] BE: Primary data saved (39622 records). [2025-09-15T17:25:10.256468] [INFO ] [MAIN ] BE: Full history saved. [2025-09-15T17:25:10.256594] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BE took 26.1s. Estimated remaining: 3h 39m 44s. Rate: 9.7 symbols/min [2025-09-15T17:25:10.429921] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:10.469298] [DEBUG] [LOCAL ] BEN: Loaded 39969 existing records from primary storage. [2025-09-15T17:25:10.469455] [INFO ] [MAIN ] BEN: Loaded 39969 existing records. [2025-09-15T17:25:10.642990] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:10.643283] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-15T17:25:10.643331] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-15T17:25:10.644614] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-15T17:25:10.644721] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-15T17:25:10.863211] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-15T17:25:11.012841] [INFO ] [REMOTE ] BEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:11.041375] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T17:25:11.657906] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-15T17:25:12.457916] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-15T17:25:12.703583] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T17:25:12.866503] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:25:12.871530] [INFO ] [REMOTE ] BDJ: Full fetch complete (31749 records). [2025-09-15T17:25:12.871670] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-15T17:25:13.252904] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-15T17:25:13.252991] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-15T17:25:13.253410] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-15T17:25:13.253451] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-15T17:25:13.254362] [DEBUG] [LOCAL ] BDJ: Trimmed 31749 records to 21245 (keeping 150 days of data) [2025-09-15T17:25:13.257941] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-15T17:25:13.391218] [DEBUG] [LOCAL ] BDJ: Primary data saved (21245 records). [2025-09-15T17:25:13.391381] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-15T17:25:13.391497] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BDJ took 29.2s. Estimated remaining: 3h 39m 11s. Rate: 9.7 symbols/min [2025-09-15T17:25:13.581171] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:25:13.603713] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:13.643530] [DEBUG] [LOCAL ] BEP: Loaded 28134 existing records from primary storage. [2025-09-15T17:25:13.643810] [INFO ] [MAIN ] BEP: Loaded 28134 existing records. [2025-09-15T17:25:13.805552] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:25:13.871855] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:13.872166] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-15T17:25:13.872226] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-15T17:25:13.873006] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-15T17:25:13.873067] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-15T17:25:14.058521] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-15T17:25:14.246770] [INFO ] [REMOTE ] BEP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:14.467901] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:25:14.857874] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-15T17:25:15.179370] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:25:15.657881] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-15T17:25:16.457939] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-15T17:25:16.790814] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-15T17:25:16.791539] [INFO ] [REMOTE ] BEDU: Full fetch complete (925 records). [2025-09-15T17:25:16.791608] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-15T17:25:16.979515] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 122 unique days, need 150 days [2025-09-15T17:25:16.979820] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:25:16.979901] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:25:16.979980] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-15T17:25:16.980065] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-15T17:25:16.980111] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-15T17:25:16.980162] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-15T17:25:16.980226] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 13.5s. Estimated remaining: 3h 38m 42s. Rate: 9.7 symbols/min [2025-09-15T17:25:17.155538] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:17.199661] [DEBUG] [LOCAL ] BEPC: Loaded 34353 existing records from primary storage. [2025-09-15T17:25:17.199846] [INFO ] [MAIN ] BEPC: Loaded 34353 existing records. [2025-09-15T17:25:17.270608] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-15T17:25:17.402668] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:17.402961] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-15T17:25:17.403114] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-15T17:25:17.404016] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-15T17:25:17.404070] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-15T17:25:17.663735] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:25:17.826722] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:18.057891] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-15T17:25:18.534332] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:25:18.857945] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-15T17:25:19.218472] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:25:19.657895] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-15T17:25:20.457896] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-15T17:25:20.717404] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:25:21.257990] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-15T17:25:21.296823] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:25:22.057880] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-15T17:25:22.114939] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T17:25:22.847757] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T17:25:22.858438] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-15T17:25:23.551513] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:25:23.657927] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-15T17:25:24.025584] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:25:24.457978] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-15T17:25:25.257896] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-15T17:25:25.389155] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:25:25.915933] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:25:26.057838] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-15T17:25:26.461461] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:25:26.857902] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-15T17:25:27.372071] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:25:27.657878] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-15T17:25:28.457925] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-15T17:25:28.580914] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:25:28.981404] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:25:29.257916] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-15T17:25:29.647214] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T17:25:30.057867] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-15T17:25:30.608793] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:25:30.857877] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-15T17:25:31.456343] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:25:31.657860] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-15T17:25:32.143932] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:25:32.457944] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-15T17:25:33.185892] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:25:33.257825] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-15T17:25:34.057918] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-15T17:25:34.253594] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:25:34.386888] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:25:34.857924] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-15T17:25:35.409389] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:25:35.415190] [INFO ] [REMOTE ] BEN: Full fetch complete (57720 records). [2025-09-15T17:25:35.415302] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-15T17:25:35.664399] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-15T17:25:35.792395] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-15T17:25:35.792475] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-15T17:25:35.793108] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-15T17:25:35.793161] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-15T17:25:35.794289] [DEBUG] [LOCAL ] BEN: Trimmed 57720 records to 39192 (keeping 150 days of data) [2025-09-15T17:25:36.043473] [DEBUG] [LOCAL ] BEN: Primary data saved (39192 records). [2025-09-15T17:25:36.043627] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-15T17:25:36.045570] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEN took 25.8s. Estimated remaining: 3h 40m 27s. Rate: 9.6 symbols/min [2025-09-15T17:25:36.215492] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:36.221526] [DEBUG] [LOCAL ] BEPH: Loaded 3539 existing records from primary storage. [2025-09-15T17:25:36.221636] [INFO ] [MAIN ] BEPH: Loaded 3539 existing records. [2025-09-15T17:25:36.398700] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:36.398975] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-15T17:25:36.399021] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-15T17:25:36.399265] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-15T17:25:36.399310] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-15T17:25:36.467437] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-15T17:25:36.752244] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:36.771099] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T17:25:36.777996] [INFO ] [REMOTE ] BEKE: Full fetch complete (57953 records). [2025-09-15T17:25:36.778176] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-15T17:25:37.199808] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-15T17:25:37.199971] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-15T17:25:37.200703] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-15T17:25:37.200875] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-15T17:25:37.202693] [DEBUG] [LOCAL ] BEKE: Trimmed 57953 records to 39242 (keeping 150 days of data) [2025-09-15T17:25:37.259423] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-15T17:25:37.330752] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:25:37.479268] [DEBUG] [LOCAL ] BEKE: Primary data saved (39242 records). [2025-09-15T17:25:37.479436] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-15T17:25:37.479827] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 32.4s. Estimated remaining: 3h 39m 40s. Rate: 9.7 symbols/min [2025-09-15T17:25:37.650818] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:37.658330] [DEBUG] [LOCAL ] BEPI: Loaded 2735 existing records from primary storage. [2025-09-15T17:25:37.658445] [INFO ] [MAIN ] BEPI: Loaded 2735 existing records. [2025-09-15T17:25:37.839116] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:37.844365] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-15T17:25:37.844749] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-15T17:25:37.844563] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:25:37.846168] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-15T17:25:37.846757] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-15T17:25:38.062938] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-15T17:25:38.245753] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:38.248891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:25:38.488767] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:25:38.857934] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-15T17:25:39.657895] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-15T17:25:40.033408] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:25:40.038624] [INFO ] [REMOTE ] BEPC: Full fetch complete (50944 records). [2025-09-15T17:25:40.038779] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-15T17:25:40.420629] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-15T17:25:40.420736] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-15T17:25:40.421296] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-15T17:25:40.421336] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-15T17:25:40.422417] [DEBUG] [LOCAL ] BEPC: Trimmed 50944 records to 33680 (keeping 150 days of data) [2025-09-15T17:25:40.482995] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-15T17:25:40.643738] [DEBUG] [LOCAL ] BEPC: Primary data saved (33680 records). [2025-09-15T17:25:40.643929] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-15T17:25:40.644055] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEPC took 23.7s. Estimated remaining: 3h 39m 8s. Rate: 9.7 symbols/min [2025-09-15T17:25:40.832526] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:40.858064] [DEBUG] [LOCAL ] BEPJ: Loaded 2618 existing records from primary storage. [2025-09-15T17:25:40.858608] [INFO ] [MAIN ] BEPJ: Loaded 2618 existing records. [2025-09-15T17:25:40.859790] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:25:41.043585] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:41.043836] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-15T17:25:41.043882] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-15T17:25:41.044073] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-15T17:25:41.044118] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-15T17:25:41.167572] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:25:41.263158] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-15T17:25:41.412133] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:41.802864] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:25:42.057918] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-15T17:25:42.432442] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:25:42.857905] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-15T17:25:43.407894] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:25:43.657887] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-15T17:25:44.194465] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:25:44.457888] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-15T17:25:45.069127] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T17:25:45.257834] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-15T17:25:45.780796] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T17:25:46.057908] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-15T17:25:46.507968] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:25:46.857871] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-15T17:25:47.401919] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:25:47.657907] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-15T17:25:48.237658] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:25:48.457875] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-15T17:25:49.043291] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:25:49.257873] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-15T17:25:49.761694] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T17:25:50.057887] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-15T17:25:50.857921] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-15T17:25:51.193690] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:25:51.448130] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:25:51.459355] [INFO ] [REMOTE ] BEP: Full fetch complete (42759 records). [2025-09-15T17:25:51.459594] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-15T17:25:51.662967] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-15T17:25:51.894965] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-15T17:25:51.895045] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-15T17:25:51.895549] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-15T17:25:51.895589] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-15T17:25:51.896514] [DEBUG] [LOCAL ] BEP: Trimmed 42759 records to 27576 (keeping 150 days of data) [2025-09-15T17:25:52.069007] [DEBUG] [LOCAL ] BEP: Primary data saved (27576 records). [2025-09-15T17:25:52.069140] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-15T17:25:52.069231] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEP took 38.7s. Estimated remaining: 3h 39m 46s. Rate: 9.6 symbols/min [2025-09-15T17:25:52.173936] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:25:52.244373] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:52.269352] [DEBUG] [LOCAL ] BFAM: Loaded 24802 existing records from primary storage. [2025-09-15T17:25:52.269487] [INFO ] [MAIN ] BFAM: Loaded 24802 existing records. [2025-09-15T17:25:52.448199] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:52.448458] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-15T17:25:52.448528] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-15T17:25:52.449273] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-15T17:25:52.449338] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-15T17:25:52.462971] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-15T17:25:52.805876] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:52.942882] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T17:25:52.943750] [INFO ] [REMOTE ] BEPI: Full fetch complete (3669 records). [2025-09-15T17:25:52.943817] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-15T17:25:53.266885] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-15T17:25:53.297202] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-15T17:25:53.297272] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-15T17:25:53.297388] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-15T17:25:53.297428] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-15T17:25:53.297879] [DEBUG] [LOCAL ] BEPI: Trimmed 3669 records to 2662 (keeping 150 days of data) [2025-09-15T17:25:53.315119] [DEBUG] [LOCAL ] BEPI: Primary data saved (2662 records). [2025-09-15T17:25:53.315826] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-15T17:25:53.315938] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPI took 15.8s. Estimated remaining: 3h 38m 58s. Rate: 9.7 symbols/min [2025-09-15T17:25:53.483038] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:53.516042] [DEBUG] [LOCAL ] BFH: Loaded 30776 existing records from primary storage. [2025-09-15T17:25:53.516194] [INFO ] [MAIN ] BFH: Loaded 30776 existing records. [2025-09-15T17:25:53.697325] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:53.697610] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-15T17:25:53.697680] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-15T17:25:53.698465] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-15T17:25:53.698520] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-15T17:25:54.064735] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-15T17:25:54.069690] [INFO ] [REMOTE ] BFH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:54.505987] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T17:25:54.638766] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T17:25:54.857908] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-15T17:25:55.286902] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T17:25:55.657874] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-15T17:25:56.203204] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:25:56.204262] [INFO ] [REMOTE ] BEPH: Full fetch complete (5756 records). [2025-09-15T17:25:56.204329] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-15T17:25:56.463028] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-15T17:25:56.562431] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-15T17:25:56.562507] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-15T17:25:56.562693] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-15T17:25:56.562735] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-15T17:25:56.563117] [DEBUG] [LOCAL ] BEPH: Trimmed 5756 records to 3476 (keeping 150 days of data) [2025-09-15T17:25:56.584598] [DEBUG] [LOCAL ] BEPH: Primary data saved (3476 records). [2025-09-15T17:25:56.587713] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-15T17:25:56.587796] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPH took 20.5s. Estimated remaining: 3h 38m 27s. Rate: 9.7 symbols/min [2025-09-15T17:25:56.788808] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:56.800321] [DEBUG] [LOCAL ] BFK: Loaded 10011 existing records from primary storage. [2025-09-15T17:25:56.800440] [INFO ] [MAIN ] BFK: Loaded 10011 existing records. [2025-09-15T17:25:57.005222] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:57.005617] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-15T17:25:57.005702] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-15T17:25:57.006131] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-15T17:25:57.006202] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-15T17:25:57.153168] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:25:57.263116] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-15T17:25:57.413551] [INFO ] [REMOTE ] BFK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:58.057901] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-15T17:25:58.531176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:25:58.857887] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-15T17:25:58.916774] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:25:59.296507] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:25:59.657885] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-15T17:26:00.074485] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T17:26:00.457864] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-15T17:26:01.257848] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-15T17:26:01.656228] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:26:01.720700] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:26:01.721571] [INFO ] [REMOTE ] BEPJ: Full fetch complete (3532 records). [2025-09-15T17:26:01.721639] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-15T17:26:02.063495] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-15T17:26:02.088266] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-15T17:26:02.088337] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-15T17:26:02.088478] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-15T17:26:02.088533] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-15T17:26:02.089060] [DEBUG] [LOCAL ] BEPJ: Trimmed 3532 records to 2575 (keeping 150 days of data) [2025-09-15T17:26:02.107473] [DEBUG] [LOCAL ] BEPJ: Primary data saved (2575 records). [2025-09-15T17:26:02.107636] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-15T17:26:02.107749] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPJ took 21.5s. Estimated remaining: 3h 38m 15s. Rate: 9.7 symbols/min [2025-09-15T17:26:02.274329] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:02.315632] [DEBUG] [LOCAL ] BFLY: Loaded 38899 existing records from primary storage. [2025-09-15T17:26:02.315819] [INFO ] [MAIN ] BFLY: Loaded 38899 existing records. [2025-09-15T17:26:02.492543] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:02.492911] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-15T17:26:02.492963] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-15T17:26:02.493983] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-15T17:26:02.494050] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-15T17:26:02.859159] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:02.859282] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-15T17:26:03.454902] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:26:03.657837] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-15T17:26:03.715338] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:26:04.457927] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-15T17:26:05.135795] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:26:05.257845] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-15T17:26:05.713751] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:26:06.057890] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-15T17:26:06.482820] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:26:06.857896] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-15T17:26:07.304030] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:26:07.658436] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-15T17:26:08.139496] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:26:08.457922] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-15T17:26:08.596466] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:26:09.257927] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-15T17:26:09.617980] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:26:10.057970] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-15T17:26:10.869364] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-15T17:26:10.896104] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:26:11.098832] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:26:11.657920] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-15T17:26:12.450107] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:26:12.461054] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-15T17:26:12.749458] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:26:12.753415] [INFO ] [REMOTE ] BFAM: Full fetch complete (35565 records). [2025-09-15T17:26:12.753559] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-15T17:26:13.151241] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-15T17:26:13.151350] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-15T17:26:13.151874] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-15T17:26:13.151933] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-15T17:26:13.159359] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:26:13.162717] [DEBUG] [LOCAL ] BFAM: Trimmed 35565 records to 24414 (keeping 150 days of data) [2025-09-15T17:26:13.259095] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-15T17:26:13.312762] [DEBUG] [LOCAL ] BFAM: Primary data saved (24414 records). [2025-09-15T17:26:13.312891] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-15T17:26:13.312973] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 21.2s. Estimated remaining: 3h 38m 51s. Rate: 9.7 symbols/min [2025-09-15T17:26:13.489902] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:13.498045] [DEBUG] [LOCAL ] BFS: Loaded 6805 existing records from primary storage. [2025-09-15T17:26:13.498140] [INFO ] [MAIN ] BFS: Loaded 6805 existing records. [2025-09-15T17:26:13.679034] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:13.679361] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-15T17:26:13.679425] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-15T17:26:13.679917] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-15T17:26:13.679977] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-15T17:26:14.038535] [INFO ] [REMOTE ] BFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:14.057821] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-15T17:26:14.727665] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:26:14.729367] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T17:26:14.857892] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-15T17:26:15.657876] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-15T17:26:16.258845] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:26:16.457909] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-15T17:26:16.512125] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:26:17.229391] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:26:17.257829] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-15T17:26:18.049973] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:26:18.057809] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-15T17:26:18.854891] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:26:18.857235] [INFO ] [REMOTE ] BFK: Full fetch complete (14535 records). [2025-09-15T17:26:18.857313] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-15T17:26:18.863046] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-15T17:26:19.267810] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-15T17:26:19.267947] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-15T17:26:19.268268] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-15T17:26:19.268312] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-15T17:26:19.268916] [DEBUG] [LOCAL ] BFK: Trimmed 14535 records to 9574 (keeping 150 days of data) [2025-09-15T17:26:19.328421] [DEBUG] [LOCAL ] BFK: Primary data saved (9574 records). [2025-09-15T17:26:19.328564] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-15T17:26:19.328689] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFK took 22.7s. Estimated remaining: 3h 38m 43s. Rate: 9.7 symbols/min [2025-09-15T17:26:19.505256] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:19.514787] [DEBUG] [LOCAL ] BFZ: Loaded 8286 existing records from primary storage. [2025-09-15T17:26:19.514894] [INFO ] [MAIN ] BFZ: Loaded 8286 existing records. [2025-09-15T17:26:19.636614] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T17:26:19.662963] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-15T17:26:19.701766] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:19.702405] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-15T17:26:19.702458] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-15T17:26:19.702886] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-15T17:26:19.702956] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-15T17:26:20.076421] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:20.457884] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-15T17:26:20.573830] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:26:21.257916] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-15T17:26:22.057886] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-15T17:26:22.154364] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:26:22.668244] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:26:22.740433] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:26:22.857883] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-15T17:26:23.617211] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:26:23.657891] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-15T17:26:24.123972] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:26:24.457889] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-15T17:26:25.055180] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T17:26:25.257883] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-15T17:26:26.057887] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-15T17:26:26.857926] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-15T17:26:27.174969] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:26:27.251956] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:26:27.637035] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:26:27.657880] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-15T17:26:28.457881] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-15T17:26:29.257906] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-15T17:26:29.326197] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T17:26:29.512842] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T17:26:29.518368] [INFO ] [REMOTE ] BFLY: Full fetch complete (56473 records). [2025-09-15T17:26:29.518502] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-15T17:26:29.910950] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-15T17:26:29.911170] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-15T17:26:29.911962] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-15T17:26:29.912018] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-15T17:26:29.913670] [DEBUG] [LOCAL ] BFLY: Trimmed 56473 records to 38151 (keeping 150 days of data) [2025-09-15T17:26:30.074723] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-15T17:26:30.142383] [DEBUG] [LOCAL ] BFLY: Primary data saved (38151 records). [2025-09-15T17:26:30.142542] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-15T17:26:30.142652] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFLY took 28.0s. Estimated remaining: 3h 39m 15s. Rate: 9.6 symbols/min [2025-09-15T17:26:30.312281] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:30.355313] [DEBUG] [LOCAL ] BG: Loaded 37983 existing records from primary storage. [2025-09-15T17:26:30.355459] [INFO ] [MAIN ] BG: Loaded 37983 existing records. [2025-09-15T17:26:30.544448] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:30.544835] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-15T17:26:30.544997] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-15T17:26:30.546156] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-15T17:26:30.546213] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-15T17:26:30.758247] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:26:30.863018] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-15T17:26:30.947009] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:26:30.951256] [INFO ] [REMOTE ] BG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:31.657887] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-15T17:26:32.072196] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:26:32.457959] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-15T17:26:32.549912] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T17:26:32.977483] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T17:26:33.257939] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-15T17:26:34.057910] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-15T17:26:34.471741] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:26:34.476357] [INFO ] [REMOTE ] BFH: Full fetch complete (45466 records). [2025-09-15T17:26:34.476496] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-15T17:26:34.858229] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-15T17:26:34.857908] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-15T17:26:34.862250] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-15T17:26:34.862858] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-15T17:26:34.863374] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-15T17:26:34.864833] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:26:34.868015] [INFO ] [REMOTE ] BFS: Full fetch complete (9647 records). [2025-09-15T17:26:34.868280] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-15T17:26:34.880279] [DEBUG] [LOCAL ] BFH: Trimmed 45466 records to 30069 (keeping 150 days of data) [2025-09-15T17:26:35.368825] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-15T17:26:35.369460] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-15T17:26:35.370244] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-15T17:26:35.370314] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-15T17:26:35.373721] [DEBUG] [LOCAL ] BFS: Trimmed 9647 records to 6716 (keeping 150 days of data) [2025-09-15T17:26:35.468405] [DEBUG] [LOCAL ] BFS: Primary data saved (6716 records). [2025-09-15T17:26:35.469342] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-15T17:26:35.469714] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFS took 22.2s. Estimated remaining: 3h 39m 1s. Rate: 9.6 symbols/min [2025-09-15T17:26:35.653010] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:35.658309] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-15T17:26:35.663039] [DEBUG] [LOCAL ] BFH: Primary data saved (30069 records). [2025-09-15T17:26:35.666851] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-15T17:26:35.667308] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFH took 42.4s. Estimated remaining: 3h 38m 6s. Rate: 9.7 symbols/min [2025-09-15T17:26:35.755070] [DEBUG] [LOCAL ] BGB: Loaded 12790 existing records from primary storage. [2025-09-15T17:26:35.776003] [INFO ] [MAIN ] BGB: Loaded 12790 existing records. [2025-09-15T17:26:36.001570] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:36.033630] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:36.033894] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-15T17:26:36.034036] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-15T17:26:36.034517] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-15T17:26:36.034574] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-15T17:26:36.150854] [DEBUG] [LOCAL ] BGH: Loaded 12346 existing records from primary storage. [2025-09-15T17:26:36.156119] [INFO ] [MAIN ] BGH: Loaded 12346 existing records. [2025-09-15T17:26:36.545316] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:36.551310] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-15T17:26:36.567142] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-15T17:26:36.576895] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-15T17:26:36.588213] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-15T17:26:36.603777] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:26:36.679109] [INFO ] [REMOTE ] BGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:36.689688] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-15T17:26:36.964055] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-15T17:26:37.045575] [INFO ] [REMOTE ] BGH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:37.257883] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-15T17:26:37.622358] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:26:37.849847] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:26:38.057915] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-15T17:26:38.857877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-15T17:26:39.462998] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T17:26:39.657864] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-15T17:26:39.799732] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:26:40.457877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-15T17:26:41.214914] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:26:41.257822] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-15T17:26:41.486276] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:26:42.057887] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-15T17:26:42.779607] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:26:42.781588] [INFO ] [REMOTE ] BFZ: Full fetch complete (12477 records). [2025-09-15T17:26:42.781680] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-15T17:26:42.860916] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-15T17:26:43.092324] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:26:43.197894] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-15T17:26:43.198014] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-15T17:26:43.198398] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-15T17:26:43.198451] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-15T17:26:43.199125] [DEBUG] [LOCAL ] BFZ: Trimmed 12477 records to 8249 (keeping 150 days of data) [2025-09-15T17:26:43.254434] [DEBUG] [LOCAL ] BFZ: Primary data saved (8249 records). [2025-09-15T17:26:43.254596] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-15T17:26:43.254739] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 23.9s. Estimated remaining: 3h 38m 11s. Rate: 9.7 symbols/min [2025-09-15T17:26:43.459321] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:43.471524] [DEBUG] [LOCAL ] BGR: Loaded 9858 existing records from primary storage. [2025-09-15T17:26:43.471699] [INFO ] [MAIN ] BGR: Loaded 9858 existing records. [2025-09-15T17:26:43.660751] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-15T17:26:43.695990] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:43.696320] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-15T17:26:43.696397] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-15T17:26:43.696945] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-15T17:26:43.697029] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-15T17:26:44.171500] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:26:44.226769] [INFO ] [REMOTE ] BGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:44.457925] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-15T17:26:45.234074] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T17:26:45.257811] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-15T17:26:45.371178] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T17:26:45.825266] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:26:46.057907] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-15T17:26:46.797885] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:26:46.857915] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-15T17:26:47.381496] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T17:26:47.657879] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-15T17:26:48.457883] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-15T17:26:48.686414] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:26:49.257880] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-15T17:26:49.822710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:26:50.057885] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-15T17:26:50.198819] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:26:50.857872] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-15T17:26:51.657877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-15T17:26:51.729223] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:26:51.814487] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:26:52.459788] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-15T17:26:52.460989] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:26:53.108714] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:26:53.257884] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-15T17:26:54.057888] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-15T17:26:54.164435] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:26:54.166776] [INFO ] [REMOTE ] BGH: Full fetch complete (17364 records). [2025-09-15T17:26:54.166848] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-15T17:26:54.553042] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-15T17:26:54.553133] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-15T17:26:54.553483] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-15T17:26:54.553527] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-15T17:26:54.554255] [DEBUG] [LOCAL ] BGH: Trimmed 17364 records to 12045 (keeping 150 days of data) [2025-09-15T17:26:54.634196] [DEBUG] [LOCAL ] BGH: Primary data saved (12045 records). [2025-09-15T17:26:54.634341] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-15T17:26:54.634424] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BGH took 19.0s. Estimated remaining: 3h 38m 47s. Rate: 9.6 symbols/min [2025-09-15T17:26:54.817611] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:54.826127] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:26:54.864818] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-15T17:26:54.867522] [DEBUG] [LOCAL ] BGS: Loaded 37999 existing records from primary storage. [2025-09-15T17:26:54.867688] [INFO ] [MAIN ] BGS: Loaded 37999 existing records. [2025-09-15T17:26:55.047137] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:55.047447] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-15T17:26:55.047534] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-15T17:26:55.048430] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-15T17:26:55.048481] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-15T17:26:55.408998] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:55.548011] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:26:55.657863] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-15T17:26:56.267249] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T17:26:56.269199] [INFO ] [REMOTE ] BGR: Full fetch complete (14905 records). [2025-09-15T17:26:56.269276] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-15T17:26:56.463918] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-15T17:26:56.631901] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-15T17:26:56.631981] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-15T17:26:56.632285] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-15T17:26:56.632356] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-15T17:26:56.632890] [DEBUG] [LOCAL ] BGR: Trimmed 14905 records to 9621 (keeping 150 days of data) [2025-09-15T17:26:56.692211] [DEBUG] [LOCAL ] BGR: Primary data saved (9621 records). [2025-09-15T17:26:56.692357] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-15T17:26:56.692443] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGR took 13.4s. Estimated remaining: 3h 38m 7s. Rate: 9.7 symbols/min [2025-09-15T17:26:56.865426] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:56.872946] [DEBUG] [LOCAL ] BGSF: Loaded 4332 existing records from primary storage. [2025-09-15T17:26:56.873147] [INFO ] [MAIN ] BGSF: Loaded 4332 existing records. [2025-09-15T17:26:57.063383] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:57.063796] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-15T17:26:57.063851] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-15T17:26:57.064159] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-15T17:26:57.064216] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-15T17:26:57.263033] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-15T17:26:57.440711] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:58.044774] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:26:58.057801] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-15T17:26:58.857868] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-15T17:26:58.892261] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:26:58.898616] [INFO ] [REMOTE ] BG: Full fetch complete (54781 records). [2025-09-15T17:26:58.898781] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-15T17:26:59.304741] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-15T17:26:59.304893] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-15T17:26:59.305560] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-15T17:26:59.305619] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-15T17:26:59.307037] [DEBUG] [LOCAL ] BG: Trimmed 54781 records to 37332 (keeping 150 days of data) [2025-09-15T17:26:59.335981] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:26:59.588727] [DEBUG] [LOCAL ] BG: Primary data saved (37332 records). [2025-09-15T17:26:59.588894] [INFO ] [MAIN ] BG: Full history saved. [2025-09-15T17:26:59.591234] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BG took 29.4s. Estimated remaining: 3h 37m 34s. Rate: 9.7 symbols/min [2025-09-15T17:26:59.662934] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-15T17:26:59.777075] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:59.787964] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:26:59.808287] [DEBUG] [LOCAL ] BGT: Loaded 12374 existing records from primary storage. [2025-09-15T17:26:59.808423] [INFO ] [MAIN ] BGT: Loaded 12374 existing records. [2025-09-15T17:26:59.988913] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:59.989199] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-15T17:26:59.989266] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-15T17:26:59.989799] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-15T17:26:59.989887] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-15T17:27:00.345968] [INFO ] [REMOTE ] BGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:00.457879] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-15T17:27:01.180736] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:27:01.218080] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:27:01.257861] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-15T17:27:02.057920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-15T17:27:02.857922] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-15T17:27:02.965546] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:27:03.280383] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T17:27:03.657888] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-15T17:27:04.457939] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-15T17:27:04.886723] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:27:04.912019] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:27:05.064252] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:27:05.257973] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-15T17:27:06.017210] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:27:06.057821] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-15T17:27:06.830274] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:27:06.857860] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-15T17:27:07.657938] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-15T17:27:07.782480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:27:08.457892] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-15T17:27:09.010182] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:27:09.257912] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-15T17:27:09.370821] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:27:09.373539] [INFO ] [REMOTE ] BGB: Full fetch complete (19575 records). [2025-09-15T17:27:09.373716] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-15T17:27:09.676557] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:27:09.761310] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-15T17:27:09.761398] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-15T17:27:09.761760] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-15T17:27:09.761814] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-15T17:27:09.762587] [DEBUG] [LOCAL ] BGB: Trimmed 19575 records to 12257 (keeping 150 days of data) [2025-09-15T17:27:09.842239] [DEBUG] [LOCAL ] BGB: Primary data saved (12257 records). [2025-09-15T17:27:09.842399] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-15T17:27:09.842505] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGB took 34.4s. Estimated remaining: 3h 38m 0s. Rate: 9.7 symbols/min [2025-09-15T17:27:10.013491] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:10.022192] [DEBUG] [LOCAL ] BGX: Loaded 7740 existing records from primary storage. [2025-09-15T17:27:10.022280] [INFO ] [MAIN ] BGX: Loaded 7740 existing records. [2025-09-15T17:27:10.063105] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-15T17:27:10.205351] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:10.205594] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-15T17:27:10.205660] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-15T17:27:10.205970] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-15T17:27:10.206016] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-15T17:27:10.554982] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:10.857894] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-15T17:27:11.283886] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:27:11.657913] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-15T17:27:11.720324] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:27:12.223363] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T17:27:12.457903] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-15T17:27:13.257900] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-15T17:27:14.057898] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-15T17:27:14.274807] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T17:27:14.857845] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-15T17:27:14.936481] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T17:27:15.064469] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:27:15.472299] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:27:15.657896] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-15T17:27:16.090416] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:27:16.457920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-15T17:27:17.033827] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:27:17.257930] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-15T17:27:17.979220] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:27:17.980905] [INFO ] [REMOTE ] BGSF: Full fetch complete (5699 records). [2025-09-15T17:27:17.980973] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-15T17:27:18.062947] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-15T17:27:18.335879] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-15T17:27:18.335969] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-15T17:27:18.336160] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-15T17:27:18.336201] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-15T17:27:18.336599] [DEBUG] [LOCAL ] BGSF: Trimmed 5699 records to 4578 (keeping 150 days of data) [2025-09-15T17:27:18.363099] [DEBUG] [LOCAL ] BGSF: Primary data saved (4578 records). [2025-09-15T17:27:18.363174] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-15T17:27:18.363272] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGSF took 21.7s. Estimated remaining: 3h 38m 13s. Rate: 9.7 symbols/min [2025-09-15T17:27:18.545492] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:18.566406] [DEBUG] [LOCAL ] BGY: Loaded 16485 existing records from primary storage. [2025-09-15T17:27:18.566547] [INFO ] [MAIN ] BGY: Loaded 16485 existing records. [2025-09-15T17:27:18.750757] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:18.751096] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-15T17:27:18.751148] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-15T17:27:18.751675] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-15T17:27:18.751731] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-15T17:27:18.863056] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-15T17:27:19.112558] [INFO ] [REMOTE ] BGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:19.630778] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:27:19.650236] [INFO ] [REMOTE ] BGS: Full fetch complete (54805 records). [2025-09-15T17:27:19.653387] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:27:19.652960] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-15T17:27:19.663220] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-15T17:27:20.035494] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-15T17:27:20.035574] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-15T17:27:20.036214] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-15T17:27:20.036258] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-15T17:27:20.037307] [DEBUG] [LOCAL ] BGS: Trimmed 54805 records to 37320 (keeping 150 days of data) [2025-09-15T17:27:20.260659] [DEBUG] [LOCAL ] BGS: Primary data saved (37320 records). [2025-09-15T17:27:20.260804] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-15T17:27:20.261074] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGS took 25.6s. Estimated remaining: 3h 37m 32s. Rate: 9.7 symbols/min [2025-09-15T17:27:20.428859] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:20.436564] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T17:27:20.451879] [DEBUG] [LOCAL ] BH: Loaded 13143 existing records from primary storage. [2025-09-15T17:27:20.451978] [INFO ] [MAIN ] BH: Loaded 13143 existing records. [2025-09-15T17:27:20.462924] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-15T17:27:20.631023] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:20.631241] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-15T17:27:20.631298] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-15T17:27:20.631762] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-15T17:27:20.631813] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-15T17:27:21.008350] [INFO ] [REMOTE ] BH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:21.257907] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-15T17:27:21.522877] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:27:21.701826] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:27:22.057913] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-15T17:27:22.767633] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:27:22.857839] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-15T17:27:23.657946] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-15T17:27:23.872486] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T17:27:24.197761] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T17:27:24.457873] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-15T17:27:25.019727] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:27:25.257900] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-15T17:27:26.057857] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-15T17:27:26.289270] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:27:26.701574] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:27:26.857876] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-15T17:27:27.657883] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-15T17:27:27.696394] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T17:27:28.356663] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:27:28.457835] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-15T17:27:29.195694] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:27:29.198381] [INFO ] [REMOTE ] BGT: Full fetch complete (17972 records). [2025-09-15T17:27:29.198452] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-15T17:27:29.263165] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-15T17:27:29.560988] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-15T17:27:29.561074] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-15T17:27:29.561463] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-15T17:27:29.561520] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-15T17:27:29.562128] [DEBUG] [LOCAL ] BGT: Trimmed 17972 records to 12264 (keeping 150 days of data) [2025-09-15T17:27:29.643380] [DEBUG] [LOCAL ] BGT: Primary data saved (12264 records). [2025-09-15T17:27:29.643546] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-15T17:27:29.643664] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGT took 30.1s. Estimated remaining: 3h 37m 51s. Rate: 9.7 symbols/min [2025-09-15T17:27:29.812479] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:29.854802] [DEBUG] [LOCAL ] BHC: Loaded 34955 existing records from primary storage. [2025-09-15T17:27:29.854960] [INFO ] [MAIN ] BHC: Loaded 34955 existing records. [2025-09-15T17:27:29.991886] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:27:30.045374] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:30.045660] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-15T17:27:30.045708] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-15T17:27:30.047004] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-15T17:27:30.047058] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-15T17:27:30.066976] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-15T17:27:30.398708] [INFO ] [REMOTE ] BHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:30.838191] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:27:30.857819] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-15T17:27:31.352530] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:27:31.657874] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-15T17:27:32.457912] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-15T17:27:32.815269] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:27:33.257872] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-15T17:27:33.470112] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:27:33.841145] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:27:33.843186] [INFO ] [REMOTE ] BGX: Full fetch complete (11967 records). [2025-09-15T17:27:33.843256] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-15T17:27:34.063063] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-15T17:27:34.200521] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-15T17:27:34.200593] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-15T17:27:34.200867] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-15T17:27:34.200908] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-15T17:27:34.201359] [DEBUG] [LOCAL ] BGX: Trimmed 11967 records to 7699 (keeping 150 days of data) [2025-09-15T17:27:34.252613] [DEBUG] [LOCAL ] BGX: Primary data saved (7699 records). [2025-09-15T17:27:34.252756] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-15T17:27:34.252850] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGX took 24.4s. Estimated remaining: 3h 37m 32s. Rate: 9.7 symbols/min [2025-09-15T17:27:34.423220] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:34.442122] [DEBUG] [LOCAL ] BHE: Loaded 17884 existing records from primary storage. [2025-09-15T17:27:34.442237] [INFO ] [MAIN ] BHE: Loaded 17884 existing records. [2025-09-15T17:27:34.619189] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:34.619416] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-15T17:27:34.619469] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-15T17:27:34.620090] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-15T17:27:34.620161] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-15T17:27:34.863085] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-15T17:27:34.972749] [INFO ] [REMOTE ] BHE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:35.231023] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:27:35.569023] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:27:35.657877] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-15T17:27:36.457942] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-15T17:27:36.940499] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:27:37.257900] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-15T17:27:37.462270] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:27:38.057903] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-15T17:27:38.328531] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:27:38.857874] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-15T17:27:39.431323] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:27:39.657900] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-15T17:27:39.762942] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:27:39.765362] [INFO ] [REMOTE ] BH: Full fetch complete (15431 records). [2025-09-15T17:27:39.765432] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-15T17:27:39.765847] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:27:39.765956] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:27:39.766004] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:27:39.766043] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-15T17:27:39.766110] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-15T17:27:39.766147] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-15T17:27:39.766476] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-15T17:27:39.766552] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 19.5s. Estimated remaining: 3h 37m 21s. Rate: 9.7 symbols/min [2025-09-15T17:27:39.973821] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:39.991834] [DEBUG] [LOCAL ] BHK: Loaded 18380 existing records from primary storage. [2025-09-15T17:27:39.991960] [INFO ] [MAIN ] BHK: Loaded 18380 existing records. [2025-09-15T17:27:40.178853] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:40.179097] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-15T17:27:40.179150] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-15T17:27:40.179792] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-15T17:27:40.179853] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-15T17:27:40.463040] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-15T17:27:40.542742] [INFO ] [REMOTE ] BHK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:40.782094] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:27:41.257877] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-15T17:27:41.860549] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:27:42.057899] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-15T17:27:42.248497] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:27:42.857911] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-15T17:27:43.024027] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:27:43.657908] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-15T17:27:43.718806] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:27:44.457843] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-15T17:27:44.805980] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T17:27:45.257893] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-15T17:27:45.315712] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:27:46.056306] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:27:46.061141] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-15T17:27:46.857926] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-15T17:27:47.657906] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-15T17:27:47.707288] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:27:47.754231] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:27:48.431468] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T17:27:48.457821] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-15T17:27:49.257897] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-15T17:27:49.421010] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:27:49.423962] [INFO ] [REMOTE ] BGY: Full fetch complete (25396 records). [2025-09-15T17:27:49.424132] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-15T17:27:49.815833] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-15T17:27:49.815968] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-15T17:27:49.816532] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-15T17:27:49.816579] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-15T17:27:49.817831] [DEBUG] [LOCAL ] BGY: Trimmed 25396 records to 16276 (keeping 150 days of data) [2025-09-15T17:27:49.918807] [DEBUG] [LOCAL ] BGY: Primary data saved (16276 records). [2025-09-15T17:27:49.918979] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-15T17:27:49.919084] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGY took 31.6s. Estimated remaining: 3h 37m 45s. Rate: 9.6 symbols/min [2025-09-15T17:27:50.065164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-15T17:27:50.094164] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:50.139686] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:27:50.159070] [DEBUG] [LOCAL ] BHP: Loaded 40153 existing records from primary storage. [2025-09-15T17:27:50.159316] [INFO ] [MAIN ] BHP: Loaded 40153 existing records. [2025-09-15T17:27:50.343831] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:50.344172] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-15T17:27:50.344222] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-15T17:27:50.345472] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-15T17:27:50.345535] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-15T17:27:50.716140] [INFO ] [REMOTE ] BHP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:50.857877] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-15T17:27:51.562262] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:27:51.593634] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:27:51.657871] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-15T17:27:52.457894] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-15T17:27:52.969101] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:27:53.257885] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-15T17:27:53.983826] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:27:54.057846] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-15T17:27:54.090611] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:27:54.857900] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-15T17:27:55.169407] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:27:55.657922] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-15T17:27:56.434665] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:27:56.457831] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-15T17:27:56.665273] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T17:27:57.257876] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-15T17:27:57.785008] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:27:57.790617] [INFO ] [REMOTE ] BHC: Full fetch complete (50928 records). [2025-09-15T17:27:57.790838] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-15T17:27:58.065543] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-15T17:27:58.171950] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-15T17:27:58.172076] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-15T17:27:58.185972] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-15T17:27:58.186091] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-15T17:27:58.187680] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:27:58.193869] [DEBUG] [LOCAL ] BHC: Trimmed 50928 records to 34175 (keeping 150 days of data) [2025-09-15T17:27:58.400488] [DEBUG] [LOCAL ] BHC: Primary data saved (34175 records). [2025-09-15T17:27:58.400668] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-15T17:27:58.400779] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHC took 28.8s. Estimated remaining: 3h 37m 57s. Rate: 9.6 symbols/min [2025-09-15T17:27:58.571806] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:58.587419] [DEBUG] [LOCAL ] BHR: Loaded 15557 existing records from primary storage. [2025-09-15T17:27:58.587583] [INFO ] [MAIN ] BHR: Loaded 15557 existing records. [2025-09-15T17:27:58.762548] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:58.762797] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-15T17:27:58.762842] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-15T17:27:58.763290] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-15T17:27:58.763337] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-15T17:27:58.863142] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-15T17:27:59.127484] [INFO ] [REMOTE ] BHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:59.521206] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:27:59.657857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-15T17:28:00.095309] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T17:28:00.457863] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-15T17:28:01.257884] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-15T17:28:01.298386] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:28:01.537930] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:28:01.956016] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:28:01.958845] [INFO ] [REMOTE ] BHE: Full fetch complete (27984 records). [2025-09-15T17:28:01.958951] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-15T17:28:02.063166] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-15T17:28:02.357834] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-15T17:28:02.357917] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-15T17:28:02.358352] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-15T17:28:02.358394] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-15T17:28:02.359198] [DEBUG] [LOCAL ] BHE: Trimmed 27984 records to 17441 (keeping 150 days of data) [2025-09-15T17:28:02.477335] [DEBUG] [LOCAL ] BHE: Primary data saved (17441 records). [2025-09-15T17:28:02.477594] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-15T17:28:02.477724] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHE took 28.2s. Estimated remaining: 3h 37m 34s. Rate: 9.6 symbols/min [2025-09-15T17:28:02.665440] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:02.665627] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-15T17:28:02.665687] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-15T17:28:02.665841] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-15T17:28:02.665881] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-15T17:28:02.665922] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-15T17:28:02.665956] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-15T17:28:02.860389] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-15T17:28:03.046724] [INFO ] [REMOTE ] BHV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:03.657941] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-15T17:28:03.823943] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:28:03.837299] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:28:03.841561] [INFO ] [REMOTE ] BHK: Full fetch complete (23576 records). [2025-09-15T17:28:03.841679] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-15T17:28:04.123815] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T17:28:04.205236] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-15T17:28:04.205319] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-15T17:28:04.205845] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-15T17:28:04.205894] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-15T17:28:04.207280] [DEBUG] [LOCAL ] BHK: Trimmed 23576 records to 18311 (keeping 150 days of data) [2025-09-15T17:28:04.319264] [DEBUG] [LOCAL ] BHK: Primary data saved (18311 records). [2025-09-15T17:28:04.319427] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-15T17:28:04.319521] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 24.6s. Estimated remaining: 3h 36m 54s. Rate: 9.7 symbols/min [2025-09-15T17:28:04.464030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-15T17:28:04.496413] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:04.541541] [DEBUG] [LOCAL ] BHVN: Loaded 37833 existing records from primary storage. [2025-09-15T17:28:04.541774] [INFO ] [MAIN ] BHVN: Loaded 37833 existing records. [2025-09-15T17:28:04.722381] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:04.722695] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-15T17:28:04.722747] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-15T17:28:04.723699] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-15T17:28:04.723758] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-15T17:28:05.084432] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:05.257848] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-15T17:28:06.057882] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-15T17:28:06.254030] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T17:28:06.418957] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:28:06.747899] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:28:06.857877] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-15T17:28:07.657940] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-15T17:28:07.894146] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:28:07.904907] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T17:28:08.457902] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-15T17:28:09.257899] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-15T17:28:09.925982] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:28:09.984262] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:28:10.057880] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-15T17:28:10.857898] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-15T17:28:11.657951] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-15T17:28:11.874705] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:28:12.029777] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:28:12.457872] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-15T17:28:12.616942] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:28:12.754610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:28:13.257913] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-15T17:28:14.057904] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-15T17:28:14.456816] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:28:14.857923] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-15T17:28:15.292738] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:28:15.657889] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-15T17:28:15.984876] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:28:16.457885] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-15T17:28:16.785676] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T17:28:16.912075] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:28:17.257882] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-15T17:28:18.057886] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-15T17:28:18.804743] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:28:18.857855] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-15T17:28:18.928428] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:28:19.657912] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-15T17:28:20.457938] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-15T17:28:20.536762] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:28:20.543105] [INFO ] [REMOTE ] BHP: Full fetch complete (58047 records). [2025-09-15T17:28:20.543280] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-15T17:28:20.839372] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T17:28:20.935451] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-15T17:28:20.935563] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-15T17:28:20.936315] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-15T17:28:20.936372] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-15T17:28:20.937856] [DEBUG] [LOCAL ] BHP: Trimmed 58047 records to 39376 (keeping 150 days of data) [2025-09-15T17:28:21.212008] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:28:21.229067] [DEBUG] [LOCAL ] BHP: Primary data saved (39376 records). [2025-09-15T17:28:21.229235] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-15T17:28:21.229998] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 31.3s. Estimated remaining: 3h 38m 10s. Rate: 9.6 symbols/min [2025-09-15T17:28:21.262973] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-15T17:28:21.409728] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:21.449188] [DEBUG] [LOCAL ] BILL: Loaded 39323 existing records from primary storage. [2025-09-15T17:28:21.449329] [INFO ] [MAIN ] BILL: Loaded 39323 existing records. [2025-09-15T17:28:21.635373] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:21.635682] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-15T17:28:21.635730] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-15T17:28:21.636627] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-15T17:28:21.636713] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-15T17:28:21.988204] [INFO ] [REMOTE ] BILL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:22.057827] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-15T17:28:22.079805] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:28:22.857889] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-15T17:28:23.421198] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:28:23.657889] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-15T17:28:23.851619] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T17:28:24.457921] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-15T17:28:25.221749] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:28:25.257813] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-15T17:28:25.594729] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:28:25.600403] [INFO ] [REMOTE ] BHVN: Full fetch complete (53240 records). [2025-09-15T17:28:25.600502] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-15T17:28:25.973566] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-15T17:28:25.973692] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-15T17:28:25.974289] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-15T17:28:25.974333] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-15T17:28:25.975849] [DEBUG] [LOCAL ] BHVN: Trimmed 53240 records to 37135 (keeping 150 days of data) [2025-09-15T17:28:26.065152] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-15T17:28:26.207523] [DEBUG] [LOCAL ] BHVN: Primary data saved (37135 records). [2025-09-15T17:28:26.207698] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-15T17:28:26.208078] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHVN took 21.9s. Estimated remaining: 3h 37m 54s. Rate: 9.6 symbols/min [2025-09-15T17:28:26.378539] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:26.401369] [DEBUG] [LOCAL ] BIO: Loaded 18672 existing records from primary storage. [2025-09-15T17:28:26.401550] [INFO ] [MAIN ] BIO: Loaded 18672 existing records. [2025-09-15T17:28:26.582328] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:26.582577] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-15T17:28:26.582624] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-15T17:28:26.583218] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-15T17:28:26.583270] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-15T17:28:26.859542] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-15T17:28:26.974666] [INFO ] [REMOTE ] BIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:26.977604] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:28:27.016174] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:28:27.426887] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T17:28:27.427788] [INFO ] [REMOTE ] BHV: Full fetch complete (1075 records). [2025-09-15T17:28:27.427857] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-15T17:28:27.610232] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T17:28:27.610432] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:28:27.610480] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:28:27.610519] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-15T17:28:27.610577] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-15T17:28:27.610633] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-15T17:28:27.610696] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-15T17:28:27.610778] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHV took 25.1s. Estimated remaining: 3h 37m 11s. Rate: 9.6 symbols/min [2025-09-15T17:28:27.663325] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-15T17:28:27.785558] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:27.823798] [DEBUG] [LOCAL ] BIP: Loaded 28380 existing records from primary storage. [2025-09-15T17:28:27.824027] [INFO ] [MAIN ] BIP: Loaded 28380 existing records. [2025-09-15T17:28:28.001093] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:28.001355] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-15T17:28:28.001400] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-15T17:28:28.002113] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-15T17:28:28.002164] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-15T17:28:28.357963] [INFO ] [REMOTE ] BIP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:28.457914] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-15T17:28:28.824309] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T17:28:28.829564] [INFO ] [REMOTE ] BHR: Full fetch complete (22607 records). [2025-09-15T17:28:28.829725] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-15T17:28:29.217161] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-15T17:28:29.217376] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-15T17:28:29.218359] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-15T17:28:29.218525] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-15T17:28:29.220916] [DEBUG] [LOCAL ] BHR: Trimmed 22607 records to 15154 (keeping 150 days of data) [2025-09-15T17:28:29.276967] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-15T17:28:29.344285] [DEBUG] [LOCAL ] BHR: Primary data saved (15154 records). [2025-09-15T17:28:29.344513] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-15T17:28:29.344672] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHR took 30.9s. Estimated remaining: 3h 36m 30s. Rate: 9.7 symbols/min [2025-09-15T17:28:29.532441] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:29.567465] [DEBUG] [LOCAL ] BIPC: Loaded 30547 existing records from primary storage. [2025-09-15T17:28:29.567698] [INFO ] [MAIN ] BIPC: Loaded 30547 existing records. [2025-09-15T17:28:29.754608] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:29.754989] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-15T17:28:29.755046] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-15T17:28:29.755911] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-15T17:28:29.755964] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-15T17:28:30.062800] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-15T17:28:30.137637] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:30.172387] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:28:30.436139] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:28:30.857904] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-15T17:28:31.554632] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:28:31.657883] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-15T17:28:32.457939] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-15T17:28:32.548850] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:28:32.615568] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:28:33.257879] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-15T17:28:33.854088] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:28:34.057871] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-15T17:28:34.682622] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:28:34.857879] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-15T17:28:35.277587] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:28:35.657921] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-15T17:28:36.463001] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-15T17:28:36.485134] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:28:36.516861] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:28:37.257890] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-15T17:28:37.611032] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:28:38.057933] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-15T17:28:38.857891] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-15T17:28:38.913738] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:28:38.919668] [INFO ] [REMOTE ] BILL: Full fetch complete (56988 records). [2025-09-15T17:28:38.919788] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-15T17:28:39.313199] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-15T17:28:39.313341] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-15T17:28:39.314079] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-15T17:28:39.314127] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-15T17:28:39.315626] [DEBUG] [LOCAL ] BILL: Trimmed 56988 records to 38625 (keeping 150 days of data) [2025-09-15T17:28:39.552009] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:28:39.586158] [DEBUG] [LOCAL ] BILL: Primary data saved (38625 records). [2025-09-15T17:28:39.586393] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-15T17:28:39.586911] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BILL took 18.4s. Estimated remaining: 3h 36m 55s. Rate: 9.6 symbols/min [2025-09-15T17:28:39.662947] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-15T17:28:39.760414] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:39.764565] [DEBUG] [LOCAL ] BIPH: Loaded 1599 existing records from primary storage. [2025-09-15T17:28:39.764694] [INFO ] [MAIN ] BIPH: Loaded 1599 existing records. [2025-09-15T17:28:39.938414] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:39.938687] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-15T17:28:39.938734] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-15T17:28:39.938939] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-15T17:28:39.938983] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-15T17:28:40.297179] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:40.324187] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:28:40.457889] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-15T17:28:40.933255] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:28:41.257901] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-15T17:28:41.587306] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:28:41.795904] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:28:42.057891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-15T17:28:42.857854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-15T17:28:43.037537] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:28:43.194411] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:28:43.657867] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-15T17:28:44.457685] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:28:44.457916] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-15T17:28:45.257928] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-15T17:28:45.460167] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:28:46.057882] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-15T17:28:46.825335] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:28:46.857836] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-15T17:28:46.898938] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:28:47.657876] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-15T17:28:48.248395] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T17:28:48.457953] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-15T17:28:48.826861] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:28:49.173204] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:28:49.257928] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-15T17:28:50.057896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-15T17:28:50.348333] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:28:50.430035] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:28:50.857892] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-15T17:28:51.236130] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:28:51.657872] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-15T17:28:52.036538] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:28:52.457870] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-15T17:28:53.257854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-15T17:28:53.467717] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:28:53.470378] [INFO ] [REMOTE ] BIO: Full fetch complete (28335 records). [2025-09-15T17:28:53.470467] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-15T17:28:53.572583] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-15T17:28:53.855529] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-15T17:28:53.855697] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-15T17:28:53.856403] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-15T17:28:53.856454] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-15T17:28:53.857488] [DEBUG] [LOCAL ] BIO: Trimmed 28335 records to 18273 (keeping 150 days of data) [2025-09-15T17:28:53.984178] [DEBUG] [LOCAL ] BIO: Primary data saved (18273 records). [2025-09-15T17:28:53.984418] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-15T17:28:53.984536] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIO took 27.8s. Estimated remaining: 3h 37m 50s. Rate: 9.6 symbols/min [2025-09-15T17:28:54.057867] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-15T17:28:54.857889] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-15T17:28:55.617810] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:28:55.624099] [INFO ] [REMOTE ] BIP: Full fetch complete (43437 records). [2025-09-15T17:28:55.624292] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-15T17:28:55.669150] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-15T17:28:56.007973] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-15T17:28:56.008124] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-15T17:28:56.008763] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-15T17:28:56.008856] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-15T17:28:56.012596] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T17:28:56.014394] [DEBUG] [LOCAL ] BIP: Trimmed 43437 records to 27810 (keeping 150 days of data) [2025-09-15T17:28:56.142242] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:28:56.225256] [DEBUG] [LOCAL ] BIP: Primary data saved (27810 records). [2025-09-15T17:28:56.225396] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-15T17:28:56.225477] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIP took 28.6s. Estimated remaining: 3h 37m 14s. Rate: 9.6 symbols/min [2025-09-15T17:28:56.457873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-15T17:28:57.002113] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:28:57.003002] [INFO ] [REMOTE ] BIPH: Full fetch complete (2784 records). [2025-09-15T17:28:57.003071] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-15T17:28:57.270045] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-15T17:28:57.358858] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-15T17:28:57.358939] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-15T17:28:57.359045] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-15T17:28:57.359084] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-15T17:28:57.359440] [DEBUG] [LOCAL ] BIPH: Trimmed 2784 records to 1566 (keeping 150 days of data) [2025-09-15T17:28:57.369265] [DEBUG] [LOCAL ] BIPH: Primary data saved (1566 records). [2025-09-15T17:28:57.369323] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-15T17:28:57.369389] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPH took 17.8s. Estimated remaining: 3h 36m 30s. Rate: 9.7 symbols/min [2025-09-15T17:28:58.617439] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:28:58.621828] [INFO ] [REMOTE ] BIPC: Full fetch complete (45504 records). [2025-09-15T17:28:58.621917] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-15T17:28:59.038513] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-15T17:28:59.038608] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-15T17:28:59.039158] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-15T17:28:59.039201] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-15T17:28:59.040279] [DEBUG] [LOCAL ] BIPC: Trimmed 45504 records to 29926 (keeping 150 days of data) [2025-09-15T17:28:59.232978] [DEBUG] [LOCAL ] BIPC: Primary data saved (29926 records). [2025-09-15T17:28:59.233126] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-15T17:28:59.233217] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 29.9s. Estimated remaining: 3h 35m 51s. Rate: 9.7 symbols/min [2025-09-15T17:28:59.915908] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.915025] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.962067] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.957910] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.971449] [DEBUG] [LOCAL ] BIPJ: Loaded 2122 existing records from primary storage. [2025-09-15T17:28:59.974091] [DEBUG] [LOCAL ] BIPI: Loaded 2075 existing records from primary storage. [2025-09-15T17:28:59.971609] [INFO ] [MAIN ] BIPJ: Loaded 2122 existing records. [2025-09-15T17:28:59.995321] [INFO ] [MAIN ] BIPI: Loaded 2075 existing records. [2025-09-15T17:29:00.224972] [DEBUG] [LOCAL ] BIT: Loaded 16547 existing records from primary storage. [2025-09-15T17:29:00.263192] [INFO ] [MAIN ] BIT: Loaded 16547 existing records. [2025-09-15T17:29:00.331579] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.400972] [DEBUG] [LOCAL ] BIRK: Loaded 38281 existing records from primary storage. [2025-09-15T17:29:00.458806] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.464192] [INFO ] [MAIN ] BIRK: Loaded 38281 existing records. [2025-09-15T17:29:00.497202] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.535469] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-15T17:29:00.535590] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.585678] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-15T17:29:00.601132] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-15T17:29:00.601181] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-15T17:29:00.641505] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-15T17:29:00.658114] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-15T17:29:00.812102] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.896885] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.924638] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.929950] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-15T17:29:00.940297] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-15T17:29:00.945560] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.960140] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-15T17:29:00.950840] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-15T17:29:01.051715] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-15T17:29:01.097504] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-15T17:29:01.763791] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:01.791080] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-15T17:29:01.895678] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:01.939710] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-15T17:29:02.150539] [INFO ] [REMOTE ] BIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:02.156683] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-15T17:29:02.242469] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:02.242863] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-15T17:29:02.314187] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:29:02.315447] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-15T17:29:02.558302] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T17:29:02.559478] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-15T17:29:02.635371] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:29:02.857810] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-15T17:29:02.914977] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:29:03.167280] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-15T17:29:03.302294] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:29:03.657872] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-15T17:29:03.795070] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:29:04.457872] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-15T17:29:04.591780] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:29:04.736216] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-15T17:29:05.257949] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-15T17:29:06.057904] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-15T17:29:06.214266] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:29:06.857923] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-15T17:29:07.427029] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:29:07.649444] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:29:07.659340] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-15T17:29:08.070356] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T17:29:08.457921] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-15T17:29:09.063943] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T17:29:09.257875] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-15T17:29:10.057916] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-15T17:29:10.577292] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:29:10.855343] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:29:10.865238] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-15T17:29:11.168779] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T17:29:11.657874] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-15T17:29:12.457883] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-15T17:29:13.000337] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:29:13.005209] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:29:13.257897] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-15T17:29:14.057877] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-15T17:29:14.487339] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:29:14.858317] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-15T17:29:14.864885] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:29:15.396508] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T17:29:15.657943] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-15T17:29:16.230473] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T17:29:16.231548] [INFO ] [REMOTE ] BIPI: Full fetch complete (3611 records). [2025-09-15T17:29:16.231614] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-15T17:29:16.467457] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-15T17:29:16.588410] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-15T17:29:16.588520] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-15T17:29:16.588693] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-15T17:29:16.588752] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-15T17:29:16.589127] [DEBUG] [LOCAL ] BIPI: Trimmed 3611 records to 2045 (keeping 150 days of data) [2025-09-15T17:29:16.602976] [DEBUG] [LOCAL ] BIPI: Primary data saved (2045 records). [2025-09-15T17:29:16.603044] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-15T17:29:16.603134] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 17.4s. Estimated remaining: 3h 37m 8s. Rate: 9.6 symbols/min [2025-09-15T17:29:16.772873] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:16.821914] [DEBUG] [LOCAL ] BJ: Loaded 38619 existing records from primary storage. [2025-09-15T17:29:16.822141] [INFO ] [MAIN ] BJ: Loaded 38619 existing records. [2025-09-15T17:29:16.998771] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:16.999053] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-15T17:29:16.999115] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-15T17:29:16.999971] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-15T17:29:17.000025] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-15T17:29:17.263026] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-15T17:29:17.364526] [INFO ] [REMOTE ] BJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:17.622467] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:29:17.836503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:29:18.057879] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-15T17:29:18.468374] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T17:29:18.857920] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-15T17:29:19.657900] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-15T17:29:19.679853] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:29:20.457936] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-15T17:29:21.257897] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-15T17:29:21.320310] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:29:21.359689] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:29:21.364001] [INFO ] [REMOTE ] BIT: Full fetch complete (23275 records). [2025-09-15T17:29:21.364137] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-15T17:29:21.740974] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-15T17:29:21.741084] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-15T17:29:21.741485] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-15T17:29:21.741543] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-15T17:29:21.742956] [DEBUG] [LOCAL ] BIT: Trimmed 23275 records to 16393 (keeping 150 days of data) [2025-09-15T17:29:21.853123] [DEBUG] [LOCAL ] BIT: Primary data saved (16393 records). [2025-09-15T17:29:21.853274] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-15T17:29:21.853361] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 22.6s. Estimated remaining: 3h 36m 54s. Rate: 9.6 symbols/min [2025-09-15T17:29:22.037887] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:22.057940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-15T17:29:22.091758] [DEBUG] [LOCAL ] BK: Loaded 40340 existing records from primary storage. [2025-09-15T17:29:22.092004] [INFO ] [MAIN ] BK: Loaded 40340 existing records. [2025-09-15T17:29:22.276523] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:22.276907] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-15T17:29:22.276957] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-15T17:29:22.277936] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-15T17:29:22.277993] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-15T17:29:22.646760] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:22.650602] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:29:22.652349] [INFO ] [REMOTE ] BIPJ: Full fetch complete (3066 records). [2025-09-15T17:29:22.652482] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-15T17:29:22.868184] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-15T17:29:23.026253] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:29:23.057566] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-15T17:29:23.057702] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-15T17:29:23.057831] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-15T17:29:23.057888] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-15T17:29:23.058870] [DEBUG] [LOCAL ] BIPJ: Trimmed 3066 records to 2114 (keeping 150 days of data) [2025-09-15T17:29:23.073280] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2114 records). [2025-09-15T17:29:23.073343] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-15T17:29:23.073431] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 23.8s. Estimated remaining: 3h 36m 11s. Rate: 9.6 symbols/min [2025-09-15T17:29:23.243183] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:23.288282] [DEBUG] [LOCAL ] BKD: Loaded 37868 existing records from primary storage. [2025-09-15T17:29:23.288429] [INFO ] [MAIN ] BKD: Loaded 37868 existing records. [2025-09-15T17:29:23.476987] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:23.477375] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-15T17:29:23.477428] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-15T17:29:23.478361] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-15T17:29:23.478418] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-15T17:29:23.660740] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-15T17:29:23.861423] [INFO ] [REMOTE ] BKD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:24.457920] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-15T17:29:24.605072] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T17:29:25.066473] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:29:25.257839] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-15T17:29:26.050451] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:29:26.059181] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-15T17:29:26.857880] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-15T17:29:26.943252] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:29:27.579386] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:29:27.657834] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-15T17:29:28.132386] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:29:28.137803] [INFO ] [REMOTE ] BIRK: Full fetch complete (55265 records). [2025-09-15T17:29:28.137898] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-15T17:29:28.470451] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-15T17:29:28.520791] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-15T17:29:28.520875] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-15T17:29:28.521502] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-15T17:29:28.521566] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-15T17:29:28.522770] [DEBUG] [LOCAL ] BIRK: Trimmed 55265 records to 37594 (keeping 150 days of data) [2025-09-15T17:29:28.748336] [DEBUG] [LOCAL ] BIRK: Primary data saved (37594 records). [2025-09-15T17:29:28.748488] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-15T17:29:28.748574] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 29.5s. Estimated remaining: 3h 36m 1s. Rate: 9.7 symbols/min [2025-09-15T17:29:28.917801] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:28.940825] [DEBUG] [LOCAL ] BKE: Loaded 25219 existing records from primary storage. [2025-09-15T17:29:28.940960] [INFO ] [MAIN ] BKE: Loaded 25219 existing records. [2025-09-15T17:29:29.146673] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:29.147437] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-15T17:29:29.148530] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:29:29.159022] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-15T17:29:29.160065] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-15T17:29:29.160120] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-15T17:29:29.261764] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-15T17:29:29.511571] [INFO ] [REMOTE ] BKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:29.945581] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:29:30.057925] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-15T17:29:30.590737] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:29:30.857909] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-15T17:29:31.662965] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-15T17:29:31.679970] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:29:32.137876] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:29:32.457882] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-15T17:29:32.777573] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:29:33.257925] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-15T17:29:33.769263] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:29:34.057901] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-15T17:29:34.627251] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:29:34.857900] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-15T17:29:35.657861] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-15T17:29:35.814565] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:29:36.457825] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-15T17:29:36.655439] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:29:36.702214] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:29:37.257927] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-15T17:29:38.057887] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-15T17:29:38.207064] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:29:38.778787] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:29:38.857882] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-15T17:29:39.073248] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T17:29:39.657898] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-15T17:29:40.457943] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-15T17:29:40.634672] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:29:41.235163] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T17:29:41.241046] [INFO ] [REMOTE ] BJ: Full fetch complete (55912 records). [2025-09-15T17:29:41.241192] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-15T17:29:41.263137] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-15T17:29:41.636389] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-15T17:29:41.636515] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-15T17:29:41.637259] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-15T17:29:41.637320] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-15T17:29:41.638931] [DEBUG] [LOCAL ] BJ: Trimmed 55912 records to 37884 (keeping 150 days of data) [2025-09-15T17:29:41.778094] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:29:41.935951] [DEBUG] [LOCAL ] BJ: Primary data saved (37884 records). [2025-09-15T17:29:41.936120] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-15T17:29:41.936514] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 25.3s. Estimated remaining: 3h 36m 46s. Rate: 9.6 symbols/min [2025-09-15T17:29:42.063124] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-15T17:29:42.162582] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:42.195837] [DEBUG] [LOCAL ] BKH: Loaded 27760 existing records from primary storage. [2025-09-15T17:29:42.196003] [INFO ] [MAIN ] BKH: Loaded 27760 existing records. [2025-09-15T17:29:42.471577] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:42.471946] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-15T17:29:42.472009] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-15T17:29:42.472874] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-15T17:29:42.472949] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-15T17:29:42.866069] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-15T17:29:43.020685] [INFO ] [REMOTE ] BKH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:43.145851] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T17:29:43.188041] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:29:43.657875] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-15T17:29:44.412371] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:29:44.457835] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-15T17:29:45.095677] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T17:29:45.104202] [INFO ] [REMOTE ] BK: Full fetch complete (58246 records). [2025-09-15T17:29:45.104502] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-15T17:29:45.263028] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-15T17:29:45.566450] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-15T17:29:45.566562] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-15T17:29:45.567420] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-15T17:29:45.567470] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-15T17:29:45.569992] [DEBUG] [LOCAL ] BK: Trimmed 58246 records to 39555 (keeping 150 days of data) [2025-09-15T17:29:45.738136] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:29:45.878680] [DEBUG] [LOCAL ] BK: Primary data saved (39555 records). [2025-09-15T17:29:45.878862] [INFO ] [MAIN ] BK: Full history saved. [2025-09-15T17:29:45.880261] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BK took 24.0s. Estimated remaining: 3h 36m 23s. Rate: 9.6 symbols/min [2025-09-15T17:29:46.061444] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:46.061549] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-15T17:29:46.090505] [DEBUG] [LOCAL ] BKKT: Loaded 25840 existing records from primary storage. [2025-09-15T17:29:46.090737] [INFO ] [MAIN ] BKKT: Loaded 25840 existing records. [2025-09-15T17:29:46.276870] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:46.277123] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-15T17:29:46.277173] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-15T17:29:46.277866] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-15T17:29:46.277921] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-15T17:29:46.652017] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:46.699044] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:29:46.857883] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-15T17:29:47.563024] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:29:47.657929] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-15T17:29:48.179716] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:29:48.457875] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-15T17:29:49.176996] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:29:49.182843] [INFO ] [REMOTE ] BKD: Full fetch complete (54368 records). [2025-09-15T17:29:49.183004] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-15T17:29:49.263121] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-15T17:29:49.583073] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-15T17:29:49.583237] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-15T17:29:49.583927] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-15T17:29:49.584004] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-15T17:29:49.585399] [DEBUG] [LOCAL ] BKD: Trimmed 54368 records to 37053 (keeping 150 days of data) [2025-09-15T17:29:49.691240] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:29:49.823800] [DEBUG] [LOCAL ] BKD: Primary data saved (37053 records). [2025-09-15T17:29:49.823947] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-15T17:29:49.824813] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKD took 26.8s. Estimated remaining: 3h 35m 60s. Rate: 9.6 symbols/min [2025-09-15T17:29:50.001547] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:50.010409] [DEBUG] [LOCAL ] BKN: Loaded 5520 existing records from primary storage. [2025-09-15T17:29:50.010542] [INFO ] [MAIN ] BKN: Loaded 5520 existing records. [2025-09-15T17:29:50.065965] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-15T17:29:50.188966] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:50.189221] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-15T17:29:50.189268] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-15T17:29:50.189597] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-15T17:29:50.189662] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-15T17:29:50.552984] [INFO ] [REMOTE ] BKN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:50.657847] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T17:29:50.857882] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-15T17:29:51.365729] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:29:51.657857] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-15T17:29:52.137120] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:29:52.457866] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-15T17:29:52.769313] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:29:52.963692] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T17:29:53.257833] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-15T17:29:54.057940] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-15T17:29:54.578982] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:29:54.857898] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-15T17:29:55.122397] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:29:55.657908] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-15T17:29:55.780390] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:29:56.457880] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-15T17:29:56.979940] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T17:29:56.984775] [INFO ] [REMOTE ] BKE: Full fetch complete (37997 records). [2025-09-15T17:29:56.984916] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-15T17:29:57.263026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-15T17:29:57.365609] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-15T17:29:57.365720] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-15T17:29:57.366259] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-15T17:29:57.366312] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-15T17:29:57.367346] [DEBUG] [LOCAL ] BKE: Trimmed 37997 records to 24727 (keeping 150 days of data) [2025-09-15T17:29:57.521396] [DEBUG] [LOCAL ] BKE: Primary data saved (24727 records). [2025-09-15T17:29:57.521531] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-15T17:29:57.521652] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKE took 28.8s. Estimated remaining: 3h 36m 4s. Rate: 9.6 symbols/min [2025-09-15T17:29:57.697939] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:29:57.721931] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:57.758693] [DEBUG] [LOCAL ] BKSY: Loaded 36355 existing records from primary storage. [2025-09-15T17:29:57.758842] [INFO ] [MAIN ] BKSY: Loaded 36355 existing records. [2025-09-15T17:29:57.890328] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:29:57.948699] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:57.948978] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-15T17:29:57.949028] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-15T17:29:57.949909] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-15T17:29:57.949962] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-15T17:29:58.063019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-15T17:29:58.300487] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:58.857927] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-15T17:29:58.948738] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:29:59.657870] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-15T17:30:00.341977] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T17:30:00.457882] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-15T17:30:00.495228] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:30:01.079431] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:30:01.257875] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-15T17:30:02.057883] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-15T17:30:02.857889] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-15T17:30:03.657917] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-15T17:30:03.696842] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-15T17:30:04.457909] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-15T17:30:06.128136] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (4.07 seconds). [2025-09-15T17:30:06.138819] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-15T17:30:06.169512] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-15T17:30:06.173233] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-15T17:30:06.174814] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-15T17:30:06.782616] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T17:30:06.787554] [INFO ] [REMOTE ] BKKT: Full fetch complete (36037 records). [2025-09-15T17:30:06.787711] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-15T17:30:06.867946] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-15T17:30:06.894717] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:30:07.181958] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-15T17:30:07.182036] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-15T17:30:07.182491] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-15T17:30:07.182530] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-15T17:30:07.183349] [DEBUG] [LOCAL ] BKKT: Trimmed 36037 records to 25845 (keeping 150 days of data) [2025-09-15T17:30:07.348182] [DEBUG] [LOCAL ] BKKT: Primary data saved (25845 records). [2025-09-15T17:30:07.348380] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-15T17:30:07.348489] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKKT took 21.5s. Estimated remaining: 3h 36m 24s. Rate: 9.6 symbols/min [2025-09-15T17:30:07.521447] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:07.532144] [DEBUG] [LOCAL ] BKT: Loaded 7512 existing records from primary storage. [2025-09-15T17:30:07.532303] [INFO ] [MAIN ] BKT: Loaded 7512 existing records. [2025-09-15T17:30:07.663079] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-15T17:30:07.724008] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:07.724269] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-15T17:30:07.724323] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-15T17:30:07.724687] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-15T17:30:07.724753] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-15T17:30:08.082189] [INFO ] [REMOTE ] BKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:08.140092] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:30:08.185705] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T17:30:08.405177] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:30:08.406571] [INFO ] [REMOTE ] BKN: Full fetch complete (8122 records). [2025-09-15T17:30:08.406638] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-15T17:30:08.467049] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-15T17:30:08.760951] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-15T17:30:08.761036] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-15T17:30:08.761240] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-15T17:30:08.761278] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-15T17:30:08.761699] [DEBUG] [LOCAL ] BKN: Trimmed 8122 records to 5415 (keeping 150 days of data) [2025-09-15T17:30:08.795481] [DEBUG] [LOCAL ] BKN: Primary data saved (5415 records). [2025-09-15T17:30:08.795611] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-15T17:30:08.795723] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 19.0s. Estimated remaining: 3h 35m 43s. Rate: 9.6 symbols/min [2025-09-15T17:30:08.963493] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:08.999282] [DEBUG] [LOCAL ] BKU: Loaded 31235 existing records from primary storage. [2025-09-15T17:30:08.999457] [INFO ] [MAIN ] BKU: Loaded 31235 existing records. [2025-09-15T17:30:09.177574] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:09.177870] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-15T17:30:09.177917] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-15T17:30:09.178594] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-15T17:30:09.178675] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-15T17:30:09.267684] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-15T17:30:09.535137] [INFO ] [REMOTE ] BKU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:09.952592] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T17:30:10.057875] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-15T17:30:10.735434] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:30:10.857987] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-15T17:30:10.991701] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:30:10.995913] [INFO ] [REMOTE ] BKH: Full fetch complete (39470 records). [2025-09-15T17:30:10.995992] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-15T17:30:11.361098] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-15T17:30:11.361177] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-15T17:30:11.361696] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-15T17:30:11.361762] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-15T17:30:11.362660] [DEBUG] [LOCAL ] BKH: Trimmed 39470 records to 27296 (keeping 150 days of data) [2025-09-15T17:30:11.540335] [DEBUG] [LOCAL ] BKH: Primary data saved (27296 records). [2025-09-15T17:30:11.540528] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-15T17:30:11.540875] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKH took 29.6s. Estimated remaining: 3h 35m 12s. Rate: 9.7 symbols/min [2025-09-15T17:30:11.662952] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-15T17:30:11.715085] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:11.738668] [DEBUG] [LOCAL ] BKV: Loaded 21330 existing records from primary storage. [2025-09-15T17:30:11.738822] [INFO ] [MAIN ] BKV: Loaded 21330 existing records. [2025-09-15T17:30:11.936874] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:11.937134] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-15T17:30:11.937188] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-15T17:30:11.937762] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-15T17:30:11.937812] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-15T17:30:12.290241] [INFO ] [REMOTE ] BKV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:12.457852] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-15T17:30:12.546917] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:30:13.257876] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-15T17:30:13.785980] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:30:14.057888] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-15T17:30:14.138786] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T17:30:14.857911] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-15T17:30:15.253889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T17:30:15.657850] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-15T17:30:15.697431] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:30:15.808140] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T17:30:16.346851] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T17:30:16.457892] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-15T17:30:17.257886] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-15T17:30:17.761579] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:30:17.889994] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:30:18.057877] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-15T17:30:18.857958] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-15T17:30:19.657893] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-15T17:30:19.959354] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T17:30:20.261087] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T17:30:20.457914] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-15T17:30:21.257854] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-15T17:30:21.429548] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:30:21.757925] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:30:21.885727] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T17:30:22.057873] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-15T17:30:22.857880] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-15T17:30:23.396877] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:30:23.554244] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:30:23.657847] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-15T17:30:24.457892] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-15T17:30:25.257846] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-15T17:30:25.425753] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:30:25.478434] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T17:30:25.483932] [INFO ] [REMOTE ] BKSY: Full fetch complete (52747 records). [2025-09-15T17:30:25.484037] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-15T17:30:25.870129] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-15T17:30:25.870221] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-15T17:30:25.870916] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-15T17:30:25.870971] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-15T17:30:25.872112] [DEBUG] [LOCAL ] BKSY: Trimmed 52747 records to 35899 (keeping 150 days of data) [2025-09-15T17:30:26.059786] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-15T17:30:26.087480] [DEBUG] [LOCAL ] BKSY: Primary data saved (35899 records). [2025-09-15T17:30:26.087603] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-15T17:30:26.088177] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKSY took 28.6s. Estimated remaining: 3h 36m 5s. Rate: 9.6 symbols/min [2025-09-15T17:30:26.257258] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:26.284616] [DEBUG] [LOCAL ] BLCO: Loaded 26908 existing records from primary storage. [2025-09-15T17:30:26.284778] [INFO ] [MAIN ] BLCO: Loaded 26908 existing records. [2025-09-15T17:30:26.469315] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:26.469669] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-15T17:30:26.469740] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-15T17:30:26.470378] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-15T17:30:26.470446] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-15T17:30:26.782901] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:30:26.842823] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:26.865324] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-15T17:30:26.870280] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:30:27.657876] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-15T17:30:27.847015] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:30:28.417221] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:30:28.457830] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-15T17:30:29.257898] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-15T17:30:29.391320] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:30:29.393666] [INFO ] [REMOTE ] BKT: Full fetch complete (10978 records). [2025-09-15T17:30:29.393742] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-15T17:30:29.772019] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-15T17:30:29.772141] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-15T17:30:29.772442] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-15T17:30:29.772516] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-15T17:30:29.773246] [DEBUG] [LOCAL ] BKT: Trimmed 10978 records to 7700 (keeping 150 days of data) [2025-09-15T17:30:29.822915] [DEBUG] [LOCAL ] BKT: Primary data saved (7700 records). [2025-09-15T17:30:29.823062] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-15T17:30:29.823162] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKT took 22.5s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-15T17:30:30.003816] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:30.024500] [DEBUG] [LOCAL ] BLD: Loaded 20705 existing records from primary storage. [2025-09-15T17:30:30.024678] [INFO ] [MAIN ] BLD: Loaded 20705 existing records. [2025-09-15T17:30:30.062954] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-15T17:30:30.241208] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:30.241569] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-15T17:30:30.241632] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-15T17:30:30.242207] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-15T17:30:30.242375] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-15T17:30:30.335945] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:30:30.622148] [INFO ] [REMOTE ] BLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:30.857889] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-15T17:30:31.254698] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:30:31.657895] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-15T17:30:32.307104] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:30:32.457890] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-15T17:30:32.640876] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:30:33.257903] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-15T17:30:33.809625] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:30:34.057882] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-15T17:30:34.567490] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:30:34.857963] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-15T17:30:35.126992] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:30:35.657943] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-15T17:30:35.938948] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T17:30:36.457881] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-15T17:30:37.148078] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:30:37.257861] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-15T17:30:37.337934] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:30:38.057887] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-15T17:30:38.591773] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:30:38.857890] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-15T17:30:39.459169] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:30:39.657884] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-15T17:30:39.976295] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T17:30:39.980782] [INFO ] [REMOTE ] BKU: Full fetch complete (45240 records). [2025-09-15T17:30:39.980894] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-15T17:30:40.349077] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-15T17:30:40.349158] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-15T17:30:40.349704] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-15T17:30:40.349749] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-15T17:30:40.350731] [DEBUG] [LOCAL ] BKU: Trimmed 45240 records to 30685 (keeping 150 days of data) [2025-09-15T17:30:40.461178] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-15T17:30:40.548289] [DEBUG] [LOCAL ] BKU: Primary data saved (30685 records). [2025-09-15T17:30:40.548443] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-15T17:30:40.548533] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKU took 31.8s. Estimated remaining: 3h 36m 7s. Rate: 9.6 symbols/min [2025-09-15T17:30:40.719124] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:40.733898] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:30:40.779499] [DEBUG] [LOCAL ] BLDR: Loaded 39059 existing records from primary storage. [2025-09-15T17:30:40.779677] [INFO ] [MAIN ] BLDR: Loaded 39059 existing records. [2025-09-15T17:30:40.955893] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:40.956185] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-15T17:30:40.956234] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-15T17:30:40.957124] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-15T17:30:40.957184] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-15T17:30:41.262986] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-15T17:30:41.317192] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:41.648829] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:30:42.057937] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-15T17:30:42.638950] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:30:42.766187] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:30:42.769240] [INFO ] [REMOTE ] BKV: Full fetch complete (33403 records). [2025-09-15T17:30:42.769358] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-15T17:30:42.866740] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-15T17:30:43.144105] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-15T17:30:43.144181] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-15T17:30:43.144655] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-15T17:30:43.144709] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-15T17:30:43.145587] [DEBUG] [LOCAL ] BKV: Trimmed 33403 records to 20925 (keeping 150 days of data) [2025-09-15T17:30:43.275342] [DEBUG] [LOCAL ] BKV: Primary data saved (20925 records). [2025-09-15T17:30:43.275481] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-15T17:30:43.275633] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKV took 31.7s. Estimated remaining: 3h 35m 36s. Rate: 9.6 symbols/min [2025-09-15T17:30:43.446818] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:43.459619] [DEBUG] [LOCAL ] BLE: Loaded 10534 existing records from primary storage. [2025-09-15T17:30:43.459774] [INFO ] [MAIN ] BLE: Loaded 10534 existing records. [2025-09-15T17:30:43.637848] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:43.638099] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-15T17:30:43.638147] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-15T17:30:43.638483] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-15T17:30:43.638530] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-15T17:30:43.670228] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-15T17:30:44.011664] [INFO ] [REMOTE ] BLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:44.278131] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:30:44.457852] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-15T17:30:44.733882] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:30:45.257917] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-15T17:30:45.285715] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:30:46.057918] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-15T17:30:46.810794] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:30:46.857858] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-15T17:30:47.288270] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:30:47.657945] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-15T17:30:48.433155] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T17:30:48.457843] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-15T17:30:48.546857] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T17:30:48.550763] [INFO ] [REMOTE ] BLCO: Full fetch complete (39980 records). [2025-09-15T17:30:48.550926] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-15T17:30:48.552869] [FATAL] [VALIDATOR ] BLCO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:30:48.552958] [FATAL] [MAIN ] BLCO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:30:48.553013] [WARN ] [MAIN ] BLCO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:30:48.553082] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-15T17:30:48.553163] [DEBUG] [LOCAL ] BLCO: No primary data file found to delete. [2025-09-15T17:30:48.553220] [INFO ] [LOCAL ] BLCO: Starting deletion of derivative data. [2025-09-15T17:30:48.553696] [DEBUG] [LOCAL ] BLCO: Deleted derivative data file. [2025-09-15T17:30:48.553837] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 22.5s. Estimated remaining: 3h 35m 23s. Rate: 9.6 symbols/min [2025-09-15T17:30:48.728000] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:48.753899] [DEBUG] [LOCAL ] BLK: Loaded 24978 existing records from primary storage. [2025-09-15T17:30:48.754041] [INFO ] [MAIN ] BLK: Loaded 24978 existing records. [2025-09-15T17:30:48.931042] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:48.931314] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-15T17:30:48.931362] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-15T17:30:48.932005] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-15T17:30:48.932054] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-15T17:30:49.261425] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-15T17:30:49.288154] [INFO ] [REMOTE ] BLK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:49.324177] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:30:49.327938] [INFO ] [REMOTE ] BLD: Full fetch complete (30845 records). [2025-09-15T17:30:49.328078] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-15T17:30:49.699940] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-15T17:30:49.700037] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-15T17:30:49.700491] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-15T17:30:49.700539] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-15T17:30:49.701538] [DEBUG] [LOCAL ] BLD: Trimmed 30845 records to 20372 (keeping 150 days of data) [2025-09-15T17:30:49.832566] [DEBUG] [LOCAL ] BLD: Primary data saved (20372 records). [2025-09-15T17:30:49.832732] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-15T17:30:49.832842] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 20.0s. Estimated remaining: 3h 34m 42s. Rate: 9.7 symbols/min [2025-09-15T17:30:50.020597] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:50.057994] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-15T17:30:50.059809] [DEBUG] [LOCAL ] BLND: Loaded 36755 existing records from primary storage. [2025-09-15T17:30:50.060045] [INFO ] [MAIN ] BLND: Loaded 36755 existing records. [2025-09-15T17:30:50.244346] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:50.244673] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-15T17:30:50.244855] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-15T17:30:50.250926] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-15T17:30:50.254734] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-15T17:30:50.299256] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:30:50.617268] [INFO ] [REMOTE ] BLND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:50.857869] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-15T17:30:51.659221] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-15T17:30:51.661717] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:30:52.459952] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-15T17:30:52.467766] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:30:52.469837] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T17:30:53.257877] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-15T17:30:54.057865] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-15T17:30:54.114101] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:30:54.776954] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:30:54.857829] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-15T17:30:55.657880] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-15T17:30:55.724761] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:30:56.111608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T17:30:56.457873] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-15T17:30:57.257871] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-15T17:30:57.447195] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T17:30:57.530820] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:30:57.901751] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:30:58.057875] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-15T17:30:58.857885] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-15T17:30:59.482600] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:30:59.657901] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-15T17:31:00.314273] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:31:00.457873] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-15T17:31:00.995246] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:31:01.257890] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-15T17:31:02.008426] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:31:02.057878] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-15T17:31:02.370814] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:31:02.857879] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-15T17:31:03.484037] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:31:03.657905] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-15T17:31:03.833402] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:31:04.457962] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-15T17:31:04.929141] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:31:04.934930] [INFO ] [REMOTE ] BLND: Full fetch complete (53945 records). [2025-09-15T17:31:04.935034] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-15T17:31:05.263003] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-15T17:31:05.359592] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-15T17:31:05.359692] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-15T17:31:05.360293] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-15T17:31:05.360335] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-15T17:31:05.362461] [DEBUG] [LOCAL ] BLND: Trimmed 53945 records to 36059 (keeping 150 days of data) [2025-09-15T17:31:05.574768] [DEBUG] [LOCAL ] BLND: Primary data saved (36059 records). [2025-09-15T17:31:05.574937] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-15T17:31:05.575051] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLND took 15.7s. Estimated remaining: 3h 35m 42s. Rate: 9.6 symbols/min [2025-09-15T17:31:05.746894] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:05.747086] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-15T17:31:05.747125] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-15T17:31:05.747257] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-15T17:31:05.747321] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-15T17:31:05.747366] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-15T17:31:05.747401] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-15T17:31:06.071997] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-15T17:31:06.097849] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:06.142853] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:31:06.857896] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-15T17:31:06.874450] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:31:07.027213] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:31:07.657897] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-15T17:31:08.388687] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T17:31:08.457934] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-15T17:31:09.164788] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:31:09.189044] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:31:09.257877] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-15T17:31:10.057926] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-15T17:31:10.348777] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:31:10.857841] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-15T17:31:11.081296] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T17:31:11.083204] [INFO ] [REMOTE ] BLE: Full fetch complete (15587 records). [2025-09-15T17:31:11.083275] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-15T17:31:11.447311] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-15T17:31:11.447418] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-15T17:31:11.447786] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-15T17:31:11.447835] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-15T17:31:11.448338] [DEBUG] [LOCAL ] BLE: Trimmed 15587 records to 10139 (keeping 150 days of data) [2025-09-15T17:31:11.510282] [DEBUG] [LOCAL ] BLE: Primary data saved (10139 records). [2025-09-15T17:31:11.510412] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-15T17:31:11.510496] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLE took 28.2s. Estimated remaining: 3h 35m 34s. Rate: 9.6 symbols/min [2025-09-15T17:31:11.678197] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-15T17:31:11.681418] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:11.692616] [DEBUG] [LOCAL ] BLW: Loaded 9026 existing records from primary storage. [2025-09-15T17:31:11.692742] [INFO ] [MAIN ] BLW: Loaded 9026 existing records. [2025-09-15T17:31:11.872763] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:11.872983] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-15T17:31:11.873028] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-15T17:31:11.873358] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-15T17:31:11.873405] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-15T17:31:11.910806] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:11.953974] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-15T17:31:12.231276] [INFO ] [REMOTE ] BLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:12.241528] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T17:31:12.245349] [INFO ] [REMOTE ] BLK: Full fetch complete (39180 records). [2025-09-15T17:31:12.245424] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-15T17:31:12.462983] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-15T17:31:12.619508] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-15T17:31:12.619592] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-15T17:31:12.620095] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-15T17:31:12.620138] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-15T17:31:12.621063] [DEBUG] [LOCAL ] BLK: Trimmed 39180 records to 24344 (keeping 150 days of data) [2025-09-15T17:31:12.787834] [DEBUG] [LOCAL ] BLK: Primary data saved (24344 records). [2025-09-15T17:31:12.787974] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-15T17:31:12.788071] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLK took 24.2s. Estimated remaining: 3h 34m 53s. Rate: 9.6 symbols/min [2025-09-15T17:31:12.832356] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:12.870151] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-15T17:31:12.963779] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:12.975418] [DEBUG] [LOCAL ] BLX: Loaded 11179 existing records from primary storage. [2025-09-15T17:31:12.975518] [INFO ] [MAIN ] BLX: Loaded 11179 existing records. [2025-09-15T17:31:13.152225] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:13.152520] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-15T17:31:13.152569] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-15T17:31:13.153006] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-15T17:31:13.153058] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-15T17:31:13.262940] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-15T17:31:13.515472] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:14.057884] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-15T17:31:14.160848] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T17:31:14.311759] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:14.312165] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-15T17:31:14.857909] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-15T17:31:15.413065] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:31:15.657876] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-15T17:31:16.457885] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-15T17:31:16.883865] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:31:17.258011] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-15T17:31:17.441832] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:17.442350] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-15T17:31:18.057889] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-15T17:31:18.132662] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:31:18.137926] [INFO ] [REMOTE ] BLDR: Full fetch complete (55720 records). [2025-09-15T17:31:18.138050] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-15T17:31:18.140345] [FATAL] [VALIDATOR ] BLDR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:18.140430] [FATAL] [MAIN ] BLDR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:18.140470] [WARN ] [MAIN ] BLDR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:18.140516] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-15T17:31:18.140577] [DEBUG] [LOCAL ] BLDR: No primary data file found to delete. [2025-09-15T17:31:18.140617] [INFO ] [LOCAL ] BLDR: Starting deletion of derivative data. [2025-09-15T17:31:18.140953] [DEBUG] [LOCAL ] BLDR: Deleted derivative data file. [2025-09-15T17:31:18.142429] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLDR took 37.6s. Estimated remaining: 3h 34m 41s. Rate: 9.6 symbols/min [2025-09-15T17:31:18.312349] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:18.346373] [DEBUG] [LOCAL ] BMA: Loaded 25819 existing records from primary storage. [2025-09-15T17:31:18.346520] [INFO ] [MAIN ] BMA: Loaded 25819 existing records. [2025-09-15T17:31:18.529560] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:18.529876] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-15T17:31:18.529925] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-15T17:31:18.530577] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-15T17:31:18.530633] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-15T17:31:18.862946] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-15T17:31:18.892041] [INFO ] [REMOTE ] BMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:18.939681] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:31:19.082827] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:19.083122] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-15T17:31:19.657871] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-15T17:31:20.457888] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-15T17:31:20.480771] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:31:21.257916] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-15T17:31:21.855389] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:31:22.034779] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:31:22.057852] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-15T17:31:22.857902] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-15T17:31:23.063968] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:31:23.407278] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T17:31:23.657851] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-15T17:31:24.258392] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:31:24.457875] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-15T17:31:25.257933] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-15T17:31:25.841854] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:31:26.057872] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-15T17:31:26.325660] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:31:26.857883] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-15T17:31:27.084919] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:31:27.621832] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:31:27.625451] [INFO ] [REMOTE ] BLW: Full fetch complete (14065 records). [2025-09-15T17:31:27.636453] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-15T17:31:27.664701] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-15T17:31:28.198251] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-15T17:31:28.198353] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-15T17:31:28.198765] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-15T17:31:28.198812] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-15T17:31:28.199614] [DEBUG] [LOCAL ] BLW: Trimmed 14065 records to 8953 (keeping 150 days of data) [2025-09-15T17:31:28.264830] [DEBUG] [LOCAL ] BLW: Primary data saved (8953 records). [2025-09-15T17:31:28.265008] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-15T17:31:28.265102] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLW took 16.8s. Estimated remaining: 3h 35m 1s. Rate: 9.6 symbols/min [2025-09-15T17:31:28.467447] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-15T17:31:28.471246] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:28.482047] [DEBUG] [LOCAL ] BME: Loaded 8191 existing records from primary storage. [2025-09-15T17:31:28.482192] [INFO ] [MAIN ] BME: Loaded 8191 existing records. [2025-09-15T17:31:28.675766] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:28.676057] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-15T17:31:28.676194] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-15T17:31:28.676657] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-15T17:31:28.681840] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-15T17:31:28.691090] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:28.760687] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:31:28.773037] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-15T17:31:29.084725] [INFO ] [REMOTE ] BME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:29.257914] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-15T17:31:30.057892] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-15T17:31:30.162388] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:31:30.802956] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:31:30.857824] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-15T17:31:31.582110] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:31:31.657919] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-15T17:31:32.457917] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-15T17:31:33.257859] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-15T17:31:33.287710] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:31:33.303516] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:31:34.057908] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-15T17:31:34.696596] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:31:34.844099] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:31:34.857870] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-15T17:31:35.627871] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:31:35.657877] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-15T17:31:36.457911] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-15T17:31:36.472614] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:31:37.257874] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-15T17:31:38.057880] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-15T17:31:38.220445] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:31:38.818437] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-15T17:31:38.824340] [INFO ] [REMOTE ] BLSH: Full fetch complete (8714 records). [2025-09-15T17:31:38.824440] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-15T17:31:38.862976] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-15T17:31:39.035859] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:31:39.043050] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 23 unique days, need 150 days [2025-09-15T17:31:39.043301] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:39.046296] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:39.046354] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-15T17:31:39.046435] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-15T17:31:39.046472] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-15T17:31:39.046512] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-15T17:31:39.046570] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLSH took 33.5s. Estimated remaining: 3h 35m 26s. Rate: 9.6 symbols/min [2025-09-15T17:31:39.233753] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:39.253884] [DEBUG] [LOCAL ] BMEZ: Loaded 18009 existing records from primary storage. [2025-09-15T17:31:39.254021] [INFO ] [MAIN ] BMEZ: Loaded 18009 existing records. [2025-09-15T17:31:39.430771] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:39.431016] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-15T17:31:39.431064] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-15T17:31:39.431681] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-15T17:31:39.431737] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-15T17:31:39.667977] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-15T17:31:39.813405] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:39.900103] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T17:31:40.399176] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:31:40.457843] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-15T17:31:41.160971] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:31:41.162741] [INFO ] [REMOTE ] BME: Full fetch complete (11334 records). [2025-09-15T17:31:41.162818] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-15T17:31:41.163282] [FATAL] [VALIDATOR ] BME: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:41.163366] [FATAL] [MAIN ] BME: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:41.163404] [WARN ] [MAIN ] BME: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:41.163445] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-15T17:31:41.163520] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-09-15T17:31:41.163559] [INFO ] [LOCAL ] BME: Starting deletion of derivative data. [2025-09-15T17:31:41.163889] [DEBUG] [LOCAL ] BME: Deleted derivative data file. [2025-09-15T17:31:41.163995] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BME took 12.9s. Estimated remaining: 3h 34m 52s. Rate: 9.6 symbols/min [2025-09-15T17:31:41.265077] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-15T17:31:41.345467] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:41.364322] [DEBUG] [LOCAL ] BMI: Loaded 17696 existing records from primary storage. [2025-09-15T17:31:41.364464] [INFO ] [MAIN ] BMI: Loaded 17696 existing records. [2025-09-15T17:31:41.562995] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:41.563340] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-15T17:31:41.563398] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-15T17:31:41.563950] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-15T17:31:41.564024] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-15T17:31:41.935614] [INFO ] [REMOTE ] BMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:42.057883] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-15T17:31:42.273462] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:31:42.857890] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-15T17:31:43.221211] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:31:43.657894] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-15T17:31:44.204546] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:31:44.457906] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-15T17:31:44.727497] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:31:45.257954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-15T17:31:45.623057] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:31:46.063001] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-15T17:31:46.073601] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:31:46.857895] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-15T17:31:47.089782] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:31:47.657907] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-15T17:31:48.205414] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:31:48.210364] [INFO ] [REMOTE ] BMA: Full fetch complete (37688 records). [2025-09-15T17:31:48.210455] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-15T17:31:48.464531] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-15T17:31:48.604546] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-15T17:31:48.604678] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-15T17:31:48.605267] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-15T17:31:48.605330] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-15T17:31:48.606700] [DEBUG] [LOCAL ] BMA: Trimmed 37688 records to 25268 (keeping 150 days of data) [2025-09-15T17:31:48.770703] [DEBUG] [LOCAL ] BMA: Primary data saved (25268 records). [2025-09-15T17:31:48.770854] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-15T17:31:48.770948] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BMA took 30.6s. Estimated remaining: 3h 34m 54s. Rate: 9.6 symbols/min [2025-09-15T17:31:48.959667] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:48.981336] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:31:48.980622] [DEBUG] [LOCAL ] BMN: Loaded 1921 existing records from primary storage. [2025-09-15T17:31:48.987701] [INFO ] [MAIN ] BMN: Loaded 1921 existing records. [2025-09-15T17:31:49.171574] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:49.172368] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-15T17:31:49.172415] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-15T17:31:49.172590] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-15T17:31:49.172634] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-15T17:31:49.263442] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-15T17:31:49.535351] [INFO ] [REMOTE ] BMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:49.570081] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:31:50.057838] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-15T17:31:50.227128] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:31:50.229067] [INFO ] [REMOTE ] BLX: Full fetch complete (16983 records). [2025-09-15T17:31:50.229139] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-15T17:31:50.229667] [FATAL] [VALIDATOR ] BLX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:50.229742] [FATAL] [MAIN ] BLX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:50.229780] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:50.229820] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-15T17:31:50.229914] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-15T17:31:50.229968] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-09-15T17:31:50.230324] [DEBUG] [LOCAL ] BLX: Deleted derivative data file. [2025-09-15T17:31:50.230439] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BLX took 37.4s. Estimated remaining: 3h 34m 16s. Rate: 9.6 symbols/min [2025-09-15T17:31:50.413420] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:50.445375] [DEBUG] [LOCAL ] BMO: Loaded 30336 existing records from primary storage. [2025-09-15T17:31:50.445539] [INFO ] [MAIN ] BMO: Loaded 30336 existing records. [2025-09-15T17:31:50.646327] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:50.646677] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-15T17:31:50.646733] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-15T17:31:50.647539] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-15T17:31:50.647598] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-15T17:31:50.859173] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-15T17:31:51.023251] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:31:51.096871] [INFO ] [REMOTE ] BMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:51.657888] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-15T17:31:51.923980] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:31:52.457870] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-15T17:31:52.958088] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:31:53.059844] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:31:53.257903] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-15T17:31:54.057844] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-15T17:31:54.378482] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:31:54.466817] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:31:54.857894] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-15T17:31:55.657885] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-15T17:31:55.884429] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:31:56.457880] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-15T17:31:56.926780] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:31:57.257900] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-15T17:31:57.569884] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:31:58.057892] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-15T17:31:58.079610] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:31:58.857875] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-15T17:31:59.614816] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:31:59.641629] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T17:31:59.646674] [INFO ] [REMOTE ] BMEZ: Full fetch complete (28461 records). [2025-09-15T17:31:59.646833] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-15T17:31:59.662973] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-15T17:32:00.085516] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-15T17:32:00.085860] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:32:00.086087] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-15T17:32:00.088517] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-15T17:32:00.088589] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-15T17:32:00.089804] [DEBUG] [LOCAL ] BMEZ: Trimmed 28461 records to 17633 (keeping 150 days of data) [2025-09-15T17:32:00.210170] [DEBUG] [LOCAL ] BMEZ: Primary data saved (17633 records). [2025-09-15T17:32:00.210340] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-15T17:32:00.210431] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMEZ took 21.2s. Estimated remaining: 3h 34m 35s. Rate: 9.6 symbols/min [2025-09-15T17:32:00.383397] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:00.426527] [DEBUG] [LOCAL ] BMY: Loaded 40497 existing records from primary storage. [2025-09-15T17:32:00.426700] [INFO ] [MAIN ] BMY: Loaded 40497 existing records. [2025-09-15T17:32:00.463042] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-15T17:32:00.608400] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:00.608681] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-15T17:32:00.608729] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-15T17:32:00.609940] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-15T17:32:00.609994] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-15T17:32:00.960602] [INFO ] [REMOTE ] BMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:01.257869] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-15T17:32:01.722296] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:32:02.057930] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-15T17:32:02.671185] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:32:02.857915] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-15T17:32:03.657866] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-15T17:32:03.890096] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:32:03.970948] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:32:03.974435] [INFO ] [REMOTE ] BMI: Full fetch complete (25221 records). [2025-09-15T17:32:03.974515] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-15T17:32:04.354697] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-15T17:32:04.354794] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-15T17:32:04.355242] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-15T17:32:04.355289] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-15T17:32:04.356093] [DEBUG] [LOCAL ] BMI: Trimmed 25221 records to 17207 (keeping 150 days of data) [2025-09-15T17:32:04.461850] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-15T17:32:04.473088] [DEBUG] [LOCAL ] BMI: Primary data saved (17207 records). [2025-09-15T17:32:04.473261] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-15T17:32:04.473372] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 23.3s. Estimated remaining: 3h 34m 15s. Rate: 9.6 symbols/min [2025-09-15T17:32:04.648122] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:04.689081] [DEBUG] [LOCAL ] BN: Loaded 39788 existing records from primary storage. [2025-09-15T17:32:04.689242] [INFO ] [MAIN ] BN: Loaded 39788 existing records. [2025-09-15T17:32:04.863281] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:04.863540] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-15T17:32:04.863586] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-15T17:32:04.864451] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-15T17:32:04.864515] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-15T17:32:05.100871] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:32:05.235951] [INFO ] [REMOTE ] BN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:05.257988] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:32:05.258075] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-15T17:32:06.057897] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-15T17:32:06.385387] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T17:32:06.857895] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-15T17:32:06.951893] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:32:07.658141] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-15T17:32:08.188544] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T17:32:08.457909] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-15T17:32:08.725226] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T17:32:09.257896] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-15T17:32:10.018028] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:32:10.057911] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-15T17:32:10.706393] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:32:10.857896] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-15T17:32:11.657869] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-15T17:32:11.709633] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:32:12.046103] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T17:32:12.457920] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-15T17:32:12.840269] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:32:13.257889] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-15T17:32:13.879469] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:32:14.057892] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-15T17:32:14.456026] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T17:32:14.457001] [INFO ] [REMOTE ] BMN: Full fetch complete (2755 records). [2025-09-15T17:32:14.457080] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-15T17:32:14.457476] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:14.457564] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:14.457616] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:14.457693] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-15T17:32:14.457756] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-15T17:32:14.457802] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-09-15T17:32:14.458064] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-09-15T17:32:14.458163] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 25.7s. Estimated remaining: 3h 34m 34s. Rate: 9.6 symbols/min [2025-09-15T17:32:14.627235] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:14.648275] [DEBUG] [LOCAL ] BNED: Loaded 22113 existing records from primary storage. [2025-09-15T17:32:14.648416] [INFO ] [MAIN ] BNED: Loaded 22113 existing records. [2025-09-15T17:32:14.824279] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:14.824518] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-15T17:32:14.824564] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-15T17:32:14.825489] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-15T17:32:14.825544] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-15T17:32:14.867353] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-15T17:32:15.184868] [INFO ] [REMOTE ] BNED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:15.284071] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:32:15.657923] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-15T17:32:16.457892] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-15T17:32:16.661553] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T17:32:16.858456] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:32:17.257885] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-15T17:32:17.664443] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:32:17.669003] [INFO ] [REMOTE ] BMO: Full fetch complete (44638 records). [2025-09-15T17:32:17.669158] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-15T17:32:17.669869] [FATAL] [VALIDATOR ] BMO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:17.669954] [FATAL] [MAIN ] BMO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:17.669992] [WARN ] [MAIN ] BMO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:17.670034] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-15T17:32:17.670097] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-15T17:32:17.670135] [INFO ] [LOCAL ] BMO: Starting deletion of derivative data. [2025-09-15T17:32:17.670376] [DEBUG] [LOCAL ] BMO: Deleted derivative data file. [2025-09-15T17:32:17.670492] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 27.4s. Estimated remaining: 3h 34m 8s. Rate: 9.6 symbols/min [2025-09-15T17:32:17.841411] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:17.846298] [DEBUG] [LOCAL ] BNH: Loaded 3202 existing records from primary storage. [2025-09-15T17:32:17.846375] [INFO ] [MAIN ] BNH: Loaded 3202 existing records. [2025-09-15T17:32:18.025944] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:18.026225] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-15T17:32:18.026275] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-15T17:32:18.026496] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-15T17:32:18.026548] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-15T17:32:18.062952] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-15T17:32:18.395868] [INFO ] [REMOTE ] BNH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:18.857924] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-15T17:32:18.956217] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:32:19.314137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:32:19.657910] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-15T17:32:20.080538] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:32:20.205815] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:32:20.457879] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-15T17:32:21.257896] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-15T17:32:22.027196] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:32:22.057817] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-15T17:32:22.233587] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:32:22.857879] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-15T17:32:23.657927] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-15T17:32:23.915859] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:32:24.221723] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:32:24.457855] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-15T17:32:24.818248] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:32:25.206536] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:32:25.212424] [INFO ] [REMOTE ] BMY: Full fetch complete (58437 records). [2025-09-15T17:32:25.212532] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-15T17:32:25.263038] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-15T17:32:25.601607] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-15T17:32:25.601709] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-15T17:32:25.602356] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-15T17:32:25.602657] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-15T17:32:25.603887] [DEBUG] [LOCAL ] BMY: Trimmed 58437 records to 39717 (keeping 150 days of data) [2025-09-15T17:32:25.854003] [DEBUG] [LOCAL ] BMY: Primary data saved (39717 records). [2025-09-15T17:32:25.854161] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-15T17:32:25.855544] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 25.6s. Estimated remaining: 3h 34m 14s. Rate: 9.6 symbols/min [2025-09-15T17:32:26.056764] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:26.057910] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-15T17:32:26.062928] [DEBUG] [LOCAL ] BNJ: Loaded 1751 existing records from primary storage. [2025-09-15T17:32:26.063171] [INFO ] [MAIN ] BNJ: Loaded 1751 existing records. [2025-09-15T17:32:26.246089] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:26.246372] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-15T17:32:26.246428] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-15T17:32:26.246690] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-15T17:32:26.246753] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-15T17:32:26.597192] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:26.865836] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-15T17:32:26.871812] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:32:27.308358] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:32:27.395053] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:32:27.657877] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-15T17:32:28.457900] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-15T17:32:28.826558] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:32:28.924058] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:32:29.257890] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-15T17:32:30.057864] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-15T17:32:30.129323] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:32:30.857885] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-15T17:32:31.367734] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T17:32:31.657916] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-15T17:32:31.712208] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T17:32:31.718304] [INFO ] [REMOTE ] BN: Full fetch complete (57630 records). [2025-09-15T17:32:31.718449] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-15T17:32:31.981477] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:32:32.139226] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-15T17:32:32.139308] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-15T17:32:32.139985] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-15T17:32:32.140030] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-15T17:32:32.141222] [DEBUG] [LOCAL ] BN: Trimmed 57630 records to 39006 (keeping 150 days of data) [2025-09-15T17:32:32.388680] [DEBUG] [LOCAL ] BN: Primary data saved (39006 records). [2025-09-15T17:32:32.388844] [INFO ] [MAIN ] BN: Full history saved. [2025-09-15T17:32:32.389285] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BN took 27.9s. Estimated remaining: 3h 34m 10s. Rate: 9.6 symbols/min [2025-09-15T17:32:32.463020] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-15T17:32:32.565428] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:32.603783] [DEBUG] [LOCAL ] BNL: Loaded 35098 existing records from primary storage. [2025-09-15T17:32:32.603934] [INFO ] [MAIN ] BNL: Loaded 35098 existing records. [2025-09-15T17:32:32.784485] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:32.784841] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-15T17:32:32.784904] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-15T17:32:32.785757] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-15T17:32:32.785820] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-15T17:32:32.949107] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:32:33.145721] [INFO ] [REMOTE ] BNL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:33.257857] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-15T17:32:33.608102] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T17:32:34.057936] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-15T17:32:34.857833] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-15T17:32:35.166216] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:32:35.169623] [INFO ] [REMOTE ] BNED: Full fetch complete (32465 records). [2025-09-15T17:32:35.169729] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-15T17:32:35.464924] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:32:35.552267] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-15T17:32:35.552425] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-15T17:32:35.553045] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-15T17:32:35.553140] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-15T17:32:35.554184] [DEBUG] [LOCAL ] BNED: Trimmed 32465 records to 21697 (keeping 150 days of data) [2025-09-15T17:32:35.657905] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-15T17:32:35.688134] [DEBUG] [LOCAL ] BNED: Primary data saved (21697 records). [2025-09-15T17:32:35.688262] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-15T17:32:35.688344] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BNED took 21.2s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-15T17:32:35.862225] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:35.901100] [DEBUG] [LOCAL ] BNS: Loaded 38577 existing records from primary storage. [2025-09-15T17:32:35.901297] [INFO ] [MAIN ] BNS: Loaded 38577 existing records. [2025-09-15T17:32:36.077483] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:36.077774] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-15T17:32:36.077821] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-15T17:32:36.078554] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-15T17:32:36.078602] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-15T17:32:36.432819] [INFO ] [REMOTE ] BNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:36.457849] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-15T17:32:36.689400] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T17:32:37.257882] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-15T17:32:38.057907] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-15T17:32:38.147371] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:32:38.834345] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:32:38.859710] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-15T17:32:38.864568] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:32:39.657918] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-15T17:32:40.117583] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T17:32:40.457954] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-15T17:32:40.641267] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:32:41.257959] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-15T17:32:41.727417] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:32:41.728406] [INFO ] [REMOTE ] BNJ: Full fetch complete (2890 records). [2025-09-15T17:32:41.728474] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-15T17:32:42.066401] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-15T17:32:42.099183] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-15T17:32:42.099410] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-15T17:32:42.099616] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-15T17:32:42.099933] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-15T17:32:42.100629] [DEBUG] [LOCAL ] BNJ: Trimmed 2890 records to 1727 (keeping 150 days of data) [2025-09-15T17:32:42.137526] [DEBUG] [LOCAL ] BNJ: Primary data saved (1727 records). [2025-09-15T17:32:42.140484] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-15T17:32:42.140736] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNJ took 16.3s. Estimated remaining: 3h 33m 40s. Rate: 9.6 symbols/min [2025-09-15T17:32:42.188583] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T17:32:42.336001] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:42.339990] [DEBUG] [LOCAL ] BNT: Loaded 2113 existing records from primary storage. [2025-09-15T17:32:42.340079] [INFO ] [MAIN ] BNT: Loaded 2113 existing records. [2025-09-15T17:32:42.545845] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:42.546094] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-15T17:32:42.546140] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-15T17:32:42.546352] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-15T17:32:42.546405] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-15T17:32:42.838931] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:32:42.861490] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-15T17:32:42.929521] [INFO ] [REMOTE ] BNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:43.657887] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-15T17:32:44.087580] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T17:32:44.457888] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-15T17:32:44.519750] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:32:44.988286] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T17:32:45.257888] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-15T17:32:46.057874] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-15T17:32:46.862916] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-15T17:32:46.882905] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:32:46.896457] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:32:47.265022] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:32:47.657880] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-15T17:32:48.159104] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:32:48.457894] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-15T17:32:48.803993] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:32:49.257876] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-15T17:32:49.604451] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T17:32:50.057930] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-15T17:32:50.857877] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-15T17:32:51.384072] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T17:32:51.657870] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-15T17:32:51.794697] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:32:52.252905] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T17:32:52.253922] [INFO ] [REMOTE ] BNH: Full fetch complete (5125 records). [2025-09-15T17:32:52.254075] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-15T17:32:52.254456] [FATAL] [VALIDATOR ] BNH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:52.254537] [FATAL] [MAIN ] BNH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:52.254604] [WARN ] [MAIN ] BNH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:52.254684] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-15T17:32:52.254784] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-09-15T17:32:52.254839] [INFO ] [LOCAL ] BNH: Starting deletion of derivative data. [2025-09-15T17:32:52.255194] [DEBUG] [LOCAL ] BNH: Deleted derivative data file. [2025-09-15T17:32:52.255307] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNH took 34.6s. Estimated remaining: 3h 33m 59s. Rate: 9.6 symbols/min [2025-09-15T17:32:52.428626] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:52.435184] [DEBUG] [LOCAL ] BNY: Loaded 5302 existing records from primary storage. [2025-09-15T17:32:52.435296] [INFO ] [MAIN ] BNY: Loaded 5302 existing records. [2025-09-15T17:32:52.464375] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-15T17:32:52.621269] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:52.621521] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-15T17:32:52.621568] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-15T17:32:52.621879] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-15T17:32:52.621930] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-15T17:32:52.980833] [INFO ] [REMOTE ] BNY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:53.257870] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-15T17:32:53.959938] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:32:54.057844] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-15T17:32:54.660031] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:32:54.857901] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-15T17:32:55.357003] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:32:55.657908] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-15T17:32:55.701473] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:32:56.457845] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-15T17:32:56.511259] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:32:57.257886] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-15T17:32:57.592662] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:32:58.057876] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-15T17:32:58.427289] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:32:58.453062] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T17:32:58.857913] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-15T17:32:59.657873] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-15T17:33:00.356250] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:33:00.362253] [INFO ] [REMOTE ] BNS: Full fetch complete (55934 records). [2025-09-15T17:33:00.362422] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-15T17:33:00.462985] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-15T17:33:00.761129] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-15T17:33:00.761211] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-15T17:33:00.761868] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-15T17:33:00.761922] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-15T17:33:00.763419] [DEBUG] [LOCAL ] BNS: Trimmed 55934 records to 37795 (keeping 150 days of data) [2025-09-15T17:33:01.019945] [DEBUG] [LOCAL ] BNS: Primary data saved (37795 records). [2025-09-15T17:33:01.020123] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-15T17:33:01.021220] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNS took 25.3s. Estimated remaining: 3h 34m 9s. Rate: 9.6 symbols/min [2025-09-15T17:33:01.156131] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:33:01.211600] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:01.231446] [DEBUG] [LOCAL ] BOC: Loaded 13587 existing records from primary storage. [2025-09-15T17:33:01.231608] [INFO ] [MAIN ] BOC: Loaded 13587 existing records. [2025-09-15T17:33:01.263063] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-15T17:33:01.424135] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:33:01.455409] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:01.455815] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-15T17:33:01.456246] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-15T17:33:01.456685] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-15T17:33:01.456739] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-15T17:33:01.856408] [INFO ] [REMOTE ] BOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:02.057929] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-15T17:33:02.857887] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-15T17:33:02.895146] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:33:03.657881] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-15T17:33:03.884524] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:33:04.457877] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-15T17:33:04.487663] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:33:04.799770] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T17:33:04.804948] [INFO ] [REMOTE ] BNL: Full fetch complete (50771 records). [2025-09-15T17:33:04.805067] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-15T17:33:05.103325] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T17:33:05.125357] [INFO ] [REMOTE ] BNT: Full fetch complete (3483 records). [2025-09-15T17:33:05.148219] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-15T17:33:05.271209] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-15T17:33:05.284272] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-15T17:33:05.300439] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-15T17:33:05.301251] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-15T17:33:05.305155] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-15T17:33:05.368859] [DEBUG] [LOCAL ] BNL: Trimmed 50771 records to 34424 (keeping 150 days of data) [2025-09-15T17:33:05.677600] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-15T17:33:05.678224] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-15T17:33:05.678605] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-15T17:33:05.678962] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-15T17:33:05.681881] [DEBUG] [LOCAL ] BNT: Trimmed 3483 records to 2060 (keeping 150 days of data) [2025-09-15T17:33:05.704736] [DEBUG] [LOCAL ] BNT: Primary data saved (2060 records). [2025-09-15T17:33:05.705186] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-15T17:33:05.705545] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNT took 23.6s. Estimated remaining: 3h 33m 52s. Rate: 9.6 symbols/min [2025-09-15T17:33:05.809139] [DEBUG] [LOCAL ] BNL: Primary data saved (34424 records). [2025-09-15T17:33:05.809298] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-15T17:33:05.809561] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNL took 33.4s. Estimated remaining: 3h 33m 6s. Rate: 9.6 symbols/min [2025-09-15T17:33:06.057863] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-15T17:33:06.234301] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:33:06.858017] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-15T17:33:06.998388] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:33:07.528766] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T17:33:07.657933] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-15T17:33:08.457974] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-15T17:33:08.702998] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:33:09.183416] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:33:09.257818] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-15T17:33:09.973824] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:33:09.975310] [INFO ] [REMOTE ] BNY: Full fetch complete (7738 records). [2025-09-15T17:33:09.975382] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-15T17:33:10.066315] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-15T17:33:10.360393] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-15T17:33:10.360512] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-15T17:33:10.360836] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-15T17:33:10.360885] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-15T17:33:10.361550] [DEBUG] [LOCAL ] BNY: Trimmed 7738 records to 5301 (keeping 150 days of data) [2025-09-15T17:33:10.396072] [DEBUG] [LOCAL ] BNY: Primary data saved (5301 records). [2025-09-15T17:33:10.396220] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-15T17:33:10.396306] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 18.1s. Estimated remaining: 3h 32m 50s. Rate: 9.6 symbols/min [2025-09-15T17:33:11.007271] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:33:11.011203] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-15T17:33:11.908412] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:33:11.912443] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-15T17:33:13.408231] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:33:13.412939] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-15T17:33:14.451190] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T17:33:14.456616] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-15T17:33:15.141217] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:33:15.143465] [INFO ] [REMOTE ] BOC: Full fetch complete (19522 records). [2025-09-15T17:33:15.143537] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-15T17:33:15.144013] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:33:15.144086] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:33:15.144133] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:33:15.144183] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-15T17:33:15.144242] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-15T17:33:15.144278] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-09-15T17:33:15.144541] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-09-15T17:33:15.144660] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 14.1s. Estimated remaining: 3h 32m 34s. Rate: 9.6 symbols/min [2025-09-15T17:33:15.678101] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.835018] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.860088] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.892151] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.909670] [DEBUG] [LOCAL ] BOE: Loaded 12245 existing records from primary storage. [2025-09-15T17:33:15.909839] [INFO ] [MAIN ] BOE: Loaded 12245 existing records. [2025-09-15T17:33:16.053894] [DEBUG] [LOCAL ] BOOT: Loaded 30125 existing records from primary storage. [2025-09-15T17:33:16.093826] [INFO ] [MAIN ] BOOT: Loaded 30125 existing records. [2025-09-15T17:33:16.059752] [DEBUG] [LOCAL ] BOND: Loaded 23942 existing records from primary storage. [2025-09-15T17:33:16.108683] [DEBUG] [LOCAL ] BOH: Loaded 22443 existing records from primary storage. [2025-09-15T17:33:16.121796] [INFO ] [MAIN ] BOND: Loaded 23942 existing records. [2025-09-15T17:33:16.155478] [INFO ] [MAIN ] BOH: Loaded 22443 existing records. [2025-09-15T17:33:16.205595] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.370900] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.404966] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-15T17:33:16.470440] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-15T17:33:16.482868] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-15T17:33:16.538375] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.652410] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.697233] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.744910] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-15T17:33:16.769223] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.768854] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.779741] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-15T17:33:16.790145] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-15T17:33:16.790247] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-15T17:33:16.784949] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-15T17:33:16.815807] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-15T17:33:16.859255] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.892538] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-15T17:33:17.001960] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-15T17:33:17.026349] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-15T17:33:17.411908] [INFO ] [REMOTE ] BOE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:17.486134] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-15T17:33:17.873801] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:17.900565] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-15T17:33:18.043953] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:18.081374] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-15T17:33:18.168200] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:18.168492] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-15T17:33:18.577491] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:33:18.581512] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-15T17:33:19.230885] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:33:19.236908] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-15T17:33:19.315280] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:33:19.321796] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-15T17:33:19.334360] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T17:33:19.657888] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-15T17:33:19.760878] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:33:20.136338] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:33:20.349671] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:33:20.457830] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-15T17:33:20.686998] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:33:21.039207] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:33:21.257882] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-15T17:33:22.057907] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-15T17:33:22.326279] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:33:22.857894] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-15T17:33:22.966016] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:33:23.657889] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-15T17:33:23.855411] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:33:24.457880] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-15T17:33:24.587719] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:33:25.257888] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-15T17:33:25.962713] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:33:26.057866] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-15T17:33:26.581332] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:33:26.857888] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-15T17:33:27.478634] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:33:27.657832] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-15T17:33:27.838896] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:33:28.457906] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-15T17:33:29.203395] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:33:29.257824] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-15T17:33:29.736803] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:33:30.057958] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-15T17:33:30.865669] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-15T17:33:30.870550] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:33:31.083502] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T17:33:31.657915] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-15T17:33:31.776600] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:33:31.780902] [INFO ] [REMOTE ] BOND: Full fetch complete (34732 records). [2025-09-15T17:33:31.780999] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-15T17:33:32.162850] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-15T17:33:32.162941] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-15T17:33:32.163401] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-15T17:33:32.163443] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-15T17:33:32.164423] [DEBUG] [LOCAL ] BOND: Trimmed 34732 records to 23537 (keeping 150 days of data) [2025-09-15T17:33:32.318916] [DEBUG] [LOCAL ] BOND: Primary data saved (23537 records). [2025-09-15T17:33:32.319056] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-15T17:33:32.319144] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOND took 17.2s. Estimated remaining: 3h 33m 37s. Rate: 9.6 symbols/min [2025-09-15T17:33:32.466431] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-15T17:33:32.489835] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:32.528474] [DEBUG] [LOCAL ] BORR: Loaded 38458 existing records from primary storage. [2025-09-15T17:33:32.528603] [INFO ] [MAIN ] BORR: Loaded 38458 existing records. [2025-09-15T17:33:32.702721] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:32.702989] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-15T17:33:32.703037] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-15T17:33:32.703923] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-15T17:33:32.703978] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-15T17:33:33.092727] [INFO ] [REMOTE ] BORR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:33.113341] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:33:33.257922] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-15T17:33:33.482320] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:33:34.006800] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:33:34.057920] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-15T17:33:34.857886] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-15T17:33:35.093611] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:33:35.657902] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-15T17:33:36.306095] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T17:33:36.308830] [INFO ] [REMOTE ] BOE: Full fetch complete (18998 records). [2025-09-15T17:33:36.308914] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-15T17:33:36.464363] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-15T17:33:36.673737] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-15T17:33:36.673903] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-15T17:33:36.674298] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-15T17:33:36.674360] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-15T17:33:36.675019] [DEBUG] [LOCAL ] BOE: Trimmed 18998 records to 11861 (keeping 150 days of data) [2025-09-15T17:33:36.761956] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T17:33:36.795413] [DEBUG] [LOCAL ] BOE: Primary data saved (11861 records). [2025-09-15T17:33:36.795559] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-15T17:33:36.795693] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOE took 21.7s. Estimated remaining: 3h 33m 20s. Rate: 9.6 symbols/min [2025-09-15T17:33:36.965765] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:36.982629] [DEBUG] [LOCAL ] BOW: Loaded 16592 existing records from primary storage. [2025-09-15T17:33:36.982777] [INFO ] [MAIN ] BOW: Loaded 16592 existing records. [2025-09-15T17:33:37.156834] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:37.157057] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-15T17:33:37.157102] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-15T17:33:37.157564] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-15T17:33:37.157612] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-15T17:33:37.258842] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-15T17:33:37.518173] [INFO ] [REMOTE ] BOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:37.698949] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:33:38.057884] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-15T17:33:38.662864] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:33:38.857886] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-15T17:33:38.966816] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:33:39.657897] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-15T17:33:40.260412] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:33:40.457904] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-15T17:33:40.720678] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:33:40.724188] [INFO ] [REMOTE ] BOH: Full fetch complete (33807 records). [2025-09-15T17:33:40.724268] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-15T17:33:41.089257] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-15T17:33:41.089340] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-15T17:33:41.089912] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-15T17:33:41.089984] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-15T17:33:41.090834] [DEBUG] [LOCAL ] BOH: Trimmed 33807 records to 21842 (keeping 150 days of data) [2025-09-15T17:33:41.233794] [DEBUG] [LOCAL ] BOH: Primary data saved (21842 records). [2025-09-15T17:33:41.233934] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-15T17:33:41.234358] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOH took 26.1s. Estimated remaining: 3h 33m 2s. Rate: 9.6 symbols/min [2025-09-15T17:33:41.265952] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-15T17:33:41.405685] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:41.442299] [DEBUG] [LOCAL ] BOX: Loaded 37722 existing records from primary storage. [2025-09-15T17:33:41.442457] [INFO ] [MAIN ] BOX: Loaded 37722 existing records. [2025-09-15T17:33:41.632447] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:41.632716] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-15T17:33:41.632766] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-15T17:33:41.633826] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-15T17:33:41.633878] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-15T17:33:42.000666] [INFO ] [REMOTE ] BOX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:42.035000] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:33:42.057818] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-15T17:33:42.561836] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:33:42.857872] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-15T17:33:43.264763] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:33:43.657942] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-15T17:33:44.032424] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:33:44.413391] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:33:44.457880] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-15T17:33:45.257874] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-15T17:33:45.433050] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T17:33:46.057876] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-15T17:33:46.429317] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:33:46.857878] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-15T17:33:47.093742] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:33:47.098018] [INFO ] [REMOTE ] BOOT: Full fetch complete (45523 records). [2025-09-15T17:33:47.098164] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-15T17:33:47.507543] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-15T17:33:47.507654] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-15T17:33:47.508233] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-15T17:33:47.508276] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-15T17:33:47.509479] [DEBUG] [LOCAL ] BOOT: Trimmed 45523 records to 29291 (keeping 150 days of data) [2025-09-15T17:33:47.662690] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-15T17:33:47.692851] [DEBUG] [LOCAL ] BOOT: Primary data saved (29291 records). [2025-09-15T17:33:47.692994] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-15T17:33:47.693100] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOOT took 32.5s. Estimated remaining: 3h 32m 57s. Rate: 9.6 symbols/min [2025-09-15T17:33:47.873326] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:47.917846] [DEBUG] [LOCAL ] BP: Loaded 40451 existing records from primary storage. [2025-09-15T17:33:47.918011] [INFO ] [MAIN ] BP: Loaded 40451 existing records. [2025-09-15T17:33:48.103324] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:48.103596] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-15T17:33:48.103677] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-15T17:33:48.104555] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-15T17:33:48.104630] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-15T17:33:48.457310] [INFO ] [REMOTE ] BP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:48.457819] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-15T17:33:48.588457] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T17:33:48.612371] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:33:49.257877] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-15T17:33:50.057849] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-15T17:33:50.138382] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:33:50.747458] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:33:50.821923] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T17:33:50.857868] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-15T17:33:51.657889] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-15T17:33:52.441923] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:33:52.457809] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-15T17:33:53.257891] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-15T17:33:53.575494] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:33:53.666052] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:33:54.057881] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-15T17:33:54.379619] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:33:54.857881] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-15T17:33:55.662965] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-15T17:33:55.679367] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:33:55.863812] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:33:55.867019] [INFO ] [REMOTE ] BOW: Full fetch complete (24987 records). [2025-09-15T17:33:55.867100] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-15T17:33:56.238089] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-15T17:33:56.238191] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-15T17:33:56.238597] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-15T17:33:56.238655] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-15T17:33:56.239296] [DEBUG] [LOCAL ] BOW: Trimmed 24987 records to 16164 (keeping 150 days of data) [2025-09-15T17:33:56.339702] [DEBUG] [LOCAL ] BOW: Primary data saved (16164 records). [2025-09-15T17:33:56.339857] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-15T17:33:56.339959] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BOW took 19.5s. Estimated remaining: 3h 33m 6s. Rate: 9.6 symbols/min [2025-09-15T17:33:56.462951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-15T17:33:56.514639] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:56.541274] [DEBUG] [LOCAL ] BR: Loaded 25468 existing records from primary storage. [2025-09-15T17:33:56.541420] [INFO ] [MAIN ] BR: Loaded 25468 existing records. [2025-09-15T17:33:56.719203] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:56.719439] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-15T17:33:56.719485] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-15T17:33:56.720279] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-15T17:33:56.720332] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-15T17:33:57.071845] [INFO ] [REMOTE ] BR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:57.263056] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-15T17:33:57.283571] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:33:58.065136] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-15T17:33:58.085107] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:33:58.857888] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-15T17:33:58.889208] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:33:59.639771] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:33:59.657816] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-15T17:34:00.457898] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-15T17:34:00.490558] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T17:34:01.257899] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-15T17:34:01.445448] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T17:34:01.619593] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:34:02.057938] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-15T17:34:02.857876] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-15T17:34:02.932815] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:34:03.212754] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:34:03.218800] [INFO ] [REMOTE ] BORR: Full fetch complete (55804 records). [2025-09-15T17:34:03.218965] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-15T17:34:03.612171] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-15T17:34:03.612292] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-15T17:34:03.613138] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-15T17:34:03.613193] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-15T17:34:03.614699] [DEBUG] [LOCAL ] BORR: Trimmed 55804 records to 37699 (keeping 150 days of data) [2025-09-15T17:34:03.664365] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-15T17:34:03.849169] [DEBUG] [LOCAL ] BORR: Primary data saved (37699 records). [2025-09-15T17:34:03.849439] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-15T17:34:03.850811] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BORR took 31.5s. Estimated remaining: 3h 33m 8s. Rate: 9.6 symbols/min [2025-09-15T17:34:04.025509] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:04.064419] [DEBUG] [LOCAL ] BRBR: Loaded 39015 existing records from primary storage. [2025-09-15T17:34:04.064782] [INFO ] [MAIN ] BRBR: Loaded 39015 existing records. [2025-09-15T17:34:04.240833] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:04.241242] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-15T17:34:04.241350] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-15T17:34:04.242524] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-15T17:34:04.242578] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-15T17:34:04.475317] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-15T17:34:04.498118] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:34:04.629097] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:05.170121] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T17:34:05.176168] [INFO ] [REMOTE ] BOX: Full fetch complete (54517 records). [2025-09-15T17:34:05.176274] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-15T17:34:05.266697] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-15T17:34:05.559136] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-15T17:34:05.559254] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-15T17:34:05.560045] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-15T17:34:05.560126] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-15T17:34:05.561727] [DEBUG] [LOCAL ] BOX: Trimmed 54517 records to 37029 (keeping 150 days of data) [2025-09-15T17:34:05.792778] [DEBUG] [LOCAL ] BOX: Primary data saved (37029 records). [2025-09-15T17:34:05.792969] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-15T17:34:05.793577] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOX took 24.6s. Estimated remaining: 3h 32m 34s. Rate: 9.6 symbols/min [2025-09-15T17:34:05.961469] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:05.977299] [DEBUG] [LOCAL ] BRC: Loaded 13569 existing records from primary storage. [2025-09-15T17:34:05.977450] [INFO ] [MAIN ] BRC: Loaded 13569 existing records. [2025-09-15T17:34:06.067763] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-15T17:34:06.156268] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:06.156663] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-15T17:34:06.156721] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-15T17:34:06.157287] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-15T17:34:06.157342] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-15T17:34:06.552332] [INFO ] [REMOTE ] BRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:06.556853] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T17:34:06.614514] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:34:06.857943] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-15T17:34:07.616838] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:34:07.657897] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-15T17:34:08.017301] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:34:08.457872] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-15T17:34:08.850382] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:34:09.257879] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-15T17:34:09.794343] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:34:10.057882] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-15T17:34:10.745496] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:34:10.857867] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-15T17:34:11.381927] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:34:11.657884] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-15T17:34:12.232093] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:34:12.457882] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-15T17:34:13.257906] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-15T17:34:13.697710] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T17:34:13.767036] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:34:14.057816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-15T17:34:14.375419] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:34:14.857900] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-15T17:34:15.577830] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:34:15.657825] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-15T17:34:15.852221] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:34:16.457876] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-15T17:34:16.940912] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:34:17.257933] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-15T17:34:17.860949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:34:18.057916] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-15T17:34:18.857895] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-15T17:34:18.992229] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:34:18.998221] [INFO ] [REMOTE ] BP: Full fetch complete (58390 records). [2025-09-15T17:34:18.998327] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-15T17:34:19.350842] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:34:19.408171] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-15T17:34:19.407951] [INFO ] [REMOTE ] BR: Full fetch complete (37225 records). [2025-09-15T17:34:19.408367] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-15T17:34:19.408508] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-15T17:34:19.409308] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-15T17:34:19.409681] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-15T17:34:19.517051] [DEBUG] [LOCAL ] BP: Trimmed 58390 records to 39671 (keeping 150 days of data) [2025-09-15T17:34:19.658825] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-15T17:34:19.905067] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-15T17:34:19.906985] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-15T17:34:19.908432] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-15T17:34:19.908718] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-15T17:34:19.912922] [DEBUG] [LOCAL ] BR: Trimmed 37225 records to 25002 (keeping 150 days of data) [2025-09-15T17:34:20.212908] [DEBUG] [LOCAL ] BR: Primary data saved (25002 records). [2025-09-15T17:34:20.213753] [INFO ] [MAIN ] BR: Full history saved. [2025-09-15T17:34:20.214352] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BR took 23.9s. Estimated remaining: 3h 33m 19s. Rate: 9.6 symbols/min [2025-09-15T17:34:20.322061] [DEBUG] [LOCAL ] BP: Primary data saved (39671 records). [2025-09-15T17:34:20.322219] [INFO ] [MAIN ] BP: Full history saved. [2025-09-15T17:34:20.322886] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BP took 32.6s. Estimated remaining: 3h 32m 35s. Rate: 9.6 symbols/min [2025-09-15T17:34:20.467244] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:20.566550] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:20.597425] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T17:34:20.610941] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T17:34:20.616766] [INFO ] [REMOTE ] BRBR: Full fetch complete (55072 records). [2025-09-15T17:34:20.616993] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-15T17:34:20.617289] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-15T17:34:20.713504] [DEBUG] [LOCAL ] BRCC: Loaded 30415 existing records from primary storage. [2025-09-15T17:34:20.729788] [INFO ] [MAIN ] BRCC: Loaded 30415 existing records. [2025-09-15T17:34:20.821429] [DEBUG] [LOCAL ] BRFS: Loaded 30661 existing records from primary storage. [2025-09-15T17:34:20.848632] [INFO ] [MAIN ] BRFS: Loaded 30661 existing records. [2025-09-15T17:34:21.233831] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:21.253125] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-15T17:34:21.263516] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-15T17:34:21.309062] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-15T17:34:21.361483] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:21.366693] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-15T17:34:21.444704] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-15T17:34:21.473257] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-15T17:34:21.473193] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-15T17:34:21.505070] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-15T17:34:21.517117] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-15T17:34:21.522346] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-15T17:34:21.527555] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-15T17:34:21.527622] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-15T17:34:21.720172] [DEBUG] [LOCAL ] BRBR: Trimmed 55072 records to 38487 (keeping 150 days of data) [2025-09-15T17:34:22.225740] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:22.257140] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-15T17:34:22.300095] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:22.302712] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-15T17:34:22.309714] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:34:22.432503] [DEBUG] [LOCAL ] BRBR: Primary data saved (38487 records). [2025-09-15T17:34:22.432689] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-15T17:34:22.433177] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRBR took 18.6s. Estimated remaining: 3h 32m 3s. Rate: 9.6 symbols/min [2025-09-15T17:34:22.600285] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:22.639237] [DEBUG] [LOCAL ] BRO: Loaded 39113 existing records from primary storage. [2025-09-15T17:34:22.639394] [INFO ] [MAIN ] BRO: Loaded 39113 existing records. [2025-09-15T17:34:22.811939] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:22.812194] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-15T17:34:22.812239] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-15T17:34:22.813119] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-15T17:34:22.813169] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-15T17:34:22.875940] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-15T17:34:23.166038] [INFO ] [REMOTE ] BRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:23.312907] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:34:23.657921] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-15T17:34:23.981744] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:34:24.051819] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T17:34:24.457931] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-15T17:34:25.106489] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:34:25.257883] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-15T17:34:25.319750] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:34:26.057945] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-15T17:34:26.857938] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-15T17:34:27.008021] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:34:27.531064] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:34:27.657920] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-15T17:34:27.788570] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:34:28.457882] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-15T17:34:28.898476] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:34:29.257919] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-15T17:34:29.850396] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:34:30.057910] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-15T17:34:30.206453] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:34:30.208918] [INFO ] [REMOTE ] BRC: Full fetch complete (21888 records). [2025-09-15T17:34:30.208994] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-15T17:34:30.568922] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-15T17:34:30.569000] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-15T17:34:30.569370] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-15T17:34:30.569409] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-15T17:34:30.570009] [DEBUG] [LOCAL ] BRC: Trimmed 21888 records to 13268 (keeping 150 days of data) [2025-09-15T17:34:30.653424] [DEBUG] [LOCAL ] BRC: Primary data saved (13268 records). [2025-09-15T17:34:30.653616] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-15T17:34:30.653720] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 24.9s. Estimated remaining: 3h 32m 9s. Rate: 9.6 symbols/min [2025-09-15T17:34:30.825166] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:30.861487] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-15T17:34:30.862502] [DEBUG] [LOCAL ] BROS: Loaded 40080 existing records from primary storage. [2025-09-15T17:34:30.863300] [INFO ] [MAIN ] BROS: Loaded 40080 existing records. [2025-09-15T17:34:31.040699] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:31.040962] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-15T17:34:31.041044] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-15T17:34:31.041906] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-15T17:34:31.041958] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-15T17:34:31.395212] [INFO ] [REMOTE ] BROS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:31.657898] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-15T17:34:31.950708] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:34:32.022304] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:34:32.457872] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-15T17:34:33.167763] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:34:33.257884] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-15T17:34:33.956512] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:34:34.057898] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-15T17:34:34.660268] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:34:34.857878] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-15T17:34:35.657853] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-15T17:34:35.736359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:34:36.054784] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:34:36.457944] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-15T17:34:36.877109] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:34:37.257917] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-15T17:34:38.057877] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-15T17:34:38.174977] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:34:38.451512] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:34:38.857887] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-15T17:34:39.657890] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-15T17:34:39.754021] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:34:40.457891] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-15T17:34:40.800865] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:34:40.939825] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T17:34:41.257872] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-15T17:34:41.758463] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:34:42.057913] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-15T17:34:42.653746] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:34:42.857868] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-15T17:34:43.617568] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:34:43.657831] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-15T17:34:44.243276] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:34:44.457863] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-15T17:34:45.072895] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:34:45.257876] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-15T17:34:45.888605] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:34:45.893595] [INFO ] [REMOTE ] BRCC: Full fetch complete (43388 records). [2025-09-15T17:34:45.893703] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-15T17:34:46.065059] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-15T17:34:46.278290] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-15T17:34:46.278368] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-15T17:34:46.278909] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-15T17:34:46.278953] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-15T17:34:46.280839] [DEBUG] [LOCAL ] BRCC: Trimmed 43388 records to 30061 (keeping 150 days of data) [2025-09-15T17:34:46.455292] [DEBUG] [LOCAL ] BRCC: Primary data saved (30061 records). [2025-09-15T17:34:46.455494] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-15T17:34:46.455633] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRCC took 26.2s. Estimated remaining: 3h 33m 1s. Rate: 9.6 symbols/min [2025-09-15T17:34:46.650188] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:46.651375] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:34:46.651559] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-15T17:34:46.656818] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-15T17:34:46.657127] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-15T17:34:46.657177] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-15T17:34:46.657219] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-15T17:34:46.657261] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-15T17:34:46.700223] [INFO ] [REMOTE ] BRO: Full fetch complete (55871 records). [2025-09-15T17:34:46.732065] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-15T17:34:46.758615] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:34:46.764157] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:34:46.774485] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:34:46.784820] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-15T17:34:46.808200] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-09-15T17:34:46.810269] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-09-15T17:34:46.865558] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-15T17:34:46.865693] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-09-15T17:34:46.892156] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRO took 24.5s. Estimated remaining: 3h 32m 19s. Rate: 9.6 symbols/min [2025-09-15T17:34:47.178187] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:47.196551] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:47.224547] [DEBUG] [LOCAL ] BRSP: Loaded 26840 existing records from primary storage. [2025-09-15T17:34:47.224746] [INFO ] [MAIN ] BRSP: Loaded 26840 existing records. [2025-09-15T17:34:47.416471] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:47.418016] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-15T17:34:47.417863] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:34:47.418095] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-15T17:34:47.424050] [INFO ] [REMOTE ] BRFS: Full fetch complete (44685 records). [2025-09-15T17:34:47.424261] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-15T17:34:47.424435] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-15T17:34:47.424583] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-15T17:34:47.430347] [FATAL] [VALIDATOR ] BRFS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:34:47.491834] [FATAL] [MAIN ] BRFS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:34:47.519393] [WARN ] [MAIN ] BRFS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:34:47.531214] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-15T17:34:47.531609] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-15T17:34:47.537066] [INFO ] [LOCAL ] BRFS: Starting deletion of derivative data. [2025-09-15T17:34:47.558019] [DEBUG] [LOCAL ] BRFS: Deleted derivative data file. [2025-09-15T17:34:47.585104] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRFS took 27.3s. Estimated remaining: 3h 31m 39s. Rate: 9.6 symbols/min [2025-09-15T17:34:47.665920] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-15T17:34:47.953625] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:47.972872] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:47.977446] [DEBUG] [LOCAL ] BRT: Loaded 3527 existing records from primary storage. [2025-09-15T17:34:47.977550] [INFO ] [MAIN ] BRT: Loaded 3527 existing records. [2025-09-15T17:34:48.009789] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:48.046718] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-15T17:34:48.160453] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:48.160735] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-15T17:34:48.160784] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-15T17:34:48.161000] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-15T17:34:48.161050] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-15T17:34:48.461404] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-15T17:34:48.519704] [INFO ] [REMOTE ] BRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:48.550340] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:34:48.696839] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:48.697186] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-15T17:34:49.257880] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-15T17:34:50.057898] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-15T17:34:50.620231] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T17:34:50.857838] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-15T17:34:51.135022] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:34:51.468293] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:34:51.657874] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-15T17:34:51.861874] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:51.862367] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-15T17:34:52.457902] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-15T17:34:52.640878] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:52.641196] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-15T17:34:53.257872] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-15T17:34:53.475229] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:53.475750] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-15T17:34:54.057877] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-15T17:34:54.857879] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-15T17:34:55.657836] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-15T17:34:55.700008] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:34:56.322785] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T17:34:56.328286] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:34:56.457835] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-15T17:34:57.257878] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-15T17:34:57.653060] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T17:34:58.057835] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-15T17:34:58.359287] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:34:58.857870] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-15T17:34:59.595202] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:34:59.657924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-15T17:35:00.100807] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T17:35:00.163547] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:35:00.457872] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-15T17:35:01.257916] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-15T17:35:01.730036] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:35:02.057989] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-15T17:35:02.857918] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-15T17:35:02.906702] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:35:02.930479] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:35:02.936590] [INFO ] [REMOTE ] BROS: Full fetch complete (57565 records). [2025-09-15T17:35:02.936843] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-15T17:35:02.937962] [FATAL] [VALIDATOR ] BROS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:02.938100] [FATAL] [MAIN ] BROS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:02.938151] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:02.938200] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-15T17:35:02.938276] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-15T17:35:02.938317] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-09-15T17:35:02.938706] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-09-15T17:35:02.939014] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BROS took 32.3s. Estimated remaining: 3h 32m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:03.123268] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:03.143530] [DEBUG] [LOCAL ] BRW: Loaded 14128 existing records from primary storage. [2025-09-15T17:35:03.143777] [INFO ] [MAIN ] BRW: Loaded 14128 existing records. [2025-09-15T17:35:03.339107] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:03.339505] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-15T17:35:03.339560] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-15T17:35:03.340207] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-15T17:35:03.340261] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-15T17:35:03.663143] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-15T17:35:03.722320] [INFO ] [REMOTE ] BRW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:03.956202] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:35:04.457984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-15T17:35:05.156511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:35:05.257875] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-15T17:35:05.382806] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:35:05.387537] [INFO ] [REMOTE ] BRSL: Full fetch complete (18687 records). [2025-09-15T17:35:05.387608] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-15T17:35:05.388125] [FATAL] [VALIDATOR ] BRSL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:05.388200] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:05.388237] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:05.388281] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-15T17:35:05.388338] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-15T17:35:05.388373] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-15T17:35:05.388412] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-15T17:35:05.388480] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRSL took 18.9s. Estimated remaining: 3h 31m 59s. Rate: 9.6 symbols/min [2025-09-15T17:35:05.554397] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:05.602207] [DEBUG] [LOCAL ] BRX: Loaded 39074 existing records from primary storage. [2025-09-15T17:35:05.602358] [INFO ] [MAIN ] BRX: Loaded 39074 existing records. [2025-09-15T17:35:05.776065] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:05.776288] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-15T17:35:05.776333] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-15T17:35:05.777144] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-15T17:35:05.777195] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-15T17:35:05.879540] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:35:05.910289] [INFO ] [REMOTE ] BRT: Full fetch complete (4965 records). [2025-09-15T17:35:05.933955] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-15T17:35:06.004107] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:06.041413] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:06.060712] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-15T17:35:06.060566] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:06.069880] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-15T17:35:06.080336] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-09-15T17:35:06.104553] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-09-15T17:35:06.141965] [INFO ] [REMOTE ] BRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:06.142007] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-09-15T17:35:06.142177] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRT took 18.6s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-15T17:35:06.318566] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:06.345324] [DEBUG] [LOCAL ] BSAC: Loaded 24764 existing records from primary storage. [2025-09-15T17:35:06.345459] [INFO ] [MAIN ] BSAC: Loaded 24764 existing records. [2025-09-15T17:35:06.520216] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:06.520497] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-15T17:35:06.520558] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-15T17:35:06.521230] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-15T17:35:06.521292] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-15T17:35:06.867011] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-15T17:35:06.872667] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:06.884918] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:35:07.657905] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-15T17:35:08.235867] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:35:08.457829] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-15T17:35:08.621054] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:35:09.257879] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-15T17:35:09.606752] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:35:10.057900] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-15T17:35:10.177710] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:35:10.857868] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-15T17:35:11.181902] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:35:11.657919] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-15T17:35:12.233398] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:35:12.457928] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-15T17:35:13.012617] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:35:13.257908] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-15T17:35:13.342534] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:35:13.347705] [INFO ] [REMOTE ] BRSP: Full fetch complete (40326 records). [2025-09-15T17:35:13.347824] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-15T17:35:13.348449] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:13.348537] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:13.348574] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:13.348617] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-15T17:35:13.348698] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-15T17:35:13.348734] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-09-15T17:35:13.348913] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-09-15T17:35:13.348989] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRSP took 26.4s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-15T17:35:13.523133] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:13.553213] [DEBUG] [LOCAL ] BSBR: Loaded 26870 existing records from primary storage. [2025-09-15T17:35:13.553377] [INFO ] [MAIN ] BSBR: Loaded 26870 existing records. [2025-09-15T17:35:13.729665] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:13.729905] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-15T17:35:13.729951] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-15T17:35:13.730522] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-15T17:35:13.730570] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-15T17:35:14.081358] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-15T17:35:14.087050] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:14.519915] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:35:14.857907] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-15T17:35:15.045978] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:35:15.657915] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-15T17:35:16.279825] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:16.457909] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-15T17:35:16.956011] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:35:17.257928] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-15T17:35:17.785065] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:35:17.946191] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:35:18.057872] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-15T17:35:18.857894] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-15T17:35:19.424588] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:35:19.659520] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-15T17:35:19.659323] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:35:20.457890] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-15T17:35:20.490317] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:35:21.257877] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-15T17:35:21.594903] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:35:22.057898] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-15T17:35:22.162695] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:35:22.857851] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-15T17:35:22.892487] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:35:23.657880] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-15T17:35:23.881630] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:35:24.457869] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-15T17:35:24.734956] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:35:25.257829] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-15T17:35:25.456974] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T17:35:25.459829] [INFO ] [REMOTE ] BRW: Full fetch complete (20276 records). [2025-09-15T17:35:25.459901] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-15T17:35:25.822936] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-15T17:35:25.823042] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-15T17:35:25.823399] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-15T17:35:25.823459] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-15T17:35:25.824097] [DEBUG] [LOCAL ] BRW: Trimmed 20276 records to 14142 (keeping 150 days of data) [2025-09-15T17:35:25.911302] [DEBUG] [LOCAL ] BRW: Primary data saved (14142 records). [2025-09-15T17:35:25.911452] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-15T17:35:25.911540] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BRW took 23.0s. Estimated remaining: 3h 31m 50s. Rate: 9.6 symbols/min [2025-09-15T17:35:26.076104] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-15T17:35:26.078394] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:26.085626] [DEBUG] [LOCAL ] BSL: Loaded 5222 existing records from primary storage. [2025-09-15T17:35:26.085725] [INFO ] [MAIN ] BSL: Loaded 5222 existing records. [2025-09-15T17:35:26.260486] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:26.260758] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-15T17:35:26.260878] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-15T17:35:26.261162] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-15T17:35:26.261210] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-15T17:35:26.618077] [INFO ] [REMOTE ] BSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:26.682685] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:26.857863] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-15T17:35:27.023980] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:35:27.657878] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-15T17:35:27.822010] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:35:28.457857] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-15T17:35:28.618432] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:35:29.257872] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-15T17:35:29.653471] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:35:30.057880] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-15T17:35:30.772238] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:35:30.857892] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-15T17:35:31.266284] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:35:31.270176] [INFO ] [REMOTE ] BSAC: Full fetch complete (35552 records). [2025-09-15T17:35:31.270286] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-15T17:35:31.645137] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-15T17:35:31.645238] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-15T17:35:31.645753] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-15T17:35:31.645815] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-15T17:35:31.646932] [DEBUG] [LOCAL ] BSAC: Trimmed 35552 records to 24120 (keeping 150 days of data) [2025-09-15T17:35:31.702390] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-15T17:35:31.799530] [DEBUG] [LOCAL ] BSAC: Primary data saved (24120 records). [2025-09-15T17:35:31.799681] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-15T17:35:31.799958] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BSAC took 25.7s. Estimated remaining: 3h 31m 42s. Rate: 9.6 symbols/min [2025-09-15T17:35:31.977576] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:32.000965] [DEBUG] [LOCAL ] BSM: Loaded 24437 existing records from primary storage. [2025-09-15T17:35:32.001149] [INFO ] [MAIN ] BSM: Loaded 24437 existing records. [2025-09-15T17:35:32.218821] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:32.219396] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-15T17:35:32.225700] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-15T17:35:32.239831] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-15T17:35:32.239754] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T17:35:32.247237] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-15T17:35:32.318431] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:35:32.463075] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-15T17:35:32.618970] [INFO ] [REMOTE ] BSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:33.257895] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-15T17:35:33.604387] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:35:34.057888] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-15T17:35:34.173284] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:35:34.660551] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:35:34.857885] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-15T17:35:35.369801] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T17:35:35.657931] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-15T17:35:36.457905] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-15T17:35:36.650720] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:35:36.873734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:35:37.257871] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-15T17:35:38.057833] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-15T17:35:38.118696] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:35:38.857878] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-15T17:35:39.492495] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T17:35:39.507442] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:35:39.657879] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-15T17:35:40.457849] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-15T17:35:40.609227] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:35:41.257880] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-15T17:35:42.027081] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:35:42.057843] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-15T17:35:42.510675] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:35:42.857917] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-15T17:35:42.884047] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:35:42.890879] [INFO ] [REMOTE ] BSBR: Full fetch complete (38140 records). [2025-09-15T17:35:42.891040] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-15T17:35:43.281248] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-15T17:35:43.281333] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-15T17:35:43.281914] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-15T17:35:43.281977] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-15T17:35:43.283137] [DEBUG] [LOCAL ] BSBR: Trimmed 38140 records to 26500 (keeping 150 days of data) [2025-09-15T17:35:43.406873] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:35:43.409670] [INFO ] [REMOTE ] BSL: Full fetch complete (9436 records). [2025-09-15T17:35:43.410053] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-15T17:35:43.666235] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-15T17:35:43.764120] [DEBUG] [LOCAL ] BSBR: Primary data saved (26500 records). [2025-09-15T17:35:43.774685] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-15T17:35:43.774942] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSBR took 30.4s. Estimated remaining: 3h 32m 10s. Rate: 9.6 symbols/min [2025-09-15T17:35:43.978253] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-15T17:35:43.988573] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-15T17:35:44.013708] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-15T17:35:44.029401] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-15T17:35:44.047253] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:44.047882] [DEBUG] [LOCAL ] BSL: Trimmed 9436 records to 5094 (keeping 150 days of data) [2025-09-15T17:35:44.092563] [DEBUG] [LOCAL ] BSL: Primary data saved (5094 records). [2025-09-15T17:35:44.093028] [DEBUG] [LOCAL ] BST: Loaded 13627 existing records from primary storage. [2025-09-15T17:35:44.093201] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-15T17:35:44.093277] [INFO ] [MAIN ] BST: Loaded 13627 existing records. [2025-09-15T17:35:44.137388] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSL took 18.2s. Estimated remaining: 3h 31m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:44.403936] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:44.454382] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-15T17:35:44.454294] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:44.454843] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-15T17:35:44.455340] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-15T17:35:44.455452] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-15T17:35:44.466661] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-15T17:35:44.687420] [DEBUG] [LOCAL ] BSTZ: Loaded 18235 existing records from primary storage. [2025-09-15T17:35:44.726995] [INFO ] [MAIN ] BSTZ: Loaded 18235 existing records. [2025-09-15T17:35:44.964148] [INFO ] [REMOTE ] BST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:45.035742] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:45.036128] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-15T17:35:45.036228] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-15T17:35:45.042668] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-15T17:35:45.052978] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-15T17:35:45.121690] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:35:45.262934] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-15T17:35:45.421737] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:46.057883] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-15T17:35:46.197772] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:35:46.204852] [INFO ] [REMOTE ] BRX: Full fetch complete (56449 records). [2025-09-15T17:35:46.205030] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-15T17:35:46.595386] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-15T17:35:46.595494] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-15T17:35:46.596257] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-15T17:35:46.596379] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-15T17:35:46.613612] [DEBUG] [LOCAL ] BRX: Trimmed 56449 records to 38344 (keeping 150 days of data) [2025-09-15T17:35:46.613464] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:35:46.860633] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-15T17:35:46.869661] [DEBUG] [LOCAL ] BRX: Primary data saved (38344 records). [2025-09-15T17:35:46.870282] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-15T17:35:46.872483] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BRX took 41.5s. Estimated remaining: 3h 31m 1s. Rate: 9.6 symbols/min [2025-09-15T17:35:47.051963] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:47.067152] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:35:47.114749] [DEBUG] [LOCAL ] BSX: Loaded 40428 existing records from primary storage. [2025-09-15T17:35:47.114893] [INFO ] [MAIN ] BSX: Loaded 40428 existing records. [2025-09-15T17:35:47.287433] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:47.287695] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-15T17:35:47.287742] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-15T17:35:47.288689] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-15T17:35:47.288739] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-15T17:35:47.641724] [INFO ] [REMOTE ] BSX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:47.657851] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-15T17:35:48.263205] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:35:48.457871] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-15T17:35:49.172826] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:35:49.262935] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-15T17:35:49.272124] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:35:50.057882] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-15T17:35:50.526998] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:35:50.767410] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:35:50.857841] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-15T17:35:51.657870] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-15T17:35:51.851930] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:35:52.457859] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-15T17:35:52.744533] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:35:53.257873] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-15T17:35:53.368970] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:35:53.953117] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:35:54.057868] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-15T17:35:54.857881] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-15T17:35:55.596883] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:35:55.657830] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-15T17:35:55.854260] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:35:56.457874] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-15T17:35:56.660672] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T17:35:57.257858] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-15T17:35:57.880348] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:58.057816] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-15T17:35:58.157408] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:35:58.161568] [INFO ] [REMOTE ] BSM: Full fetch complete (35993 records). [2025-09-15T17:35:58.161672] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-15T17:35:58.526614] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-15T17:35:58.526713] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-15T17:35:58.527192] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-15T17:35:58.527233] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-15T17:35:58.528024] [DEBUG] [LOCAL ] BSM: Trimmed 35993 records to 23991 (keeping 150 days of data) [2025-09-15T17:35:58.675300] [DEBUG] [LOCAL ] BSM: Primary data saved (23991 records). [2025-09-15T17:35:58.675446] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-15T17:35:58.675533] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSM took 26.9s. Estimated remaining: 3h 31m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:58.842218] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:58.847677] [DEBUG] [LOCAL ] BTA: Loaded 4083 existing records from primary storage. [2025-09-15T17:35:58.847760] [INFO ] [MAIN ] BTA: Loaded 4083 existing records. [2025-09-15T17:35:58.867724] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-15T17:35:59.021924] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:59.022145] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-15T17:35:59.022194] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-15T17:35:59.022427] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-15T17:35:59.022470] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-15T17:35:59.379396] [INFO ] [REMOTE ] BTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:59.657910] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-15T17:35:59.959491] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T17:36:00.226138] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:36:00.457850] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-15T17:36:00.481251] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:36:01.257927] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-15T17:36:02.057904] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-15T17:36:02.204018] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:36:02.323327] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:36:02.691960] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:36:02.857858] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-15T17:36:03.657864] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-15T17:36:03.879127] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:36:04.262629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:36:04.457968] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-15T17:36:05.257886] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-15T17:36:05.389329] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:36:05.392260] [INFO ] [REMOTE ] BSTZ: Full fetch complete (27054 records). [2025-09-15T17:36:05.392357] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-15T17:36:05.767230] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-15T17:36:05.767385] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-15T17:36:05.767863] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-15T17:36:05.767940] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-15T17:36:05.768779] [DEBUG] [LOCAL ] BSTZ: Trimmed 27054 records to 18005 (keeping 150 days of data) [2025-09-15T17:36:05.881547] [DEBUG] [LOCAL ] BSTZ: Primary data saved (18005 records). [2025-09-15T17:36:05.881714] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-15T17:36:05.881829] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSTZ took 21.7s. Estimated remaining: 3h 31m 27s. Rate: 9.6 symbols/min [2025-09-15T17:36:06.052836] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:06.059735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-15T17:36:06.066839] [DEBUG] [LOCAL ] BTCM: Loaded 12647 existing records from primary storage. [2025-09-15T17:36:06.066933] [INFO ] [MAIN ] BTCM: Loaded 12647 existing records. [2025-09-15T17:36:06.243146] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:06.243459] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-15T17:36:06.243512] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-15T17:36:06.243886] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-15T17:36:06.243935] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-15T17:36:06.552719] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T17:36:06.598314] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:36:06.620521] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:06.857884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-15T17:36:07.574525] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:36:07.657933] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-15T17:36:08.439190] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:36:08.457879] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-15T17:36:09.257910] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-15T17:36:09.869818] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T17:36:10.057887] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-15T17:36:10.215235] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T17:36:10.857846] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-15T17:36:10.876070] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:36:11.657894] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-15T17:36:12.368348] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T17:36:12.457905] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-15T17:36:12.638403] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:36:13.122248] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:36:13.257884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-15T17:36:14.057933] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-15T17:36:14.857879] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-15T17:36:14.978853] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:36:15.052594] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:36:15.055010] [INFO ] [REMOTE ] BST: Full fetch complete (21146 records). [2025-09-15T17:36:15.055092] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-15T17:36:15.055716] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:36:15.055808] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:36:15.055853] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:36:15.055901] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-15T17:36:15.055975] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-15T17:36:15.056014] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-15T17:36:15.056365] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-09-15T17:36:15.056454] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BST took 31.3s. Estimated remaining: 3h 31m 38s. Rate: 9.6 symbols/min [2025-09-15T17:36:15.245365] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:15.287495] [DEBUG] [LOCAL ] BTE: Loaded 39642 existing records from primary storage. [2025-09-15T17:36:15.287667] [INFO ] [MAIN ] BTE: Loaded 39642 existing records. [2025-09-15T17:36:15.466414] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:15.466662] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-15T17:36:15.466716] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-15T17:36:15.467569] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-15T17:36:15.467619] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-15T17:36:15.667521] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-15T17:36:15.826724] [INFO ] [REMOTE ] BTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:16.289578] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:36:16.295526] [INFO ] [REMOTE ] BSX: Full fetch complete (58365 records). [2025-09-15T17:36:16.295635] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-15T17:36:16.475035] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-15T17:36:16.570103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:36:16.708931] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-15T17:36:16.709018] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-15T17:36:16.709686] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-15T17:36:16.709734] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-15T17:36:16.711118] [DEBUG] [LOCAL ] BSX: Trimmed 58365 records to 39648 (keeping 150 days of data) [2025-09-15T17:36:16.970030] [DEBUG] [LOCAL ] BSX: Primary data saved (39648 records). [2025-09-15T17:36:16.970186] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-15T17:36:16.971450] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSX took 30.1s. Estimated remaining: 3h 31m 6s. Rate: 9.6 symbols/min [2025-09-15T17:36:17.148356] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:17.190822] [DEBUG] [LOCAL ] BTI: Loaded 40349 existing records from primary storage. [2025-09-15T17:36:17.191013] [INFO ] [MAIN ] BTI: Loaded 40349 existing records. [2025-09-15T17:36:17.266837] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-15T17:36:17.379343] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:17.379587] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-15T17:36:17.379637] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-15T17:36:17.380547] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-15T17:36:17.380599] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-15T17:36:17.734696] [INFO ] [REMOTE ] BTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:17.866899] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:36:18.057903] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-15T17:36:18.127804] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:36:18.761822] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:36:18.763054] [INFO ] [REMOTE ] BTA: Full fetch complete (5973 records). [2025-09-15T17:36:18.763124] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-15T17:36:18.863066] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-15T17:36:19.129555] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-15T17:36:19.129631] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-15T17:36:19.129809] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-15T17:36:19.129848] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-15T17:36:19.130236] [DEBUG] [LOCAL ] BTA: Trimmed 5973 records to 4014 (keeping 150 days of data) [2025-09-15T17:36:19.154438] [DEBUG] [LOCAL ] BTA: Primary data saved (4014 records). [2025-09-15T17:36:19.154518] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-15T17:36:19.154635] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTA took 20.5s. Estimated remaining: 3h 30m 36s. Rate: 9.6 symbols/min [2025-09-15T17:36:19.330919] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:19.338250] [DEBUG] [LOCAL ] BTO: Loaded 6230 existing records from primary storage. [2025-09-15T17:36:19.338331] [INFO ] [MAIN ] BTO: Loaded 6230 existing records. [2025-09-15T17:36:19.521524] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:19.521798] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-15T17:36:19.521847] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-15T17:36:19.522210] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-15T17:36:19.522280] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-15T17:36:19.672930] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-15T17:36:19.918417] [INFO ] [REMOTE ] BTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:20.457875] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-15T17:36:20.684843] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T17:36:20.947982] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:36:21.257863] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-15T17:36:21.827132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T17:36:22.057911] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-15T17:36:22.857895] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-15T17:36:23.155656] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T17:36:23.388202] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T17:36:23.657889] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-15T17:36:23.839662] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:36:24.457876] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-15T17:36:24.964209] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T17:36:25.257884] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-15T17:36:25.607399] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T17:36:25.754484] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:36:26.057873] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-15T17:36:26.567790] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T17:36:26.857865] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-15T17:36:27.657867] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-15T17:36:28.092503] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:36:28.095477] [INFO ] [REMOTE ] BTCM: Full fetch complete (14521 records). [2025-09-15T17:36:28.095559] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-15T17:36:28.463047] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-15T17:36:28.468435] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-15T17:36:28.469319] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-15T17:36:28.469751] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-15T17:36:28.469819] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-15T17:36:28.470602] [DEBUG] [LOCAL ] BTCM: Trimmed 14521 records to 12784 (keeping 150 days of data) [2025-09-15T17:36:28.546954] [DEBUG] [LOCAL ] BTCM: Primary data saved (12784 records). [2025-09-15T17:36:28.547096] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-15T17:36:28.547203] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 22.7s. Estimated remaining: 3h 30m 48s. Rate: 9.6 symbols/min [2025-09-15T17:36:28.723545] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:28.735291] [DEBUG] [LOCAL ] BTT: Loaded 11736 existing records from primary storage. [2025-09-15T17:36:28.735457] [INFO ] [MAIN ] BTT: Loaded 11736 existing records. [2025-09-15T17:36:28.915183] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:28.915440] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-15T17:36:28.915486] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-15T17:36:28.915948] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-15T17:36:28.916009] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-15T17:36:29.272624] [INFO ] [REMOTE ] BTT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:29.272717] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-15T17:36:29.366907] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:36:29.980039] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:36:30.057884] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-15T17:36:30.234676] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:36:30.779494] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:36:30.857936] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-15T17:36:31.581898] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:36:31.658019] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-15T17:36:32.157703] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T17:36:32.159126] [INFO ] [REMOTE ] BTO: Full fetch complete (9790 records). [2025-09-15T17:36:32.159204] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-15T17:36:32.462782] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-15T17:36:32.549473] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-15T17:36:32.549558] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-15T17:36:32.549916] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-15T17:36:32.549969] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-15T17:36:32.550491] [DEBUG] [LOCAL ] BTO: Trimmed 9790 records to 6142 (keeping 150 days of data) [2025-09-15T17:36:32.590474] [DEBUG] [LOCAL ] BTO: Primary data saved (6142 records). [2025-09-15T17:36:32.590612] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-15T17:36:32.590732] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTO took 13.4s. Estimated remaining: 3h 30m 29s. Rate: 9.6 symbols/min [2025-09-15T17:36:32.793149] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:32.835040] [DEBUG] [LOCAL ] BTU: Loaded 40092 existing records from primary storage. [2025-09-15T17:36:32.835188] [INFO ] [MAIN ] BTU: Loaded 40092 existing records. [2025-09-15T17:36:33.018744] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:33.019011] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-15T17:36:33.019061] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-15T17:36:33.020011] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-15T17:36:33.020065] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-15T17:36:33.269404] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-15T17:36:33.393099] [INFO ] [REMOTE ] BTU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:34.057900] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-15T17:36:34.097167] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:36:34.564246] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:36:34.857863] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-15T17:36:35.657899] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-15T17:36:35.867468] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T17:36:36.457912] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-15T17:36:36.626611] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:36:37.257875] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-15T17:36:37.312515] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:36:37.956875] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:36:38.057878] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-15T17:36:38.857880] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-15T17:36:38.932533] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:36:39.657862] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-15T17:36:39.773391] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:36:39.911872] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T17:36:40.457882] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-15T17:36:41.229327] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:36:41.235101] [INFO ] [REMOTE ] BTE: Full fetch complete (57288 records). [2025-09-15T17:36:41.235199] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-15T17:36:41.267389] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-15T17:36:41.641181] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-15T17:36:41.641464] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-15T17:36:41.642438] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-15T17:36:41.642869] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:36:41.642965] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-15T17:36:41.649045] [DEBUG] [LOCAL ] BTE: Trimmed 57288 records to 38887 (keeping 150 days of data) [2025-09-15T17:36:41.884652] [DEBUG] [LOCAL ] BTE: Primary data saved (38887 records). [2025-09-15T17:36:41.884857] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-15T17:36:41.885373] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTE took 26.8s. Estimated remaining: 3h 30m 40s. Rate: 9.6 symbols/min [2025-09-15T17:36:42.056442] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:42.056607] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-15T17:36:42.056782] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-15T17:36:42.056925] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-15T17:36:42.056968] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-15T17:36:42.057012] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-15T17:36:42.057056] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-15T17:36:42.068312] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-15T17:36:42.423499] [INFO ] [REMOTE ] BTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:42.734113] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:36:42.739881] [INFO ] [REMOTE ] BTI: Full fetch complete (58223 records). [2025-09-15T17:36:42.739982] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-15T17:36:42.863013] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-15T17:36:43.140501] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-15T17:36:43.140592] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-15T17:36:43.141269] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-15T17:36:43.141315] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-15T17:36:43.142474] [DEBUG] [LOCAL ] BTI: Trimmed 58223 records to 39570 (keeping 150 days of data) [2025-09-15T17:36:43.404482] [DEBUG] [LOCAL ] BTI: Primary data saved (39570 records). [2025-09-15T17:36:43.404677] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-15T17:36:43.405552] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTI took 26.4s. Estimated remaining: 3h 30m 7s. Rate: 9.6 symbols/min [2025-09-15T17:36:43.582573] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:43.601598] [DEBUG] [LOCAL ] BTZ: Loaded 16645 existing records from primary storage. [2025-09-15T17:36:43.601783] [INFO ] [MAIN ] BTZ: Loaded 16645 existing records. [2025-09-15T17:36:43.667042] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-15T17:36:43.793370] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:43.793807] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-15T17:36:43.793891] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-15T17:36:43.800958] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-15T17:36:43.801070] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-15T17:36:43.807692] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:36:44.175190] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:44.205831] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-15T17:36:44.457843] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-15T17:36:44.762529] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:36:45.196778] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:36:45.257837] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-15T17:36:45.907065] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:36:46.057880] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-15T17:36:46.857920] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-15T17:36:47.373273] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:36:47.657869] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-15T17:36:48.457898] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-15T17:36:48.724665] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T17:36:48.790139] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:36:49.257891] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-15T17:36:49.695727] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:36:50.057873] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-15T17:36:50.543777] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:36:50.857874] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-15T17:36:50.912125] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:36:51.657882] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-15T17:36:52.246010] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:36:52.455711] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:36:52.462504] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-15T17:36:53.257884] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-15T17:36:54.057929] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-15T17:36:54.166136] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:36:54.200853] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T17:36:54.857886] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-15T17:36:54.954036] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:36:55.657875] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-15T17:36:55.794575] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T17:36:56.457892] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-15T17:36:56.754585] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:36:57.073686] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:36:57.257871] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-15T17:36:58.057871] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-15T17:36:58.232620] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:36:58.857852] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-15T17:36:59.156556] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:36:59.657852] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-15T17:36:59.847109] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:36:59.851876] [INFO ] [REMOTE ] BTX: Full fetch complete (34215 records). [2025-09-15T17:36:59.852025] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-15T17:37:00.047794] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T17:37:00.048265] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:37:00.048319] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:37:00.048367] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-15T17:37:00.048445] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-15T17:37:00.048491] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-15T17:37:00.048534] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-15T17:37:00.048600] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTX took 18.2s. Estimated remaining: 3h 30m 60s. Rate: 9.6 symbols/min [2025-09-15T17:37:00.234142] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:00.278912] [DEBUG] [LOCAL ] BUD: Loaded 39588 existing records from primary storage. [2025-09-15T17:37:00.279108] [INFO ] [MAIN ] BUD: Loaded 39588 existing records. [2025-09-15T17:37:00.461936] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-15T17:37:00.465527] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:00.466105] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-15T17:37:00.466902] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-15T17:37:00.467857] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-15T17:37:00.467915] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-15T17:37:00.826139] [INFO ] [REMOTE ] BUD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:01.257904] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-15T17:37:01.300127] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:37:01.573081] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:37:01.576979] [INFO ] [REMOTE ] BTZ: Full fetch complete (25090 records). [2025-09-15T17:37:01.577056] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-15T17:37:01.956351] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:37:01.971620] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-15T17:37:01.971745] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-15T17:37:01.972250] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-15T17:37:01.972323] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-15T17:37:01.974299] [DEBUG] [LOCAL ] BTZ: Trimmed 25090 records to 16047 (keeping 150 days of data) [2025-09-15T17:37:02.057899] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-15T17:37:02.089601] [DEBUG] [LOCAL ] BTZ: Primary data saved (16047 records). [2025-09-15T17:37:02.089794] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-15T17:37:02.089900] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTZ took 18.7s. Estimated remaining: 3h 30m 29s. Rate: 9.6 symbols/min [2025-09-15T17:37:02.262402] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:02.273451] [DEBUG] [LOCAL ] BUI: Loaded 8643 existing records from primary storage. [2025-09-15T17:37:02.273596] [INFO ] [MAIN ] BUI: Loaded 8643 existing records. [2025-09-15T17:37:02.456210] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:02.456449] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-15T17:37:02.456494] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-15T17:37:02.456895] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-15T17:37:02.456944] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-15T17:37:02.817624] [INFO ] [REMOTE ] BUI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:02.824462] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:37:02.826821] [INFO ] [REMOTE ] BTT: Full fetch complete (17233 records). [2025-09-15T17:37:02.826891] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-15T17:37:02.827337] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:37:02.827411] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:37:02.827456] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:37:02.827503] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-15T17:37:02.827560] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-15T17:37:02.827596] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-09-15T17:37:02.827883] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-09-15T17:37:02.827975] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTT took 34.3s. Estimated remaining: 3h 29m 52s. Rate: 9.6 symbols/min [2025-09-15T17:37:02.862951] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-15T17:37:03.003313] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:03.044771] [DEBUG] [LOCAL ] BUR: Loaded 34135 existing records from primary storage. [2025-09-15T17:37:03.044907] [INFO ] [MAIN ] BUR: Loaded 34135 existing records. [2025-09-15T17:37:03.239585] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:03.239865] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-15T17:37:03.239910] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-15T17:37:03.240547] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-15T17:37:03.240593] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-15T17:37:03.593128] [INFO ] [REMOTE ] BUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:03.657834] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-15T17:37:04.457906] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-15T17:37:04.837944] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T17:37:04.909064] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:37:05.257947] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-15T17:37:05.977012] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:37:06.015538] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:37:06.057823] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-15T17:37:06.857927] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-15T17:37:07.290112] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:37:07.418871] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:37:07.426038] [INFO ] [REMOTE ] BTU: Full fetch complete (57933 records). [2025-09-15T17:37:07.426146] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-15T17:37:07.662991] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-15T17:37:07.810896] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-15T17:37:07.810968] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-15T17:37:07.811620] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-15T17:37:07.811679] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-15T17:37:07.812807] [DEBUG] [LOCAL ] BTU: Trimmed 57933 records to 39314 (keeping 150 days of data) [2025-09-15T17:37:08.054959] [DEBUG] [LOCAL ] BTU: Primary data saved (39314 records). [2025-09-15T17:37:08.055110] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-15T17:37:08.055723] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BTU took 35.5s. Estimated remaining: 3h 29m 40s. Rate: 9.6 symbols/min [2025-09-15T17:37:08.231023] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:08.271863] [DEBUG] [LOCAL ] BURL: Loaded 34400 existing records from primary storage. [2025-09-15T17:37:08.271996] [INFO ] [MAIN ] BURL: Loaded 34400 existing records. [2025-09-15T17:37:08.450476] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:08.458680] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:37:08.458333] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-15T17:37:08.458756] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-15T17:37:08.462231] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-15T17:37:08.463336] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-15T17:37:08.463391] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-15T17:37:08.821266] [INFO ] [REMOTE ] BURL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:09.257927] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-15T17:37:09.773130] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:37:10.057854] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-15T17:37:10.198663] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:37:10.857873] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-15T17:37:11.644992] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:37:11.657805] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-15T17:37:11.703700] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:37:12.457877] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-15T17:37:12.504632] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:37:13.257894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-15T17:37:14.057876] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-15T17:37:14.132341] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:37:14.843881] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:37:14.857810] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-15T17:37:14.929808] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T17:37:15.500740] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:37:15.502844] [INFO ] [REMOTE ] BUI: Full fetch complete (12214 records). [2025-09-15T17:37:15.502918] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-15T17:37:15.676383] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-15T17:37:15.869473] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-15T17:37:15.869546] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-15T17:37:15.869829] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-15T17:37:15.869871] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-15T17:37:15.870332] [DEBUG] [LOCAL ] BUI: Trimmed 12214 records to 8539 (keeping 150 days of data) [2025-09-15T17:37:15.927349] [DEBUG] [LOCAL ] BUI: Primary data saved (8539 records). [2025-09-15T17:37:15.927502] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-15T17:37:15.927604] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 13.8s. Estimated remaining: 3h 29m 43s. Rate: 9.6 symbols/min [2025-09-15T17:37:16.457879] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-15T17:37:17.257887] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-15T17:37:17.651391] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:37:17.802315] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:37:18.057940] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-15T17:37:18.857899] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-15T17:37:19.071517] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:37:19.210496] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T17:37:19.657920] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-15T17:37:20.348128] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:37:20.457880] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-15T17:37:21.084816] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:37:21.257889] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-15T17:37:22.057986] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-15T17:37:22.165533] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:37:22.531822] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:37:22.857894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-15T17:37:23.657931] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-15T17:37:23.814639] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:37:24.310610] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:37:24.457963] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-15T17:37:25.204007] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:37:25.257839] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-15T17:37:25.809771] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:37:26.057919] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-15T17:37:26.732332] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:37:26.737885] [INFO ] [REMOTE ] BUR: Full fetch complete (48635 records). [2025-09-15T17:37:26.738066] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-15T17:37:26.863020] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-15T17:37:27.131148] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-15T17:37:27.131303] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-15T17:37:27.132102] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-15T17:37:27.132182] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-15T17:37:27.133609] [DEBUG] [LOCAL ] BUR: Trimmed 48635 records to 33462 (keeping 150 days of data) [2025-09-15T17:37:27.341974] [DEBUG] [LOCAL ] BUR: Primary data saved (33462 records). [2025-09-15T17:37:27.342120] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-15T17:37:27.342701] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUR took 24.5s. Estimated remaining: 3h 30m 5s. Rate: 9.6 symbols/min [2025-09-15T17:37:27.452539] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:37:27.657895] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-15T17:37:28.467854] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:37:28.477952] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-15T17:37:29.473057] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:37:29.484895] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-15T17:37:30.079150] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:37:30.084339] [INFO ] [REMOTE ] BURL: Full fetch complete (50473 records). [2025-09-15T17:37:30.084479] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-15T17:37:30.500124] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-15T17:37:30.500300] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-15T17:37:30.500974] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-15T17:37:30.501028] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-15T17:37:30.502306] [DEBUG] [LOCAL ] BURL: Trimmed 50473 records to 33645 (keeping 150 days of data) [2025-09-15T17:37:30.709026] [DEBUG] [LOCAL ] BURL: Primary data saved (33645 records). [2025-09-15T17:37:30.709170] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-15T17:37:30.709255] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BURL took 22.7s. Estimated remaining: 3h 29m 43s. Rate: 9.6 symbols/min [2025-09-15T17:37:30.983934] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:37:30.991383] [INFO ] [REMOTE ] BUD: Full fetch complete (57366 records). [2025-09-15T17:37:30.991602] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-15T17:37:31.379950] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-15T17:37:31.380031] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-15T17:37:31.380691] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-15T17:37:31.380735] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-15T17:37:31.381828] [DEBUG] [LOCAL ] BUD: Trimmed 57366 records to 38809 (keeping 150 days of data) [2025-09-15T17:37:31.618826] [DEBUG] [LOCAL ] BUD: Primary data saved (38809 records). [2025-09-15T17:37:31.618975] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-15T17:37:31.620347] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BUD took 31.6s. Estimated remaining: 3h 29m 7s. Rate: 9.6 symbols/min [2025-09-15T17:37:32.261193] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.267178] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.360031] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.361829] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.386434] [DEBUG] [LOCAL ] BUXX: Loaded 11633 existing records from primary storage. [2025-09-15T17:37:32.386660] [INFO ] [MAIN ] BUXX: Loaded 11633 existing records. [2025-09-15T17:37:32.557115] [DEBUG] [LOCAL ] BVN: Loaded 32333 existing records from primary storage. [2025-09-15T17:37:32.556261] [DEBUG] [LOCAL ] BV: Loaded 28695 existing records from primary storage. [2025-09-15T17:37:32.572715] [INFO ] [MAIN ] BV: Loaded 28695 existing records. [2025-09-15T17:37:32.597611] [INFO ] [MAIN ] BVN: Loaded 32333 existing records. [2025-09-15T17:37:32.609266] [DEBUG] [LOCAL ] BW: Loaded 28564 existing records from primary storage. [2025-09-15T17:37:32.701065] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:32.695466] [INFO ] [MAIN ] BW: Loaded 28564 existing records. [2025-09-15T17:37:32.925831] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.025473] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-15T17:37:33.077229] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.124111] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.136341] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-15T17:37:33.207390] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-15T17:37:33.184492] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-15T17:37:33.252795] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.211742] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.286919] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.278077] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-15T17:37:33.313136] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.318361] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-15T17:37:33.328552] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-15T17:37:33.328667] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-15T17:37:33.339792] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-15T17:37:33.350550] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-15T17:37:33.380584] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-15T17:37:33.369880] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-15T17:37:34.535601] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.541491] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.540222] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-15T17:37:34.562911] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-15T17:37:34.708781] [INFO ] [REMOTE ] BW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.709207] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-15T17:37:34.705518] [INFO ] [REMOTE ] BVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.710156] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-15T17:37:35.550711] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:37:35.553497] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-15T17:37:36.125609] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:37:36.133813] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-15T17:37:36.209050] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:37:36.217603] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-15T17:37:36.244946] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:37:36.253172] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-15T17:37:36.338570] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T17:37:36.457910] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-15T17:37:37.299588] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:37:37.308309] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-15T17:37:37.359240] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:37:37.389135] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:37:37.620727] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:37:38.057895] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-15T17:37:38.652582] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:37:38.857884] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-15T17:37:39.016073] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T17:37:39.657872] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-15T17:37:39.742021] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:37:40.457883] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-15T17:37:41.199533] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:37:41.257820] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-15T17:37:42.020426] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:37:42.057856] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-15T17:37:42.204672] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:37:42.857875] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-15T17:37:43.238901] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:37:43.657908] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-15T17:37:43.729175] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:37:44.457884] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-15T17:37:44.696918] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:37:45.257863] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-15T17:37:45.674531] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:37:46.057870] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-15T17:37:46.748061] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:37:46.857906] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-15T17:37:47.448054] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:37:47.657887] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-15T17:37:47.907688] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:37:48.457925] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-15T17:37:48.722359] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:37:49.257894] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-15T17:37:49.857817] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:37:50.057888] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-15T17:37:50.453743] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:37:50.857861] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-15T17:37:51.539106] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:37:51.657834] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-15T17:37:51.828047] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:37:51.833009] [INFO ] [REMOTE ] BVN: Full fetch complete (47115 records). [2025-09-15T17:37:51.833092] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-15T17:37:52.200450] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-15T17:37:52.200528] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-15T17:37:52.201092] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-15T17:37:52.201135] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-15T17:37:52.202064] [DEBUG] [LOCAL ] BVN: Trimmed 47115 records to 31889 (keeping 150 days of data) [2025-09-15T17:37:52.388148] [DEBUG] [LOCAL ] BVN: Primary data saved (31889 records). [2025-09-15T17:37:52.388289] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-15T17:37:52.388369] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BVN took 20.8s. Estimated remaining: 3h 30m 21s. Rate: 9.5 symbols/min [2025-09-15T17:37:52.462992] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-15T17:37:52.558296] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:52.599598] [DEBUG] [LOCAL ] BWA: Loaded 39146 existing records from primary storage. [2025-09-15T17:37:52.599767] [INFO ] [MAIN ] BWA: Loaded 39146 existing records. [2025-09-15T17:37:52.781784] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:52.782086] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-15T17:37:52.782262] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-15T17:37:52.788203] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-15T17:37:52.795407] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-15T17:37:52.879096] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T17:37:52.945447] [INFO ] [REMOTE ] BW: Full fetch complete (42902 records). [2025-09-15T17:37:52.961617] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-15T17:37:53.258275] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-15T17:37:53.285082] [INFO ] [REMOTE ] BWA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:53.530657] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-15T17:37:53.530748] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-15T17:37:53.531321] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-15T17:37:53.531364] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-15T17:37:53.532371] [DEBUG] [LOCAL ] BW: Trimmed 42902 records to 28077 (keeping 150 days of data) [2025-09-15T17:37:53.695811] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:37:53.709716] [INFO ] [REMOTE ] BV: Full fetch complete (42102 records). [2025-09-15T17:37:53.712566] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-15T17:37:53.714862] [DEBUG] [LOCAL ] BW: Primary data saved (28077 records). [2025-09-15T17:37:53.715262] [INFO ] [MAIN ] BW: Full history saved. [2025-09-15T17:37:53.715846] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BW took 22.1s. Estimated remaining: 3h 29m 47s. Rate: 9.6 symbols/min [2025-09-15T17:37:54.080988] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-15T17:37:54.082627] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:54.284817] [DEBUG] [LOCAL ] BWG: Loaded 9612 existing records from primary storage. [2025-09-15T17:37:54.302465] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:37:54.302710] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-15T17:37:54.302844] [INFO ] [MAIN ] BWG: Loaded 9612 existing records. [2025-09-15T17:37:54.339527] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-15T17:37:54.372236] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-15T17:37:54.383836] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-15T17:37:54.433336] [DEBUG] [LOCAL ] BV: Trimmed 42102 records to 28319 (keeping 150 days of data) [2025-09-15T17:37:54.494004] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:54.555719] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-15T17:37:54.582725] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-15T17:37:54.590965] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-15T17:37:54.602227] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-15T17:37:54.859700] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-15T17:37:55.007125] [DEBUG] [LOCAL ] BV: Primary data saved (28319 records). [2025-09-15T17:37:55.008140] [INFO ] [MAIN ] BV: Full history saved. [2025-09-15T17:37:55.017928] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BV took 23.4s. Estimated remaining: 3h 29m 14s. Rate: 9.6 symbols/min [2025-09-15T17:37:55.028291] [INFO ] [REMOTE ] BWG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:55.215294] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:55.243493] [DEBUG] [LOCAL ] BWLP: Loaded 24114 existing records from primary storage. [2025-09-15T17:37:55.243634] [INFO ] [MAIN ] BWLP: Loaded 24114 existing records. [2025-09-15T17:37:55.427315] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:55.428071] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-15T17:37:55.428171] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-15T17:37:55.428926] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-15T17:37:55.429066] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-15T17:37:55.450859] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T17:37:55.630835] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:37:55.664115] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-15T17:37:55.851484] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:56.457844] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-15T17:37:56.604926] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:37:56.607004] [INFO ] [REMOTE ] BUXX: Full fetch complete (16143 records). [2025-09-15T17:37:56.607093] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-15T17:37:56.965877] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-15T17:37:56.965959] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-15T17:37:56.966288] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-15T17:37:56.966326] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-15T17:37:56.966879] [DEBUG] [LOCAL ] BUXX: Trimmed 16143 records to 11375 (keeping 150 days of data) [2025-09-15T17:37:57.041631] [DEBUG] [LOCAL ] BUXX: Primary data saved (11375 records). [2025-09-15T17:37:57.041795] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-15T17:37:57.041883] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BUXX took 25.4s. Estimated remaining: 3h 28m 44s. Rate: 9.6 symbols/min [2025-09-15T17:37:57.210186] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:57.218114] [DEBUG] [LOCAL ] BWMX: Loaded 6394 existing records from primary storage. [2025-09-15T17:37:57.218233] [INFO ] [MAIN ] BWMX: Loaded 6394 existing records. [2025-09-15T17:37:57.263108] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-15T17:37:57.397030] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:57.397307] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-15T17:37:57.397356] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-15T17:37:57.397707] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-15T17:37:57.397757] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-15T17:37:57.756919] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:57.774939] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:37:58.057869] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-15T17:37:58.136141] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T17:37:58.497326] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:37:58.857879] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-15T17:37:59.536023] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T17:37:59.657859] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-15T17:38:00.382290] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:38:00.457888] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-15T17:38:01.257938] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-15T17:38:01.324282] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:38:02.057916] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-15T17:38:02.398186] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:38:02.857882] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-15T17:38:03.435184] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:38:03.657870] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-15T17:38:04.149006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:38:04.257827] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:38:04.457910] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-15T17:38:04.813672] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:38:05.257867] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-15T17:38:06.057902] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-15T17:38:06.738367] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:38:06.857869] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-15T17:38:07.159922] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:38:07.657887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-15T17:38:08.226250] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:38:08.241332] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:38:08.457921] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-15T17:38:08.934275] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:38:09.257878] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-15T17:38:10.057857] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-15T17:38:10.221601] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:38:10.857887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-15T17:38:11.359562] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:38:11.657919] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-15T17:38:11.756000] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:38:11.758950] [INFO ] [REMOTE ] BWG: Full fetch complete (13140 records). [2025-09-15T17:38:11.759057] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-15T17:38:12.125456] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-15T17:38:12.125586] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-15T17:38:12.125894] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-15T17:38:12.125950] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-15T17:38:12.126604] [DEBUG] [LOCAL ] BWG: Trimmed 13140 records to 9569 (keeping 150 days of data) [2025-09-15T17:38:12.188181] [DEBUG] [LOCAL ] BWG: Primary data saved (9569 records). [2025-09-15T17:38:12.188323] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-15T17:38:12.188438] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWG took 18.5s. Estimated remaining: 3h 29m 27s. Rate: 9.6 symbols/min [2025-09-15T17:38:12.358414] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:12.364333] [DEBUG] [LOCAL ] BWNB: Loaded 3446 existing records from primary storage. [2025-09-15T17:38:12.364477] [INFO ] [MAIN ] BWNB: Loaded 3446 existing records. [2025-09-15T17:38:12.463182] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-15T17:38:12.546514] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:12.546804] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-15T17:38:12.546851] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-15T17:38:12.547094] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-15T17:38:12.547140] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-15T17:38:12.906565] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:13.001788] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:38:13.067919] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:38:13.257914] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-15T17:38:14.057889] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-15T17:38:14.245620] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:38:14.249371] [INFO ] [REMOTE ] BWLP: Full fetch complete (35870 records). [2025-09-15T17:38:14.249451] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-15T17:38:14.564486] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T17:38:14.648460] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-15T17:38:14.648533] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-15T17:38:14.649020] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-15T17:38:14.649070] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-15T17:38:14.649858] [DEBUG] [LOCAL ] BWLP: Trimmed 35870 records to 23730 (keeping 150 days of data) [2025-09-15T17:38:14.793421] [DEBUG] [LOCAL ] BWLP: Primary data saved (23730 records). [2025-09-15T17:38:14.793551] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-15T17:38:14.793630] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWLP took 19.8s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:14.864290] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-15T17:38:14.984186] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:14.991227] [DEBUG] [LOCAL ] BWSN: Loaded 4133 existing records from primary storage. [2025-09-15T17:38:14.991343] [INFO ] [MAIN ] BWSN: Loaded 4133 existing records. [2025-09-15T17:38:15.167016] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:15.167420] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-15T17:38:15.167468] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-15T17:38:15.167994] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-15T17:38:15.168045] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-15T17:38:15.521802] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:15.522978] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T17:38:15.657906] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-15T17:38:16.260404] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:38:16.457951] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-15T17:38:17.258002] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-15T17:38:17.937926] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:38:17.954279] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T17:38:18.057864] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-15T17:38:18.857910] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-15T17:38:19.236578] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:38:19.301863] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:38:19.657880] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-15T17:38:20.457866] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-15T17:38:21.018541] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:38:21.196181] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:38:21.257887] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-15T17:38:22.057901] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-15T17:38:22.190119] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:38:22.777366] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:38:22.857893] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-15T17:38:23.435781] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T17:38:23.657880] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-15T17:38:24.457885] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-15T17:38:25.257895] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-15T17:38:25.310993] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:38:25.402506] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:38:25.742509] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:38:26.057887] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-15T17:38:26.457735] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T17:38:26.857938] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-15T17:38:27.657920] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-15T17:38:28.195591] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:38:28.201728] [INFO ] [REMOTE ] BWA: Full fetch complete (56854 records). [2025-09-15T17:38:28.201899] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-15T17:38:28.313350] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:38:28.331734] [INFO ] [REMOTE ] BWMX: Full fetch complete (7830 records). [2025-09-15T17:38:28.342311] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-15T17:38:28.372339] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:38:28.402551] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:38:28.463188] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-15T17:38:28.463409] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:38:28.463851] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-15T17:38:28.477178] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-15T17:38:28.503235] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-15T17:38:28.525312] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-09-15T17:38:28.535910] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWMX took 31.5s. Estimated remaining: 3h 29m 35s. Rate: 9.6 symbols/min [2025-09-15T17:38:28.734928] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-15T17:38:28.740136] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-15T17:38:28.745946] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-15T17:38:28.761506] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-15T17:38:28.791199] [DEBUG] [LOCAL ] BWA: Trimmed 56854 records to 38415 (keeping 150 days of data) [2025-09-15T17:38:28.792613] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:28.942305] [DEBUG] [LOCAL ] BWXT: Loaded 35100 existing records from primary storage. [2025-09-15T17:38:28.942456] [INFO ] [MAIN ] BWXT: Loaded 35100 existing records. [2025-09-15T17:38:29.205700] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:29.207133] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-15T17:38:29.207736] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-15T17:38:29.209481] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-15T17:38:29.209778] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-15T17:38:29.264265] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-15T17:38:29.519541] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:38:29.605016] [DEBUG] [LOCAL ] BWA: Primary data saved (38415 records). [2025-09-15T17:38:29.610720] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:29.610904] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-15T17:38:29.612151] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWA took 37.2s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:29.780896] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:29.824162] [DEBUG] [LOCAL ] BX: Loaded 40257 existing records from primary storage. [2025-09-15T17:38:29.824314] [INFO ] [MAIN ] BX: Loaded 40257 existing records. [2025-09-15T17:38:30.010291] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:30.015421] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-15T17:38:30.015345] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T17:38:30.015603] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-15T17:38:30.018377] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-15T17:38:30.018439] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-15T17:38:30.062941] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-15T17:38:30.382015] [INFO ] [REMOTE ] BX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:30.857882] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-15T17:38:31.580966] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:38:31.657873] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-15T17:38:32.457936] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-15T17:38:32.557817] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:38:32.742419] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:38:32.888721] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T17:38:32.889756] [INFO ] [REMOTE ] BWNB: Full fetch complete (4794 records). [2025-09-15T17:38:32.889825] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-15T17:38:33.242071] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-15T17:38:33.242147] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-15T17:38:33.242273] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-15T17:38:33.242312] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-15T17:38:33.242701] [DEBUG] [LOCAL ] BWNB: Trimmed 4794 records to 3439 (keeping 150 days of data) [2025-09-15T17:38:33.258809] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-15T17:38:33.265149] [DEBUG] [LOCAL ] BWNB: Primary data saved (3439 records). [2025-09-15T17:38:33.265222] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-15T17:38:33.265298] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWNB took 21.1s. Estimated remaining: 3h 28m 40s. Rate: 9.6 symbols/min [2025-09-15T17:38:33.442123] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:33.453607] [DEBUG] [LOCAL ] BXC: Loaded 10237 existing records from primary storage. [2025-09-15T17:38:33.453759] [INFO ] [MAIN ] BXC: Loaded 10237 existing records. [2025-09-15T17:38:33.629239] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:33.629506] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-15T17:38:33.629556] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-15T17:38:33.629918] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-15T17:38:33.629969] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-15T17:38:33.981992] [INFO ] [REMOTE ] BXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:34.057865] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-15T17:38:34.857857] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-15T17:38:34.908242] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:38:35.350892] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T17:38:35.657908] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-15T17:38:36.296339] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:38:36.457902] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-15T17:38:36.836344] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:38:37.257837] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-15T17:38:37.304349] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:38:38.057881] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-15T17:38:38.364374] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-15T17:38:38.857875] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-15T17:38:39.014912] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:38:39.587028] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:38:39.657891] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-15T17:38:40.199122] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:38:40.200097] [INFO ] [REMOTE ] BWSN: Full fetch complete (5354 records). [2025-09-15T17:38:40.200163] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-15T17:38:40.463280] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-15T17:38:40.556738] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-15T17:38:40.556822] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-15T17:38:40.556966] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-15T17:38:40.557004] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-15T17:38:40.557378] [DEBUG] [LOCAL ] BWSN: Trimmed 5354 records to 4084 (keeping 150 days of data) [2025-09-15T17:38:40.581962] [DEBUG] [LOCAL ] BWSN: Primary data saved (4084 records). [2025-09-15T17:38:40.582043] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-15T17:38:40.582133] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWSN took 25.8s. Estimated remaining: 3h 28m 39s. Rate: 9.6 symbols/min [2025-09-15T17:38:40.749708] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:40.783267] [DEBUG] [LOCAL ] BXMT: Loaded 34780 existing records from primary storage. [2025-09-15T17:38:40.783452] [INFO ] [MAIN ] BXMT: Loaded 34780 existing records. [2025-09-15T17:38:40.962533] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:40.962824] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-15T17:38:40.962870] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-15T17:38:40.963587] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-15T17:38:40.963668] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-15T17:38:41.263044] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-15T17:38:41.315154] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:42.057876] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-15T17:38:42.312516] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:38:42.554087] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T17:38:42.857895] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-15T17:38:43.290951] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:38:43.657867] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-15T17:38:44.457921] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-15T17:38:44.517884] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:38:45.253693] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:38:45.257818] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-15T17:38:45.349191] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:38:46.032465] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:38:46.057816] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-15T17:38:46.823888] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T17:38:46.857871] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-15T17:38:47.657885] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-15T17:38:48.259829] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:38:48.457885] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-15T17:38:49.257943] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-15T17:38:49.473174] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:38:49.662202] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:38:49.770709] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T17:38:50.057892] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-15T17:38:50.620787] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T17:38:50.857891] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-15T17:38:51.489018] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T17:38:51.490849] [INFO ] [REMOTE ] BXC: Full fetch complete (14603 records). [2025-09-15T17:38:51.490939] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-15T17:38:51.665016] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-15T17:38:51.854264] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-15T17:38:51.854342] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-15T17:38:51.854687] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-15T17:38:51.854761] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-15T17:38:51.855272] [DEBUG] [LOCAL ] BXC: Trimmed 14603 records to 10082 (keeping 150 days of data) [2025-09-15T17:38:51.916132] [DEBUG] [LOCAL ] BXC: Primary data saved (10082 records). [2025-09-15T17:38:51.916278] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-15T17:38:51.916365] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 18.7s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:52.083860] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:52.098506] [DEBUG] [LOCAL ] BXMX: Loaded 13751 existing records from primary storage. [2025-09-15T17:38:52.098627] [INFO ] [MAIN ] BXMX: Loaded 13751 existing records. [2025-09-15T17:38:52.277773] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:52.278017] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-15T17:38:52.278064] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-15T17:38:52.278535] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-15T17:38:52.278583] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-15T17:38:52.464035] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-15T17:38:52.628033] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:53.257879] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-15T17:38:53.376823] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:38:53.817042] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:38:53.822979] [INFO ] [REMOTE ] BWXT: Full fetch complete (50766 records). [2025-09-15T17:38:53.823102] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-15T17:38:54.063064] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-15T17:38:54.217282] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:38:54.217425] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-15T17:38:54.221977] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-15T17:38:54.222686] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-15T17:38:54.222752] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-15T17:38:54.223954] [DEBUG] [LOCAL ] BWXT: Trimmed 50766 records to 34580 (keeping 150 days of data) [2025-09-15T17:38:54.449494] [DEBUG] [LOCAL ] BWXT: Primary data saved (34580 records). [2025-09-15T17:38:54.449652] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-15T17:38:54.449742] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BWXT took 25.9s. Estimated remaining: 3h 28m 34s. Rate: 9.6 symbols/min [2025-09-15T17:38:54.616448] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:54.654575] [DEBUG] [LOCAL ] BXP: Loaded 37306 existing records from primary storage. [2025-09-15T17:38:54.654761] [INFO ] [MAIN ] BXP: Loaded 37306 existing records. [2025-09-15T17:38:54.827975] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:54.828263] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-15T17:38:54.828329] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-15T17:38:54.829218] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-15T17:38:54.829286] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-15T17:38:54.862959] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-15T17:38:55.188694] [INFO ] [REMOTE ] BXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:55.657853] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-15T17:38:55.715894] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:38:56.457839] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-15T17:38:56.620755] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:38:56.778575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:38:57.257883] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-15T17:38:57.680287] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:38:58.057820] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-15T17:38:58.388212] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:38:58.857895] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-15T17:38:59.531781] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:38:59.657859] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-15T17:38:59.689163] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:39:00.457871] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-15T17:39:01.125706] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:39:01.257874] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-15T17:39:01.591010] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:39:02.057912] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-15T17:39:02.321123] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:39:02.857889] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-15T17:39:03.654671] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T17:39:03.664453] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-15T17:39:04.457889] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-15T17:39:04.572122] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:39:04.578377] [INFO ] [REMOTE ] BX: Full fetch complete (58173 records). [2025-09-15T17:39:04.578539] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-15T17:39:04.969519] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-15T17:39:04.969602] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-15T17:39:04.970309] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-15T17:39:04.970356] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-15T17:39:04.971511] [DEBUG] [LOCAL ] BX: Trimmed 58173 records to 39477 (keeping 150 days of data) [2025-09-15T17:39:05.115063] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:39:05.121857] [INFO ] [REMOTE ] BXMT: Full fetch complete (51749 records). [2025-09-15T17:39:05.122819] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-15T17:39:05.272671] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-15T17:39:05.472527] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:39:05.637575] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-15T17:39:05.638152] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-15T17:39:05.639277] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-15T17:39:05.640303] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-15T17:39:05.645412] [DEBUG] [LOCAL ] BXMT: Trimmed 51749 records to 33962 (keeping 150 days of data) [2025-09-15T17:39:05.761958] [DEBUG] [LOCAL ] BX: Primary data saved (39477 records). [2025-09-15T17:39:05.762663] [INFO ] [MAIN ] BX: Full history saved. [2025-09-15T17:39:05.764011] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BX took 36.2s. Estimated remaining: 3h 28m 55s. Rate: 9.6 symbols/min [2025-09-15T17:39:05.947308] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:06.053480] [DEBUG] [LOCAL ] BXMT: Primary data saved (33962 records). [2025-09-15T17:39:06.053670] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-15T17:39:06.053935] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMT took 25.5s. Estimated remaining: 3h 28m 17s. Rate: 9.6 symbols/min [2025-09-15T17:39:06.075841] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-15T17:39:06.129738] [DEBUG] [LOCAL ] BXSL: Loaded 35067 existing records from primary storage. [2025-09-15T17:39:06.146191] [INFO ] [MAIN ] BXSL: Loaded 35067 existing records. [2025-09-15T17:39:06.340409] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:06.452870] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:06.453126] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-15T17:39:06.453175] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-15T17:39:06.453947] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-15T17:39:06.453998] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-15T17:39:06.557375] [DEBUG] [LOCAL ] BY: Loaded 16124 existing records from primary storage. [2025-09-15T17:39:06.560663] [INFO ] [MAIN ] BY: Loaded 16124 existing records. [2025-09-15T17:39:06.915586] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:06.942104] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-15T17:39:06.976514] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-15T17:39:07.004799] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:07.016968] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-15T17:39:07.016575] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-15T17:39:07.018189] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:39:07.019318] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-15T17:39:07.319921] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:39:07.437172] [INFO ] [REMOTE ] BY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:07.657871] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-15T17:39:08.308318] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:39:08.457919] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-15T17:39:08.801541] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:39:09.257939] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-15T17:39:09.936762] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:39:10.057941] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-15T17:39:10.212574] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:39:10.857913] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-15T17:39:11.018424] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:39:11.657886] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-15T17:39:12.457937] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-15T17:39:12.539380] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:39:12.542370] [INFO ] [REMOTE ] BXMX: Full fetch complete (21311 records). [2025-09-15T17:39:12.542455] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-15T17:39:12.896017] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T17:39:12.963995] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-15T17:39:12.964077] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-15T17:39:12.964548] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-15T17:39:12.964610] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-15T17:39:12.965243] [DEBUG] [LOCAL ] BXMX: Trimmed 21311 records to 13325 (keeping 150 days of data) [2025-09-15T17:39:13.052896] [DEBUG] [LOCAL ] BXMX: Primary data saved (13325 records). [2025-09-15T17:39:13.053063] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-15T17:39:13.053175] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXMX took 21.1s. Estimated remaining: 3h 28m 14s. Rate: 9.6 symbols/min [2025-09-15T17:39:13.232503] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:13.265929] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-15T17:39:13.267927] [DEBUG] [LOCAL ] BYD: Loaded 33858 existing records from primary storage. [2025-09-15T17:39:13.268774] [INFO ] [MAIN ] BYD: Loaded 33858 existing records. [2025-09-15T17:39:13.455919] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:13.456215] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-15T17:39:13.456379] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-15T17:39:13.462303] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-15T17:39:13.471273] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-15T17:39:13.477593] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:39:13.842165] [INFO ] [REMOTE ] BYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:14.057905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-15T17:39:14.656415] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:39:14.857886] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-15T17:39:15.015557] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:39:15.657855] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-15T17:39:15.744262] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T17:39:16.457916] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-15T17:39:17.257885] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-15T17:39:17.318941] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:39:17.355238] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:39:18.057891] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-15T17:39:18.664337] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:39:18.857922] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-15T17:39:19.504934] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:39:19.657870] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-15T17:39:19.822719] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:39:20.457914] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-15T17:39:20.925111] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:39:20.931073] [INFO ] [REMOTE ] BXP: Full fetch complete (54118 records). [2025-09-15T17:39:20.931184] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-15T17:39:21.264335] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-15T17:39:21.318563] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-15T17:39:21.318671] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-15T17:39:21.319326] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-15T17:39:21.319370] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-15T17:39:21.320663] [DEBUG] [LOCAL ] BXP: Trimmed 54118 records to 36565 (keeping 150 days of data) [2025-09-15T17:39:21.553515] [DEBUG] [LOCAL ] BXP: Primary data saved (36565 records). [2025-09-15T17:39:21.553756] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-15T17:39:21.555133] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXP took 27.1s. Estimated remaining: 3h 28m 20s. Rate: 9.6 symbols/min [2025-09-15T17:39:21.725478] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:21.771428] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:39:21.771781] [DEBUG] [LOCAL ] BYM: Loaded 8535 existing records from primary storage. [2025-09-15T17:39:21.785905] [INFO ] [MAIN ] BYM: Loaded 8535 existing records. [2025-09-15T17:39:21.965822] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:21.966108] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-15T17:39:21.966158] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-15T17:39:21.966515] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-15T17:39:21.966571] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-15T17:39:22.063755] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-15T17:39:22.319378] [INFO ] [REMOTE ] BYM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:22.610813] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:39:22.615005] [INFO ] [REMOTE ] BY: Full fetch complete (22517 records). [2025-09-15T17:39:22.615102] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-15T17:39:22.869795] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-15T17:39:23.009852] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-15T17:39:23.009940] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-15T17:39:23.010374] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-15T17:39:23.010415] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-15T17:39:23.011057] [DEBUG] [LOCAL ] BY: Trimmed 22517 records to 15598 (keeping 150 days of data) [2025-09-15T17:39:23.111691] [DEBUG] [LOCAL ] BY: Primary data saved (15598 records). [2025-09-15T17:39:23.111857] [INFO ] [MAIN ] BY: Full history saved. [2025-09-15T17:39:23.111962] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 17.0s. Estimated remaining: 3h 27m 49s. Rate: 9.6 symbols/min [2025-09-15T17:39:23.286875] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:23.310559] [DEBUG] [LOCAL ] BZH: Loaded 24562 existing records from primary storage. [2025-09-15T17:39:23.310758] [INFO ] [MAIN ] BZH: Loaded 24562 existing records. [2025-09-15T17:39:23.499383] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:23.499685] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-15T17:39:23.499748] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-15T17:39:23.500322] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-15T17:39:23.500373] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-15T17:39:23.660959] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-15T17:39:23.865390] [INFO ] [REMOTE ] BZH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:23.908921] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T17:39:24.457835] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-15T17:39:24.571706] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:39:24.603057] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:39:25.257930] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-15T17:39:25.798276] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:39:26.057924] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-15T17:39:26.808892] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:39:26.857817] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-15T17:39:27.108273] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:39:27.657871] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-15T17:39:28.296145] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:39:28.457867] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-15T17:39:29.076811] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:39:29.257890] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-15T17:39:29.789002] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:39:29.822466] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:39:30.057898] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-15T17:39:30.857944] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-15T17:39:31.071555] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T17:39:31.657869] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-15T17:39:32.357122] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:39:32.424344] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:39:32.457894] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-15T17:39:33.210432] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:39:33.257846] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-15T17:39:34.057874] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-15T17:39:34.660416] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:39:34.665245] [INFO ] [REMOTE ] BYD: Full fetch complete (49237 records). [2025-09-15T17:39:34.665330] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-15T17:39:34.794868] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:39:34.867036] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-15T17:39:35.056229] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-15T17:39:35.056329] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-15T17:39:35.056968] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-15T17:39:35.057014] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-15T17:39:35.058264] [DEBUG] [LOCAL ] BYD: Trimmed 49237 records to 33316 (keeping 150 days of data) [2025-09-15T17:39:35.260965] [DEBUG] [LOCAL ] BYD: Primary data saved (33316 records). [2025-09-15T17:39:35.261104] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-15T17:39:35.261694] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BYD took 22.2s. Estimated remaining: 3h 28m 13s. Rate: 9.6 symbols/min [2025-09-15T17:39:35.429807] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:35.435754] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:39:35.477046] [DEBUG] [LOCAL ] C: Loaded 40482 existing records from primary storage. [2025-09-15T17:39:35.477182] [INFO ] [MAIN ] C: Loaded 40482 existing records. [2025-09-15T17:39:35.654518] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:35.654915] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-15T17:39:35.654970] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-15T17:39:35.655819] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-15T17:39:35.655872] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-15T17:39:35.666624] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-15T17:39:36.008414] [INFO ] [REMOTE ] C: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:36.457919] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-15T17:39:36.524058] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:39:36.526667] [INFO ] [REMOTE ] BYM: Full fetch complete (13073 records). [2025-09-15T17:39:36.526747] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-15T17:39:36.898523] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-15T17:39:36.898701] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-15T17:39:36.899155] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-15T17:39:36.899214] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-15T17:39:36.900334] [DEBUG] [LOCAL ] BYM: Trimmed 13073 records to 8410 (keeping 150 days of data) [2025-09-15T17:39:36.955968] [DEBUG] [LOCAL ] BYM: Primary data saved (8410 records). [2025-09-15T17:39:36.956116] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-15T17:39:36.956220] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 15.4s. Estimated remaining: 3h 27m 43s. Rate: 9.6 symbols/min [2025-09-15T17:39:37.123944] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:37.140478] [DEBUG] [LOCAL ] CAAP: Loaded 13531 existing records from primary storage. [2025-09-15T17:39:37.140610] [INFO ] [MAIN ] CAAP: Loaded 13531 existing records. [2025-09-15T17:39:37.263039] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-15T17:39:37.317015] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:37.317210] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-15T17:39:37.317261] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-15T17:39:37.317752] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-15T17:39:37.317804] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-15T17:39:37.664982] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:38.057859] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-15T17:39:38.352393] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T17:39:38.547101] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:39:38.715502] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T17:39:38.857862] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-15T17:39:39.657880] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-15T17:39:39.674569] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:39:40.457878] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-15T17:39:41.082849] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:39:41.257861] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-15T17:39:42.057862] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-15T17:39:42.151992] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:39:42.593994] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:39:42.857937] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-15T17:39:43.406213] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:39:43.657859] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-15T17:39:44.457896] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-15T17:39:44.766634] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T17:39:44.996141] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:39:45.257928] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-15T17:39:45.448592] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:39:46.057930] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-15T17:39:46.857859] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-15T17:39:46.918401] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:39:47.001565] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T17:39:47.591633] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T17:39:47.657849] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-15T17:39:48.208123] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T17:39:48.457904] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-15T17:39:49.257881] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-15T17:39:49.430986] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:39:50.057873] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-15T17:39:50.857891] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-15T17:39:50.980433] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T17:39:51.017699] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:39:51.657884] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-15T17:39:52.043948] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:39:52.457922] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-15T17:39:53.076288] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:39:53.082824] [INFO ] [REMOTE ] BXSL: Full fetch complete (51480 records). [2025-09-15T17:39:53.083191] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-15T17:39:53.268362] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-15T17:39:53.493155] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-15T17:39:53.493254] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-15T17:39:53.493970] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-15T17:39:53.494023] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-15T17:39:53.495358] [DEBUG] [LOCAL ] BXSL: Trimmed 51480 records to 34368 (keeping 150 days of data) [2025-09-15T17:39:53.722189] [DEBUG] [LOCAL ] BXSL: Primary data saved (34368 records). [2025-09-15T17:39:53.722352] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-15T17:39:53.723416] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BXSL took 48.0s. Estimated remaining: 3h 28m 32s. Rate: 9.5 symbols/min [2025-09-15T17:39:53.895065] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:53.912288] [DEBUG] [LOCAL ] CABO: Loaded 13907 existing records from primary storage. [2025-09-15T17:39:53.912419] [INFO ] [MAIN ] CABO: Loaded 13907 existing records. [2025-09-15T17:39:54.064469] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-15T17:39:54.094190] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:54.095895] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-15T17:39:54.095957] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-15T17:39:54.096512] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-15T17:39:54.096565] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-15T17:39:54.453506] [INFO ] [REMOTE ] CABO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:54.480371] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:39:54.802109] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-15T17:39:54.857880] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-15T17:39:54.967884] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:39:54.971036] [INFO ] [REMOTE ] CAAP: Full fetch complete (20168 records). [2025-09-15T17:39:54.971131] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-15T17:39:55.340885] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-15T17:39:55.340994] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-15T17:39:55.341579] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-15T17:39:55.341634] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-15T17:39:55.342497] [DEBUG] [LOCAL ] CAAP: Trimmed 20168 records to 13239 (keeping 150 days of data) [2025-09-15T17:39:55.427254] [DEBUG] [LOCAL ] CAAP: Primary data saved (13239 records). [2025-09-15T17:39:55.427486] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-15T17:39:55.427608] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 18.5s. Estimated remaining: 3h 28m 2s. Rate: 9.6 symbols/min [2025-09-15T17:39:55.608578] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:55.622905] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:39:55.644755] [DEBUG] [LOCAL ] CACI: Loaded 17208 existing records from primary storage. [2025-09-15T17:39:55.644950] [INFO ] [MAIN ] CACI: Loaded 17208 existing records. [2025-09-15T17:39:55.666615] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-15T17:39:55.829297] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:55.829672] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-15T17:39:55.829732] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-15T17:39:55.830256] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-15T17:39:55.830305] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-15T17:39:56.183412] [INFO ] [REMOTE ] CACI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:56.457896] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-15T17:39:57.267999] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-15T17:39:57.293969] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:39:57.431002] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T17:39:58.000398] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T17:39:58.057872] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-15T17:39:58.857932] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-15T17:39:58.936671] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:39:59.657861] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-15T17:40:00.457869] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-15T17:40:00.628328] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:40:00.636580] [INFO ] [REMOTE ] C: Full fetch complete (58421 records). [2025-09-15T17:40:00.636752] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-15T17:40:01.062306] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-15T17:40:01.062455] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-15T17:40:01.063253] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-15T17:40:01.063312] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-15T17:40:01.064762] [DEBUG] [LOCAL ] C: Trimmed 58421 records to 39702 (keeping 150 days of data) [2025-09-15T17:40:01.182201] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:40:01.276547] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-15T17:40:01.357317] [DEBUG] [LOCAL ] C: Primary data saved (39702 records). [2025-09-15T17:40:01.357592] [INFO ] [MAIN ] C: Full history saved. [2025-09-15T17:40:01.359064] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 26.1s. Estimated remaining: 3h 27m 53s. Rate: 9.6 symbols/min [2025-09-15T17:40:01.445808] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:40:01.485933] [INFO ] [REMOTE ] BZH: Full fetch complete (36374 records). [2025-09-15T17:40:01.501574] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-15T17:40:01.619904] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:01.964950] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-15T17:40:01.966357] [DEBUG] [LOCAL ] CADE: Loaded 37014 existing records from primary storage. [2025-09-15T17:40:01.966537] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-15T17:40:01.966677] [INFO ] [MAIN ] CADE: Loaded 37014 existing records. [2025-09-15T17:40:01.967465] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-15T17:40:02.015292] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-15T17:40:02.062977] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-15T17:40:02.088770] [DEBUG] [LOCAL ] BZH: Trimmed 36374 records to 24078 (keeping 150 days of data) [2025-09-15T17:40:02.213521] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:02.255743] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-15T17:40:02.256682] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-15T17:40:02.259266] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-15T17:40:02.259987] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-15T17:40:02.644965] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:40:02.683484] [INFO ] [REMOTE ] CADE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:02.717951] [DEBUG] [LOCAL ] BZH: Primary data saved (24078 records). [2025-09-15T17:40:02.718120] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-15T17:40:02.718235] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. BZH took 39.6s. Estimated remaining: 3h 27m 22s. Rate: 9.6 symbols/min [2025-09-15T17:40:02.866108] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-15T17:40:02.898470] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:02.932565] [DEBUG] [LOCAL ] CAE: Loaded 28792 existing records from primary storage. [2025-09-15T17:40:02.932752] [INFO ] [MAIN ] CAE: Loaded 28792 existing records. [2025-09-15T17:40:03.116875] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:03.117210] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-15T17:40:03.117327] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-15T17:40:03.123328] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-15T17:40:03.131076] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-15T17:40:03.137271] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:40:03.553023] [INFO ] [REMOTE ] CAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:03.657868] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-15T17:40:04.457935] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-15T17:40:04.531731] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T17:40:05.257858] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-15T17:40:05.299417] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:40:05.479628] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:40:06.057880] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-15T17:40:06.115307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:40:06.857907] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-15T17:40:07.182519] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:40:07.657857] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-15T17:40:07.962974] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:40:08.457857] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-15T17:40:08.721070] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:40:09.257890] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-15T17:40:09.368755] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:40:09.967067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:40:10.057867] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-15T17:40:10.857885] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-15T17:40:11.133244] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:40:11.657857] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-15T17:40:12.248940] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T17:40:12.328874] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:40:12.331432] [INFO ] [REMOTE ] CACI: Full fetch complete (29622 records). [2025-09-15T17:40:12.331508] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-15T17:40:12.472970] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-15T17:40:12.728320] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-15T17:40:12.728432] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-15T17:40:12.728898] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-15T17:40:12.728941] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-15T17:40:12.729664] [DEBUG] [LOCAL ] CACI: Trimmed 29622 records to 16695 (keeping 150 days of data) [2025-09-15T17:40:12.834266] [DEBUG] [LOCAL ] CACI: Primary data saved (16695 records). [2025-09-15T17:40:12.834420] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-15T17:40:12.834507] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CACI took 17.4s. Estimated remaining: 3h 27m 35s. Rate: 9.6 symbols/min [2025-09-15T17:40:13.001381] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:13.005561] [DEBUG] [LOCAL ] CAF: Loaded 2328 existing records from primary storage. [2025-09-15T17:40:13.005669] [INFO ] [MAIN ] CAF: Loaded 2328 existing records. [2025-09-15T17:40:13.181577] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:13.181861] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-15T17:40:13.181908] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-15T17:40:13.182151] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-15T17:40:13.182197] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-15T17:40:13.263070] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-15T17:40:13.540269] [INFO ] [REMOTE ] CAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:14.057866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-15T17:40:14.099584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:40:14.167630] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:40:14.169675] [INFO ] [REMOTE ] CABO: Full fetch complete (19093 records). [2025-09-15T17:40:14.169750] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-15T17:40:14.544784] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-15T17:40:14.544901] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-15T17:40:14.545350] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-15T17:40:14.545399] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-15T17:40:14.546124] [DEBUG] [LOCAL ] CABO: Trimmed 19093 records to 13796 (keeping 150 days of data) [2025-09-15T17:40:14.636808] [DEBUG] [LOCAL ] CABO: Primary data saved (13796 records). [2025-09-15T17:40:14.636965] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-15T17:40:14.637056] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CABO took 20.9s. Estimated remaining: 3h 27m 6s. Rate: 9.6 symbols/min [2025-09-15T17:40:14.815019] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:14.859907] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-15T17:40:14.861633] [DEBUG] [LOCAL ] CAG: Loaded 40406 existing records from primary storage. [2025-09-15T17:40:14.861752] [INFO ] [MAIN ] CAG: Loaded 40406 existing records. [2025-09-15T17:40:15.058718] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:15.059662] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-15T17:40:15.059720] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-15T17:40:15.061027] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-15T17:40:15.061085] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-15T17:40:15.453163] [INFO ] [REMOTE ] CAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:15.657901] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-15T17:40:16.335187] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:40:16.460907] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-15T17:40:16.463573] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T17:40:17.257878] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-15T17:40:17.908894] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:40:18.064691] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-15T17:40:18.067012] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (4.01 seconds). [2025-09-15T17:40:18.386708] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:40:18.857876] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-15T17:40:19.657864] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-15T17:40:19.725409] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:40:20.233249] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:40:20.457844] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-15T17:40:21.003488] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:40:21.257846] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-15T17:40:21.330108] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:40:21.595637] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:40:22.057921] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-15T17:40:22.465398] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:40:22.857954] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-15T17:40:23.657944] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-15T17:40:24.140022] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:40:24.274303] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T17:40:24.457900] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-15T17:40:25.257905] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-15T17:40:25.796628] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:40:25.860502] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:40:26.057866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-15T17:40:26.857936] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-15T17:40:27.455766] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:40:27.657873] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-15T17:40:28.457872] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-15T17:40:28.536360] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:40:28.541929] [INFO ] [REMOTE ] CADE: Full fetch complete (52696 records). [2025-09-15T17:40:28.542034] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-15T17:40:28.918718] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-15T17:40:28.918818] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-15T17:40:28.919520] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-15T17:40:28.919567] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-15T17:40:28.920874] [DEBUG] [LOCAL ] CADE: Trimmed 52696 records to 36349 (keeping 150 days of data) [2025-09-15T17:40:29.151294] [DEBUG] [LOCAL ] CADE: Primary data saved (36349 records). [2025-09-15T17:40:29.151549] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-15T17:40:29.151881] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CADE took 27.8s. Estimated remaining: 3h 27m 42s. Rate: 9.5 symbols/min [2025-09-15T17:40:29.259737] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-15T17:40:29.353058] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:29.407777] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:40:29.433271] [DEBUG] [LOCAL ] CAH: Loaded 38710 existing records from primary storage. [2025-09-15T17:40:29.433427] [INFO ] [MAIN ] CAH: Loaded 38710 existing records. [2025-09-15T17:40:29.611178] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:29.611413] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-15T17:40:29.611459] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-15T17:40:29.612343] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-15T17:40:29.612392] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-15T17:40:29.879475] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:40:29.981153] [INFO ] [REMOTE ] CAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:30.005110] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:40:30.057837] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-15T17:40:30.857882] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-15T17:40:31.183531] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:40:31.183857] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:40:31.190439] [INFO ] [REMOTE ] CAE: Full fetch complete (42467 records). [2025-09-15T17:40:31.190565] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-15T17:40:31.585791] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-15T17:40:31.585886] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-15T17:40:31.586465] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-15T17:40:31.586510] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-15T17:40:31.587622] [DEBUG] [LOCAL ] CAE: Trimmed 42467 records to 28270 (keeping 150 days of data) [2025-09-15T17:40:31.673688] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-15T17:40:31.772384] [DEBUG] [LOCAL ] CAE: Primary data saved (28270 records). [2025-09-15T17:40:31.772557] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-15T17:40:31.772680] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAE took 29.1s. Estimated remaining: 3h 27m 17s. Rate: 9.6 symbols/min [2025-09-15T17:40:31.955305] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:31.991303] [DEBUG] [LOCAL ] CAL: Loaded 32070 existing records from primary storage. [2025-09-15T17:40:31.991486] [INFO ] [MAIN ] CAL: Loaded 32070 existing records. [2025-09-15T17:40:32.168893] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:32.169143] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-15T17:40:32.169190] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-15T17:40:32.169893] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-15T17:40:32.169941] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-15T17:40:32.463127] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-15T17:40:32.536014] [INFO ] [REMOTE ] CAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:33.126846] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:40:33.257888] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-15T17:40:33.907313] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:40:34.057858] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-15T17:40:34.739141] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:40:34.857914] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-15T17:40:35.577110] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:40:35.657888] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-15T17:40:36.149536] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:40:36.272945] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:40:36.273925] [INFO ] [REMOTE ] CAF: Full fetch complete (3939 records). [2025-09-15T17:40:36.273994] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-15T17:40:36.465401] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-15T17:40:36.641193] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-15T17:40:36.641301] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-15T17:40:36.641452] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-15T17:40:36.641493] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-15T17:40:36.641998] [DEBUG] [LOCAL ] CAF: Trimmed 3939 records to 2269 (keeping 150 days of data) [2025-09-15T17:40:36.657116] [DEBUG] [LOCAL ] CAF: Primary data saved (2269 records). [2025-09-15T17:40:36.657190] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-15T17:40:36.657289] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAF took 23.8s. Estimated remaining: 3h 27m 4s. Rate: 9.6 symbols/min [2025-09-15T17:40:36.830080] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:36.858256] [DEBUG] [LOCAL ] CALX: Loaded 28955 existing records from primary storage. [2025-09-15T17:40:36.858399] [INFO ] [MAIN ] CALX: Loaded 28955 existing records. [2025-09-15T17:40:37.033472] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:37.033740] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-15T17:40:37.033799] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-15T17:40:37.034380] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-15T17:40:37.034444] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-15T17:40:37.271141] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-15T17:40:37.391480] [INFO ] [REMOTE ] CALX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:38.057891] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-15T17:40:38.258431] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T17:40:38.857882] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-15T17:40:39.223230] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:40:39.400167] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T17:40:39.657954] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-15T17:40:40.457938] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-15T17:40:40.513470] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:40:41.084539] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:40:41.257857] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-15T17:40:41.789999] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:40:42.057880] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-15T17:40:42.769754] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:40:42.857893] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-15T17:40:43.657932] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-15T17:40:43.720572] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:40:43.726444] [INFO ] [REMOTE ] CAG: Full fetch complete (58335 records). [2025-09-15T17:40:43.726563] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-15T17:40:44.103105] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-15T17:40:44.103184] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-15T17:40:44.103869] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-15T17:40:44.103923] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-15T17:40:44.105076] [DEBUG] [LOCAL ] CAG: Trimmed 58335 records to 39628 (keeping 150 days of data) [2025-09-15T17:40:44.353433] [DEBUG] [LOCAL ] CAG: Primary data saved (39628 records). [2025-09-15T17:40:44.353615] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-15T17:40:44.354231] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAG took 29.7s. Estimated remaining: 3h 27m 5s. Rate: 9.6 symbols/min [2025-09-15T17:40:44.460699] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-15T17:40:44.542472] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:44.565625] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T17:40:44.599367] [DEBUG] [LOCAL ] CANG: Loaded 20289 existing records from primary storage. [2025-09-15T17:40:44.599499] [INFO ] [MAIN ] CANG: Loaded 20289 existing records. [2025-09-15T17:40:44.775011] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:44.775341] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-15T17:40:44.775471] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-15T17:40:44.776107] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-15T17:40:44.776228] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-15T17:40:44.978473] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:40:45.165476] [INFO ] [REMOTE ] CANG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:45.257822] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-15T17:40:45.488374] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T17:40:46.057883] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-15T17:40:46.414395] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:40:46.857886] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-15T17:40:47.277083] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:40:47.657848] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-15T17:40:47.736943] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T17:40:48.457952] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-15T17:40:49.104195] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:40:49.257868] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-15T17:40:49.930731] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:40:50.057850] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-15T17:40:50.692531] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:40:50.697799] [INFO ] [REMOTE ] CAL: Full fetch complete (46959 records). [2025-09-15T17:40:50.697914] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-15T17:40:50.858179] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-15T17:40:51.114889] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-15T17:40:51.114977] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-15T17:40:51.115593] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-15T17:40:51.115636] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-15T17:40:51.116728] [DEBUG] [LOCAL ] CAL: Trimmed 46959 records to 31389 (keeping 150 days of data) [2025-09-15T17:40:51.315213] [DEBUG] [LOCAL ] CAL: Primary data saved (31389 records). [2025-09-15T17:40:51.315395] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-15T17:40:51.315717] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAL took 19.5s. Estimated remaining: 3h 27m 2s. Rate: 9.6 symbols/min [2025-09-15T17:40:51.487780] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:51.515062] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:40:51.527821] [DEBUG] [LOCAL ] CAPL: Loaded 3919 existing records from primary storage. [2025-09-15T17:40:51.528635] [INFO ] [MAIN ] CAPL: Loaded 3919 existing records. [2025-09-15T17:40:51.668760] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-15T17:40:51.706954] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:51.707211] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-15T17:40:51.707257] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-15T17:40:51.707532] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-15T17:40:51.707577] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-15T17:40:52.068315] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:52.080983] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:40:52.457885] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-15T17:40:52.879162] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:40:52.999756] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:40:53.257878] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-15T17:40:54.057879] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-15T17:40:54.560797] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:40:54.857876] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-15T17:40:55.271929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:40:55.565899] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:40:55.657864] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-15T17:40:56.457885] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-15T17:40:56.786189] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:40:57.160636] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T17:40:57.257817] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-15T17:40:57.665949] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T17:40:58.057869] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-15T17:40:58.550254] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:40:58.857881] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-15T17:40:59.657867] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-15T17:41:00.102996] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:41:00.108689] [INFO ] [REMOTE ] CAH: Full fetch complete (56139 records). [2025-09-15T17:41:00.108824] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-15T17:41:00.470477] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-15T17:41:00.489986] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-15T17:41:00.490068] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-15T17:41:00.490877] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-15T17:41:00.491032] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-15T17:41:00.507354] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:41:00.512798] [DEBUG] [LOCAL ] CAH: Trimmed 56139 records to 37932 (keeping 150 days of data) [2025-09-15T17:41:00.759821] [DEBUG] [LOCAL ] CAH: Primary data saved (37932 records). [2025-09-15T17:41:00.760001] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-15T17:41:00.760729] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 31.6s. Estimated remaining: 3h 27m 12s. Rate: 9.5 symbols/min [2025-09-15T17:41:00.931552] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:00.971445] [DEBUG] [LOCAL ] CARR: Loaded 40349 existing records from primary storage. [2025-09-15T17:41:00.971596] [INFO ] [MAIN ] CARR: Loaded 40349 existing records. [2025-09-15T17:41:01.149235] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:01.149550] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-15T17:41:01.149619] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-15T17:41:01.150627] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-15T17:41:01.150723] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-15T17:41:01.257856] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-15T17:41:01.334379] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:41:01.522457] [INFO ] [REMOTE ] CARR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:02.057867] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-15T17:41:02.773192] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:41:02.777040] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:41:02.857888] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-15T17:41:03.392261] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T17:41:03.393704] [INFO ] [REMOTE ] CAPL: Full fetch complete (6447 records). [2025-09-15T17:41:03.393828] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-15T17:41:03.663075] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-15T17:41:03.772576] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-15T17:41:03.772711] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-15T17:41:03.772953] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-15T17:41:03.773002] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-15T17:41:03.773990] [DEBUG] [LOCAL ] CAPL: Trimmed 6447 records to 3877 (keeping 150 days of data) [2025-09-15T17:41:03.798906] [DEBUG] [LOCAL ] CAPL: Primary data saved (3877 records). [2025-09-15T17:41:03.799050] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-15T17:41:03.799156] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CAPL took 12.5s. Estimated remaining: 3h 26m 49s. Rate: 9.6 symbols/min [2025-09-15T17:41:03.972236] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:04.004632] [DEBUG] [LOCAL ] CARS: Loaded 29560 existing records from primary storage. [2025-09-15T17:41:04.004806] [INFO ] [MAIN ] CARS: Loaded 29560 existing records. [2025-09-15T17:41:04.181760] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:04.182026] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-15T17:41:04.182077] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-15T17:41:04.182860] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-15T17:41:04.182922] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-15T17:41:04.457943] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-15T17:41:04.537570] [INFO ] [REMOTE ] CARS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:05.174846] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:41:05.257853] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-15T17:41:05.700543] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:41:06.057886] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-15T17:41:06.561282] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:41:06.857899] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-15T17:41:07.460114] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:41:07.657880] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-15T17:41:08.212271] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:41:08.216236] [INFO ] [REMOTE ] CANG: Full fetch complete (29085 records). [2025-09-15T17:41:08.216338] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-15T17:41:08.465697] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-15T17:41:08.589779] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-15T17:41:08.589861] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-15T17:41:08.590326] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-15T17:41:08.590377] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-15T17:41:08.591867] [DEBUG] [LOCAL ] CANG: Trimmed 29085 records to 20242 (keeping 150 days of data) [2025-09-15T17:41:08.711471] [DEBUG] [LOCAL ] CANG: Primary data saved (20242 records). [2025-09-15T17:41:08.711675] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-15T17:41:08.717189] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CANG took 24.4s. Estimated remaining: 3h 26m 36s. Rate: 9.6 symbols/min [2025-09-15T17:41:08.796745] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:41:08.846253] [INFO ] [REMOTE ] CALX: Full fetch complete (41895 records). [2025-09-15T17:41:08.861865] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-15T17:41:08.906705] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:09.277119] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-15T17:41:09.303923] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-15T17:41:09.304023] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-15T17:41:09.304621] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-15T17:41:09.309843] [DEBUG] [LOCAL ] CAT: Loaded 39807 existing records from primary storage. [2025-09-15T17:41:09.310194] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-15T17:41:09.310296] [INFO ] [MAIN ] CAT: Loaded 39807 existing records. [2025-09-15T17:41:09.419948] [DEBUG] [LOCAL ] CALX: Trimmed 41895 records to 28396 (keeping 150 days of data) [2025-09-15T17:41:09.550220] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:09.583562] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-15T17:41:09.584609] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-15T17:41:09.587895] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-15T17:41:09.589292] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-15T17:41:10.036384] [INFO ] [REMOTE ] CAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:10.047209] [DEBUG] [LOCAL ] CALX: Primary data saved (28396 records). [2025-09-15T17:41:10.057397] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-15T17:41:10.057624] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CALX took 33.4s. Estimated remaining: 3h 26m 5s. Rate: 9.6 symbols/min [2025-09-15T17:41:10.064360] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-15T17:41:10.064303] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:41:10.247057] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:10.255681] [DEBUG] [LOCAL ] CATO: Loaded 5126 existing records from primary storage. [2025-09-15T17:41:10.255830] [INFO ] [MAIN ] CATO: Loaded 5126 existing records. [2025-09-15T17:41:10.432151] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:10.432455] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-15T17:41:10.432510] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-15T17:41:10.432767] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-15T17:41:10.432860] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-15T17:41:10.783209] [INFO ] [REMOTE ] CATO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:10.870088] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-15T17:41:10.876130] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T17:41:11.598088] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:41:11.657888] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-15T17:41:11.851069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T17:41:12.457873] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-15T17:41:13.204088] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:41:13.257891] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-15T17:41:14.057903] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-15T17:41:14.441896] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T17:41:14.857903] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-15T17:41:15.023579] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:41:15.275174] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:41:15.498192] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:41:15.658008] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-15T17:41:16.457929] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-15T17:41:16.981434] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:41:17.257875] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-15T17:41:18.057896] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-15T17:41:18.626825] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T17:41:18.868601] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-15T17:41:18.877250] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:41:19.013564] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:41:19.657918] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-15T17:41:20.341214] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:41:20.457878] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-15T17:41:20.771716] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T17:41:20.924756] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:41:21.257919] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-15T17:41:22.057883] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-15T17:41:22.857867] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-15T17:41:22.943755] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:41:23.186727] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:41:23.657892] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-15T17:41:24.040081] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:41:24.209911] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:41:24.457945] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-15T17:41:25.257897] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-15T17:41:25.743929] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T17:41:26.057931] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-15T17:41:26.340521] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:41:26.857883] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-15T17:41:27.405976] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:41:27.657896] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-15T17:41:28.133038] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:41:28.457898] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-15T17:41:28.630676] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:41:29.257923] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-15T17:41:29.913221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T17:41:29.919156] [INFO ] [REMOTE ] CARR: Full fetch complete (58279 records). [2025-09-15T17:41:29.919256] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-15T17:41:30.062996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-15T17:41:30.306903] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-15T17:41:30.307000] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-15T17:41:30.307728] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-15T17:41:30.307780] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-15T17:41:30.309402] [DEBUG] [LOCAL ] CARR: Trimmed 58279 records to 39576 (keeping 150 days of data) [2025-09-15T17:41:30.555355] [DEBUG] [LOCAL ] CARR: Primary data saved (39576 records). [2025-09-15T17:41:30.555501] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-15T17:41:30.555585] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARR took 29.8s. Estimated remaining: 3h 27m 10s. Rate: 9.5 symbols/min [2025-09-15T17:41:30.725132] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:30.764033] [DEBUG] [LOCAL ] CAVA: Loaded 40321 existing records from primary storage. [2025-09-15T17:41:30.764177] [INFO ] [MAIN ] CAVA: Loaded 40321 existing records. [2025-09-15T17:41:30.867415] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-15T17:41:30.872311] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:41:30.896070] [INFO ] [REMOTE ] CATO: Full fetch complete (8214 records). [2025-09-15T17:41:30.933602] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-15T17:41:30.987372] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:31.059393] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-15T17:41:31.059570] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-15T17:41:31.065871] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-15T17:41:31.076198] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-15T17:41:31.612297] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-15T17:41:31.623783] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-15T17:41:31.624396] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-15T17:41:31.650927] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-15T17:41:31.706486] [DEBUG] [LOCAL ] CATO: Trimmed 8214 records to 5040 (keeping 150 days of data) [2025-09-15T17:41:31.725639] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:31.729845] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-15T17:41:31.732592] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-15T17:41:31.768902] [INFO ] [REMOTE ] CAT: Full fetch complete (57572 records). [2025-09-15T17:41:31.773764] [DEBUG] [LOCAL ] CATO: Primary data saved (5040 records). [2025-09-15T17:41:31.773968] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-15T17:41:31.774908] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-15T17:41:31.775169] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 21.7s. Estimated remaining: 3h 26m 38s. Rate: 9.5 symbols/min [2025-09-15T17:41:32.215773] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:32.444408] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-15T17:41:32.459299] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-15T17:41:32.448044] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:41:32.460862] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-15T17:41:32.461051] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-15T17:41:32.471500] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-15T17:41:32.474343] [DEBUG] [LOCAL ] CAT: Trimmed 57572 records to 39023 (keeping 150 days of data) [2025-09-15T17:41:32.488537] [DEBUG] [LOCAL ] CB: Loaded 37384 existing records from primary storage. [2025-09-15T17:41:32.489195] [INFO ] [MAIN ] CB: Loaded 37384 existing records. [2025-09-15T17:41:32.785926] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:32.787246] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-15T17:41:32.787316] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-15T17:41:32.789045] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-15T17:41:32.789621] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-15T17:41:33.165977] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:33.278617] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-15T17:41:33.321772] [DEBUG] [LOCAL ] CAT: Primary data saved (39023 records). [2025-09-15T17:41:33.322019] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-15T17:41:33.323223] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 24.6s. Estimated remaining: 3h 26m 8s. Rate: 9.6 symbols/min [2025-09-15T17:41:33.428305] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:41:33.553488] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:41:34.057895] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-15T17:41:34.849461] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:41:34.858467] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-15T17:41:35.000040] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:41:35.004318] [INFO ] [REMOTE ] CARS: Full fetch complete (43503 records). [2025-09-15T17:41:35.004470] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-15T17:41:35.378776] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-15T17:41:35.378869] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-15T17:41:35.379448] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-15T17:41:35.379491] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-15T17:41:35.380611] [DEBUG] [LOCAL ] CARS: Trimmed 43503 records to 28899 (keeping 150 days of data) [2025-09-15T17:41:35.562701] [DEBUG] [LOCAL ] CARS: Primary data saved (28899 records). [2025-09-15T17:41:35.562865] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-15T17:41:35.563004] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CARS took 31.8s. Estimated remaining: 3h 25m 42s. Rate: 9.6 symbols/min [2025-09-15T17:41:35.657937] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-15T17:41:36.473157] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:41:36.484828] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-15T17:41:37.296109] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:41:37.306755] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-15T17:41:38.042368] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:41:38.057814] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-15T17:41:39.106246] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T17:41:39.117191] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-15T17:41:39.567708] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:41:39.657880] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-15T17:41:40.843624] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:41:40.853816] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-15T17:41:41.702247] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T17:41:41.713069] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-15T17:41:42.432938] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:41:42.443052] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-15T17:41:43.311658] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:41:43.323514] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-15T17:41:43.922100] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:41:43.933307] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-15T17:41:45.632461] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:41:45.643193] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-15T17:41:45.721317] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-15T17:41:45.733976] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-15T17:41:47.449695] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T17:41:47.454981] [INFO ] [REMOTE ] CB: Full fetch complete (53989 records). [2025-09-15T17:41:47.455081] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-15T17:41:47.455695] [FATAL] [VALIDATOR ] CB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:41:47.455772] [FATAL] [MAIN ] CB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:41:47.455827] [WARN ] [MAIN ] CB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:41:47.455870] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-15T17:41:47.455930] [DEBUG] [LOCAL ] CB: No primary data file found to delete. [2025-09-15T17:41:47.455987] [INFO ] [LOCAL ] CB: Starting deletion of derivative data. [2025-09-15T17:41:47.456413] [DEBUG] [LOCAL ] CB: Deleted derivative data file. [2025-09-15T17:41:47.456512] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CB took 15.7s. Estimated remaining: 3h 26m 4s. Rate: 9.6 symbols/min [2025-09-15T17:41:47.662303] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T17:41:47.667719] [INFO ] [REMOTE ] CAVA: Full fetch complete (57804 records). [2025-09-15T17:41:47.667837] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-15T17:41:47.668564] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:41:47.668661] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:41:47.668702] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:41:47.668745] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-15T17:41:47.668803] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-15T17:41:47.668838] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-09-15T17:41:47.669080] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-09-15T17:41:47.669160] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CAVA took 17.1s. Estimated remaining: 3h 25m 28s. Rate: 9.6 symbols/min [2025-09-15T17:41:48.245581] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.247300] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.301629] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-15T17:41:48.347584] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-15T17:41:48.347492] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.374278] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.373391] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-15T17:41:48.375249] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-15T17:41:48.375332] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-15T17:41:48.375370] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-15T17:41:48.422708] [DEBUG] [LOCAL ] CBAN: Loaded 7543 existing records from primary storage. [2025-09-15T17:41:48.466042] [DEBUG] [LOCAL ] CBNA: Loaded 2374 existing records from primary storage. [2025-09-15T17:41:48.476722] [INFO ] [MAIN ] CBNA: Loaded 2374 existing records. [2025-09-15T17:41:48.471337] [INFO ] [MAIN ] CBAN: Loaded 7543 existing records. [2025-09-15T17:41:48.583355] [DEBUG] [LOCAL ] CBL: Loaded 12055 existing records from primary storage. [2025-09-15T17:41:48.759569] [INFO ] [MAIN ] CBL: Loaded 12055 existing records. [2025-09-15T17:41:49.021419] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.104723] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.170853] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-15T17:41:49.165361] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.191596] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.202206] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-15T17:41:49.202297] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-15T17:41:49.237004] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-15T17:41:49.274189] [INFO ] [REMOTE ] CBO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:49.280365] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-15T17:41:49.289593] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-15T17:41:49.330740] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-15T17:41:49.444064] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.529782] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.538773] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-15T17:41:49.611062] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-15T17:41:49.659382] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-15T17:41:49.659103] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:41:49.903691] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-15T17:41:49.958387] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-15T17:41:50.161431] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.204550] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-15T17:41:50.452344] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.461153] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-15T17:41:50.482492] [INFO ] [REMOTE ] CBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.482874] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-15T17:41:50.543067] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T17:41:50.543930] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-15T17:41:50.767218] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-15T17:41:50.857867] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-15T17:41:50.893387] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:41:50.978273] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:41:51.265593] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:41:51.553300] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:41:51.657876] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-15T17:41:52.285289] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:41:52.457870] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-15T17:41:52.830772] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:41:53.257870] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-15T17:41:54.057909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-15T17:41:54.188221] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:41:54.499339] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T17:41:54.857879] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-15T17:41:55.440754] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:41:55.657878] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-15T17:41:56.050757] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T17:41:56.457871] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-15T17:41:56.703559] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T17:41:57.257870] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-15T17:41:57.473789] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:41:58.057885] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-15T17:41:58.815986] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:41:58.857886] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-15T17:41:59.587673] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T17:41:59.657874] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-15T17:42:00.400058] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:42:00.457875] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-15T17:42:00.887116] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:42:01.257874] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-15T17:42:01.840451] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:42:02.057863] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-15T17:42:02.597716] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:42:02.598612] [INFO ] [REMOTE ] CBNA: Full fetch complete (3201 records). [2025-09-15T17:42:02.598699] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-15T17:42:02.862938] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-15T17:42:02.972251] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-15T17:42:02.972331] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-15T17:42:02.972446] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-15T17:42:02.972485] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-15T17:42:02.972881] [DEBUG] [LOCAL ] CBNA: Trimmed 3201 records to 2270 (keeping 150 days of data) [2025-09-15T17:42:02.987867] [DEBUG] [LOCAL ] CBNA: Primary data saved (2270 records). [2025-09-15T17:42:02.988001] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-15T17:42:02.988103] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBNA took 15.3s. Estimated remaining: 3h 26m 6s. Rate: 9.5 symbols/min [2025-09-15T17:42:03.161037] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:03.198350] [DEBUG] [LOCAL ] CBRE: Loaded 37804 existing records from primary storage. [2025-09-15T17:42:03.198516] [INFO ] [MAIN ] CBRE: Loaded 37804 existing records. [2025-09-15T17:42:03.372499] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:03.372744] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-15T17:42:03.372789] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-15T17:42:03.373527] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-15T17:42:03.373572] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-15T17:42:03.661840] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-15T17:42:03.733726] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:03.736604] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:42:04.125921] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:04.126384] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-15T17:42:04.457860] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-15T17:42:05.181952] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:42:05.257957] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-15T17:42:06.057837] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-15T17:42:06.206545] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:42:06.857893] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-15T17:42:06.915908] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:42:07.181027] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:07.181342] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-15T17:42:07.181429] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-15T17:42:07.181491] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-15T17:42:07.182131] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:42:07.182202] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:07.182242] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:07.182287] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-15T17:42:07.182347] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-15T17:42:07.182383] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-15T17:42:07.182447] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-15T17:42:07.182510] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBO took 19.5s. Estimated remaining: 3h 25m 49s. Rate: 9.6 symbols/min [2025-09-15T17:42:07.349581] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:07.371257] [DEBUG] [LOCAL ] CBT: Loaded 23085 existing records from primary storage. [2025-09-15T17:42:07.371396] [INFO ] [MAIN ] CBT: Loaded 23085 existing records. [2025-09-15T17:42:07.551991] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:07.552279] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-15T17:42:07.552328] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-15T17:42:07.553049] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-15T17:42:07.553124] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-15T17:42:07.663060] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-15T17:42:08.027425] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:08.457952] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-15T17:42:09.079961] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:42:09.257897] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-15T17:42:10.061471] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-15T17:42:10.063451] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:42:10.184725] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:42:10.676374] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:42:10.857893] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-15T17:42:11.657885] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-15T17:42:12.457888] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-15T17:42:12.498903] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:42:12.971310] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:42:13.257916] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-15T17:42:13.358353] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:42:13.360439] [INFO ] [REMOTE ] CBL: Full fetch complete (18646 records). [2025-09-15T17:42:13.360553] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-15T17:42:13.729620] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-15T17:42:13.729737] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-15T17:42:13.730138] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-15T17:42:13.730178] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-15T17:42:13.730743] [DEBUG] [LOCAL ] CBL: Trimmed 18646 records to 11888 (keeping 150 days of data) [2025-09-15T17:42:13.803415] [DEBUG] [LOCAL ] CBL: Primary data saved (11888 records). [2025-09-15T17:42:13.803553] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-15T17:42:13.803655] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 26.1s. Estimated remaining: 3h 25m 45s. Rate: 9.6 symbols/min [2025-09-15T17:42:13.969969] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:13.986139] [DEBUG] [LOCAL ] CBU: Loaded 16496 existing records from primary storage. [2025-09-15T17:42:13.986252] [INFO ] [MAIN ] CBU: Loaded 16496 existing records. [2025-09-15T17:42:14.063027] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-15T17:42:14.160876] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:14.161109] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-15T17:42:14.161154] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-15T17:42:14.161894] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-15T17:42:14.162029] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-15T17:42:14.521572] [INFO ] [REMOTE ] CBU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:14.609597] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:42:14.857858] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-15T17:42:15.234456] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:42:15.657858] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-15T17:42:16.023292] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:42:16.132915] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:42:16.457926] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-15T17:42:17.257898] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-15T17:42:18.057867] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-15T17:42:18.116565] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:42:18.117269] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:42:18.129726] [INFO ] [REMOTE ] CBAN: Full fetch complete (12326 records). [2025-09-15T17:42:18.129823] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-15T17:42:18.496813] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-15T17:42:18.496914] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-15T17:42:18.497197] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-15T17:42:18.497246] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-15T17:42:18.497753] [DEBUG] [LOCAL ] CBAN: Trimmed 12326 records to 7399 (keeping 150 days of data) [2025-09-15T17:42:18.548023] [DEBUG] [LOCAL ] CBAN: Primary data saved (7399 records). [2025-09-15T17:42:18.548182] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-15T17:42:18.548276] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBAN took 30.9s. Estimated remaining: 3h 25m 31s. Rate: 9.6 symbols/min [2025-09-15T17:42:18.719588] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:18.719816] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-15T17:42:18.719858] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-15T17:42:18.719992] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-15T17:42:18.720033] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-15T17:42:18.720079] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-15T17:42:18.720111] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-15T17:42:18.862965] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-15T17:42:19.085323] [INFO ] [REMOTE ] CBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:19.135983] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:42:19.657888] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-15T17:42:20.196160] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:42:20.415751] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:42:20.457817] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-15T17:42:21.257906] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-15T17:42:21.458332] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:42:22.057929] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-15T17:42:22.662506] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:42:22.699867] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:42:22.857882] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-15T17:42:23.657905] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-15T17:42:24.444123] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:42:24.457805] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-15T17:42:24.831238] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:42:25.257922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-15T17:42:25.713810] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:42:26.057941] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-15T17:42:26.331445] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:26.331804] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-15T17:42:26.494731] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:42:26.857903] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-15T17:42:27.042356] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:27.042685] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-15T17:42:27.657888] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-15T17:42:28.457897] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-15T17:42:28.918838] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:42:29.257886] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-15T17:42:30.057900] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-15T17:42:30.151340] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:42:30.157085] [INFO ] [REMOTE ] CBRE: Full fetch complete (55239 records). [2025-09-15T17:42:30.157208] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-15T17:42:30.306033] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:30.316034] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-15T17:42:30.564808] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-15T17:42:30.564983] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-15T17:42:30.565874] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-15T17:42:30.572284] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-15T17:42:30.584312] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:42:30.591629] [DEBUG] [LOCAL ] CBRE: Trimmed 55239 records to 37044 (keeping 150 days of data) [2025-09-15T17:42:30.835144] [DEBUG] [LOCAL ] CBRE: Primary data saved (37044 records). [2025-09-15T17:42:30.835300] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-15T17:42:30.837885] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBRE took 27.8s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-15T17:42:30.868013] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-15T17:42:31.017451] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:31.043578] [DEBUG] [LOCAL ] CBZ: Loaded 25154 existing records from primary storage. [2025-09-15T17:42:31.043740] [INFO ] [MAIN ] CBZ: Loaded 25154 existing records. [2025-09-15T17:42:31.226392] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:31.226715] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-15T17:42:31.226772] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-15T17:42:31.227500] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-15T17:42:31.227561] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-15T17:42:31.590439] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:31.657850] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-15T17:42:32.245948] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:42:32.457863] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-15T17:42:32.830531] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:42:33.257892] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-15T17:42:33.631083] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:42:33.634670] [INFO ] [REMOTE ] CBT: Full fetch complete (34500 records). [2025-09-15T17:42:33.634773] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-15T17:42:34.009024] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-15T17:42:34.009106] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-15T17:42:34.009589] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-15T17:42:34.009629] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-15T17:42:34.010455] [DEBUG] [LOCAL ] CBT: Trimmed 34500 records to 22706 (keeping 150 days of data) [2025-09-15T17:42:34.067459] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-15T17:42:34.124186] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:42:34.170455] [DEBUG] [LOCAL ] CBT: Primary data saved (22706 records). [2025-09-15T17:42:34.170598] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-15T17:42:34.170707] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 27.0s. Estimated remaining: 3h 25m 33s. Rate: 9.5 symbols/min [2025-09-15T17:42:34.365014] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:34.404411] [DEBUG] [LOCAL ] CC: Loaded 39907 existing records from primary storage. [2025-09-15T17:42:34.404610] [INFO ] [MAIN ] CC: Loaded 39907 existing records. [2025-09-15T17:42:34.589508] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:34.589870] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-15T17:42:34.589934] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-15T17:42:34.591167] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-15T17:42:34.591232] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-15T17:42:34.863093] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-15T17:42:34.962771] [INFO ] [REMOTE ] CC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:35.171780] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T17:42:35.305917] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:42:35.657870] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-15T17:42:35.881059] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:42:36.457912] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-15T17:42:37.257927] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-15T17:42:37.446201] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:37.446549] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-15T17:42:37.514198] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:42:37.516987] [INFO ] [REMOTE ] CBU: Full fetch complete (24320 records). [2025-09-15T17:42:37.517074] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-15T17:42:37.887515] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-15T17:42:37.887614] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-15T17:42:37.888057] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-15T17:42:37.888101] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-15T17:42:37.888792] [DEBUG] [LOCAL ] CBU: Trimmed 24320 records to 16204 (keeping 150 days of data) [2025-09-15T17:42:37.990549] [DEBUG] [LOCAL ] CBU: Primary data saved (16204 records). [2025-09-15T17:42:37.990709] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-15T17:42:37.990810] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 24.2s. Estimated remaining: 3h 25m 15s. Rate: 9.6 symbols/min [2025-09-15T17:42:38.063107] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-15T17:42:38.160854] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:38.198984] [DEBUG] [LOCAL ] CCI: Loaded 39942 existing records from primary storage. [2025-09-15T17:42:38.199132] [INFO ] [MAIN ] CCI: Loaded 39942 existing records. [2025-09-15T17:42:38.375280] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:38.375522] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-15T17:42:38.375567] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-15T17:42:38.376504] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-15T17:42:38.376554] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-15T17:42:38.735277] [INFO ] [REMOTE ] CCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:38.857916] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-15T17:42:39.158280] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:39.158611] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-15T17:42:39.158727] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-15T17:42:39.158809] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-15T17:42:39.159452] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:42:39.159531] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:39.159574] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:39.159617] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-15T17:42:39.159712] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-15T17:42:39.159761] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-15T17:42:39.159803] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-15T17:42:39.159861] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBX took 20.6s. Estimated remaining: 3h 24m 44s. Rate: 9.6 symbols/min [2025-09-15T17:42:39.351548] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:39.351786] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-15T17:42:39.351828] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-15T17:42:39.351954] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-15T17:42:39.351995] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-15T17:42:39.352038] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-15T17:42:39.352072] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-15T17:42:39.666861] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-15T17:42:39.726235] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:39.752415] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:42:40.457894] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-15T17:42:40.982125] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:42:41.243383] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:42:41.257818] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-15T17:42:42.057896] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-15T17:42:42.857994] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-15T17:42:43.268967] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:42:43.449339] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:42:43.657890] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-15T17:42:44.216270] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:42:44.459778] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-15T17:42:44.462266] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:42:45.257911] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-15T17:42:46.057880] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-15T17:42:46.198416] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:42:46.262915] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:42:46.857884] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-15T17:42:47.194684] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:42:47.657943] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-15T17:42:48.041605] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:42:48.063945] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:42:48.457875] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-15T17:42:49.257887] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-15T17:42:49.840244] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:42:50.057868] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-15T17:42:50.857985] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-15T17:42:50.987016] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:42:51.360536] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:42:51.365082] [INFO ] [REMOTE ] CBZ: Full fetch complete (35398 records). [2025-09-15T17:42:51.365168] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-15T17:42:51.488393] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T17:42:51.663138] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-15T17:42:51.767137] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-15T17:42:51.767228] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-15T17:42:51.767767] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-15T17:42:51.767821] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-15T17:42:51.768714] [DEBUG] [LOCAL ] CBZ: Trimmed 35398 records to 24586 (keeping 150 days of data) [2025-09-15T17:42:51.922164] [DEBUG] [LOCAL ] CBZ: Primary data saved (24586 records). [2025-09-15T17:42:51.922343] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-15T17:42:51.922461] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CBZ took 21.1s. Estimated remaining: 3h 25m 9s. Rate: 9.6 symbols/min [2025-09-15T17:42:52.029396] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T17:42:52.100279] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:52.112458] [DEBUG] [LOCAL ] CCIF: Loaded 11453 existing records from primary storage. [2025-09-15T17:42:52.112591] [INFO ] [MAIN ] CCIF: Loaded 11453 existing records. [2025-09-15T17:42:52.290130] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:52.290406] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-15T17:42:52.290452] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-15T17:42:52.290879] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-15T17:42:52.290933] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-15T17:42:52.464018] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-15T17:42:52.655580] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:53.257878] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-15T17:42:53.514622] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-15T17:42:54.109827] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-15T17:42:54.131541] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T17:42:54.857879] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-15T17:42:55.518904] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:42:55.657854] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-15T17:42:56.339148] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:42:56.457873] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-15T17:42:57.003063] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:42:57.257891] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-15T17:42:58.057900] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-15T17:42:58.275694] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:42:58.389869] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:42:58.857880] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-15T17:42:58.894845] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T17:42:59.317996] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:42:59.318917] [INFO ] [REMOTE ] CCIA: Full fetch complete (1536 records). [2025-09-15T17:42:59.318987] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-15T17:42:59.496450] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T17:42:59.496704] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:59.496761] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:59.496804] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-15T17:42:59.496864] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-15T17:42:59.496901] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-15T17:42:59.496955] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-15T17:42:59.497018] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIA took 20.3s. Estimated remaining: 3h 25m 9s. Rate: 9.5 symbols/min [2025-09-15T17:42:59.668185] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-15T17:42:59.670760] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:59.717371] [DEBUG] [LOCAL ] CCJ: Loaded 40437 existing records from primary storage. [2025-09-15T17:42:59.717525] [INFO ] [MAIN ] CCJ: Loaded 40437 existing records. [2025-09-15T17:42:59.891595] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:59.891879] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-15T17:42:59.891926] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-15T17:42:59.892775] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-15T17:42:59.892851] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-15T17:43:00.246482] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:00.457922] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-15T17:43:00.875786] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:43:01.257974] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-15T17:43:02.057859] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-15T17:43:02.267496] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T17:43:02.857910] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-15T17:43:03.354399] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T17:43:03.422578] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:43:03.657904] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-15T17:43:03.700094] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:43:03.706541] [INFO ] [REMOTE ] CCI: Full fetch complete (57794 records). [2025-09-15T17:43:03.706716] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-15T17:43:04.116590] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-15T17:43:04.116734] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-15T17:43:04.117607] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-15T17:43:04.117676] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-15T17:43:04.119386] [DEBUG] [LOCAL ] CCI: Trimmed 57794 records to 39172 (keeping 150 days of data) [2025-09-15T17:43:04.383107] [DEBUG] [LOCAL ] CCI: Primary data saved (39172 records). [2025-09-15T17:43:04.383360] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-15T17:43:04.383484] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CCI took 26.4s. Estimated remaining: 3h 24m 56s. Rate: 9.6 symbols/min [2025-09-15T17:43:04.463039] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-15T17:43:04.596952] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:04.638762] [DEBUG] [LOCAL ] CCK: Loaded 34738 existing records from primary storage. [2025-09-15T17:43:04.638967] [INFO ] [MAIN ] CCK: Loaded 34738 existing records. [2025-09-15T17:43:04.823993] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:04.824326] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-15T17:43:04.824378] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-15T17:43:04.825367] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-15T17:43:04.825429] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-15T17:43:05.195780] [INFO ] [REMOTE ] CCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:05.257913] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-15T17:43:05.581471] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:43:06.057888] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-15T17:43:06.567211] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-15T17:43:06.610350] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:43:06.857888] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-15T17:43:07.657888] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-15T17:43:07.960210] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:43:07.980954] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:43:08.457916] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-15T17:43:09.177951] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:43:09.183704] [INFO ] [REMOTE ] CC: Full fetch complete (57543 records). [2025-09-15T17:43:09.183803] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-15T17:43:09.262993] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-15T17:43:09.578433] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-15T17:43:09.578552] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-15T17:43:09.579252] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-15T17:43:09.579307] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-15T17:43:09.580596] [DEBUG] [LOCAL ] CC: Trimmed 57543 records to 39175 (keeping 150 days of data) [2025-09-15T17:43:09.836853] [DEBUG] [LOCAL ] CC: Primary data saved (39175 records). [2025-09-15T17:43:09.837005] [INFO ] [MAIN ] CC: Full history saved. [2025-09-15T17:43:09.837092] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CC took 35.7s. Estimated remaining: 3h 24m 46s. Rate: 9.6 symbols/min [2025-09-15T17:43:10.019503] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:10.060818] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-15T17:43:10.062383] [DEBUG] [LOCAL ] CCL: Loaded 40540 existing records from primary storage. [2025-09-15T17:43:10.062466] [INFO ] [MAIN ] CCL: Loaded 40540 existing records. [2025-09-15T17:43:10.254007] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:10.261161] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-15T17:43:10.262809] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:43:10.267226] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-15T17:43:10.268683] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-15T17:43:10.268810] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-15T17:43:10.605270] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T17:43:10.677974] [INFO ] [REMOTE ] CCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:10.857887] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-15T17:43:11.657880] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-15T17:43:11.751490] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:43:12.457875] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-15T17:43:13.121876] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T17:43:13.257838] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-15T17:43:13.702102] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:43:13.882960] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-15T17:43:14.057854] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-15T17:43:14.857869] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-15T17:43:15.657859] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-15T17:43:15.705905] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-15T17:43:16.252771] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T17:43:16.457929] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-15T17:43:16.491961] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:43:16.704890] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:43:17.257887] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-15T17:43:18.057879] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-15T17:43:18.100745] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T17:43:18.857940] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-15T17:43:19.473715] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T17:43:19.657885] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-15T17:43:19.750442] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:43:20.238228] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T17:43:20.457959] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-15T17:43:20.872820] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-15T17:43:20.880503] [INFO ] [REMOTE ] CCJ: Full fetch complete (58354 records). [2025-09-15T17:43:20.880615] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-15T17:43:21.263851] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-15T17:43:21.267865] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-15T17:43:21.267948] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-15T17:43:21.268706] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-15T17:43:21.268853] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-15T17:43:21.270054] [DEBUG] [LOCAL ] CCJ: Trimmed 58354 records to 39663 (keeping 150 days of data) [2025-09-15T17:43:21.516728] [DEBUG] [LOCAL ] CCJ: Primary data saved (39663 records). [2025-09-15T17:43:21.516890] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-15T17:43:21.517464] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCJ took 22.0s. Estimated remaining: 3h 25m 5s. Rate: 9.5 symbols/min [2025-09-15T17:43:21.684785] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:21.723107] [DEBUG] [LOCAL ] CCO: Loaded 36522 existing records from primary storage. [2025-09-15T17:43:21.723278] [INFO ] [MAIN ] CCO: Loaded 36522 existing records. [2025-09-15T17:43:21.902431] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:21.902789] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-15T17:43:21.902850] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-15T17:43:21.903584] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-15T17:43:21.903632] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-15T17:43:22.058598] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-15T17:43:22.264515] [INFO ] [REMOTE ] CCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:22.500852] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-15T17:43:22.776575] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:43:22.857870] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-15T17:43:22.992190] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:43:23.657917] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-15T17:43:24.330704] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:43:24.332895] [INFO ] [REMOTE ] CCIF: Full fetch complete (16572 records). [2025-09-15T17:43:24.333039] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-15T17:43:24.462779] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-15T17:43:24.646881] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T17:43:24.748627] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-15T17:43:24.748760] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-15T17:43:24.749136] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-15T17:43:24.749177] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-15T17:43:24.749825] [DEBUG] [LOCAL ] CCIF: Trimmed 16572 records to 11217 (keeping 150 days of data) [2025-09-15T17:43:24.822400] [DEBUG] [LOCAL ] CCIF: Primary data saved (11217 records). [2025-09-15T17:43:24.822551] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-15T17:43:24.822661] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCIF took 32.9s. Estimated remaining: 3h 24m 45s. Rate: 9.5 symbols/min [2025-09-15T17:43:24.993132] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:25.004138] [DEBUG] [LOCAL ] CCRD: Loaded 7757 existing records from primary storage. [2025-09-15T17:43:25.004279] [INFO ] [MAIN ] CCRD: Loaded 7757 existing records. [2025-09-15T17:43:25.187303] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:25.187538] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-15T17:43:25.187589] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-15T17:43:25.187976] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-15T17:43:25.188025] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-15T17:43:25.265195] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-15T17:43:25.569789] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:25.622672] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:43:26.057883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-15T17:43:26.548039] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T17:43:26.634617] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:43:26.641183] [INFO ] [REMOTE ] CCK: Full fetch complete (50793 records). [2025-09-15T17:43:26.641375] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-15T17:43:26.866220] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-15T17:43:27.046187] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-15T17:43:27.046283] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-15T17:43:27.047058] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-15T17:43:27.047123] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-15T17:43:27.049038] [DEBUG] [LOCAL ] CCK: Trimmed 50793 records to 34145 (keeping 150 days of data) [2025-09-15T17:43:27.273404] [DEBUG] [LOCAL ] CCK: Primary data saved (34145 records). [2025-09-15T17:43:27.273569] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-15T17:43:27.274106] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCK took 22.9s. Estimated remaining: 3h 24m 20s. Rate: 9.6 symbols/min [2025-09-15T17:43:27.442428] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:27.468198] [DEBUG] [LOCAL ] CCS: Loaded 22771 existing records from primary storage. [2025-09-15T17:43:27.468337] [INFO ] [MAIN ] CCS: Loaded 22771 existing records. [2025-09-15T17:43:27.647899] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:27.648325] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-15T17:43:27.648395] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-15T17:43:27.649229] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-15T17:43:27.649298] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-15T17:43:27.663127] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-15T17:43:28.023983] [INFO ] [REMOTE ] CCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:28.457917] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-15T17:43:28.568343] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:43:29.174053] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:43:29.257893] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-15T17:43:29.818053] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:43:30.057940] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-15T17:43:30.857887] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-15T17:43:31.254360] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:43:31.310235] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T17:43:31.657922] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-15T17:43:32.136817] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:43:32.457876] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-15T17:43:33.257871] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-15T17:43:33.702545] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T17:43:33.735311] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T17:43:33.818302] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:43:34.057878] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-15T17:43:34.516255] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T17:43:34.857886] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-15T17:43:35.657903] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-15T17:43:36.348414] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:43:36.457915] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-15T17:43:36.510708] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:43:37.257870] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-15T17:43:38.057903] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-15T17:43:38.754572] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:43:38.800195] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-15T17:43:38.806274] [INFO ] [REMOTE ] CCL: Full fetch complete (58480 records). [2025-09-15T17:43:38.806437] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-15T17:43:38.863289] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-15T17:43:39.214110] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-15T17:43:39.214801] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-15T17:43:39.215671] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-15T17:43:39.216508] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-15T17:43:39.216422] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:43:39.224635] [DEBUG] [LOCAL ] CCL: Trimmed 58480 records to 39760 (keeping 150 days of data) [2025-09-15T17:43:39.468256] [DEBUG] [LOCAL ] CCL: Primary data saved (39760 records). [2025-09-15T17:43:39.468404] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-15T17:43:39.468488] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 29.6s. Estimated remaining: 3h 24m 42s. Rate: 9.5 symbols/min [2025-09-15T17:43:39.636790] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:39.653484] [DEBUG] [LOCAL ] CCU: Loaded 16710 existing records from primary storage. [2025-09-15T17:43:39.653610] [INFO ] [MAIN ] CCU: Loaded 16710 existing records. [2025-09-15T17:43:39.664688] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-15T17:43:39.830905] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:39.831148] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-15T17:43:39.831193] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-15T17:43:39.831689] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-15T17:43:39.831740] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-15T17:43:40.208235] [INFO ] [REMOTE ] CCU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:40.361082] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:43:40.457834] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-15T17:43:40.741684] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:43:41.257881] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-15T17:43:42.046305] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T17:43:42.057815] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-15T17:43:42.125941] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T17:43:42.857883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-15T17:43:43.453106] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:43:43.458381] [INFO ] [REMOTE ] CCO: Full fetch complete (51032 records). [2025-09-15T17:43:43.458475] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-15T17:43:43.678760] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:43:43.668161] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-15T17:43:43.855837] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-15T17:43:43.855915] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-15T17:43:43.856529] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-15T17:43:43.856570] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-15T17:43:43.857619] [DEBUG] [LOCAL ] CCO: Trimmed 51032 records to 35835 (keeping 150 days of data) [2025-09-15T17:43:44.061269] [DEBUG] [LOCAL ] CCO: Primary data saved (35835 records). [2025-09-15T17:43:44.061413] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-15T17:43:44.063065] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCO took 22.5s. Estimated remaining: 3h 24m 28s. Rate: 9.5 symbols/min [2025-09-15T17:43:44.239695] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:44.239956] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-15T17:43:44.240016] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-15T17:43:44.240190] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-15T17:43:44.240270] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-15T17:43:44.240335] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-15T17:43:44.240377] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-15T17:43:44.465288] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-15T17:43:44.634514] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:45.075158] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:43:45.257895] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-15T17:43:45.272591] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:43:46.057922] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-15T17:43:46.115627] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:43:46.117266] [INFO ] [REMOTE ] CCRD: Full fetch complete (9284 records). [2025-09-15T17:43:46.117333] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-15T17:43:46.468014] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-15T17:43:46.468093] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-15T17:43:46.468312] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-15T17:43:46.468349] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-15T17:43:46.468806] [DEBUG] [LOCAL ] CCRD: Trimmed 9284 records to 7738 (keeping 150 days of data) [2025-09-15T17:43:46.516242] [DEBUG] [LOCAL ] CCRD: Primary data saved (7738 records). [2025-09-15T17:43:46.516352] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-15T17:43:46.516434] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 21.7s. Estimated remaining: 3h 24m 4s. Rate: 9.6 symbols/min [2025-09-15T17:43:46.688822] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:46.730516] [DEBUG] [LOCAL ] CDE: Loaded 40384 existing records from primary storage. [2025-09-15T17:43:46.730678] [INFO ] [MAIN ] CDE: Loaded 40384 existing records. [2025-09-15T17:43:46.869083] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-15T17:43:46.908560] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:46.908790] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-15T17:43:46.908836] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-15T17:43:46.909632] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-15T17:43:46.909705] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-15T17:43:47.269987] [INFO ] [REMOTE ] CDE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:47.333683] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T17:43:47.370261] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:43:47.657885] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-15T17:43:48.457870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-15T17:43:48.549788] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:43:49.257907] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-15T17:43:49.641352] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:43:50.057896] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-15T17:43:50.416804] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:43:50.596139] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:43:50.600694] [INFO ] [REMOTE ] CCS: Full fetch complete (33463 records). [2025-09-15T17:43:50.600803] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-15T17:43:50.863062] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-15T17:43:50.966677] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-15T17:43:50.966757] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-15T17:43:50.967258] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-15T17:43:50.967297] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-15T17:43:50.968031] [DEBUG] [LOCAL ] CCS: Trimmed 33463 records to 22400 (keeping 150 days of data) [2025-09-15T17:43:51.109417] [DEBUG] [LOCAL ] CCS: Primary data saved (22400 records). [2025-09-15T17:43:51.109577] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-15T17:43:51.109690] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCS took 23.8s. Estimated remaining: 3h 23m 50s. Rate: 9.6 symbols/min [2025-09-15T17:43:51.281470] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:51.289484] [DEBUG] [LOCAL ] CDLR: Loaded 7036 existing records from primary storage. [2025-09-15T17:43:51.289574] [INFO ] [MAIN ] CDLR: Loaded 7036 existing records. [2025-09-15T17:43:51.462519] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:51.462791] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-15T17:43:51.462837] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-15T17:43:51.463125] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-15T17:43:51.463170] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-15T17:43:51.665322] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-15T17:43:51.810386] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:52.033319] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:43:52.457914] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-15T17:43:52.907598] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T17:43:53.257913] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-15T17:43:53.308757] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:43:54.057889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-15T17:43:54.851767] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:43:54.862329] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-15T17:43:55.260403] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:43:55.439809] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:43:55.657856] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-15T17:43:56.347489] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:43:56.457870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-15T17:43:57.257927] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-15T17:43:57.333890] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T17:43:57.843980] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:43:58.057867] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-15T17:43:58.355816] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:43:58.857871] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-15T17:43:59.657854] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-15T17:43:59.969919] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T17:44:00.347545] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:44:00.457823] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-15T17:44:01.252187] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T17:44:01.254810] [INFO ] [REMOTE ] CCU: Full fetch complete (26284 records). [2025-09-15T17:44:01.254890] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-15T17:44:01.266116] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-15T17:44:01.679399] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-15T17:44:01.679478] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-15T17:44:01.679921] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-15T17:44:01.679963] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-15T17:44:01.680615] [DEBUG] [LOCAL ] CCU: Trimmed 26284 records to 16315 (keeping 150 days of data) [2025-09-15T17:44:01.776274] [DEBUG] [LOCAL ] CCU: Primary data saved (16315 records). [2025-09-15T17:44:01.776436] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-15T17:44:01.776522] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCU took 22.3s. Estimated remaining: 3h 24m 4s. Rate: 9.6 symbols/min [2025-09-15T17:44:01.971949] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:01.972186] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-09-15T17:44:01.972229] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-09-15T17:44:01.972358] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-15T17:44:01.972399] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-15T17:44:01.972441] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-15T17:44:01.972476] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-15T17:44:02.066437] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-15T17:44:02.274573] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T17:44:02.358312] [INFO ] [REMOTE ] CDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:02.857919] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-15T17:44:03.462958] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T17:44:03.657905] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-15T17:44:03.892208] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:03.892746] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-15T17:44:04.149393] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T17:44:04.457898] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-15T17:44:05.257928] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-15T17:44:06.057841] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-15T17:44:06.142525] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:44:06.172145] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:44:06.857856] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-15T17:44:07.521082] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T17:44:07.657912] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-15T17:44:07.915858] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-15T17:44:08.458000] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-15T17:44:08.583197] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T17:44:08.907056] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:44:09.257918] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-15T17:44:09.566386] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-15T17:44:10.057878] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-15T17:44:10.857882] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-15T17:44:11.595194] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:44:11.657892] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-15T17:44:11.948716] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:44:12.457908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-15T17:44:13.236080] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:44:13.257817] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-15T17:44:13.646421] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:44:14.057921] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-15T17:44:14.857884] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-15T17:44:15.352196] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-15T17:44:15.358046] [INFO ] [REMOTE ] CDE: Full fetch complete (58320 records). [2025-09-15T17:44:15.358147] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-15T17:44:15.661324] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-15T17:44:15.664140] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:44:15.707024] [INFO ] [REMOTE ] CDLR: Full fetch complete (10652 records). [2025-09-15T17:44:15.739796] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-15T17:44:15.759926] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-15T17:44:15.790618] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-15T17:44:15.828985] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-15T17:44:15.840838] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-15T17:44:15.925482] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T17:44:15.995116] [DEBUG] [LOCAL ] CDE: Trimmed 58320 records to 39604 (keeping 150 days of data) [2025-09-15T17:44:16.242488] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-15T17:44:16.243079] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-15T17:44:16.243606] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-15T17:44:16.243939] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-15T17:44:16.245989] [DEBUG] [LOCAL ] CDLR: Trimmed 10652 records to 6990 (keeping 150 days of data) [2025-09-15T17:44:16.293572] [DEBUG] [LOCAL ] CDLR: Primary data saved (6990 records). [2025-09-15T17:44:16.294435] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-15T17:44:16.295569] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 25.2s. Estimated remaining: 3h 24m 35s. Rate: 9.5 symbols/min [2025-09-15T17:44:16.401052] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:44:16.413688] [INFO ] [REMOTE ] CCZ: Full fetch complete (76 records). [2025-09-15T17:44:16.430592] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-15T17:44:16.461990] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-15T17:44:16.494357] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:16.744997] [WARN ] [VALIDATOR ] CCZ: Validation failed - insufficient historical data. Have 21 unique days, need 150 days [2025-09-15T17:44:16.761010] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:44:16.791401] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:44:16.790452] [DEBUG] [LOCAL ] CDRE: Loaded 18728 existing records from primary storage. [2025-09-15T17:44:16.792158] [INFO ] [MAIN ] CDRE: Loaded 18728 existing records. [2025-09-15T17:44:16.792093] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-15T17:44:16.798565] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-15T17:44:16.806542] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-15T17:44:16.827701] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-15T17:44:16.840438] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CCZ took 32.8s. Estimated remaining: 3h 24m 3s. Rate: 9.5 symbols/min [2025-09-15T17:44:17.113766] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:17.158551] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-15T17:44:17.158253] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:17.158934] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-15T17:44:17.160999] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-15T17:44:17.161753] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-15T17:44:17.465518] [DEBUG] [LOCAL ] CE: Loaded 38584 existing records from primary storage. [2025-09-15T17:44:17.476787] [INFO ] [MAIN ] CE: Loaded 38584 existing records. [2025-09-15T17:44:17.620456] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:17.624210] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-15T17:44:17.623919] [DEBUG] [LOCAL ] CDE: Primary data saved (39604 records). [2025-09-15T17:44:17.639731] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-15T17:44:17.647673] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 31.1s. Estimated remaining: 3h 23m 31s. Rate: 9.6 symbols/min [2025-09-15T17:44:17.854684] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:17.855129] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-15T17:44:17.876125] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-15T17:44:17.927243] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:17.923981] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-15T17:44:17.927659] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-15T17:44:18.059394] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-15T17:44:18.071281] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:44:18.081765] [INFO ] [MAIN ] CEE: Loaded 4013 existing records. [2025-09-15T17:44:18.151733] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-15T17:44:18.486939] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:18.504756] [INFO ] [REMOTE ] CE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:18.504974] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-15T17:44:18.505231] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-15T17:44:18.505481] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-15T17:44:18.505528] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-15T17:44:18.856814] [INFO ] [REMOTE ] CEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:18.864621] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-15T17:44:18.867999] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:44:19.657841] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-15T17:44:19.683149] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:44:19.772578] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:44:20.457890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-15T17:44:20.985968] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:44:21.251214] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:44:21.260515] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-15T17:44:22.057922] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-15T17:44:22.233285] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:44:22.712902] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:44:22.857857] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-15T17:44:23.657903] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-15T17:44:23.947861] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:44:23.952774] [INFO ] [REMOTE ] CDP: Full fetch complete (46648 records). [2025-09-15T17:44:23.952888] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-15T17:44:24.341796] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-15T17:44:24.341880] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-15T17:44:24.342517] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-15T17:44:24.342565] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-15T17:44:24.343513] [DEBUG] [LOCAL ] CDP: Trimmed 46648 records to 31021 (keeping 150 days of data) [2025-09-15T17:44:24.460882] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-15T17:44:24.537365] [DEBUG] [LOCAL ] CDP: Primary data saved (31021 records). [2025-09-15T17:44:24.537498] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-15T17:44:24.537581] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDP took 22.8s. Estimated remaining: 3h 23m 28s. Rate: 9.6 symbols/min [2025-09-15T17:44:24.713894] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:24.733687] [DEBUG] [LOCAL ] CEPU: Loaded 18775 existing records from primary storage. [2025-09-15T17:44:24.733830] [INFO ] [MAIN ] CEPU: Loaded 18775 existing records. [2025-09-15T17:44:24.921966] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:24.922242] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-15T17:44:24.922290] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-15T17:44:24.922853] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-15T17:44:24.922905] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-15T17:44:25.261984] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-15T17:44:25.291777] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:25.325936] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:44:25.526145] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:44:25.895902] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T17:44:26.057878] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-15T17:44:26.857941] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-15T17:44:27.292533] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:44:27.482055] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:44:27.657871] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-15T17:44:28.099716] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:44:28.457882] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-15T17:44:29.257917] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-15T17:44:29.488503] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T17:44:30.018734] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:44:30.057815] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-15T17:44:30.830490] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:44:30.831553] [INFO ] [REMOTE ] CEE: Full fetch complete (8735 records). [2025-09-15T17:44:30.831622] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-15T17:44:30.862976] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-15T17:44:31.187235] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-15T17:44:31.187310] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-15T17:44:31.187516] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-15T17:44:31.187554] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-15T17:44:31.187968] [DEBUG] [LOCAL ] CEE: Trimmed 8735 records to 3994 (keeping 150 days of data) [2025-09-15T17:44:31.211435] [DEBUG] [LOCAL ] CEE: Primary data saved (3994 records). [2025-09-15T17:44:31.211506] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-15T17:44:31.211578] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 13.6s. Estimated remaining: 3h 23m 23s. Rate: 9.6 symbols/min [2025-09-15T17:44:31.384940] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:31.425318] [DEBUG] [LOCAL ] CF: Loaded 39355 existing records from primary storage. [2025-09-15T17:44:31.425482] [INFO ] [MAIN ] CF: Loaded 39355 existing records. [2025-09-15T17:44:31.599944] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:31.600194] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-15T17:44:31.600242] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-15T17:44:31.601199] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-15T17:44:31.601256] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-15T17:44:31.663029] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-15T17:44:31.952262] [INFO ] [REMOTE ] CF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:32.174751] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:44:32.457869] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-15T17:44:32.828029] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T17:44:33.257829] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-15T17:44:33.659795] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:44:34.057878] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-15T17:44:34.650266] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:44:34.857880] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-15T17:44:34.964517] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:44:35.657868] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-15T17:44:36.348191] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:44:36.457891] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-15T17:44:36.598148] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:44:37.257953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-15T17:44:37.945042] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:44:38.057870] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-15T17:44:38.857877] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-15T17:44:39.029581] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:44:39.657926] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-15T17:44:39.739363] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T17:44:39.776808] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:44:40.457886] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-15T17:44:41.263040] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-15T17:44:41.280307] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:44:41.961960] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:44:42.057890] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-15T17:44:42.335763] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:44:42.857934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-15T17:44:43.490500] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:44:43.657879] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-15T17:44:43.685578] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:44:44.457877] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-15T17:44:45.176340] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:44:45.257991] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-15T17:44:45.661311] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T17:44:45.972919] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:44:45.975617] [INFO ] [REMOTE ] CDRE: Full fetch complete (26494 records). [2025-09-15T17:44:45.975728] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-15T17:44:46.062985] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-15T17:44:46.343358] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-15T17:44:46.343453] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-15T17:44:46.343917] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-15T17:44:46.343961] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-15T17:44:46.344729] [DEBUG] [LOCAL ] CDRE: Trimmed 26494 records to 18482 (keeping 150 days of data) [2025-09-15T17:44:46.457064] [DEBUG] [LOCAL ] CDRE: Primary data saved (18482 records). [2025-09-15T17:44:46.457227] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-15T17:44:46.457328] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CDRE took 30.2s. Estimated remaining: 3h 23m 58s. Rate: 9.5 symbols/min [2025-09-15T17:44:46.625330] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:46.662069] [DEBUG] [LOCAL ] CFG: Loaded 40366 existing records from primary storage. [2025-09-15T17:44:46.662219] [INFO ] [MAIN ] CFG: Loaded 40366 existing records. [2025-09-15T17:44:46.837146] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:46.837404] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-15T17:44:46.837452] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-15T17:44:46.838389] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-15T17:44:46.838441] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-15T17:44:46.868631] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-15T17:44:47.233308] [INFO ] [REMOTE ] CFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:47.657889] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-15T17:44:47.804190] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:44:48.457871] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-15T17:44:48.586228] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:44:48.857581] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:44:49.257879] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-15T17:44:49.992008] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:44:50.013011] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:44:50.013150] [INFO ] [REMOTE ] CF: Full fetch complete (56911 records). [2025-09-15T17:44:50.018542] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-15T17:44:50.063014] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-15T17:44:50.406905] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-15T17:44:50.407000] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-15T17:44:50.407706] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-15T17:44:50.407753] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-15T17:44:50.409062] [DEBUG] [LOCAL ] CF: Trimmed 56911 records to 38590 (keeping 150 days of data) [2025-09-15T17:44:50.654459] [DEBUG] [LOCAL ] CF: Primary data saved (38590 records). [2025-09-15T17:44:50.654668] [INFO ] [MAIN ] CF: Full history saved. [2025-09-15T17:44:50.655547] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CF took 19.4s. Estimated remaining: 3h 23m 42s. Rate: 9.5 symbols/min [2025-09-15T17:44:50.829856] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:50.830096] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-15T17:44:50.830136] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-15T17:44:50.830243] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-15T17:44:50.830284] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-15T17:44:50.830325] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-15T17:44:50.830359] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-15T17:44:50.863011] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-15T17:44:51.198354] [INFO ] [REMOTE ] CFND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:51.657883] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-15T17:44:51.977543] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T17:44:52.041481] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:44:52.045001] [INFO ] [REMOTE ] CEPU: Full fetch complete (27886 records). [2025-09-15T17:44:52.045076] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-15T17:44:52.411813] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-15T17:44:52.411896] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-15T17:44:52.412338] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-15T17:44:52.412378] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-15T17:44:52.413156] [DEBUG] [LOCAL ] CEPU: Trimmed 27886 records to 18551 (keeping 150 days of data) [2025-09-15T17:44:52.459669] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-15T17:44:52.524340] [DEBUG] [LOCAL ] CEPU: Primary data saved (18551 records). [2025-09-15T17:44:52.524519] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-15T17:44:52.524949] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CEPU took 28.0s. Estimated remaining: 3h 23m 16s. Rate: 9.5 symbols/min [2025-09-15T17:44:52.699844] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:52.728415] [DEBUG] [LOCAL ] CFR: Loaded 24399 existing records from primary storage. [2025-09-15T17:44:52.728602] [INFO ] [MAIN ] CFR: Loaded 24399 existing records. [2025-09-15T17:44:52.924081] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:52.924454] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-15T17:44:52.924525] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-15T17:44:52.925598] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-15T17:44:52.925743] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-15T17:44:53.265237] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-15T17:44:53.272313] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:44:53.373316] [INFO ] [REMOTE ] CFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:53.517901] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:53.518218] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-15T17:44:54.001374] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:44:54.057873] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-15T17:44:54.857870] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-15T17:44:55.340479] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:44:55.657928] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-15T17:44:56.294994] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:44:56.457854] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-15T17:44:56.886954] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:44:56.892889] [INFO ] [REMOTE ] CE: Full fetch complete (56295 records). [2025-09-15T17:44:56.893008] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-15T17:44:57.260278] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-15T17:44:57.278523] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-15T17:44:57.278623] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-15T17:44:57.279400] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-15T17:44:57.279538] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-15T17:44:57.280945] [DEBUG] [LOCAL ] CE: Trimmed 56295 records to 37804 (keeping 150 days of data) [2025-09-15T17:44:57.518610] [DEBUG] [LOCAL ] CE: Primary data saved (37804 records). [2025-09-15T17:44:57.518776] [INFO ] [MAIN ] CE: Full history saved. [2025-09-15T17:44:57.518865] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CE took 40.7s. Estimated remaining: 3h 23m 3s. Rate: 9.6 symbols/min [2025-09-15T17:44:57.562709] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:57.596269] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-15T17:44:57.701098] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:57.735453] [DEBUG] [LOCAL ] CGAU: Loaded 31557 existing records from primary storage. [2025-09-15T17:44:57.735729] [INFO ] [MAIN ] CGAU: Loaded 31557 existing records. [2025-09-15T17:44:57.926471] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:57.946406] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-15T17:44:57.946523] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-15T17:44:57.947247] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-15T17:44:57.949307] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:44:57.949383] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-15T17:44:58.063036] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-15T17:44:58.319745] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:58.321150] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-15T17:44:58.340888] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:58.857891] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-15T17:44:59.657878] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-15T17:45:00.213152] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:45:00.457875] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-15T17:45:01.014871] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:45:01.257871] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-15T17:45:02.057858] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-15T17:45:02.274141] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:45:02.299236] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:02.299694] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-15T17:45:02.857865] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-15T17:45:02.954724] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:45:03.657879] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-15T17:45:04.356173] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:45:04.457890] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-15T17:45:05.257925] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-15T17:45:05.433051] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:45:05.438961] [INFO ] [REMOTE ] CFG: Full fetch complete (58291 records). [2025-09-15T17:45:05.439099] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-15T17:45:05.820058] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-15T17:45:05.820176] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-15T17:45:05.820970] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-15T17:45:05.821033] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-15T17:45:05.822500] [DEBUG] [LOCAL ] CFG: Trimmed 58291 records to 39585 (keeping 150 days of data) [2025-09-15T17:45:06.061699] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-15T17:45:06.065560] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:45:06.097791] [DEBUG] [LOCAL ] CFG: Primary data saved (39585 records). [2025-09-15T17:45:06.097960] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-15T17:45:06.098314] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 19.6s. Estimated remaining: 3h 23m 8s. Rate: 9.5 symbols/min [2025-09-15T17:45:06.274734] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:06.278385] [DEBUG] [LOCAL ] CGV: Loaded 953 existing records from primary storage. [2025-09-15T17:45:06.278512] [INFO ] [MAIN ] CGV: Loaded 953 existing records. [2025-09-15T17:45:06.300942] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:06.351543] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-15T17:45:06.471234] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:06.471836] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-15T17:45:06.471941] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-15T17:45:06.472209] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-15T17:45:06.472304] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-15T17:45:06.638729] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:45:06.863345] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-15T17:45:07.051339] [INFO ] [REMOTE ] CGV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:07.657947] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-15T17:45:08.010272] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-15T17:45:08.345597] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:45:08.457887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-15T17:45:09.257885] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-15T17:45:09.454827] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:09.653752] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:45:10.057872] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-15T17:45:10.541875] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:45:10.857884] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-15T17:45:11.657892] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-15T17:45:12.270783] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:12.271088] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-15T17:45:12.306849] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:45:12.457888] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-15T17:45:13.257915] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-15T17:45:13.325281] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:45:14.057918] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-15T17:45:14.212916] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:45:14.405548] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:45:14.857870] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-15T17:45:15.657890] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-15T17:45:16.014111] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-15T17:45:16.068070] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T17:45:16.457888] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-15T17:45:17.257866] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-15T17:45:17.666856] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:45:17.906274] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:45:18.057872] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-15T17:45:18.702104] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:45:18.703386] [INFO ] [REMOTE ] CFND: Full fetch complete (2219 records). [2025-09-15T17:45:18.703456] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-15T17:45:18.860823] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-15T17:45:18.880727] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 27 unique days, need 150 days [2025-09-15T17:45:18.881625] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:45:18.881720] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:45:18.881787] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-15T17:45:18.881857] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-15T17:45:18.881905] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-15T17:45:18.881966] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-15T17:45:18.882036] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFND took 28.2s. Estimated remaining: 3h 23m 31s. Rate: 9.5 symbols/min [2025-09-15T17:45:19.051420] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:19.075487] [DEBUG] [LOCAL ] CHCT: Loaded 18123 existing records from primary storage. [2025-09-15T17:45:19.075617] [INFO ] [MAIN ] CHCT: Loaded 18123 existing records. [2025-09-15T17:45:19.256545] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:19.256837] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-15T17:45:19.256882] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-15T17:45:19.257408] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-15T17:45:19.257482] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-15T17:45:19.604129] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:19.657813] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-15T17:45:20.447263] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:45:20.457819] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-15T17:45:20.509040] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:45:21.257930] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-15T17:45:21.561470] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:45:21.613956] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T17:45:22.057878] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-15T17:45:22.857891] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-15T17:45:23.208118] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:45:23.213299] [INFO ] [REMOTE ] CGAU: Full fetch complete (45844 records). [2025-09-15T17:45:23.213393] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-15T17:45:23.314697] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:45:23.317873] [INFO ] [REMOTE ] CGV: Full fetch complete (1631 records). [2025-09-15T17:45:23.317968] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-15T17:45:23.657925] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-15T17:45:23.889357] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-15T17:45:23.899675] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-15T17:45:23.910453] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-15T17:45:23.932613] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-15T17:45:23.961032] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-15T17:45:23.961107] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-15T17:45:23.961203] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-15T17:45:23.961240] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-15T17:45:23.961593] [DEBUG] [LOCAL ] CGV: Trimmed 1631 records to 943 (keeping 150 days of data) [2025-09-15T17:45:23.968735] [DEBUG] [LOCAL ] CGV: Primary data saved (943 records). [2025-09-15T17:45:23.968954] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-15T17:45:23.969110] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CGV took 17.9s. Estimated remaining: 3h 23m 19s. Rate: 9.5 symbols/min [2025-09-15T17:45:24.000356] [DEBUG] [LOCAL ] CGAU: Trimmed 45844 records to 31020 (keeping 150 days of data) [2025-09-15T17:45:24.228629] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:24.336958] [DEBUG] [LOCAL ] CHD: Loaded 39567 existing records from primary storage. [2025-09-15T17:45:24.337579] [INFO ] [MAIN ] CHD: Loaded 39567 existing records. [2025-09-15T17:45:24.463151] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-15T17:45:24.523113] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:24.524396] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-15T17:45:24.524712] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-15T17:45:24.526206] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-15T17:45:24.526763] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-15T17:45:24.559368] [DEBUG] [LOCAL ] CGAU: Primary data saved (31020 records). [2025-09-15T17:45:24.597822] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-15T17:45:24.619733] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGAU took 27.1s. Estimated remaining: 3h 22m 47s. Rate: 9.5 symbols/min [2025-09-15T17:45:24.980927] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:25.064746] [INFO ] [REMOTE ] CHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:25.068888] [DEBUG] [LOCAL ] CHE: Loaded 11232 existing records from primary storage. [2025-09-15T17:45:25.069174] [INFO ] [MAIN ] CHE: Loaded 11232 existing records. [2025-09-15T17:45:25.245593] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:25.245908] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-15T17:45:25.246169] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-15T17:45:25.256335] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-15T17:45:25.256750] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-15T17:45:25.256703] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:45:25.267691] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-15T17:45:25.325190] [INFO ] [REMOTE ] CFR: Full fetch complete (36435 records). [2025-09-15T17:45:25.352968] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-15T17:45:25.369684] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:45:25.390290] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:45:25.419774] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:45:25.421766] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-15T17:45:25.437530] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-09-15T17:45:25.462607] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-09-15T17:45:25.505352] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-09-15T17:45:25.522318] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CFR took 33.0s. Estimated remaining: 3h 22m 17s. Rate: 9.6 symbols/min [2025-09-15T17:45:25.734616] [INFO ] [REMOTE ] CHE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:25.828897] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:25.829985] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:45:25.871737] [DEBUG] [LOCAL ] CHGG: Loaded 35858 existing records from primary storage. [2025-09-15T17:45:25.871876] [INFO ] [MAIN ] CHGG: Loaded 35858 existing records. [2025-09-15T17:45:26.054519] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:26.054842] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-15T17:45:26.054910] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-15T17:45:26.055592] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-15T17:45:26.055661] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-15T17:45:26.066739] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-15T17:45:26.416736] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:26.857878] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-15T17:45:27.089149] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T17:45:27.140834] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:45:27.657887] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-15T17:45:28.097942] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:45:28.457936] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-15T17:45:28.522502] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:45:29.257921] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-15T17:45:30.025222] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:45:30.057853] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-15T17:45:30.262371] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:30.857929] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-15T17:45:31.599587] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:45:31.657819] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-15T17:45:32.083423] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:45:32.457863] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-15T17:45:33.257914] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-15T17:45:33.320527] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:45:34.057844] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-15T17:45:34.163389] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:45:34.466181] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:45:34.857885] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-15T17:45:34.953989] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:45:35.657901] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-15T17:45:36.231008] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:45:36.457933] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-15T17:45:37.257905] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-15T17:45:37.508290] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:45:37.560248] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:45:38.046159] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T17:45:38.057822] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-15T17:45:38.857924] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-15T17:45:39.097166] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:45:39.657907] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-15T17:45:39.927004] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:45:40.457878] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-15T17:45:41.207246] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:45:41.257827] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-15T17:45:41.368546] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:45:42.057875] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-15T17:45:42.857877] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-15T17:45:42.912814] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:45:43.072123] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:45:43.657883] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-15T17:45:43.789780] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:45:43.792757] [INFO ] [REMOTE ] CHCT: Full fetch complete (26420 records). [2025-09-15T17:45:43.792846] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-15T17:45:44.177098] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-15T17:45:44.177206] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-15T17:45:44.177664] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-15T17:45:44.177720] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-15T17:45:44.178677] [DEBUG] [LOCAL ] CHCT: Trimmed 26420 records to 17753 (keeping 150 days of data) [2025-09-15T17:45:44.296471] [DEBUG] [LOCAL ] CHCT: Primary data saved (17753 records). [2025-09-15T17:45:44.296620] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-15T17:45:44.296746] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 25.4s. Estimated remaining: 3h 23m 6s. Rate: 9.5 symbols/min [2025-09-15T17:45:44.469925] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:44.466315] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-15T17:45:44.498468] [DEBUG] [LOCAL ] CHH: Loaded 23681 existing records from primary storage. [2025-09-15T17:45:44.498607] [INFO ] [MAIN ] CHH: Loaded 23681 existing records. [2025-09-15T17:45:44.679133] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:44.679417] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-15T17:45:44.679463] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-15T17:45:44.680027] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-15T17:45:44.680075] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-15T17:45:45.038833] [INFO ] [REMOTE ] CHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:45.105669] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:45:45.257884] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-15T17:45:45.466894] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T17:45:46.057891] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-15T17:45:46.828803] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:45:46.836519] [INFO ] [REMOTE ] CHE: Full fetch complete (15389 records). [2025-09-15T17:45:46.843699] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-15T17:45:46.844119] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:45:46.862965] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-15T17:45:46.903727] [INFO ] [REMOTE ] CHGG: Full fetch complete (52248 records). [2025-09-15T17:45:46.919360] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-15T17:45:47.571955] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-15T17:45:47.577499] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-15T17:45:47.586117] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-15T17:45:47.586443] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-15T17:45:47.608080] [DEBUG] [LOCAL ] CHE: Trimmed 15389 records to 11150 (keeping 150 days of data) [2025-09-15T17:45:47.658915] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-15T17:45:47.658782] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-15T17:45:47.659080] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-15T17:45:47.660048] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-15T17:45:47.675077] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-15T17:45:47.680578] [DEBUG] [LOCAL ] CHGG: Trimmed 52248 records to 35278 (keeping 150 days of data) [2025-09-15T17:45:47.792883] [DEBUG] [LOCAL ] CHE: Primary data saved (11150 records). [2025-09-15T17:45:47.793532] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-15T17:45:47.793880] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 23.2s. Estimated remaining: 3h 22m 48s. Rate: 9.5 symbols/min [2025-09-15T17:45:47.976612] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:47.997874] [DEBUG] [LOCAL ] CHMI: Loaded 15383 existing records from primary storage. [2025-09-15T17:45:47.999039] [INFO ] [MAIN ] CHMI: Loaded 15383 existing records. [2025-09-15T17:45:48.232800] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:48.254405] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-15T17:45:48.255458] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-15T17:45:48.259306] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-15T17:45:48.259690] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-15T17:45:48.690104] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:48.692550] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:45:48.691369] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-15T17:45:48.703660] [DEBUG] [LOCAL ] CHGG: Primary data saved (35278 records). [2025-09-15T17:45:48.703797] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-15T17:45:48.703893] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 23.2s. Estimated remaining: 3h 22m 17s. Rate: 9.6 symbols/min [2025-09-15T17:45:49.106587] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:45:49.257925] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-15T17:45:49.425545] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:45:50.057902] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-15T17:45:50.487287] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:45:50.831165] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T17:45:50.857842] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-15T17:45:51.657884] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-15T17:45:52.250261] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:45:52.457903] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-15T17:45:52.681854] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:45:53.257886] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-15T17:45:54.057870] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-15T17:45:54.253948] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:54.287525] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:45:54.857889] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-15T17:45:54.999635] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:45:55.565380] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:45:55.657873] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-15T17:45:56.457871] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-15T17:45:56.630880] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:45:57.257925] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-15T17:45:57.656107] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:45:58.057884] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-15T17:45:58.858050] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-15T17:45:58.859072] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:45:58.865893] [INFO ] [REMOTE ] CHD: Full fetch complete (56347 records). [2025-09-15T17:45:58.865987] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-15T17:45:59.233092] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:45:59.383768] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-15T17:45:59.383906] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-15T17:45:59.385422] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-15T17:45:59.385533] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-15T17:45:59.387442] [DEBUG] [LOCAL ] CHD: Trimmed 56347 records to 38809 (keeping 150 days of data) [2025-09-15T17:45:59.678395] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-15T17:45:59.736349] [DEBUG] [LOCAL ] CHD: Primary data saved (38809 records). [2025-09-15T17:45:59.736569] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-15T17:45:59.736733] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHD took 35.8s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-15T17:46:00.505464] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:46:00.513013] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-15T17:46:00.774295] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:46:00.776807] [INFO ] [REMOTE ] CHMI: Full fetch complete (23460 records). [2025-09-15T17:46:00.776879] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-15T17:46:00.777356] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:46:00.777436] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:00.777473] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:00.777508] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-15T17:46:00.777566] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-09-15T17:46:00.777600] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-09-15T17:46:00.777865] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-09-15T17:46:00.777943] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHMI took 13.0s. Estimated remaining: 3h 22m 3s. Rate: 9.6 symbols/min [2025-09-15T17:46:01.830185] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:46:01.837324] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-15T17:46:03.103692] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:46:03.107153] [INFO ] [REMOTE ] CHH: Full fetch complete (35531 records). [2025-09-15T17:46:03.107243] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-15T17:46:03.495954] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-15T17:46:03.496102] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-15T17:46:03.496722] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-15T17:46:03.496793] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-15T17:46:03.497820] [DEBUG] [LOCAL ] CHH: Trimmed 35531 records to 23316 (keeping 150 days of data) [2025-09-15T17:46:03.650538] [DEBUG] [LOCAL ] CHH: Primary data saved (23316 records). [2025-09-15T17:46:03.650693] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-15T17:46:03.650782] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHH took 19.4s. Estimated remaining: 3h 21m 41s. Rate: 9.6 symbols/min [2025-09-15T17:46:04.291082] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.300552] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.377177] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.378685] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.382461] [DEBUG] [LOCAL ] CHN: Loaded 3676 existing records from primary storage. [2025-09-15T17:46:04.383260] [INFO ] [MAIN ] CHN: Loaded 3676 existing records. [2025-09-15T17:46:04.628604] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:04.629629] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-15T17:46:04.629866] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-15T17:46:04.629752] [DEBUG] [LOCAL ] CHT: Loaded 14550 existing records from primary storage. [2025-09-15T17:46:04.630231] [INFO ] [MAIN ] CHT: Loaded 14550 existing records. [2025-09-15T17:46:04.640978] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-15T17:46:04.678711] [DEBUG] [LOCAL ] CHWY: Loaded 40401 existing records from primary storage. [2025-09-15T17:46:04.698831] [INFO ] [MAIN ] CHWY: Loaded 40401 existing records. [2025-09-15T17:46:04.698482] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-15T17:46:04.901756] [DEBUG] [LOCAL ] CHPT: Loaded 37016 existing records from primary storage. [2025-09-15T17:46:04.991291] [INFO ] [MAIN ] CHPT: Loaded 37016 existing records. [2025-09-15T17:46:05.086329] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.286334] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.334787] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.363139] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-15T17:46:05.428508] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.433926] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-15T17:46:05.485396] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-15T17:46:05.498166] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-15T17:46:05.661375] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.674521] [INFO ] [REMOTE ] CHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:05.674616] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-15T17:46:05.708773] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-15T17:46:05.712541] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-15T17:46:05.708306] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.735700] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-15T17:46:05.770510] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-15T17:46:05.855267] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-15T17:46:06.533720] [INFO ] [REMOTE ] CHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.571636] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-15T17:46:06.677267] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.693993] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-15T17:46:06.744679] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T17:46:06.764523] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.766967] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-15T17:46:06.766748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-15T17:46:07.114280] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-15T17:46:07.115897] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-15T17:46:07.668049] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:46:07.671987] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-15T17:46:07.709602] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:46:07.711483] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-15T17:46:08.098999] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T17:46:08.457881] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-15T17:46:08.713867] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T17:46:08.755426] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:46:08.830251] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T17:46:08.932798] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:46:09.257902] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-15T17:46:10.057836] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-15T17:46:10.121134] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:46:10.504110] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T17:46:10.857888] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-15T17:46:11.657873] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-15T17:46:11.725216] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:46:12.457918] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-15T17:46:13.257935] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-15T17:46:13.493670] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:46:13.779936] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-15T17:46:13.821632] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T17:46:13.822992] [INFO ] [REMOTE ] CHN: Full fetch complete (5412 records). [2025-09-15T17:46:13.823069] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-15T17:46:13.823513] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:46:13.823970] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:13.824183] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:13.824244] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-15T17:46:13.824345] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-09-15T17:46:13.824389] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-09-15T17:46:13.824881] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-09-15T17:46:13.825037] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 10.2s. Estimated remaining: 3h 21m 52s. Rate: 9.6 symbols/min [2025-09-15T17:46:14.003713] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:14.040998] [DEBUG] [LOCAL ] CI: Loaded 37661 existing records from primary storage. [2025-09-15T17:46:14.041169] [INFO ] [MAIN ] CI: Loaded 37661 existing records. [2025-09-15T17:46:14.063015] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-15T17:46:14.224364] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:14.224628] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-15T17:46:14.224698] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-15T17:46:14.225722] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-15T17:46:14.225780] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-15T17:46:14.593157] [INFO ] [REMOTE ] CI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:14.857915] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-15T17:46:15.128325] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:46:15.657883] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-15T17:46:16.457842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-15T17:46:16.484610] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:46:17.062540] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:46:17.089490] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:46:17.257853] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-15T17:46:18.002582] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T17:46:18.057842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-15T17:46:18.857901] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-15T17:46:18.970728] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:46:18.973187] [INFO ] [REMOTE ] CHT: Full fetch complete (21472 records). [2025-09-15T17:46:18.973275] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-15T17:46:19.332919] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-15T17:46:19.333000] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-15T17:46:19.333449] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-15T17:46:19.333489] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-15T17:46:19.334107] [DEBUG] [LOCAL ] CHT: Trimmed 21472 records to 14218 (keeping 150 days of data) [2025-09-15T17:46:19.421287] [DEBUG] [LOCAL ] CHT: Primary data saved (14218 records). [2025-09-15T17:46:19.421430] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-15T17:46:19.421514] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 15.8s. Estimated remaining: 3h 21m 43s. Rate: 9.6 symbols/min [2025-09-15T17:46:19.599534] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:19.612556] [DEBUG] [LOCAL ] CIA: Loaded 12924 existing records from primary storage. [2025-09-15T17:46:19.612685] [INFO ] [MAIN ] CIA: Loaded 12924 existing records. [2025-09-15T17:46:19.662966] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-15T17:46:19.800679] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:19.800919] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-15T17:46:19.800968] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-15T17:46:19.801352] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-15T17:46:19.801401] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-15T17:46:20.157499] [INFO ] [REMOTE ] CIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:20.457915] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-15T17:46:21.052623] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T17:46:21.257881] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-15T17:46:21.371530] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:46:22.057885] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-15T17:46:22.350697] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:46:22.386418] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:46:22.857873] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-15T17:46:23.657885] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-15T17:46:24.217441] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T17:46:24.457858] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-15T17:46:24.532443] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:46:25.041515] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T17:46:25.257898] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-15T17:46:25.524274] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T17:46:26.057914] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-15T17:46:26.183116] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:46:26.857876] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-15T17:46:27.575584] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:46:27.657900] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-15T17:46:28.089376] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-15T17:46:28.457913] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-15T17:46:29.260533] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-15T17:46:29.266998] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:46:29.934064] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:46:30.057873] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-15T17:46:30.857902] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-15T17:46:31.657907] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-15T17:46:31.776912] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:46:32.023590] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-15T17:46:32.068662] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T17:46:32.457900] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-15T17:46:33.257883] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-15T17:46:33.553702] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T17:46:34.065839] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-15T17:46:34.071240] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:46:34.341891] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:46:34.857880] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-15T17:46:35.657881] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-15T17:46:35.782897] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:46:35.969029] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:46:36.457901] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-15T17:46:37.257834] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-15T17:46:37.370758] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:46:37.853207] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:46:37.873028] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:46:37.874867] [INFO ] [REMOTE ] CIA: Full fetch complete (18219 records). [2025-09-15T17:46:37.874936] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-15T17:46:38.059216] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-15T17:46:38.249963] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-15T17:46:38.250046] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-15T17:46:38.250509] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-15T17:46:38.250558] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-15T17:46:38.251152] [DEBUG] [LOCAL ] CIA: Trimmed 18219 records to 12731 (keeping 150 days of data) [2025-09-15T17:46:38.322032] [DEBUG] [LOCAL ] CIA: Primary data saved (12731 records). [2025-09-15T17:46:38.322179] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-15T17:46:38.322262] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CIA took 18.9s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-15T17:46:38.488797] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:38.510373] [DEBUG] [LOCAL ] CIB: Loaded 22339 existing records from primary storage. [2025-09-15T17:46:38.510508] [INFO ] [MAIN ] CIB: Loaded 22339 existing records. [2025-09-15T17:46:38.683751] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:38.684005] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-15T17:46:38.684051] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-15T17:46:38.684678] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-15T17:46:38.684731] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-15T17:46:38.866608] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-15T17:46:39.042310] [INFO ] [REMOTE ] CIB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:39.387137] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:46:39.391491] [INFO ] [REMOTE ] CHPT: Full fetch complete (54741 records). [2025-09-15T17:46:39.391588] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-15T17:46:39.664603] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-15T17:46:39.764266] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-15T17:46:39.764350] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-15T17:46:39.765060] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-15T17:46:39.765108] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-15T17:46:39.766248] [DEBUG] [LOCAL ] CHPT: Trimmed 54741 records to 36128 (keeping 150 days of data) [2025-09-15T17:46:39.981058] [DEBUG] [LOCAL ] CHPT: Primary data saved (36128 records). [2025-09-15T17:46:39.981203] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-15T17:46:39.981678] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHPT took 36.3s. Estimated remaining: 3h 22m 5s. Rate: 9.5 symbols/min [2025-09-15T17:46:40.157593] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:40.157850] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-15T17:46:40.157891] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-15T17:46:40.158056] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-15T17:46:40.158100] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-15T17:46:40.158147] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-15T17:46:40.158182] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-15T17:46:40.474006] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-15T17:46:40.513083] [INFO ] [REMOTE ] CICB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:40.813909] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T17:46:40.820277] [INFO ] [REMOTE ] CHWY: Full fetch complete (58297 records). [2025-09-15T17:46:40.820457] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-15T17:46:41.207070] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-15T17:46:41.207206] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-15T17:46:41.208177] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-15T17:46:41.208239] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-15T17:46:41.209738] [DEBUG] [LOCAL ] CHWY: Trimmed 58297 records to 39622 (keeping 150 days of data) [2025-09-15T17:46:41.261870] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-15T17:46:41.333778] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:46:41.342908] [INFO ] [REMOTE ] CI: Full fetch complete (54290 records). [2025-09-15T17:46:41.344295] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-15T17:46:41.867286] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:46:41.883301] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-15T17:46:41.884292] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-15T17:46:41.885378] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-15T17:46:41.886346] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-15T17:46:41.905524] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:46:41.914783] [DEBUG] [LOCAL ] CI: Trimmed 54290 records to 36930 (keeping 150 days of data) [2025-09-15T17:46:42.053945] [DEBUG] [LOCAL ] CHWY: Primary data saved (39622 records). [2025-09-15T17:46:42.055294] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-15T17:46:42.055850] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CHWY took 38.4s. Estimated remaining: 3h 21m 41s. Rate: 9.5 symbols/min [2025-09-15T17:46:42.066481] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-15T17:46:42.244684] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:42.383597] [DEBUG] [LOCAL ] CIEN: Loaded 39027 existing records from primary storage. [2025-09-15T17:46:42.386042] [DEBUG] [LOCAL ] CI: Primary data saved (36930 records). [2025-09-15T17:46:42.386158] [INFO ] [MAIN ] CIEN: Loaded 39027 existing records. [2025-09-15T17:46:42.417321] [INFO ] [MAIN ] CI: Full history saved. [2025-09-15T17:46:42.449588] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CI took 28.6s. Estimated remaining: 3h 21m 9s. Rate: 9.6 symbols/min [2025-09-15T17:46:42.556511] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:46:42.674106] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:42.714416] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-15T17:46:42.727913] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-15T17:46:42.744898] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-15T17:46:42.746510] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:42.746670] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-15T17:46:42.853259] [DEBUG] [LOCAL ] CIF: Loaded 2998 existing records from primary storage. [2025-09-15T17:46:42.853428] [INFO ] [MAIN ] CIF: Loaded 2998 existing records. [2025-09-15T17:46:42.869465] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-15T17:46:43.306600] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:43.310817] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-15T17:46:43.310896] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-15T17:46:43.310541] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:43.311265] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-15T17:46:43.311327] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-15T17:46:43.670336] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-15T17:46:43.674860] [INFO ] [REMOTE ] CIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:43.893243] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:46:44.457892] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-15T17:46:45.226179] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:46:45.257822] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-15T17:46:46.024997] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:46:46.057821] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-15T17:46:46.857854] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-15T17:46:47.220552] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T17:46:47.234993] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:46:47.332917] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T17:46:47.657890] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-15T17:46:48.039383] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:46:48.457914] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-15T17:46:48.727039] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-15T17:46:49.257913] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-15T17:46:49.743897] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T17:46:50.057886] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-15T17:46:50.333207] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T17:46:50.857862] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-15T17:46:51.181420] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:46:51.657919] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-15T17:46:52.457983] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-15T17:46:53.074349] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:46:53.076690] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:46:53.077595] [INFO ] [REMOTE ] CICB: Full fetch complete (1455 records). [2025-09-15T17:46:53.088249] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-15T17:46:53.272168] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T17:46:53.266862] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-15T17:46:53.272426] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:53.273260] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:53.273315] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-15T17:46:53.273366] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-15T17:46:53.273409] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-15T17:46:53.273452] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-15T17:46:53.273519] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CICB took 13.3s. Estimated remaining: 3h 21m 22s. Rate: 9.5 symbols/min [2025-09-15T17:46:53.510231] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:53.550618] [DEBUG] [LOCAL ] CIG: Loaded 33103 existing records from primary storage. [2025-09-15T17:46:53.550847] [INFO ] [MAIN ] CIG: Loaded 33103 existing records. [2025-09-15T17:46:53.741083] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:53.741525] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-15T17:46:53.741598] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-15T17:46:53.742687] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-15T17:46:53.742769] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-15T17:46:54.063147] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-15T17:46:54.122425] [INFO ] [REMOTE ] CIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:54.857834] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-15T17:46:54.930230] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T17:46:54.949092] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:46:55.657894] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-15T17:46:56.394450] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:46:56.457875] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-15T17:46:57.140092] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:46:57.257812] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-15T17:46:57.704258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:46:58.057886] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-15T17:46:58.472070] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:46:58.857867] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-15T17:46:59.154369] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:46:59.657870] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-15T17:47:00.288170] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:47:00.457888] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-15T17:47:01.109959] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:47:01.260163] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-15T17:47:01.265751] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:47:02.057914] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-15T17:47:02.076516] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:47:02.857891] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-15T17:47:03.161996] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:47:03.657878] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-15T17:47:04.110867] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:47:04.148830] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:47:04.457890] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-15T17:47:05.257945] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-15T17:47:05.568847] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:47:06.057867] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-15T17:47:06.217873] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:47:06.221937] [INFO ] [REMOTE ] CIB: Full fetch complete (34130 records). [2025-09-15T17:47:06.222026] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-15T17:47:06.602320] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-15T17:47:06.602408] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-15T17:47:06.603004] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-15T17:47:06.603084] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-15T17:47:06.604065] [DEBUG] [LOCAL ] CIB: Trimmed 34130 records to 21773 (keeping 150 days of data) [2025-09-15T17:47:06.735821] [DEBUG] [LOCAL ] CIB: Primary data saved (21773 records). [2025-09-15T17:47:06.735948] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-15T17:47:06.736036] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIB took 28.4s. Estimated remaining: 3h 21m 47s. Rate: 9.5 symbols/min [2025-09-15T17:47:06.862932] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-15T17:47:06.908332] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:06.923594] [DEBUG] [LOCAL ] CII: Loaded 10502 existing records from primary storage. [2025-09-15T17:47:06.923776] [INFO ] [MAIN ] CII: Loaded 10502 existing records. [2025-09-15T17:47:07.102707] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:07.102957] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-15T17:47:07.103005] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-15T17:47:07.103460] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-15T17:47:07.103536] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-15T17:47:07.393638] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T17:47:07.470386] [INFO ] [REMOTE ] CII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:07.594885] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:47:07.657856] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-15T17:47:08.457908] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-15T17:47:09.019869] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:47:09.257887] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-15T17:47:09.860243] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:47:09.866291] [INFO ] [REMOTE ] CIEN: Full fetch complete (56648 records). [2025-09-15T17:47:09.866433] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-15T17:47:10.059613] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-15T17:47:10.277321] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-15T17:47:10.277445] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-15T17:47:10.278534] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-15T17:47:10.278588] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-15T17:47:10.280435] [DEBUG] [LOCAL ] CIEN: Trimmed 56648 records to 38272 (keeping 150 days of data) [2025-09-15T17:47:10.398755] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:47:10.407484] [INFO ] [REMOTE ] CIG: Full fetch complete (46846 records). [2025-09-15T17:47:10.408204] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-15T17:47:10.855307] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:47:10.858738] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-15T17:47:10.982708] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-15T17:47:10.988370] [DEBUG] [LOCAL ] CIEN: Primary data saved (38272 records). [2025-09-15T17:47:10.988757] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-15T17:47:10.988668] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-15T17:47:10.990174] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 28.9s. Estimated remaining: 3h 21m 32s. Rate: 9.5 symbols/min [2025-09-15T17:47:10.991420] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-15T17:47:10.991700] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-15T17:47:11.095718] [DEBUG] [LOCAL ] CIG: Trimmed 46846 records to 32541 (keeping 150 days of data) [2025-09-15T17:47:11.167490] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:11.304246] [DEBUG] [LOCAL ] CIM: Loaded 27047 existing records from primary storage. [2025-09-15T17:47:11.306759] [INFO ] [MAIN ] CIM: Loaded 27047 existing records. [2025-09-15T17:47:11.544689] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:11.548123] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-15T17:47:11.554534] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-15T17:47:11.562757] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-15T17:47:11.571370] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-15T17:47:11.596899] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:47:11.660037] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-15T17:47:11.680129] [DEBUG] [LOCAL ] CIG: Primary data saved (32541 records). [2025-09-15T17:47:11.692778] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-15T17:47:11.703966] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIG took 18.4s. Estimated remaining: 3h 21m 1s. Rate: 9.5 symbols/min [2025-09-15T17:47:12.124314] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:12.138929] [INFO ] [REMOTE ] CIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:12.145869] [DEBUG] [LOCAL ] CIMN: Loaded 2000 existing records from primary storage. [2025-09-15T17:47:12.146073] [INFO ] [MAIN ] CIMN: Loaded 2000 existing records. [2025-09-15T17:47:12.338321] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:12.338713] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-15T17:47:12.338770] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-15T17:47:12.339127] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-15T17:47:12.339189] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-15T17:47:12.460700] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-15T17:47:12.678201] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:47:12.741526] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:13.257935] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-15T17:47:13.285700] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T17:47:13.843946] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:47:14.057906] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-15T17:47:14.857909] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-15T17:47:15.160157] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:47:15.657889] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-15T17:47:16.146506] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:47:16.147490] [INFO ] [REMOTE ] CIF: Full fetch complete (5109 records). [2025-09-15T17:47:16.147560] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-15T17:47:16.477410] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-15T17:47:16.508382] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-15T17:47:16.508599] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-15T17:47:16.508853] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-15T17:47:16.509015] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-15T17:47:16.509579] [DEBUG] [LOCAL ] CIF: Trimmed 5109 records to 2943 (keeping 150 days of data) [2025-09-15T17:47:16.545740] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:47:16.557542] [DEBUG] [LOCAL ] CIF: Primary data saved (2943 records). [2025-09-15T17:47:16.557617] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-15T17:47:16.557714] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIF took 34.1s. Estimated remaining: 3h 20m 49s. Rate: 9.6 symbols/min [2025-09-15T17:47:16.728552] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:16.732055] [DEBUG] [LOCAL ] CIMO: Loaded 2054 existing records from primary storage. [2025-09-15T17:47:16.732126] [INFO ] [MAIN ] CIMO: Loaded 2054 existing records. [2025-09-15T17:47:16.903912] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:16.904153] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-15T17:47:16.904204] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-15T17:47:16.904421] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-15T17:47:16.904494] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-15T17:47:17.247668] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:17.257826] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-15T17:47:17.419823] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:47:17.828847] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T17:47:18.057885] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-15T17:47:18.685935] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:47:18.857893] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-15T17:47:19.657920] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-15T17:47:19.887749] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:47:20.015553] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:47:20.457915] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-15T17:47:21.025579] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:47:21.257868] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-15T17:47:21.579851] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:47:22.057874] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-15T17:47:22.461526] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:47:22.857923] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-15T17:47:23.376742] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T17:47:23.657886] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-15T17:47:24.457891] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-15T17:47:24.782339] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:47:25.262980] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-15T17:47:25.277428] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:47:25.594307] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T17:47:26.057917] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-15T17:47:26.857873] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-15T17:47:27.233746] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:47:27.538868] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T17:47:27.657881] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-15T17:47:28.457885] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-15T17:47:28.556430] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:47:28.934831] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T17:47:29.257860] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-15T17:47:29.909115] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:47:30.057880] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-15T17:47:30.857892] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-15T17:47:30.989148] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:47:31.328265] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:47:31.329356] [INFO ] [REMOTE ] CIMO: Full fetch complete (3150 records). [2025-09-15T17:47:31.329424] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-15T17:47:31.678349] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-15T17:47:31.687201] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-09-15T17:47:31.687262] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-09-15T17:47:31.687383] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-09-15T17:47:31.687433] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-09-15T17:47:31.687866] [DEBUG] [LOCAL ] CIMO: Trimmed 3150 records to 2027 (keeping 150 days of data) [2025-09-15T17:47:31.701260] [DEBUG] [LOCAL ] CIMO: Primary data saved (2027 records). [2025-09-15T17:47:31.701353] [INFO ] [MAIN ] CIMO: Full history saved. [2025-09-15T17:47:31.701430] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIMO took 15.1s. Estimated remaining: 3h 21m 20s. Rate: 9.5 symbols/min [2025-09-15T17:47:31.879663] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:31.898441] [DEBUG] [LOCAL ] CINT: Loaded 13273 existing records from primary storage. [2025-09-15T17:47:31.898585] [INFO ] [MAIN ] CINT: Loaded 13273 existing records. [2025-09-15T17:47:32.080079] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:32.080329] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-15T17:47:32.080375] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-15T17:47:32.080911] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-15T17:47:32.080962] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-15T17:47:32.190834] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T17:47:32.438313] [INFO ] [REMOTE ] CINT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:32.457816] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-15T17:47:33.257901] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-15T17:47:33.558680] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:47:33.771910] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:47:34.057875] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-15T17:47:34.857867] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-15T17:47:34.905835] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:47:35.657901] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-15T17:47:35.723088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:47:35.725357] [INFO ] [REMOTE ] CII: Full fetch complete (16921 records). [2025-09-15T17:47:35.725436] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-15T17:47:36.089288] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-15T17:47:36.089369] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-15T17:47:36.089744] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-15T17:47:36.089788] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-15T17:47:36.090414] [DEBUG] [LOCAL ] CII: Trimmed 16921 records to 10090 (keeping 150 days of data) [2025-09-15T17:47:36.158885] [DEBUG] [LOCAL ] CII: Primary data saved (10090 records). [2025-09-15T17:47:36.159046] [INFO ] [MAIN ] CII: Full history saved. [2025-09-15T17:47:36.159168] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CII took 29.4s. Estimated remaining: 3h 21m 6s. Rate: 9.5 symbols/min [2025-09-15T17:47:36.333859] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:36.349424] [DEBUG] [LOCAL ] CIO: Loaded 14685 existing records from primary storage. [2025-09-15T17:47:36.349594] [INFO ] [MAIN ] CIO: Loaded 14685 existing records. [2025-09-15T17:47:36.460635] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-15T17:47:36.539236] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:36.539487] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-15T17:47:36.539535] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-15T17:47:36.540003] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-15T17:47:36.540051] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-15T17:47:36.922101] [INFO ] [REMOTE ] CIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:36.944962] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:47:37.165922] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:47:37.257872] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-15T17:47:38.057902] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-15T17:47:38.309234] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T17:47:38.857909] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-15T17:47:39.402248] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T17:47:39.492551] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:47:39.496886] [INFO ] [REMOTE ] CIM: Full fetch complete (40718 records). [2025-09-15T17:47:39.496998] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-15T17:47:39.668561] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-15T17:47:39.873370] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-15T17:47:39.873446] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-15T17:47:39.874065] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-15T17:47:39.874109] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-15T17:47:39.875989] [DEBUG] [LOCAL ] CIM: Trimmed 40718 records to 26357 (keeping 150 days of data) [2025-09-15T17:47:40.042924] [DEBUG] [LOCAL ] CIM: Primary data saved (26357 records). [2025-09-15T17:47:40.043059] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-15T17:47:40.043183] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 29.1s. Estimated remaining: 3h 20m 50s. Rate: 9.5 symbols/min [2025-09-15T17:47:40.218362] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:40.239481] [DEBUG] [LOCAL ] CION: Loaded 20633 existing records from primary storage. [2025-09-15T17:47:40.239607] [INFO ] [MAIN ] CION: Loaded 20633 existing records. [2025-09-15T17:47:40.414444] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:40.414706] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-15T17:47:40.414760] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-15T17:47:40.415315] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-15T17:47:40.415363] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-15T17:47:40.469100] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-15T17:47:40.770526] [INFO ] [REMOTE ] CION: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:40.782033] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:47:40.967122] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T17:47:41.257848] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-15T17:47:41.702109] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T17:47:41.702929] [INFO ] [REMOTE ] CIMN: Full fetch complete (2866 records). [2025-09-15T17:47:41.702995] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-15T17:47:42.054687] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-15T17:47:42.054773] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-15T17:47:42.054872] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-15T17:47:42.054908] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-15T17:47:42.055251] [DEBUG] [LOCAL ] CIMN: Trimmed 2866 records to 1932 (keeping 150 days of data) [2025-09-15T17:47:42.062020] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-15T17:47:42.068691] [DEBUG] [LOCAL ] CIMN: Primary data saved (1932 records). [2025-09-15T17:47:42.068751] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-15T17:47:42.068835] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMN took 30.4s. Estimated remaining: 3h 20m 26s. Rate: 9.5 symbols/min [2025-09-15T17:47:42.239730] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:42.286859] [DEBUG] [LOCAL ] CIVI: Loaded 39579 existing records from primary storage. [2025-09-15T17:47:42.287003] [INFO ] [MAIN ] CIVI: Loaded 39579 existing records. [2025-09-15T17:47:42.499918] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:42.500165] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-15T17:47:42.500211] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-15T17:47:42.501090] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-15T17:47:42.501146] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-15T17:47:42.851444] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:42.857816] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-15T17:47:43.085052] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:47:43.657877] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-15T17:47:44.271007] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:47:44.457923] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-15T17:47:44.682289] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:47:45.257889] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-15T17:47:45.290489] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:47:46.057932] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-15T17:47:46.124409] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:47:46.857919] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-15T17:47:46.903851] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:47:47.658050] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-15T17:47:47.773978] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:47:48.457883] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-15T17:47:49.257928] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-15T17:47:49.348499] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:47:49.711826] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:47:50.057869] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-15T17:47:50.583455] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:47:50.695447] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:47:50.857866] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-15T17:47:51.657892] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-15T17:47:51.918290] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:47:51.921138] [INFO ] [REMOTE ] CIO: Full fetch complete (21210 records). [2025-09-15T17:47:51.921209] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-15T17:47:52.298059] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-15T17:47:52.298253] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-15T17:47:52.304064] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-15T17:47:52.307525] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-15T17:47:52.310685] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:47:52.314576] [DEBUG] [LOCAL ] CIO: Trimmed 21210 records to 14449 (keeping 150 days of data) [2025-09-15T17:47:52.407281] [DEBUG] [LOCAL ] CIO: Primary data saved (14449 records). [2025-09-15T17:47:52.407428] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-15T17:47:52.407532] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CIO took 16.2s. Estimated remaining: 3h 20m 36s. Rate: 9.5 symbols/min [2025-09-15T17:47:52.462938] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-15T17:47:52.585998] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:52.632475] [DEBUG] [LOCAL ] CL: Loaded 40389 existing records from primary storage. [2025-09-15T17:47:52.632620] [INFO ] [MAIN ] CL: Loaded 40389 existing records. [2025-09-15T17:47:52.814765] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:52.814996] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-15T17:47:52.815041] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-15T17:47:52.815907] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-15T17:47:52.815955] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-15T17:47:53.172897] [INFO ] [REMOTE ] CL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:53.257839] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-15T17:47:53.916677] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:47:54.057875] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-15T17:47:54.682956] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:47:54.857863] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-15T17:47:55.657887] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-15T17:47:55.738313] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:47:56.268191] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:47:56.457902] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-15T17:47:57.246413] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:47:57.257811] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-15T17:47:57.567802] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:47:58.057873] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-15T17:47:58.638251] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T17:47:58.857851] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-15T17:47:59.196869] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:47:59.657869] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-15T17:48:00.333151] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:48:00.457820] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-15T17:48:00.802501] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:48:01.257913] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-15T17:48:01.832759] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:48:02.057876] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-15T17:48:02.316971] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:48:02.857877] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-15T17:48:03.657886] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-15T17:48:03.886811] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:48:04.167337] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:48:04.457910] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-15T17:48:04.549991] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:48:05.265282] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-15T17:48:05.268313] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:48:05.271878] [INFO ] [REMOTE ] CION: Full fetch complete (31447 records). [2025-09-15T17:48:05.271965] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-15T17:48:05.644690] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-15T17:48:05.644783] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-15T17:48:05.645296] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-15T17:48:05.645337] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-15T17:48:05.646084] [DEBUG] [LOCAL ] CION: Trimmed 31447 records to 20264 (keeping 150 days of data) [2025-09-15T17:48:05.771530] [DEBUG] [LOCAL ] CION: Primary data saved (20264 records). [2025-09-15T17:48:05.771677] [INFO ] [MAIN ] CION: Full history saved. [2025-09-15T17:48:05.771758] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CION took 25.7s. Estimated remaining: 3h 20m 60s. Rate: 9.5 symbols/min [2025-09-15T17:48:05.939945] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:05.964326] [DEBUG] [LOCAL ] CLB: Loaded 24690 existing records from primary storage. [2025-09-15T17:48:05.964629] [INFO ] [MAIN ] CLB: Loaded 24690 existing records. [2025-09-15T17:48:06.062288] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-15T17:48:06.140494] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:06.140758] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-15T17:48:06.140805] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-15T17:48:06.141516] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-15T17:48:06.141567] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-15T17:48:06.487820] [INFO ] [REMOTE ] CLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:06.857855] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-15T17:48:06.968747] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:48:07.043988] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:48:07.050185] [INFO ] [REMOTE ] CINT: Full fetch complete (19747 records). [2025-09-15T17:48:07.050427] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-15T17:48:07.446888] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-15T17:48:07.446979] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-15T17:48:07.447509] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-15T17:48:07.447551] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-15T17:48:07.448219] [DEBUG] [LOCAL ] CINT: Trimmed 19747 records to 13303 (keeping 150 days of data) [2025-09-15T17:48:07.525131] [DEBUG] [LOCAL ] CINT: Primary data saved (13303 records). [2025-09-15T17:48:07.525282] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-15T17:48:07.525367] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CINT took 35.8s. Estimated remaining: 3h 20m 34s. Rate: 9.5 symbols/min [2025-09-15T17:48:07.664561] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-15T17:48:07.695767] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:07.704982] [DEBUG] [LOCAL ] CLCO: Loaded 8144 existing records from primary storage. [2025-09-15T17:48:07.705096] [INFO ] [MAIN ] CLCO: Loaded 8144 existing records. [2025-09-15T17:48:07.885160] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:07.885456] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-15T17:48:07.885505] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-15T17:48:07.885860] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-15T17:48:07.885911] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-15T17:48:08.243346] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:08.457834] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-15T17:48:08.526330] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:48:08.779263] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:48:09.257933] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-15T17:48:10.031031] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:48:10.039746] [INFO ] [REMOTE ] CL: Full fetch complete (58319 records). [2025-09-15T17:48:10.039993] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-15T17:48:10.066708] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-15T17:48:10.429470] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-15T17:48:10.429564] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-15T17:48:10.430359] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-15T17:48:10.430419] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-15T17:48:10.431685] [DEBUG] [LOCAL ] CL: Trimmed 58319 records to 39609 (keeping 150 days of data) [2025-09-15T17:48:10.679699] [DEBUG] [LOCAL ] CL: Primary data saved (39609 records). [2025-09-15T17:48:10.679845] [INFO ] [MAIN ] CL: Full history saved. [2025-09-15T17:48:10.680428] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 18.3s. Estimated remaining: 3h 20m 15s. Rate: 9.5 symbols/min [2025-09-15T17:48:10.856821] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:10.857834] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-15T17:48:10.876361] [DEBUG] [LOCAL ] CLDT: Loaded 18061 existing records from primary storage. [2025-09-15T17:48:10.876504] [INFO ] [MAIN ] CLDT: Loaded 18061 existing records. [2025-09-15T17:48:11.068125] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:11.068671] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-15T17:48:11.068738] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-15T17:48:11.074470] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-15T17:48:11.083591] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-15T17:48:11.114432] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T17:48:11.230322] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T17:48:11.495360] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:11.657858] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-15T17:48:12.062659] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:48:12.457927] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-15T17:48:12.574631] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:48:13.257886] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-15T17:48:13.690511] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:48:13.700293] [INFO ] [REMOTE ] CIVI: Full fetch complete (57093 records). [2025-09-15T17:48:13.700602] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-15T17:48:14.060550] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-15T17:48:14.124495] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-15T17:48:14.124674] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-15T17:48:14.125709] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-15T17:48:14.125787] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-15T17:48:14.127727] [DEBUG] [LOCAL ] CIVI: Trimmed 57093 records to 38791 (keeping 150 days of data) [2025-09-15T17:48:14.273580] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:48:14.433900] [DEBUG] [LOCAL ] CIVI: Primary data saved (38791 records). [2025-09-15T17:48:14.434152] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-15T17:48:14.434795] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CIVI took 32.4s. Estimated remaining: 3h 19m 58s. Rate: 9.5 symbols/min [2025-09-15T17:48:14.630690] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:14.679667] [DEBUG] [LOCAL ] CLF: Loaded 40482 existing records from primary storage. [2025-09-15T17:48:14.679889] [INFO ] [MAIN ] CLF: Loaded 40482 existing records. [2025-09-15T17:48:14.867700] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-15T17:48:14.876341] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:14.876683] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-15T17:48:14.876753] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-15T17:48:14.877801] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-15T17:48:14.877857] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-15T17:48:15.266836] [INFO ] [REMOTE ] CLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:15.276325] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:48:15.657974] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-15T17:48:16.258878] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:48:16.457974] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-15T17:48:16.823140] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:48:17.257848] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-15T17:48:17.287694] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:48:18.057882] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-15T17:48:18.857894] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-15T17:48:19.225489] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:48:19.276720] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T17:48:19.577958] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:48:19.657961] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-15T17:48:20.457950] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-15T17:48:20.890326] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:48:21.257918] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-15T17:48:22.057895] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-15T17:48:22.292890] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:48:22.489264] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T17:48:22.857971] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-15T17:48:23.495728] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:48:23.657932] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-15T17:48:24.457841] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-15T17:48:24.609337] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:48:24.999586] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:48:25.257847] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-15T17:48:25.347818] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:48:26.057871] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-15T17:48:26.857928] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-15T17:48:27.069775] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:48:27.074110] [INFO ] [REMOTE ] CLB: Full fetch complete (35814 records). [2025-09-15T17:48:27.074286] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-15T17:48:27.467491] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-15T17:48:27.467693] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-15T17:48:27.468523] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-15T17:48:27.479413] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-15T17:48:27.498949] [DEBUG] [LOCAL ] CLB: Trimmed 35814 records to 24105 (keeping 150 days of data) [2025-09-15T17:48:27.500752] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-15T17:48:27.659403] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-15T17:48:27.665109] [DEBUG] [LOCAL ] CLB: Primary data saved (24105 records). [2025-09-15T17:48:27.665406] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-15T17:48:27.665507] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CLB took 21.9s. Estimated remaining: 3h 20m 21s. Rate: 9.5 symbols/min [2025-09-15T17:48:27.837892] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:27.857725] [DEBUG] [LOCAL ] CLH: Loaded 20164 existing records from primary storage. [2025-09-15T17:48:27.857861] [INFO ] [MAIN ] CLH: Loaded 20164 existing records. [2025-09-15T17:48:28.049334] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:28.057558] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-15T17:48:28.057666] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-15T17:48:28.058408] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:48:28.062561] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-15T17:48:28.063101] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-15T17:48:28.429166] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:28.457827] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-15T17:48:28.748459] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:48:28.751391] [INFO ] [REMOTE ] CLDT: Full fetch complete (28557 records). [2025-09-15T17:48:28.751500] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-15T17:48:29.153332] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-15T17:48:29.153415] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-15T17:48:29.153951] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-15T17:48:29.154001] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-15T17:48:29.154750] [DEBUG] [LOCAL ] CLDT: Trimmed 28557 records to 17486 (keeping 150 days of data) [2025-09-15T17:48:29.258721] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-15T17:48:29.261103] [DEBUG] [LOCAL ] CLDT: Primary data saved (17486 records). [2025-09-15T17:48:29.261185] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-15T17:48:29.261263] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLDT took 18.6s. Estimated remaining: 3h 19m 55s. Rate: 9.5 symbols/min [2025-09-15T17:48:29.437877] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:29.448323] [DEBUG] [LOCAL ] CLPR: Loaded 7910 existing records from primary storage. [2025-09-15T17:48:29.448512] [INFO ] [MAIN ] CLPR: Loaded 7910 existing records. [2025-09-15T17:48:29.646690] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:29.647118] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-15T17:48:29.647270] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-15T17:48:29.647760] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-15T17:48:29.647858] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-15T17:48:29.961839] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:48:30.055755] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:30.057849] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-15T17:48:30.807033] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:48:30.857932] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-15T17:48:31.440269] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-15T17:48:31.460069] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:48:31.657880] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-15T17:48:32.280405] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:48:32.457900] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-15T17:48:33.257869] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-15T17:48:33.709682] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:48:34.057871] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-15T17:48:34.639592] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:48:34.857877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-15T17:48:34.977840] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:48:35.657922] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-15T17:48:36.074898] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:48:36.457926] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-15T17:48:37.257895] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-15T17:48:37.290171] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T17:48:37.919841] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T17:48:37.995463] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T17:48:38.057825] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-15T17:48:38.857851] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-15T17:48:39.613584] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:48:39.657824] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-15T17:48:39.791799] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T17:48:40.457877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-15T17:48:40.469680] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T17:48:41.257880] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-15T17:48:41.720843] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:48:41.771817] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:48:42.057869] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-15T17:48:42.731505] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:48:42.732941] [INFO ] [REMOTE ] CLPR: Full fetch complete (12576 records). [2025-09-15T17:48:42.733015] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-15T17:48:42.862966] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-15T17:48:43.104577] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-15T17:48:43.104692] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-15T17:48:43.105057] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-15T17:48:43.105099] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-15T17:48:43.105720] [DEBUG] [LOCAL ] CLPR: Trimmed 12576 records to 7760 (keeping 150 days of data) [2025-09-15T17:48:43.152262] [DEBUG] [LOCAL ] CLPR: Primary data saved (7760 records). [2025-09-15T17:48:43.152400] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-15T17:48:43.152508] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLPR took 13.9s. Estimated remaining: 3h 20m 20s. Rate: 9.5 symbols/min [2025-09-15T17:48:43.323490] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:43.365289] [DEBUG] [LOCAL ] CLS: Loaded 40398 existing records from primary storage. [2025-09-15T17:48:43.365431] [INFO ] [MAIN ] CLS: Loaded 40398 existing records. [2025-09-15T17:48:43.541592] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:43.541867] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-15T17:48:43.541932] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-15T17:48:43.543001] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-15T17:48:43.543066] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-15T17:48:43.662945] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-15T17:48:43.909894] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:44.450721] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:48:44.457805] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-15T17:48:44.964776] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-15T17:48:44.970716] [INFO ] [REMOTE ] CLF: Full fetch complete (58422 records). [2025-09-15T17:48:44.970870] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-15T17:48:45.077728] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:48:45.119564] [INFO ] [REMOTE ] CLCO: Full fetch complete (15593 records). [2025-09-15T17:48:45.138852] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-15T17:48:45.259933] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-15T17:48:45.681424] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-15T17:48:45.692661] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-15T17:48:45.709629] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-15T17:48:45.736795] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-15T17:48:45.771632] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-15T17:48:45.771842] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-15T17:48:45.772178] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-15T17:48:45.772318] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-15T17:48:45.773690] [DEBUG] [LOCAL ] CLCO: Trimmed 15593 records to 7925 (keeping 150 days of data) [2025-09-15T17:48:45.773500] [DEBUG] [LOCAL ] CLF: Trimmed 58422 records to 39702 (keeping 150 days of data) [2025-09-15T17:48:45.913477] [DEBUG] [LOCAL ] CLCO: Primary data saved (7925 records). [2025-09-15T17:48:45.922891] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-15T17:48:45.923410] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLCO took 38.4s. Estimated remaining: 3h 19m 59s. Rate: 9.5 symbols/min [2025-09-15T17:48:46.060917] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-15T17:48:46.181755] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:46.270031] [DEBUG] [LOCAL ] CLVT: Loaded 39160 existing records from primary storage. [2025-09-15T17:48:46.270849] [INFO ] [MAIN ] CLVT: Loaded 39160 existing records. [2025-09-15T17:48:46.444967] [DEBUG] [LOCAL ] CLF: Primary data saved (39702 records). [2025-09-15T17:48:46.464995] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-15T17:48:46.465154] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:46.466063] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 32.0s. Estimated remaining: 3h 19m 29s. Rate: 9.5 symbols/min [2025-09-15T17:48:46.466264] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-15T17:48:46.466598] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-15T17:48:46.504815] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-15T17:48:46.524500] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-15T17:48:46.752794] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:46.810769] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:48:46.890781] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-15T17:48:46.969196] [DEBUG] [LOCAL ] CLW: Loaded 15967 existing records from primary storage. [2025-09-15T17:48:46.975163] [INFO ] [MAIN ] CLW: Loaded 15967 existing records. [2025-09-15T17:48:47.160083] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:47.231011] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:47.231261] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-15T17:48:47.231311] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-15T17:48:47.231844] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-15T17:48:47.231906] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-15T17:48:47.597398] [INFO ] [REMOTE ] CLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:47.657898] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-15T17:48:48.201068] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:48:48.463889] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-15T17:48:48.482156] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-15T17:48:48.536164] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T17:48:49.257891] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-15T17:48:50.057872] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-15T17:48:50.162855] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:48:50.857882] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-15T17:48:51.271830] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:48:51.446602] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T17:48:51.657872] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-15T17:48:52.457895] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-15T17:48:52.493394] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:48:52.813127] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T17:48:52.816135] [INFO ] [REMOTE ] CLH: Full fetch complete (31708 records). [2025-09-15T17:48:52.816216] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-15T17:48:53.187415] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-15T17:48:53.187494] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-15T17:48:53.188002] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-15T17:48:53.188061] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-15T17:48:53.188869] [DEBUG] [LOCAL ] CLH: Trimmed 31708 records to 19570 (keeping 150 days of data) [2025-09-15T17:48:53.276403] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-15T17:48:53.310920] [DEBUG] [LOCAL ] CLH: Primary data saved (19570 records). [2025-09-15T17:48:53.311037] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-15T17:48:53.311130] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLH took 25.6s. Estimated remaining: 3h 19m 25s. Rate: 9.5 symbols/min [2025-09-15T17:48:53.480243] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:53.529082] [DEBUG] [LOCAL ] CLX: Loaded 39046 existing records from primary storage. [2025-09-15T17:48:53.529262] [INFO ] [MAIN ] CLX: Loaded 39046 existing records. [2025-09-15T17:48:53.727723] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:53.728042] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-15T17:48:53.728103] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-15T17:48:53.729180] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-15T17:48:53.729245] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-15T17:48:54.063091] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-15T17:48:54.088924] [INFO ] [REMOTE ] CLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:54.429209] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:48:54.617360] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T17:48:54.857877] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-15T17:48:55.657877] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-15T17:48:55.787810] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:48:56.002632] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:48:56.457914] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-15T17:48:57.257863] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-15T17:48:57.587733] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T17:48:58.029475] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:48:58.057903] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-15T17:48:58.825354] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:48:58.857904] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-15T17:48:59.657970] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-15T17:49:00.068237] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T17:49:00.430785] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T17:49:00.457835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-15T17:49:00.651501] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:49:01.257932] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-15T17:49:02.039783] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:49:02.057835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-15T17:49:02.857877] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-15T17:49:03.566972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-15T17:49:03.657826] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-15T17:49:03.747705] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:49:03.883496] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T17:49:04.457874] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-15T17:49:05.257900] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-15T17:49:05.950035] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:49:05.951549] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-15T17:49:06.057903] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-15T17:49:06.105752] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T17:49:06.111368] [INFO ] [REMOTE ] CLVT: Full fetch complete (56681 records). [2025-09-15T17:49:06.111473] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-15T17:49:06.500724] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-15T17:49:06.500838] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-15T17:49:06.501665] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-15T17:49:06.501729] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-15T17:49:06.503054] [DEBUG] [LOCAL ] CLVT: Trimmed 56681 records to 38400 (keeping 150 days of data) [2025-09-15T17:49:06.732344] [DEBUG] [LOCAL ] CLVT: Primary data saved (38400 records). [2025-09-15T17:49:06.732534] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-15T17:49:06.733784] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 20.8s. Estimated remaining: 3h 19m 48s. Rate: 9.5 symbols/min [2025-09-15T17:49:06.862980] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-15T17:49:06.912677] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:06.955187] [DEBUG] [LOCAL ] CM: Loaded 36406 existing records from primary storage. [2025-09-15T17:49:06.955380] [INFO ] [MAIN ] CM: Loaded 36406 existing records. [2025-09-15T17:49:07.149582] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:07.149900] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-15T17:49:07.149984] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-15T17:49:07.151019] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-15T17:49:07.151083] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-15T17:49:07.517840] [INFO ] [REMOTE ] CM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:07.657868] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-15T17:49:07.729888] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:49:08.295657] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-15T17:49:08.301843] [INFO ] [REMOTE ] CLS: Full fetch complete (58323 records). [2025-09-15T17:49:08.301979] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-15T17:49:08.462957] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-15T17:49:08.695066] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-15T17:49:08.695177] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-15T17:49:08.695905] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-15T17:49:08.695951] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-15T17:49:08.697224] [DEBUG] [LOCAL ] CLS: Trimmed 58323 records to 39616 (keeping 150 days of data) [2025-09-15T17:49:08.952836] [DEBUG] [LOCAL ] CLS: Primary data saved (39616 records). [2025-09-15T17:49:08.952997] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-15T17:49:08.953485] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLS took 25.8s. Estimated remaining: 3h 19m 25s. Rate: 9.5 symbols/min [2025-09-15T17:49:09.132936] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:09.176955] [DEBUG] [LOCAL ] CMA: Loaded 37599 existing records from primary storage. [2025-09-15T17:49:09.177120] [INFO ] [MAIN ] CMA: Loaded 37599 existing records. [2025-09-15T17:49:09.262268] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-15T17:49:09.368221] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:09.368543] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-15T17:49:09.368696] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-15T17:49:09.369631] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-15T17:49:09.390761] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-15T17:49:09.459933] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T17:49:09.770868] [INFO ] [REMOTE ] CMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:10.057877] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-15T17:49:10.168767] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:49:10.171503] [INFO ] [REMOTE ] CLW: Full fetch complete (24644 records). [2025-09-15T17:49:10.171577] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-15T17:49:10.536740] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-15T17:49:10.536821] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-15T17:49:10.537252] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-15T17:49:10.537291] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-15T17:49:10.537923] [DEBUG] [LOCAL ] CLW: Trimmed 24644 records to 15618 (keeping 150 days of data) [2025-09-15T17:49:10.634820] [DEBUG] [LOCAL ] CLW: Primary data saved (15618 records). [2025-09-15T17:49:10.635073] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-15T17:49:10.635233] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 24.2s. Estimated remaining: 3h 19m 0s. Rate: 9.5 symbols/min [2025-09-15T17:49:10.806288] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:10.844101] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T17:49:10.861087] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-15T17:49:10.861435] [DEBUG] [LOCAL ] CMBT: Loaded 16797 existing records from primary storage. [2025-09-15T17:49:10.862446] [INFO ] [MAIN ] CMBT: Loaded 16797 existing records. [2025-09-15T17:49:11.045183] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:11.045513] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-15T17:49:11.045566] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-15T17:49:11.046027] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-15T17:49:11.046086] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-15T17:49:11.430195] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:11.657835] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-15T17:49:11.685908] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:49:12.457857] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-15T17:49:12.621911] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:49:12.678036] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T17:49:13.257873] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-15T17:49:14.019395] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:49:14.057828] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-15T17:49:14.373462] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:49:14.857905] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-15T17:49:15.657921] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-15T17:49:15.731404] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:49:16.360131] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:49:16.457867] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-15T17:49:16.733206] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T17:49:17.257916] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-15T17:49:18.057923] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-15T17:49:18.235797] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T17:49:18.342891] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:49:18.857903] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-15T17:49:19.570780] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:49:19.657939] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-15T17:49:20.463966] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-15T17:49:20.476737] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T17:49:21.257885] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-15T17:49:21.446025] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:49:21.641190] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T17:49:22.057912] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-15T17:49:22.809670] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:49:22.857821] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-15T17:49:22.944542] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T17:49:23.657869] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-15T17:49:24.308073] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T17:49:24.457922] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-15T17:49:24.945582] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:49:25.257884] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-15T17:49:25.661239] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:49:26.057950] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-15T17:49:26.857896] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-15T17:49:26.906154] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:49:27.217756] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:49:27.657915] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-15T17:49:27.989939] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:49:28.457876] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-15T17:49:29.120839] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:49:29.257889] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-15T17:49:30.036257] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:49:30.057813] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-15T17:49:30.423145] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:49:30.857883] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-15T17:49:31.506736] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:49:31.511803] [INFO ] [REMOTE ] CM: Full fetch complete (52284 records). [2025-09-15T17:49:31.511952] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-15T17:49:31.512843] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:49:31.512927] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:49:31.512965] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:49:31.513004] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-15T17:49:31.513075] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-15T17:49:31.513116] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-15T17:49:31.513460] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-09-15T17:49:31.513879] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CM took 24.8s. Estimated remaining: 3h 19m 53s. Rate: 9.5 symbols/min [2025-09-15T17:49:31.664184] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-15T17:49:31.692219] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:31.733493] [DEBUG] [LOCAL ] CMC: Loaded 33573 existing records from primary storage. [2025-09-15T17:49:31.733667] [INFO ] [MAIN ] CMC: Loaded 33573 existing records. [2025-09-15T17:49:31.915940] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:31.916216] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-15T17:49:31.916267] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-15T17:49:31.917175] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-15T17:49:31.917233] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-15T17:49:32.272134] [INFO ] [REMOTE ] CMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:32.457893] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-15T17:49:32.631451] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:49:32.637322] [INFO ] [REMOTE ] CMBT: Full fetch complete (21765 records). [2025-09-15T17:49:32.637433] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-15T17:49:33.002569] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-15T17:49:33.002666] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-15T17:49:33.003087] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-15T17:49:33.003145] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-15T17:49:33.003822] [DEBUG] [LOCAL ] CMBT: Trimmed 21765 records to 16946 (keeping 150 days of data) [2025-09-15T17:49:33.104777] [DEBUG] [LOCAL ] CMBT: Primary data saved (16946 records). [2025-09-15T17:49:33.104930] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-15T17:49:33.105041] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMBT took 22.5s. Estimated remaining: 3h 19m 27s. Rate: 9.5 symbols/min [2025-09-15T17:49:33.262757] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-15T17:49:33.290025] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:33.308779] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:49:33.317233] [DEBUG] [LOCAL ] CMCM: Loaded 3310 existing records from primary storage. [2025-09-15T17:49:33.317478] [INFO ] [MAIN ] CMCM: Loaded 3310 existing records. [2025-09-15T17:49:33.362301] [INFO ] [REMOTE ] CMA: Full fetch complete (54817 records). [2025-09-15T17:49:33.390109] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-15T17:49:33.646047] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:33.701280] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-15T17:49:33.717315] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-15T17:49:33.783545] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-15T17:49:33.794435] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-15T17:49:34.060911] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-15T17:49:34.070548] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-15T17:49:34.079635] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-15T17:49:34.096043] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-15T17:49:34.208816] [DEBUG] [LOCAL ] CMA: Trimmed 54817 records to 36840 (keeping 150 days of data) [2025-09-15T17:49:34.336355] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:34.373053] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-15T17:49:34.408596] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T17:49:34.431470] [INFO ] [REMOTE ] CLX: Full fetch complete (55672 records). [2025-09-15T17:49:34.431637] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-15T17:49:34.811754] [DEBUG] [LOCAL ] CMA: Primary data saved (36840 records). [2025-09-15T17:49:34.836061] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-15T17:49:34.836874] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 25.9s. Estimated remaining: 3h 19m 3s. Rate: 9.5 symbols/min [2025-09-15T17:49:35.058070] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-15T17:49:35.058183] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-15T17:49:35.059471] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-15T17:49:35.085632] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-15T17:49:35.137738] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:35.138047] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-15T17:49:35.138177] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-15T17:49:35.138711] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-15T17:49:35.138875] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-15T17:49:35.142820] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-15T17:49:35.145450] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:49:35.145875] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-15T17:49:35.153927] [DEBUG] [LOCAL ] CLX: Trimmed 55672 records to 38387 (keeping 150 days of data) [2025-09-15T17:49:35.154701] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-15T17:49:35.444081] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T17:49:35.711909] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-15T17:49:35.780050] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:49:35.843358] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:35.871212] [DEBUG] [LOCAL ] CLX: Primary data saved (38387 records). [2025-09-15T17:49:35.871405] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-15T17:49:35.873898] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CLX took 42.6s. Estimated remaining: 3h 18m 35s. Rate: 9.5 symbols/min [2025-09-15T17:49:36.064704] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:36.112626] [DEBUG] [LOCAL ] CMG: Loaded 40465 existing records from primary storage. [2025-09-15T17:49:36.112786] [INFO ] [MAIN ] CMG: Loaded 40465 existing records. [2025-09-15T17:49:36.289303] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:36.289595] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-15T17:49:36.289665] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-15T17:49:36.290574] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-15T17:49:36.290625] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-15T17:49:36.461447] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-15T17:49:36.648020] [INFO ] [REMOTE ] CMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:37.257914] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-15T17:49:37.297485] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T17:49:37.338051] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:49:38.057880] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-15T17:49:38.262507] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:38.262855] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-15T17:49:38.857869] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-15T17:49:39.489178] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-15T17:49:39.657911] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-15T17:49:40.410840] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:49:40.457904] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-15T17:49:41.233003] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T17:49:41.257844] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-15T17:49:41.597462] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:49:42.057878] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-15T17:49:42.499051] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T17:49:42.854981] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:49:42.865513] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-15T17:49:43.657888] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-15T17:49:43.844864] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:43.845215] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-15T17:49:43.996340] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:49:44.457881] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-15T17:49:45.257886] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-15T17:49:45.694661] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T17:49:46.057894] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-15T17:49:46.221041] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:49:46.248914] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:46.249213] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-15T17:49:46.857878] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-15T17:49:47.657901] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-15T17:49:47.990298] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:49:48.014122] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T17:49:48.457911] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-15T17:49:49.096745] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:49:49.257889] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-15T17:49:50.057881] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-15T17:49:50.853030] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:49:50.855003] [INFO ] [REMOTE ] CMCM: Full fetch complete (5315 records). [2025-09-15T17:49:50.855079] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-15T17:49:50.877397] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-15T17:49:51.131466] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T17:49:51.362543] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-15T17:49:51.362721] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-15T17:49:51.363012] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-15T17:49:51.363110] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-15T17:49:51.363840] [DEBUG] [LOCAL ] CMCM: Trimmed 5315 records to 3391 (keeping 150 days of data) [2025-09-15T17:49:51.390595] [DEBUG] [LOCAL ] CMCM: Primary data saved (3391 records). [2025-09-15T17:49:51.390814] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-15T17:49:51.390939] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMCM took 18.3s. Estimated remaining: 3h 19m 6s. Rate: 9.5 symbols/min [2025-09-15T17:49:51.663422] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-15T17:49:51.669022] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:51.719485] [DEBUG] [LOCAL ] CMI: Loaded 30752 existing records from primary storage. [2025-09-15T17:49:51.719724] [INFO ] [MAIN ] CMI: Loaded 30752 existing records. [2025-09-15T17:49:51.980075] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:51.980382] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-15T17:49:51.980433] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-15T17:49:51.981230] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-15T17:49:51.981284] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-15T17:49:52.360939] [INFO ] [REMOTE ] CMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:52.457870] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-15T17:49:52.560955] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:49:52.841286] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T17:49:53.257864] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-15T17:49:53.760299] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:49:54.057874] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-15T17:49:54.398501] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:49:54.857873] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-15T17:49:55.657955] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-15T17:49:56.031932] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T17:49:56.203085] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:49:56.208401] [INFO ] [REMOTE ] CMC: Full fetch complete (49791 records). [2025-09-15T17:49:56.208548] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-15T17:49:56.414046] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T17:49:56.461039] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-15T17:49:56.604929] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-15T17:49:56.605012] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-15T17:49:56.605630] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-15T17:49:56.605691] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-15T17:49:56.606719] [DEBUG] [LOCAL ] CMC: Trimmed 49791 records to 32872 (keeping 150 days of data) [2025-09-15T17:49:56.816727] [DEBUG] [LOCAL ] CMC: Primary data saved (32872 records). [2025-09-15T17:49:56.816878] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-15T17:49:56.817845] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 25.3s. Estimated remaining: 3h 18m 56s. Rate: 9.5 symbols/min [2025-09-15T17:49:56.984884] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:57.014255] [DEBUG] [LOCAL ] CMP: Loaded 28011 existing records from primary storage. [2025-09-15T17:49:57.014400] [INFO ] [MAIN ] CMP: Loaded 28011 existing records. [2025-09-15T17:49:57.197172] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:57.197407] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-15T17:49:57.197453] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-15T17:49:57.198133] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-15T17:49:57.198204] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-15T17:49:57.263401] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-15T17:49:57.567396] [INFO ] [REMOTE ] CMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:58.057911] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-15T17:49:58.178055] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:49:58.852246] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-15T17:49:58.863042] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-15T17:49:59.657859] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-15T17:49:59.717331] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:49:59.841330] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:49:59.843272] [INFO ] [REMOTE ] CMDB: Full fetch complete (10179 records). [2025-09-15T17:49:59.843376] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-15T17:49:59.843786] [FATAL] [VALIDATOR ] CMDB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:49:59.843861] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:49:59.843908] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:49:59.843948] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-15T17:49:59.844004] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-15T17:49:59.844039] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-15T17:49:59.844093] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-15T17:49:59.844149] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMDB took 25.0s. Estimated remaining: 3h 18m 37s. Rate: 9.5 symbols/min [2025-09-15T17:50:00.015297] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:00.047089] [DEBUG] [LOCAL ] CMRE: Loaded 26592 existing records from primary storage. [2025-09-15T17:50:00.047237] [INFO ] [MAIN ] CMRE: Loaded 26592 existing records. [2025-09-15T17:50:00.228143] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:00.228402] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-15T17:50:00.228448] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-15T17:50:00.229192] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-15T17:50:00.229243] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-15T17:50:00.468688] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-15T17:50:00.597103] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:01.257962] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-15T17:50:01.921727] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-15T17:50:01.930954] [INFO ] [REMOTE ] CMG: Full fetch complete (58398 records). [2025-09-15T17:50:01.931174] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-15T17:50:02.063090] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-15T17:50:02.348910] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-15T17:50:02.349037] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-15T17:50:02.349840] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-15T17:50:02.349897] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-15T17:50:02.351265] [DEBUG] [LOCAL ] CMG: Trimmed 58398 records to 39687 (keeping 150 days of data) [2025-09-15T17:50:02.594226] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-15T17:50:02.635236] [DEBUG] [LOCAL ] CMG: Primary data saved (39687 records). [2025-09-15T17:50:02.635406] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-15T17:50:02.636634] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMG took 26.8s. Estimated remaining: 3h 18m 17s. Rate: 9.5 symbols/min [2025-09-15T17:50:02.857890] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-15T17:50:02.945401] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:50:03.568405] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:50:03.657908] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-15T17:50:04.056508] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:50:04.457902] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-15T17:50:04.953485] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:50:05.257888] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-15T17:50:05.782249] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:50:06.057895] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-15T17:50:06.769107] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:50:06.857906] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-15T17:50:07.324120] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:50:07.657994] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-15T17:50:08.212724] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:50:08.457936] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-15T17:50:08.846959] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:50:09.257876] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-15T17:50:09.404239] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:50:10.057925] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-15T17:50:10.549216] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:50:10.857921] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-15T17:50:11.628772] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:50:11.657953] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-15T17:50:11.803956] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:50:12.457939] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-15T17:50:12.676024] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:50:13.257913] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-15T17:50:13.733806] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:50:14.057921] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-15T17:50:14.566899] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:50:14.571036] [INFO ] [REMOTE ] CMP: Full fetch complete (40429 records). [2025-09-15T17:50:14.571175] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-15T17:50:14.863039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-15T17:50:14.963488] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-15T17:50:14.963571] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-15T17:50:14.964189] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-15T17:50:14.964236] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-15T17:50:14.965224] [DEBUG] [LOCAL ] CMP: Trimmed 40429 records to 27389 (keeping 150 days of data) [2025-09-15T17:50:15.129241] [DEBUG] [LOCAL ] CMP: Primary data saved (27389 records). [2025-09-15T17:50:15.129438] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-15T17:50:15.129543] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMP took 18.3s. Estimated remaining: 3h 18m 35s. Rate: 9.5 symbols/min [2025-09-15T17:50:15.138767] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:50:15.142422] [INFO ] [REMOTE ] CMRE: Full fetch complete (38876 records). [2025-09-15T17:50:15.142507] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-15T17:50:15.526018] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-15T17:50:15.526136] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-15T17:50:15.527195] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-15T17:50:15.527402] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-15T17:50:15.528756] [DEBUG] [LOCAL ] CMRE: Trimmed 38876 records to 26054 (keeping 150 days of data) [2025-09-15T17:50:15.682314] [DEBUG] [LOCAL ] CMRE: Primary data saved (26054 records). [2025-09-15T17:50:15.682465] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-15T17:50:15.682554] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMRE took 15.8s. Estimated remaining: 3h 18m 6s. Rate: 9.5 symbols/min [2025-09-15T17:50:16.291586] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:50:16.299741] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-15T17:50:17.883673] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:50:17.893144] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-15T17:50:19.156362] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:50:19.165155] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-15T17:50:20.298850] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:50:20.303508] [INFO ] [REMOTE ] CMI: Full fetch complete (45436 records). [2025-09-15T17:50:20.303596] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-15T17:50:20.685683] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-15T17:50:20.685767] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-15T17:50:20.686434] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-15T17:50:20.686483] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-15T17:50:20.687466] [DEBUG] [LOCAL ] CMI: Trimmed 45436 records to 30182 (keeping 150 days of data) [2025-09-15T17:50:20.878945] [DEBUG] [LOCAL ] CMI: Primary data saved (30182 records). [2025-09-15T17:50:20.879082] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-15T17:50:20.879380] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMI took 29.5s. Estimated remaining: 3h 17m 55s. Rate: 9.5 symbols/min [2025-09-15T17:50:21.485443] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.582122] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.585532] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.586773] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.591890] [DEBUG] [LOCAL ] CMSA: Loaded 2560 existing records from primary storage. [2025-09-15T17:50:21.592043] [INFO ] [MAIN ] CMSA: Loaded 2560 existing records. [2025-09-15T17:50:21.659540] [DEBUG] [LOCAL ] CMSC: Loaded 3570 existing records from primary storage. [2025-09-15T17:50:21.702404] [INFO ] [MAIN ] CMSC: Loaded 3570 existing records. [2025-09-15T17:50:21.694127] [DEBUG] [LOCAL ] CMSD: Loaded 5819 existing records from primary storage. [2025-09-15T17:50:21.723737] [INFO ] [MAIN ] CMSD: Loaded 5819 existing records. [2025-09-15T17:50:21.950117] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.006553] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.057085] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-15T17:50:22.097584] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-15T17:50:22.108690] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.108910] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-15T17:50:22.126223] [DEBUG] [LOCAL ] CMS: Loaded 39684 existing records from primary storage. [2025-09-15T17:50:22.140822] [INFO ] [MAIN ] CMS: Loaded 39684 existing records. [2025-09-15T17:50:22.243692] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.293366] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.293305] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.304960] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-15T17:50:22.349715] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-15T17:50:22.363153] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-15T17:50:22.373533] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-15T17:50:22.410846] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-15T17:50:22.416422] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-15T17:50:22.706321] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.810500] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.849127] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-15T17:50:22.913838] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-15T17:50:22.997479] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-15T17:50:23.292419] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.327025] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-15T17:50:23.432250] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.462905] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-15T17:50:23.523563] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.539614] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-15T17:50:23.777823] [INFO ] [REMOTE ] CMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.778194] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-15T17:50:24.100034] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T17:50:24.101310] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-15T17:50:24.112595] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T17:50:24.113949] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-15T17:50:24.347612] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:50:24.349455] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-15T17:50:24.434551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:50:24.435860] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-15T17:50:24.544419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T17:50:24.553464] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-15T17:50:24.806743] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:50:24.983662] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:50:25.130631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:50:25.257915] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-15T17:50:25.283816] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:50:25.850774] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:50:26.057885] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-15T17:50:26.670417] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T17:50:26.857876] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-15T17:50:27.278785] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:50:27.657932] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-15T17:50:28.365114] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T17:50:28.457886] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-15T17:50:28.879810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:50:29.257885] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-15T17:50:29.971593] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:50:30.057884] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-15T17:50:30.622500] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:50:30.857872] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-15T17:50:31.657896] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-15T17:50:32.046892] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T17:50:32.431349] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:50:32.457872] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-15T17:50:33.257877] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-15T17:50:33.672382] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:50:34.057872] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-15T17:50:34.270447] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T17:50:34.547908] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:50:34.857923] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-15T17:50:35.534005] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:50:35.535336] [INFO ] [REMOTE ] CMSD: Full fetch complete (8717 records). [2025-09-15T17:50:35.535407] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-15T17:50:35.673928] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-15T17:50:35.900285] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-15T17:50:35.900365] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-15T17:50:35.900602] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-15T17:50:35.900663] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-15T17:50:35.901090] [DEBUG] [LOCAL ] CMSD: Trimmed 8717 records to 5630 (keeping 150 days of data) [2025-09-15T17:50:35.935382] [DEBUG] [LOCAL ] CMSD: Primary data saved (5630 records). [2025-09-15T17:50:35.935479] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-15T17:50:35.935561] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSD took 15.1s. Estimated remaining: 3h 18m 23s. Rate: 9.5 symbols/min [2025-09-15T17:50:36.101767] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:36.128579] [DEBUG] [LOCAL ] CMTG: Loaded 27084 existing records from primary storage. [2025-09-15T17:50:36.128762] [INFO ] [MAIN ] CMTG: Loaded 27084 existing records. [2025-09-15T17:50:36.310328] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:36.310673] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-15T17:50:36.310723] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-15T17:50:36.311421] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-15T17:50:36.311470] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-15T17:50:36.415210] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:50:36.465678] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-15T17:50:36.665292] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:37.257877] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-15T17:50:38.057880] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-15T17:50:38.242230] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T17:50:38.346917] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T17:50:38.621323] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:50:38.857875] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-15T17:50:39.657894] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-15T17:50:40.132535] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:50:40.133476] [INFO ] [REMOTE ] CMSA: Full fetch complete (3533 records). [2025-09-15T17:50:40.133545] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-15T17:50:40.461853] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-15T17:50:40.500579] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-15T17:50:40.500664] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-15T17:50:40.500802] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-15T17:50:40.500841] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-15T17:50:40.501221] [DEBUG] [LOCAL ] CMSA: Trimmed 3533 records to 2500 (keeping 150 days of data) [2025-09-15T17:50:40.517601] [DEBUG] [LOCAL ] CMSA: Primary data saved (2500 records). [2025-09-15T17:50:40.517711] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-15T17:50:40.517797] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 19.6s. Estimated remaining: 3h 18m 10s. Rate: 9.5 symbols/min [2025-09-15T17:50:40.723475] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:40.726039] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:50:40.742187] [DEBUG] [LOCAL ] CMU: Loaded 4747 existing records from primary storage. [2025-09-15T17:50:40.742283] [INFO ] [MAIN ] CMU: Loaded 4747 existing records. [2025-09-15T17:50:40.923324] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:40.923581] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-15T17:50:40.923637] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-15T17:50:40.923952] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-15T17:50:40.924001] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-15T17:50:41.057967] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:50:41.262937] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-15T17:50:41.297881] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:41.918727] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:50:41.919997] [INFO ] [REMOTE ] CMSC: Full fetch complete (5354 records). [2025-09-15T17:50:41.920068] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-15T17:50:42.063089] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-15T17:50:42.275602] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-15T17:50:42.275707] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-15T17:50:42.275889] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-15T17:50:42.275930] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-15T17:50:42.276338] [DEBUG] [LOCAL ] CMSC: Trimmed 5354 records to 3425 (keeping 150 days of data) [2025-09-15T17:50:42.297280] [DEBUG] [LOCAL ] CMSC: Primary data saved (3425 records). [2025-09-15T17:50:42.297361] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-15T17:50:42.297443] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMSC took 21.4s. Estimated remaining: 3h 17m 46s. Rate: 9.5 symbols/min [2025-09-15T17:50:42.468398] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:42.491229] [DEBUG] [LOCAL ] CNA: Loaded 24776 existing records from primary storage. [2025-09-15T17:50:42.491438] [INFO ] [MAIN ] CNA: Loaded 24776 existing records. [2025-09-15T17:50:42.663288] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:42.663557] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-15T17:50:42.663604] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-15T17:50:42.664732] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-15T17:50:42.664787] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-15T17:50:42.867166] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-15T17:50:43.014226] [INFO ] [REMOTE ] CNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:43.571829] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:50:43.595045] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:50:43.657955] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-15T17:50:44.457886] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-15T17:50:44.927803] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T17:50:45.257911] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-15T17:50:45.484168] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:50:46.057892] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-15T17:50:46.744338] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:50:46.857871] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-15T17:50:47.576828] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T17:50:47.657905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-15T17:50:47.849350] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:50:48.457891] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-15T17:50:49.257944] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-15T17:50:49.337320] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:50:49.344202] [INFO ] [REMOTE ] CMS: Full fetch complete (57290 records). [2025-09-15T17:50:49.344488] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-15T17:50:49.765337] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-15T17:50:49.765489] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-15T17:50:49.766897] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-15T17:50:49.766976] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-15T17:50:49.768941] [DEBUG] [LOCAL ] CMS: Trimmed 57290 records to 38924 (keeping 150 days of data) [2025-09-15T17:50:49.903318] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:50:49.951119] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:50:50.059830] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-15T17:50:50.098280] [DEBUG] [LOCAL ] CMS: Primary data saved (38924 records). [2025-09-15T17:50:50.098829] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-15T17:50:50.098952] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMS took 29.2s. Estimated remaining: 3h 17m 46s. Rate: 9.5 symbols/min [2025-09-15T17:50:50.276702] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:50.322120] [DEBUG] [LOCAL ] CNC: Loaded 40524 existing records from primary storage. [2025-09-15T17:50:50.322330] [INFO ] [MAIN ] CNC: Loaded 40524 existing records. [2025-09-15T17:50:50.513222] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:50.513584] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-15T17:50:50.513661] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-15T17:50:50.514810] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-15T17:50:50.514876] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-15T17:50:50.862989] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-15T17:50:50.921325] [INFO ] [REMOTE ] CNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:51.115483] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:50:51.657895] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-15T17:50:51.995557] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T17:50:52.258961] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:50:52.457880] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-15T17:50:53.257965] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-15T17:50:53.350951] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:50:54.057884] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-15T17:50:54.271587] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:50:54.857865] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-15T17:50:54.871867] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:50:54.875758] [INFO ] [REMOTE ] CMTG: Full fetch complete (41448 records). [2025-09-15T17:50:54.875873] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-15T17:50:55.267735] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-15T17:50:55.267831] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-15T17:50:55.268398] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-15T17:50:55.268440] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-15T17:50:55.269536] [DEBUG] [LOCAL ] CMTG: Trimmed 41448 records to 26381 (keeping 150 days of data) [2025-09-15T17:50:55.422653] [DEBUG] [LOCAL ] CMTG: Primary data saved (26381 records). [2025-09-15T17:50:55.422803] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-15T17:50:55.422939] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMTG took 19.5s. Estimated remaining: 3h 17m 36s. Rate: 9.5 symbols/min [2025-09-15T17:50:55.601246] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:55.611842] [DEBUG] [LOCAL ] CNF: Loaded 8737 existing records from primary storage. [2025-09-15T17:50:55.611979] [INFO ] [MAIN ] CNF: Loaded 8737 existing records. [2025-09-15T17:50:55.661318] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-15T17:50:55.802693] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:55.803041] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-15T17:50:55.803176] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-15T17:50:55.803689] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-15T17:50:55.803761] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-15T17:50:55.923838] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:50:56.182937] [INFO ] [REMOTE ] CNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:56.457882] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-15T17:50:56.539446] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T17:50:57.257930] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-15T17:50:57.684090] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:50:57.757394] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T17:50:58.057914] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-15T17:50:58.857921] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-15T17:50:59.431249] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:50:59.478729] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T17:50:59.657909] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-15T17:51:00.457875] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-15T17:51:00.934095] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:51:01.110124] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:51:01.257890] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-15T17:51:02.057900] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-15T17:51:02.869173] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-15T17:51:02.893570] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:51:02.914674] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:51:03.565882] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:51:03.567148] [INFO ] [REMOTE ] CMU: Full fetch complete (7588 records). [2025-09-15T17:51:03.567230] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-15T17:51:03.663034] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-15T17:51:03.995351] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-15T17:51:03.995431] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-15T17:51:03.995662] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-15T17:51:03.995712] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-15T17:51:03.996127] [DEBUG] [LOCAL ] CMU: Trimmed 7588 records to 4387 (keeping 150 days of data) [2025-09-15T17:51:04.022465] [DEBUG] [LOCAL ] CMU: Primary data saved (4387 records). [2025-09-15T17:51:04.022577] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-15T17:51:04.022675] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 23.5s. Estimated remaining: 3h 17m 39s. Rate: 9.5 symbols/min [2025-09-15T17:51:04.217260] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:04.259494] [DEBUG] [LOCAL ] CNH: Loaded 40307 existing records from primary storage. [2025-09-15T17:51:04.259666] [INFO ] [MAIN ] CNH: Loaded 40307 existing records. [2025-09-15T17:51:04.446762] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:04.447040] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-15T17:51:04.447091] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-15T17:51:04.447970] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-15T17:51:04.448021] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-15T17:51:04.463026] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-15T17:51:04.824666] [INFO ] [REMOTE ] CNH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:05.259153] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-15T17:51:05.264656] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:51:06.007375] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:51:06.057895] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-15T17:51:06.634818] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T17:51:06.857887] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-15T17:51:06.906251] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:51:07.638515] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T17:51:07.657848] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-15T17:51:08.313405] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:51:08.457877] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-15T17:51:09.257905] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-15T17:51:09.668391] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:51:09.671985] [INFO ] [REMOTE ] CNA: Full fetch complete (35911 records). [2025-09-15T17:51:09.672065] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-15T17:51:09.967471] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:51:10.053565] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-15T17:51:10.053657] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-15T17:51:10.054167] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-15T17:51:10.054208] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-15T17:51:10.055074] [DEBUG] [LOCAL ] CNA: Trimmed 35911 records to 24485 (keeping 150 days of data) [2025-09-15T17:51:10.111238] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-15T17:51:10.212195] [DEBUG] [LOCAL ] CNA: Primary data saved (24485 records). [2025-09-15T17:51:10.212353] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-15T17:51:10.212447] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CNA took 27.9s. Estimated remaining: 3h 17m 32s. Rate: 9.5 symbols/min [2025-09-15T17:51:10.383594] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:10.424000] [DEBUG] [LOCAL ] CNI: Loaded 38895 existing records from primary storage. [2025-09-15T17:51:10.424171] [INFO ] [MAIN ] CNI: Loaded 38895 existing records. [2025-09-15T17:51:10.599954] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:10.600215] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-15T17:51:10.600261] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-15T17:51:10.601135] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-15T17:51:10.601185] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-15T17:51:10.861583] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-15T17:51:10.972575] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T17:51:10.999085] [INFO ] [REMOTE ] CNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:11.657882] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-15T17:51:12.457874] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-15T17:51:12.526744] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:51:12.528882] [INFO ] [REMOTE ] CNF: Full fetch complete (10836 records). [2025-09-15T17:51:12.528958] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-15T17:51:12.918658] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-15T17:51:12.918862] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-15T17:51:12.919175] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-15T17:51:12.919232] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-15T17:51:12.919994] [DEBUG] [LOCAL ] CNF: Trimmed 10836 records to 8697 (keeping 150 days of data) [2025-09-15T17:51:12.982987] [DEBUG] [LOCAL ] CNF: Primary data saved (8697 records). [2025-09-15T17:51:12.998976] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-15T17:51:12.999120] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 17.6s. Estimated remaining: 3h 17m 12s. Rate: 9.5 symbols/min [2025-09-15T17:51:13.085096] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:51:13.197167] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:13.236516] [DEBUG] [LOCAL ] CNK: Loaded 39750 existing records from primary storage. [2025-09-15T17:51:13.236681] [INFO ] [MAIN ] CNK: Loaded 39750 existing records. [2025-09-15T17:51:13.268268] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-15T17:51:13.425479] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:13.425770] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-15T17:51:13.425818] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-15T17:51:13.426845] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-15T17:51:13.426899] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-15T17:51:13.781431] [INFO ] [REMOTE ] CNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:14.057917] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-15T17:51:14.403318] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T17:51:14.809279] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T17:51:14.857881] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-15T17:51:15.555063] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:51:15.657856] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-15T17:51:16.319368] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:51:16.457983] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-15T17:51:17.257897] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-15T17:51:17.330304] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:51:18.057925] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-15T17:51:18.197127] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:51:18.715210] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:51:18.857937] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-15T17:51:19.664841] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-15T17:51:19.667609] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:51:20.404813] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:51:20.457823] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-15T17:51:20.962747] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:51:21.257879] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-15T17:51:21.885636] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:51:22.057866] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-15T17:51:22.857916] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-15T17:51:23.029820] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:51:23.657880] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-15T17:51:23.827541] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:51:24.126392] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T17:51:24.457914] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-15T17:51:25.245155] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T17:51:25.257811] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-15T17:51:26.001497] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:51:26.057889] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-15T17:51:26.857898] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-15T17:51:27.003934] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:51:27.657842] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-15T17:51:27.688981] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:51:28.219232] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:51:28.225260] [INFO ] [REMOTE ] CNI: Full fetch complete (56127 records). [2025-09-15T17:51:28.225407] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-15T17:51:28.463060] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-15T17:51:28.627752] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-15T17:51:28.627871] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-15T17:51:28.628884] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-15T17:51:28.628952] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-15T17:51:28.630575] [DEBUG] [LOCAL ] CNI: Trimmed 56127 records to 38141 (keeping 150 days of data) [2025-09-15T17:51:28.891054] [DEBUG] [LOCAL ] CNI: Primary data saved (38141 records). [2025-09-15T17:51:28.891221] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-15T17:51:28.891887] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNI took 18.7s. Estimated remaining: 3h 17m 43s. Rate: 9.5 symbols/min [2025-09-15T17:51:29.065967] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:29.105681] [DEBUG] [LOCAL ] CNM: Loaded 38006 existing records from primary storage. [2025-09-15T17:51:29.105814] [INFO ] [MAIN ] CNM: Loaded 38006 existing records. [2025-09-15T17:51:29.260875] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-15T17:51:29.281338] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:29.282625] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-15T17:51:29.282759] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-15T17:51:29.283592] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-15T17:51:29.283773] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-15T17:51:29.597739] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:51:29.686260] [INFO ] [REMOTE ] CNM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:30.057902] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-15T17:51:30.676759] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-15T17:51:30.724177] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:51:30.857847] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-15T17:51:31.439214] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:51:31.657896] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-15T17:51:32.382743] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T17:51:32.457865] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-15T17:51:33.257948] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-15T17:51:33.924575] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-15T17:51:33.981714] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:51:33.988463] [INFO ] [REMOTE ] CNK: Full fetch complete (57449 records). [2025-09-15T17:51:33.988606] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-15T17:51:34.063074] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-15T17:51:34.397682] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-15T17:51:34.397815] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-15T17:51:34.398797] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-15T17:51:34.398856] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-15T17:51:34.400525] [DEBUG] [LOCAL ] CNK: Trimmed 57449 records to 38995 (keeping 150 days of data) [2025-09-15T17:51:34.670265] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:51:34.686570] [INFO ] [REMOTE ] CNH: Full fetch complete (58242 records). [2025-09-15T17:51:34.688415] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-15T17:51:34.875493] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-15T17:51:34.969329] [DEBUG] [LOCAL ] CNK: Primary data saved (38995 records). [2025-09-15T17:51:34.999070] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-15T17:51:35.003433] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNK took 22.0s. Estimated remaining: 3h 17m 36s. Rate: 9.5 symbols/min [2025-09-15T17:51:35.256810] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-15T17:51:35.257665] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-15T17:51:35.274508] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-15T17:51:35.277281] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-15T17:51:35.277198] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:35.279197] [DEBUG] [LOCAL ] CNH: Trimmed 58242 records to 39528 (keeping 150 days of data) [2025-09-15T17:51:35.393181] [DEBUG] [LOCAL ] CNMD: Loaded 23985 existing records from primary storage. [2025-09-15T17:51:35.393827] [INFO ] [MAIN ] CNMD: Loaded 23985 existing records. [2025-09-15T17:51:35.594608] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:35.600826] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-15T17:51:35.601674] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-15T17:51:35.606450] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-15T17:51:35.607054] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-15T17:51:36.081947] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:36.083953] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-15T17:51:36.109201] [DEBUG] [LOCAL ] CNH: Primary data saved (39528 records). [2025-09-15T17:51:36.109382] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-15T17:51:36.110094] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNH took 32.1s. Estimated remaining: 3h 17m 9s. Rate: 9.5 symbols/min [2025-09-15T17:51:36.231821] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T17:51:36.291573] [INFO ] [REMOTE ] CNC: Full fetch complete (58394 records). [2025-09-15T17:51:36.309181] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-15T17:51:36.309084] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:36.625553] [DEBUG] [LOCAL ] CNNE: Loaded 26922 existing records from primary storage. [2025-09-15T17:51:36.652184] [INFO ] [MAIN ] CNNE: Loaded 26922 existing records. [2025-09-15T17:51:36.816793] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-15T17:51:36.822668] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-15T17:51:36.833746] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-15T17:51:36.838998] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-15T17:51:36.895740] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:36.896280] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-15T17:51:36.896433] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-15T17:51:36.896961] [DEBUG] [LOCAL ] CNC: Trimmed 58394 records to 39748 (keeping 150 days of data) [2025-09-15T17:51:36.897343] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-15T17:51:36.897582] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-15T17:51:37.087844] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-15T17:51:37.133789] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-15T17:51:37.411775] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:37.413219] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-15T17:51:37.546054] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T17:51:37.583341] [DEBUG] [LOCAL ] CNC: Primary data saved (39748 records). [2025-09-15T17:51:37.583510] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-15T17:51:37.584542] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNC took 47.5s. Estimated remaining: 3h 16m 45s. Rate: 9.5 symbols/min [2025-09-15T17:51:37.752392] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:37.790491] [DEBUG] [LOCAL ] CNO: Loaded 30210 existing records from primary storage. [2025-09-15T17:51:37.790657] [INFO ] [MAIN ] CNO: Loaded 30210 existing records. [2025-09-15T17:51:37.969050] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:37.969289] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-15T17:51:37.969336] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-15T17:51:37.970139] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-15T17:51:37.970193] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-15T17:51:38.067441] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-15T17:51:38.335847] [INFO ] [REMOTE ] CNO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:38.535967] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:51:38.575889] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:51:38.857880] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-15T17:51:39.520117] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:51:39.657875] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-15T17:51:40.457926] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-15T17:51:40.498480] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:51:41.163811] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:51:41.257882] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-15T17:51:41.582293] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:51:42.057878] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-15T17:51:42.633703] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:51:42.857884] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-15T17:51:43.394983] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:51:43.657861] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-15T17:51:43.801087] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T17:51:44.457909] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-15T17:51:45.257841] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-15T17:51:45.286509] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:51:45.492435] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:51:46.057874] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-15T17:51:46.719918] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:51:46.857847] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-15T17:51:47.459321] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:51:47.657863] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-15T17:51:48.286305] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T17:51:48.457877] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-15T17:51:49.265793] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-15T17:51:49.269391] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:51:49.805294] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:51:50.057869] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-15T17:51:50.707398] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:51:50.857864] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-15T17:51:51.355113] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:51:51.657860] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-15T17:51:52.236618] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:51:52.457881] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-15T17:51:53.136904] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:51:53.257934] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-15T17:51:53.548326] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:51:54.057935] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-15T17:51:54.312459] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:51:54.857895] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-15T17:51:55.336977] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:51:55.343462] [INFO ] [REMOTE ] CNMD: Full fetch complete (35831 records). [2025-09-15T17:51:55.343777] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-15T17:51:55.668585] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-15T17:51:55.963471] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-15T17:51:55.963661] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-15T17:51:55.965069] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-15T17:51:55.965162] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-15T17:51:55.966804] [DEBUG] [LOCAL ] CNMD: Trimmed 35831 records to 23436 (keeping 150 days of data) [2025-09-15T17:51:56.193669] [DEBUG] [LOCAL ] CNMD: Primary data saved (23436 records). [2025-09-15T17:51:56.193858] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-15T17:51:56.193982] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNMD took 21.2s. Estimated remaining: 3h 17m 25s. Rate: 9.5 symbols/min [2025-09-15T17:51:56.413627] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:56.459345] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-15T17:51:56.466552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:51:56.527103] [DEBUG] [LOCAL ] CNP: Loaded 40238 existing records from primary storage. [2025-09-15T17:51:56.527260] [INFO ] [MAIN ] CNP: Loaded 40238 existing records. [2025-09-15T17:51:56.707782] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:56.708015] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-15T17:51:56.708061] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-15T17:51:56.708936] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-15T17:51:56.708987] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-15T17:51:57.062713] [INFO ] [REMOTE ] CNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:57.257923] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-15T17:51:57.428875] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T17:51:57.434946] [INFO ] [REMOTE ] CNM: Full fetch complete (55099 records). [2025-09-15T17:51:57.435103] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-15T17:51:57.822327] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-15T17:51:57.822434] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-15T17:51:57.823296] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-15T17:51:57.823368] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-15T17:51:57.832217] [DEBUG] [LOCAL ] CNM: Trimmed 55099 records to 37287 (keeping 150 days of data) [2025-09-15T17:51:57.846606] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T17:51:58.057940] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-15T17:51:58.077081] [DEBUG] [LOCAL ] CNM: Primary data saved (37287 records). [2025-09-15T17:51:58.077226] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-15T17:51:58.077797] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 29.2s. Estimated remaining: 3h 17m 2s. Rate: 9.5 symbols/min [2025-09-15T17:51:58.249122] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:58.294251] [DEBUG] [LOCAL ] CNQ: Loaded 40333 existing records from primary storage. [2025-09-15T17:51:58.294404] [INFO ] [MAIN ] CNQ: Loaded 40333 existing records. [2025-09-15T17:51:58.478771] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:58.479057] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-15T17:51:58.479104] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-15T17:51:58.480277] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-15T17:51:58.480329] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-15T17:51:58.833148] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:58.850405] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:51:58.857047] [INFO ] [REMOTE ] CNNE: Full fetch complete (39735 records). [2025-09-15T17:51:58.857229] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-15T17:51:58.863079] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-15T17:51:59.243638] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-15T17:51:59.243734] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-15T17:51:59.244296] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-15T17:51:59.244336] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-15T17:51:59.245278] [DEBUG] [LOCAL ] CNNE: Trimmed 39735 records to 26310 (keeping 150 days of data) [2025-09-15T17:51:59.407589] [DEBUG] [LOCAL ] CNNE: Primary data saved (26310 records). [2025-09-15T17:51:59.407749] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-15T17:51:59.407836] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNNE took 23.3s. Estimated remaining: 3h 16m 37s. Rate: 9.5 symbols/min [2025-09-15T17:51:59.579987] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:59.626219] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:51:59.660318] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-15T17:51:59.660889] [DEBUG] [LOCAL ] CNR: Loaded 32616 existing records from primary storage. [2025-09-15T17:51:59.661986] [INFO ] [MAIN ] CNR: Loaded 32616 existing records. [2025-09-15T17:51:59.846436] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:59.846723] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-15T17:51:59.846871] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-15T17:51:59.847693] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-15T17:51:59.847746] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-15T17:52:00.192895] [INFO ] [REMOTE ] CNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:00.457883] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-15T17:52:01.055012] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-15T17:52:01.257935] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-15T17:52:01.567542] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T17:52:01.886190] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:52:02.057868] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-15T17:52:02.630328] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:52:02.857900] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-15T17:52:03.657873] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-15T17:52:03.749288] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:52:04.457896] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-15T17:52:04.841639] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:52:05.257930] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-15T17:52:05.661101] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T17:52:05.738829] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:52:06.057883] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-15T17:52:06.787790] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:52:06.857912] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-15T17:52:07.657878] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-15T17:52:07.865304] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:52:08.090523] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:52:08.457915] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-15T17:52:09.257938] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-15T17:52:09.399009] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:52:09.937619] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:52:09.942620] [INFO ] [REMOTE ] CNO: Full fetch complete (45785 records). [2025-09-15T17:52:09.942817] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-15T17:52:10.063062] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-15T17:52:10.321958] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-15T17:52:10.322041] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-15T17:52:10.322692] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-15T17:52:10.322735] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-15T17:52:10.323686] [DEBUG] [LOCAL ] CNO: Trimmed 45785 records to 29693 (keeping 150 days of data) [2025-09-15T17:52:10.545551] [DEBUG] [LOCAL ] CNO: Primary data saved (29693 records). [2025-09-15T17:52:10.545770] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-15T17:52:10.545897] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 33.0s. Estimated remaining: 3h 16m 49s. Rate: 9.5 symbols/min [2025-09-15T17:52:10.628563] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:52:10.735051] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:10.752302] [DEBUG] [LOCAL ] CNS: Loaded 14962 existing records from primary storage. [2025-09-15T17:52:10.752439] [INFO ] [MAIN ] CNS: Loaded 14962 existing records. [2025-09-15T17:52:10.863027] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-15T17:52:10.927632] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:10.927905] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-15T17:52:10.927977] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-15T17:52:10.928431] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-15T17:52:10.928480] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-15T17:52:11.286453] [INFO ] [REMOTE ] CNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:11.657850] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-15T17:52:11.825399] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:52:12.457918] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-15T17:52:12.867870] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T17:52:12.971872] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:52:13.257989] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-15T17:52:14.019696] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:52:14.057836] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-15T17:52:14.348166] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:52:14.857891] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-15T17:52:15.657939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-15T17:52:15.819963] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:52:16.439143] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:52:16.457826] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-15T17:52:17.024873] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:52:17.257912] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-15T17:52:17.925847] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:52:18.057864] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-15T17:52:18.266763] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:52:18.857870] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-15T17:52:19.533567] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:52:19.538397] [INFO ] [REMOTE ] CNR: Full fetch complete (48410 records). [2025-09-15T17:52:19.538500] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-15T17:52:19.662939] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-15T17:52:19.934435] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-09-15T17:52:19.934532] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-09-15T17:52:19.935230] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-09-15T17:52:19.935280] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-09-15T17:52:19.936489] [DEBUG] [LOCAL ] CNR: Trimmed 48410 records to 32097 (keeping 150 days of data) [2025-09-15T17:52:20.139623] [DEBUG] [LOCAL ] CNR: Primary data saved (32097 records). [2025-09-15T17:52:20.139781] [INFO ] [MAIN ] CNR: Full history saved. [2025-09-15T17:52:20.140499] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNR took 20.7s. Estimated remaining: 3h 16m 55s. Rate: 9.5 symbols/min [2025-09-15T17:52:20.313218] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:20.351775] [DEBUG] [LOCAL ] CNX: Loaded 38562 existing records from primary storage. [2025-09-15T17:52:20.351942] [INFO ] [MAIN ] CNX: Loaded 38562 existing records. [2025-09-15T17:52:20.462949] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-15T17:52:20.529554] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:20.529771] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-15T17:52:20.529825] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-15T17:52:20.530674] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-15T17:52:20.530725] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-15T17:52:20.887426] [INFO ] [REMOTE ] CNX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:20.928824] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T17:52:21.257928] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-15T17:52:21.285924] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:52:21.291930] [INFO ] [REMOTE ] CNP: Full fetch complete (58110 records). [2025-09-15T17:52:21.292039] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-15T17:52:21.687468] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:52:21.687748] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-15T17:52:21.693083] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-15T17:52:21.693866] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-15T17:52:21.693950] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-15T17:52:21.695448] [DEBUG] [LOCAL ] CNP: Trimmed 58110 records to 39456 (keeping 150 days of data) [2025-09-15T17:52:21.945899] [DEBUG] [LOCAL ] CNP: Primary data saved (39456 records). [2025-09-15T17:52:21.946061] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-15T17:52:21.946588] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNP took 25.8s. Estimated remaining: 3h 16m 32s. Rate: 9.5 symbols/min [2025-09-15T17:52:22.062969] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-15T17:52:22.122758] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:22.152999] [DEBUG] [LOCAL ] CODI: Loaded 31566 existing records from primary storage. [2025-09-15T17:52:22.153143] [INFO ] [MAIN ] CODI: Loaded 31566 existing records. [2025-09-15T17:52:22.328571] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:22.328856] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-15T17:52:22.328906] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-15T17:52:22.329584] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-15T17:52:22.329633] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-15T17:52:22.681293] [INFO ] [REMOTE ] CODI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:22.857907] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-15T17:52:22.905137] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:52:23.614619] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T17:52:23.621312] [INFO ] [REMOTE ] CNQ: Full fetch complete (58257 records). [2025-09-15T17:52:23.621461] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-15T17:52:23.662993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-15T17:52:24.008921] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-15T17:52:24.009031] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-15T17:52:24.009762] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-15T17:52:24.009839] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-15T17:52:24.022904] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:52:24.028239] [DEBUG] [LOCAL ] CNQ: Trimmed 58257 records to 39551 (keeping 150 days of data) [2025-09-15T17:52:24.277172] [DEBUG] [LOCAL ] CNQ: Primary data saved (39551 records). [2025-09-15T17:52:24.277328] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-15T17:52:24.278449] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNQ took 26.2s. Estimated remaining: 3h 16m 11s. Rate: 9.5 symbols/min [2025-09-15T17:52:24.448043] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:24.457893] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-15T17:52:24.487395] [DEBUG] [LOCAL ] COF: Loaded 40371 existing records from primary storage. [2025-09-15T17:52:24.487529] [INFO ] [MAIN ] COF: Loaded 40371 existing records. [2025-09-15T17:52:24.661877] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:24.662080] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-15T17:52:24.662124] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-15T17:52:24.663024] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-15T17:52:24.663074] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-15T17:52:25.013998] [INFO ] [REMOTE ] COF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:25.257832] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-15T17:52:25.376200] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:52:25.614609] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:52:26.057925] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-15T17:52:26.812440] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:52:26.857834] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-15T17:52:27.657858] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-15T17:52:27.733930] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:52:28.323893] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T17:52:28.359818] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:52:28.457874] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-15T17:52:29.257960] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-15T17:52:29.792484] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:52:30.057888] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-15T17:52:30.477676] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:52:30.857886] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-15T17:52:31.657856] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-15T17:52:31.915944] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:52:31.991138] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:52:32.457933] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-15T17:52:33.257916] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-15T17:52:33.333219] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:52:34.057905] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-15T17:52:34.149147] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:52:34.514533] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T17:52:34.857943] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-15T17:52:35.473197] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:52:35.510318] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:52:35.657879] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-15T17:52:36.457887] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-15T17:52:37.257868] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-15T17:52:37.423237] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:52:38.066117] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-15T17:52:38.091680] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:52:38.857862] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-15T17:52:39.108597] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:52:39.657859] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-15T17:52:39.696917] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:52:39.854058] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T17:52:39.856926] [INFO ] [REMOTE ] CNS: Full fetch complete (22795 records). [2025-09-15T17:52:39.857011] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-15T17:52:40.240098] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-15T17:52:40.240178] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-15T17:52:40.240609] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-15T17:52:40.240673] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-15T17:52:40.241284] [DEBUG] [LOCAL ] CNS: Trimmed 22795 records to 14550 (keeping 150 days of data) [2025-09-15T17:52:40.336826] [DEBUG] [LOCAL ] CNS: Primary data saved (14550 records). [2025-09-15T17:52:40.336979] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-15T17:52:40.337069] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNS took 29.8s. Estimated remaining: 3h 16m 41s. Rate: 9.5 symbols/min [2025-09-15T17:52:40.463041] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-15T17:52:40.516225] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:40.558596] [DEBUG] [LOCAL ] COHR: Loaded 40158 existing records from primary storage. [2025-09-15T17:52:40.558783] [INFO ] [MAIN ] COHR: Loaded 40158 existing records. [2025-09-15T17:52:40.750903] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:40.751364] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-15T17:52:40.751431] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-15T17:52:40.752834] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-15T17:52:40.752905] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-15T17:52:41.141238] [INFO ] [REMOTE ] COHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:41.257889] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-15T17:52:41.274567] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:52:41.280563] [INFO ] [REMOTE ] CNX: Full fetch complete (55969 records). [2025-09-15T17:52:41.280696] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-15T17:52:41.666324] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-15T17:52:41.666407] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-15T17:52:41.667102] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-15T17:52:41.667147] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-15T17:52:41.668319] [DEBUG] [LOCAL ] CNX: Trimmed 55969 records to 37796 (keeping 150 days of data) [2025-09-15T17:52:41.893364] [DEBUG] [LOCAL ] CNX: Primary data saved (37796 records). [2025-09-15T17:52:41.893516] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-15T17:52:41.894087] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNX took 21.8s. Estimated remaining: 3h 16m 17s. Rate: 9.5 symbols/min [2025-09-15T17:52:42.067729] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-15T17:52:42.070037] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:42.113040] [DEBUG] [LOCAL ] COLD: Loaded 39316 existing records from primary storage. [2025-09-15T17:52:42.113198] [INFO ] [MAIN ] COLD: Loaded 39316 existing records. [2025-09-15T17:52:42.320126] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:42.320589] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-15T17:52:42.320715] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-15T17:52:42.321622] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-15T17:52:42.321715] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-15T17:52:42.717305] [INFO ] [REMOTE ] COLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:42.720436] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T17:52:42.857824] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-15T17:52:43.147016] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:52:43.184526] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T17:52:43.657869] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-15T17:52:44.093164] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:52:44.457895] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-15T17:52:45.257883] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-15T17:52:45.538880] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T17:52:45.986175] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T17:52:46.057841] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-15T17:52:46.612529] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:52:46.857860] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-15T17:52:47.613918] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:52:47.620702] [INFO ] [REMOTE ] COF: Full fetch complete (58262 records). [2025-09-15T17:52:47.620910] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-15T17:52:47.663134] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-15T17:52:48.156496] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-15T17:52:48.156669] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-15T17:52:48.158277] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-15T17:52:48.158372] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-15T17:52:48.160397] [DEBUG] [LOCAL ] COF: Trimmed 58262 records to 39597 (keeping 150 days of data) [2025-09-15T17:52:48.488249] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-15T17:52:48.568966] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:52:48.624841] [DEBUG] [LOCAL ] COF: Primary data saved (39597 records). [2025-09-15T17:52:48.625024] [INFO ] [MAIN ] COF: Full history saved. [2025-09-15T17:52:48.625818] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. COF took 24.3s. Estimated remaining: 3h 16m 12s. Rate: 9.5 symbols/min [2025-09-15T17:52:48.836809] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:48.880901] [DEBUG] [LOCAL ] COMP: Loaded 40161 existing records from primary storage. [2025-09-15T17:52:48.881086] [INFO ] [MAIN ] COMP: Loaded 40161 existing records. [2025-09-15T17:52:49.066015] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:49.066264] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-15T17:52:49.066309] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-15T17:52:49.067090] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-15T17:52:49.067141] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-15T17:52:49.273334] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-15T17:52:49.420383] [INFO ] [REMOTE ] COMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:49.829108] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T17:52:50.031670] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:52:50.057814] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-15T17:52:50.735694] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:52:50.857882] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-15T17:52:51.234201] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:52:51.238602] [INFO ] [REMOTE ] CODI: Full fetch complete (41394 records). [2025-09-15T17:52:51.238758] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-15T17:52:51.629146] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-15T17:52:51.629236] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-15T17:52:51.629823] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-15T17:52:51.629867] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-15T17:52:51.630781] [DEBUG] [LOCAL ] CODI: Trimmed 41394 records to 31124 (keeping 150 days of data) [2025-09-15T17:52:51.678328] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-15T17:52:51.821137] [DEBUG] [LOCAL ] CODI: Primary data saved (31124 records). [2025-09-15T17:52:51.821303] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-15T17:52:51.821408] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 29.9s. Estimated remaining: 3h 15m 54s. Rate: 9.5 symbols/min [2025-09-15T17:52:51.995831] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:52.024011] [DEBUG] [LOCAL ] CON: Loaded 28932 existing records from primary storage. [2025-09-15T17:52:52.024214] [INFO ] [MAIN ] CON: Loaded 28932 existing records. [2025-09-15T17:52:52.207002] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:52.207419] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-15T17:52:52.207482] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-15T17:52:52.208156] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-15T17:52:52.208213] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-15T17:52:52.418998] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:52:52.469595] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-15T17:52:52.624863] [INFO ] [REMOTE ] CON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:53.257841] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-15T17:52:53.784915] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T17:52:54.057865] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-15T17:52:54.158520] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:52:54.635664] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T17:52:54.857873] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-15T17:52:55.643680] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:52:55.657821] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-15T17:52:56.457931] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-15T17:52:56.645251] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:52:57.188933] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:52:57.257910] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-15T17:52:57.600072] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:52:58.057943] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-15T17:52:58.857980] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-15T17:52:59.407101] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:52:59.473002] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:52:59.657869] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-15T17:53:00.457846] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-15T17:53:00.519191] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T17:53:01.031730] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:53:01.257940] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-15T17:53:02.057862] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-15T17:53:02.138267] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:53:02.509608] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:53:02.857883] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-15T17:53:03.657917] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-15T17:53:03.936482] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:53:03.942538] [INFO ] [REMOTE ] COHR: Full fetch complete (58033 records). [2025-09-15T17:53:03.942746] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-15T17:53:04.355595] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-15T17:53:04.357671] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-15T17:53:04.359004] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-15T17:53:04.359616] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-15T17:53:04.359537] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:53:04.366065] [INFO ] [REMOTE ] COLD: Full fetch complete (56339 records). [2025-09-15T17:53:04.366214] [DEBUG] [LOCAL ] COHR: Trimmed 58033 records to 39393 (keeping 150 days of data) [2025-09-15T17:53:04.366333] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-15T17:53:04.461471] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-15T17:53:04.975087] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-15T17:53:04.975428] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-15T17:53:04.977385] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-15T17:53:04.977777] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-15T17:53:04.981566] [DEBUG] [LOCAL ] COLD: Trimmed 56339 records to 38617 (keeping 150 days of data) [2025-09-15T17:53:05.126303] [DEBUG] [LOCAL ] COHR: Primary data saved (39393 records). [2025-09-15T17:53:05.126754] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-15T17:53:05.128451] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COHR took 24.8s. Estimated remaining: 3h 16m 14s. Rate: 9.5 symbols/min [2025-09-15T17:53:05.419635] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:05.423818] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:53:05.437926] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-15T17:53:05.458052] [DEBUG] [LOCAL ] COOK: Loaded 18711 existing records from primary storage. [2025-09-15T17:53:05.458673] [INFO ] [MAIN ] COOK: Loaded 18711 existing records. [2025-09-15T17:53:05.657537] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:05.658967] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-15T17:53:05.659605] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-15T17:53:05.661196] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-15T17:53:05.661793] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-15T17:53:05.891590] [DEBUG] [LOCAL ] COLD: Primary data saved (38617 records). [2025-09-15T17:53:05.924695] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-15T17:53:05.941700] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COLD took 24.0s. Estimated remaining: 3h 15m 47s. Rate: 9.5 symbols/min [2025-09-15T17:53:06.146955] [INFO ] [REMOTE ] COOK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:06.162794] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-15T17:53:06.209475] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:06.237506] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:53:06.283794] [DEBUG] [LOCAL ] COP: Loaded 40467 existing records from primary storage. [2025-09-15T17:53:06.283962] [INFO ] [MAIN ] COP: Loaded 40467 existing records. [2025-09-15T17:53:06.468000] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:06.468328] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-15T17:53:06.468384] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-15T17:53:06.469529] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-15T17:53:06.469605] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-15T17:53:06.827370] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:06.858891] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-15T17:53:06.863367] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T17:53:07.071062] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:53:07.657873] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-15T17:53:08.024180] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:53:08.457891] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-15T17:53:08.665922] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:53:09.257936] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-15T17:53:09.530450] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T17:53:09.535631] [INFO ] [REMOTE ] CON: Full fetch complete (42104 records). [2025-09-15T17:53:09.535733] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-15T17:53:09.910468] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-15T17:53:09.910584] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-15T17:53:09.911173] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-15T17:53:09.911217] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-15T17:53:09.912189] [DEBUG] [LOCAL ] CON: Trimmed 42104 records to 28443 (keeping 150 days of data) [2025-09-15T17:53:10.066711] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-15T17:53:10.093092] [DEBUG] [LOCAL ] CON: Primary data saved (28443 records). [2025-09-15T17:53:10.093210] [INFO ] [MAIN ] CON: Full history saved. [2025-09-15T17:53:10.093498] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. CON took 18.3s. Estimated remaining: 3h 15m 33s. Rate: 9.5 symbols/min [2025-09-15T17:53:10.265617] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:10.300325] [DEBUG] [LOCAL ] COR: Loaded 34959 existing records from primary storage. [2025-09-15T17:53:10.300492] [INFO ] [MAIN ] COR: Loaded 34959 existing records. [2025-09-15T17:53:10.482341] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:10.482669] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-15T17:53:10.482722] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-15T17:53:10.483455] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-15T17:53:10.483505] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-15T17:53:10.842213] [INFO ] [REMOTE ] COR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:10.867749] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-15T17:53:10.873560] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:53:11.140995] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:53:11.657896] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-15T17:53:12.437468] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:53:12.457815] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-15T17:53:12.799759] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:53:13.257875] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-15T17:53:14.057886] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-15T17:53:14.515915] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T17:53:14.832793] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:53:14.857815] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-15T17:53:15.529478] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:53:15.657870] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-15T17:53:16.457985] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-15T17:53:16.672165] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:53:17.263145] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-15T17:53:17.277855] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:53:17.870282] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:53:18.057994] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-15T17:53:18.719286] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:53:18.857816] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-15T17:53:19.108298] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T17:53:19.657929] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-15T17:53:20.457885] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-15T17:53:20.529439] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T17:53:21.006436] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:53:21.257926] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-15T17:53:22.057914] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-15T17:53:22.126245] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:53:22.133480] [INFO ] [REMOTE ] COMP: Full fetch complete (58015 records). [2025-09-15T17:53:22.133599] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-15T17:53:22.513716] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-15T17:53:22.513799] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-15T17:53:22.514637] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-15T17:53:22.514929] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-15T17:53:22.516364] [DEBUG] [LOCAL ] COMP: Trimmed 58015 records to 39382 (keeping 150 days of data) [2025-09-15T17:53:22.747044] [DEBUG] [LOCAL ] COMP: Primary data saved (39382 records). [2025-09-15T17:53:22.747266] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-15T17:53:22.748315] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COMP took 34.1s. Estimated remaining: 3h 15m 50s. Rate: 9.5 symbols/min [2025-09-15T17:53:22.858883] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-15T17:53:22.920750] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:22.986662] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:53:22.987430] [DEBUG] [LOCAL ] COTY: Loaded 40116 existing records from primary storage. [2025-09-15T17:53:22.998102] [INFO ] [MAIN ] COTY: Loaded 40116 existing records. [2025-09-15T17:53:23.188578] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:23.188923] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-15T17:53:23.188974] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-15T17:53:23.189772] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-15T17:53:23.189832] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-15T17:53:23.557417] [INFO ] [REMOTE ] COTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:23.657901] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-15T17:53:23.781058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:53:23.823803] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:53:24.457934] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-15T17:53:24.935594] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:53:25.257887] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-15T17:53:26.057893] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-15T17:53:26.219759] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:53:26.289513] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T17:53:26.292841] [INFO ] [REMOTE ] COOK: Full fetch complete (25126 records). [2025-09-15T17:53:26.292924] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-15T17:53:26.665416] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-15T17:53:26.665501] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-15T17:53:26.666018] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-15T17:53:26.666069] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-15T17:53:26.667084] [DEBUG] [LOCAL ] COOK: Trimmed 25126 records to 18462 (keeping 150 days of data) [2025-09-15T17:53:26.776874] [DEBUG] [LOCAL ] COOK: Primary data saved (18462 records). [2025-09-15T17:53:26.777030] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-15T17:53:26.777130] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COOK took 21.6s. Estimated remaining: 3h 15m 35s. Rate: 9.5 symbols/min [2025-09-15T17:53:26.866620] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-15T17:53:26.946631] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:26.984172] [DEBUG] [LOCAL ] COUR: Loaded 36989 existing records from primary storage. [2025-09-15T17:53:26.984311] [INFO ] [MAIN ] COUR: Loaded 36989 existing records. [2025-09-15T17:53:27.164370] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:27.164664] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-15T17:53:27.164712] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-15T17:53:27.165312] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-15T17:53:27.165357] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-15T17:53:27.511210] [INFO ] [REMOTE ] COUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:27.657814] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-15T17:53:28.114747] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T17:53:28.169762] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T17:53:28.457892] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-15T17:53:29.257839] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-15T17:53:29.293378] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:53:29.885276] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:53:30.057881] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-15T17:53:30.857879] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-15T17:53:30.956220] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T17:53:31.657866] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-15T17:53:31.722491] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:53:31.728734] [INFO ] [REMOTE ] COP: Full fetch complete (58407 records). [2025-09-15T17:53:31.728908] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-15T17:53:31.773819] [DEBUG] [REMOTE ] COR: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-15T17:53:31.807226] [WARN ] [REMOTE ] COR: No data returned for month 2025-08 [2025-09-15T17:53:32.112635] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-15T17:53:32.112761] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-15T17:53:32.113472] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-15T17:53:32.113514] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-15T17:53:32.114756] [DEBUG] [LOCAL ] COP: Trimmed 58407 records to 39687 (keeping 150 days of data) [2025-09-15T17:53:32.393529] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:53:32.410866] [DEBUG] [LOCAL ] COP: Primary data saved (39687 records). [2025-09-15T17:53:32.410974] [INFO ] [MAIN ] COP: Full history saved. [2025-09-15T17:53:32.411068] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COP took 26.5s. Estimated remaining: 3h 15m 27s. Rate: 9.5 symbols/min [2025-09-15T17:53:32.467631] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-15T17:53:32.586342] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:32.625785] [DEBUG] [LOCAL ] CP: Loaded 40048 existing records from primary storage. [2025-09-15T17:53:32.625928] [INFO ] [MAIN ] CP: Loaded 40048 existing records. [2025-09-15T17:53:32.837215] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:32.837452] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-15T17:53:32.837505] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-15T17:53:32.838325] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-15T17:53:32.838373] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-15T17:53:33.187503] [INFO ] [REMOTE ] CP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:33.257815] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-15T17:53:33.900084] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:53:33.905408] [INFO ] [REMOTE ] COR: Full fetch complete (44707 records). [2025-09-15T17:53:33.905531] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-15T17:53:34.062407] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-15T17:53:34.095304] [WARN ] [VALIDATOR ] COR: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T17:53:34.095818] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:53:34.095876] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:53:34.095921] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-15T17:53:34.095987] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-09-15T17:53:34.096033] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-09-15T17:53:34.096351] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-09-15T17:53:34.096607] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COR took 24.0s. Estimated remaining: 3h 15m 4s. Rate: 9.5 symbols/min [2025-09-15T17:53:34.267248] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:34.297379] [DEBUG] [LOCAL ] CPA: Loaded 21487 existing records from primary storage. [2025-09-15T17:53:34.297542] [INFO ] [MAIN ] CPA: Loaded 21487 existing records. [2025-09-15T17:53:34.478268] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:34.478571] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-15T17:53:34.478631] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-15T17:53:34.479193] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-15T17:53:34.479243] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-15T17:53:34.830082] [INFO ] [REMOTE ] CPA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:34.857891] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-15T17:53:34.858751] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:53:35.540201] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:53:35.657842] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-15T17:53:36.108942] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:53:36.457890] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-15T17:53:37.139781] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:53:37.257840] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-15T17:53:37.706227] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:53:38.057869] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-15T17:53:38.706071] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:53:38.857879] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-15T17:53:39.441533] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:53:39.657864] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-15T17:53:40.457960] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-15T17:53:40.508187] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:53:41.096435] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:53:41.257879] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-15T17:53:42.057877] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-15T17:53:42.134618] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:53:42.296007] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:53:42.857872] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-15T17:53:43.657843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-15T17:53:43.767766] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:53:44.135949] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T17:53:44.457875] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-15T17:53:45.257838] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-15T17:53:45.306100] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:53:45.436325] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:53:46.057867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-15T17:53:46.858836] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-15T17:53:46.862356] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:53:46.869275] [INFO ] [REMOTE ] COTY: Full fetch complete (57942 records). [2025-09-15T17:53:46.869366] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-15T17:53:47.253306] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-15T17:53:47.253428] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-15T17:53:47.254164] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-15T17:53:47.254219] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-15T17:53:47.255563] [DEBUG] [LOCAL ] COTY: Trimmed 57942 records to 39335 (keeping 150 days of data) [2025-09-15T17:53:47.282652] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:53:47.513212] [DEBUG] [LOCAL ] COTY: Primary data saved (39335 records). [2025-09-15T17:53:47.513360] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-15T17:53:47.514074] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COTY took 24.8s. Estimated remaining: 3h 15m 23s. Rate: 9.5 symbols/min [2025-09-15T17:53:47.683514] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-15T17:53:47.686032] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:47.686972] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-15T17:53:47.687017] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-15T17:53:47.687129] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-15T17:53:47.687168] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-15T17:53:47.687208] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-15T17:53:47.687241] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-15T17:53:48.081121] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:48.099403] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T17:53:48.457886] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-15T17:53:48.978327] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:53:49.257840] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-15T17:53:49.557295] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:53:50.057867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-15T17:53:50.857889] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-15T17:53:51.011239] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:53:51.280070] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:53:51.440847] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:53:51.657901] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-15T17:53:52.457895] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-15T17:53:52.647324] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:53:52.650885] [INFO ] [REMOTE ] CPA: Full fetch complete (31861 records). [2025-09-15T17:53:52.650982] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-15T17:53:53.026077] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-15T17:53:53.026164] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-15T17:53:53.026830] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-15T17:53:53.026893] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-15T17:53:53.027725] [DEBUG] [LOCAL ] CPA: Trimmed 31861 records to 21144 (keeping 150 days of data) [2025-09-15T17:53:53.169980] [DEBUG] [LOCAL ] CPA: Primary data saved (21144 records). [2025-09-15T17:53:53.170114] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-15T17:53:53.170195] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. CPA took 19.1s. Estimated remaining: 3h 15m 14s. Rate: 9.5 symbols/min [2025-09-15T17:53:53.263489] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-15T17:53:53.350019] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:53.372343] [DEBUG] [LOCAL ] CPAY: Loaded 22765 existing records from primary storage. [2025-09-15T17:53:53.372501] [INFO ] [MAIN ] CPAY: Loaded 22765 existing records. [2025-09-15T17:53:53.549868] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:53.550165] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-15T17:53:53.550213] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-15T17:53:53.550821] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-15T17:53:53.550885] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-15T17:53:53.669303] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:53:53.915414] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:54.057891] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-15T17:53:54.199088] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:53:54.857886] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-15T17:53:55.255087] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:53:55.657912] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-15T17:53:55.942241] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-15T17:53:56.457905] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-15T17:53:56.479497] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:53:56.485488] [INFO ] [REMOTE ] COUR: Full fetch complete (53081 records). [2025-09-15T17:53:56.485664] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-15T17:53:56.874930] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-15T17:53:56.875036] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-15T17:53:56.875881] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-15T17:53:56.875929] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-15T17:53:56.877411] [DEBUG] [LOCAL ] COUR: Trimmed 53081 records to 36333 (keeping 150 days of data) [2025-09-15T17:53:57.115038] [DEBUG] [LOCAL ] COUR: Primary data saved (36333 records). [2025-09-15T17:53:57.115246] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-15T17:53:57.116570] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COUR took 30.3s. Estimated remaining: 3h 14m 60s. Rate: 9.5 symbols/min [2025-09-15T17:53:57.261400] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-15T17:53:57.293906] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:57.309780] [DEBUG] [LOCAL ] CPF: Loaded 11023 existing records from primary storage. [2025-09-15T17:53:57.309974] [INFO ] [MAIN ] CPF: Loaded 11023 existing records. [2025-09-15T17:53:57.490552] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:57.490947] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-15T17:53:57.491029] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-15T17:53:57.491430] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-15T17:53:57.491477] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-15T17:53:57.856837] [INFO ] [REMOTE ] CPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:58.057901] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-15T17:53:58.115625] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:53:58.543111] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:53:58.857930] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-15T17:53:59.155980] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:53:59.166284] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:53:59.657942] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-15T17:54:00.385100] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T17:54:00.457875] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-15T17:54:01.257910] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-15T17:54:01.503138] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:54:01.746366] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:54:02.057902] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-15T17:54:02.857937] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-15T17:54:03.400969] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:54:03.657905] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-15T17:54:04.208382] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:54:04.457880] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-15T17:54:04.891206] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:54:05.036259] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:54:05.257904] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-15T17:54:05.583403] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:54:06.057908] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-15T17:54:06.857884] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-15T17:54:07.253598] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:54:07.259853] [INFO ] [REMOTE ] CP: Full fetch complete (57910 records). [2025-09-15T17:54:07.260005] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-15T17:54:07.644091] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-15T17:54:07.644200] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-15T17:54:07.645294] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-15T17:54:07.645367] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-15T17:54:07.646763] [DEBUG] [LOCAL ] CP: Trimmed 57910 records to 39276 (keeping 150 days of data) [2025-09-15T17:54:07.714043] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-15T17:54:07.905882] [DEBUG] [LOCAL ] CP: Primary data saved (39276 records). [2025-09-15T17:54:07.906027] [INFO ] [MAIN ] CP: Full history saved. [2025-09-15T17:54:07.907503] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CP took 35.5s. Estimated remaining: 3h 15m 9s. Rate: 9.5 symbols/min [2025-09-15T17:54:08.104474] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:54:08.106695] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:08.126441] [DEBUG] [LOCAL ] CPK: Loaded 9467 existing records from primary storage. [2025-09-15T17:54:08.126578] [INFO ] [MAIN ] CPK: Loaded 9467 existing records. [2025-09-15T17:54:08.302636] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:08.302889] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-15T17:54:08.302936] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-15T17:54:08.303292] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-15T17:54:08.303339] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-15T17:54:08.461406] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-15T17:54:08.666848] [INFO ] [REMOTE ] CPK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:08.676969] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T17:54:09.257849] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-15T17:54:09.717496] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:54:09.747393] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:54:09.748248] [INFO ] [REMOTE ] CPAC: Full fetch complete (1257 records). [2025-09-15T17:54:09.748319] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-15T17:54:09.932907] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T17:54:09.933122] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:54:09.933172] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:54:09.933217] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-15T17:54:09.933294] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-15T17:54:09.933333] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-15T17:54:09.933373] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-15T17:54:09.933432] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPAC took 22.4s. Estimated remaining: 3h 14m 48s. Rate: 9.5 symbols/min [2025-09-15T17:54:10.073232] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-15T17:54:10.105505] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:10.151250] [DEBUG] [LOCAL ] CPNG: Loaded 40425 existing records from primary storage. [2025-09-15T17:54:10.151404] [INFO ] [MAIN ] CPNG: Loaded 40425 existing records. [2025-09-15T17:54:10.324994] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:10.325262] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-15T17:54:10.325307] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-15T17:54:10.326141] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-15T17:54:10.326192] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-15T17:54:10.691530] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:10.857844] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-15T17:54:11.124487] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:54:11.619132] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T17:54:11.657858] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-15T17:54:12.433159] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:54:12.457813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-15T17:54:13.257896] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-15T17:54:13.507423] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:54:13.912484] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:54:14.057919] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-15T17:54:14.777467] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:54:14.857852] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-15T17:54:15.657915] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-15T17:54:16.275161] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:54:16.457909] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-15T17:54:17.257944] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-15T17:54:17.320041] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:54:17.512320] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:54:17.838334] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:54:17.841106] [INFO ] [REMOTE ] CPF: Full fetch complete (16916 records). [2025-09-15T17:54:17.841201] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-15T17:54:18.067301] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-15T17:54:18.222559] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-15T17:54:18.222635] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-15T17:54:18.223007] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-15T17:54:18.223046] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-15T17:54:18.223565] [DEBUG] [LOCAL ] CPF: Trimmed 16916 records to 10798 (keeping 150 days of data) [2025-09-15T17:54:18.291243] [DEBUG] [LOCAL ] CPF: Primary data saved (10798 records). [2025-09-15T17:54:18.291365] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-15T17:54:18.291447] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPF took 21.2s. Estimated remaining: 3h 14m 49s. Rate: 9.5 symbols/min [2025-09-15T17:54:18.458064] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:18.504275] [DEBUG] [LOCAL ] CPRI: Loaded 39506 existing records from primary storage. [2025-09-15T17:54:18.504458] [INFO ] [MAIN ] CPRI: Loaded 39506 existing records. [2025-09-15T17:54:18.681201] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:18.681465] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-15T17:54:18.681514] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-15T17:54:18.682350] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-15T17:54:18.682401] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-15T17:54:18.864547] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-15T17:54:19.035721] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:19.657881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-15T17:54:20.066621] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T17:54:20.334061] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:54:20.337459] [INFO ] [REMOTE ] CPAY: Full fetch complete (33934 records). [2025-09-15T17:54:20.337544] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-15T17:54:20.463040] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-15T17:54:20.702802] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-15T17:54:20.702880] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-15T17:54:20.703388] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-15T17:54:20.703427] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-15T17:54:20.704220] [DEBUG] [LOCAL ] CPAY: Trimmed 33934 records to 22320 (keeping 150 days of data) [2025-09-15T17:54:20.838867] [DEBUG] [LOCAL ] CPAY: Primary data saved (22320 records). [2025-09-15T17:54:20.838997] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-15T17:54:20.839078] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAY took 27.7s. Estimated remaining: 3h 14m 29s. Rate: 9.5 symbols/min [2025-09-15T17:54:21.259170] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-15T17:54:21.262593] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:54:21.861122] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:54:22.057934] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-15T17:54:22.378221] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:54:22.857862] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-15T17:54:23.657903] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-15T17:54:23.722789] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:54:24.324936] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T17:54:24.457881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-15T17:54:25.065034] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-15T17:54:25.257864] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-15T17:54:25.823052] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:54:26.057911] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-15T17:54:26.857870] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-15T17:54:27.317775] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-15T17:54:27.440444] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:54:27.575332] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:54:27.657934] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-15T17:54:28.458466] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-15T17:54:28.459872] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:54:28.461691] [INFO ] [REMOTE ] CPK: Full fetch complete (14013 records). [2025-09-15T17:54:28.461766] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-15T17:54:28.829302] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-15T17:54:28.829391] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-15T17:54:28.829743] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-15T17:54:28.829803] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-15T17:54:28.830358] [DEBUG] [LOCAL ] CPK: Trimmed 14013 records to 9139 (keeping 150 days of data) [2025-09-15T17:54:28.887700] [DEBUG] [LOCAL ] CPK: Primary data saved (9139 records). [2025-09-15T17:54:28.887828] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-15T17:54:28.887927] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 21.0s. Estimated remaining: 3h 14m 29s. Rate: 9.5 symbols/min [2025-09-15T17:54:29.257926] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-15T17:54:30.910279] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T17:54:30.922739] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-15T17:54:30.958652] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:54:30.969901] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-15T17:54:32.682536] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T17:54:32.695558] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-15T17:54:33.195187] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-15T17:54:33.206877] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-15T17:54:34.172370] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:54:34.183388] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-15T17:54:35.108024] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T17:54:35.116617] [INFO ] [REMOTE ] CPNG: Full fetch complete (58348 records). [2025-09-15T17:54:35.116877] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-15T17:54:35.664095] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-15T17:54:35.664256] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-15T17:54:35.665202] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-15T17:54:35.665665] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-15T17:54:35.673433] [DEBUG] [LOCAL ] CPNG: Trimmed 58348 records to 39648 (keeping 150 days of data) [2025-09-15T17:54:35.684211] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:54:35.691335] [INFO ] [REMOTE ] CPRI: Full fetch complete (57173 records). [2025-09-15T17:54:35.691475] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-15T17:54:36.241451] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-15T17:54:36.241572] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-15T17:54:36.242410] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-15T17:54:36.242478] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-15T17:54:36.331370] [DEBUG] [LOCAL ] CPRI: Trimmed 57173 records to 38730 (keeping 150 days of data) [2025-09-15T17:54:36.535223] [DEBUG] [LOCAL ] CPNG: Primary data saved (39648 records). [2025-09-15T17:54:36.562703] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-15T17:54:36.567356] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPNG took 26.6s. Estimated remaining: 3h 14m 28s. Rate: 9.5 symbols/min [2025-09-15T17:54:36.594840] [DEBUG] [LOCAL ] CPRI: Primary data saved (38730 records). [2025-09-15T17:54:36.594997] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-15T17:54:36.596489] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPRI took 18.3s. Estimated remaining: 3h 13m 59s. Rate: 9.5 symbols/min [2025-09-15T17:54:37.220307] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.266768] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.285273] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.286853] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.316063] [DEBUG] [LOCAL ] CPS: Loaded 18945 existing records from primary storage. [2025-09-15T17:54:37.315689] [DEBUG] [LOCAL ] CQP: Loaded 15095 existing records from primary storage. [2025-09-15T17:54:37.316222] [INFO ] [MAIN ] CPS: Loaded 18945 existing records. [2025-09-15T17:54:37.316315] [INFO ] [MAIN ] CQP: Loaded 15095 existing records. [2025-09-15T17:54:37.503318] [DEBUG] [LOCAL ] CR: Loaded 18070 existing records from primary storage. [2025-09-15T17:54:37.528340] [INFO ] [MAIN ] CR: Loaded 18070 existing records. [2025-09-15T17:54:37.755363] [DEBUG] [LOCAL ] CPT: Loaded 33071 existing records from primary storage. [2025-09-15T17:54:37.771087] [INFO ] [MAIN ] CPT: Loaded 33071 existing records. [2025-09-15T17:54:37.760632] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:37.830146] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:37.877053] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-15T17:54:37.877196] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-15T17:54:37.901159] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-15T17:54:37.901113] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-15T17:54:37.942886] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-15T17:54:37.982166] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-15T17:54:37.990532] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-15T17:54:37.982070] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-15T17:54:38.070213] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:38.225584] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:38.269893] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-15T17:54:38.281757] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-15T17:54:38.297926] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-15T17:54:38.316781] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-15T17:54:38.349843] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-15T17:54:38.359035] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-15T17:54:38.390092] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-15T17:54:38.388598] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-15T17:54:39.171110] [INFO ] [REMOTE ] CQP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.226239] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-15T17:54:39.369417] [INFO ] [REMOTE ] CPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.417584] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-15T17:54:39.549161] [INFO ] [REMOTE ] CPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.567535] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-15T17:54:39.587276] [INFO ] [REMOTE ] CR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.588962] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-15T17:54:40.518875] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:54:40.524447] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-15T17:54:40.602455] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:54:40.607910] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-15T17:54:40.713745] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:54:40.722863] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-15T17:54:40.806828] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:54:40.811431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-15T17:54:41.320231] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:54:41.325122] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-15T17:54:41.843392] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:54:41.849675] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-15T17:54:41.927540] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:54:41.993358] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:54:42.013422] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:54:42.057842] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-15T17:54:42.857855] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-15T17:54:43.160707] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T17:54:43.625684] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:54:43.657861] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-15T17:54:43.927886] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:54:44.457887] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-15T17:54:45.164627] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:54:45.257924] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-15T17:54:45.659963] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:54:46.057872] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-15T17:54:46.264050] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:54:46.857871] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-15T17:54:47.059209] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:54:47.657916] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-15T17:54:48.149636] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T17:54:48.457839] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-15T17:54:48.494598] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:54:49.257887] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-15T17:54:49.342171] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:54:50.057862] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-15T17:54:50.706262] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:54:50.857855] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-15T17:54:50.905806] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:54:51.657918] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-15T17:54:52.366041] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:54:52.457836] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-15T17:54:52.747851] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T17:54:53.257857] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-15T17:54:53.439027] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:54:53.958577] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:54:54.057874] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-15T17:54:54.826816] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:54:54.828708] [INFO ] [REMOTE ] CQP: Full fetch complete (22123 records). [2025-09-15T17:54:54.828789] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-15T17:54:54.862982] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-15T17:54:55.212136] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-15T17:54:55.212222] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-15T17:54:55.212711] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-15T17:54:55.212768] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-15T17:54:55.213403] [DEBUG] [LOCAL ] CQP: Trimmed 22123 records to 14914 (keeping 150 days of data) [2025-09-15T17:54:55.309849] [DEBUG] [LOCAL ] CQP: Primary data saved (14914 records). [2025-09-15T17:54:55.310006] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-15T17:54:55.310102] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 18.7s. Estimated remaining: 3h 14m 37s. Rate: 9.5 symbols/min [2025-09-15T17:54:55.487201] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:55.495574] [DEBUG] [LOCAL ] CRBD: Loaded 6949 existing records from primary storage. [2025-09-15T17:54:55.495689] [INFO ] [MAIN ] CRBD: Loaded 6949 existing records. [2025-09-15T17:54:55.667672] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-15T17:54:55.672827] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:55.674347] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-15T17:54:55.674451] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-15T17:54:55.674810] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-15T17:54:55.674868] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-15T17:54:56.050001] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:56.463082] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-15T17:54:56.469774] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:54:56.492769] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:54:56.500191] [INFO ] [REMOTE ] CPT: Full fetch complete (48281 records). [2025-09-15T17:54:56.500348] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-15T17:54:56.891078] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-15T17:54:56.891178] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-15T17:54:56.891840] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-15T17:54:56.891887] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-15T17:54:56.893053] [DEBUG] [LOCAL ] CPT: Trimmed 48281 records to 32473 (keeping 150 days of data) [2025-09-15T17:54:57.099571] [DEBUG] [LOCAL ] CPT: Primary data saved (32473 records). [2025-09-15T17:54:57.099727] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-15T17:54:57.099812] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CPT took 20.5s. Estimated remaining: 3h 14m 14s. Rate: 9.5 symbols/min [2025-09-15T17:54:57.266452] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-15T17:54:57.269014] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:57.277381] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:54:57.316169] [DEBUG] [LOCAL ] CRBG: Loaded 39482 existing records from primary storage. [2025-09-15T17:54:57.316345] [INFO ] [MAIN ] CRBG: Loaded 39482 existing records. [2025-09-15T17:54:57.493921] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:57.494214] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-15T17:54:57.494281] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-15T17:54:57.495123] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-15T17:54:57.495177] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-15T17:54:57.839102] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:58.057878] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-15T17:54:58.524478] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:54:58.527838] [INFO ] [REMOTE ] CR: Full fetch complete (26539 records). [2025-09-15T17:54:58.527915] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-15T17:54:58.876767] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-15T17:54:58.888135] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-15T17:54:58.888197] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-15T17:54:58.888633] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-15T17:54:58.888697] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-15T17:54:58.889441] [DEBUG] [LOCAL ] CR: Trimmed 26539 records to 17772 (keeping 150 days of data) [2025-09-15T17:54:59.011053] [DEBUG] [LOCAL ] CR: Primary data saved (17772 records). [2025-09-15T17:54:59.011193] [INFO ] [MAIN ] CR: Full history saved. [2025-09-15T17:54:59.011307] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CR took 22.4s. Estimated remaining: 3h 13m 53s. Rate: 9.5 symbols/min [2025-09-15T17:54:59.178886] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:59.210332] [DEBUG] [LOCAL ] CRC: Loaded 32978 existing records from primary storage. [2025-09-15T17:54:59.210483] [INFO ] [MAIN ] CRC: Loaded 32978 existing records. [2025-09-15T17:54:59.386136] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:59.386348] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-15T17:54:59.386393] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-15T17:54:59.387092] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-15T17:54:59.387149] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-15T17:54:59.658125] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-15T17:54:59.743258] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:59.749333] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T17:54:59.886404] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:55:00.457872] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-15T17:55:00.770586] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:55:01.257883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-15T17:55:02.057846] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-15T17:55:02.146725] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:55:02.222588] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:55:02.857867] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-15T17:55:03.657961] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-15T17:55:03.837323] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:55:04.457915] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-15T17:55:05.257933] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-15T17:55:05.331850] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:55:05.721404] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-15T17:55:05.769084] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-15T17:55:05.771968] [INFO ] [REMOTE ] CPS: Full fetch complete (28923 records). [2025-09-15T17:55:05.772052] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-15T17:55:06.063083] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-15T17:55:06.140734] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-15T17:55:06.140822] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-15T17:55:06.141336] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-15T17:55:06.141377] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-15T17:55:06.142189] [DEBUG] [LOCAL ] CPS: Trimmed 28923 records to 18514 (keeping 150 days of data) [2025-09-15T17:55:06.257545] [DEBUG] [LOCAL ] CPS: Primary data saved (18514 records). [2025-09-15T17:55:06.257733] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-15T17:55:06.257843] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPS took 29.7s. Estimated remaining: 3h 13m 50s. Rate: 9.5 symbols/min [2025-09-15T17:55:06.453423] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:06.453620] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-15T17:55:06.453679] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-15T17:55:06.453808] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-15T17:55:06.453848] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-15T17:55:06.453889] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-15T17:55:06.453921] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-15T17:55:06.806810] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:06.867900] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-15T17:55:06.896622] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:55:07.617393] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:55:07.657868] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-15T17:55:07.769471] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:55:08.457891] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-15T17:55:09.248148] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:55:09.257809] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-15T17:55:09.809465] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:55:10.057925] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-15T17:55:10.250376] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:10.250709] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-15T17:55:10.726519] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:55:10.857874] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-15T17:55:11.657929] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-15T17:55:11.992871] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:55:12.457900] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-15T17:55:12.683526] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:12.683893] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-15T17:55:13.262954] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-15T17:55:13.279753] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:55:14.057866] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-15T17:55:14.727860] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:55:14.857880] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-15T17:55:15.044710] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:15.045024] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-15T17:55:15.657896] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-15T17:55:15.791135] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T17:55:15.837430] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:15.837784] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-15T17:55:16.457928] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-15T17:55:17.257884] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-15T17:55:18.057908] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-15T17:55:18.563259] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-15T17:55:18.857864] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-15T17:55:19.657985] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-15T17:55:19.926301] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:55:20.054286] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-15T17:55:20.228201] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:55:20.233880] [INFO ] [REMOTE ] CRBG: Full fetch complete (56892 records). [2025-09-15T17:55:20.233972] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-15T17:55:20.347965] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:55:20.462961] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-15T17:55:20.634739] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-15T17:55:20.634815] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-15T17:55:20.635494] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-15T17:55:20.635536] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-15T17:55:20.636668] [DEBUG] [LOCAL ] CRBG: Trimmed 56892 records to 38714 (keeping 150 days of data) [2025-09-15T17:55:20.869121] [DEBUG] [LOCAL ] CRBG: Primary data saved (38714 records). [2025-09-15T17:55:20.869268] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-15T17:55:20.869851] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBG took 23.8s. Estimated remaining: 3h 14m 12s. Rate: 9.5 symbols/min [2025-09-15T17:55:21.037915] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:21.075522] [DEBUG] [LOCAL ] CRGY: Loaded 39368 existing records from primary storage. [2025-09-15T17:55:21.075684] [INFO ] [MAIN ] CRGY: Loaded 39368 existing records. [2025-09-15T17:55:21.255262] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:21.255552] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-15T17:55:21.255600] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-15T17:55:21.256530] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-15T17:55:21.256583] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-15T17:55:21.267963] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-15T17:55:21.617578] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:22.057895] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-15T17:55:22.775462] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-15T17:55:22.780173] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:55:22.857817] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-15T17:55:22.906933] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:55:22.912014] [INFO ] [REMOTE ] CRC: Full fetch complete (47849 records). [2025-09-15T17:55:22.912097] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-15T17:55:23.278805] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-15T17:55:23.278880] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-15T17:55:23.279432] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-15T17:55:23.279473] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-15T17:55:23.280429] [DEBUG] [LOCAL ] CRC: Trimmed 47849 records to 32513 (keeping 150 days of data) [2025-09-15T17:55:23.492994] [DEBUG] [LOCAL ] CRC: Primary data saved (32513 records). [2025-09-15T17:55:23.493154] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-15T17:55:23.493244] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRC took 24.5s. Estimated remaining: 3h 13m 53s. Rate: 9.5 symbols/min [2025-09-15T17:55:23.664216] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-15T17:55:23.664159] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:23.704820] [DEBUG] [LOCAL ] CRH: Loaded 40240 existing records from primary storage. [2025-09-15T17:55:23.704953] [INFO ] [MAIN ] CRH: Loaded 40240 existing records. [2025-09-15T17:55:23.880995] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:23.881289] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-15T17:55:23.881339] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-15T17:55:23.882311] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-15T17:55:23.882365] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-15T17:55:24.233337] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:24.239870] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:55:24.241556] [INFO ] [REMOTE ] CRBD: Full fetch complete (9934 records). [2025-09-15T17:55:24.241637] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-15T17:55:24.463049] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-15T17:55:24.610793] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-15T17:55:24.610872] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-15T17:55:24.611144] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-15T17:55:24.611189] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-15T17:55:24.611671] [DEBUG] [LOCAL ] CRBD: Trimmed 9934 records to 6872 (keeping 150 days of data) [2025-09-15T17:55:24.655860] [DEBUG] [LOCAL ] CRBD: Primary data saved (6872 records). [2025-09-15T17:55:24.656009] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-15T17:55:24.656107] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRBD took 29.3s. Estimated remaining: 3h 13m 29s. Rate: 9.5 symbols/min [2025-09-15T17:55:24.825923] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:24.865048] [DEBUG] [LOCAL ] CRI: Loaded 37683 existing records from primary storage. [2025-09-15T17:55:24.865218] [INFO ] [MAIN ] CRI: Loaded 37683 existing records. [2025-09-15T17:55:25.041679] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:25.041975] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-15T17:55:25.042022] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-15T17:55:25.042899] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-15T17:55:25.042951] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-15T17:55:25.261396] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-15T17:55:25.402794] [INFO ] [REMOTE ] CRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:25.438187] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-15T17:55:26.057832] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-15T17:55:26.494124] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T17:55:26.773472] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:55:26.857902] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-15T17:55:27.382315] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:55:27.657884] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-15T17:55:28.463411] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:55:28.461263] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-15T17:55:29.247501] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:55:29.258216] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-15T17:55:30.057869] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-15T17:55:30.530626] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:55:30.857853] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-15T17:55:31.071393] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-15T17:55:31.077076] [INFO ] [REMOTE ] CRCL: Full fetch complete (27099 records). [2025-09-15T17:55:31.077153] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-15T17:55:31.261598] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 70 unique days, need 150 days [2025-09-15T17:55:31.262144] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:55:31.262206] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:55:31.262264] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-15T17:55:31.262362] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-15T17:55:31.262431] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-15T17:55:31.262495] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-15T17:55:31.262572] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRCL took 25.0s. Estimated remaining: 3h 13m 24s. Rate: 9.5 symbols/min [2025-09-15T17:55:31.459727] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:31.502792] [DEBUG] [LOCAL ] CRK: Loaded 39134 existing records from primary storage. [2025-09-15T17:55:31.502951] [INFO ] [MAIN ] CRK: Loaded 39134 existing records. [2025-09-15T17:55:31.663302] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-15T17:55:31.727814] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:31.731369] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-15T17:55:31.730942] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:55:31.731587] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-15T17:55:31.743942] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-15T17:55:31.744018] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-15T17:55:32.139521] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:32.457913] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-15T17:55:32.521128] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T17:55:33.075053] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:55:33.257885] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-15T17:55:33.808598] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:55:34.057875] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-15T17:55:34.817373] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T17:55:34.857819] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-15T17:55:35.657885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-15T17:55:35.672478] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:55:35.932094] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:55:36.457897] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-15T17:55:37.120165] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:55:37.257872] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-15T17:55:38.057899] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-15T17:55:38.144715] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:55:38.857910] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-15T17:55:38.899416] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T17:55:39.371127] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:55:39.657870] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-15T17:55:40.206032] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:55:40.457869] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-15T17:55:41.190551] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:55:41.257835] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-15T17:55:42.062948] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-15T17:55:42.082040] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:55:42.428830] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:55:42.857864] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-15T17:55:43.638941] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:55:43.657822] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-15T17:55:44.067301] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:55:44.457888] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-15T17:55:45.031766] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:55:45.257879] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-15T17:55:46.057885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-15T17:55:46.086772] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:55:46.092204] [INFO ] [REMOTE ] CRI: Full fetch complete (54169 records). [2025-09-15T17:55:46.092312] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-15T17:55:46.483630] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-15T17:55:46.483763] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-15T17:55:46.484953] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-15T17:55:46.485016] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-15T17:55:46.486480] [DEBUG] [LOCAL ] CRI: Trimmed 54169 records to 36947 (keeping 150 days of data) [2025-09-15T17:55:46.832668] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:55:46.882674] [DEBUG] [LOCAL ] CRI: Primary data saved (36947 records). [2025-09-15T17:55:46.883878] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-15T17:55:46.885365] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-15T17:55:46.884962] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRI took 22.2s. Estimated remaining: 3h 13m 50s. Rate: 9.5 symbols/min [2025-09-15T17:55:47.147779] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:47.196703] [DEBUG] [LOCAL ] CRL: Loaded 31895 existing records from primary storage. [2025-09-15T17:55:47.196897] [INFO ] [MAIN ] CRL: Loaded 31895 existing records. [2025-09-15T17:55:47.462972] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:47.463408] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-15T17:55:47.463882] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-15T17:55:47.464680] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-15T17:55:47.464764] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-15T17:55:47.679044] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-15T17:55:47.932258] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:55:47.937595] [INFO ] [REMOTE ] CRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:48.457874] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-15T17:55:48.786016] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T17:55:49.196755] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:55:49.203257] [INFO ] [REMOTE ] CRGY: Full fetch complete (57044 records). [2025-09-15T17:55:49.203434] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-15T17:55:49.258722] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-15T17:55:49.622231] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-15T17:55:49.622471] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-15T17:55:49.623694] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-15T17:55:49.623780] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-15T17:55:49.625939] [DEBUG] [LOCAL ] CRGY: Trimmed 57044 records to 38598 (keeping 150 days of data) [2025-09-15T17:55:49.774376] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:55:49.931820] [DEBUG] [LOCAL ] CRGY: Primary data saved (38598 records). [2025-09-15T17:55:49.932057] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-15T17:55:49.932851] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 29.1s. Estimated remaining: 3h 13m 32s. Rate: 9.5 symbols/min [2025-09-15T17:55:50.063060] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-15T17:55:50.126716] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:50.179184] [DEBUG] [LOCAL ] CRM: Loaded 40510 existing records from primary storage. [2025-09-15T17:55:50.179413] [INFO ] [MAIN ] CRM: Loaded 40510 existing records. [2025-09-15T17:55:50.364703] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:50.365082] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-15T17:55:50.365145] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-15T17:55:50.366122] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-15T17:55:50.366181] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-15T17:55:50.757558] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:50.857868] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-15T17:55:51.202257] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T17:55:51.209277] [INFO ] [REMOTE ] CRH: Full fetch complete (58159 records). [2025-09-15T17:55:51.209398] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-15T17:55:51.585225] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-15T17:55:51.585306] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-15T17:55:51.586019] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-15T17:55:51.586066] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-15T17:55:51.587295] [DEBUG] [LOCAL ] CRH: Trimmed 58159 records to 39445 (keeping 150 days of data) [2025-09-15T17:55:51.660396] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-15T17:55:51.867370] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:55:51.900760] [DEBUG] [LOCAL ] CRH: Primary data saved (39445 records). [2025-09-15T17:55:51.900919] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-15T17:55:51.902039] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 28.4s. Estimated remaining: 3h 13m 11s. Rate: 9.5 symbols/min [2025-09-15T17:55:52.073022] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:52.116726] [DEBUG] [LOCAL ] CRS: Loaded 32697 existing records from primary storage. [2025-09-15T17:55:52.116898] [INFO ] [MAIN ] CRS: Loaded 32697 existing records. [2025-09-15T17:55:52.295710] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:52.296158] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-15T17:55:52.296319] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-15T17:55:52.297408] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-15T17:55:52.297473] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-15T17:55:52.483557] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-15T17:55:52.601622] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:55:52.701567] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:53.257888] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-15T17:55:53.532174] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T17:55:54.057872] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-15T17:55:54.250471] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:55:54.257188] [INFO ] [REMOTE ] CRK: Full fetch complete (56612 records). [2025-09-15T17:55:54.257366] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-15T17:55:54.647476] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-15T17:55:54.647589] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-15T17:55:54.648336] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-15T17:55:54.648388] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-15T17:55:54.650808] [DEBUG] [LOCAL ] CRK: Trimmed 56612 records to 38364 (keeping 150 days of data) [2025-09-15T17:55:54.861156] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-15T17:55:54.894733] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:55:54.915871] [DEBUG] [LOCAL ] CRK: Primary data saved (38364 records). [2025-09-15T17:55:54.916000] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-15T17:55:54.916490] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 23.7s. Estimated remaining: 3h 12m 53s. Rate: 9.5 symbols/min [2025-09-15T17:55:55.086500] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:55.092106] [DEBUG] [LOCAL ] CRT: Loaded 3442 existing records from primary storage. [2025-09-15T17:55:55.092217] [INFO ] [MAIN ] CRT: Loaded 3442 existing records. [2025-09-15T17:55:55.265329] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:55.265559] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-15T17:55:55.265628] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-15T17:55:55.265873] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-15T17:55:55.265919] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-15T17:55:55.617334] [INFO ] [REMOTE ] CRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:55.647771] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:55:55.658001] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-15T17:55:56.419633] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T17:55:56.457839] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-15T17:55:56.936402] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:55:57.257915] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-15T17:55:58.057947] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-15T17:55:58.282326] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T17:55:58.438324] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T17:55:58.769256] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:55:58.857823] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-15T17:55:59.657881] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-15T17:56:00.457907] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-15T17:56:00.488612] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:56:01.257878] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-15T17:56:01.876661] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T17:56:02.018891] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:56:02.057842] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-15T17:56:02.865635] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-15T17:56:02.889782] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T17:56:03.316458] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:56:03.657919] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-15T17:56:04.360593] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T17:56:04.457920] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-15T17:56:05.216051] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-15T17:56:05.257823] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-15T17:56:05.650483] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T17:56:06.057874] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-15T17:56:06.857867] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-15T17:56:07.347507] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:56:07.352025] [INFO ] [REMOTE ] CRL: Full fetch complete (48002 records). [2025-09-15T17:56:07.352144] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-15T17:56:07.352772] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:56:07.352852] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:56:07.352909] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:56:07.352956] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-15T17:56:07.353023] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-15T17:56:07.353062] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-15T17:56:07.353384] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-15T17:56:07.354631] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRL took 20.5s. Estimated remaining: 3h 13m 8s. Rate: 9.5 symbols/min [2025-09-15T17:56:07.530081] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:07.565720] [DEBUG] [LOCAL ] CSAN: Loaded 31822 existing records from primary storage. [2025-09-15T17:56:07.565862] [INFO ] [MAIN ] CSAN: Loaded 31822 existing records. [2025-09-15T17:56:07.662934] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-15T17:56:07.747515] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:07.747950] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-15T17:56:07.751885] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-15T17:56:07.752630] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:56:07.754151] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-15T17:56:07.754524] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-15T17:56:08.064693] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-15T17:56:08.154283] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:08.457892] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-15T17:56:09.015256] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:56:09.257900] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-15T17:56:09.636500] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:56:10.057924] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-15T17:56:10.857849] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-15T17:56:10.979005] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-15T17:56:11.249867] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T17:56:11.663619] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-15T17:56:11.678736] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:56:12.457895] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-15T17:56:13.257902] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-15T17:56:13.581734] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:56:13.854590] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:56:14.057877] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-15T17:56:14.529113] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T17:56:14.857894] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-15T17:56:14.906550] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:56:15.657926] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-15T17:56:16.280944] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:56:16.282171] [INFO ] [REMOTE ] CRT: Full fetch complete (5393 records). [2025-09-15T17:56:16.282238] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-15T17:56:16.457998] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-15T17:56:16.668509] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-15T17:56:16.668612] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-15T17:56:16.668856] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-15T17:56:16.668917] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-15T17:56:16.669358] [DEBUG] [LOCAL ] CRT: Trimmed 5393 records to 3442 (keeping 150 days of data) [2025-09-15T17:56:16.693146] [DEBUG] [LOCAL ] CRT: Primary data saved (3442 records). [2025-09-15T17:56:16.693328] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-15T17:56:16.693431] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRT took 21.8s. Estimated remaining: 3h 13m 12s. Rate: 9.5 symbols/min [2025-09-15T17:56:16.880456] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:16.906270] [DEBUG] [LOCAL ] CSL: Loaded 22559 existing records from primary storage. [2025-09-15T17:56:16.906478] [INFO ] [MAIN ] CSL: Loaded 22559 existing records. [2025-09-15T17:56:17.087701] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:17.088052] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-15T17:56:17.088129] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-15T17:56:17.088842] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-15T17:56:17.088893] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-15T17:56:17.263122] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-15T17:56:17.452158] [INFO ] [REMOTE ] CSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:17.515611] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-15T17:56:17.521700] [INFO ] [REMOTE ] CRM: Full fetch complete (58448 records). [2025-09-15T17:56:17.521823] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-15T17:56:17.914207] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-15T17:56:17.914299] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-15T17:56:17.915127] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-15T17:56:17.915174] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-15T17:56:17.916432] [DEBUG] [LOCAL ] CRM: Trimmed 58448 records to 39730 (keeping 150 days of data) [2025-09-15T17:56:18.100244] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-15T17:56:18.176529] [DEBUG] [LOCAL ] CRM: Primary data saved (39730 records). [2025-09-15T17:56:18.177033] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-15T17:56:18.177753] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRM took 28.2s. Estimated remaining: 3h 12m 49s. Rate: 9.5 symbols/min [2025-09-15T17:56:18.384524] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T17:56:18.386156] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:18.410497] [DEBUG] [LOCAL ] CSR: Loaded 9762 existing records from primary storage. [2025-09-15T17:56:18.410679] [INFO ] [MAIN ] CSR: Loaded 9762 existing records. [2025-09-15T17:56:18.590900] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:18.591325] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-15T17:56:18.591392] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-15T17:56:18.591907] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-15T17:56:18.592042] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-15T17:56:18.871762] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-15T17:56:18.951771] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:56:19.023175] [INFO ] [REMOTE ] CSR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:19.265661] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:56:19.657879] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-15T17:56:20.458388] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-15T17:56:20.471156] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T17:56:20.815427] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T17:56:21.089567] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T17:56:21.257852] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-15T17:56:22.057898] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-15T17:56:22.747932] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:56:22.857827] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-15T17:56:23.657856] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-15T17:56:23.726210] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T17:56:23.989608] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:56:24.310231] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:56:24.457882] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-15T17:56:25.257855] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-15T17:56:25.552198] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:56:26.057892] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-15T17:56:26.712767] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:56:26.718567] [INFO ] [REMOTE ] CRS: Full fetch complete (47462 records). [2025-09-15T17:56:26.718704] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-15T17:56:26.868029] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-15T17:56:27.102433] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-15T17:56:27.102603] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-15T17:56:27.103311] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-15T17:56:27.103371] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-15T17:56:27.104578] [DEBUG] [LOCAL ] CRS: Trimmed 47462 records to 32032 (keeping 150 days of data) [2025-09-15T17:56:27.240373] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T17:56:27.354142] [DEBUG] [LOCAL ] CRS: Primary data saved (32032 records). [2025-09-15T17:56:27.354286] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-15T17:56:27.354372] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRS took 35.5s. Estimated remaining: 3h 12m 53s. Rate: 9.5 symbols/min [2025-09-15T17:56:27.523308] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:27.558337] [DEBUG] [LOCAL ] CSTM: Loaded 35715 existing records from primary storage. [2025-09-15T17:56:27.558487] [INFO ] [MAIN ] CSTM: Loaded 35715 existing records. [2025-09-15T17:56:27.662945] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-15T17:56:27.741887] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:27.742155] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-15T17:56:27.742212] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-15T17:56:27.743019] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-15T17:56:27.743074] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-15T17:56:28.099383] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:28.139848] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T17:56:28.457883] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-15T17:56:28.495200] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:56:29.257923] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-15T17:56:29.796242] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T17:56:30.048996] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:56:30.057818] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-15T17:56:30.859097] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-15T17:56:30.862289] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:56:31.657871] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-15T17:56:31.982949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T17:56:32.457873] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-15T17:56:32.715534] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:56:33.257871] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-15T17:56:33.639357] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:56:34.057901] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-15T17:56:34.494281] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:56:34.857936] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-15T17:56:34.967734] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:56:34.969634] [INFO ] [REMOTE ] CSR: Full fetch complete (13244 records). [2025-09-15T17:56:34.969725] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-15T17:56:35.325401] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-15T17:56:35.325480] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-15T17:56:35.325789] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-15T17:56:35.325830] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-15T17:56:35.326323] [DEBUG] [LOCAL ] CSR: Trimmed 13244 records to 9476 (keeping 150 days of data) [2025-09-15T17:56:35.385546] [DEBUG] [LOCAL ] CSR: Primary data saved (9476 records). [2025-09-15T17:56:35.385713] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-15T17:56:35.385802] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CSR took 17.2s. Estimated remaining: 3h 12m 52s. Rate: 9.5 symbols/min [2025-09-15T17:56:35.551681] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:35.561694] [DEBUG] [LOCAL ] CSV: Loaded 9150 existing records from primary storage. [2025-09-15T17:56:35.561798] [INFO ] [MAIN ] CSV: Loaded 9150 existing records. [2025-09-15T17:56:35.663702] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-15T17:56:35.741991] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:35.742286] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-15T17:56:35.742334] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-15T17:56:35.742950] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-15T17:56:35.743001] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-15T17:56:36.092270] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:36.231207] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T17:56:36.457889] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-15T17:56:36.762321] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:56:36.767472] [INFO ] [REMOTE ] CSAN: Full fetch complete (45451 records). [2025-09-15T17:56:36.767579] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-15T17:56:37.139756] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-15T17:56:37.139835] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-15T17:56:37.140437] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-15T17:56:37.140478] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-15T17:56:37.141447] [DEBUG] [LOCAL ] CSAN: Trimmed 45451 records to 31174 (keeping 150 days of data) [2025-09-15T17:56:37.258060] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-15T17:56:37.329394] [DEBUG] [LOCAL ] CSAN: Primary data saved (31174 records). [2025-09-15T17:56:37.329528] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-15T17:56:37.330192] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSAN took 30.0s. Estimated remaining: 3h 12m 31s. Rate: 9.5 symbols/min [2025-09-15T17:56:37.497358] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:37.497546] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-15T17:56:37.497588] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-15T17:56:37.497724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-15T17:56:37.497764] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-15T17:56:37.497804] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-15T17:56:37.497836] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-15T17:56:37.761389] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:56:37.859611] [INFO ] [REMOTE ] CSW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:38.057873] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-15T17:56:38.240597] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:38.240974] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-15T17:56:38.553621] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:56:38.559129] [INFO ] [REMOTE ] CSL: Full fetch complete (34158 records). [2025-09-15T17:56:38.559370] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-15T17:56:38.863084] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-15T17:56:38.938615] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-15T17:56:38.938722] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-15T17:56:38.939341] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-15T17:56:38.939419] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-15T17:56:38.940296] [DEBUG] [LOCAL ] CSL: Trimmed 34158 records to 22192 (keeping 150 days of data) [2025-09-15T17:56:39.081136] [DEBUG] [LOCAL ] CSL: Primary data saved (22192 records). [2025-09-15T17:56:39.081268] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-15T17:56:39.081357] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 22.4s. Estimated remaining: 3h 12m 9s. Rate: 9.5 symbols/min [2025-09-15T17:56:39.247611] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:39.254129] [DEBUG] [LOCAL ] CTBB: Loaded 4859 existing records from primary storage. [2025-09-15T17:56:39.254211] [INFO ] [MAIN ] CTBB: Loaded 4859 existing records. [2025-09-15T17:56:39.430762] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:39.431031] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-15T17:56:39.431076] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-15T17:56:39.431367] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-15T17:56:39.431413] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-15T17:56:39.666693] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-15T17:56:39.839529] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:39.852307] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:56:39.913854] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:39.914408] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-15T17:56:40.457964] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-15T17:56:41.257866] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-15T17:56:41.426248] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:56:42.057918] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-15T17:56:42.632803] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:56:42.679620] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T17:56:42.857850] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-15T17:56:43.446165] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:56:43.657900] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-15T17:56:44.282199] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:56:44.457885] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-15T17:56:45.257940] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-15T17:56:45.461409] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:45.461711] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-15T17:56:45.714000] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:56:46.057863] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-15T17:56:46.862443] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-15T17:56:46.865302] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T17:56:47.657873] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-15T17:56:48.233278] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:56:48.371746] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:56:48.457823] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-15T17:56:48.644408] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:48.644674] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-15T17:56:49.257863] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-15T17:56:50.057897] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-15T17:56:50.247631] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T17:56:50.857894] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-15T17:56:50.865132] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:56:51.657920] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-15T17:56:51.710464] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:56:52.292298] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:56:52.457895] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-15T17:56:53.040079] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:56:53.257876] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-15T17:56:54.004672] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:56:54.057832] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-15T17:56:54.742065] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T17:56:54.857861] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-15T17:56:55.657864] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-15T17:56:55.815029] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:56:56.457855] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-15T17:56:56.560472] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:56:56.562605] [INFO ] [REMOTE ] CSV: Full fetch complete (14415 records). [2025-09-15T17:56:56.562744] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-15T17:56:56.962559] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-15T17:56:56.962429] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T17:56:56.962734] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-15T17:56:56.965341] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-15T17:56:56.965696] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-15T17:56:56.966321] [DEBUG] [LOCAL ] CSV: Trimmed 14415 records to 8876 (keeping 150 days of data) [2025-09-15T17:56:57.026213] [DEBUG] [LOCAL ] CSV: Primary data saved (8876 records). [2025-09-15T17:56:57.026384] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-15T17:56:57.026500] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSV took 21.6s. Estimated remaining: 3h 12m 42s. Rate: 9.5 symbols/min [2025-09-15T17:56:57.201230] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:57.206946] [DEBUG] [LOCAL ] CTDD: Loaded 3852 existing records from primary storage. [2025-09-15T17:56:57.207036] [INFO ] [MAIN ] CTDD: Loaded 3852 existing records. [2025-09-15T17:56:57.268178] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-15T17:56:57.384806] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:57.385062] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-15T17:56:57.385125] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-15T17:56:57.385377] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-15T17:56:57.385423] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-15T17:56:57.772697] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:57.982036] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:56:57.983369] [INFO ] [REMOTE ] CTBB: Full fetch complete (7887 records). [2025-09-15T17:56:57.983438] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-15T17:56:58.062998] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-15T17:56:58.333824] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-15T17:56:58.333905] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-15T17:56:58.334111] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-15T17:56:58.334150] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-15T17:56:58.334589] [DEBUG] [LOCAL ] CTBB: Trimmed 7887 records to 4787 (keeping 150 days of data) [2025-09-15T17:56:58.364451] [DEBUG] [LOCAL ] CTBB: Primary data saved (4787 records). [2025-09-15T17:56:58.364547] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-15T17:56:58.364626] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CTBB took 19.3s. Estimated remaining: 3h 12m 19s. Rate: 9.5 symbols/min [2025-09-15T17:56:58.531901] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:58.532083] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-15T17:56:58.532121] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-15T17:56:58.532242] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-15T17:56:58.532281] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-15T17:56:58.532321] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-15T17:56:58.532352] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-15T17:56:58.811154] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:56:58.862921] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-15T17:56:58.889886] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:59.626159] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:56:59.657877] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-15T17:57:00.392735] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:57:00.457879] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-15T17:57:01.257879] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-15T17:57:01.691707] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:01.692004] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-15T17:57:02.059902] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-15T17:57:02.065975] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:57:02.857873] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-15T17:57:03.318137] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:57:03.657922] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-15T17:57:04.457909] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-15T17:57:04.560149] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:57:04.736755] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:04.737157] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-15T17:57:04.959960] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-15T17:57:04.962338] [INFO ] [REMOTE ] CSW: Full fetch complete (7238 records). [2025-09-15T17:57:04.962417] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-15T17:57:05.145625] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 68 unique days, need 150 days [2025-09-15T17:57:05.145896] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:05.145950] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:05.145990] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-15T17:57:05.146051] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-15T17:57:05.146088] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-15T17:57:05.146130] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-15T17:57:05.146188] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSW took 27.8s. Estimated remaining: 3h 12m 14s. Rate: 9.5 symbols/min [2025-09-15T17:57:05.263067] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-15T17:57:05.322280] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:05.322483] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-15T17:57:05.322522] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-15T17:57:05.322666] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-15T17:57:05.322711] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-15T17:57:05.322758] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-15T17:57:05.322800] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-15T17:57:05.677274] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:05.888229] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:57:06.058049] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-15T17:57:06.274059] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:06.274370] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-15T17:57:06.857873] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-15T17:57:07.247096] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T17:57:07.657895] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-15T17:57:08.457937] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-15T17:57:08.488325] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:57:09.257879] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-15T17:57:09.941348] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:57:10.057849] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-15T17:57:10.124601] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:57:10.714011] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:57:10.715246] [INFO ] [REMOTE ] CTDD: Full fetch complete (6229 records). [2025-09-15T17:57:10.715316] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-15T17:57:10.865256] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-15T17:57:11.083404] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-15T17:57:11.083483] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-15T17:57:11.083692] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-15T17:57:11.083738] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-15T17:57:11.084173] [DEBUG] [LOCAL ] CTDD: Trimmed 6229 records to 3783 (keeping 150 days of data) [2025-09-15T17:57:11.108660] [DEBUG] [LOCAL ] CTDD: Primary data saved (3783 records). [2025-09-15T17:57:11.108797] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-15T17:57:11.108885] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTDD took 14.1s. Estimated remaining: 3h 12m 7s. Rate: 9.5 symbols/min [2025-09-15T17:57:11.280858] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:11.281059] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-09-15T17:57:11.281097] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-09-15T17:57:11.281248] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-15T17:57:11.281308] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-15T17:57:11.281350] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-15T17:57:11.281391] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-15T17:57:11.640398] [INFO ] [REMOTE ] CTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:11.657814] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-15T17:57:11.865677] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T17:57:12.457871] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-15T17:57:13.257924] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-15T17:57:13.337394] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:57:14.057885] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-15T17:57:14.191411] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:57:14.196933] [INFO ] [REMOTE ] CSTM: Full fetch complete (52245 records). [2025-09-15T17:57:14.197073] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-15T17:57:14.582353] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-15T17:57:14.582434] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-15T17:57:14.583098] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-15T17:57:14.583142] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-15T17:57:14.584299] [DEBUG] [LOCAL ] CSTM: Trimmed 52245 records to 34900 (keeping 150 days of data) [2025-09-15T17:57:14.654164] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:57:14.811905] [DEBUG] [LOCAL ] CSTM: Primary data saved (34900 records). [2025-09-15T17:57:14.812097] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-15T17:57:14.812219] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CSTM took 47.5s. Estimated remaining: 3h 11m 52s. Rate: 9.5 symbols/min [2025-09-15T17:57:14.866306] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-15T17:57:14.987539] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:15.014375] [DEBUG] [LOCAL ] CTOS: Loaded 27448 existing records from primary storage. [2025-09-15T17:57:15.014580] [INFO ] [MAIN ] CTOS: Loaded 27448 existing records. [2025-09-15T17:57:15.188824] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:15.189092] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-15T17:57:15.189139] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-15T17:57:15.189807] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-15T17:57:15.189864] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-15T17:57:15.544323] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:15.657864] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-15T17:57:15.760162] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:57:15.834581] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:57:16.457902] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-15T17:57:16.719683] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-15T17:57:16.975227] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:57:17.257891] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-15T17:57:18.057926] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-15T17:57:18.462243] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:57:18.857912] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-15T17:57:19.010569] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T17:57:19.657870] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-15T17:57:19.702993] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:57:19.874293] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:57:20.457917] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-15T17:57:21.207277] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:57:21.257847] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-15T17:57:22.057894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-15T17:57:22.440230] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T17:57:22.857883] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-15T17:57:23.016402] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:57:23.657888] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-15T17:57:23.955486] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:23.955849] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-15T17:57:24.018691] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:57:24.457882] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-15T17:57:25.257879] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-15T17:57:25.590416] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:57:25.593755] [INFO ] [REMOTE ] CTO: Full fetch complete (31223 records). [2025-09-15T17:57:25.593842] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-15T17:57:25.962405] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-15T17:57:25.962494] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-15T17:57:25.963235] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-15T17:57:25.963300] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-15T17:57:25.964161] [DEBUG] [LOCAL ] CTO: Trimmed 31223 records to 19381 (keeping 150 days of data) [2025-09-15T17:57:26.061089] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-15T17:57:26.100370] [DEBUG] [LOCAL ] CTO: Primary data saved (19381 records). [2025-09-15T17:57:26.100547] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-15T17:57:26.100632] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTO took 15.0s. Estimated remaining: 3h 12m 2s. Rate: 9.5 symbols/min [2025-09-15T17:57:26.286827] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:26.332073] [DEBUG] [LOCAL ] CTRA: Loaded 40394 existing records from primary storage. [2025-09-15T17:57:26.332257] [INFO ] [MAIN ] CTRA: Loaded 40394 existing records. [2025-09-15T17:57:26.523156] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:26.523427] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-15T17:57:26.523487] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-15T17:57:26.524627] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-15T17:57:26.524722] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-15T17:57:26.870312] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-15T17:57:26.912020] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:26.925965] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:57:26.960883] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:57:27.420225] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:27.420711] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-15T17:57:27.420816] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-15T17:57:27.420902] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-15T17:57:27.422264] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:57:27.422632] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:27.422720] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:27.422774] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-15T17:57:27.422842] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-15T17:57:27.422882] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-15T17:57:27.422929] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-15T17:57:27.423026] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTEST took 29.1s. Estimated remaining: 3h 11m 39s. Rate: 9.5 symbols/min [2025-09-15T17:57:27.602943] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:27.650890] [DEBUG] [LOCAL ] CTRE: Loaded 36929 existing records from primary storage. [2025-09-15T17:57:27.651073] [INFO ] [MAIN ] CTRE: Loaded 36929 existing records. [2025-09-15T17:57:27.664737] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-15T17:57:27.857066] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:27.857396] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-15T17:57:27.857462] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-15T17:57:27.858310] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-15T17:57:27.858379] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-15T17:57:28.219535] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:28.457890] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-15T17:57:29.093178] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T17:57:29.257886] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-15T17:57:30.057875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-15T17:57:30.120504] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:57:30.483494] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:57:30.655146] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:57:30.857863] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-15T17:57:31.657875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-15T17:57:32.408197] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:57:32.457957] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-15T17:57:32.483213] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T17:57:32.485797] [INFO ] [REMOTE ] CTEV: Full fetch complete (12953 records). [2025-09-15T17:57:32.485920] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-15T17:57:32.711432] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-15T17:57:32.711988] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:32.712072] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:32.712131] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-15T17:57:32.712216] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-15T17:57:32.712257] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-15T17:57:32.712299] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-15T17:57:32.712387] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTEV took 27.6s. Estimated remaining: 3h 11m 30s. Rate: 9.5 symbols/min [2025-09-15T17:57:32.936390] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:32.998586] [DEBUG] [LOCAL ] CTRI: Loaded 29300 existing records from primary storage. [2025-09-15T17:57:32.998955] [INFO ] [MAIN ] CTRI: Loaded 29300 existing records. [2025-09-15T17:57:33.264022] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-15T17:57:33.264348] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:33.266302] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-15T17:57:33.266423] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-15T17:57:33.267450] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-15T17:57:33.267535] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-15T17:57:33.721930] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:34.057903] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-15T17:57:34.307442] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:57:34.339893] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:57:34.857853] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-15T17:57:35.189707] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:57:35.657878] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-15T17:57:35.760555] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T17:57:36.457899] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-15T17:57:36.951969] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:57:37.257930] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-15T17:57:38.057927] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-15T17:57:38.097198] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T17:57:38.159662] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T17:57:38.857869] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-15T17:57:39.295592] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:57:39.299688] [INFO ] [REMOTE ] CTOS: Full fetch complete (39820 records). [2025-09-15T17:57:39.299780] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-15T17:57:39.663566] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-15T17:57:39.686209] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-15T17:57:39.686324] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-15T17:57:39.687039] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-15T17:57:39.687207] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-15T17:57:39.688705] [DEBUG] [LOCAL ] CTOS: Trimmed 39820 records to 26642 (keeping 150 days of data) [2025-09-15T17:57:39.853540] [DEBUG] [LOCAL ] CTOS: Primary data saved (26642 records). [2025-09-15T17:57:39.853711] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-15T17:57:39.853832] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 25.0s. Estimated remaining: 3h 11m 26s. Rate: 9.5 symbols/min [2025-09-15T17:57:40.028334] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:40.045003] [DEBUG] [LOCAL ] CTS: Loaded 14207 existing records from primary storage. [2025-09-15T17:57:40.045139] [INFO ] [MAIN ] CTS: Loaded 14207 existing records. [2025-09-15T17:57:40.219864] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:40.220119] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-15T17:57:40.220186] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-15T17:57:40.220545] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-15T17:57:40.220590] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-15T17:57:40.464634] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-15T17:57:40.574623] [INFO ] [REMOTE ] CTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:40.663706] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T17:57:40.695965] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:57:41.257893] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-15T17:57:41.819494] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:57:42.057899] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-15T17:57:42.439008] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:57:42.857864] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-15T17:57:43.454629] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:57:43.657926] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-15T17:57:44.442946] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:57:44.464270] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-15T17:57:44.465935] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:57:45.257871] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-15T17:57:45.834095] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:57:46.057927] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-15T17:57:46.280327] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:57:46.857933] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-15T17:57:47.333313] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:57:47.657870] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-15T17:57:48.457873] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-15T17:57:48.661103] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T17:57:48.779866] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T17:57:48.785372] [INFO ] [REMOTE ] CTRE: Full fetch complete (53477 records). [2025-09-15T17:57:48.785472] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-15T17:57:49.164955] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-15T17:57:49.165062] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-15T17:57:49.165752] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-15T17:57:49.165806] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-15T17:57:49.167168] [DEBUG] [LOCAL ] CTRE: Trimmed 53477 records to 36257 (keeping 150 days of data) [2025-09-15T17:57:49.263213] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-15T17:57:49.413315] [DEBUG] [LOCAL ] CTRE: Primary data saved (36257 records). [2025-09-15T17:57:49.413457] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-15T17:57:49.413996] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRE took 22.0s. Estimated remaining: 3h 11m 30s. Rate: 9.5 symbols/min [2025-09-15T17:57:49.579730] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:49.618833] [DEBUG] [LOCAL ] CTVA: Loaded 40082 existing records from primary storage. [2025-09-15T17:57:49.618970] [INFO ] [MAIN ] CTVA: Loaded 40082 existing records. [2025-09-15T17:57:49.814478] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:49.816053] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:57:49.823480] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-15T17:57:49.823890] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-15T17:57:49.825176] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-15T17:57:49.825232] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-15T17:57:50.067940] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-15T17:57:50.179750] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:50.659407] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:57:50.862921] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-15T17:57:50.871216] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:57:51.657925] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-15T17:57:52.457914] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-15T17:57:52.719548] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T17:57:52.725797] [INFO ] [REMOTE ] CTRA: Full fetch complete (58329 records). [2025-09-15T17:57:52.726011] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-15T17:57:52.834328] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:57:53.128878] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-15T17:57:53.128969] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-15T17:57:53.129692] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-15T17:57:53.129738] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-15T17:57:53.131080] [DEBUG] [LOCAL ] CTRA: Trimmed 58329 records to 39612 (keeping 150 days of data) [2025-09-15T17:57:53.258468] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-15T17:57:53.391625] [DEBUG] [LOCAL ] CTRA: Primary data saved (39612 records). [2025-09-15T17:57:53.391816] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-15T17:57:53.392679] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRA took 27.3s. Estimated remaining: 3h 11m 16s. Rate: 9.5 symbols/min [2025-09-15T17:57:53.564559] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:53.564772] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-15T17:57:53.564814] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-15T17:57:53.564942] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-15T17:57:53.564981] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-15T17:57:53.565022] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-15T17:57:53.565054] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-15T17:57:53.932765] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:53.963612] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:57:54.057894] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-15T17:57:54.595880] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:57:54.857876] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-15T17:57:55.547463] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:57:55.657868] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-15T17:57:55.846515] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T17:57:56.101812] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:57:56.457869] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-15T17:57:57.210996] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:57:57.257822] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-15T17:57:58.057909] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-15T17:57:58.301121] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:57:58.309329] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T17:57:58.857881] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-15T17:57:59.657904] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-15T17:57:59.983868] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-15T17:58:00.462704] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-15T17:58:00.467841] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:58:00.806254] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T17:58:01.257874] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-15T17:58:01.874114] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T17:58:02.057848] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-15T17:58:02.857888] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-15T17:58:03.112454] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:58:03.114931] [INFO ] [REMOTE ] CTS: Full fetch complete (20645 records). [2025-09-15T17:58:03.115010] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-15T17:58:03.475521] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-15T17:58:03.475606] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-15T17:58:03.476072] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-15T17:58:03.476118] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-15T17:58:03.476791] [DEBUG] [LOCAL ] CTS: Trimmed 20645 records to 13778 (keeping 150 days of data) [2025-09-15T17:58:03.561250] [DEBUG] [LOCAL ] CTS: Primary data saved (13778 records). [2025-09-15T17:58:03.561389] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-15T17:58:03.561485] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTS took 23.7s. Estimated remaining: 3h 11m 23s. Rate: 9.5 symbols/min [2025-09-15T17:58:03.662834] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-15T17:58:03.733392] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:03.770822] [DEBUG] [LOCAL ] CUBE: Loaded 38219 existing records from primary storage. [2025-09-15T17:58:03.770982] [INFO ] [MAIN ] CUBE: Loaded 38219 existing records. [2025-09-15T17:58:03.946793] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:03.947001] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-15T17:58:03.947053] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-15T17:58:03.947963] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-15T17:58:03.948014] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-15T17:58:04.334013] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:04.348388] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T17:58:04.353890] [INFO ] [REMOTE ] CTRI: Full fetch complete (39693 records). [2025-09-15T17:58:04.353972] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-15T17:58:04.462920] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-15T17:58:04.725395] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-15T17:58:04.725472] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-15T17:58:04.726048] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-15T17:58:04.726091] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-15T17:58:04.726968] [DEBUG] [LOCAL ] CTRI: Trimmed 39693 records to 29026 (keeping 150 days of data) [2025-09-15T17:58:04.901588] [DEBUG] [LOCAL ] CTRI: Primary data saved (29026 records). [2025-09-15T17:58:04.901745] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-15T17:58:04.901830] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTRI took 32.2s. Estimated remaining: 3h 11m 0s. Rate: 9.5 symbols/min [2025-09-15T17:58:05.074031] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:05.093069] [DEBUG] [LOCAL ] CUBI: Loaded 20046 existing records from primary storage. [2025-09-15T17:58:05.093194] [INFO ] [MAIN ] CUBI: Loaded 20046 existing records. [2025-09-15T17:58:05.268290] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-15T17:58:05.273637] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:05.274722] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-15T17:58:05.274786] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-15T17:58:05.275374] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-15T17:58:05.275485] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-15T17:58:05.544512] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-15T17:58:05.638082] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:05.667375] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T17:58:05.929844] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:58:06.057840] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-15T17:58:06.419493] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T17:58:06.857883] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-15T17:58:07.657891] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-15T17:58:07.977881] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:58:08.457918] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-15T17:58:08.825025] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T17:58:08.825875] [INFO ] [REMOTE ] CUBB: Full fetch complete (737 records). [2025-09-15T17:58:08.825950] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-15T17:58:09.006571] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 138 unique days, need 150 days [2025-09-15T17:58:09.006846] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:58:09.006905] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:58:09.006951] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-15T17:58:09.007088] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-15T17:58:09.007130] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-15T17:58:09.007297] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-15T17:58:09.007366] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CUBB took 15.6s. Estimated remaining: 3h 10m 47s. Rate: 9.5 symbols/min [2025-09-15T17:58:09.137101] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T17:58:09.221547] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:09.258544] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-15T17:58:09.260117] [DEBUG] [LOCAL ] CUK: Loaded 38115 existing records from primary storage. [2025-09-15T17:58:09.260198] [INFO ] [MAIN ] CUK: Loaded 38115 existing records. [2025-09-15T17:58:09.437235] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:09.437505] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-15T17:58:09.437554] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-15T17:58:09.438322] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-15T17:58:09.438373] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-15T17:58:09.790659] [INFO ] [REMOTE ] CUK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:10.057954] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-15T17:58:10.832278] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:58:10.857818] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-15T17:58:11.391717] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:58:11.657873] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-15T17:58:12.458195] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-15T17:58:12.461260] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:58:12.683495] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T17:58:13.257923] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-15T17:58:13.833797] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:58:14.057893] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-15T17:58:14.857914] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-15T17:58:15.105412] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T17:58:15.657988] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-15T17:58:15.966499] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T17:58:16.432277] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:58:16.457834] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-15T17:58:17.257952] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-15T17:58:17.517054] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:58:17.605536] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T17:58:18.057893] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-15T17:58:18.378095] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:58:18.857877] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-15T17:58:19.385000] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:58:19.657883] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-15T17:58:20.472466] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-15T17:58:20.504484] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:58:21.040157] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:58:21.257873] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-15T17:58:22.057844] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-15T17:58:22.190761] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:58:22.857897] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-15T17:58:23.091842] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:58:23.619223] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:58:23.657826] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-15T17:58:24.391201] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:58:24.396935] [INFO ] [REMOTE ] CTVA: Full fetch complete (57836 records). [2025-09-15T17:58:24.397033] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-15T17:58:24.462934] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-15T17:58:24.773859] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-15T17:58:24.774038] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-15T17:58:24.774806] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-15T17:58:24.774862] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-15T17:58:24.781327] [DEBUG] [LOCAL ] CTVA: Trimmed 57836 records to 39324 (keeping 150 days of data) [2025-09-15T17:58:24.790922] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:58:24.859953] [INFO ] [REMOTE ] CUBE: Full fetch complete (54949 records). [2025-09-15T17:58:24.860157] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-15T17:58:25.263884] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-15T17:58:25.644456] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-15T17:58:25.650485] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-15T17:58:25.657407] [DEBUG] [LOCAL ] CTVA: Primary data saved (39324 records). [2025-09-15T17:58:25.657615] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-15T17:58:25.658054] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTVA took 36.2s. Estimated remaining: 3h 11m 14s. Rate: 9.5 symbols/min [2025-09-15T17:58:25.680183] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-15T17:58:25.707934] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-15T17:58:25.761147] [DEBUG] [LOCAL ] CUBE: Trimmed 54949 records to 37556 (keeping 150 days of data) [2025-09-15T17:58:26.130897] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:26.176377] [DEBUG] [LOCAL ] CULP: Loaded 2034 existing records from primary storage. [2025-09-15T17:58:26.177259] [INFO ] [MAIN ] CULP: Loaded 2034 existing records. [2025-09-15T17:58:26.316715] [DEBUG] [LOCAL ] CUBE: Primary data saved (37556 records). [2025-09-15T17:58:26.327880] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-15T17:58:26.340345] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBE took 22.8s. Estimated remaining: 3h 10m 49s. Rate: 9.5 symbols/min [2025-09-15T17:58:26.444078] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:26.537018] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T17:58:26.549562] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-15T17:58:26.555870] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-15T17:58:26.576606] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-15T17:58:26.603724] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-15T17:58:26.623807] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-15T17:58:26.623737] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:26.909672] [DEBUG] [LOCAL ] CURB: Loaded 23951 existing records from primary storage. [2025-09-15T17:58:26.921809] [INFO ] [MAIN ] CURB: Loaded 23951 existing records. [2025-09-15T17:58:27.093617] [INFO ] [REMOTE ] CULP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:27.113560] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-15T17:58:27.134596] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T17:58:27.226548] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:27.226827] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-15T17:58:27.226877] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-15T17:58:27.227441] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-15T17:58:27.227494] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-15T17:58:27.584831] [INFO ] [REMOTE ] CURB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:27.657900] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-15T17:58:27.718660] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:58:28.311881] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:58:28.317611] [INFO ] [REMOTE ] CUK: Full fetch complete (55539 records). [2025-09-15T17:58:28.317751] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-15T17:58:28.470059] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-15T17:58:28.716983] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-15T17:58:28.717081] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-15T17:58:28.717823] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-15T17:58:28.717987] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-15T17:58:28.732047] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:58:28.736858] [DEBUG] [LOCAL ] CUK: Trimmed 55539 records to 37358 (keeping 150 days of data) [2025-09-15T17:58:28.947829] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T17:58:28.968514] [DEBUG] [LOCAL ] CUK: Primary data saved (37358 records). [2025-09-15T17:58:28.968689] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-15T17:58:28.968775] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUK took 20.0s. Estimated remaining: 3h 10m 31s. Rate: 9.5 symbols/min [2025-09-15T17:58:29.135152] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:29.155787] [DEBUG] [LOCAL ] CURV: Loaded 19974 existing records from primary storage. [2025-09-15T17:58:29.155945] [INFO ] [MAIN ] CURV: Loaded 19974 existing records. [2025-09-15T17:58:29.259146] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-15T17:58:29.339569] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:29.339864] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-15T17:58:29.339922] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-15T17:58:29.340513] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-15T17:58:29.340569] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-15T17:58:29.693210] [INFO ] [REMOTE ] CURV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:30.057888] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-15T17:58:30.365392] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:58:30.468614] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:58:30.857893] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-15T17:58:31.657905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-15T17:58:32.015043] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:58:32.457889] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-15T17:58:32.936587] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:58:33.106264] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:58:33.257893] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-15T17:58:34.057900] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-15T17:58:34.408245] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:58:34.858343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:58:34.858482] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-15T17:58:35.320394] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T17:58:35.657956] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-15T17:58:36.457896] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-15T17:58:36.788063] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T17:58:37.257902] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-15T17:58:37.732161] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:58:38.057913] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-15T17:58:38.303255] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:58:38.608994] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T17:58:38.857881] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-15T17:58:39.657884] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-15T17:58:39.803117] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:58:40.100022] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:58:40.457872] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-15T17:58:40.897239] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:58:41.257866] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-15T17:58:41.836315] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:58:41.837276] [INFO ] [REMOTE ] CULP: Full fetch complete (3333 records). [2025-09-15T17:58:41.837343] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-15T17:58:42.065793] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-15T17:58:42.193727] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-15T17:58:42.193805] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-15T17:58:42.193926] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-15T17:58:42.193964] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-15T17:58:42.194335] [DEBUG] [LOCAL ] CULP: Trimmed 3333 records to 1982 (keeping 150 days of data) [2025-09-15T17:58:42.206110] [DEBUG] [LOCAL ] CULP: Primary data saved (1982 records). [2025-09-15T17:58:42.206169] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-15T17:58:42.206238] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CULP took 16.5s. Estimated remaining: 3h 10m 47s. Rate: 9.5 symbols/min [2025-09-15T17:58:42.857872] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-15T17:58:43.396135] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:58:43.657899] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-15T17:58:43.809565] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:58:43.813178] [INFO ] [REMOTE ] CUBI: Full fetch complete (29050 records). [2025-09-15T17:58:43.813262] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-15T17:58:44.191939] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-15T17:58:44.192152] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-15T17:58:44.192660] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-15T17:58:44.192704] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-15T17:58:44.193501] [DEBUG] [LOCAL ] CUBI: Trimmed 29050 records to 19575 (keeping 150 days of data) [2025-09-15T17:58:44.311854] [DEBUG] [LOCAL ] CUBI: Primary data saved (19575 records). [2025-09-15T17:58:44.312024] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-15T17:58:44.312150] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUBI took 39.4s. Estimated remaining: 3h 10m 27s. Rate: 9.5 symbols/min [2025-09-15T17:58:44.457877] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-15T17:58:44.842956] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:58:45.257930] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-15T17:58:45.756774] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:58:46.057925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-15T17:58:46.600252] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T17:58:46.857905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-15T17:58:47.094949] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:58:47.657865] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-15T17:58:47.790207] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:58:48.457857] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-15T17:58:48.488456] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T17:58:49.257919] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-15T17:58:49.763853] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:58:49.767714] [INFO ] [REMOTE ] CURB: Full fetch complete (35549 records). [2025-09-15T17:58:49.767796] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-15T17:58:50.165458] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-15T17:58:50.165631] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-15T17:58:50.166668] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-15T17:58:50.166742] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-15T17:58:50.173721] [DEBUG] [LOCAL ] CURB: Trimmed 35549 records to 23402 (keeping 150 days of data) [2025-09-15T17:58:50.182211] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:58:50.187158] [INFO ] [REMOTE ] CURV: Full fetch complete (28525 records). [2025-09-15T17:58:50.187313] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-15T17:58:50.666750] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-15T17:58:50.667844] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-15T17:58:50.669675] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-15T17:58:50.669959] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-15T17:58:50.676155] [DEBUG] [LOCAL ] CURV: Trimmed 28525 records to 19728 (keeping 150 days of data) [2025-09-15T17:58:50.794119] [DEBUG] [LOCAL ] CURB: Primary data saved (23402 records). [2025-09-15T17:58:50.795303] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-15T17:58:50.795837] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURB took 24.4s. Estimated remaining: 3h 10m 22s. Rate: 9.5 symbols/min [2025-09-15T17:58:50.824555] [DEBUG] [LOCAL ] CURV: Primary data saved (19728 records). [2025-09-15T17:58:50.824726] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-15T17:58:50.824824] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURV took 21.9s. Estimated remaining: 3h 9m 55s. Rate: 9.5 symbols/min [2025-09-15T17:58:51.368222] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.516905] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.470920] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.551108] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.588389] [DEBUG] [LOCAL ] CVEO: Loaded 11781 existing records from primary storage. [2025-09-15T17:58:51.588702] [INFO ] [MAIN ] CVEO: Loaded 11781 existing records. [2025-09-15T17:58:51.739552] [DEBUG] [LOCAL ] CVE: Loaded 40314 existing records from primary storage. [2025-09-15T17:58:51.755194] [DEBUG] [LOCAL ] CVI: Loaded 34598 existing records from primary storage. [2025-09-15T17:58:51.756087] [DEBUG] [LOCAL ] CUZ: Loaded 37222 existing records from primary storage. [2025-09-15T17:58:51.756259] [INFO ] [MAIN ] CUZ: Loaded 37222 existing records. [2025-09-15T17:58:51.756202] [INFO ] [MAIN ] CVE: Loaded 40314 existing records. [2025-09-15T17:58:51.761620] [INFO ] [MAIN ] CVI: Loaded 34598 existing records. [2025-09-15T17:58:52.158257] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.274521] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.319959] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-15T17:58:52.366124] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.405080] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.460516] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.460743] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.460614] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.460931] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-15T17:58:52.461061] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.461110] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-15T17:58:52.461197] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-15T17:58:52.461277] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-15T17:58:52.460831] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-15T17:58:52.468686] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-15T17:58:52.473884] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-15T17:58:52.474076] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-15T17:58:52.493691] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-15T17:58:52.483366] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-15T17:58:52.526708] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-15T17:58:53.830231] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.814999] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.877839] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-15T17:58:53.886008] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-15T17:58:53.938411] [INFO ] [REMOTE ] CVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.960564] [INFO ] [REMOTE ] CVE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.961490] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-15T17:58:53.960938] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-15T17:58:54.561824] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:58:54.564789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-15T17:58:55.439115] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:58:55.447700] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-15T17:58:55.485607] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:58:55.489612] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-15T17:58:55.567389] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:58:55.662412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-15T17:58:55.667729] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:58:56.118490] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T17:58:56.457912] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-15T17:58:56.715352] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T17:58:56.755348] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:58:57.257911] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-15T17:58:58.057832] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-15T17:58:58.163664] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:58:58.437781] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:58:58.862974] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-15T17:58:58.871906] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T17:58:59.657936] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-15T17:59:00.457931] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-15T17:59:00.710831] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T17:59:00.994540] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:59:01.257879] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-15T17:59:01.404032] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:59:02.057913] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-15T17:59:02.455195] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:59:02.857928] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-15T17:59:03.657895] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-15T17:59:03.772635] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:59:04.306054] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:59:04.457883] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-15T17:59:04.699020] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:59:05.257898] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-15T17:59:06.057875] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-15T17:59:06.186416] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T17:59:06.589838] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T17:59:06.857881] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-15T17:59:07.657922] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-15T17:59:07.932024] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:59:08.457895] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-15T17:59:08.538978] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:59:08.612808] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:59:09.257886] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-15T17:59:09.877116] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:59:09.879221] [INFO ] [REMOTE ] CVEO: Full fetch complete (16868 records). [2025-09-15T17:59:09.879290] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-15T17:59:10.058858] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-15T17:59:10.196983] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:59:10.284892] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-15T17:59:10.284969] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-15T17:59:10.285364] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-15T17:59:10.285415] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-15T17:59:10.285955] [DEBUG] [LOCAL ] CVEO: Trimmed 16868 records to 11679 (keeping 150 days of data) [2025-09-15T17:59:10.354229] [DEBUG] [LOCAL ] CVEO: Primary data saved (11679 records). [2025-09-15T17:59:10.354368] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-15T17:59:10.354486] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVEO took 19.5s. Estimated remaining: 3h 10m 31s. Rate: 9.5 symbols/min [2025-09-15T17:59:10.522161] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:10.534883] [DEBUG] [LOCAL ] CVLG: Loaded 11706 existing records from primary storage. [2025-09-15T17:59:10.535005] [INFO ] [MAIN ] CVLG: Loaded 11706 existing records. [2025-09-15T17:59:10.714154] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:10.714480] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-15T17:59:10.714544] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-15T17:59:10.715000] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-15T17:59:10.715050] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-15T17:59:10.863006] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-15T17:59:11.070518] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:11.537969] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:59:11.657848] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-15T17:59:12.457876] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-15T17:59:12.682441] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:59:12.758583] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:59:13.257889] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-15T17:59:13.637375] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:59:13.643138] [INFO ] [REMOTE ] CUZ: Full fetch complete (53419 records). [2025-09-15T17:59:13.643240] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-15T17:59:14.017612] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-15T17:59:14.017708] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-15T17:59:14.018383] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-15T17:59:14.018426] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-15T17:59:14.019471] [DEBUG] [LOCAL ] CUZ: Trimmed 53419 records to 36592 (keeping 150 days of data) [2025-09-15T17:59:14.074522] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-15T17:59:14.250119] [DEBUG] [LOCAL ] CUZ: Primary data saved (36592 records). [2025-09-15T17:59:14.250280] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-15T17:59:14.250375] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CUZ took 23.4s. Estimated remaining: 3h 10m 17s. Rate: 9.5 symbols/min [2025-09-15T17:59:14.421541] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:14.459800] [DEBUG] [LOCAL ] CVNA: Loaded 39897 existing records from primary storage. [2025-09-15T17:59:14.459935] [INFO ] [MAIN ] CVNA: Loaded 39897 existing records. [2025-09-15T17:59:14.635000] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:14.635279] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-15T17:59:14.635386] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-15T17:59:14.636271] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-15T17:59:14.636323] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-15T17:59:14.866381] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-15T17:59:14.997213] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:15.006789] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T17:59:15.012114] [INFO ] [REMOTE ] CVI: Full fetch complete (50274 records). [2025-09-15T17:59:15.012206] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-15T17:59:15.388206] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-15T17:59:15.388328] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-15T17:59:15.389171] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-15T17:59:15.389232] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-15T17:59:15.390662] [DEBUG] [LOCAL ] CVI: Trimmed 50274 records to 33984 (keeping 150 days of data) [2025-09-15T17:59:15.511921] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T17:59:15.534139] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T17:59:15.656804] [DEBUG] [LOCAL ] CVI: Primary data saved (33984 records). [2025-09-15T17:59:15.657001] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-15T17:59:15.657124] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVI took 24.8s. Estimated remaining: 3h 9m 55s. Rate: 9.5 symbols/min [2025-09-15T17:59:15.663129] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-15T17:59:15.830742] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:15.871459] [DEBUG] [LOCAL ] CVS: Loaded 40438 existing records from primary storage. [2025-09-15T17:59:15.871629] [INFO ] [MAIN ] CVS: Loaded 40438 existing records. [2025-09-15T17:59:16.048095] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:16.048372] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-15T17:59:16.048418] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-15T17:59:16.049289] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-15T17:59:16.049351] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-15T17:59:16.405671] [INFO ] [REMOTE ] CVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:16.457850] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-15T17:59:17.257894] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-15T17:59:17.488484] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:59:18.057834] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-15T17:59:18.179775] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T17:59:18.857891] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-15T17:59:18.968419] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:59:18.974511] [INFO ] [REMOTE ] CVE: Full fetch complete (58231 records). [2025-09-15T17:59:18.974718] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-15T17:59:19.367171] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-15T17:59:19.367258] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-15T17:59:19.367989] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-15T17:59:19.368076] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-15T17:59:19.370920] [DEBUG] [LOCAL ] CVE: Trimmed 58231 records to 39534 (keeping 150 days of data) [2025-09-15T17:59:19.507999] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:59:19.633101] [DEBUG] [LOCAL ] CVE: Primary data saved (39534 records). [2025-09-15T17:59:19.633247] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-15T17:59:19.633341] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 28.8s. Estimated remaining: 3h 9m 41s. Rate: 9.5 symbols/min [2025-09-15T17:59:19.665389] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-15T17:59:19.807848] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:19.850506] [DEBUG] [LOCAL ] CVX: Loaded 40500 existing records from primary storage. [2025-09-15T17:59:19.850665] [INFO ] [MAIN ] CVX: Loaded 40500 existing records. [2025-09-15T17:59:20.031496] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:20.031780] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-15T17:59:20.031842] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-15T17:59:20.032780] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-15T17:59:20.032832] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-15T17:59:20.388796] [INFO ] [REMOTE ] CVX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:20.444944] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-15T17:59:20.457810] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-15T17:59:21.257884] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-15T17:59:21.555245] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:59:22.057868] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-15T17:59:22.378496] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:59:22.841457] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:59:22.857813] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-15T17:59:23.657908] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-15T17:59:23.973260] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:59:24.457941] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-15T17:59:25.045166] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T17:59:25.257861] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-15T17:59:25.668391] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:59:26.057880] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-15T17:59:26.596485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T17:59:26.857890] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-15T17:59:27.161162] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:59:27.461014] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T17:59:27.657907] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-15T17:59:28.457935] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-15T17:59:28.551167] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:59:28.692537] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:59:29.257874] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-15T17:59:29.853508] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:59:30.057870] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-15T17:59:30.161737] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:59:30.857947] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-15T17:59:31.657882] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-15T17:59:31.775407] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T17:59:32.091465] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T17:59:32.457947] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-15T17:59:33.257945] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-15T17:59:33.984449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:59:34.059328] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-15T17:59:34.065749] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:59:34.308127] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-15T17:59:34.857873] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-15T17:59:35.657906] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-15T17:59:35.698926] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:59:35.700720] [INFO ] [REMOTE ] CVLG: Full fetch complete (16182 records). [2025-09-15T17:59:35.700823] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-15T17:59:36.074802] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-15T17:59:36.074979] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-15T17:59:36.075423] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-15T17:59:36.075481] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-15T17:59:36.076256] [DEBUG] [LOCAL ] CVLG: Trimmed 16182 records to 11290 (keeping 150 days of data) [2025-09-15T17:59:36.170573] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T17:59:36.197650] [DEBUG] [LOCAL ] CVLG: Primary data saved (11290 records). [2025-09-15T17:59:36.197789] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-15T17:59:36.197915] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 25.8s. Estimated remaining: 3h 10m 8s. Rate: 9.5 symbols/min [2025-09-15T17:59:36.368409] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:36.388363] [DEBUG] [LOCAL ] CW: Loaded 16960 existing records from primary storage. [2025-09-15T17:59:36.388486] [INFO ] [MAIN ] CW: Loaded 16960 existing records. [2025-09-15T17:59:36.462959] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-15T17:59:36.565859] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:36.566136] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-15T17:59:36.566187] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-15T17:59:36.566713] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-15T17:59:36.566769] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-15T17:59:36.926242] [INFO ] [REMOTE ] CW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:37.257969] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-15T17:59:37.930579] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-15T17:59:38.054401] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:59:38.060171] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-15T17:59:38.063246] [INFO ] [REMOTE ] CVS: Full fetch complete (58378 records). [2025-09-15T17:59:38.063559] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-15T17:59:38.542956] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-15T17:59:38.543066] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-15T17:59:38.543888] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-15T17:59:38.543966] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-15T17:59:38.561051] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:59:38.566882] [DEBUG] [LOCAL ] CVS: Trimmed 58378 records to 39658 (keeping 150 days of data) [2025-09-15T17:59:38.831429] [DEBUG] [LOCAL ] CVS: Primary data saved (39658 records). [2025-09-15T17:59:38.831700] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-15T17:59:38.832496] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVS took 23.2s. Estimated remaining: 3h 9m 50s. Rate: 9.5 symbols/min [2025-09-15T17:59:38.864276] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-15T17:59:39.006739] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:39.058680] [DEBUG] [LOCAL ] CWAN: Loaded 39593 existing records from primary storage. [2025-09-15T17:59:39.058827] [INFO ] [MAIN ] CWAN: Loaded 39593 existing records. [2025-09-15T17:59:39.235747] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:39.236000] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-15T17:59:39.236055] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-15T17:59:39.236869] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-15T17:59:39.236917] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-15T17:59:39.600811] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:39.657871] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-15T17:59:39.706121] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:59:40.457875] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-15T17:59:41.061906] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T17:59:41.222492] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:59:41.257822] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-15T17:59:41.501216] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:59:42.057891] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-15T17:59:42.804517] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:59:42.857825] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-15T17:59:43.474496] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:59:43.480376] [INFO ] [REMOTE ] CVNA: Full fetch complete (57717 records). [2025-09-15T17:59:43.480488] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-15T17:59:43.658762] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-15T17:59:43.869544] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-15T17:59:43.869632] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-15T17:59:43.870360] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-15T17:59:43.870404] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-15T17:59:43.871744] [DEBUG] [LOCAL ] CVNA: Trimmed 57717 records to 39119 (keeping 150 days of data) [2025-09-15T17:59:44.122564] [DEBUG] [LOCAL ] CVNA: Primary data saved (39119 records). [2025-09-15T17:59:44.122734] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-15T17:59:44.122839] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVNA took 29.9s. Estimated remaining: 3h 9m 40s. Rate: 9.5 symbols/min [2025-09-15T17:59:44.299701] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:44.335779] [DEBUG] [LOCAL ] CWEN: Loaded 33419 existing records from primary storage. [2025-09-15T17:59:44.335921] [INFO ] [MAIN ] CWEN: Loaded 33419 existing records. [2025-09-15T17:59:44.462850] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-15T17:59:44.530665] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:44.531684] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-15T17:59:44.532040] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-15T17:59:44.543505] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-15T17:59:44.560801] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-15T17:59:44.598191] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:59:44.941411] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:44.957327] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:59:45.257874] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-15T17:59:46.057849] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-15T17:59:46.546538] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T17:59:46.683372] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:59:46.857877] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-15T17:59:47.309342] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:59:47.657877] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-15T17:59:47.763990] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T17:59:48.457876] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-15T17:59:48.743630] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:59:49.257893] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-15T17:59:49.980842] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:59:50.057872] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-15T17:59:50.756543] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:59:50.857847] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-15T17:59:51.657948] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-15T17:59:51.913226] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:59:51.982176] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-15T17:59:51.989195] [INFO ] [REMOTE ] CVX: Full fetch complete (58440 records). [2025-09-15T17:59:51.989425] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-15T17:59:52.380807] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-15T17:59:52.380898] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-15T17:59:52.381660] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-15T17:59:52.381727] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-15T17:59:52.382997] [DEBUG] [LOCAL ] CVX: Trimmed 58440 records to 39720 (keeping 150 days of data) [2025-09-15T17:59:52.482374] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-15T17:59:52.631906] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:59:52.675928] [DEBUG] [LOCAL ] CVX: Primary data saved (39720 records). [2025-09-15T17:59:52.676099] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-15T17:59:52.677429] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVX took 33.0s. Estimated remaining: 3h 9m 41s. Rate: 9.5 symbols/min [2025-09-15T17:59:52.859899] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:52.902387] [DEBUG] [LOCAL ] CWH: Loaded 38864 existing records from primary storage. [2025-09-15T17:59:52.902562] [INFO ] [MAIN ] CWH: Loaded 38864 existing records. [2025-09-15T17:59:53.081963] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:53.082228] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-15T17:59:53.082274] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-15T17:59:53.083226] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-15T17:59:53.083278] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-15T17:59:53.268178] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-15T17:59:53.433717] [INFO ] [REMOTE ] CWH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:53.582050] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:59:54.057901] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-15T17:59:54.857904] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-15T17:59:55.113990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T17:59:55.404236] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:59:55.657872] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-15T17:59:55.949045] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:59:56.457923] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-15T17:59:56.653091] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:59:57.257900] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-15T17:59:57.888819] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T17:59:58.038080] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:59:58.057824] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-15T17:59:58.821411] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:59:58.823909] [INFO ] [REMOTE ] CW: Full fetch complete (25634 records). [2025-09-15T17:59:58.823978] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-15T17:59:58.863137] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-15T17:59:59.190730] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-15T17:59:59.190830] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-15T17:59:59.191293] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-15T17:59:59.191332] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-15T17:59:59.192116] [DEBUG] [LOCAL ] CW: Trimmed 25634 records to 16766 (keeping 150 days of data) [2025-09-15T17:59:59.304281] [DEBUG] [LOCAL ] CW: Primary data saved (16766 records). [2025-09-15T17:59:59.304458] [INFO ] [MAIN ] CW: Full history saved. [2025-09-15T17:59:59.304570] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 23.1s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-15T17:59:59.471977] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:59.516149] [DEBUG] [LOCAL ] CWK: Loaded 37114 existing records from primary storage. [2025-09-15T17:59:59.516287] [INFO ] [MAIN ] CWK: Loaded 37114 existing records. [2025-09-15T17:59:59.665351] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-15T17:59:59.729143] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:59.729956] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-15T17:59:59.730005] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-15T17:59:59.730732] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-15T17:59:59.730779] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-15T18:00:00.087328] [INFO ] [REMOTE ] CWK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:00.143304] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:00:00.457910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-15T18:00:01.257929] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-15T18:00:01.515868] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T18:00:02.057875] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-15T18:00:02.340428] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:00:02.857831] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-15T18:00:03.301565] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:00:03.657932] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-15T18:00:04.341321] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:00:04.457936] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-15T18:00:05.257894] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-15T18:00:05.896409] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-15T18:00:06.064885] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-15T18:00:06.067831] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:00:06.472041] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-15T18:00:06.479293] [INFO ] [REMOTE ] CWAN: Full fetch complete (56808 records). [2025-09-15T18:00:06.479488] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-15T18:00:06.865988] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-15T18:00:06.865830] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-15T18:00:06.866222] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-15T18:00:06.879583] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-15T18:00:06.880502] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-15T18:00:06.881775] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:00:06.887484] [INFO ] [REMOTE ] CWEN: Full fetch complete (48956 records). [2025-09-15T18:00:06.887632] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-15T18:00:06.888102] [DEBUG] [LOCAL ] CWAN: Trimmed 56808 records to 38857 (keeping 150 days of data) [2025-09-15T18:00:07.401429] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-15T18:00:07.405500] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-15T18:00:07.409883] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-15T18:00:07.412514] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-15T18:00:07.418755] [DEBUG] [LOCAL ] CWEN: Trimmed 48956 records to 32791 (keeping 150 days of data) [2025-09-15T18:00:07.639690] [DEBUG] [LOCAL ] CWAN: Primary data saved (38857 records). [2025-09-15T18:00:07.644745] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-15T18:00:07.645982] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 28.8s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-15T18:00:07.893927] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:07.918296] [DEBUG] [LOCAL ] CWEN: Primary data saved (32791 records). [2025-09-15T18:00:07.918672] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-15T18:00:07.918781] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 23.8s. Estimated remaining: 3h 9m 10s. Rate: 9.5 symbols/min [2025-09-15T18:00:08.046184] [DEBUG] [LOCAL ] CWT: Loaded 20471 existing records from primary storage. [2025-09-15T18:00:08.062026] [INFO ] [MAIN ] CWT: Loaded 20471 existing records. [2025-09-15T18:00:08.192042] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:08.337509] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:08.341144] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-15T18:00:08.338540] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-15T18:00:08.351256] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-15T18:00:08.355429] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-15T18:00:08.355873] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-15T18:00:08.405728] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-15T18:00:08.565784] [DEBUG] [LOCAL ] CX: Loaded 39740 existing records from primary storage. [2025-09-15T18:00:08.616691] [INFO ] [MAIN ] CX: Loaded 39740 existing records. [2025-09-15T18:00:08.857331] [INFO ] [REMOTE ] CWT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:08.857936] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-15T18:00:08.926669] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:08.927104] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-15T18:00:08.927158] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-15T18:00:08.960931] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-15T18:00:08.964097] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-15T18:00:09.064334] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:00:09.262949] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-15T18:00:09.327099] [INFO ] [REMOTE ] CX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:10.031882] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:00:10.057871] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-15T18:00:10.308708] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:00:10.857901] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-15T18:00:11.095965] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:00:11.245625] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:00:11.657860] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-15T18:00:12.002275] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:00:12.457954] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-15T18:00:13.257947] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-15T18:00:13.347281] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:00:13.850354] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:00:13.855781] [INFO ] [REMOTE ] CWH: Full fetch complete (55405 records). [2025-09-15T18:00:13.855884] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-15T18:00:14.065173] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-15T18:00:14.248897] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-15T18:00:14.248983] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-15T18:00:14.249722] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-15T18:00:14.249837] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-15T18:00:14.251035] [DEBUG] [LOCAL ] CWH: Trimmed 55405 records to 38060 (keeping 150 days of data) [2025-09-15T18:00:14.485975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:00:14.515770] [DEBUG] [LOCAL ] CWH: Primary data saved (38060 records). [2025-09-15T18:00:14.515934] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-15T18:00:14.516423] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 21.8s. Estimated remaining: 3h 9m 5s. Rate: 9.5 symbols/min [2025-09-15T18:00:14.690891] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:14.699056] [DEBUG] [LOCAL ] CXE: Loaded 4713 existing records from primary storage. [2025-09-15T18:00:14.699195] [INFO ] [MAIN ] CXE: Loaded 4713 existing records. [2025-09-15T18:00:14.862045] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-15T18:00:14.889003] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:14.889279] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-15T18:00:14.889354] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-15T18:00:14.889681] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-15T18:00:14.889732] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-15T18:00:15.244572] [INFO ] [REMOTE ] CXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:15.657893] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-15T18:00:16.457872] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-15T18:00:16.590031] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-15T18:00:16.860314] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:00:17.260625] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-15T18:00:17.265158] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T18:00:18.057959] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-15T18:00:18.506225] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-15T18:00:18.553572] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:00:18.857935] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-15T18:00:19.172719] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:00:19.631166] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:00:19.657825] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-15T18:00:20.114051] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T18:00:20.457875] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-15T18:00:20.869422] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:00:21.257873] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-15T18:00:22.057859] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-15T18:00:22.383104] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:00:22.435041] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:00:22.857873] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-15T18:00:23.657899] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-15T18:00:24.090834] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:00:24.144274] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:00:24.457881] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-15T18:00:25.257927] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-15T18:00:25.533287] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:00:25.536617] [INFO ] [REMOTE ] CWT: Full fetch complete (30654 records). [2025-09-15T18:00:25.536773] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-15T18:00:25.854276] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:00:25.919457] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-15T18:00:25.919537] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-15T18:00:25.920041] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-15T18:00:25.920084] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-15T18:00:25.920982] [DEBUG] [LOCAL ] CWT: Trimmed 30654 records to 20038 (keeping 150 days of data) [2025-09-15T18:00:26.045715] [DEBUG] [LOCAL ] CWT: Primary data saved (20038 records). [2025-09-15T18:00:26.045844] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-15T18:00:26.045926] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWT took 18.4s. Estimated remaining: 3h 9m 15s. Rate: 9.5 symbols/min [2025-09-15T18:00:26.066377] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-15T18:00:26.225265] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:26.230787] [DEBUG] [LOCAL ] CXH: Loaded 3883 existing records from primary storage. [2025-09-15T18:00:26.230870] [INFO ] [MAIN ] CXH: Loaded 3883 existing records. [2025-09-15T18:00:26.407354] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:26.407660] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-15T18:00:26.407712] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-15T18:00:26.408031] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-15T18:00:26.408079] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-15T18:00:26.768700] [INFO ] [REMOTE ] CXH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:26.857873] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-15T18:00:26.883564] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:00:26.885375] [INFO ] [REMOTE ] CXE: Full fetch complete (8080 records). [2025-09-15T18:00:26.885456] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-15T18:00:27.252748] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-15T18:00:27.252898] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-15T18:00:27.253112] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-15T18:00:27.253152] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-15T18:00:27.253719] [DEBUG] [LOCAL ] CXE: Trimmed 8080 records to 4647 (keeping 150 days of data) [2025-09-15T18:00:27.287451] [DEBUG] [LOCAL ] CXE: Primary data saved (4647 records). [2025-09-15T18:00:27.287630] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-15T18:00:27.287805] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXE took 12.8s. Estimated remaining: 3h 8m 53s. Rate: 9.5 symbols/min [2025-09-15T18:00:27.394933] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T18:00:27.467754] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:27.500500] [DEBUG] [LOCAL ] CXM: Loaded 35801 existing records from primary storage. [2025-09-15T18:00:27.500687] [INFO ] [MAIN ] CXM: Loaded 35801 existing records. [2025-09-15T18:00:27.657942] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-15T18:00:27.680347] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:27.680608] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-15T18:00:27.680680] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-15T18:00:27.681480] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-15T18:00:27.681531] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-15T18:00:28.038927] [INFO ] [REMOTE ] CXM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:28.457885] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-15T18:00:28.746870] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T18:00:29.257911] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-15T18:00:30.057967] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-15T18:00:30.341129] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:00:30.646117] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T18:00:30.857924] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-15T18:00:31.412655] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:00:31.657924] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-15T18:00:32.302720] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:00:32.457874] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-15T18:00:32.888003] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:00:33.257911] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-15T18:00:34.057901] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-15T18:00:34.157686] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:00:34.732387] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:00:34.737696] [INFO ] [REMOTE ] CWK: Full fetch complete (53265 records). [2025-09-15T18:00:34.737792] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-15T18:00:34.738556] [FATAL] [VALIDATOR ] CWK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:00:34.738637] [FATAL] [MAIN ] CWK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:00:34.738696] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:00:34.738766] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-15T18:00:34.738837] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-09-15T18:00:34.738882] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-09-15T18:00:34.739281] [DEBUG] [LOCAL ] CWK: Deleted derivative data file. [2025-09-15T18:00:34.741059] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWK took 35.4s. Estimated remaining: 3h 8m 50s. Rate: 9.5 symbols/min [2025-09-15T18:00:34.863057] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-15T18:00:34.919273] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:34.947338] [DEBUG] [LOCAL ] CXT: Loaded 22501 existing records from primary storage. [2025-09-15T18:00:34.947553] [INFO ] [MAIN ] CXT: Loaded 22501 existing records. [2025-09-15T18:00:35.135985] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:35.136337] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-15T18:00:35.136391] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-15T18:00:35.137161] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-15T18:00:35.137217] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-15T18:00:35.499728] [INFO ] [REMOTE ] CXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:35.657904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-15T18:00:35.845402] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:00:36.109167] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T18:00:36.266012] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:00:36.457869] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-15T18:00:37.054100] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:00:37.257880] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-15T18:00:38.057888] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-15T18:00:38.442244] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:00:38.716807] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:00:38.857871] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-15T18:00:39.663666] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-15T18:00:39.665363] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:00:40.457881] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-15T18:00:40.852421] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:00:41.257863] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-15T18:00:41.709831] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:00:41.802935] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:00:42.057841] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-15T18:00:42.857879] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-15T18:00:43.384476] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:00:43.479058] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:00:43.480457] [INFO ] [REMOTE ] CXH: Full fetch complete (4611 records). [2025-09-15T18:00:43.480536] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-15T18:00:43.662961] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-15T18:00:43.864991] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-15T18:00:43.865097] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-15T18:00:43.865240] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-15T18:00:43.865280] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-15T18:00:43.865749] [DEBUG] [LOCAL ] CXH: Trimmed 4611 records to 3905 (keeping 150 days of data) [2025-09-15T18:00:43.890206] [DEBUG] [LOCAL ] CXH: Primary data saved (3905 records). [2025-09-15T18:00:43.890359] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-15T18:00:43.890465] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 17.8s. Estimated remaining: 3h 8m 52s. Rate: 9.5 symbols/min [2025-09-15T18:00:44.082571] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:44.123267] [DEBUG] [LOCAL ] CXW: Loaded 33263 existing records from primary storage. [2025-09-15T18:00:44.123434] [INFO ] [MAIN ] CXW: Loaded 33263 existing records. [2025-09-15T18:00:44.305315] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:44.305601] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-15T18:00:44.305665] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-15T18:00:44.306376] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-15T18:00:44.306425] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-15T18:00:44.462944] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-15T18:00:44.687954] [INFO ] [REMOTE ] CXW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:45.237116] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:00:45.243165] [INFO ] [REMOTE ] CX: Full fetch complete (57448 records). [2025-09-15T18:00:45.243289] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-15T18:00:45.264625] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-15T18:00:45.639673] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-15T18:00:45.639804] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-15T18:00:45.640707] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-15T18:00:45.640878] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-15T18:00:45.642248] [DEBUG] [LOCAL ] CX: Trimmed 57448 records to 38965 (keeping 150 days of data) [2025-09-15T18:00:45.762446] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T18:00:45.920595] [DEBUG] [LOCAL ] CX: Primary data saved (38965 records). [2025-09-15T18:00:45.920792] [INFO ] [MAIN ] CX: Full history saved. [2025-09-15T18:00:45.920944] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 38.0s. Estimated remaining: 3h 8m 33s. Rate: 9.5 symbols/min [2025-09-15T18:00:46.065395] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-15T18:00:46.098171] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:46.119089] [DEBUG] [LOCAL ] CYD: Loaded 19326 existing records from primary storage. [2025-09-15T18:00:46.119244] [INFO ] [MAIN ] CYD: Loaded 19326 existing records. [2025-09-15T18:00:46.299334] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:46.299775] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-15T18:00:46.299879] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-15T18:00:46.300482] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-15T18:00:46.300547] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-15T18:00:46.485252] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:00:46.701104] [INFO ] [REMOTE ] CYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:46.857909] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-15T18:00:47.488566] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:00:47.494811] [INFO ] [REMOTE ] CXM: Full fetch complete (52007 records). [2025-09-15T18:00:47.494989] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-15T18:00:47.658935] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-15T18:00:47.892356] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:00:47.912816] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-15T18:00:47.912888] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-15T18:00:47.913599] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-15T18:00:47.913667] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-15T18:00:47.914744] [DEBUG] [LOCAL ] CXM: Trimmed 52007 records to 35117 (keeping 150 days of data) [2025-09-15T18:00:48.127490] [DEBUG] [LOCAL ] CXM: Primary data saved (35117 records). [2025-09-15T18:00:48.127691] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-15T18:00:48.127785] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 20.8s. Estimated remaining: 3h 8m 14s. Rate: 9.5 symbols/min [2025-09-15T18:00:48.297974] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:48.336886] [DEBUG] [LOCAL ] CYH: Loaded 36354 existing records from primary storage. [2025-09-15T18:00:48.337028] [INFO ] [MAIN ] CYH: Loaded 36354 existing records. [2025-09-15T18:00:48.463101] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-15T18:00:48.518156] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:48.518473] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-15T18:00:48.518522] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-15T18:00:48.519256] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-15T18:00:48.519306] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-15T18:00:48.867212] [INFO ] [REMOTE ] CYH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:49.004319] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:00:49.257929] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-15T18:00:49.495083] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:00:50.057915] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-15T18:00:50.547454] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:00:50.857885] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-15T18:00:51.587898] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T18:00:51.657875] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-15T18:00:51.722413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:00:52.457899] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-15T18:00:52.547797] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:00:53.257949] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-15T18:00:53.868511] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:00:54.057910] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-15T18:00:54.797125] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T18:00:54.857844] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-15T18:00:55.590843] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:00:55.657924] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-15T18:00:56.435329] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:00:56.457834] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-15T18:00:56.551694] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:00:57.257874] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-15T18:00:57.641400] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:00:58.057872] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-15T18:00:58.188239] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T18:00:58.857884] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-15T18:00:59.616803] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:00:59.657814] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-15T18:01:00.457921] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-15T18:01:00.485684] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T18:01:01.252760] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:01:01.262350] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-15T18:01:01.655475] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:01:02.057912] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-15T18:01:02.172892] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:01:02.857894] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-15T18:01:03.657919] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-15T18:01:03.745161] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:01:04.331214] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:01:04.401348] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T18:01:04.457905] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-15T18:01:05.257853] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-15T18:01:05.625917] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:01:06.057962] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-15T18:01:06.857958] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-15T18:01:06.981061] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:01:07.263281] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:01:07.657966] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-15T18:01:07.991625] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:01:08.457965] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-15T18:01:08.969801] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:01:08.973884] [INFO ] [REMOTE ] CXT: Full fetch complete (33987 records). [2025-09-15T18:01:08.973982] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-15T18:01:09.267521] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-15T18:01:09.365204] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-15T18:01:09.365320] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-15T18:01:09.366086] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-15T18:01:09.366152] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-15T18:01:09.367352] [DEBUG] [LOCAL ] CXT: Trimmed 33987 records to 22071 (keeping 150 days of data) [2025-09-15T18:01:09.518999] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:01:09.524196] [INFO ] [REMOTE ] CYD: Full fetch complete (29007 records). [2025-09-15T18:01:09.524798] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-15T18:01:09.920839] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-15T18:01:09.921620] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-15T18:01:09.922899] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-15T18:01:09.923632] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-15T18:01:09.927018] [DEBUG] [LOCAL ] CYD: Trimmed 29007 records to 18953 (keeping 150 days of data) [2025-09-15T18:01:10.047707] [DEBUG] [LOCAL ] CXT: Primary data saved (22071 records). [2025-09-15T18:01:10.051326] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-15T18:01:10.051962] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 35.3s. Estimated remaining: 3h 8m 56s. Rate: 9.5 symbols/min [2025-09-15T18:01:10.067495] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-15T18:01:10.174176] [DEBUG] [LOCAL ] CYD: Primary data saved (18953 records). [2025-09-15T18:01:10.174420] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-15T18:01:10.174883] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CYD took 24.3s. Estimated remaining: 3h 8m 30s. Rate: 9.5 symbols/min [2025-09-15T18:01:10.320629] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:10.432787] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:10.443863] [DEBUG] [LOCAL ] DAC: Loaded 9159 existing records from primary storage. [2025-09-15T18:01:10.444073] [INFO ] [MAIN ] DAC: Loaded 9159 existing records. [2025-09-15T18:01:10.649254] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:10.650367] [DEBUG] [LOCAL ] D: Loaded 40397 existing records from primary storage. [2025-09-15T18:01:10.650676] [INFO ] [MAIN ] D: Loaded 40397 existing records. [2025-09-15T18:01:10.650619] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-15T18:01:10.650773] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-15T18:01:10.730470] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-15T18:01:10.740750] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-15T18:01:10.917763] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:10.951998] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-15T18:01:10.994531] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-15T18:01:11.104715] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-15T18:01:11.106358] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T18:01:11.106490] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-15T18:01:11.171040] [INFO ] [REMOTE ] CYH: Full fetch complete (52732 records). [2025-09-15T18:01:11.176800] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-15T18:01:11.408627] [INFO ] [REMOTE ] DAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:11.462554] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-15T18:01:11.908877] [INFO ] [REMOTE ] D: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:11.909246] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-15T18:01:11.999008] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-15T18:01:11.999096] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-15T18:01:11.999832] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-15T18:01:11.999882] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-15T18:01:12.002710] [DEBUG] [LOCAL ] CYH: Trimmed 52732 records to 35531 (keeping 150 days of data) [2025-09-15T18:01:12.125466] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:01:12.135459] [INFO ] [REMOTE ] CXW: Full fetch complete (49046 records). [2025-09-15T18:01:12.136159] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-15T18:01:12.627356] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-15T18:01:12.627796] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-15T18:01:12.632065] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-15T18:01:12.632946] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-15T18:01:12.634993] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:01:12.641699] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-15T18:01:12.643237] [DEBUG] [LOCAL ] CXW: Trimmed 49046 records to 32561 (keeping 150 days of data) [2025-09-15T18:01:12.655154] [DEBUG] [LOCAL ] CYH: Primary data saved (35531 records). [2025-09-15T18:01:12.655367] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-15T18:01:12.656262] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYH took 24.5s. Estimated remaining: 3h 8m 12s. Rate: 9.5 symbols/min [2025-09-15T18:01:12.926157] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:13.040676] [DEBUG] [LOCAL ] DAL: Loaded 40493 existing records from primary storage. [2025-09-15T18:01:13.041932] [INFO ] [MAIN ] DAL: Loaded 40493 existing records. [2025-09-15T18:01:13.126820] [DEBUG] [LOCAL ] CXW: Primary data saved (32561 records). [2025-09-15T18:01:13.153826] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-15T18:01:13.154552] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. CXW took 29.3s. Estimated remaining: 3h 7m 48s. Rate: 9.5 symbols/min [2025-09-15T18:01:13.335050] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:13.344891] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-15T18:01:13.345017] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-15T18:01:13.365699] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-15T18:01:13.380575] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-15T18:01:13.442912] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:13.660794] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T18:01:13.686606] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-15T18:01:13.849655] [DEBUG] [LOCAL ] DAN: Loaded 36951 existing records from primary storage. [2025-09-15T18:01:13.875122] [INFO ] [REMOTE ] DAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:13.884516] [INFO ] [MAIN ] DAN: Loaded 36951 existing records. [2025-09-15T18:01:13.990548] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T18:01:14.071458] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-15T18:01:14.075803] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:14.076765] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-15T18:01:14.076834] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-15T18:01:14.077693] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-15T18:01:14.077756] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-15T18:01:14.427747] [INFO ] [REMOTE ] DAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:14.738935] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:01:14.857949] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-15T18:01:15.657858] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-15T18:01:15.721899] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:01:15.971995] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:01:16.457933] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-15T18:01:17.182053] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:01:17.257933] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-15T18:01:18.057861] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-15T18:01:18.096471] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:01:18.382275] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T18:01:18.857897] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-15T18:01:19.657914] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-15T18:01:19.754243] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:01:20.457854] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-15T18:01:20.885410] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T18:01:21.020475] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:01:21.204828] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:01:21.257821] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-15T18:01:22.057887] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-15T18:01:22.497212] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:01:22.857974] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-15T18:01:23.657965] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-15T18:01:23.753900] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:01:24.092536] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T18:01:24.457934] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-15T18:01:24.857142] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:01:25.257931] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-15T18:01:26.057924] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-15T18:01:26.341104] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:01:26.857834] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-15T18:01:27.335316] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T18:01:27.657900] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-15T18:01:28.114051] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:01:28.457919] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-15T18:01:28.575481] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:01:29.257864] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-15T18:01:29.395282] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:01:29.615893] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:01:30.057883] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-15T18:01:30.857887] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-15T18:01:31.027751] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:01:31.657898] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-15T18:01:32.263332] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-15T18:01:32.448445] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:01:32.457807] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-15T18:01:32.628017] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:01:32.633561] [INFO ] [REMOTE ] DAN: Full fetch complete (53319 records). [2025-09-15T18:01:32.633696] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-15T18:01:33.016386] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-15T18:01:33.016480] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-15T18:01:33.017231] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-15T18:01:33.017305] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-15T18:01:33.018506] [DEBUG] [LOCAL ] DAN: Trimmed 53319 records to 36208 (keeping 150 days of data) [2025-09-15T18:01:33.248806] [DEBUG] [LOCAL ] DAN: Primary data saved (36208 records). [2025-09-15T18:01:33.249046] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-15T18:01:33.249157] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 20.1s. Estimated remaining: 3h 8m 24s. Rate: 9.5 symbols/min [2025-09-15T18:01:33.262966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-15T18:01:33.359079] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T18:01:33.381755] [INFO ] [REMOTE ] DAC: Full fetch complete (14203 records). [2025-09-15T18:01:33.432572] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:33.432891] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-15T18:01:33.434406] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:33.434533] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:33.434609] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:33.434708] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-15T18:01:33.434806] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-15T18:01:33.434865] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-15T18:01:33.435263] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-15T18:01:33.435451] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. DAC took 23.2s. Estimated remaining: 3h 7m 59s. Rate: 9.5 symbols/min [2025-09-15T18:01:33.549917] [DEBUG] [LOCAL ] DAO: Loaded 13641 existing records from primary storage. [2025-09-15T18:01:33.555786] [INFO ] [MAIN ] DAO: Loaded 13641 existing records. [2025-09-15T18:01:33.728149] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:33.806700] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:33.806993] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-15T18:01:33.807833] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-15T18:01:33.808190] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-15T18:01:33.808237] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-15T18:01:33.987170] [DEBUG] [LOCAL ] DAR: Loaded 39024 existing records from primary storage. [2025-09-15T18:01:34.001767] [INFO ] [MAIN ] DAR: Loaded 39024 existing records. [2025-09-15T18:01:34.070087] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-15T18:01:34.357127] [INFO ] [REMOTE ] DAO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:34.377441] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:34.377782] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-15T18:01:34.377831] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-15T18:01:34.378858] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-15T18:01:34.378910] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-15T18:01:34.732030] [INFO ] [REMOTE ] DAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:34.747179] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:01:34.752875] [INFO ] [REMOTE ] D: Full fetch complete (57935 records). [2025-09-15T18:01:34.752989] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-15T18:01:34.753629] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:34.753728] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:34.753766] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:34.753813] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-15T18:01:34.753873] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-15T18:01:34.753908] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-09-15T18:01:34.754199] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-09-15T18:01:34.754314] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 24.7s. Estimated remaining: 3h 7m 37s. Rate: 9.5 symbols/min [2025-09-15T18:01:34.862932] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-15T18:01:34.926489] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:34.964328] [DEBUG] [LOCAL ] DAVA: Loaded 30679 existing records from primary storage. [2025-09-15T18:01:34.964494] [INFO ] [MAIN ] DAVA: Loaded 30679 existing records. [2025-09-15T18:01:35.142175] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:35.142426] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-15T18:01:35.142472] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-15T18:01:35.143456] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-15T18:01:35.143511] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-15T18:01:35.497786] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:35.657870] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-15T18:01:35.988186] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:01:36.096716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T18:01:36.457866] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-15T18:01:37.064010] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:01:37.257867] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-15T18:01:37.367606] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:01:38.057871] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-15T18:01:38.743172] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:01:38.857882] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-15T18:01:39.253811] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:01:39.657878] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-15T18:01:39.905008] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:01:40.457865] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-15T18:01:40.663787] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:01:41.257864] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-15T18:01:41.717041] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:01:42.057924] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-15T18:01:42.857906] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-15T18:01:43.356218] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T18:01:43.415796] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-15T18:01:43.641046] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:01:43.657820] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-15T18:01:44.457886] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-15T18:01:44.792628] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T18:01:45.257912] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-15T18:01:45.805414] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:01:45.812498] [INFO ] [REMOTE ] DAL: Full fetch complete (58043 records). [2025-09-15T18:01:45.812690] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-15T18:01:45.813564] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:45.813698] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:45.813752] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:45.813804] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-15T18:01:45.813896] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-09-15T18:01:45.813948] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-09-15T18:01:45.814271] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-09-15T18:01:45.815539] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAL took 33.2s. Estimated remaining: 3h 7m 45s. Rate: 9.5 symbols/min [2025-09-15T18:01:45.997853] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:46.037598] [DEBUG] [LOCAL ] DAY: Loaded 37479 existing records from primary storage. [2025-09-15T18:01:46.037791] [INFO ] [MAIN ] DAY: Loaded 37479 existing records. [2025-09-15T18:01:46.063208] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-15T18:01:46.229735] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:46.229985] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-15T18:01:46.230033] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-15T18:01:46.230934] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-15T18:01:46.230988] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-15T18:01:46.589859] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:46.857876] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-15T18:01:46.983679] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T18:01:47.616137] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:01:47.657822] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-15T18:01:48.160365] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:01:48.457878] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-15T18:01:48.599197] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:01:49.257890] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-15T18:01:49.815901] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:01:50.057902] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-15T18:01:50.365931] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:01:50.857963] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-15T18:01:51.532988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:01:51.657874] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-15T18:01:51.818303] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:01:52.457876] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-15T18:01:53.206895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:01:53.257825] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-15T18:01:54.058673] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-15T18:01:54.062208] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:01:54.857882] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-15T18:01:55.016221] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:01:55.099777] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:01:55.102360] [INFO ] [REMOTE ] DAO: Full fetch complete (24676 records). [2025-09-15T18:01:55.102447] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-15T18:01:55.487626] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-15T18:01:55.487725] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-15T18:01:55.488254] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-15T18:01:55.488320] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-15T18:01:55.489005] [DEBUG] [LOCAL ] DAO: Trimmed 24676 records to 13357 (keeping 150 days of data) [2025-09-15T18:01:55.565547] [DEBUG] [LOCAL ] DAO: Primary data saved (13357 records). [2025-09-15T18:01:55.565697] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-15T18:01:55.565792] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 22.3s. Estimated remaining: 3h 7m 49s. Rate: 9.5 symbols/min [2025-09-15T18:01:55.667187] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-15T18:01:55.739350] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:55.775997] [DEBUG] [LOCAL ] DB: Loaded 39472 existing records from primary storage. [2025-09-15T18:01:55.776141] [INFO ] [MAIN ] DB: Loaded 39472 existing records. [2025-09-15T18:01:55.951238] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:55.951517] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-15T18:01:55.951583] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-15T18:01:55.952506] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-15T18:01:55.952569] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-15T18:01:56.308445] [INFO ] [REMOTE ] DB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:56.462933] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-15T18:01:56.478676] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:01:57.073068] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:01:57.079362] [INFO ] [REMOTE ] DAVA: Full fetch complete (43381 records). [2025-09-15T18:01:57.079520] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-15T18:01:57.261462] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-15T18:01:57.487594] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-15T18:01:57.487689] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-15T18:01:57.488283] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-15T18:01:57.488323] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-15T18:01:57.490193] [DEBUG] [LOCAL ] DAVA: Trimmed 43381 records to 30318 (keeping 150 days of data) [2025-09-15T18:01:57.673709] [DEBUG] [LOCAL ] DAVA: Primary data saved (30318 records). [2025-09-15T18:01:57.673874] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-15T18:01:57.673987] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 22.9s. Estimated remaining: 3h 7m 30s. Rate: 9.5 symbols/min [2025-09-15T18:01:57.849461] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:57.868177] [DEBUG] [LOCAL ] DBD: Loaded 18458 existing records from primary storage. [2025-09-15T18:01:57.868308] [INFO ] [MAIN ] DBD: Loaded 18458 existing records. [2025-09-15T18:01:58.044286] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:58.044581] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-15T18:01:58.044630] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-15T18:01:58.045148] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-15T18:01:58.045202] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-15T18:01:58.076437] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-15T18:01:58.403784] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:58.435453] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:01:58.839172] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:01:58.857831] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-15T18:01:59.657879] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-15T18:01:59.773896] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:02:00.052020] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:02:00.457852] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-15T18:02:00.608911] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T18:02:01.257883] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-15T18:02:02.057884] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-15T18:02:02.157996] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:02:02.270790] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:02:02.857900] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-15T18:02:03.526794] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:02:03.657900] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-15T18:02:04.383595] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:02:04.389237] [INFO ] [REMOTE ] DAR: Full fetch complete (55942 records). [2025-09-15T18:02:04.389362] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-15T18:02:04.390139] [FATAL] [VALIDATOR ] DAR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:02:04.390226] [FATAL] [MAIN ] DAR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:02:04.390266] [WARN ] [MAIN ] DAR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:02:04.390307] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-15T18:02:04.390367] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-15T18:02:04.390405] [INFO ] [LOCAL ] DAR: Starting deletion of derivative data. [2025-09-15T18:02:04.390714] [DEBUG] [LOCAL ] DAR: Deleted derivative data file. [2025-09-15T18:02:04.390801] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 31.0s. Estimated remaining: 3h 7m 25s. Rate: 9.5 symbols/min [2025-09-15T18:02:04.462972] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-15T18:02:04.572132] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:04.609267] [DEBUG] [LOCAL ] DBI: Loaded 33452 existing records from primary storage. [2025-09-15T18:02:04.609417] [INFO ] [MAIN ] DBI: Loaded 33452 existing records. [2025-09-15T18:02:04.787203] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:04.787486] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-15T18:02:04.787538] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-15T18:02:04.788304] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-15T18:02:04.788368] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-15T18:02:05.163262] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:05.249485] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T18:02:05.260516] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-15T18:02:05.935813] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:02:06.057877] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-15T18:02:06.827205] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T18:02:06.857838] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-15T18:02:07.657844] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-15T18:02:08.049084] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:02:08.054436] [INFO ] [REMOTE ] DAY: Full fetch complete (54493 records). [2025-09-15T18:02:08.054534] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-15T18:02:08.461987] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-15T18:02:08.481199] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-15T18:02:08.481301] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-15T18:02:08.482052] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-15T18:02:08.482193] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-15T18:02:08.509027] [DEBUG] [LOCAL ] DAY: Trimmed 54493 records to 36701 (keeping 150 days of data) [2025-09-15T18:02:08.510383] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:02:08.748058] [DEBUG] [LOCAL ] DAY: Primary data saved (36701 records). [2025-09-15T18:02:08.748441] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-15T18:02:08.749029] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 22.9s. Estimated remaining: 3h 7m 13s. Rate: 9.5 symbols/min [2025-09-15T18:02:08.924211] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:08.940410] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T18:02:08.952293] [DEBUG] [LOCAL ] DBL: Loaded 7122 existing records from primary storage. [2025-09-15T18:02:08.952443] [INFO ] [MAIN ] DBL: Loaded 7122 existing records. [2025-09-15T18:02:09.127295] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:09.127570] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-15T18:02:09.127619] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-15T18:02:09.128050] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-15T18:02:09.128100] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-15T18:02:09.263108] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-15T18:02:09.511373] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:10.057899] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-15T18:02:10.329034] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T18:02:10.831854] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:02:10.857874] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-15T18:02:11.045836] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T18:02:11.251215] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:02:11.657895] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-15T18:02:12.457879] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-15T18:02:13.257894] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-15T18:02:13.297125] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:02:14.056245] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:02:14.058553] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-15T18:02:14.197227] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T18:02:14.857892] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-15T18:02:15.052898] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:02:15.233338] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T18:02:15.657898] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-15T18:02:16.462971] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-15T18:02:16.474065] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:02:17.257873] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-15T18:02:18.057279] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:02:18.064831] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-15T18:02:18.069965] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:02:18.857849] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-15T18:02:18.901099] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:02:19.657906] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-15T18:02:19.687813] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:02:20.457925] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-15T18:02:21.257881] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-15T18:02:21.464597] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:02:21.499355] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T18:02:22.052722] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:02:22.057814] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-15T18:02:22.857916] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-15T18:02:23.244956] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:02:23.657946] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-15T18:02:23.807281] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:02:23.810156] [INFO ] [REMOTE ] DBD: Full fetch complete (24926 records). [2025-09-15T18:02:23.810269] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-15T18:02:23.810838] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:02:23.810933] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:02:23.810978] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:02:23.811025] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-15T18:02:23.811093] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-15T18:02:23.811130] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-15T18:02:23.811622] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-09-15T18:02:23.811731] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBD took 26.1s. Estimated remaining: 3h 7m 33s. Rate: 9.5 symbols/min [2025-09-15T18:02:23.986366] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:24.023433] [DEBUG] [LOCAL ] DBRG: Loaded 37419 existing records from primary storage. [2025-09-15T18:02:24.023584] [INFO ] [MAIN ] DBRG: Loaded 37419 existing records. [2025-09-15T18:02:24.206159] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:24.206411] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-15T18:02:24.206458] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-15T18:02:24.207307] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-15T18:02:24.207357] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-15T18:02:24.462953] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-15T18:02:24.506224] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:02:24.573168] [INFO ] [REMOTE ] DBL: Full fetch complete (9857 records). [2025-09-15T18:02:24.578779] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:24.579677] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-15T18:02:24.952536] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-15T18:02:24.952622] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-15T18:02:24.952886] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-15T18:02:24.952927] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-15T18:02:24.953362] [DEBUG] [LOCAL ] DBL: Trimmed 9857 records to 7034 (keeping 150 days of data) [2025-09-15T18:02:24.996833] [DEBUG] [LOCAL ] DBL: Primary data saved (7034 records). [2025-09-15T18:02:24.996947] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-15T18:02:24.997030] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBL took 16.2s. Estimated remaining: 3h 7m 11s. Rate: 9.5 symbols/min [2025-09-15T18:02:25.167849] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:25.195904] [DEBUG] [LOCAL ] DCI: Loaded 27720 existing records from primary storage. [2025-09-15T18:02:25.196107] [INFO ] [MAIN ] DCI: Loaded 27720 existing records. [2025-09-15T18:02:25.263247] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-15T18:02:25.381216] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:25.381468] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-15T18:02:25.381514] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-15T18:02:25.382196] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-15T18:02:25.382249] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-15T18:02:25.743469] [INFO ] [REMOTE ] DCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:26.057881] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-15T18:02:26.648558] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T18:02:26.857904] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-15T18:02:26.930577] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:02:27.470302] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:02:27.657898] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-15T18:02:28.395575] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:02:28.402185] [INFO ] [REMOTE ] DB: Full fetch complete (57068 records). [2025-09-15T18:02:28.402387] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-15T18:02:28.468790] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-15T18:02:28.793228] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-15T18:02:28.793331] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-15T18:02:28.794117] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-15T18:02:28.794177] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-15T18:02:28.795482] [DEBUG] [LOCAL ] DB: Trimmed 57068 records to 38694 (keeping 150 days of data) [2025-09-15T18:02:29.065806] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:02:29.083494] [DEBUG] [LOCAL ] DB: Primary data saved (38694 records). [2025-09-15T18:02:29.083708] [INFO ] [MAIN ] DB: Full history saved. [2025-09-15T18:02:29.084855] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 33.5s. Estimated remaining: 3h 6m 58s. Rate: 9.5 symbols/min [2025-09-15T18:02:29.263605] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:29.263735] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-15T18:02:29.278062] [DEBUG] [LOCAL ] DCO: Loaded 10870 existing records from primary storage. [2025-09-15T18:02:29.278204] [INFO ] [MAIN ] DCO: Loaded 10870 existing records. [2025-09-15T18:02:29.466502] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:29.466782] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-15T18:02:29.466842] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-15T18:02:29.467239] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-15T18:02:29.467286] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-15T18:02:29.843053] [INFO ] [REMOTE ] DCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:30.046463] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:02:30.051993] [INFO ] [REMOTE ] DBI: Full fetch complete (49344 records). [2025-09-15T18:02:30.052142] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-15T18:02:30.063776] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-15T18:02:30.444245] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-15T18:02:30.444348] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-15T18:02:30.445151] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-15T18:02:30.445201] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-15T18:02:30.446374] [DEBUG] [LOCAL ] DBI: Trimmed 49344 records to 32715 (keeping 150 days of data) [2025-09-15T18:02:30.651462] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:02:30.679574] [DEBUG] [LOCAL ] DBI: Primary data saved (32715 records). [2025-09-15T18:02:30.679751] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-15T18:02:30.679850] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 26.3s. Estimated remaining: 3h 6m 38s. Rate: 9.5 symbols/min [2025-09-15T18:02:30.853139] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:30.857853] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-15T18:02:30.892543] [DEBUG] [LOCAL ] DD: Loaded 39762 existing records from primary storage. [2025-09-15T18:02:30.892711] [INFO ] [MAIN ] DD: Loaded 39762 existing records. [2025-09-15T18:02:31.079055] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:31.079323] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-15T18:02:31.079371] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-15T18:02:31.080193] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-15T18:02:31.080244] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-15T18:02:31.444254] [INFO ] [REMOTE ] DD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:31.657882] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-15T18:02:31.712675] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:02:32.457846] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-15T18:02:32.520063] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:02:32.552882] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:02:33.257897] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-15T18:02:33.809219] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:02:33.858425] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:02:34.057898] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-15T18:02:34.857907] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-15T18:02:35.455943] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:02:35.664577] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-15T18:02:35.667082] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:02:36.457878] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-15T18:02:37.263574] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-15T18:02:37.276191] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T18:02:37.982080] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:02:38.027190] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T18:02:38.057874] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-15T18:02:38.857882] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-15T18:02:39.256293] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:02:39.657867] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-15T18:02:40.457866] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-15T18:02:41.257953] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-15T18:02:41.543348] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-15T18:02:41.856230] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:02:42.043950] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:02:42.057819] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-15T18:02:42.150212] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-15T18:02:42.858006] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-15T18:02:43.505869] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:02:43.657889] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-15T18:02:44.457918] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-15T18:02:44.763063] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:02:45.197472] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:02:45.257913] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-15T18:02:46.057877] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-15T18:02:46.175951] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:02:46.482623] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:02:46.863373] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-15T18:02:46.865210] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:02:47.658146] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-15T18:02:48.215277] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:02:48.220309] [INFO ] [REMOTE ] DCI: Full fetch complete (40888 records). [2025-09-15T18:02:48.220433] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-15T18:02:48.463029] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-15T18:02:48.585241] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T18:02:48.621438] [INFO ] [REMOTE ] DCO: Full fetch complete (14574 records). [2025-09-15T18:02:48.621680] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-15T18:02:48.621775] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-15T18:02:48.621836] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-15T18:02:48.622707] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-15T18:02:48.638690] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-15T18:02:48.733940] [DEBUG] [LOCAL ] DCI: Trimmed 40888 records to 27192 (keeping 150 days of data) [2025-09-15T18:02:49.094372] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-15T18:02:49.094659] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-15T18:02:49.096894] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-15T18:02:49.097861] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-15T18:02:49.104822] [DEBUG] [LOCAL ] DCO: Trimmed 14574 records to 10699 (keeping 150 days of data) [2025-09-15T18:02:49.220517] [DEBUG] [LOCAL ] DCO: Primary data saved (10699 records). [2025-09-15T18:02:49.221939] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-15T18:02:49.222733] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DCO took 20.1s. Estimated remaining: 3h 7m 8s. Rate: 9.5 symbols/min [2025-09-15T18:02:49.268018] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-15T18:02:49.335878] [DEBUG] [LOCAL ] DCI: Primary data saved (27192 records). [2025-09-15T18:02:49.341566] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-15T18:02:49.352061] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DCI took 24.4s. Estimated remaining: 3h 6m 43s. Rate: 9.5 symbols/min [2025-09-15T18:02:49.494082] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:49.596945] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:49.630005] [DEBUG] [LOCAL ] DDL: Loaded 26209 existing records from primary storage. [2025-09-15T18:02:49.641465] [INFO ] [MAIN ] DDL: Loaded 26209 existing records. [2025-09-15T18:02:49.697881] [DEBUG] [LOCAL ] DDD: Loaded 38100 existing records from primary storage. [2025-09-15T18:02:49.712071] [INFO ] [MAIN ] DDD: Loaded 38100 existing records. [2025-09-15T18:02:49.957682] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:50.016975] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-15T18:02:50.020367] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:50.020552] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-15T18:02:50.020945] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-15T18:02:50.021014] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-15T18:02:50.021502] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-15T18:02:50.021572] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-15T18:02:50.026930] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-15T18:02:50.060558] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-15T18:02:50.367333] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:02:50.508106] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-15T18:02:50.759226] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:50.827380] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:50.866858] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-15T18:02:50.875829] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:02:51.657843] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-15T18:02:51.677293] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:02:51.682739] [INFO ] [REMOTE ] DBRG: Full fetch complete (54364 records). [2025-09-15T18:02:51.682883] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-15T18:02:52.066682] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-15T18:02:52.066765] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-15T18:02:52.067442] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-15T18:02:52.067484] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-15T18:02:52.068632] [DEBUG] [LOCAL ] DBRG: Trimmed 54364 records to 36678 (keeping 150 days of data) [2025-09-15T18:02:52.299323] [DEBUG] [LOCAL ] DBRG: Primary data saved (36678 records). [2025-09-15T18:02:52.299476] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-15T18:02:52.301190] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DBRG took 28.5s. Estimated remaining: 3h 6m 27s. Rate: 9.5 symbols/min [2025-09-15T18:02:52.407328] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:02:52.457893] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-15T18:02:53.131385] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:02:53.257832] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-15T18:02:53.805263] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:02:54.057897] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-15T18:02:54.732926] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:02:54.857907] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-15T18:02:55.306397] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:02:55.657909] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-15T18:02:56.125106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:02:56.131181] [INFO ] [REMOTE ] DD: Full fetch complete (57377 records). [2025-09-15T18:02:56.131346] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-15T18:02:56.468450] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-15T18:02:56.519831] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-15T18:02:56.519910] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-15T18:02:56.520710] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-15T18:02:56.520775] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-15T18:02:56.522020] [DEBUG] [LOCAL ] DD: Trimmed 57377 records to 38986 (keeping 150 days of data) [2025-09-15T18:02:56.777002] [DEBUG] [LOCAL ] DD: Primary data saved (38986 records). [2025-09-15T18:02:56.777175] [INFO ] [MAIN ] DD: Full history saved. [2025-09-15T18:02:56.777263] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 26.1s. Estimated remaining: 3h 6m 15s. Rate: 9.5 symbols/min [2025-09-15T18:02:57.088446] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:02:57.257879] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-15T18:02:58.317444] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T18:02:58.326973] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-15T18:02:58.411002] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:02:58.857920] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-15T18:02:59.696997] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:02:59.707790] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-15T18:02:59.931319] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:03:00.457948] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-15T18:03:01.665920] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-15T18:03:01.680141] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-15T18:03:01.705264] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T18:03:02.057888] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-15T18:03:03.180913] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T18:03:03.192074] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-15T18:03:03.553271] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:03:03.558052] [INFO ] [REMOTE ] DDL: Full fetch complete (39485 records). [2025-09-15T18:03:03.558172] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-15T18:03:03.944790] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-15T18:03:03.944876] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-15T18:03:03.945501] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-15T18:03:03.945544] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-15T18:03:03.946498] [DEBUG] [LOCAL ] DDL: Trimmed 39485 records to 25348 (keeping 150 days of data) [2025-09-15T18:03:04.102677] [DEBUG] [LOCAL ] DDL: Primary data saved (25348 records). [2025-09-15T18:03:04.102824] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-15T18:03:04.102926] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 14.7s. Estimated remaining: 3h 6m 12s. Rate: 9.5 symbols/min [2025-09-15T18:03:04.999070] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T18:03:05.010050] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-15T18:03:06.670657] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:03:06.681876] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-15T18:03:08.115235] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T18:03:08.126122] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-15T18:03:09.759151] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:03:09.764850] [INFO ] [REMOTE ] DDD: Full fetch complete (55223 records). [2025-09-15T18:03:09.764994] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-15T18:03:10.140601] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-15T18:03:10.140697] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-15T18:03:10.141388] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-15T18:03:10.141440] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-15T18:03:10.142747] [DEBUG] [LOCAL ] DDD: Trimmed 55223 records to 37346 (keeping 150 days of data) [2025-09-15T18:03:10.362449] [DEBUG] [LOCAL ] DDD: Primary data saved (37346 records). [2025-09-15T18:03:10.362624] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-15T18:03:10.362751] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 21.1s. Estimated remaining: 3h 6m 5s. Rate: 9.5 symbols/min [2025-09-15T18:03:10.965567] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.037238] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.066815] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.091725] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.095842] [DEBUG] [LOCAL ] DDT: Loaded 1389 existing records from primary storage. [2025-09-15T18:03:11.096044] [INFO ] [MAIN ] DDT: Loaded 1389 existing records. [2025-09-15T18:03:11.231743] [DEBUG] [LOCAL ] DDS: Loaded 9703 existing records from primary storage. [2025-09-15T18:03:11.232333] [INFO ] [MAIN ] DDS: Loaded 9703 existing records. [2025-09-15T18:03:11.336457] [DEBUG] [LOCAL ] DEA: Loaded 29951 existing records from primary storage. [2025-09-15T18:03:11.375467] [INFO ] [MAIN ] DEA: Loaded 29951 existing records. [2025-09-15T18:03:11.380694] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.486476] [DEBUG] [LOCAL ] DE: Loaded 35483 existing records from primary storage. [2025-09-15T18:03:11.495102] [INFO ] [MAIN ] DE: Loaded 35483 existing records. [2025-09-15T18:03:11.482531] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-15T18:03:11.559557] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-15T18:03:11.647783] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-15T18:03:11.671459] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-15T18:03:11.712136] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.856743] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-15T18:03:11.934967] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.921582] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-15T18:03:11.975622] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.978933] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-15T18:03:11.979363] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-15T18:03:11.979277] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-15T18:03:12.001116] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-15T18:03:12.070533] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-15T18:03:12.083801] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-15T18:03:12.070397] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-15T18:03:12.103594] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-15T18:03:12.110590] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-15T18:03:12.108828] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-15T18:03:12.759688] [INFO ] [REMOTE ] DDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:12.798090] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-15T18:03:13.121078] [INFO ] [REMOTE ] DDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.190137] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-15T18:03:13.240498] [INFO ] [REMOTE ] DEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.241587] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-15T18:03:13.318117] [INFO ] [REMOTE ] DE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.318416] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-15T18:03:13.409222] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:03:13.410259] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-15T18:03:13.752387] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:03:13.753565] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-15T18:03:14.193304] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:03:14.196549] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-15T18:03:14.252837] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:03:14.254402] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-15T18:03:14.620714] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:03:14.621808] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-15T18:03:14.898557] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:03:14.908563] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-15T18:03:14.912120] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-15T18:03:14.913553] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-15T18:03:14.924866] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T18:03:14.928460] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-15T18:03:15.246855] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:03:15.457337] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T18:03:15.657893] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-15T18:03:15.715859] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:03:16.249618] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:03:16.457866] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-15T18:03:17.257829] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-15T18:03:17.382744] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:03:17.973683] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:03:18.057857] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-15T18:03:18.297359] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:03:18.857871] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-15T18:03:19.128724] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-15T18:03:19.444262] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:03:19.657923] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-15T18:03:20.439494] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:03:20.457843] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-15T18:03:21.003566] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:03:21.257880] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-15T18:03:22.057878] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-15T18:03:22.709119] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:03:22.857854] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-15T18:03:23.657872] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-15T18:03:23.966816] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:03:24.141523] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:03:24.457854] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-15T18:03:24.510744] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T18:03:25.257876] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-15T18:03:25.909847] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:03:26.008143] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T18:03:26.010623] [INFO ] [REMOTE ] DDS: Full fetch complete (14799 records). [2025-09-15T18:03:26.010748] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-15T18:03:26.063005] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-15T18:03:26.379658] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-15T18:03:26.379764] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-15T18:03:26.380132] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-15T18:03:26.380176] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-15T18:03:26.380780] [DEBUG] [LOCAL ] DDS: Trimmed 14799 records to 9514 (keeping 150 days of data) [2025-09-15T18:03:26.448129] [DEBUG] [LOCAL ] DDS: Primary data saved (9514 records). [2025-09-15T18:03:26.448280] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-15T18:03:26.448399] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDS took 16.1s. Estimated remaining: 3h 6m 28s. Rate: 9.5 symbols/min [2025-09-15T18:03:26.614916] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:26.640387] [DEBUG] [LOCAL ] DEC: Loaded 21746 existing records from primary storage. [2025-09-15T18:03:26.640518] [INFO ] [MAIN ] DEC: Loaded 21746 existing records. [2025-09-15T18:03:26.739376] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:03:26.742405] [INFO ] [REMOTE ] DDT: Full fetch complete (2191 records). [2025-09-15T18:03:26.742745] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-15T18:03:26.858866] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-15T18:03:26.925760] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:26.947947] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-15T18:03:26.953214] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-15T18:03:27.048018] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-15T18:03:27.088389] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-15T18:03:27.316266] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-15T18:03:27.334611] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-15T18:03:27.350887] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-15T18:03:27.367323] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-15T18:03:27.447020] [DEBUG] [LOCAL ] DDT: Trimmed 2191 records to 1355 (keeping 150 days of data) [2025-09-15T18:03:27.507006] [DEBUG] [LOCAL ] DDT: Primary data saved (1355 records). [2025-09-15T18:03:27.530258] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-15T18:03:27.540376] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDT took 17.2s. Estimated remaining: 3h 6m 6s. Rate: 9.5 symbols/min [2025-09-15T18:03:27.559932] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:27.666772] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-15T18:03:27.748716] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:27.795154] [DEBUG] [LOCAL ] DECK: Loaded 40114 existing records from primary storage. [2025-09-15T18:03:27.795307] [INFO ] [MAIN ] DECK: Loaded 40114 existing records. [2025-09-15T18:03:27.973679] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:27.973917] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-15T18:03:27.973964] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-15T18:03:27.974984] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-15T18:03:27.975036] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-15T18:03:28.342090] [INFO ] [REMOTE ] DECK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:28.357195] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:03:28.362391] [INFO ] [REMOTE ] DEA: Full fetch complete (46310 records). [2025-09-15T18:03:28.362512] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-15T18:03:28.463039] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-15T18:03:28.753663] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-15T18:03:28.753754] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-15T18:03:28.754551] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-15T18:03:28.754598] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-15T18:03:28.755764] [DEBUG] [LOCAL ] DEA: Trimmed 46310 records to 29061 (keeping 150 days of data) [2025-09-15T18:03:28.965778] [DEBUG] [LOCAL ] DEA: Primary data saved (29061 records). [2025-09-15T18:03:28.965945] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-15T18:03:28.966883] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 18.6s. Estimated remaining: 3h 5m 46s. Rate: 9.5 symbols/min [2025-09-15T18:03:29.201333] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:29.264601] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-15T18:03:29.269941] [DEBUG] [LOCAL ] DEI: Loaded 36290 existing records from primary storage. [2025-09-15T18:03:29.270170] [INFO ] [MAIN ] DEI: Loaded 36290 existing records. [2025-09-15T18:03:29.571377] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:29.571952] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-15T18:03:29.572051] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-15T18:03:29.573137] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-15T18:03:29.573228] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-15T18:03:29.945007] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:03:30.063276] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-15T18:03:30.238375] [INFO ] [REMOTE ] DEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:30.328280] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:03:30.608404] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:03:30.857867] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-15T18:03:31.333764] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:03:31.657874] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-15T18:03:32.206140] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:03:32.457878] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-15T18:03:33.257874] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-15T18:03:33.305315] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:03:34.057849] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-15T18:03:34.106672] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:03:34.763466] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:03:34.857885] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-15T18:03:35.657888] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-15T18:03:36.398810] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-15T18:03:36.457836] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-15T18:03:36.621164] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:03:36.663564] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:03:37.257873] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-15T18:03:37.978489] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:03:38.057869] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-15T18:03:38.661126] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:03:38.857866] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-15T18:03:39.657845] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-15T18:03:40.136527] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T18:03:40.216554] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:03:40.221757] [INFO ] [REMOTE ] DE: Full fetch complete (51937 records). [2025-09-15T18:03:40.221886] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-15T18:03:40.222623] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:03:40.222723] [FATAL] [MAIN ] DE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:03:40.222784] [WARN ] [MAIN ] DE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:03:40.222830] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-15T18:03:40.222891] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-09-15T18:03:40.222928] [INFO ] [LOCAL ] DE: Starting deletion of derivative data. [2025-09-15T18:03:40.223324] [DEBUG] [LOCAL ] DE: Deleted derivative data file. [2025-09-15T18:03:40.223418] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 29.9s. Estimated remaining: 3h 5m 54s. Rate: 9.5 symbols/min [2025-09-15T18:03:40.395531] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:40.437879] [DEBUG] [LOCAL ] DELL: Loaded 40477 existing records from primary storage. [2025-09-15T18:03:40.438049] [INFO ] [MAIN ] DELL: Loaded 40477 existing records. [2025-09-15T18:03:40.468345] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-15T18:03:40.620405] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:40.620703] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-15T18:03:40.620755] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-15T18:03:40.622013] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-15T18:03:40.622068] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-15T18:03:40.968593] [INFO ] [REMOTE ] DELL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:41.084691] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:03:41.257873] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-15T18:03:42.057886] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-15T18:03:42.118890] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T18:03:42.447829] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:03:42.857911] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-15T18:03:43.657893] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-15T18:03:43.919748] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:03:43.971497] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:03:44.457870] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-15T18:03:45.240787] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:03:45.257822] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-15T18:03:45.688152] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:03:46.057900] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-15T18:03:46.857974] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-15T18:03:47.258090] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:03:47.657933] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-15T18:03:47.985856] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:03:48.406085] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-15T18:03:48.457906] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-15T18:03:49.257889] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-15T18:03:49.487836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:03:50.057892] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-15T18:03:50.102863] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:03:50.105859] [INFO ] [REMOTE ] DEC: Full fetch complete (34077 records). [2025-09-15T18:03:50.105936] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-15T18:03:50.470547] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-15T18:03:50.470626] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-15T18:03:50.471224] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-15T18:03:50.471276] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-15T18:03:50.472068] [DEBUG] [LOCAL ] DEC: Trimmed 34077 records to 21123 (keeping 150 days of data) [2025-09-15T18:03:50.617937] [DEBUG] [LOCAL ] DEC: Primary data saved (21123 records). [2025-09-15T18:03:50.618065] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-15T18:03:50.618152] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 24.2s. Estimated remaining: 3h 5m 59s. Rate: 9.5 symbols/min [2025-09-15T18:03:50.791789] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:50.834807] [DEBUG] [LOCAL ] DEO: Loaded 36454 existing records from primary storage. [2025-09-15T18:03:50.835010] [INFO ] [MAIN ] DEO: Loaded 36454 existing records. [2025-09-15T18:03:50.865280] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-15T18:03:51.014184] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:51.014570] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-15T18:03:51.014627] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-15T18:03:51.015504] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-15T18:03:51.015554] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-15T18:03:51.320316] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-15T18:03:51.409828] [INFO ] [REMOTE ] DEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:51.462263] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:03:51.657875] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-15T18:03:52.457889] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-15T18:03:52.685525] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:03:52.691425] [INFO ] [REMOTE ] DECK: Full fetch complete (57997 records). [2025-09-15T18:03:52.691583] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-15T18:03:53.076167] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-15T18:03:53.076267] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-15T18:03:53.077104] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-15T18:03:53.077163] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-15T18:03:53.078702] [DEBUG] [LOCAL ] DECK: Trimmed 57997 records to 39340 (keeping 150 days of data) [2025-09-15T18:03:53.262815] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-15T18:03:53.341592] [DEBUG] [LOCAL ] DECK: Primary data saved (39340 records). [2025-09-15T18:03:53.341779] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-15T18:03:53.341879] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DECK took 25.8s. Estimated remaining: 3h 5m 42s. Rate: 9.5 symbols/min [2025-09-15T18:03:53.527487] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:03:53.563120] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:53.587522] [DEBUG] [LOCAL ] DFH: Loaded 24215 existing records from primary storage. [2025-09-15T18:03:53.587699] [INFO ] [MAIN ] DFH: Loaded 24215 existing records. [2025-09-15T18:03:53.804402] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:53.804689] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-15T18:03:53.804737] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-15T18:03:53.805389] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-15T18:03:53.805438] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-15T18:03:54.064932] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-15T18:03:54.186956] [INFO ] [REMOTE ] DFH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:54.220657] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T18:03:54.857866] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-15T18:03:55.594264] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-15T18:03:55.648870] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:03:55.658762] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-15T18:03:56.457923] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-15T18:03:56.480751] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:03:56.486613] [INFO ] [REMOTE ] DEI: Full fetch complete (52484 records). [2025-09-15T18:03:56.486801] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-15T18:03:56.871260] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-15T18:03:56.871370] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-15T18:03:56.872583] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-15T18:03:56.872655] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-15T18:03:56.874153] [DEBUG] [LOCAL ] DEI: Trimmed 52484 records to 35546 (keeping 150 days of data) [2025-09-15T18:03:57.115546] [DEBUG] [LOCAL ] DEI: Primary data saved (35546 records). [2025-09-15T18:03:57.115777] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-15T18:03:57.116929] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DEI took 28.1s. Estimated remaining: 3h 5m 29s. Rate: 9.5 symbols/min [2025-09-15T18:03:57.291569] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-15T18:03:57.296768] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:57.317132] [DEBUG] [LOCAL ] DFIN: Loaded 16451 existing records from primary storage. [2025-09-15T18:03:57.317311] [INFO ] [MAIN ] DFIN: Loaded 16451 existing records. [2025-09-15T18:03:57.510110] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:57.510756] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-15T18:03:57.510884] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-15T18:03:57.511582] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-15T18:03:57.511630] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-15T18:03:57.793744] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-15T18:03:57.907061] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:57.989228] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:03:58.057900] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-15T18:03:58.274138] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:03:58.857922] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-15T18:03:59.226984] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:03:59.657882] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-15T18:04:00.457876] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-15T18:04:01.115949] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T18:04:01.257861] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-15T18:04:01.452502] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:04:01.521590] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:04:02.057925] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-15T18:04:02.857871] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-15T18:04:02.938956] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:04:02.976588] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:04:03.657874] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-15T18:04:04.457884] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-15T18:04:04.692891] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T18:04:05.257875] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-15T18:04:05.326605] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T18:04:05.388301] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:04:05.393797] [INFO ] [REMOTE ] DELL: Full fetch complete (58026 records). [2025-09-15T18:04:05.393929] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-15T18:04:05.394872] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:04:05.394967] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:04:05.395028] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:04:05.395096] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-15T18:04:05.395166] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-15T18:04:05.395203] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-15T18:04:05.395489] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-09-15T18:04:05.396107] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DELL took 25.2s. Estimated remaining: 3h 5m 28s. Rate: 9.5 symbols/min [2025-09-15T18:04:05.577199] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:05.592123] [DEBUG] [LOCAL ] DFP: Loaded 8600 existing records from primary storage. [2025-09-15T18:04:05.592281] [INFO ] [MAIN ] DFP: Loaded 8600 existing records. [2025-09-15T18:04:05.768822] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:05.769096] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-15T18:04:05.769142] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-15T18:04:05.769581] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-15T18:04:05.769627] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-15T18:04:06.062949] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-15T18:04:06.117808] [INFO ] [REMOTE ] DFP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:06.857862] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-15T18:04:07.195512] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:04:07.544154] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:04:07.657901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-15T18:04:07.682105] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:04:08.421572] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T18:04:08.457812] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-15T18:04:09.257924] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-15T18:04:09.446240] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:04:10.057881] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-15T18:04:10.772489] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:04:10.857871] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-15T18:04:10.993054] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:04:11.657883] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-15T18:04:11.848090] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:04:12.457877] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-15T18:04:13.045078] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:04:13.050560] [INFO ] [REMOTE ] DEO: Full fetch complete (53242 records). [2025-09-15T18:04:13.050687] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-15T18:04:13.263079] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-15T18:04:13.373738] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:04:13.445420] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-15T18:04:13.445504] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-15T18:04:13.446228] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-15T18:04:13.446274] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-15T18:04:13.447360] [DEBUG] [LOCAL ] DEO: Trimmed 53242 records to 35760 (keeping 150 days of data) [2025-09-15T18:04:13.671374] [DEBUG] [LOCAL ] DEO: Primary data saved (35760 records). [2025-09-15T18:04:13.671553] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-15T18:04:13.673146] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 23.1s. Estimated remaining: 3h 5m 27s. Rate: 9.5 symbols/min [2025-09-15T18:04:13.842373] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:13.887503] [DEBUG] [LOCAL ] DG: Loaded 40084 existing records from primary storage. [2025-09-15T18:04:13.887665] [INFO ] [MAIN ] DG: Loaded 40084 existing records. [2025-09-15T18:04:14.059624] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-15T18:04:14.066793] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:14.067065] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-15T18:04:14.067115] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-15T18:04:14.068151] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-15T18:04:14.068209] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-15T18:04:14.362123] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:04:14.445144] [INFO ] [REMOTE ] DG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:14.857887] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-15T18:04:15.341452] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:04:15.641437] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:04:15.644223] [INFO ] [REMOTE ] DFIN: Full fetch complete (25996 records). [2025-09-15T18:04:15.644297] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-15T18:04:15.663023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-15T18:04:16.034801] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-15T18:04:16.034889] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-15T18:04:16.035422] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-15T18:04:16.035486] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-15T18:04:16.036329] [DEBUG] [LOCAL ] DFIN: Trimmed 25996 records to 15977 (keeping 150 days of data) [2025-09-15T18:04:16.139357] [DEBUG] [LOCAL ] DFIN: Primary data saved (15977 records). [2025-09-15T18:04:16.139532] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-15T18:04:16.139676] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFIN took 19.0s. Estimated remaining: 3h 5m 10s. Rate: 9.5 symbols/min [2025-09-15T18:04:16.313599] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:16.348968] [DEBUG] [LOCAL ] DGX: Loaded 33788 existing records from primary storage. [2025-09-15T18:04:16.349115] [INFO ] [MAIN ] DGX: Loaded 33788 existing records. [2025-09-15T18:04:16.462972] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-15T18:04:16.525965] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:16.527752] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-15T18:04:16.536001] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-15T18:04:16.536972] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T18:04:16.540106] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-15T18:04:16.541025] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-15T18:04:16.910176] [INFO ] [REMOTE ] DGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:17.257886] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-15T18:04:18.057905] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-15T18:04:18.144147] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:04:18.390997] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:04:18.857898] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-15T18:04:19.397058] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:04:19.657870] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-15T18:04:19.681155] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:04:20.457870] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-15T18:04:21.227154] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:04:21.257832] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-15T18:04:21.955975] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:04:22.057927] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-15T18:04:22.858674] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-15T18:04:22.863922] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:04:23.454522] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:04:23.657892] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-15T18:04:24.457915] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-15T18:04:24.683084] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:04:24.933809] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:04:25.257877] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-15T18:04:25.318497] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T18:04:25.697959] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:04:26.057863] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-15T18:04:26.857904] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-15T18:04:27.277581] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:04:27.281397] [INFO ] [REMOTE ] DFH: Full fetch complete (36222 records). [2025-09-15T18:04:27.281523] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-15T18:04:27.618364] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:04:27.667400] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-15T18:04:27.669543] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-15T18:04:27.670366] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-15T18:04:27.671135] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-15T18:04:27.671274] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-15T18:04:27.672310] [DEBUG] [LOCAL ] DFH: Trimmed 36222 records to 23634 (keeping 150 days of data) [2025-09-15T18:04:27.817478] [DEBUG] [LOCAL ] DFH: Primary data saved (23634 records). [2025-09-15T18:04:27.817619] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-15T18:04:27.817782] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFH took 34.5s. Estimated remaining: 3h 5m 19s. Rate: 9.5 symbols/min [2025-09-15T18:04:27.989973] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:28.007295] [DEBUG] [LOCAL ] DHF: Loaded 16009 existing records from primary storage. [2025-09-15T18:04:28.007422] [INFO ] [MAIN ] DHF: Loaded 16009 existing records. [2025-09-15T18:04:28.184770] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:28.185035] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-15T18:04:28.185082] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-15T18:04:28.185559] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-15T18:04:28.185617] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-15T18:04:28.466911] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-15T18:04:28.551986] [INFO ] [REMOTE ] DHF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:29.257898] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-15T18:04:29.641968] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T18:04:29.676264] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:04:30.057854] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-15T18:04:30.114361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:04:30.857882] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-15T18:04:31.657874] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-15T18:04:31.904267] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T18:04:31.924320] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:04:31.926303] [INFO ] [REMOTE ] DFP: Full fetch complete (12667 records). [2025-09-15T18:04:31.926388] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-15T18:04:31.926845] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:04:31.926922] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:04:31.926964] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:04:31.927048] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-15T18:04:31.927124] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-15T18:04:31.927184] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-15T18:04:31.927490] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-09-15T18:04:31.927616] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 26.5s. Estimated remaining: 3h 5m 6s. Rate: 9.5 symbols/min [2025-09-15T18:04:32.096898] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:32.138944] [DEBUG] [LOCAL ] DHI: Loaded 40196 existing records from primary storage. [2025-09-15T18:04:32.139109] [INFO ] [MAIN ] DHI: Loaded 40196 existing records. [2025-09-15T18:04:32.315425] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:32.315731] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-15T18:04:32.315793] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-15T18:04:32.316739] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-15T18:04:32.316799] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-15T18:04:32.463918] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-15T18:04:32.672809] [INFO ] [REMOTE ] DHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:32.930786] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:04:33.257862] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-15T18:04:33.936422] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:04:34.057862] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-15T18:04:34.383360] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:04:34.857866] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-15T18:04:35.657855] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-15T18:04:35.889538] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:04:36.457871] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-15T18:04:36.552114] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T18:04:36.642376] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T18:04:37.257873] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-15T18:04:37.777579] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:04:38.057857] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-15T18:04:38.210518] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:04:38.857868] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-15T18:04:39.657849] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-15T18:04:39.817189] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T18:04:40.048076] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:04:40.054136] [INFO ] [REMOTE ] DG: Full fetch complete (57969 records). [2025-09-15T18:04:40.054271] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-15T18:04:40.462973] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-15T18:04:40.464759] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-15T18:04:40.464858] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-15T18:04:40.465581] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-15T18:04:40.465780] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-15T18:04:40.467039] [DEBUG] [LOCAL ] DG: Trimmed 57969 records to 39311 (keeping 150 days of data) [2025-09-15T18:04:40.719003] [DEBUG] [LOCAL ] DG: Primary data saved (39311 records). [2025-09-15T18:04:40.719167] [INFO ] [MAIN ] DG: Full history saved. [2025-09-15T18:04:40.720781] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DG took 27.0s. Estimated remaining: 3h 5m 7s. Rate: 9.5 symbols/min [2025-09-15T18:04:40.895750] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:40.939987] [DEBUG] [LOCAL ] DHR: Loaded 40171 existing records from primary storage. [2025-09-15T18:04:40.940141] [INFO ] [MAIN ] DHR: Loaded 40171 existing records. [2025-09-15T18:04:41.118807] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:41.119109] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-15T18:04:41.119156] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-15T18:04:41.120152] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-15T18:04:41.120204] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-15T18:04:41.266625] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-15T18:04:41.497940] [INFO ] [REMOTE ] DHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:41.530998] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:04:41.610875] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:04:42.057823] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-15T18:04:42.432388] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:04:42.857932] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-15T18:04:43.426506] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T18:04:43.431242] [INFO ] [REMOTE ] DGX: Full fetch complete (49927 records). [2025-09-15T18:04:43.431358] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-15T18:04:43.662994] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-15T18:04:43.830465] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-15T18:04:43.830556] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-15T18:04:43.831294] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-15T18:04:43.831344] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-15T18:04:43.832721] [DEBUG] [LOCAL ] DGX: Trimmed 49927 records to 32994 (keeping 150 days of data) [2025-09-15T18:04:44.052840] [DEBUG] [LOCAL ] DGX: Primary data saved (32994 records). [2025-09-15T18:04:44.053013] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-15T18:04:44.053808] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 27.9s. Estimated remaining: 3h 4m 52s. Rate: 9.5 symbols/min [2025-09-15T18:04:44.224256] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:44.255581] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:04:44.300201] [DEBUG] [LOCAL ] DHT: Loaded 35605 existing records from primary storage. [2025-09-15T18:04:44.300369] [INFO ] [MAIN ] DHT: Loaded 35605 existing records. [2025-09-15T18:04:44.458461] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-15T18:04:44.480292] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:44.480564] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-15T18:04:44.480612] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-15T18:04:44.481477] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-15T18:04:44.481531] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-15T18:04:44.837619] [INFO ] [REMOTE ] DHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:45.257898] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-15T18:04:45.362411] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:04:46.057873] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-15T18:04:46.124837] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:04:46.297454] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T18:04:46.857890] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-15T18:04:47.504098] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T18:04:47.506524] [INFO ] [REMOTE ] DHF: Full fetch complete (22726 records). [2025-09-15T18:04:47.506598] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-15T18:04:47.669512] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-15T18:04:47.770419] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:04:47.936881] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-15T18:04:47.936963] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-15T18:04:47.937443] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-15T18:04:47.937483] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-15T18:04:47.938161] [DEBUG] [LOCAL ] DHF: Trimmed 22726 records to 15803 (keeping 150 days of data) [2025-09-15T18:04:48.033958] [DEBUG] [LOCAL ] DHF: Primary data saved (15803 records). [2025-09-15T18:04:48.034136] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-15T18:04:48.034260] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 20.2s. Estimated remaining: 3h 4m 39s. Rate: 9.5 symbols/min [2025-09-15T18:04:48.209587] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:48.219713] [DEBUG] [LOCAL ] DHX: Loaded 9236 existing records from primary storage. [2025-09-15T18:04:48.219833] [INFO ] [MAIN ] DHX: Loaded 9236 existing records. [2025-09-15T18:04:48.398338] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:48.398630] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-15T18:04:48.398707] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-15T18:04:48.399021] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-15T18:04:48.399076] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-15T18:04:48.462941] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-15T18:04:48.759924] [INFO ] [REMOTE ] DHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:49.257879] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-15T18:04:49.658233] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:04:50.057885] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-15T18:04:50.122300] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:04:50.264728] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:04:50.857887] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-15T18:04:51.657877] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-15T18:04:51.959220] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T18:04:52.173596] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:04:52.457906] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-15T18:04:53.068150] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:04:53.258148] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-15T18:04:53.264264] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:04:54.057865] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-15T18:04:54.184478] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T18:04:54.857931] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-15T18:04:55.657920] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-15T18:04:55.845185] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T18:04:56.457935] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-15T18:04:57.257863] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-15T18:04:57.454595] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-15T18:04:58.057837] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-15T18:04:58.165283] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-15T18:04:58.272622] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:04:58.472722] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:04:58.857897] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-15T18:04:59.657838] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-15T18:04:59.885278] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:05:00.457902] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-15T18:05:00.582666] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:05:00.610755] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:05:00.616689] [INFO ] [REMOTE ] DHI: Full fetch complete (58044 records). [2025-09-15T18:05:00.616801] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-15T18:05:01.040388] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-15T18:05:01.040478] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-15T18:05:01.041277] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-15T18:05:01.041330] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-15T18:05:01.042666] [DEBUG] [LOCAL ] DHI: Trimmed 58044 records to 39418 (keeping 150 days of data) [2025-09-15T18:05:01.259155] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-15T18:05:01.332771] [DEBUG] [LOCAL ] DHI: Primary data saved (39418 records). [2025-09-15T18:05:01.332955] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-15T18:05:01.333600] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 29.4s. Estimated remaining: 3h 4m 53s. Rate: 9.5 symbols/min [2025-09-15T18:05:01.513272] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:01.527501] [DEBUG] [LOCAL ] DIAX: Loaded 8704 existing records from primary storage. [2025-09-15T18:05:01.527635] [INFO ] [MAIN ] DIAX: Loaded 8704 existing records. [2025-09-15T18:05:01.709953] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:01.710244] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-15T18:05:01.710293] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-15T18:05:01.710699] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-15T18:05:01.710778] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-15T18:05:01.980474] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:05:02.066208] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-15T18:05:02.112022] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:02.253893] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T18:05:02.857886] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-15T18:05:03.657856] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-15T18:05:04.053517] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T18:05:04.420851] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:05:04.467836] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-15T18:05:04.472015] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:05:05.257911] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-15T18:05:05.268957] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:05:05.861134] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:05:05.863497] [INFO ] [REMOTE ] DHX: Full fetch complete (15358 records). [2025-09-15T18:05:05.863581] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-15T18:05:06.063360] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-15T18:05:06.225964] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-15T18:05:06.226054] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-15T18:05:06.226424] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-15T18:05:06.226480] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-15T18:05:06.227066] [DEBUG] [LOCAL ] DHX: Trimmed 15358 records to 9039 (keeping 150 days of data) [2025-09-15T18:05:06.280488] [DEBUG] [LOCAL ] DHX: Primary data saved (9039 records). [2025-09-15T18:05:06.280662] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-15T18:05:06.280781] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHX took 18.2s. Estimated remaining: 3h 4m 43s. Rate: 9.5 symbols/min [2025-09-15T18:05:06.459619] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:06.486796] [DEBUG] [LOCAL ] DIN: Loaded 27267 existing records from primary storage. [2025-09-15T18:05:06.486940] [INFO ] [MAIN ] DIN: Loaded 27267 existing records. [2025-09-15T18:05:06.669054] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:06.669331] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-15T18:05:06.669380] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-15T18:05:06.670169] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-15T18:05:06.670227] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-15T18:05:06.870470] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-15T18:05:07.056204] [INFO ] [REMOTE ] DIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:07.657891] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-15T18:05:08.007155] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:05:08.014295] [INFO ] [REMOTE ] DHR: Full fetch complete (58043 records). [2025-09-15T18:05:08.014482] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-15T18:05:08.361138] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:05:08.436835] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-15T18:05:08.436931] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-15T18:05:08.437687] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-15T18:05:08.437741] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-15T18:05:08.440721] [DEBUG] [LOCAL ] DHR: Trimmed 58043 records to 39395 (keeping 150 days of data) [2025-09-15T18:05:08.509329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-15T18:05:08.609379] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:05:08.786074] [DEBUG] [LOCAL ] DHR: Primary data saved (39395 records). [2025-09-15T18:05:08.786255] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-15T18:05:08.787347] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 28.1s. Estimated remaining: 3h 4m 25s. Rate: 9.5 symbols/min [2025-09-15T18:05:08.960077] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:09.008740] [DEBUG] [LOCAL ] DINO: Loaded 39866 existing records from primary storage. [2025-09-15T18:05:09.008939] [INFO ] [MAIN ] DINO: Loaded 39866 existing records. [2025-09-15T18:05:09.185676] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:09.185974] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-15T18:05:09.186033] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-15T18:05:09.186959] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-15T18:05:09.187015] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-15T18:05:09.262983] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-15T18:05:09.547495] [INFO ] [REMOTE ] DINO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:10.057902] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-15T18:05:10.108193] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:05:10.163492] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:05:10.857897] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-15T18:05:11.608582] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:05:11.657928] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-15T18:05:12.157406] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:05:12.314190] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:05:12.457889] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-15T18:05:13.257876] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-15T18:05:13.551386] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:05:14.057934] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-15T18:05:14.513459] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:05:14.857952] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-15T18:05:14.921599] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:05:14.930360] [INFO ] [REMOTE ] DHT: Full fetch complete (51961 records). [2025-09-15T18:05:14.930597] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-15T18:05:14.931786] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:05:14.931946] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:14.932023] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:14.932095] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-15T18:05:14.932200] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-15T18:05:14.932269] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-15T18:05:14.934584] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-15T18:05:14.939143] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHT took 30.9s. Estimated remaining: 3h 4m 19s. Rate: 9.5 symbols/min [2025-09-15T18:05:15.217487] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:15.297409] [DEBUG] [LOCAL ] DIS: Loaded 40528 existing records from primary storage. [2025-09-15T18:05:15.297673] [INFO ] [MAIN ] DIS: Loaded 40528 existing records. [2025-09-15T18:05:15.514162] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:15.514737] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-15T18:05:15.520059] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-15T18:05:15.527149] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T18:05:15.527211] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-15T18:05:15.530459] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-15T18:05:15.673168] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-15T18:05:15.921820] [INFO ] [REMOTE ] DIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:16.457909] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-15T18:05:17.257831] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-15T18:05:17.705852] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T18:05:18.057893] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-15T18:05:18.857893] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-15T18:05:18.892226] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:05:19.057797] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-15T18:05:19.492477] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T18:05:19.657909] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-15T18:05:19.875100] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:05:20.457922] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-15T18:05:21.257877] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-15T18:05:21.413391] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:05:21.556502] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:05:22.057942] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-15T18:05:22.857898] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-15T18:05:22.978403] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:05:23.000814] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:05:23.002547] [INFO ] [REMOTE ] DIAX: Full fetch complete (12969 records). [2025-09-15T18:05:23.002615] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-15T18:05:23.003056] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:05:23.003138] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:23.003174] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:23.003213] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-15T18:05:23.003285] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-15T18:05:23.003324] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-15T18:05:23.003634] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-09-15T18:05:23.003735] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 21.7s. Estimated remaining: 3h 4m 17s. Rate: 9.5 symbols/min [2025-09-15T18:05:23.174537] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:23.174782] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-15T18:05:23.174821] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-15T18:05:23.174939] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-15T18:05:23.174978] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-15T18:05:23.175018] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-15T18:05:23.175049] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-15T18:05:23.526052] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:23.657879] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-15T18:05:24.457874] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-15T18:05:24.689490] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:05:24.869720] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T18:05:25.257873] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-15T18:05:25.398446] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:05:26.057885] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-15T18:05:26.857877] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-15T18:05:27.069941] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:05:27.642898] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:05:27.657847] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-15T18:05:27.911913] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:05:28.457865] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-15T18:05:29.257876] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-15T18:05:29.395841] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:05:29.486934] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T18:05:29.491612] [INFO ] [REMOTE ] DIN: Full fetch complete (40640 records). [2025-09-15T18:05:29.491797] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-15T18:05:29.870691] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-15T18:05:29.870780] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-15T18:05:29.871358] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-15T18:05:29.871412] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-15T18:05:29.872491] [DEBUG] [LOCAL ] DIN: Trimmed 40640 records to 26800 (keeping 150 days of data) [2025-09-15T18:05:30.040560] [DEBUG] [LOCAL ] DIN: Primary data saved (26800 records). [2025-09-15T18:05:30.040712] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-15T18:05:30.040799] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 23.8s. Estimated remaining: 3h 4m 13s. Rate: 9.5 symbols/min [2025-09-15T18:05:30.063018] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-15T18:05:30.216074] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:30.251937] [DEBUG] [LOCAL ] DK: Loaded 37241 existing records from primary storage. [2025-09-15T18:05:30.252100] [INFO ] [MAIN ] DK: Loaded 37241 existing records. [2025-09-15T18:05:30.425864] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:30.426134] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-15T18:05:30.426186] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-15T18:05:30.427100] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-15T18:05:30.427151] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-15T18:05:30.695052] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:05:30.793178] [INFO ] [REMOTE ] DK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:30.857826] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-15T18:05:31.430783] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T18:05:31.657869] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-15T18:05:31.850351] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:05:32.457901] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-15T18:05:33.257871] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-15T18:05:33.553570] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T18:05:33.631905] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:05:34.057923] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-15T18:05:34.375699] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:05:34.857871] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-15T18:05:35.657850] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-15T18:05:35.891544] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:05:35.897366] [INFO ] [REMOTE ] DINO: Full fetch complete (57626 records). [2025-09-15T18:05:35.897462] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-15T18:05:36.122902] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T18:05:36.281133] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-15T18:05:36.281208] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-15T18:05:36.281920] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-15T18:05:36.281964] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-15T18:05:36.283137] [DEBUG] [LOCAL ] DINO: Trimmed 57626 records to 39092 (keeping 150 days of data) [2025-09-15T18:05:36.470985] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-15T18:05:36.531851] [DEBUG] [LOCAL ] DINO: Primary data saved (39092 records). [2025-09-15T18:05:36.531966] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-15T18:05:36.533385] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DINO took 27.7s. Estimated remaining: 3h 4m 7s. Rate: 9.5 symbols/min [2025-09-15T18:05:36.703912] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:36.732065] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:05:36.753749] [DEBUG] [LOCAL ] DKL: Loaded 13168 existing records from primary storage. [2025-09-15T18:05:36.755871] [INFO ] [MAIN ] DKL: Loaded 13168 existing records. [2025-09-15T18:05:36.755980] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-15T18:05:36.928634] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:36.928872] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-15T18:05:36.928925] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-15T18:05:36.929328] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-15T18:05:36.929390] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-15T18:05:37.268738] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-15T18:05:37.273599] [INFO ] [REMOTE ] DKL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:37.545296] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:05:38.057898] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-15T18:05:38.857871] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-15T18:05:39.364044] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:05:39.657888] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-15T18:05:40.341295] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:05:40.457862] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-15T18:05:40.995587] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:05:41.257884] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-15T18:05:42.031806] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:05:42.057816] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-15T18:05:42.857892] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-15T18:05:43.495571] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:05:43.615523] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:05:43.657811] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-15T18:05:43.816851] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:05:44.457869] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-15T18:05:44.788889] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T18:05:45.257876] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-15T18:05:45.665002] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:05:45.665741] [INFO ] [REMOTE ] DIVY: Full fetch complete (1278 records). [2025-09-15T18:05:45.665811] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-15T18:05:45.850332] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T18:05:45.850616] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:45.850756] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:45.850833] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-15T18:05:45.850937] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-15T18:05:45.850979] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-15T18:05:45.851031] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-15T18:05:45.851152] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DIVY took 22.8s. Estimated remaining: 3h 4m 9s. Rate: 9.5 symbols/min [2025-09-15T18:05:46.030947] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:46.047938] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-15T18:05:46.054714] [INFO ] [REMOTE ] DIS: Full fetch complete (58468 records). [2025-09-15T18:05:46.054990] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-15T18:05:46.067354] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-15T18:05:46.339421] [DEBUG] [LOCAL ] DKS: Loaded 37372 existing records from primary storage. [2025-09-15T18:05:46.378972] [INFO ] [MAIN ] DKS: Loaded 37372 existing records. [2025-09-15T18:05:46.666819] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-15T18:05:46.683109] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-15T18:05:46.687056] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-15T18:05:46.687124] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-15T18:05:46.687233] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:46.687824] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-15T18:05:46.688136] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-15T18:05:46.688758] [DEBUG] [LOCAL ] DIS: Trimmed 58468 records to 39748 (keeping 150 days of data) [2025-09-15T18:05:46.689192] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-15T18:05:46.689512] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-15T18:05:46.860617] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-15T18:05:47.172019] [INFO ] [REMOTE ] DKS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:47.309954] [DEBUG] [LOCAL ] DIS: Primary data saved (39748 records). [2025-09-15T18:05:47.310089] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-15T18:05:47.311186] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 32.4s. Estimated remaining: 3h 3m 49s. Rate: 9.5 symbols/min [2025-09-15T18:05:47.488840] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:47.514882] [DEBUG] [LOCAL ] DLB: Loaded 23969 existing records from primary storage. [2025-09-15T18:05:47.515041] [INFO ] [MAIN ] DLB: Loaded 23969 existing records. [2025-09-15T18:05:47.659782] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-15T18:05:47.727349] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:47.727896] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-15T18:05:47.727978] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-15T18:05:47.745027] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-15T18:05:47.759470] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-15T18:05:47.784422] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:05:47.920174] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:05:48.150380] [INFO ] [REMOTE ] DLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:48.457909] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-15T18:05:49.257912] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-15T18:05:49.359394] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:05:49.956876] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:05:49.990848] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:05:50.057920] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-15T18:05:50.857886] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-15T18:05:51.026064] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:05:51.657891] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-15T18:05:52.457944] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-15T18:05:52.528789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T18:05:52.534972] [INFO ] [REMOTE ] DK: Full fetch complete (53730 records). [2025-09-15T18:05:52.535142] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-15T18:05:52.908212] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-15T18:05:52.908292] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-15T18:05:52.908987] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-15T18:05:52.909031] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-15T18:05:52.910093] [DEBUG] [LOCAL ] DK: Trimmed 53730 records to 36616 (keeping 150 days of data) [2025-09-15T18:05:53.140321] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:05:53.156214] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:05:53.182332] [DEBUG] [LOCAL ] DK: Primary data saved (36616 records). [2025-09-15T18:05:53.182460] [INFO ] [MAIN ] DK: Full history saved. [2025-09-15T18:05:53.182539] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DK took 23.1s. Estimated remaining: 3h 3m 42s. Rate: 9.5 symbols/min [2025-09-15T18:05:53.262986] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-15T18:05:53.353346] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:53.358980] [DEBUG] [LOCAL ] DLNG: Loaded 4441 existing records from primary storage. [2025-09-15T18:05:53.359062] [INFO ] [MAIN ] DLNG: Loaded 4441 existing records. [2025-09-15T18:05:53.533759] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:53.534014] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-15T18:05:53.534064] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-15T18:05:53.534354] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-15T18:05:53.534399] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-15T18:05:53.898393] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:54.057858] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-15T18:05:54.857910] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-15T18:05:55.040361] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T18:05:55.411802] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:05:55.657910] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-15T18:05:55.831384] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T18:05:56.301475] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T18:05:56.457864] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-15T18:05:57.257919] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-15T18:05:57.258309] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:05:57.261810] [INFO ] [REMOTE ] DKL: Full fetch complete (22139 records). [2025-09-15T18:05:57.261901] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-15T18:05:57.635532] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-15T18:05:57.635668] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-15T18:05:57.636121] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-15T18:05:57.636164] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-15T18:05:57.636815] [DEBUG] [LOCAL ] DKL: Trimmed 22139 records to 12610 (keeping 150 days of data) [2025-09-15T18:05:57.715334] [DEBUG] [LOCAL ] DKL: Primary data saved (12610 records). [2025-09-15T18:05:57.715482] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-15T18:05:57.715586] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DKL took 21.2s. Estimated remaining: 3h 3m 30s. Rate: 9.5 symbols/min [2025-09-15T18:05:57.883468] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:57.930468] [DEBUG] [LOCAL ] DLR: Loaded 38217 existing records from primary storage. [2025-09-15T18:05:57.930630] [INFO ] [MAIN ] DLR: Loaded 38217 existing records. [2025-09-15T18:05:58.073248] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-15T18:05:58.111859] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:58.112071] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-15T18:05:58.112144] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-15T18:05:58.113175] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-15T18:05:58.113248] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-15T18:05:58.460676] [INFO ] [REMOTE ] DLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:58.857872] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-15T18:05:59.095210] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:05:59.164830] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:05:59.234188] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T18:05:59.657870] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-15T18:06:00.457984] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-15T18:06:00.893919] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:06:01.257921] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-15T18:06:02.057931] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-15T18:06:02.489734] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T18:06:02.771561] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:06:02.857848] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-15T18:06:03.657865] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-15T18:06:03.707994] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:06:04.457872] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-15T18:06:04.988584] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:06:05.046347] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T18:06:05.257920] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-15T18:06:05.858708] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T18:06:06.057907] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-15T18:06:06.857864] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-15T18:06:06.908982] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:06:07.594427] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:06:07.657935] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-15T18:06:07.924155] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T18:06:08.457896] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-15T18:06:09.232416] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:06:09.257820] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-15T18:06:10.057860] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-15T18:06:10.423406] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T18:06:10.857882] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-15T18:06:11.147291] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T18:06:11.228763] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:06:11.232675] [INFO ] [REMOTE ] DLB: Full fetch complete (35114 records). [2025-09-15T18:06:11.232789] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-15T18:06:11.351394] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:06:11.624309] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-15T18:06:11.624409] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-15T18:06:11.625024] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-15T18:06:11.625067] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-15T18:06:11.625976] [DEBUG] [LOCAL ] DLB: Trimmed 35114 records to 23670 (keeping 150 days of data) [2025-09-15T18:06:11.682896] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-15T18:06:11.776496] [DEBUG] [LOCAL ] DLB: Primary data saved (23670 records). [2025-09-15T18:06:11.776630] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-15T18:06:11.776748] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 24.5s. Estimated remaining: 3h 3m 46s. Rate: 9.5 symbols/min [2025-09-15T18:06:11.950130] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:11.971987] [DEBUG] [LOCAL ] DLX: Loaded 21803 existing records from primary storage. [2025-09-15T18:06:11.972113] [INFO ] [MAIN ] DLX: Loaded 21803 existing records. [2025-09-15T18:06:12.146015] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:12.146262] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-15T18:06:12.146308] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-15T18:06:12.146911] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-15T18:06:12.146963] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-15T18:06:12.425937] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:06:12.467494] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-15T18:06:12.506412] [INFO ] [REMOTE ] DLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:13.136340] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T18:06:13.137483] [INFO ] [REMOTE ] DLNG: Full fetch complete (7348 records). [2025-09-15T18:06:13.137552] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-15T18:06:13.263027] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-15T18:06:13.490358] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-15T18:06:13.490435] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-15T18:06:13.490609] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-15T18:06:13.490663] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-15T18:06:13.491054] [DEBUG] [LOCAL ] DLNG: Trimmed 7348 records to 4259 (keeping 150 days of data) [2025-09-15T18:06:13.515802] [DEBUG] [LOCAL ] DLNG: Primary data saved (4259 records). [2025-09-15T18:06:13.515878] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-15T18:06:13.515959] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 20.3s. Estimated remaining: 3h 3m 27s. Rate: 9.5 symbols/min [2025-09-15T18:06:13.682357] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:13.696614] [DEBUG] [LOCAL ] DLY: Loaded 13869 existing records from primary storage. [2025-09-15T18:06:13.696745] [INFO ] [MAIN ] DLY: Loaded 13869 existing records. [2025-09-15T18:06:13.875604] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:13.875896] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-15T18:06:13.875943] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-15T18:06:13.876457] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-15T18:06:13.876506] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-15T18:06:14.067690] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-15T18:06:14.223098] [INFO ] [REMOTE ] DLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:14.857875] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-15T18:06:15.657905] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-15T18:06:15.887193] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-15T18:06:16.457853] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-15T18:06:16.563604] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-15T18:06:16.614498] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T18:06:16.772190] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T18:06:17.257890] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-15T18:06:17.900323] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:06:18.057933] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-15T18:06:18.446676] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:06:18.452230] [INFO ] [REMOTE ] DKS: Full fetch complete (54213 records). [2025-09-15T18:06:18.452339] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-15T18:06:18.831183] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-15T18:06:18.831278] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-15T18:06:18.831989] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-15T18:06:18.832036] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-15T18:06:18.833246] [DEBUG] [LOCAL ] DKS: Trimmed 54213 records to 36782 (keeping 150 days of data) [2025-09-15T18:06:18.895067] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-15T18:06:19.080452] [DEBUG] [LOCAL ] DKS: Primary data saved (36782 records). [2025-09-15T18:06:19.080615] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-15T18:06:19.081521] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 33.2s. Estimated remaining: 3h 3m 18s. Rate: 9.5 symbols/min [2025-09-15T18:06:19.254230] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:19.260432] [DEBUG] [LOCAL ] DMA: Loaded 3632 existing records from primary storage. [2025-09-15T18:06:19.260555] [INFO ] [MAIN ] DMA: Loaded 3632 existing records. [2025-09-15T18:06:19.438105] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:19.438371] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-15T18:06:19.438416] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-15T18:06:19.438633] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-15T18:06:19.438709] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-15T18:06:19.664164] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-15T18:06:19.831831] [INFO ] [REMOTE ] DMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:19.871503] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:06:20.127542] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:06:20.457909] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-15T18:06:20.646925] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:06:21.146153] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T18:06:21.257934] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-15T18:06:22.057965] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-15T18:06:22.532818] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T18:06:22.575834] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:06:22.857879] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-15T18:06:23.657936] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-15T18:06:23.723794] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T18:06:24.457895] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-15T18:06:24.704278] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:06:25.257870] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-15T18:06:25.763706] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:06:26.007543] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:06:26.057913] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-15T18:06:26.857906] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-15T18:06:27.284267] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:06:27.657865] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-15T18:06:28.284373] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:06:28.290112] [INFO ] [REMOTE ] DLR: Full fetch complete (55861 records). [2025-09-15T18:06:28.290258] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-15T18:06:28.469744] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-15T18:06:28.680214] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-15T18:06:28.680305] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-15T18:06:28.681024] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-15T18:06:28.681080] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-15T18:06:28.682389] [DEBUG] [LOCAL ] DLR: Trimmed 55861 records to 37449 (keeping 150 days of data) [2025-09-15T18:06:28.821835] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T18:06:28.930244] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:06:28.960627] [DEBUG] [LOCAL ] DLR: Primary data saved (37449 records). [2025-09-15T18:06:28.960794] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-15T18:06:28.961972] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 31.2s. Estimated remaining: 3h 3m 22s. Rate: 9.5 symbols/min [2025-09-15T18:06:29.139838] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:29.151226] [DEBUG] [LOCAL ] DMB: Loaded 8087 existing records from primary storage. [2025-09-15T18:06:29.151369] [INFO ] [MAIN ] DMB: Loaded 8087 existing records. [2025-09-15T18:06:29.263029] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-15T18:06:29.331164] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:29.331450] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-15T18:06:29.331498] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-15T18:06:29.331903] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-15T18:06:29.331954] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-15T18:06:29.686058] [INFO ] [REMOTE ] DMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:30.057868] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-15T18:06:30.293739] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:06:30.514254] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:06:30.857878] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-15T18:06:31.561686] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:06:31.564490] [INFO ] [REMOTE ] DLY: Full fetch complete (20213 records). [2025-09-15T18:06:31.564566] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-15T18:06:31.565087] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:06:31.565172] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:06:31.565208] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:06:31.565245] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-15T18:06:31.565301] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-15T18:06:31.565420] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-09-15T18:06:31.565804] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-09-15T18:06:31.565897] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLY took 18.0s. Estimated remaining: 3h 3m 5s. Rate: 9.5 symbols/min [2025-09-15T18:06:31.663517] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-15T18:06:31.739727] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:31.748175] [DEBUG] [LOCAL ] DMO: Loaded 7071 existing records from primary storage. [2025-09-15T18:06:31.748258] [INFO ] [MAIN ] DMO: Loaded 7071 existing records. [2025-09-15T18:06:31.923010] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:31.923227] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-15T18:06:31.923280] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-15T18:06:31.923673] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-15T18:06:31.923723] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-15T18:06:32.279005] [INFO ] [REMOTE ] DMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:32.457882] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-15T18:06:32.504252] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:06:33.204076] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T18:06:33.257885] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-15T18:06:34.058062] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-15T18:06:34.059892] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:06:34.579613] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T18:06:34.857892] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-15T18:06:35.657869] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-15T18:06:35.904350] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:06:36.457869] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-15T18:06:36.463726] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T18:06:36.465008] [INFO ] [REMOTE ] DMA: Full fetch complete (5026 records). [2025-09-15T18:06:36.465080] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-15T18:06:36.829981] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-15T18:06:36.830068] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-15T18:06:36.830240] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-15T18:06:36.830283] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-15T18:06:36.830692] [DEBUG] [LOCAL ] DMA: Trimmed 5026 records to 3612 (keeping 150 days of data) [2025-09-15T18:06:36.854592] [DEBUG] [LOCAL ] DMA: Primary data saved (3612 records). [2025-09-15T18:06:36.854766] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-15T18:06:36.854873] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DMA took 17.8s. Estimated remaining: 3h 2m 56s. Rate: 9.5 symbols/min [2025-09-15T18:06:37.033437] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:37.076589] [DEBUG] [LOCAL ] DNA: Loaded 36266 existing records from primary storage. [2025-09-15T18:06:37.076763] [INFO ] [MAIN ] DNA: Loaded 36266 existing records. [2025-09-15T18:06:37.250046] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:37.250321] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-15T18:06:37.250366] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-15T18:06:37.251081] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-15T18:06:37.251137] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-15T18:06:37.263748] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-15T18:06:37.604425] [INFO ] [REMOTE ] DNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:37.817305] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:06:37.852965] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:06:38.057856] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-15T18:06:38.546725] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T18:06:38.857921] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-15T18:06:39.578876] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T18:06:39.657832] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-15T18:06:40.453309] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:06:40.457802] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-15T18:06:41.150810] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T18:06:41.257867] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-15T18:06:41.738266] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T18:06:42.057902] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-15T18:06:42.857882] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-15T18:06:42.924045] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:06:43.359692] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T18:06:43.657926] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-15T18:06:44.457838] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-15T18:06:44.769316] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:06:44.772523] [INFO ] [REMOTE ] DLX: Full fetch complete (32410 records). [2025-09-15T18:06:44.772632] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-15T18:06:45.165689] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-15T18:06:45.165769] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-15T18:06:45.166294] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-15T18:06:45.166333] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-15T18:06:45.167061] [DEBUG] [LOCAL ] DLX: Trimmed 32410 records to 21432 (keeping 150 days of data) [2025-09-15T18:06:45.258870] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-15T18:06:45.290850] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:06:45.312693] [DEBUG] [LOCAL ] DLX: Primary data saved (21432 records). [2025-09-15T18:06:45.312795] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-15T18:06:45.312869] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLX took 33.5s. Estimated remaining: 3h 2m 55s. Rate: 9.5 symbols/min [2025-09-15T18:06:45.481481] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:45.513497] [DEBUG] [LOCAL ] DNOW: Loaded 32346 existing records from primary storage. [2025-09-15T18:06:45.513631] [INFO ] [MAIN ] DNOW: Loaded 32346 existing records. [2025-09-15T18:06:45.688513] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:45.688750] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-15T18:06:45.688795] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-15T18:06:45.689445] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-15T18:06:45.689493] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-15T18:06:46.038906] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:46.045266] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:06:46.057807] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-15T18:06:46.787296] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:06:46.857878] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-15T18:06:47.651567] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:06:47.657810] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-15T18:06:48.409376] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:06:48.457841] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-15T18:06:49.155288] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:06:49.157281] [INFO ] [REMOTE ] DMB: Full fetch complete (10777 records). [2025-09-15T18:06:49.157364] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-15T18:06:49.262943] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-15T18:06:49.521810] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-15T18:06:49.521896] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-15T18:06:49.522171] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-15T18:06:49.522245] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-15T18:06:49.522806] [DEBUG] [LOCAL ] DMB: Trimmed 10777 records to 7871 (keeping 150 days of data) [2025-09-15T18:06:49.571910] [DEBUG] [LOCAL ] DMB: Primary data saved (7871 records). [2025-09-15T18:06:49.572045] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-15T18:06:49.572130] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMB took 20.6s. Estimated remaining: 3h 2m 43s. Rate: 9.5 symbols/min [2025-09-15T18:06:49.741038] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:49.765908] [DEBUG] [LOCAL ] DNP: Loaded 24884 existing records from primary storage. [2025-09-15T18:06:49.766052] [INFO ] [MAIN ] DNP: Loaded 24884 existing records. [2025-09-15T18:06:49.948275] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:49.948569] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-15T18:06:49.948618] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-15T18:06:49.949281] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-15T18:06:49.949333] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-15T18:06:50.062960] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-15T18:06:50.304819] [INFO ] [REMOTE ] DNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:50.857873] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-15T18:06:51.265654] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-15T18:06:51.338969] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:06:51.387546] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:06:51.389414] [INFO ] [REMOTE ] DMO: Full fetch complete (10445 records). [2025-09-15T18:06:51.389502] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-15T18:06:51.663025] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-15T18:06:51.755628] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-15T18:06:51.755726] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-15T18:06:51.755991] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-15T18:06:51.756030] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-15T18:06:51.756511] [DEBUG] [LOCAL ] DMO: Trimmed 10445 records to 6850 (keeping 150 days of data) [2025-09-15T18:06:51.800561] [DEBUG] [LOCAL ] DMO: Primary data saved (6850 records). [2025-09-15T18:06:51.800686] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-15T18:06:51.800789] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 20.2s. Estimated remaining: 3h 2m 26s. Rate: 9.5 symbols/min [2025-09-15T18:06:51.985113] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:52.028624] [DEBUG] [LOCAL ] DOC: Loaded 40314 existing records from primary storage. [2025-09-15T18:06:52.028788] [INFO ] [MAIN ] DOC: Loaded 40314 existing records. [2025-09-15T18:06:52.206095] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:52.206353] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-15T18:06:52.206399] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-15T18:06:52.207269] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-15T18:06:52.207322] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-15T18:06:52.463034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-15T18:06:52.573880] [INFO ] [REMOTE ] DOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:53.052408] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T18:06:53.257929] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-15T18:06:53.935348] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:06:54.057850] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-15T18:06:54.729632] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:06:54.857872] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-15T18:06:55.578157] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:06:55.657820] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-15T18:06:56.453727] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:06:56.463123] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-15T18:06:56.980892] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:06:57.257882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-15T18:06:57.959748] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:06:58.057827] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-15T18:06:58.857860] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-15T18:06:58.939887] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T18:06:59.394301] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T18:06:59.657884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-15T18:06:59.832986] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:07:00.458065] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-15T18:07:01.257965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-15T18:07:01.441857] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:07:01.732866] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:07:02.057911] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-15T18:07:02.857917] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-15T18:07:03.178717] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:07:03.657834] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-15T18:07:03.695321] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:07:04.206234] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:07:04.457917] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-15T18:07:05.257895] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-15T18:07:05.506699] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:07:05.544241] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T18:07:06.057873] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-15T18:07:06.857882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-15T18:07:07.286190] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:07:07.324832] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:07:07.657918] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-15T18:07:08.457894] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-15T18:07:08.490718] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:07:08.960626] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:07:09.257912] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-15T18:07:09.531888] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:07:09.536942] [INFO ] [REMOTE ] DNOW: Full fetch complete (47184 records). [2025-09-15T18:07:09.537052] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-15T18:07:09.537741] [FATAL] [VALIDATOR ] DNOW: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:07:09.537823] [FATAL] [MAIN ] DNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:07:09.537870] [WARN ] [MAIN ] DNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:07:09.537912] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-15T18:07:09.537996] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-09-15T18:07:09.538059] [INFO ] [LOCAL ] DNOW: Starting deletion of derivative data. [2025-09-15T18:07:09.538391] [DEBUG] [LOCAL ] DNOW: Deleted derivative data file. [2025-09-15T18:07:09.538526] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNOW took 24.2s. Estimated remaining: 3h 2m 51s. Rate: 9.5 symbols/min [2025-09-15T18:07:09.706892] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:09.751601] [DEBUG] [LOCAL ] DOCN: Loaded 38164 existing records from primary storage. [2025-09-15T18:07:09.751768] [INFO ] [MAIN ] DOCN: Loaded 38164 existing records. [2025-09-15T18:07:09.929134] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:09.929454] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-15T18:07:09.929532] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-15T18:07:09.930328] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-15T18:07:09.930383] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-15T18:07:10.068416] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-15T18:07:10.280093] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:10.541673] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:07:10.857831] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-15T18:07:11.248337] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:07:11.657937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-15T18:07:12.457860] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-15T18:07:12.724351] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:07:13.267078] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-15T18:07:13.268913] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:07:13.274353] [INFO ] [REMOTE ] DNA: Full fetch complete (53163 records). [2025-09-15T18:07:13.274439] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-15T18:07:13.670739] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-15T18:07:13.670955] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-15T18:07:13.672103] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-15T18:07:13.672179] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-15T18:07:13.673936] [DEBUG] [LOCAL ] DNA: Trimmed 53163 records to 35541 (keeping 150 days of data) [2025-09-15T18:07:13.801514] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:07:13.948431] [DEBUG] [LOCAL ] DNA: Primary data saved (35541 records). [2025-09-15T18:07:13.948684] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-15T18:07:13.949398] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 37.1s. Estimated remaining: 3h 2m 39s. Rate: 9.5 symbols/min [2025-09-15T18:07:14.057908] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-15T18:07:14.527809] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:07:14.531930] [INFO ] [REMOTE ] DNP: Full fetch complete (36436 records). [2025-09-15T18:07:14.532031] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-15T18:07:14.865392] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-15T18:07:14.913472] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-15T18:07:14.913568] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-15T18:07:14.914178] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-15T18:07:14.914234] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-15T18:07:14.915465] [DEBUG] [LOCAL ] DNP: Trimmed 36436 records to 24357 (keeping 150 days of data) [2025-09-15T18:07:15.080608] [DEBUG] [LOCAL ] DNP: Primary data saved (24357 records). [2025-09-15T18:07:15.080800] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-15T18:07:15.080910] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 25.5s. Estimated remaining: 3h 2m 19s. Rate: 9.5 symbols/min [2025-09-15T18:07:16.244430] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T18:07:16.256108] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-15T18:07:16.419168] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:07:16.457861] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-15T18:07:17.646842] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:07:17.659051] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-15T18:07:17.722609] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:07:18.057983] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-15T18:07:18.851614] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:07:18.857976] [INFO ] [REMOTE ] DOC: Full fetch complete (58180 records). [2025-09-15T18:07:18.858160] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-15T18:07:19.249731] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-15T18:07:19.249917] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-15T18:07:19.250719] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-15T18:07:19.250788] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-15T18:07:19.252131] [DEBUG] [LOCAL ] DOC: Trimmed 58180 records to 39535 (keeping 150 days of data) [2025-09-15T18:07:19.502889] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T18:07:19.519283] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-15T18:07:19.547360] [DEBUG] [LOCAL ] DOC: Primary data saved (39535 records). [2025-09-15T18:07:19.547492] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-15T18:07:19.547576] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 27.7s. Estimated remaining: 3h 2m 7s. Rate: 9.5 symbols/min [2025-09-15T18:07:21.118844] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:07:21.134077] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-15T18:07:22.510605] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:07:22.521690] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-15T18:07:24.419030] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:07:24.430094] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-15T18:07:26.039350] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:07:26.050356] [INFO ] [REMOTE ] DOCN: Full fetch complete (54683 records). [2025-09-15T18:07:26.050525] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-15T18:07:26.448812] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-15T18:07:26.448913] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-15T18:07:26.449622] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-15T18:07:26.449687] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-15T18:07:26.451017] [DEBUG] [LOCAL ] DOCN: Trimmed 54683 records to 37526 (keeping 150 days of data) [2025-09-15T18:07:26.686587] [DEBUG] [LOCAL ] DOCN: Primary data saved (37526 records). [2025-09-15T18:07:26.686756] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-15T18:07:26.687376] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 17.1s. Estimated remaining: 3h 2m 3s. Rate: 9.5 symbols/min [2025-09-15T18:07:27.327786] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.359400] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.365005] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.399110] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.466279] [DEBUG] [LOCAL ] DOUG: Loaded 26246 existing records from primary storage. [2025-09-15T18:07:27.477910] [INFO ] [MAIN ] DOUG: Loaded 26246 existing records. [2025-09-15T18:07:27.501690] [DEBUG] [LOCAL ] DOLE: Loaded 28724 existing records from primary storage. [2025-09-15T18:07:27.520693] [DEBUG] [LOCAL ] DOV: Loaded 33991 existing records from primary storage. [2025-09-15T18:07:27.536934] [DEBUG] [LOCAL ] DOCS: Loaded 38355 existing records from primary storage. [2025-09-15T18:07:27.536267] [INFO ] [MAIN ] DOV: Loaded 33991 existing records. [2025-09-15T18:07:27.536331] [INFO ] [MAIN ] DOLE: Loaded 28724 existing records. [2025-09-15T18:07:27.560385] [INFO ] [MAIN ] DOCS: Loaded 38355 existing records. [2025-09-15T18:07:28.116137] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.214569] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.251732] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.247994] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.255925] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-15T18:07:28.255625] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.256324] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256021] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256504] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-15T18:07:28.256660] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-15T18:07:28.256566] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256853] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-15T18:07:28.257397] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-15T18:07:28.257451] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-15T18:07:28.262788] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-15T18:07:28.262908] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-15T18:07:28.292841] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-15T18:07:28.262855] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-15T18:07:28.292940] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-15T18:07:28.322267] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-15T18:07:29.557061] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.513724] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.598617] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-15T18:07:29.614368] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-15T18:07:29.679886] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.705954] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-15T18:07:29.710742] [INFO ] [REMOTE ] DOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.711799] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-15T18:07:30.744522] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:07:30.750833] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-15T18:07:31.037241] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:07:31.044217] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-15T18:07:31.258291] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:07:31.266597] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-15T18:07:31.399963] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:07:31.409908] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-15T18:07:31.644159] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:07:31.652990] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-15T18:07:32.268834] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:07:32.279421] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-15T18:07:32.610751] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:07:32.621189] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-15T18:07:32.700627] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:07:32.711676] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-15T18:07:32.797513] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T18:07:32.805817] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-15T18:07:33.491991] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:07:33.499389] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-15T18:07:33.981820] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:07:33.990750] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-15T18:07:34.021678] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:07:34.058180] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-15T18:07:34.063484] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:07:34.614188] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:07:34.857914] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-15T18:07:35.180855] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T18:07:35.211346] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:07:35.657870] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-15T18:07:36.457895] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-15T18:07:36.640839] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:07:36.741462] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:07:37.257846] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-15T18:07:37.366474] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T18:07:38.057821] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-15T18:07:38.237414] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:07:38.857883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-15T18:07:39.400734] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T18:07:39.657883] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-15T18:07:40.457867] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-15T18:07:40.555167] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:07:41.236268] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:07:41.257815] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-15T18:07:41.568013] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:07:41.573333] [INFO ] [REMOTE ] DOLE: Full fetch complete (40473 records). [2025-09-15T18:07:41.573439] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-15T18:07:41.945758] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-15T18:07:41.945843] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-15T18:07:41.946469] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-15T18:07:41.946509] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-15T18:07:41.947463] [DEBUG] [LOCAL ] DOLE: Trimmed 40473 records to 28240 (keeping 150 days of data) [2025-09-15T18:07:42.061184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-15T18:07:42.119471] [DEBUG] [LOCAL ] DOLE: Primary data saved (28240 records). [2025-09-15T18:07:42.119781] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-15T18:07:42.119872] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOLE took 15.4s. Estimated remaining: 3h 2m 22s. Rate: 9.5 symbols/min [2025-09-15T18:07:42.290206] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:42.328619] [DEBUG] [LOCAL ] DOW: Loaded 40473 existing records from primary storage. [2025-09-15T18:07:42.328800] [INFO ] [MAIN ] DOW: Loaded 40473 existing records. [2025-09-15T18:07:42.515443] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:42.515741] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-15T18:07:42.515789] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-15T18:07:42.516823] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-15T18:07:42.516881] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-15T18:07:42.867846] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-15T18:07:42.906398] [INFO ] [REMOTE ] DOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:43.112592] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:07:43.485099] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:07:43.657870] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-15T18:07:44.457901] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-15T18:07:44.580790] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T18:07:44.945372] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:07:45.257937] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-15T18:07:45.947788] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T18:07:45.952376] [INFO ] [REMOTE ] DOV: Full fetch complete (49278 records). [2025-09-15T18:07:45.952469] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-15T18:07:45.953123] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:07:45.953206] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:07:45.953253] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:07:45.953316] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-15T18:07:45.953385] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-15T18:07:45.953424] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-09-15T18:07:45.953796] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-09-15T18:07:45.953882] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOV took 19.3s. Estimated remaining: 3h 2m 9s. Rate: 9.5 symbols/min [2025-09-15T18:07:46.063021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-15T18:07:46.128097] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:46.138757] [DEBUG] [LOCAL ] DPG: Loaded 9966 existing records from primary storage. [2025-09-15T18:07:46.138869] [INFO ] [MAIN ] DPG: Loaded 9966 existing records. [2025-09-15T18:07:46.319909] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:46.320165] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-15T18:07:46.320211] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-15T18:07:46.320545] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-15T18:07:46.320591] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-15T18:07:46.675612] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:07:46.678883] [INFO ] [REMOTE ] DPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:46.682759] [INFO ] [REMOTE ] DOUG: Full fetch complete (37985 records). [2025-09-15T18:07:46.682834] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-15T18:07:46.858260] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-15T18:07:47.055026] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-15T18:07:47.055123] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-15T18:07:47.055824] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-15T18:07:47.055879] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-15T18:07:47.057274] [DEBUG] [LOCAL ] DOUG: Trimmed 37985 records to 25700 (keeping 150 days of data) [2025-09-15T18:07:47.207340] [DEBUG] [LOCAL ] DOUG: Primary data saved (25700 records). [2025-09-15T18:07:47.207508] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-15T18:07:47.207606] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOUG took 20.5s. Estimated remaining: 3h 1m 49s. Rate: 9.5 symbols/min [2025-09-15T18:07:47.381853] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:47.414728] [DEBUG] [LOCAL ] DQ: Loaded 31915 existing records from primary storage. [2025-09-15T18:07:47.414899] [INFO ] [MAIN ] DQ: Loaded 31915 existing records. [2025-09-15T18:07:47.598599] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:47.598968] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-15T18:07:47.599122] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-15T18:07:47.600005] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-15T18:07:47.600066] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-15T18:07:47.658896] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-15T18:07:47.832627] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:07:48.036577] [INFO ] [REMOTE ] DQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:48.043967] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:07:48.457867] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-15T18:07:49.175393] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:07:49.257867] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-15T18:07:49.856520] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:07:50.057876] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-15T18:07:50.831455] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:07:50.857826] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-15T18:07:51.087316] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T18:07:51.478159] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:07:51.657930] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-15T18:07:52.457895] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-15T18:07:53.257904] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-15T18:07:53.326717] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T18:07:53.559530] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:07:54.057921] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-15T18:07:54.327629] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:07:54.857902] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-15T18:07:55.473208] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:07:55.478481] [INFO ] [REMOTE ] DOCS: Full fetch complete (56115 records). [2025-09-15T18:07:55.478592] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-15T18:07:55.663316] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-15T18:07:55.852811] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-15T18:07:55.852886] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-15T18:07:55.853578] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-15T18:07:55.853692] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-15T18:07:55.854843] [DEBUG] [LOCAL ] DOCS: Trimmed 56115 records to 37582 (keeping 150 days of data) [2025-09-15T18:07:56.082350] [DEBUG] [LOCAL ] DOCS: Primary data saved (37582 records). [2025-09-15T18:07:56.082785] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-15T18:07:56.082960] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 29.4s. Estimated remaining: 3h 1m 49s. Rate: 9.5 symbols/min [2025-09-15T18:07:56.255157] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:56.282883] [DEBUG] [LOCAL ] DRD: Loaded 26676 existing records from primary storage. [2025-09-15T18:07:56.283055] [INFO ] [MAIN ] DRD: Loaded 26676 existing records. [2025-09-15T18:07:56.405985] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:07:56.458392] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-15T18:07:56.477765] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:56.478003] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-15T18:07:56.478061] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-15T18:07:56.478960] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-15T18:07:56.479017] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-15T18:07:56.802555] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:07:56.886056] [INFO ] [REMOTE ] DRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:57.257921] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-15T18:07:57.971495] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T18:07:58.057915] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-15T18:07:58.373094] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:07:58.857897] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-15T18:07:59.057849] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T18:07:59.657924] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-15T18:08:00.213071] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:08:00.428633] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T18:08:00.457878] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-15T18:08:01.257880] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-15T18:08:01.693719] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:08:02.057911] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-15T18:08:02.076680] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:08:02.857912] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-15T18:08:03.067185] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:08:03.657922] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-15T18:08:03.779812] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:08:04.457875] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-15T18:08:05.257851] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-15T18:08:05.662751] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T18:08:05.938832] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:08:06.057899] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-15T18:08:06.207042] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:08:06.857880] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-15T18:08:07.657897] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-15T18:08:08.033727] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T18:08:08.340329] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:08:08.460022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-15T18:08:08.460857] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:08:08.463608] [INFO ] [REMOTE ] DPG: Full fetch complete (14319 records). [2025-09-15T18:08:08.463705] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-15T18:08:08.838856] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-15T18:08:08.839118] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-15T18:08:08.839667] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-15T18:08:08.839739] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-15T18:08:08.840278] [DEBUG] [LOCAL ] DPG: Trimmed 14319 records to 9724 (keeping 150 days of data) [2025-09-15T18:08:08.902625] [DEBUG] [LOCAL ] DPG: Primary data saved (9724 records). [2025-09-15T18:08:08.902774] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-15T18:08:08.902893] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 22.9s. Estimated remaining: 3h 2m 0s. Rate: 9.5 symbols/min [2025-09-15T18:08:09.075842] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:09.116196] [DEBUG] [LOCAL ] DRH: Loaded 37808 existing records from primary storage. [2025-09-15T18:08:09.116344] [INFO ] [MAIN ] DRH: Loaded 37808 existing records. [2025-09-15T18:08:09.263110] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-15T18:08:09.298958] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:09.299234] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-15T18:08:09.299280] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-15T18:08:09.300193] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-15T18:08:09.300252] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-15T18:08:09.651843] [INFO ] [REMOTE ] DRH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:09.842337] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:08:09.847707] [INFO ] [REMOTE ] DQ: Full fetch complete (47257 records). [2025-09-15T18:08:09.847805] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-15T18:08:10.063087] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-15T18:08:10.218903] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-15T18:08:10.218987] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-15T18:08:10.219832] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-15T18:08:10.219888] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-15T18:08:10.220947] [DEBUG] [LOCAL ] DQ: Trimmed 47257 records to 31306 (keeping 150 days of data) [2025-09-15T18:08:10.405407] [DEBUG] [LOCAL ] DQ: Primary data saved (31306 records). [2025-09-15T18:08:10.405549] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-15T18:08:10.405633] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 23.2s. Estimated remaining: 3h 1m 41s. Rate: 9.5 symbols/min [2025-09-15T18:08:10.571868] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:10.604933] [DEBUG] [LOCAL ] DRI: Loaded 35431 existing records from primary storage. [2025-09-15T18:08:10.605073] [INFO ] [MAIN ] DRI: Loaded 35431 existing records. [2025-09-15T18:08:10.777665] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:10.777950] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-15T18:08:10.778000] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-15T18:08:10.778870] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-15T18:08:10.778918] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-15T18:08:10.871630] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-15T18:08:11.132702] [INFO ] [REMOTE ] DRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:11.433775] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T18:08:11.580827] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:08:11.657816] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-15T18:08:12.457915] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-15T18:08:12.609097] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:08:12.978346] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:08:13.257946] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-15T18:08:14.006594] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:08:14.016580] [INFO ] [REMOTE ] DOW: Full fetch complete (58411 records). [2025-09-15T18:08:14.016890] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-15T18:08:14.063175] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-15T18:08:14.445352] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-15T18:08:14.445482] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-15T18:08:14.446725] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-15T18:08:14.446793] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-15T18:08:14.448979] [DEBUG] [LOCAL ] DOW: Trimmed 58411 records to 39693 (keeping 150 days of data) [2025-09-15T18:08:14.739702] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:08:14.767270] [DEBUG] [LOCAL ] DOW: Primary data saved (39693 records). [2025-09-15T18:08:14.767427] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-15T18:08:14.768950] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DOW took 32.6s. Estimated remaining: 3h 1m 29s. Rate: 9.5 symbols/min [2025-09-15T18:08:14.864874] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-15T18:08:14.951882] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:14.961500] [DEBUG] [LOCAL ] DRLL: Loaded 6601 existing records from primary storage. [2025-09-15T18:08:14.961633] [INFO ] [MAIN ] DRLL: Loaded 6601 existing records. [2025-09-15T18:08:15.141249] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:15.141537] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-15T18:08:15.141587] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-15T18:08:15.141860] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-15T18:08:15.141909] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-15T18:08:15.507556] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:15.634056] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:08:15.639146] [INFO ] [REMOTE ] DRD: Full fetch complete (38617 records). [2025-09-15T18:08:15.639232] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-15T18:08:15.663030] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-15T18:08:16.029583] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-15T18:08:16.029693] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-15T18:08:16.030335] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-15T18:08:16.030379] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-15T18:08:16.031315] [DEBUG] [LOCAL ] DRD: Trimmed 38617 records to 26240 (keeping 150 days of data) [2025-09-15T18:08:16.202539] [DEBUG] [LOCAL ] DRD: Primary data saved (26240 records). [2025-09-15T18:08:16.202719] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-15T18:08:16.202836] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 20.1s. Estimated remaining: 3h 1m 10s. Rate: 9.5 symbols/min [2025-09-15T18:08:16.376907] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:16.412970] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:08:16.430743] [DEBUG] [LOCAL ] DSL: Loaded 20334 existing records from primary storage. [2025-09-15T18:08:16.430893] [INFO ] [MAIN ] DSL: Loaded 20334 existing records. [2025-09-15T18:08:16.462990] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-15T18:08:16.629735] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:16.629988] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-15T18:08:16.630038] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-15T18:08:16.630690] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-15T18:08:16.630750] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-15T18:08:17.015493] [INFO ] [REMOTE ] DSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:17.086417] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:08:17.257915] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-15T18:08:18.059199] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-15T18:08:18.064883] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:08:18.537004] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:08:18.857887] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-15T18:08:19.405979] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:08:19.657880] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-15T18:08:20.457898] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-15T18:08:20.570126] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:08:21.215941] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:08:21.257873] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-15T18:08:21.772698] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:08:22.057862] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-15T18:08:22.786204] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T18:08:22.857847] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-15T18:08:23.029881] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:08:23.657884] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-15T18:08:23.975764] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T18:08:24.457885] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-15T18:08:24.497766] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T18:08:25.257895] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-15T18:08:26.057875] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-15T18:08:26.176168] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:08:26.359995] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:08:26.365830] [INFO ] [REMOTE ] DRH: Full fetch complete (54470 records). [2025-09-15T18:08:26.365946] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-15T18:08:26.746121] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-15T18:08:26.746202] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-15T18:08:26.746935] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-15T18:08:26.746986] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-15T18:08:26.748153] [DEBUG] [LOCAL ] DRH: Trimmed 54470 records to 37030 (keeping 150 days of data) [2025-09-15T18:08:26.857965] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-15T18:08:26.984854] [DEBUG] [LOCAL ] DRH: Primary data saved (37030 records). [2025-09-15T18:08:26.985036] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-15T18:08:26.986051] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 18.1s. Estimated remaining: 3h 1m 16s. Rate: 9.5 symbols/min [2025-09-15T18:08:27.158298] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:27.176226] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:08:27.190481] [DEBUG] [LOCAL ] DSM: Loaded 10547 existing records from primary storage. [2025-09-15T18:08:27.190616] [INFO ] [MAIN ] DSM: Loaded 10547 existing records. [2025-09-15T18:08:27.371308] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:27.371595] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-15T18:08:27.371682] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-15T18:08:27.372065] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-15T18:08:27.372134] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-15T18:08:27.663135] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-15T18:08:27.725892] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:27.734897] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:08:28.457941] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-15T18:08:29.063066] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:08:29.257854] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-15T18:08:29.666837] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:08:30.057876] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-15T18:08:30.815888] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:08:30.857834] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-15T18:08:31.113205] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:08:31.657883] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-15T18:08:32.465123] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-15T18:08:32.470376] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:08:32.755388] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:08:32.758546] [INFO ] [REMOTE ] DSL: Full fetch complete (30724 records). [2025-09-15T18:08:32.758621] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-15T18:08:33.129605] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-15T18:08:33.129775] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-15T18:08:33.130345] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-15T18:08:33.130397] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-15T18:08:33.143507] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:08:33.143149] [DEBUG] [LOCAL ] DSL: Trimmed 30724 records to 19964 (keeping 150 days of data) [2025-09-15T18:08:33.260690] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-15T18:08:33.275130] [DEBUG] [LOCAL ] DSL: Primary data saved (19964 records). [2025-09-15T18:08:33.275253] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-15T18:08:33.275352] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DSL took 17.1s. Estimated remaining: 3h 1m 9s. Rate: 9.5 symbols/min [2025-09-15T18:08:33.447358] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:33.450366] [DEBUG] [LOCAL ] DSMC: Loaded 1241 existing records from primary storage. [2025-09-15T18:08:33.450446] [INFO ] [MAIN ] DSMC: Loaded 1241 existing records. [2025-09-15T18:08:33.660079] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:33.660363] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-15T18:08:33.660410] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-15T18:08:33.660603] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-15T18:08:33.660682] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-15T18:08:34.016281] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:34.057833] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-15T18:08:34.424988] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:08:34.491620] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:08:34.857866] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-15T18:08:35.657875] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-15T18:08:36.133749] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T18:08:36.457876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-15T18:08:36.561047] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:08:36.566268] [INFO ] [REMOTE ] DRI: Full fetch complete (52021 records). [2025-09-15T18:08:36.566395] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-15T18:08:36.959476] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-15T18:08:36.959557] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-15T18:08:36.960247] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-15T18:08:36.960324] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-15T18:08:36.961543] [DEBUG] [LOCAL ] DRI: Trimmed 52021 records to 34727 (keeping 150 days of data) [2025-09-15T18:08:37.077191] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:08:37.198607] [DEBUG] [LOCAL ] DRI: Primary data saved (34727 records). [2025-09-15T18:08:37.198798] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-15T18:08:37.198886] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRI took 26.8s. Estimated remaining: 3h 0m 57s. Rate: 9.5 symbols/min [2025-09-15T18:08:37.262949] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-15T18:08:37.370996] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:37.387551] [DEBUG] [LOCAL ] DSU: Loaded 15655 existing records from primary storage. [2025-09-15T18:08:37.387705] [INFO ] [MAIN ] DSU: Loaded 15655 existing records. [2025-09-15T18:08:37.565863] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:37.566130] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-15T18:08:37.566176] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-15T18:08:37.566759] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-15T18:08:37.566821] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-15T18:08:37.919978] [INFO ] [REMOTE ] DSU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:38.009466] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:08:38.057885] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-15T18:08:38.857873] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-15T18:08:38.902481] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:08:39.643250] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:08:39.657814] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-15T18:08:40.185035] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:08:40.457870] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-15T18:08:40.912938] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T18:08:41.257879] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-15T18:08:41.591890] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T18:08:42.057901] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-15T18:08:42.398150] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T18:08:42.857859] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-15T18:08:43.154706] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-15T18:08:43.657876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-15T18:08:44.093050] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:08:44.457882] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-15T18:08:45.257917] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-15T18:08:45.817147] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:08:45.954904] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T18:08:46.057886] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-15T18:08:46.713627] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T18:08:46.857920] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-15T18:08:47.398531] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T18:08:47.657903] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-15T18:08:48.457922] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-15T18:08:48.676627] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:08:48.980079] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:08:48.980954] [INFO ] [REMOTE ] DSMC: Full fetch complete (2234 records). [2025-09-15T18:08:48.981022] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-15T18:08:49.262963] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-15T18:08:49.345897] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-15T18:08:49.345973] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-15T18:08:49.346058] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-15T18:08:49.346096] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-15T18:08:49.346431] [DEBUG] [LOCAL ] DSMC: Trimmed 2234 records to 1215 (keeping 150 days of data) [2025-09-15T18:08:49.354307] [DEBUG] [LOCAL ] DSMC: Primary data saved (1215 records). [2025-09-15T18:08:49.354389] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-15T18:08:49.354461] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DSMC took 16.1s. Estimated remaining: 3h 1m 6s. Rate: 9.5 symbols/min [2025-09-15T18:08:49.524871] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:49.542145] [DEBUG] [LOCAL ] DSX: Loaded 17812 existing records from primary storage. [2025-09-15T18:08:49.542265] [INFO ] [MAIN ] DSX: Loaded 17812 existing records. [2025-09-15T18:08:49.726437] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:49.726759] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-15T18:08:49.726815] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-15T18:08:49.727312] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-15T18:08:49.727379] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-15T18:08:50.061030] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-15T18:08:50.082170] [INFO ] [REMOTE ] DSX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:50.316037] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T18:08:50.857874] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-15T18:08:50.879394] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:08:50.881135] [INFO ] [REMOTE ] DRLL: Full fetch complete (11147 records). [2025-09-15T18:08:50.881263] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-15T18:08:51.239903] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-15T18:08:51.239985] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-15T18:08:51.240232] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-15T18:08:51.240272] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-15T18:08:51.240783] [DEBUG] [LOCAL ] DRLL: Trimmed 11147 records to 6438 (keeping 150 days of data) [2025-09-15T18:08:51.286817] [DEBUG] [LOCAL ] DRLL: Primary data saved (6438 records). [2025-09-15T18:08:51.287055] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-15T18:08:51.287177] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DRLL took 36.5s. Estimated remaining: 3h 0m 48s. Rate: 9.5 symbols/min [2025-09-15T18:08:51.455758] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:51.500480] [DEBUG] [LOCAL ] DT: Loaded 39809 existing records from primary storage. [2025-09-15T18:08:51.500660] [INFO ] [MAIN ] DT: Loaded 39809 existing records. [2025-09-15T18:08:51.657974] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-15T18:08:51.678771] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:51.679017] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-15T18:08:51.679065] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-15T18:08:51.679970] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-15T18:08:51.680037] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-15T18:08:52.035763] [INFO ] [REMOTE ] DT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:52.282861] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:08:52.457884] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-15T18:08:53.257915] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-15T18:08:54.057889] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-15T18:08:54.229254] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-15T18:08:54.786194] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T18:08:54.857815] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-15T18:08:54.945521] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:08:55.189149] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-15T18:08:55.657886] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-15T18:08:55.673858] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:08:56.457888] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-15T18:08:57.035045] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:08:57.257824] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-15T18:08:57.659178] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:08:57.888312] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T18:08:57.890426] [INFO ] [REMOTE ] DSM: Full fetch complete (17935 records). [2025-09-15T18:08:57.890506] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-15T18:08:58.059005] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-15T18:08:58.255891] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-15T18:08:58.255962] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-15T18:08:58.256329] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-15T18:08:58.256367] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-15T18:08:58.256949] [DEBUG] [LOCAL ] DSM: Trimmed 17935 records to 10060 (keeping 150 days of data) [2025-09-15T18:08:58.316290] [DEBUG] [LOCAL ] DSM: Primary data saved (10060 records). [2025-09-15T18:08:58.316411] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-15T18:08:58.316533] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSM took 31.3s. Estimated remaining: 3h 0m 43s. Rate: 9.5 symbols/min [2025-09-15T18:08:58.502397] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:58.510198] [DEBUG] [LOCAL ] DTB: Loaded 3720 existing records from primary storage. [2025-09-15T18:08:58.510393] [INFO ] [MAIN ] DTB: Loaded 3720 existing records. [2025-09-15T18:08:58.698933] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:58.699289] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-15T18:08:58.699339] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-15T18:08:58.699613] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-15T18:08:58.699710] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-15T18:08:58.862867] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-15T18:08:59.073811] [INFO ] [REMOTE ] DTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:59.413388] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:08:59.657889] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-15T18:08:59.914161] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:09:00.287619] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:09:00.457918] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-15T18:09:01.257875] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-15T18:09:01.551163] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:09:01.799462] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:09:02.057894] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-15T18:09:02.857869] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-15T18:09:03.348147] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:09:03.657909] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-15T18:09:04.457885] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-15T18:09:04.771488] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:09:05.257870] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-15T18:09:05.360209] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T18:09:05.612480] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T18:09:06.058011] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-15T18:09:06.475703] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-15T18:09:06.838392] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:09:06.857964] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-15T18:09:07.657882] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-15T18:09:08.457896] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-15T18:09:08.657660] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:09:08.888091] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T18:09:09.043827] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T18:09:09.257922] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-15T18:09:09.620854] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:09:10.057886] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-15T18:09:10.857839] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-15T18:09:10.966439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:09:11.657875] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-15T18:09:12.242839] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:09:12.261860] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:09:12.263195] [INFO ] [REMOTE ] DTB: Full fetch complete (4980 records). [2025-09-15T18:09:12.263266] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-15T18:09:12.463980] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-15T18:09:12.636577] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-15T18:09:12.636713] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-15T18:09:12.636901] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-15T18:09:12.636945] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-15T18:09:12.637439] [DEBUG] [LOCAL ] DTB: Trimmed 4980 records to 3739 (keeping 150 days of data) [2025-09-15T18:09:12.661636] [DEBUG] [LOCAL ] DTB: Primary data saved (3739 records). [2025-09-15T18:09:12.661800] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-15T18:09:12.661903] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DTB took 14.3s. Estimated remaining: 3h 0m 58s. Rate: 9.5 symbols/min [2025-09-15T18:09:12.836354] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:12.883160] [DEBUG] [LOCAL ] DTE: Loaded 35858 existing records from primary storage. [2025-09-15T18:09:12.883301] [INFO ] [MAIN ] DTE: Loaded 35858 existing records. [2025-09-15T18:09:13.061842] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:13.062124] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-15T18:09:13.062180] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-15T18:09:13.063068] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-15T18:09:13.063131] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-15T18:09:13.263045] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-15T18:09:13.425689] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:09:13.445874] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:14.057864] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-15T18:09:14.783412] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:09:14.786115] [INFO ] [REMOTE ] DSU: Full fetch complete (23001 records). [2025-09-15T18:09:14.786190] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-15T18:09:14.786702] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:09:14.786775] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:14.786822] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:14.786865] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-15T18:09:14.786929] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-09-15T18:09:14.786967] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-09-15T18:09:14.787299] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-09-15T18:09:14.787391] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSU took 37.6s. Estimated remaining: 3h 0m 41s. Rate: 9.5 symbols/min [2025-09-15T18:09:14.863003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-15T18:09:14.961030] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:14.961330] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-15T18:09:14.961385] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-15T18:09:14.961556] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-15T18:09:14.961704] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-15T18:09:14.961777] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-15T18:09:14.961824] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-15T18:09:15.359734] [INFO ] [REMOTE ] DTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:15.364829] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:09:15.657878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-15T18:09:16.078387] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:09:16.139792] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T18:09:16.142979] [INFO ] [REMOTE ] DSX: Full fetch complete (27465 records). [2025-09-15T18:09:16.143063] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-15T18:09:16.468365] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-15T18:09:16.515329] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-15T18:09:16.515431] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-15T18:09:16.516000] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-15T18:09:16.516070] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-15T18:09:16.517094] [DEBUG] [LOCAL ] DSX: Trimmed 27465 records to 17629 (keeping 150 days of data) [2025-09-15T18:09:16.629577] [DEBUG] [LOCAL ] DSX: Primary data saved (17629 records). [2025-09-15T18:09:16.629751] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-15T18:09:16.629869] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSX took 27.3s. Estimated remaining: 3h 0m 23s. Rate: 9.5 symbols/min [2025-09-15T18:09:16.802953] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:16.810817] [DEBUG] [LOCAL ] DTG: Loaded 4209 existing records from primary storage. [2025-09-15T18:09:16.810934] [INFO ] [MAIN ] DTG: Loaded 4209 existing records. [2025-09-15T18:09:16.982706] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:09:17.006565] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:17.006987] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-15T18:09:17.007046] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-15T18:09:17.007522] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-15T18:09:17.007580] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-15T18:09:17.263228] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-15T18:09:17.381722] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:18.057888] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-15T18:09:18.497240] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:09:18.857889] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-15T18:09:18.967236] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:09:19.278794] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T18:09:19.657877] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-15T18:09:20.457876] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-15T18:09:21.257968] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-15T18:09:21.429688] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:09:22.020683] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:09:22.057907] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-15T18:09:22.186098] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T18:09:22.677975] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:09:22.857890] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-15T18:09:23.657892] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-15T18:09:24.417863] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T18:09:24.423597] [INFO ] [REMOTE ] DT: Full fetch complete (57574 records). [2025-09-15T18:09:24.423722] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-15T18:09:24.468355] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-15T18:09:24.804437] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-15T18:09:24.804515] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-15T18:09:24.805284] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-15T18:09:24.805329] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-15T18:09:24.806495] [DEBUG] [LOCAL ] DT: Trimmed 57574 records to 39040 (keeping 150 days of data) [2025-09-15T18:09:24.904740] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:09:25.051850] [DEBUG] [LOCAL ] DT: Primary data saved (39040 records). [2025-09-15T18:09:25.052000] [INFO ] [MAIN ] DT: Full history saved. [2025-09-15T18:09:25.053358] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 33.8s. Estimated remaining: 3h 0m 22s. Rate: 9.5 symbols/min [2025-09-15T18:09:25.222028] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:25.261077] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-15T18:09:25.263275] [DEBUG] [LOCAL ] DTM: Loaded 32519 existing records from primary storage. [2025-09-15T18:09:25.263562] [INFO ] [MAIN ] DTM: Loaded 32519 existing records. [2025-09-15T18:09:25.442810] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:25.443106] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-15T18:09:25.443352] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-15T18:09:25.455411] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-15T18:09:25.465721] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-15T18:09:25.586089] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:09:25.786323] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:09:25.848218] [INFO ] [REMOTE ] DTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:26.057837] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-15T18:09:26.857932] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-15T18:09:27.339739] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:09:27.657913] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-15T18:09:28.043840] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T18:09:28.153753] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T18:09:28.457912] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-15T18:09:28.868610] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:09:28.869747] [INFO ] [REMOTE ] DTF: Full fetch complete (1336 records). [2025-09-15T18:09:28.869820] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-15T18:09:29.054432] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T18:09:29.054720] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:29.054803] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:29.054854] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-15T18:09:29.054938] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-15T18:09:29.054978] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-15T18:09:29.055095] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-15T18:09:29.055190] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTF took 14.3s. Estimated remaining: 3h 0m 9s. Rate: 9.5 symbols/min [2025-09-15T18:09:29.231209] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:29.237434] [DEBUG] [LOCAL ] DTW: Loaded 3562 existing records from primary storage. [2025-09-15T18:09:29.237571] [INFO ] [MAIN ] DTW: Loaded 3562 existing records. [2025-09-15T18:09:29.267474] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-15T18:09:29.429432] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:29.429803] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-15T18:09:29.429862] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-15T18:09:29.430219] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-15T18:09:29.430270] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-15T18:09:29.815590] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:30.057884] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-15T18:09:30.857931] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-15T18:09:31.032469] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:09:31.402049] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:09:31.470372] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T18:09:31.657907] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-15T18:09:32.175693] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T18:09:32.457896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-15T18:09:33.257887] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-15T18:09:34.041896] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:09:34.057829] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-15T18:09:34.856889] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:09:34.866512] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-15T18:09:35.098518] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:09:35.237545] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T18:09:35.657861] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-15T18:09:36.457881] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-15T18:09:36.841220] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T18:09:36.949717] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:09:37.257862] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-15T18:09:37.868017] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:09:38.057857] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-15T18:09:38.614435] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:09:38.857865] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-15T18:09:39.657928] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-15T18:09:40.224754] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T18:09:40.339285] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:09:40.344874] [INFO ] [REMOTE ] DTE: Full fetch complete (52195 records). [2025-09-15T18:09:40.345008] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-15T18:09:40.462984] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-15T18:09:40.725705] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-15T18:09:40.725784] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-15T18:09:40.726472] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-15T18:09:40.726519] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-15T18:09:40.727618] [DEBUG] [LOCAL ] DTE: Trimmed 52195 records to 35164 (keeping 150 days of data) [2025-09-15T18:09:40.954813] [DEBUG] [LOCAL ] DTE: Primary data saved (35164 records). [2025-09-15T18:09:40.954961] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-15T18:09:40.955977] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTE took 28.3s. Estimated remaining: 3h 0m 18s. Rate: 9.5 symbols/min [2025-09-15T18:09:41.127062] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:41.131279] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T18:09:41.176419] [DEBUG] [LOCAL ] DUK: Loaded 40227 existing records from primary storage. [2025-09-15T18:09:41.176556] [INFO ] [MAIN ] DUK: Loaded 40227 existing records. [2025-09-15T18:09:41.263058] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-15T18:09:41.355097] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:41.355323] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-15T18:09:41.355368] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-15T18:09:41.356334] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-15T18:09:41.356385] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-15T18:09:41.707986] [INFO ] [REMOTE ] DUK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:42.057860] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-15T18:09:42.622086] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:09:42.785415] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:09:42.857858] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-15T18:09:43.657882] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-15T18:09:44.135007] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:09:44.151805] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T18:09:44.457884] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-15T18:09:45.027352] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:09:45.257914] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-15T18:09:45.625567] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T18:09:46.057891] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-15T18:09:46.857886] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-15T18:09:47.497998] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:09:47.499183] [INFO ] [REMOTE ] DTW: Full fetch complete (5200 records). [2025-09-15T18:09:47.499252] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-15T18:09:47.658007] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-15T18:09:47.865735] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-15T18:09:47.865816] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-15T18:09:47.865983] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-15T18:09:47.866021] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-15T18:09:47.866388] [DEBUG] [LOCAL ] DTW: Trimmed 5200 records to 3503 (keeping 150 days of data) [2025-09-15T18:09:47.888156] [DEBUG] [LOCAL ] DTW: Primary data saved (3503 records). [2025-09-15T18:09:47.888247] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-15T18:09:47.888339] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTW took 18.8s. Estimated remaining: 3h 0m 13s. Rate: 9.5 symbols/min [2025-09-15T18:09:48.059998] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:48.066744] [DEBUG] [LOCAL ] DUKB: Loaded 4720 existing records from primary storage. [2025-09-15T18:09:48.066971] [INFO ] [MAIN ] DUKB: Loaded 4720 existing records. [2025-09-15T18:09:48.228995] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T18:09:48.305916] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:48.306193] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-15T18:09:48.306244] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-15T18:09:48.306611] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-15T18:09:48.306690] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-15T18:09:48.469722] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-15T18:09:48.506870] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:09:48.543962] [INFO ] [REMOTE ] DTG: Full fetch complete (6379 records). [2025-09-15T18:09:48.564623] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-15T18:09:48.582181] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:09:48.590867] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:48.593188] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:48.593564] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-15T18:09:48.646887] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-15T18:09:48.683980] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-15T18:09:48.693058] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-09-15T18:09:48.707093] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 32.1s. Estimated remaining: 2h 59m 52s. Rate: 9.5 symbols/min [2025-09-15T18:09:48.711815] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:48.882078] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:48.923170] [DEBUG] [LOCAL ] DV: Loaded 38284 existing records from primary storage. [2025-09-15T18:09:48.923383] [INFO ] [MAIN ] DV: Loaded 38284 existing records. [2025-09-15T18:09:49.121065] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:49.121340] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-15T18:09:49.121410] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-15T18:09:49.122183] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-15T18:09:49.122233] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-15T18:09:49.263366] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-15T18:09:49.486102] [INFO ] [REMOTE ] DV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:49.888609] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:09:50.057938] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-15T18:09:50.462347] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-15T18:09:50.857877] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-15T18:09:51.474966] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:09:51.657867] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-15T18:09:52.213572] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:09:52.457922] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-15T18:09:53.188744] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:09:53.217272] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:09:53.257833] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-15T18:09:54.057961] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-15T18:09:54.857919] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-15T18:09:54.978953] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:09:55.243434] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T18:09:55.644142] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:09:55.657819] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-15T18:09:56.457883] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-15T18:09:57.051704] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:09:57.257865] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-15T18:09:57.398368] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:09:58.057914] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-15T18:09:58.585256] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:09:58.823685] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:09:58.830012] [INFO ] [REMOTE ] DTM: Full fetch complete (48825 records). [2025-09-15T18:09:58.830215] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-15T18:09:58.863912] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-15T18:09:59.434985] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-15T18:09:59.435090] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-15T18:09:59.436177] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-15T18:09:59.436274] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-15T18:09:59.438046] [DEBUG] [LOCAL ] DTM: Trimmed 48825 records to 31775 (keeping 150 days of data) [2025-09-15T18:09:59.696862] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-15T18:09:59.770188] [DEBUG] [LOCAL ] DTM: Primary data saved (31775 records). [2025-09-15T18:09:59.770369] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-15T18:09:59.770464] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 34.7s. Estimated remaining: 2h 59m 58s. Rate: 9.5 symbols/min [2025-09-15T18:09:59.951776] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:59.988283] [DEBUG] [LOCAL ] DVA: Loaded 30946 existing records from primary storage. [2025-09-15T18:09:59.988433] [INFO ] [MAIN ] DVA: Loaded 30946 existing records. [2025-09-15T18:10:00.164518] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:00.164782] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-15T18:10:00.164829] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-15T18:10:00.165616] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-15T18:10:00.165688] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-15T18:10:00.463071] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-15T18:10:00.517304] [INFO ] [REMOTE ] DVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:00.551559] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:10:01.257926] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-15T18:10:01.357888] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T18:10:01.406431] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:10:02.057891] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-15T18:10:02.450681] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T18:10:02.727062] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T18:10:02.857845] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-15T18:10:03.657898] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-15T18:10:04.122322] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:10:04.457913] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-15T18:10:05.266572] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-15T18:10:05.272407] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:10:06.057888] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-15T18:10:06.101628] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:10:06.645366] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:10:06.646528] [INFO ] [REMOTE ] DUKB: Full fetch complete (6925 records). [2025-09-15T18:10:06.646596] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-15T18:10:06.863084] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-15T18:10:07.022962] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-15T18:10:07.023153] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-15T18:10:07.023373] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-15T18:10:07.023471] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-15T18:10:07.034088] [DEBUG] [LOCAL ] DUKB: Trimmed 6925 records to 4653 (keeping 150 days of data) [2025-09-15T18:10:07.054630] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T18:10:07.093845] [DEBUG] [LOCAL ] DUKB: Primary data saved (4653 records). [2025-09-15T18:10:07.093976] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-15T18:10:07.094057] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 19.2s. Estimated remaining: 2h 59m 54s. Rate: 9.5 symbols/min [2025-09-15T18:10:07.266284] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:07.310559] [DEBUG] [LOCAL ] DVN: Loaded 40439 existing records from primary storage. [2025-09-15T18:10:07.310774] [INFO ] [MAIN ] DVN: Loaded 40439 existing records. [2025-09-15T18:10:07.500742] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:07.501121] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-15T18:10:07.501169] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-15T18:10:07.502014] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-15T18:10:07.502074] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-15T18:10:07.678570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-15T18:10:07.870540] [INFO ] [REMOTE ] DVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:08.174693] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T18:10:08.457914] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-15T18:10:09.257899] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-15T18:10:09.623885] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:10:09.666139] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T18:10:10.057874] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-15T18:10:10.857939] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-15T18:10:11.207891] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T18:10:11.657931] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-15T18:10:11.686977] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:10:11.692812] [INFO ] [REMOTE ] DUK: Full fetch complete (58149 records). [2025-09-15T18:10:11.692938] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-15T18:10:12.097459] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-15T18:10:12.097561] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-15T18:10:12.098335] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-15T18:10:12.098392] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-15T18:10:12.099947] [DEBUG] [LOCAL ] DUK: Trimmed 58149 records to 39449 (keeping 150 days of data) [2025-09-15T18:10:12.240748] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:10:12.386976] [DEBUG] [LOCAL ] DUK: Primary data saved (39449 records). [2025-09-15T18:10:12.387122] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-15T18:10:12.387940] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUK took 31.4s. Estimated remaining: 2h 59m 45s. Rate: 9.5 symbols/min [2025-09-15T18:10:12.462971] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-15T18:10:12.566859] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:12.610958] [DEBUG] [LOCAL ] DX: Loaded 39442 existing records from primary storage. [2025-09-15T18:10:12.611269] [INFO ] [MAIN ] DX: Loaded 39442 existing records. [2025-09-15T18:10:12.794025] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:12.794351] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-15T18:10:12.794403] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-15T18:10:12.795604] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-15T18:10:12.795697] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-15T18:10:13.155759] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:13.257876] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-15T18:10:13.524765] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:10:14.057924] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-15T18:10:14.614625] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:10:14.857878] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-15T18:10:15.048311] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-15T18:10:15.657835] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-15T18:10:15.724505] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:10:16.229897] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:10:16.457943] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-15T18:10:16.984527] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:10:17.257927] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-15T18:10:18.057964] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-15T18:10:18.325628] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:10:18.857932] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-15T18:10:19.098465] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T18:10:19.402126] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:10:19.406982] [INFO ] [REMOTE ] DVA: Full fetch complete (45955 records). [2025-09-15T18:10:19.407097] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-15T18:10:19.665884] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-15T18:10:19.792007] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-15T18:10:19.792245] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-15T18:10:19.792922] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-15T18:10:19.792969] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-15T18:10:19.794018] [DEBUG] [LOCAL ] DVA: Trimmed 45955 records to 30220 (keeping 150 days of data) [2025-09-15T18:10:19.982517] [DEBUG] [LOCAL ] DVA: Primary data saved (30220 records). [2025-09-15T18:10:19.982672] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-15T18:10:19.982759] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DVA took 20.2s. Estimated remaining: 2h 59m 42s. Rate: 9.5 symbols/min [2025-09-15T18:10:20.155805] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:20.194847] [DEBUG] [LOCAL ] DXC: Loaded 37447 existing records from primary storage. [2025-09-15T18:10:20.195026] [INFO ] [MAIN ] DXC: Loaded 37447 existing records. [2025-09-15T18:10:20.385959] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:20.386418] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-15T18:10:20.386525] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-15T18:10:20.387497] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-15T18:10:20.387614] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-15T18:10:20.471714] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-15T18:10:20.524346] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:10:20.806012] [INFO ] [REMOTE ] DXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:20.890928] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:10:21.257876] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-15T18:10:22.069392] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-15T18:10:22.074995] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:10:22.857889] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-15T18:10:23.036300] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:10:23.266859] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:10:23.657883] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-15T18:10:24.457885] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-15T18:10:24.485937] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:10:24.491860] [INFO ] [REMOTE ] DV: Full fetch complete (55559 records). [2025-09-15T18:10:24.491988] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-15T18:10:24.885985] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-15T18:10:24.886077] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-15T18:10:24.886869] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-15T18:10:24.886926] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-15T18:10:24.888083] [DEBUG] [LOCAL ] DV: Trimmed 55559 records to 37587 (keeping 150 days of data) [2025-09-15T18:10:25.115897] [DEBUG] [LOCAL ] DV: Primary data saved (37587 records). [2025-09-15T18:10:25.116052] [INFO ] [MAIN ] DV: Full history saved. [2025-09-15T18:10:25.117175] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 36.4s. Estimated remaining: 2h 59m 33s. Rate: 9.5 symbols/min [2025-09-15T18:10:25.265399] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-15T18:10:25.295957] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:25.329313] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:10:25.361228] [DEBUG] [LOCAL ] DXYZ: Loaded 26884 existing records from primary storage. [2025-09-15T18:10:25.361367] [INFO ] [MAIN ] DXYZ: Loaded 26884 existing records. [2025-09-15T18:10:25.550324] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:25.550603] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-15T18:10:25.550678] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-15T18:10:25.551291] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-15T18:10:25.551341] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-15T18:10:25.903531] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:26.057871] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-15T18:10:26.309047] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:10:26.857881] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-15T18:10:26.997930] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:10:27.386866] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T18:10:27.657930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-15T18:10:28.457891] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-15T18:10:28.523428] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T18:10:29.079732] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T18:10:29.257879] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-15T18:10:30.057886] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-15T18:10:30.163096] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:10:30.674584] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:10:30.680469] [INFO ] [REMOTE ] DVN: Full fetch complete (58379 records). [2025-09-15T18:10:30.680610] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-15T18:10:30.865575] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-15T18:10:31.057216] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-15T18:10:31.057307] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-15T18:10:31.058059] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-15T18:10:31.058108] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-15T18:10:31.059394] [DEBUG] [LOCAL ] DVN: Trimmed 58379 records to 39659 (keeping 150 days of data) [2025-09-15T18:10:31.308968] [DEBUG] [LOCAL ] DVN: Primary data saved (39659 records). [2025-09-15T18:10:31.309140] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-15T18:10:31.309239] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 24.2s. Estimated remaining: 2h 59m 26s. Rate: 9.5 symbols/min [2025-09-15T18:10:31.479373] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:31.502202] [DEBUG] [LOCAL ] DY: Loaded 21411 existing records from primary storage. [2025-09-15T18:10:31.502345] [INFO ] [MAIN ] DY: Loaded 21411 existing records. [2025-09-15T18:10:31.659476] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-15T18:10:31.679514] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:31.681493] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-15T18:10:31.681692] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-15T18:10:31.682384] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-15T18:10:31.682584] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-15T18:10:31.983486] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:10:32.082694] [INFO ] [REMOTE ] DY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:32.457892] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-15T18:10:32.515673] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:10:33.160583] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:10:33.170268] [INFO ] [REMOTE ] DX: Full fetch complete (56968 records). [2025-09-15T18:10:33.170408] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-15T18:10:33.268110] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-15T18:10:33.556353] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-15T18:10:33.556437] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-15T18:10:33.557257] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-15T18:10:33.557311] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-15T18:10:33.558583] [DEBUG] [LOCAL ] DX: Trimmed 56968 records to 38676 (keeping 150 days of data) [2025-09-15T18:10:33.803219] [DEBUG] [LOCAL ] DX: Primary data saved (38676 records). [2025-09-15T18:10:33.803363] [INFO ] [MAIN ] DX: Full history saved. [2025-09-15T18:10:33.804177] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DX took 21.4s. Estimated remaining: 2h 59m 10s. Rate: 9.5 symbols/min [2025-09-15T18:10:34.003340] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:34.029778] [DEBUG] [LOCAL ] E: Loaded 25020 existing records from primary storage. [2025-09-15T18:10:34.029953] [INFO ] [MAIN ] E: Loaded 25020 existing records. [2025-09-15T18:10:34.062520] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-15T18:10:34.217958] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:34.218353] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-15T18:10:34.218412] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-15T18:10:34.219079] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-15T18:10:34.219133] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-15T18:10:34.421199] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T18:10:34.612441] [INFO ] [REMOTE ] E: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:34.710551] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:10:34.857851] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-15T18:10:35.657879] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-15T18:10:35.760099] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:10:36.284966] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T18:10:36.457892] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-15T18:10:36.703252] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T18:10:37.257917] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-15T18:10:38.059495] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-15T18:10:38.062195] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:10:38.338505] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:10:38.857885] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-15T18:10:39.657872] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-15T18:10:39.763276] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:10:39.952420] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:10:40.457862] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-15T18:10:41.068583] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:10:41.074084] [INFO ] [REMOTE ] DXC: Full fetch complete (53237 records). [2025-09-15T18:10:41.074175] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-15T18:10:41.262949] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-15T18:10:41.449191] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-15T18:10:41.449270] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-15T18:10:41.450008] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-15T18:10:41.450064] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-15T18:10:41.451154] [DEBUG] [LOCAL ] DXC: Trimmed 53237 records to 36743 (keeping 150 days of data) [2025-09-15T18:10:41.670156] [DEBUG] [LOCAL ] DXC: Primary data saved (36743 records). [2025-09-15T18:10:41.670365] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-15T18:10:41.671165] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DXC took 21.7s. Estimated remaining: 2h 59m 8s. Rate: 9.5 symbols/min [2025-09-15T18:10:41.840196] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:41.873818] [DEBUG] [LOCAL ] EAF: Loaded 33346 existing records from primary storage. [2025-09-15T18:10:41.873951] [INFO ] [MAIN ] EAF: Loaded 33346 existing records. [2025-09-15T18:10:42.049527] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:42.049854] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-15T18:10:42.049901] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-15T18:10:42.050557] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-15T18:10:42.050603] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-15T18:10:42.081639] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-15T18:10:42.427701] [INFO ] [REMOTE ] EAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:42.469813] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T18:10:42.478981] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:10:42.857887] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-15T18:10:43.246489] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:10:43.657897] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-15T18:10:44.457902] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-15T18:10:44.631367] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T18:10:44.720159] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T18:10:45.257881] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-15T18:10:45.458488] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:10:46.058083] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-15T18:10:46.167243] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:10:46.857883] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-15T18:10:47.657883] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-15T18:10:47.855348] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:10:47.954034] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:10:48.424529] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T18:10:48.457910] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-15T18:10:49.257965] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-15T18:10:49.657635] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:10:50.057873] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-15T18:10:50.857936] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-15T18:10:51.089612] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:10:51.170763] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:10:51.657885] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-15T18:10:52.266835] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:10:52.457883] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-15T18:10:52.861468] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:10:53.257886] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-15T18:10:53.722153] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:10:53.725792] [INFO ] [REMOTE ] E: Full fetch complete (36535 records). [2025-09-15T18:10:53.725892] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-15T18:10:54.062963] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-15T18:10:54.102912] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-15T18:10:54.103041] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-15T18:10:54.103630] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-15T18:10:54.103707] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-15T18:10:54.104696] [DEBUG] [LOCAL ] E: Trimmed 36535 records to 24276 (keeping 150 days of data) [2025-09-15T18:10:54.250038] [DEBUG] [LOCAL ] E: Primary data saved (24276 records). [2025-09-15T18:10:54.250179] [INFO ] [MAIN ] E: Full history saved. [2025-09-15T18:10:54.250262] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. E took 20.4s. Estimated remaining: 2h 59m 17s. Rate: 9.5 symbols/min [2025-09-15T18:10:54.424860] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:54.429121] [DEBUG] [LOCAL ] EAI: Loaded 2854 existing records from primary storage. [2025-09-15T18:10:54.429198] [INFO ] [MAIN ] EAI: Loaded 2854 existing records. [2025-09-15T18:10:54.608951] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:54.609221] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-15T18:10:54.609269] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-15T18:10:54.609482] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-15T18:10:54.609534] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-15T18:10:54.858238] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-15T18:10:54.916805] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:10:54.978849] [INFO ] [REMOTE ] EAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:54.979370] [INFO ] [REMOTE ] DXYZ: Full fetch complete (40586 records). [2025-09-15T18:10:54.979459] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-15T18:10:55.365098] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-15T18:10:55.365268] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-15T18:10:55.365954] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-15T18:10:55.366029] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-15T18:10:55.367357] [DEBUG] [LOCAL ] DXYZ: Trimmed 40586 records to 26469 (keeping 150 days of data) [2025-09-15T18:10:55.550209] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T18:10:55.569819] [DEBUG] [LOCAL ] DXYZ: Primary data saved (26469 records). [2025-09-15T18:10:55.569993] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-15T18:10:55.570096] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DXYZ took 30.5s. Estimated remaining: 2h 58m 58s. Rate: 9.5 symbols/min [2025-09-15T18:10:55.664032] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-15T18:10:55.756291] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:55.778527] [DEBUG] [LOCAL ] EARN: Loaded 20708 existing records from primary storage. [2025-09-15T18:10:55.778720] [INFO ] [MAIN ] EARN: Loaded 20708 existing records. [2025-09-15T18:10:55.960794] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:55.961067] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-15T18:10:55.961117] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-15T18:10:55.961746] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-15T18:10:55.961798] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-15T18:10:56.328987] [INFO ] [REMOTE ] EARN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:56.334622] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T18:10:56.457950] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-15T18:10:56.618728] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:10:56.790881] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-15T18:10:57.257876] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-15T18:10:58.057886] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-15T18:10:58.757205] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:10:58.857863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-15T18:10:59.479428] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:10:59.483149] [INFO ] [REMOTE ] DY: Full fetch complete (33461 records). [2025-09-15T18:10:59.483240] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-15T18:10:59.659400] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-15T18:10:59.857146] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-15T18:10:59.857254] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-15T18:10:59.858128] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-15T18:10:59.858175] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-15T18:10:59.859304] [DEBUG] [LOCAL ] DY: Trimmed 33461 records to 20943 (keeping 150 days of data) [2025-09-15T18:10:59.999425] [DEBUG] [LOCAL ] DY: Primary data saved (20943 records). [2025-09-15T18:10:59.999614] [INFO ] [MAIN ] DY: Full history saved. [2025-09-15T18:10:59.999747] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DY took 28.7s. Estimated remaining: 2h 58m 47s. Rate: 9.5 symbols/min [2025-09-15T18:11:00.183897] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:00.226317] [DEBUG] [LOCAL ] EAT: Loaded 37345 existing records from primary storage. [2025-09-15T18:11:00.226471] [INFO ] [MAIN ] EAT: Loaded 37345 existing records. [2025-09-15T18:11:00.404392] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:00.404729] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-15T18:11:00.409521] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-15T18:11:00.410506] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T18:11:00.412266] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-15T18:11:00.412578] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-15T18:11:00.466478] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-15T18:11:00.768907] [INFO ] [REMOTE ] EAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:00.803493] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T18:11:01.257886] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-15T18:11:01.320169] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:11:02.057883] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-15T18:11:02.857774] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:11:02.857833] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-15T18:11:02.896620] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:11:03.657935] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-15T18:11:04.114211] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:11:04.223338] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:11:04.457870] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-15T18:11:05.257931] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-15T18:11:06.057882] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-15T18:11:06.297181] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T18:11:06.737967] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:11:06.857890] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-15T18:11:07.172073] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:11:07.176350] [INFO ] [REMOTE ] EAF: Full fetch complete (48841 records). [2025-09-15T18:11:07.176449] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-15T18:11:07.564624] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-15T18:11:07.564759] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-15T18:11:07.565611] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-15T18:11:07.565688] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-15T18:11:07.566874] [DEBUG] [LOCAL ] EAF: Trimmed 48841 records to 32555 (keeping 150 days of data) [2025-09-15T18:11:07.661872] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-15T18:11:07.775160] [DEBUG] [LOCAL ] EAF: Primary data saved (32555 records). [2025-09-15T18:11:07.775316] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-15T18:11:07.775443] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. EAF took 26.1s. Estimated remaining: 2h 58m 44s. Rate: 9.5 symbols/min [2025-09-15T18:11:07.950607] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:07.978584] [DEBUG] [LOCAL ] EB: Loaded 27695 existing records from primary storage. [2025-09-15T18:11:07.978745] [INFO ] [MAIN ] EB: Loaded 27695 existing records. [2025-09-15T18:11:08.167518] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:08.168039] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-15T18:11:08.168176] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-15T18:11:08.168861] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-15T18:11:08.168914] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-15T18:11:08.323915] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:11:08.424106] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:11:08.461890] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-15T18:11:08.572229] [INFO ] [REMOTE ] EB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:09.257881] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-15T18:11:09.882623] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:11:09.883694] [INFO ] [REMOTE ] EAI: Full fetch complete (4308 records). [2025-09-15T18:11:09.883765] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-15T18:11:10.061405] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-15T18:11:10.252293] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-15T18:11:10.252406] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-15T18:11:10.252561] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-15T18:11:10.252621] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-15T18:11:10.253290] [DEBUG] [LOCAL ] EAI: Trimmed 4308 records to 2827 (keeping 150 days of data) [2025-09-15T18:11:10.271777] [DEBUG] [LOCAL ] EAI: Primary data saved (2827 records). [2025-09-15T18:11:10.271878] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-15T18:11:10.271994] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAI took 16.0s. Estimated remaining: 2h 58m 28s. Rate: 9.5 symbols/min [2025-09-15T18:11:10.444532] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:10.476665] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:11:10.499216] [DEBUG] [LOCAL ] EBF: Loaded 14154 existing records from primary storage. [2025-09-15T18:11:10.499344] [INFO ] [MAIN ] EBF: Loaded 14154 existing records. [2025-09-15T18:11:10.679530] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:10.679966] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-15T18:11:10.680022] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-15T18:11:10.680411] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-15T18:11:10.680459] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-15T18:11:10.865588] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-15T18:11:11.033923] [INFO ] [REMOTE ] EBF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:11.213809] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:11:11.657882] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-15T18:11:12.417573] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:11:12.457895] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-15T18:11:12.768400] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:11:13.257884] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-15T18:11:13.537779] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:11:14.057959] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-15T18:11:14.644677] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:11:14.857974] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-15T18:11:15.105466] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:11:15.657870] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-15T18:11:16.236880] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:11:16.457870] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-15T18:11:16.933972] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:11:17.257911] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-15T18:11:17.936571] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:11:18.007285] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:11:18.057846] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-15T18:11:18.857922] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-15T18:11:19.550731] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:11:19.657851] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-15T18:11:19.896580] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:11:20.457877] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-15T18:11:21.262701] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-15T18:11:21.284548] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:11:21.541219] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:11:22.057885] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-15T18:11:22.647580] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:11:22.857887] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-15T18:11:23.048340] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:11:23.052008] [INFO ] [REMOTE ] EARN: Full fetch complete (34457 records). [2025-09-15T18:11:23.052114] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-15T18:11:23.454255] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-15T18:11:23.454383] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-15T18:11:23.455013] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-15T18:11:23.455069] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-15T18:11:23.456020] [DEBUG] [LOCAL ] EARN: Trimmed 34457 records to 20059 (keeping 150 days of data) [2025-09-15T18:11:23.585064] [DEBUG] [LOCAL ] EARN: Primary data saved (20059 records). [2025-09-15T18:11:23.585195] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-15T18:11:23.585284] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 28.0s. Estimated remaining: 2h 58m 40s. Rate: 9.5 symbols/min [2025-09-15T18:11:23.659261] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-15T18:11:23.761784] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:23.774935] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:11:23.818467] [DEBUG] [LOCAL ] EBR: Loaded 31998 existing records from primary storage. [2025-09-15T18:11:23.818628] [INFO ] [MAIN ] EBR: Loaded 31998 existing records. [2025-09-15T18:11:23.994499] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:23.994773] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-15T18:11:23.994821] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-15T18:11:23.995585] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-15T18:11:23.995633] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-15T18:11:24.350352] [INFO ] [REMOTE ] EBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:24.457834] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-15T18:11:24.538519] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:11:25.257887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-15T18:11:26.015480] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:11:26.057846] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-15T18:11:26.677855] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:11:26.857889] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-15T18:11:27.233883] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:11:27.239430] [INFO ] [REMOTE ] EAT: Full fetch complete (54329 records). [2025-09-15T18:11:27.239539] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-15T18:11:27.612166] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-15T18:11:27.612243] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-15T18:11:27.612982] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-15T18:11:27.613030] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-15T18:11:27.614161] [DEBUG] [LOCAL ] EAT: Trimmed 54329 records to 36616 (keeping 150 days of data) [2025-09-15T18:11:27.670412] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-15T18:11:27.865495] [DEBUG] [LOCAL ] EAT: Primary data saved (36616 records). [2025-09-15T18:11:27.865782] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-15T18:11:27.865982] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAT took 27.9s. Estimated remaining: 2h 58m 28s. Rate: 9.5 symbols/min [2025-09-15T18:11:27.892066] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:11:28.457895] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-15T18:11:28.639737] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:11:29.257924] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-15T18:11:30.057923] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-15T18:11:30.127628] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:11:30.188325] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T18:11:30.857954] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-15T18:11:31.534033] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:11:31.657866] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-15T18:11:32.325167] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:11:32.457828] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-15T18:11:33.167955] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:11:33.257887] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-15T18:11:33.766264] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:11:34.057875] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-15T18:11:34.115107] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:11:34.119321] [INFO ] [REMOTE ] EB: Full fetch complete (41551 records). [2025-09-15T18:11:34.119427] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-15T18:11:34.527192] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-15T18:11:34.527331] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-15T18:11:34.528304] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-15T18:11:34.528369] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-15T18:11:34.530112] [DEBUG] [LOCAL ] EB: Trimmed 41551 records to 26972 (keeping 150 days of data) [2025-09-15T18:11:34.695188] [DEBUG] [LOCAL ] EB: Primary data saved (26972 records). [2025-09-15T18:11:34.695374] [INFO ] [MAIN ] EB: Full history saved. [2025-09-15T18:11:34.695480] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 26.9s. Estimated remaining: 2h 58m 23s. Rate: 9.5 symbols/min [2025-09-15T18:11:34.857865] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-15T18:11:35.069334] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:11:35.657873] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-15T18:11:36.130124] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:11:36.457927] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-15T18:11:36.538286] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:11:36.540681] [INFO ] [REMOTE ] EBF: Full fetch complete (21461 records). [2025-09-15T18:11:36.540757] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-15T18:11:36.915420] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-15T18:11:36.915552] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-15T18:11:36.916021] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-15T18:11:36.916064] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-15T18:11:36.916632] [DEBUG] [LOCAL ] EBF: Trimmed 21461 records to 13862 (keeping 150 days of data) [2025-09-15T18:11:37.008925] [DEBUG] [LOCAL ] EBF: Primary data saved (13862 records). [2025-09-15T18:11:37.009097] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-15T18:11:37.009189] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 26.7s. Estimated remaining: 2h 58m 7s. Rate: 9.5 symbols/min [2025-09-15T18:11:38.148626] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T18:11:38.158145] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-15T18:11:39.596885] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T18:11:39.602057] [INFO ] [REMOTE ] EBR: Full fetch complete (46449 records). [2025-09-15T18:11:39.602174] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-15T18:11:39.987353] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-15T18:11:39.987435] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-15T18:11:39.988115] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-15T18:11:39.988157] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-15T18:11:39.989139] [DEBUG] [LOCAL ] EBR: Trimmed 46449 records to 31335 (keeping 150 days of data) [2025-09-15T18:11:40.177483] [DEBUG] [LOCAL ] EBR: Primary data saved (31335 records). [2025-09-15T18:11:40.177628] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-15T18:11:40.178546] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBR took 16.6s. Estimated remaining: 2h 57m 53s. Rate: 9.5 symbols/min [2025-09-15T18:11:40.959362] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.924536] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.965298] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.984565] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:41.006536] [DEBUG] [LOCAL ] ECAT: Loaded 21834 existing records from primary storage. [2025-09-15T18:11:41.016064] [INFO ] [MAIN ] ECAT: Loaded 21834 existing records. [2025-09-15T18:11:41.165342] [DEBUG] [LOCAL ] EBS: Loaded 35421 existing records from primary storage. [2025-09-15T18:11:41.166023] [DEBUG] [LOCAL ] EC: Loaded 36834 existing records from primary storage. [2025-09-15T18:11:41.166612] [INFO ] [MAIN ] EBS: Loaded 35421 existing records. [2025-09-15T18:11:41.171963] [INFO ] [MAIN ] EC: Loaded 36834 existing records. [2025-09-15T18:11:41.350968] [DEBUG] [LOCAL ] ECC: Loaded 32304 existing records from primary storage. [2025-09-15T18:11:41.375009] [INFO ] [MAIN ] ECC: Loaded 32304 existing records. [2025-09-15T18:11:41.531578] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.648327] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.715505] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.717411] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-15T18:11:41.737528] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.754939] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-15T18:11:41.754793] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-15T18:11:41.755230] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-15T18:11:41.774595] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-15T18:11:41.784435] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.820442] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-15T18:11:41.845210] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.896287] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-15T18:11:42.046904] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:42.038247] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-15T18:11:42.058282] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-15T18:11:42.058194] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-15T18:11:42.079320] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-15T18:11:42.104672] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-15T18:11:42.115231] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-15T18:11:43.093261] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.159909] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-15T18:11:43.316962] [INFO ] [REMOTE ] EBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.374116] [INFO ] [REMOTE ] EC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.369163] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-15T18:11:43.355873] [INFO ] [REMOTE ] ECC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.375914] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-15T18:11:43.377035] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-15T18:11:44.529988] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:11:44.536164] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-15T18:11:44.663483] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:11:44.671155] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-15T18:11:44.751042] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:11:44.761040] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-15T18:11:44.970191] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:11:44.979178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-15T18:11:45.923000] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:11:45.933148] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-15T18:11:45.955140] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:11:45.962247] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-15T18:11:46.239467] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:11:46.249616] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-15T18:11:46.437393] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:11:46.857894] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-15T18:11:47.160051] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:11:47.387180] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:11:47.657942] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-15T18:11:47.819735] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:11:48.332510] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:11:48.457908] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-15T18:11:48.973654] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:11:49.257933] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-15T18:11:49.587271] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:11:50.057948] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-15T18:11:50.814864] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:11:50.857817] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-15T18:11:51.641819] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:11:51.657823] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-15T18:11:52.367996] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T18:11:52.457881] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-15T18:11:53.257918] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-15T18:11:53.429863] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:11:53.812016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:11:54.057865] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-15T18:11:54.857913] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-15T18:11:55.008784] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T18:11:55.657909] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-15T18:11:55.849941] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:11:56.256711] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:11:56.457878] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-15T18:11:57.257899] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-15T18:11:57.282173] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:11:57.397546] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:11:58.057862] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-15T18:11:58.807892] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:11:58.857829] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-15T18:11:59.438690] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:11:59.443715] [INFO ] [REMOTE ] EBS: Full fetch complete (51085 records). [2025-09-15T18:11:59.443840] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-15T18:11:59.666256] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-15T18:11:59.824961] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-15T18:11:59.825046] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-15T18:11:59.825879] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-15T18:11:59.825936] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-15T18:11:59.827133] [DEBUG] [LOCAL ] EBS: Trimmed 51085 records to 34806 (keeping 150 days of data) [2025-09-15T18:12:00.035916] [DEBUG] [LOCAL ] EBS: Primary data saved (34806 records). [2025-09-15T18:12:00.036093] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-15T18:12:00.036202] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBS took 19.9s. Estimated remaining: 2h 58m 20s. Rate: 9.5 symbols/min [2025-09-15T18:12:00.218134] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:00.218356] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-15T18:12:00.218400] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-15T18:12:00.218552] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-15T18:12:00.218594] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-15T18:12:00.218633] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-15T18:12:00.218687] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-15T18:12:00.462985] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-15T18:12:00.576722] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:00.607437] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:12:00.926848] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:12:01.257932] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-15T18:12:02.057877] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-15T18:12:02.351209] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T18:12:02.857878] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-15T18:12:03.321846] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:12:03.326996] [INFO ] [REMOTE ] ECC: Full fetch complete (46701 records). [2025-09-15T18:12:03.327116] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-15T18:12:03.668187] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-15T18:12:03.707474] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-15T18:12:03.707543] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-15T18:12:03.708206] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-15T18:12:03.708251] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-15T18:12:03.709436] [DEBUG] [LOCAL ] ECC: Trimmed 46701 records to 31558 (keeping 150 days of data) [2025-09-15T18:12:03.905133] [DEBUG] [LOCAL ] ECC: Primary data saved (31558 records). [2025-09-15T18:12:03.905315] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-15T18:12:03.906566] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECC took 23.7s. Estimated remaining: 2h 58m 7s. Rate: 9.5 symbols/min [2025-09-15T18:12:04.078599] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:04.082792] [DEBUG] [LOCAL ] ECCU: Loaded 1685 existing records from primary storage. [2025-09-15T18:12:04.082882] [INFO ] [MAIN ] ECCU: Loaded 1685 existing records. [2025-09-15T18:12:04.267422] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:04.267708] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-15T18:12:04.267756] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-15T18:12:04.267965] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-15T18:12:04.268011] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-15T18:12:04.351701] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-15T18:12:04.477899] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-15T18:12:04.666815] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:04.976257] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T18:12:04.998229] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-15T18:12:05.003877] [INFO ] [REMOTE ] EC: Full fetch complete (53998 records). [2025-09-15T18:12:05.004055] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-15T18:12:05.264283] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-15T18:12:05.402730] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-15T18:12:05.402845] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-15T18:12:05.403596] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-15T18:12:05.403658] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-15T18:12:05.404998] [DEBUG] [LOCAL ] EC: Trimmed 53998 records to 36092 (keeping 150 days of data) [2025-09-15T18:12:05.631981] [DEBUG] [LOCAL ] EC: Primary data saved (36092 records). [2025-09-15T18:12:05.632149] [INFO ] [MAIN ] EC: Full history saved. [2025-09-15T18:12:05.632292] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EC took 25.5s. Estimated remaining: 2h 57m 50s. Rate: 9.5 symbols/min [2025-09-15T18:12:05.810084] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:05.810306] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-15T18:12:05.810358] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-15T18:12:05.810482] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-15T18:12:05.810522] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-15T18:12:05.810574] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-15T18:12:05.810625] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-15T18:12:05.915638] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T18:12:05.970383] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-15T18:12:05.995320] [INFO ] [REMOTE ] ECAT: Full fetch complete (32295 records). [2025-09-15T18:12:06.023197] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-15T18:12:06.063019] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-15T18:12:06.518461] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:06.741837] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T18:12:06.833492] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-15T18:12:06.833698] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-15T18:12:06.835558] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-15T18:12:06.835771] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-15T18:12:06.837495] [DEBUG] [LOCAL ] ECAT: Trimmed 32295 records to 21685 (keeping 150 days of data) [2025-09-15T18:12:06.913393] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-15T18:12:07.033625] [DEBUG] [LOCAL ] ECAT: Primary data saved (21685 records). [2025-09-15T18:12:07.033906] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-15T18:12:07.034084] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. ECAT took 26.9s. Estimated remaining: 2h 57m 31s. Rate: 9.5 symbols/min [2025-09-15T18:12:07.281616] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:07.281908] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-15T18:12:07.281951] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-15T18:12:07.282098] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-15T18:12:07.282168] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-15T18:12:07.282214] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-15T18:12:07.282250] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-15T18:12:07.606148] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:12:07.661232] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-15T18:12:07.687953] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:07.961952] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T18:12:08.457952] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-15T18:12:08.877904] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:12:09.258035] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-15T18:12:09.667709] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:12:10.057943] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-15T18:12:10.393977] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:12:10.857896] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-15T18:12:11.329785] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:12:11.657888] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-15T18:12:11.967785] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T18:12:12.457923] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-15T18:12:12.947617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T18:12:13.257916] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-15T18:12:13.725564] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T18:12:14.057875] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-15T18:12:14.857884] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-15T18:12:14.868231] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:12:15.657890] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-15T18:12:15.862133] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T18:12:15.947579] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T18:12:16.457911] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-15T18:12:16.985361] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:12:17.257924] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-15T18:12:17.596358] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:12:18.057878] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-15T18:12:18.499046] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T18:12:18.857891] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-15T18:12:19.302109] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:12:19.302919] [INFO ] [REMOTE ] ECCC: Full fetch complete (965 records). [2025-09-15T18:12:19.302991] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-15T18:12:19.500321] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:12:19.500593] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:19.500689] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:19.500846] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-15T18:12:19.500929] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-15T18:12:19.500976] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-15T18:12:19.501028] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-15T18:12:19.501094] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCC took 19.5s. Estimated remaining: 2h 57m 40s. Rate: 9.5 symbols/min [2025-09-15T18:12:19.663055] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-15T18:12:19.685802] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:19.711053] [DEBUG] [LOCAL ] ECG: Loaded 24863 existing records from primary storage. [2025-09-15T18:12:19.711227] [INFO ] [MAIN ] ECG: Loaded 24863 existing records. [2025-09-15T18:12:19.899495] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:19.899788] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-15T18:12:19.899837] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-15T18:12:19.900491] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-15T18:12:19.900541] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-15T18:12:20.192799] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:12:20.273412] [INFO ] [REMOTE ] ECG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:20.457881] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-15T18:12:21.257889] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-15T18:12:21.731210] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:12:21.759862] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:12:22.057864] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-15T18:12:22.304224] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-15T18:12:22.857868] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-15T18:12:23.293390] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:12:23.294243] [INFO ] [REMOTE ] ECCX: Full fetch complete (1151 records). [2025-09-15T18:12:23.294344] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-15T18:12:23.476177] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:12:23.476385] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:23.476437] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:23.476486] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-15T18:12:23.476546] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-15T18:12:23.476584] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-15T18:12:23.476626] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-15T18:12:23.476707] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCX took 16.4s. Estimated remaining: 2h 57m 28s. Rate: 9.5 symbols/min [2025-09-15T18:12:23.654352] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:23.657858] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-15T18:12:23.699962] [DEBUG] [LOCAL ] ECL: Loaded 34722 existing records from primary storage. [2025-09-15T18:12:23.700138] [INFO ] [MAIN ] ECL: Loaded 34722 existing records. [2025-09-15T18:12:23.883937] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:23.884198] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-15T18:12:23.884245] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-15T18:12:23.885045] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-15T18:12:23.885099] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-15T18:12:24.162909] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:12:24.252897] [INFO ] [REMOTE ] ECL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:24.457878] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-15T18:12:24.738573] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-15T18:12:25.257910] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-15T18:12:26.057922] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-15T18:12:26.469816] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:12:26.470966] [INFO ] [REMOTE ] ECCU: Full fetch complete (3202 records). [2025-09-15T18:12:26.471053] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-15T18:12:26.870394] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-15T18:12:26.882003] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:12:26.883321] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-09-15T18:12:26.892801] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-09-15T18:12:26.893787] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-09-15T18:12:26.893886] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-09-15T18:12:26.894733] [DEBUG] [LOCAL ] ECCU: Trimmed 3202 records to 1672 (keeping 150 days of data) [2025-09-15T18:12:26.906963] [DEBUG] [LOCAL ] ECCU: Primary data saved (1672 records). [2025-09-15T18:12:26.907112] [INFO ] [MAIN ] ECCU: Full history saved. [2025-09-15T18:12:26.907225] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECCU took 23.0s. Estimated remaining: 2h 57m 14s. Rate: 9.5 symbols/min [2025-09-15T18:12:27.081895] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:27.099695] [DEBUG] [LOCAL ] ECO: Loaded 13176 existing records from primary storage. [2025-09-15T18:12:27.099857] [INFO ] [MAIN ] ECO: Loaded 13176 existing records. [2025-09-15T18:12:27.278678] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:27.278939] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-15T18:12:27.278984] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-15T18:12:27.279455] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-15T18:12:27.279501] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-15T18:12:27.666098] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-15T18:12:27.671519] [INFO ] [REMOTE ] ECO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:28.026694] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T18:12:28.457875] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-15T18:12:28.548364] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:12:29.257911] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-15T18:12:29.570084] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T18:12:30.039507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:12:30.057902] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-15T18:12:30.858024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-15T18:12:31.193222] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:12:31.512127] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:12:31.657921] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-15T18:12:32.457903] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-15T18:12:32.599526] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:12:32.876235] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:12:33.257905] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-15T18:12:34.057867] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-15T18:12:34.295776] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:12:34.857887] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-15T18:12:35.369014] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:12:35.369774] [INFO ] [REMOTE ] ECCW: Full fetch complete (1185 records). [2025-09-15T18:12:35.369848] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-15T18:12:35.545037] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-15T18:12:35.545223] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:35.545263] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:35.545303] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-15T18:12:35.545381] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-15T18:12:35.545432] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-15T18:12:35.545475] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-15T18:12:35.545531] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 29.9s. Estimated remaining: 2h 57m 14s. Rate: 9.5 symbols/min [2025-09-15T18:12:35.662928] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-15T18:12:35.750802] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:35.783235] [DEBUG] [LOCAL ] ECVT: Loaded 32268 existing records from primary storage. [2025-09-15T18:12:35.783420] [INFO ] [MAIN ] ECVT: Loaded 32268 existing records. [2025-09-15T18:12:35.969418] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:35.969852] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-15T18:12:35.970007] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-15T18:12:35.979410] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-15T18:12:35.995681] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-15T18:12:36.045946] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:12:36.358176] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:36.457833] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-15T18:12:36.484188] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:12:37.257877] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-15T18:12:37.860600] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:12:37.938346] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:12:38.057878] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-15T18:12:38.857879] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-15T18:12:38.948090] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:12:39.657870] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-15T18:12:39.847636] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:12:40.318894] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T18:12:40.457870] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-15T18:12:41.257921] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-15T18:12:41.562802] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:12:42.057876] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-15T18:12:42.308221] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:12:42.857852] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-15T18:12:43.158415] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:12:43.657893] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-15T18:12:44.162561] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:12:44.457939] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-15T18:12:44.685057] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:12:45.257913] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-15T18:12:45.810951] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:12:46.057890] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-15T18:12:46.784732] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:12:46.857874] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-15T18:12:47.535004] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:12:47.654371] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:12:47.657450] [INFO ] [REMOTE ] ECO: Full fetch complete (20673 records). [2025-09-15T18:12:47.657778] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-15T18:12:47.657855] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-15T18:12:48.023088] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-15T18:12:48.023172] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-15T18:12:48.023714] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-15T18:12:48.023773] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-15T18:12:48.024920] [DEBUG] [LOCAL ] ECO: Trimmed 20673 records to 13055 (keeping 150 days of data) [2025-09-15T18:12:48.109016] [DEBUG] [LOCAL ] ECO: Primary data saved (13055 records). [2025-09-15T18:12:48.109175] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-15T18:12:48.109273] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECO took 21.2s. Estimated remaining: 2h 57m 23s. Rate: 9.5 symbols/min [2025-09-15T18:12:48.297292] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:48.354264] [DEBUG] [LOCAL ] ED: Loaded 39716 existing records from primary storage. [2025-09-15T18:12:48.354511] [INFO ] [MAIN ] ED: Loaded 39716 existing records. [2025-09-15T18:12:48.463108] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-15T18:12:48.569634] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:48.570107] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-15T18:12:48.570175] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-15T18:12:48.571376] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-15T18:12:48.571449] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-15T18:12:48.988939] [INFO ] [REMOTE ] ED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:49.132616] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T18:12:49.257963] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-15T18:12:49.922263] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:12:49.925870] [INFO ] [REMOTE ] ECG: Full fetch complete (38919 records). [2025-09-15T18:12:49.925956] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-15T18:12:50.068089] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-15T18:12:50.298541] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-15T18:12:50.298625] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-15T18:12:50.299244] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-15T18:12:50.299287] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-15T18:12:50.300116] [DEBUG] [LOCAL ] ECG: Trimmed 38919 records to 24130 (keeping 150 days of data) [2025-09-15T18:12:50.450712] [DEBUG] [LOCAL ] ECG: Primary data saved (24130 records). [2025-09-15T18:12:50.450850] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-15T18:12:50.450981] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 30.9s. Estimated remaining: 2h 57m 7s. Rate: 9.5 symbols/min [2025-09-15T18:12:50.619329] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:50.639293] [DEBUG] [LOCAL ] EDD: Loaded 20453 existing records from primary storage. [2025-09-15T18:12:50.639421] [INFO ] [MAIN ] EDD: Loaded 20453 existing records. [2025-09-15T18:12:50.818420] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:50.818798] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-15T18:12:50.818867] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-15T18:12:50.819468] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-15T18:12:50.819516] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-15T18:12:50.881621] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-15T18:12:51.182039] [INFO ] [REMOTE ] EDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:51.198289] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:12:51.204536] [INFO ] [REMOTE ] ECL: Full fetch complete (50926 records). [2025-09-15T18:12:51.204731] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-15T18:12:51.601848] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-15T18:12:51.602012] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-15T18:12:51.603465] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-15T18:12:51.603558] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-15T18:12:51.605415] [DEBUG] [LOCAL ] ECL: Trimmed 50926 records to 33964 (keeping 150 days of data) [2025-09-15T18:12:51.674626] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-15T18:12:51.867154] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:12:51.893504] [DEBUG] [LOCAL ] ECL: Primary data saved (33964 records). [2025-09-15T18:12:51.893779] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-15T18:12:51.894987] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECL took 28.4s. Estimated remaining: 2h 56m 48s. Rate: 9.5 symbols/min [2025-09-15T18:12:52.072315] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:52.089951] [DEBUG] [LOCAL ] EDF: Loaded 9711 existing records from primary storage. [2025-09-15T18:12:52.090136] [INFO ] [MAIN ] EDF: Loaded 9711 existing records. [2025-09-15T18:12:52.271412] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:52.271781] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-15T18:12:52.271830] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-15T18:12:52.272205] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-15T18:12:52.272253] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-15T18:12:52.472829] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-15T18:12:52.642814] [INFO ] [REMOTE ] EDF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:52.659528] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:12:52.699182] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:12:53.257911] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-15T18:12:54.056080] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:12:54.068324] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-15T18:12:54.450170] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:12:54.857888] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-15T18:12:55.135282] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:12:55.657867] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-15T18:12:56.467575] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-15T18:12:56.473722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:12:56.560920] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:12:57.257914] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-15T18:12:57.950217] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:12:58.057852] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-15T18:12:58.385895] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:12:58.857908] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-15T18:12:59.446424] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:12:59.657980] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-15T18:13:00.038157] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:13:00.457953] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-15T18:13:01.257959] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-15T18:13:01.378050] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:13:01.428415] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:13:02.057877] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-15T18:13:02.771673] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:13:02.857942] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-15T18:13:02.951717] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:13:03.440476] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:13:03.657919] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-15T18:13:04.457908] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-15T18:13:04.704624] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:13:05.257937] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-15T18:13:05.304156] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T18:13:06.057877] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-15T18:13:06.689102] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:13:06.694684] [INFO ] [REMOTE ] ECVT: Full fetch complete (46200 records). [2025-09-15T18:13:06.694838] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-15T18:13:06.858692] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-15T18:13:07.139845] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-15T18:13:07.139935] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-15T18:13:07.140607] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-15T18:13:07.140678] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-15T18:13:07.141813] [DEBUG] [LOCAL ] ECVT: Trimmed 46200 records to 31664 (keeping 150 days of data) [2025-09-15T18:13:07.350871] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:13:07.372142] [DEBUG] [LOCAL ] ECVT: Primary data saved (31664 records). [2025-09-15T18:13:07.372303] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-15T18:13:07.372425] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECVT took 31.8s. Estimated remaining: 2h 57m 4s. Rate: 9.5 symbols/min [2025-09-15T18:13:07.540418] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:07.555123] [DEBUG] [LOCAL ] EDN: Loaded 13165 existing records from primary storage. [2025-09-15T18:13:07.555251] [INFO ] [MAIN ] EDN: Loaded 13165 existing records. [2025-09-15T18:13:07.663812] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-15T18:13:07.746150] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:07.746464] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-15T18:13:07.746668] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-15T18:13:07.752292] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-15T18:13:07.757457] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-15T18:13:07.805289] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:13:08.147639] [INFO ] [REMOTE ] EDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:08.457964] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-15T18:13:09.037477] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:13:09.257923] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-15T18:13:09.464494] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:13:10.057862] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-15T18:13:10.698512] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:13:10.857882] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-15T18:13:11.077066] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:13:11.080593] [INFO ] [REMOTE ] EDD: Full fetch complete (29747 records). [2025-09-15T18:13:11.080692] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-15T18:13:11.451031] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-15T18:13:11.451124] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-15T18:13:11.451672] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-15T18:13:11.451724] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-15T18:13:11.460554] [DEBUG] [LOCAL ] EDD: Trimmed 29747 records to 19939 (keeping 150 days of data) [2025-09-15T18:13:11.460434] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:13:11.581490] [DEBUG] [LOCAL ] EDD: Primary data saved (19939 records). [2025-09-15T18:13:11.581682] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-15T18:13:11.581776] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. EDD took 21.1s. Estimated remaining: 2h 56m 53s. Rate: 9.5 symbols/min [2025-09-15T18:13:11.663089] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-15T18:13:11.758344] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:11.789479] [DEBUG] [LOCAL ] EDU: Loaded 33261 existing records from primary storage. [2025-09-15T18:13:11.789633] [INFO ] [MAIN ] EDU: Loaded 33261 existing records. [2025-09-15T18:13:11.967897] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:11.968201] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-15T18:13:11.968306] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-15T18:13:11.969219] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-15T18:13:11.969280] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-15T18:13:12.330931] [INFO ] [REMOTE ] EDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:12.458019] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-15T18:13:12.938735] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:13:13.257966] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-15T18:13:14.036756] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:13:14.057823] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-15T18:13:14.295981] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:13:14.857965] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-15T18:13:15.514175] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:13:15.520566] [INFO ] [REMOTE ] ED: Full fetch complete (57404 records). [2025-09-15T18:13:15.520798] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-15T18:13:15.661093] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-15T18:13:15.845922] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:13:15.963248] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-15T18:13:15.963333] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-15T18:13:15.964104] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-15T18:13:15.964150] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-15T18:13:15.965455] [DEBUG] [LOCAL ] ED: Trimmed 57404 records to 38957 (keeping 150 days of data) [2025-09-15T18:13:16.219798] [DEBUG] [LOCAL ] ED: Primary data saved (38957 records). [2025-09-15T18:13:16.219950] [INFO ] [MAIN ] ED: Full history saved. [2025-09-15T18:13:16.220688] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. ED took 28.1s. Estimated remaining: 2h 56m 42s. Rate: 9.5 symbols/min [2025-09-15T18:13:16.391117] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:16.415002] [DEBUG] [LOCAL ] EE: Loaded 24503 existing records from primary storage. [2025-09-15T18:13:16.415136] [INFO ] [MAIN ] EE: Loaded 24503 existing records. [2025-09-15T18:13:16.468723] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-15T18:13:16.545842] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:13:16.604491] [INFO ] [REMOTE ] EDF: Full fetch complete (15235 records). [2025-09-15T18:13:16.604624] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:16.604875] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-15T18:13:16.605225] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-15T18:13:16.605315] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-15T18:13:16.674620] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-15T18:13:16.680245] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-15T18:13:17.267846] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-15T18:13:17.333999] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:17.337270] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-15T18:13:17.337459] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-15T18:13:17.338145] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-15T18:13:17.338266] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-15T18:13:17.353534] [DEBUG] [LOCAL ] EDF: Trimmed 15235 records to 9497 (keeping 150 days of data) [2025-09-15T18:13:17.356078] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:13:17.418341] [DEBUG] [LOCAL ] EDF: Primary data saved (9497 records). [2025-09-15T18:13:17.418488] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-15T18:13:17.418586] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. EDF took 25.5s. Estimated remaining: 2h 56m 24s. Rate: 9.5 symbols/min [2025-09-15T18:13:17.630588] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:17.634407] [DEBUG] [LOCAL ] EEA: Loaded 2030 existing records from primary storage. [2025-09-15T18:13:17.634475] [INFO ] [MAIN ] EEA: Loaded 2030 existing records. [2025-09-15T18:13:17.810177] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:17.810437] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-15T18:13:17.810483] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-15T18:13:17.810691] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-15T18:13:17.810739] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-15T18:13:18.063103] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-15T18:13:18.167352] [INFO ] [REMOTE ] EEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:18.857860] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-15T18:13:18.948294] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:13:19.359702] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:13:19.457508] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:13:19.657904] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-15T18:13:20.457900] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-15T18:13:20.578620] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:13:21.257851] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-15T18:13:21.452044] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:13:21.773867] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:13:22.057865] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-15T18:13:22.857898] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-15T18:13:23.662831] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-15T18:13:23.669878] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:13:23.876784] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:13:24.457984] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-15T18:13:25.147393] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:13:25.257902] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-15T18:13:25.546989] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:13:25.549858] [INFO ] [REMOTE ] EDN: Full fetch complete (19698 records). [2025-09-15T18:13:25.549936] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-15T18:13:25.854475] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:13:25.929914] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-15T18:13:25.930023] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-15T18:13:25.930491] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-15T18:13:25.930535] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-15T18:13:25.931344] [DEBUG] [LOCAL ] EDN: Trimmed 19698 records to 12886 (keeping 150 days of data) [2025-09-15T18:13:26.007804] [DEBUG] [LOCAL ] EDN: Primary data saved (12886 records). [2025-09-15T18:13:26.007955] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-15T18:13:26.008042] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDN took 18.6s. Estimated remaining: 2h 56m 23s. Rate: 9.5 symbols/min [2025-09-15T18:13:26.063067] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-15T18:13:26.178281] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:26.188099] [DEBUG] [LOCAL ] EEX: Loaded 7466 existing records from primary storage. [2025-09-15T18:13:26.188226] [INFO ] [MAIN ] EEX: Loaded 7466 existing records. [2025-09-15T18:13:26.362323] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:26.362594] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-15T18:13:26.362676] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-15T18:13:26.363015] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-15T18:13:26.363061] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-15T18:13:26.724655] [INFO ] [REMOTE ] EEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:26.857860] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-15T18:13:27.388085] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:13:27.599751] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:13:27.657853] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-15T18:13:28.457879] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-15T18:13:29.257887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-15T18:13:29.423606] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:13:29.489486] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:13:29.672479] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T18:13:30.057927] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-15T18:13:30.522725] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:13:30.857870] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-15T18:13:31.304417] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T18:13:31.657864] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-15T18:13:32.457836] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-15T18:13:32.588750] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T18:13:33.257867] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-15T18:13:33.937574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:13:34.057859] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-15T18:13:34.206839] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:13:34.857865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-15T18:13:35.047698] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:13:35.630579] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:13:35.657899] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-15T18:13:36.306767] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T18:13:36.457879] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-15T18:13:36.929693] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T18:13:37.257874] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-15T18:13:37.737378] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T18:13:37.738551] [INFO ] [REMOTE ] EEA: Full fetch complete (3047 records). [2025-09-15T18:13:37.738666] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-15T18:13:38.062982] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-15T18:13:38.139873] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-15T18:13:38.139962] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-15T18:13:38.140106] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-15T18:13:38.140156] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-15T18:13:38.140520] [DEBUG] [LOCAL ] EEA: Trimmed 3047 records to 1980 (keeping 150 days of data) [2025-09-15T18:13:38.153293] [DEBUG] [LOCAL ] EEA: Primary data saved (1980 records). [2025-09-15T18:13:38.153355] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-15T18:13:38.153424] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EEA took 20.7s. Estimated remaining: 2h 56m 30s. Rate: 9.5 symbols/min [2025-09-15T18:13:38.332532] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:38.370542] [DEBUG] [LOCAL ] EFC: Loaded 34360 existing records from primary storage. [2025-09-15T18:13:38.370703] [INFO ] [MAIN ] EFC: Loaded 34360 existing records. [2025-09-15T18:13:38.549039] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:38.549580] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-15T18:13:38.549629] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-15T18:13:38.550712] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-15T18:13:38.550771] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-15T18:13:38.871894] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-15T18:13:38.912458] [INFO ] [REMOTE ] EFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:39.516903] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:13:39.563135] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T18:13:39.657840] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-15T18:13:40.366682] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T18:13:40.457877] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-15T18:13:41.141171] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:13:41.257925] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-15T18:13:41.893584] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:13:41.895635] [INFO ] [REMOTE ] EEX: Full fetch complete (13751 records). [2025-09-15T18:13:41.895750] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-15T18:13:42.063186] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-15T18:13:42.275586] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-15T18:13:42.275691] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-15T18:13:42.276024] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-15T18:13:42.276083] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-15T18:13:42.276614] [DEBUG] [LOCAL ] EEX: Trimmed 13751 records to 7231 (keeping 150 days of data) [2025-09-15T18:13:42.320098] [DEBUG] [LOCAL ] EEX: Primary data saved (7231 records). [2025-09-15T18:13:42.320233] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-15T18:13:42.320333] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EEX took 16.3s. Estimated remaining: 2h 56m 19s. Rate: 9.5 symbols/min [2025-09-15T18:13:42.495959] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:42.509073] [DEBUG] [LOCAL ] EFR: Loaded 10568 existing records from primary storage. [2025-09-15T18:13:42.509246] [INFO ] [MAIN ] EFR: Loaded 10568 existing records. [2025-09-15T18:13:42.697605] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:42.697878] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-15T18:13:42.697924] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-15T18:13:42.698374] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-15T18:13:42.698422] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-15T18:13:42.859805] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-15T18:13:43.065133] [INFO ] [REMOTE ] EFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:43.657944] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-15T18:13:43.763348] [DEBUG] [REMOTE ] EFR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T18:13:43.763660] [WARN ] [REMOTE ] EFR: No data returned for month 2025-02 [2025-09-15T18:13:43.850215] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T18:13:44.457905] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-15T18:13:44.520687] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:13:45.257966] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-15T18:13:46.057897] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-15T18:13:46.136108] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:13:46.520386] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:13:46.721075] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T18:13:46.857887] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-15T18:13:47.657885] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-15T18:13:47.776894] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:13:48.457888] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-15T18:13:48.680293] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:13:48.685800] [INFO ] [REMOTE ] EDU: Full fetch complete (49881 records). [2025-09-15T18:13:48.685980] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-15T18:13:49.092536] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-15T18:13:49.092675] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-15T18:13:49.093409] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-15T18:13:49.093453] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-15T18:13:49.094683] [DEBUG] [LOCAL ] EDU: Trimmed 49881 records to 32550 (keeping 150 days of data) [2025-09-15T18:13:49.273309] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-15T18:13:49.297374] [DEBUG] [LOCAL ] EDU: Primary data saved (32550 records). [2025-09-15T18:13:49.297546] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-15T18:13:49.297677] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EDU took 37.7s. Estimated remaining: 2h 56m 14s. Rate: 9.5 symbols/min [2025-09-15T18:13:49.466075] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:49.476309] [DEBUG] [LOCAL ] EFT: Loaded 9263 existing records from primary storage. [2025-09-15T18:13:49.476420] [INFO ] [MAIN ] EFT: Loaded 9263 existing records. [2025-09-15T18:13:49.655551] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:49.655868] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-15T18:13:49.655916] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-15T18:13:49.656215] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-15T18:13:49.656259] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-15T18:13:50.009671] [INFO ] [REMOTE ] EFT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:50.018437] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:13:50.057834] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-15T18:13:50.092856] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T18:13:50.581178] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:13:50.857930] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-15T18:13:51.574841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T18:13:51.657883] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-15T18:13:52.457902] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-15T18:13:52.885408] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:13:53.257945] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-15T18:13:54.057895] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-15T18:13:54.234526] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:13:54.280511] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:13:54.857880] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-15T18:13:55.048411] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:13:55.657909] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-15T18:13:56.010115] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:13:56.457875] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-15T18:13:56.659905] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:13:56.663300] [INFO ] [REMOTE ] EE: Full fetch complete (34402 records). [2025-09-15T18:13:56.663376] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-15T18:13:57.043208] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-15T18:13:57.043365] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-15T18:13:57.044315] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-15T18:13:57.044436] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-15T18:13:57.046114] [DEBUG] [LOCAL ] EE: Trimmed 34402 records to 23948 (keeping 150 days of data) [2025-09-15T18:13:57.197596] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T18:13:57.207807] [DEBUG] [LOCAL ] EE: Primary data saved (23948 records). [2025-09-15T18:13:57.207883] [INFO ] [MAIN ] EE: Full history saved. [2025-09-15T18:13:57.207960] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EE took 41.0s. Estimated remaining: 2h 56m 12s. Rate: 9.5 symbols/min [2025-09-15T18:13:57.263733] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-15T18:13:57.391191] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:57.425552] [DEBUG] [LOCAL ] EFX: Loaded 33339 existing records from primary storage. [2025-09-15T18:13:57.425725] [INFO ] [MAIN ] EFX: Loaded 33339 existing records. [2025-09-15T18:13:57.601322] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:57.601584] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-15T18:13:57.601633] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-15T18:13:57.602422] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-15T18:13:57.602471] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-15T18:13:57.962795] [INFO ] [REMOTE ] EFX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:58.057854] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-15T18:13:58.292479] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:13:58.857972] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-15T18:13:59.645787] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:13:59.657833] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-15T18:14:00.006256] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:14:00.457891] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-15T18:14:01.212361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:14:01.257836] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-15T18:14:02.057880] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-15T18:14:02.139704] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:02.639996] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:14:02.857873] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-15T18:14:03.053566] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T18:14:03.657926] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-15T18:14:03.695993] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:14:04.457905] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-15T18:14:05.023040] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:05.241350] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T18:14:05.257849] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-15T18:14:06.057868] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-15T18:14:06.171274] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:14:06.173275] [INFO ] [REMOTE ] EFT: Full fetch complete (13148 records). [2025-09-15T18:14:06.173552] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-15T18:14:06.539956] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-15T18:14:06.540050] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-15T18:14:06.540347] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-15T18:14:06.540388] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-15T18:14:06.540871] [DEBUG] [LOCAL ] EFT: Trimmed 13148 records to 9090 (keeping 150 days of data) [2025-09-15T18:14:06.597131] [DEBUG] [LOCAL ] EFT: Primary data saved (9090 records). [2025-09-15T18:14:06.597278] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-15T18:14:06.597365] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EFT took 17.3s. Estimated remaining: 2h 56m 13s. Rate: 9.5 symbols/min [2025-09-15T18:14:06.766408] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:06.785715] [DEBUG] [LOCAL ] EFXT: Loaded 21439 existing records from primary storage. [2025-09-15T18:14:06.785833] [INFO ] [MAIN ] EFXT: Loaded 21439 existing records. [2025-09-15T18:14:06.863079] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-15T18:14:06.967226] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:06.967500] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-15T18:14:06.967560] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-15T18:14:06.968138] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-15T18:14:06.968191] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-15T18:14:07.336532] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:07.657920] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-15T18:14:07.704229] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:14:08.388578] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:14:08.394342] [INFO ] [REMOTE ] EFC: Full fetch complete (50146 records). [2025-09-15T18:14:08.394511] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-15T18:14:08.464600] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-15T18:14:08.793822] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-15T18:14:08.793916] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-15T18:14:08.794622] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-15T18:14:08.794762] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-15T18:14:08.795981] [DEBUG] [LOCAL ] EFC: Trimmed 50146 records to 33691 (keeping 150 days of data) [2025-09-15T18:14:08.926879] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:14:09.039348] [DEBUG] [LOCAL ] EFC: Primary data saved (33691 records). [2025-09-15T18:14:09.039509] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-15T18:14:09.039608] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFC took 30.9s. Estimated remaining: 2h 55m 57s. Rate: 9.5 symbols/min [2025-09-15T18:14:09.212186] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:09.232555] [DEBUG] [LOCAL ] EG: Loaded 21242 existing records from primary storage. [2025-09-15T18:14:09.232768] [INFO ] [MAIN ] EG: Loaded 21242 existing records. [2025-09-15T18:14:09.263094] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-15T18:14:09.379945] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:14:09.437500] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:09.437832] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-15T18:14:09.437885] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-15T18:14:09.438480] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-15T18:14:09.438535] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-15T18:14:09.806996] [INFO ] [REMOTE ] EG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:10.057890] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-15T18:14:10.476672] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:14:10.857872] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-15T18:14:11.333058] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:14:11.657877] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-15T18:14:12.051046] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T18:14:12.457928] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-15T18:14:12.499117] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:14:12.501630] [INFO ] [REMOTE ] EFR: Full fetch complete (13771 records). [2025-09-15T18:14:12.501949] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-15T18:14:12.502486] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:14:12.502573] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:14:12.502612] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:14:12.502683] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-15T18:14:12.502759] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-15T18:14:12.502804] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-15T18:14:12.503163] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-09-15T18:14:12.503248] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFR took 30.2s. Estimated remaining: 2h 55m 44s. Rate: 9.5 symbols/min [2025-09-15T18:14:12.674425] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:12.715300] [DEBUG] [LOCAL ] EGO: Loaded 38604 existing records from primary storage. [2025-09-15T18:14:12.715441] [INFO ] [MAIN ] EGO: Loaded 38604 existing records. [2025-09-15T18:14:12.901628] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:12.901937] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-15T18:14:12.901987] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-15T18:14:12.902809] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-15T18:14:12.902873] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-15T18:14:13.254170] [INFO ] [REMOTE ] EGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:13.257821] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-15T18:14:14.057852] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-15T18:14:14.133601] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:14.857869] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-15T18:14:15.137921] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:14:15.372807] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T18:14:15.657868] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-15T18:14:16.335691] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:14:16.340841] [INFO ] [REMOTE ] EFX: Full fetch complete (48976 records). [2025-09-15T18:14:16.340950] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-15T18:14:16.463023] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-15T18:14:16.726144] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-15T18:14:16.726227] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-15T18:14:16.727797] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-15T18:14:16.727950] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-15T18:14:16.732830] [DEBUG] [LOCAL ] EFX: Trimmed 48976 records to 32620 (keeping 150 days of data) [2025-09-15T18:14:16.950782] [DEBUG] [LOCAL ] EFX: Primary data saved (32620 records). [2025-09-15T18:14:16.950941] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-15T18:14:16.951494] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFX took 19.7s. Estimated remaining: 2h 55m 33s. Rate: 9.5 symbols/min [2025-09-15T18:14:17.122352] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:17.148701] [DEBUG] [LOCAL ] EGP: Loaded 22583 existing records from primary storage. [2025-09-15T18:14:17.148843] [INFO ] [MAIN ] EGP: Loaded 22583 existing records. [2025-09-15T18:14:17.262430] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-15T18:14:17.338399] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:17.339058] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-15T18:14:17.339132] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-15T18:14:17.340031] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-15T18:14:17.340110] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-15T18:14:17.608616] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T18:14:17.756956] [INFO ] [REMOTE ] EGP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:17.772427] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:14:18.057872] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-15T18:14:18.782240] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:14:18.857884] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-15T18:14:19.657875] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-15T18:14:19.817070] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:14:20.028206] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:14:20.457898] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-15T18:14:20.876062] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T18:14:21.264276] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-15T18:14:21.281311] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:14:22.057872] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-15T18:14:22.630239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:22.857923] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-15T18:14:23.401942] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:14:23.407431] [INFO ] [REMOTE ] EFXT: Full fetch complete (32340 records). [2025-09-15T18:14:23.407558] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-15T18:14:23.663675] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-15T18:14:23.819851] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-15T18:14:23.819932] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-15T18:14:23.820546] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-15T18:14:23.820589] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-15T18:14:23.821442] [DEBUG] [LOCAL ] EFXT: Trimmed 32340 records to 20982 (keeping 150 days of data) [2025-09-15T18:14:23.953694] [DEBUG] [LOCAL ] EFXT: Primary data saved (20982 records). [2025-09-15T18:14:23.953839] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-15T18:14:23.953938] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 17.4s. Estimated remaining: 2h 55m 28s. Rate: 9.5 symbols/min [2025-09-15T18:14:24.125226] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:24.160062] [DEBUG] [LOCAL ] EGY: Loaded 31091 existing records from primary storage. [2025-09-15T18:14:24.160224] [INFO ] [MAIN ] EGY: Loaded 31091 existing records. [2025-09-15T18:14:24.346752] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:24.347186] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-15T18:14:24.347252] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-15T18:14:24.348037] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-15T18:14:24.348211] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-15T18:14:24.457883] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-15T18:14:24.493219] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:14:24.753803] [INFO ] [REMOTE ] EGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:25.073589] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:14:25.257866] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-15T18:14:26.052563] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:14:26.059774] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-15T18:14:26.857902] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-15T18:14:26.922013] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:14:27.220596] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:14:27.657882] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-15T18:14:28.136872] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T18:14:28.457902] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-15T18:14:29.257906] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-15T18:14:29.342451] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:29.645498] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:14:30.057860] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-15T18:14:30.413408] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:14:30.857880] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-15T18:14:31.282849] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:14:31.657890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-15T18:14:32.237978] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:14:32.457891] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-15T18:14:33.248930] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:14:33.255864] [INFO ] [REMOTE ] EGO: Full fetch complete (55426 records). [2025-09-15T18:14:33.255986] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-15T18:14:33.257534] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:14:33.257622] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:14:33.257695] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:14:33.257753] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-15T18:14:33.257826] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-15T18:14:33.258054] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-09-15T18:14:33.257943] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-15T18:14:33.259204] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-09-15T18:14:33.260544] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EGO took 20.8s. Estimated remaining: 2h 55m 29s. Rate: 9.5 symbols/min [2025-09-15T18:14:33.436060] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:33.465852] [DEBUG] [LOCAL ] EHAB: Loaded 22977 existing records from primary storage. [2025-09-15T18:14:33.465991] [INFO ] [MAIN ] EHAB: Loaded 22977 existing records. [2025-09-15T18:14:33.658191] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:33.658452] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-15T18:14:33.658501] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-15T18:14:33.659074] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-15T18:14:33.659126] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-15T18:14:34.023516] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:34.048820] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:14:34.058427] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-15T18:14:34.129816] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:14:34.857888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-15T18:14:35.381588] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:14:35.657912] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-15T18:14:35.720923] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:14:36.457888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-15T18:14:37.047096] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:14:37.257905] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-15T18:14:37.740279] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:14:38.057927] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-15T18:14:38.479884] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:14:38.857906] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-15T18:14:39.384827] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:14:39.657867] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-15T18:14:39.962451] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:14:40.457928] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-15T18:14:40.833584] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:14:41.257951] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-15T18:14:41.465091] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:14:42.057860] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-15T18:14:42.745310] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:14:42.857823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-15T18:14:43.263557] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:14:43.266753] [INFO ] [REMOTE ] EG: Full fetch complete (32043 records). [2025-09-15T18:14:43.266825] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-15T18:14:43.629222] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-15T18:14:43.629299] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-15T18:14:43.629843] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-15T18:14:43.629894] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-15T18:14:43.630582] [DEBUG] [LOCAL ] EG: Trimmed 32043 records to 20850 (keeping 150 days of data) [2025-09-15T18:14:43.692817] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-15T18:14:43.769922] [DEBUG] [LOCAL ] EG: Primary data saved (20850 records). [2025-09-15T18:14:43.770035] [INFO ] [MAIN ] EG: Full history saved. [2025-09-15T18:14:43.770146] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EG took 34.7s. Estimated remaining: 2h 55m 33s. Rate: 9.5 symbols/min [2025-09-15T18:14:43.943606] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:43.981315] [DEBUG] [LOCAL ] EHC: Loaded 31562 existing records from primary storage. [2025-09-15T18:14:43.981463] [INFO ] [MAIN ] EHC: Loaded 31562 existing records. [2025-09-15T18:14:44.159702] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:44.159955] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-15T18:14:44.160009] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-15T18:14:44.160916] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-15T18:14:44.160979] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-15T18:14:44.465076] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-15T18:14:44.530671] [INFO ] [REMOTE ] EHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:44.554484] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:14:44.956798] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:14:45.257901] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-15T18:14:45.481926] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:14:45.485840] [INFO ] [REMOTE ] EGP: Full fetch complete (34543 records). [2025-09-15T18:14:45.485940] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-15T18:14:45.850735] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-15T18:14:45.850813] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-15T18:14:45.851361] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-15T18:14:45.851401] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-15T18:14:45.852147] [DEBUG] [LOCAL ] EGP: Trimmed 34543 records to 22063 (keeping 150 days of data) [2025-09-15T18:14:45.995265] [DEBUG] [LOCAL ] EGP: Primary data saved (22063 records). [2025-09-15T18:14:45.995393] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-15T18:14:45.995480] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGP took 29.0s. Estimated remaining: 2h 55m 17s. Rate: 9.5 symbols/min [2025-09-15T18:14:46.063022] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-15T18:14:46.163163] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:46.172216] [DEBUG] [LOCAL ] EHI: Loaded 7822 existing records from primary storage. [2025-09-15T18:14:46.172311] [INFO ] [MAIN ] EHI: Loaded 7822 existing records. [2025-09-15T18:14:46.345928] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:46.346137] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-15T18:14:46.346180] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-15T18:14:46.346486] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-15T18:14:46.346541] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-15T18:14:46.700852] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:46.863339] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-15T18:14:46.878015] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:14:47.291018] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:14:47.295405] [INFO ] [REMOTE ] EGY: Full fetch complete (45923 records). [2025-09-15T18:14:47.295485] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-15T18:14:47.598435] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:14:47.666845] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-15T18:14:47.682566] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-15T18:14:47.682622] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-15T18:14:47.683265] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-15T18:14:47.683383] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-15T18:14:47.684395] [DEBUG] [LOCAL ] EGY: Trimmed 45923 records to 30410 (keeping 150 days of data) [2025-09-15T18:14:47.892597] [DEBUG] [LOCAL ] EGY: Primary data saved (30410 records). [2025-09-15T18:14:47.892868] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-15T18:14:47.892995] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 23.9s. Estimated remaining: 2h 54m 60s. Rate: 9.5 symbols/min [2025-09-15T18:14:48.078808] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:48.100766] [DEBUG] [LOCAL ] EIC: Loaded 18009 existing records from primary storage. [2025-09-15T18:14:48.101012] [INFO ] [MAIN ] EIC: Loaded 18009 existing records. [2025-09-15T18:14:48.298454] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:48.298808] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-15T18:14:48.298859] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-15T18:14:48.299538] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-15T18:14:48.299593] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-15T18:14:48.463607] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-15T18:14:48.593540] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T18:14:48.706022] [INFO ] [REMOTE ] EIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:49.257913] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-15T18:14:49.917432] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:14:50.057883] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-15T18:14:50.360607] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:14:50.857839] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-15T18:14:51.262978] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:14:51.657905] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-15T18:14:52.240046] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:14:52.457922] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-15T18:14:52.561522] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:14:53.257892] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-15T18:14:53.658333] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:14:53.732366] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:14:54.057881] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-15T18:14:54.859361] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:14:54.857844] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-15T18:14:55.657890] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-15T18:14:56.228756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:56.457896] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-15T18:14:56.717263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:14:56.720460] [INFO ] [REMOTE ] EHAB: Full fetch complete (32262 records). [2025-09-15T18:14:56.720546] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-15T18:14:57.128388] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-15T18:14:57.128473] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-15T18:14:57.129202] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-15T18:14:57.129259] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-15T18:14:57.130129] [DEBUG] [LOCAL ] EHAB: Trimmed 32262 records to 22563 (keeping 150 days of data) [2025-09-15T18:14:57.261488] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-15T18:14:57.270962] [DEBUG] [LOCAL ] EHAB: Primary data saved (22563 records). [2025-09-15T18:14:57.271161] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-15T18:14:57.271253] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EHAB took 24.0s. Estimated remaining: 2h 55m 1s. Rate: 9.5 symbols/min [2025-09-15T18:14:57.454749] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:57.454967] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-15T18:14:57.455009] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-15T18:14:57.455137] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-15T18:14:57.455177] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-15T18:14:57.455218] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-15T18:14:57.455251] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-15T18:14:57.821816] [INFO ] [REMOTE ] EICA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:57.877406] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:14:58.057890] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-15T18:14:58.430909] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-15T18:14:58.468670] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:14:58.857890] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-15T18:14:59.497039] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:14:59.657909] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-15T18:14:59.962265] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-15T18:15:00.457894] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-15T18:15:00.829479] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T18:15:01.257918] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-15T18:15:02.057933] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-15T18:15:02.857901] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-15T18:15:03.657921] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-15T18:15:03.709842] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T18:15:04.457914] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-15T18:15:04.695023] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-15T18:15:04.787901] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T18:15:05.257945] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-15T18:15:05.416250] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:15:06.057891] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-15T18:15:06.405491] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:15:06.478583] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T18:15:06.857910] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-15T18:15:06.919907] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T18:15:07.657926] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-15T18:15:08.306910] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:15:08.312093] [INFO ] [REMOTE ] EHC: Full fetch complete (45172 records). [2025-09-15T18:15:08.312273] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-15T18:15:08.461738] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-15T18:15:08.698558] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-15T18:15:08.698665] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-15T18:15:08.699369] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-15T18:15:08.699411] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-15T18:15:08.700474] [DEBUG] [LOCAL ] EHC: Trimmed 45172 records to 30763 (keeping 150 days of data) [2025-09-15T18:15:08.902063] [DEBUG] [LOCAL ] EHC: Primary data saved (30763 records). [2025-09-15T18:15:08.902217] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-15T18:15:08.902311] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHC took 25.1s. Estimated remaining: 2h 55m 7s. Rate: 9.5 symbols/min [2025-09-15T18:15:09.076408] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:09.076782] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-15T18:15:09.076934] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-15T18:15:09.077343] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-15T18:15:09.077471] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-15T18:15:09.084588] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-15T18:15:09.085804] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:15:09.085295] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-15T18:15:09.146408] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:15:09.263039] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-15T18:15:09.473567] [INFO ] [REMOTE ] EICB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:10.057866] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-15T18:15:10.269502] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T18:15:10.271876] [INFO ] [REMOTE ] EHI: Full fetch complete (11397 records). [2025-09-15T18:15:10.271958] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-15T18:15:10.635839] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-15T18:15:10.635926] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-15T18:15:10.636194] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-15T18:15:10.636235] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-15T18:15:10.636891] [DEBUG] [LOCAL ] EHI: Trimmed 11397 records to 7828 (keeping 150 days of data) [2025-09-15T18:15:10.684919] [DEBUG] [LOCAL ] EHI: Primary data saved (7828 records). [2025-09-15T18:15:10.685078] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-15T18:15:10.685166] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHI took 24.7s. Estimated remaining: 2h 54m 50s. Rate: 9.5 symbols/min [2025-09-15T18:15:10.862773] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-15T18:15:10.863907] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:10.871895] [DEBUG] [LOCAL ] EICC: Loaded 4350 existing records from primary storage. [2025-09-15T18:15:10.872022] [INFO ] [MAIN ] EICC: Loaded 4350 existing records. [2025-09-15T18:15:11.059511] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:11.059831] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-15T18:15:11.059882] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-15T18:15:11.060166] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-15T18:15:11.060248] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-15T18:15:11.387243] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:15:11.455751] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:11.473268] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:15:11.657910] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-15T18:15:12.189209] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T18:15:12.457881] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-15T18:15:13.038190] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:15:13.257959] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-15T18:15:14.057940] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-15T18:15:14.069862] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:15:14.857924] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-15T18:15:15.657902] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-15T18:15:15.918333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:15:15.990975] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T18:15:16.008235] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:15:16.457894] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-15T18:15:16.767046] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-15T18:15:17.257895] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-15T18:15:17.867439] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T18:15:18.057862] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-15T18:15:18.656703] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:15:18.857870] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-15T18:15:19.454878] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:15:19.657874] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-15T18:15:20.064330] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T18:15:20.457878] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-15T18:15:20.825770] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:15:20.826704] [INFO ] [REMOTE ] EICA: Full fetch complete (867 records). [2025-09-15T18:15:20.826777] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-15T18:15:20.827213] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:20.827300] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:20.827339] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:20.827384] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-15T18:15:20.827451] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-15T18:15:20.827498] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-15T18:15:20.827873] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-15T18:15:20.828478] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EICA took 23.6s. Estimated remaining: 2h 54m 52s. Rate: 9.5 symbols/min [2025-09-15T18:15:21.008524] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:21.025574] [DEBUG] [LOCAL ] EIG: Loaded 15585 existing records from primary storage. [2025-09-15T18:15:21.025747] [INFO ] [MAIN ] EIG: Loaded 15585 existing records. [2025-09-15T18:15:21.220666] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:21.221038] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-15T18:15:21.221089] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-15T18:15:21.221616] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-15T18:15:21.221698] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-15T18:15:21.263056] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-15T18:15:21.588047] [INFO ] [REMOTE ] EIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:21.732233] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T18:15:21.733575] [INFO ] [REMOTE ] EICC: Full fetch complete (6245 records). [2025-09-15T18:15:21.733664] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-15T18:15:21.734048] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:21.734119] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:21.734162] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:21.734205] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-15T18:15:21.734262] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-15T18:15:21.734333] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-15T18:15:21.734693] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-09-15T18:15:21.734773] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICC took 11.0s. Estimated remaining: 2h 54m 33s. Rate: 9.5 symbols/min [2025-09-15T18:15:21.907131] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:21.948043] [DEBUG] [LOCAL ] EIX: Loaded 40171 existing records from primary storage. [2025-09-15T18:15:21.948187] [INFO ] [MAIN ] EIX: Loaded 40171 existing records. [2025-09-15T18:15:22.063001] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-15T18:15:22.123595] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:22.123840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-15T18:15:22.123888] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-15T18:15:22.124765] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-15T18:15:22.124817] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-15T18:15:22.502307] [INFO ] [REMOTE ] EIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:22.839872] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:15:22.842406] [INFO ] [REMOTE ] EIC: Full fetch complete (26964 records). [2025-09-15T18:15:22.842498] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-15T18:15:22.863101] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-15T18:15:23.209776] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-15T18:15:23.209860] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-15T18:15:23.210437] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-15T18:15:23.210993] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-15T18:15:23.211725] [DEBUG] [LOCAL ] EIC: Trimmed 26964 records to 17683 (keeping 150 days of data) [2025-09-15T18:15:23.322268] [DEBUG] [LOCAL ] EIC: Primary data saved (17683 records). [2025-09-15T18:15:23.322431] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-15T18:15:23.322522] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 35.4s. Estimated remaining: 2h 54m 16s. Rate: 9.5 symbols/min [2025-09-15T18:15:23.423071] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:15:23.494680] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:23.533677] [DEBUG] [LOCAL ] EL: Loaded 40296 existing records from primary storage. [2025-09-15T18:15:23.533830] [INFO ] [MAIN ] EL: Loaded 40296 existing records. [2025-09-15T18:15:23.663866] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-15T18:15:23.737587] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:23.737985] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-15T18:15:23.738060] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-15T18:15:23.739087] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-15T18:15:23.739150] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-15T18:15:24.089352] [INFO ] [REMOTE ] EL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:24.457826] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-15T18:15:24.840314] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:15:25.257891] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-15T18:15:26.057884] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-15T18:15:26.317037] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:15:26.399691] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:15:26.857883] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-15T18:15:27.136886] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:15:27.657885] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-15T18:15:28.457869] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-15T18:15:28.593715] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T18:15:29.067226] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:15:29.257916] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-15T18:15:29.573359] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:15:29.599230] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T18:15:30.057891] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-15T18:15:30.857876] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-15T18:15:31.181890] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T18:15:31.657863] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-15T18:15:31.885804] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:15:32.097832] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:15:32.457875] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-15T18:15:33.257933] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-15T18:15:34.057901] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-15T18:15:34.365962] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:15:34.452312] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:15:34.489182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T18:15:34.857936] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-15T18:15:35.657939] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-15T18:15:36.457884] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-15T18:15:36.944171] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T18:15:37.257931] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-15T18:15:37.684236] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:15:37.786014] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:15:37.786962] [INFO ] [REMOTE ] EICB: Full fetch complete (1986 records). [2025-09-15T18:15:37.787035] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-15T18:15:37.972629] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T18:15:37.972866] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:37.972993] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:37.973107] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-15T18:15:37.973204] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-15T18:15:37.973343] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-15T18:15:37.973419] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-15T18:15:37.973504] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 29.1s. Estimated remaining: 2h 54m 29s. Rate: 9.5 symbols/min [2025-09-15T18:15:38.063086] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-15T18:15:38.156777] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-15T18:15:38.197917] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:38.245260] [DEBUG] [LOCAL ] ELAN: Loaded 40091 existing records from primary storage. [2025-09-15T18:15:38.245430] [INFO ] [MAIN ] ELAN: Loaded 40091 existing records. [2025-09-15T18:15:38.434898] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:38.435245] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-15T18:15:38.435298] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-15T18:15:38.436334] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-15T18:15:38.436393] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-15T18:15:38.798548] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:38.857833] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-15T18:15:39.649986] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T18:15:39.661134] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-15T18:15:40.334555] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:15:40.457917] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-15T18:15:40.481560] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:15:41.257890] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-15T18:15:42.057873] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-15T18:15:42.664030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-15T18:15:42.750157] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:15:42.776382] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:15:42.857899] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-15T18:15:43.657893] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-15T18:15:44.452525] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:15:44.463103] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-15T18:15:45.090791] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:15:45.257891] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-15T18:15:45.368841] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:15:46.057889] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-15T18:15:46.862999] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-15T18:15:46.885013] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:15:47.186094] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:15:47.188726] [INFO ] [REMOTE ] EIG: Full fetch complete (21647 records). [2025-09-15T18:15:47.188800] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-15T18:15:47.557916] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-15T18:15:47.558025] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-15T18:15:47.558535] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-15T18:15:47.558577] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-15T18:15:47.559268] [DEBUG] [LOCAL ] EIG: Trimmed 21647 records to 15429 (keeping 150 days of data) [2025-09-15T18:15:47.666302] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-15T18:15:47.666167] [DEBUG] [LOCAL ] EIG: Primary data saved (15429 records). [2025-09-15T18:15:47.666626] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-15T18:15:47.667719] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 26.8s. Estimated remaining: 2h 54m 30s. Rate: 9.5 symbols/min [2025-09-15T18:15:48.457834] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-15T18:15:48.937301] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T18:15:49.257922] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-15T18:15:49.351724] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:15:50.057926] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-15T18:15:50.527760] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T18:15:50.673144] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:15:50.679288] [INFO ] [REMOTE ] EL: Full fetch complete (58158 records). [2025-09-15T18:15:50.679461] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-15T18:15:50.858694] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-15T18:15:51.069118] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-15T18:15:51.069209] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-15T18:15:51.070007] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-15T18:15:51.070054] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-15T18:15:51.071366] [DEBUG] [LOCAL ] EL: Trimmed 58158 records to 39517 (keeping 150 days of data) [2025-09-15T18:15:51.330100] [DEBUG] [LOCAL ] EL: Primary data saved (39517 records). [2025-09-15T18:15:51.330301] [INFO ] [MAIN ] EL: Full history saved. [2025-09-15T18:15:51.330431] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EL took 28.0s. Estimated remaining: 2h 54m 18s. Rate: 9.5 symbols/min [2025-09-15T18:15:51.649453] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:15:51.662234] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-15T18:15:52.700081] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:15:52.711813] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-15T18:15:53.375348] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:15:53.387022] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-15T18:15:54.343732] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:15:54.349349] [INFO ] [REMOTE ] EIX: Full fetch complete (57648 records). [2025-09-15T18:15:54.349487] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-15T18:15:54.350298] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:54.350381] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:54.350418] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:54.350456] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-15T18:15:54.350515] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-15T18:15:54.350560] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-15T18:15:54.350915] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-15T18:15:54.351656] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.6s. Estimated remaining: 2h 54m 4s. Rate: 9.5 symbols/min [2025-09-15T18:15:55.113088] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:15:55.119439] [INFO ] [REMOTE ] ELAN: Full fetch complete (57756 records). [2025-09-15T18:15:55.119597] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-15T18:15:55.499212] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-15T18:15:55.499295] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-15T18:15:55.500077] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-15T18:15:55.500123] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-15T18:15:55.501364] [DEBUG] [LOCAL ] ELAN: Trimmed 57756 records to 39316 (keeping 150 days of data) [2025-09-15T18:15:55.745098] [DEBUG] [LOCAL ] ELAN: Primary data saved (39316 records). [2025-09-15T18:15:55.745268] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-15T18:15:55.745372] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. ELAN took 17.8s. Estimated remaining: 2h 53m 46s. Rate: 9.5 symbols/min [2025-09-15T18:15:56.253270] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.409085] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.440953] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.469728] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.474276] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-15T18:15:56.474586] [INFO ] [MAIN ] ELC: Loaded 2672 existing records. [2025-09-15T18:15:56.678106] [DEBUG] [LOCAL ] ELF: Loaded 39284 existing records from primary storage. [2025-09-15T18:15:56.642794] [DEBUG] [LOCAL ] ELP: Loaded 19609 existing records from primary storage. [2025-09-15T18:15:56.707713] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:56.707959] [INFO ] [MAIN ] ELP: Loaded 19609 existing records. [2025-09-15T18:15:56.715892] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-15T18:15:56.708082] [INFO ] [MAIN ] ELF: Loaded 39284 existing records. [2025-09-15T18:15:56.728115] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-15T18:15:56.772071] [DEBUG] [LOCAL ] ELME: Loaded 29297 existing records from primary storage. [2025-09-15T18:15:56.843490] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-15T18:15:56.873280] [INFO ] [MAIN ] ELME: Loaded 29297 existing records. [2025-09-15T18:15:56.873187] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-15T18:15:57.439514] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:57.526019] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-15T18:15:57.518497] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:57.555828] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-15T18:15:57.599715] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-15T18:15:57.618033] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-15T18:15:57.599557] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-15T18:15:57.646274] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-15T18:15:57.646864] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-15T18:15:57.646581] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-15T18:15:57.980507] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:58.146250] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-15T18:15:58.190284] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-15T18:15:58.235688] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-15T18:15:58.256486] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-15T18:15:58.446412] [INFO ] [REMOTE ] ELC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.488839] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-15T18:15:58.891311] [INFO ] [REMOTE ] ELF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.918668] [INFO ] [REMOTE ] ELP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.944865] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-15T18:15:58.944626] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-15T18:15:59.102115] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:15:59.108852] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-15T18:15:59.180841] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:59.181222] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-15T18:15:59.741061] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:15:59.742514] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-15T18:16:00.117415] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:16:00.124737] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-15T18:16:00.330562] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:16:00.332137] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-15T18:16:00.846769] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T18:16:00.858893] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-15T18:16:00.864574] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:16:00.890361] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:16:01.257884] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-15T18:16:01.383752] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:16:01.841866] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:16:02.057878] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-15T18:16:02.514210] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:16:02.857869] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-15T18:16:03.001465] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-15T18:16:03.218144] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:16:03.657908] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-15T18:16:04.457896] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-15T18:16:05.257911] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-15T18:16:05.683109] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:16:05.711721] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:16:06.057926] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-15T18:16:06.721374] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:16:06.722562] [INFO ] [REMOTE ] ELC: Full fetch complete (3756 records). [2025-09-15T18:16:06.722671] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-15T18:16:06.723129] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:06.723238] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:06.723281] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:06.723338] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-15T18:16:06.723403] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-15T18:16:06.723443] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-09-15T18:16:06.723736] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-09-15T18:16:06.723833] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 11.0s. Estimated remaining: 2h 53m 51s. Rate: 9.5 symbols/min [2025-09-15T18:16:06.863010] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-15T18:16:06.914101] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:06.914368] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-15T18:16:06.914427] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-15T18:16:06.914570] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-15T18:16:06.914611] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-15T18:16:06.914700] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-15T18:16:06.914747] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-15T18:16:07.275153] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:07.300348] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T18:16:07.657868] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-15T18:16:08.073279] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:16:08.457829] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-15T18:16:08.587004] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:16:09.257905] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-15T18:16:09.865667] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:16:09.897000] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:16:10.057896] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-15T18:16:10.857939] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-15T18:16:11.387747] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:16:11.657925] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-15T18:16:12.087896] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T18:16:12.175282] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:16:12.457904] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-15T18:16:13.257860] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-15T18:16:13.488721] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:16:14.057918] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-15T18:16:14.345671] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:16:14.857920] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-15T18:16:15.328606] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T18:16:15.657922] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-15T18:16:16.011690] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:16:16.457918] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-15T18:16:17.257912] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-15T18:16:17.510422] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T18:16:17.610900] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:16:17.658554] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:16:18.057865] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-15T18:16:18.468133] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:16:18.857911] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-15T18:16:19.657935] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-15T18:16:19.951194] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:16:19.953869] [INFO ] [REMOTE ] ELP: Full fetch complete (28203 records). [2025-09-15T18:16:19.953943] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-15T18:16:20.320548] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-15T18:16:20.320626] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-15T18:16:20.321172] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-15T18:16:20.321214] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-15T18:16:20.321984] [DEBUG] [LOCAL ] ELP: Trimmed 28203 records to 19225 (keeping 150 days of data) [2025-09-15T18:16:20.433959] [DEBUG] [LOCAL ] ELP: Primary data saved (19225 records). [2025-09-15T18:16:20.434092] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-15T18:16:20.434174] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELP took 24.7s. Estimated remaining: 2h 54m 1s. Rate: 9.5 symbols/min [2025-09-15T18:16:20.464825] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-15T18:16:20.606734] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:20.641765] [DEBUG] [LOCAL ] ELS: Loaded 37194 existing records from primary storage. [2025-09-15T18:16:20.641908] [INFO ] [MAIN ] ELS: Loaded 37194 existing records. [2025-09-15T18:16:20.800558] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T18:16:20.820471] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:20.820682] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-15T18:16:20.820728] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-15T18:16:20.821589] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-15T18:16:20.821657] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-15T18:16:21.175660] [INFO ] [REMOTE ] ELS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:21.194380] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:16:21.257884] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-15T18:16:21.591601] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-15T18:16:21.592357] [INFO ] [REMOTE ] ELPC: Full fetch complete (971 records). [2025-09-15T18:16:21.592431] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-15T18:16:21.592940] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:21.593034] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:21.593098] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:21.593168] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-15T18:16:21.593251] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-15T18:16:21.593320] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-15T18:16:21.593408] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-15T18:16:21.593493] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELPC took 14.9s. Estimated remaining: 2h 53m 43s. Rate: 9.5 symbols/min [2025-09-15T18:16:21.762687] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:21.805186] [DEBUG] [LOCAL ] ELV: Loaded 38179 existing records from primary storage. [2025-09-15T18:16:21.805350] [INFO ] [MAIN ] ELV: Loaded 38179 existing records. [2025-09-15T18:16:21.984871] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:21.985191] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-15T18:16:21.985254] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-15T18:16:21.986243] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-15T18:16:21.986305] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-15T18:16:22.062958] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-15T18:16:22.339457] [INFO ] [REMOTE ] ELV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:22.857888] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-15T18:16:23.657875] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-15T18:16:24.240532] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T18:16:24.457870] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-15T18:16:24.560979] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:16:25.012022] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:16:25.257876] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-15T18:16:26.057874] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-15T18:16:26.144727] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:16:26.562596] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:16:26.857873] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-15T18:16:27.341354] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:16:27.657871] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-15T18:16:28.457886] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-15T18:16:28.615718] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:16:28.812624] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:16:29.257871] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-15T18:16:29.833656] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:16:30.057872] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-15T18:16:30.825155] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:16:30.831434] [INFO ] [REMOTE ] ELME: Full fetch complete (42445 records). [2025-09-15T18:16:30.831585] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-15T18:16:30.832282] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:30.832385] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:30.832445] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:30.832507] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-15T18:16:30.832579] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-15T18:16:30.832618] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-09-15T18:16:30.832871] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-09-15T18:16:30.833007] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELME took 35.1s. Estimated remaining: 2h 53m 43s. Rate: 9.5 symbols/min [2025-09-15T18:16:30.858216] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-15T18:16:31.014362] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:31.014571] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-15T18:16:31.014610] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-15T18:16:31.014751] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-15T18:16:31.014792] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-15T18:16:31.014835] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-15T18:16:31.014868] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-15T18:16:31.376063] [INFO ] [REMOTE ] EMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:31.657870] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-15T18:16:32.457846] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-15T18:16:32.548349] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-15T18:16:32.756951] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:32.757281] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-15T18:16:33.257901] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-15T18:16:33.867416] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-15T18:16:34.057872] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-15T18:16:34.259951] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:34.260257] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-15T18:16:34.857886] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-15T18:16:35.172292] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T18:16:35.220807] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-15T18:16:35.226819] [INFO ] [REMOTE ] ELF: Full fetch complete (57012 records). [2025-09-15T18:16:35.226930] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-15T18:16:35.617602] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-15T18:16:35.617727] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-15T18:16:35.618555] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-15T18:16:35.618611] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-15T18:16:35.620256] [DEBUG] [LOCAL ] ELF: Trimmed 57012 records to 38501 (keeping 150 days of data) [2025-09-15T18:16:35.679681] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-15T18:16:35.870325] [DEBUG] [LOCAL ] ELF: Primary data saved (38501 records). [2025-09-15T18:16:35.870483] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-15T18:16:35.870602] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELF took 40.1s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-15T18:16:36.040060] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:36.056482] [DEBUG] [LOCAL ] EMD: Loaded 15058 existing records from primary storage. [2025-09-15T18:16:36.056661] [INFO ] [MAIN ] EMD: Loaded 15058 existing records. [2025-09-15T18:16:36.238151] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:36.238459] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-15T18:16:36.238508] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-15T18:16:36.238933] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-15T18:16:36.238987] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-15T18:16:36.470279] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-15T18:16:36.612576] [INFO ] [REMOTE ] EMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:36.642707] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:16:36.733275] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:36.733592] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-15T18:16:37.037605] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:16:37.257864] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-15T18:16:38.057945] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-15T18:16:38.857893] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-15T18:16:39.007185] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:16:39.657836] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-15T18:16:39.794905] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:16:40.115055] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:16:40.195382] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:16:40.457908] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-15T18:16:41.256048] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:16:41.259545] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-15T18:16:42.044024] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:16:42.057819] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-15T18:16:42.857879] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-15T18:16:42.976699] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:16:43.657877] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-15T18:16:44.457890] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-15T18:16:45.242551] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:16:45.244945] [INFO ] [REMOTE ] EMA: Full fetch complete (7215 records). [2025-09-15T18:16:45.245039] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-15T18:16:45.267660] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-15T18:16:45.430498] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 76 unique days, need 150 days [2025-09-15T18:16:45.430782] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:45.430843] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:45.430895] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-15T18:16:45.430962] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-15T18:16:45.431000] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-15T18:16:45.431049] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-15T18:16:45.431117] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 14.6s. Estimated remaining: 2h 53m 35s. Rate: 9.5 symbols/min [2025-09-15T18:16:45.598880] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:45.629447] [DEBUG] [LOCAL ] EME: Loaded 22709 existing records from primary storage. [2025-09-15T18:16:45.629632] [INFO ] [MAIN ] EME: Loaded 22709 existing records. [2025-09-15T18:16:45.816779] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:45.817198] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-15T18:16:45.817350] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-15T18:16:45.818226] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-15T18:16:45.818308] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-15T18:16:46.148985] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (3.29 seconds). [2025-09-15T18:16:46.233635] [INFO ] [REMOTE ] EME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:46.234522] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-15T18:16:46.250160] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T18:16:46.257234] [INFO ] [REMOTE ] ELS: Full fetch complete (52917 records). [2025-09-15T18:16:46.257377] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-15T18:16:46.258378] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:46.258460] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:46.258498] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:46.258542] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-15T18:16:46.258611] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-15T18:16:46.258672] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-15T18:16:46.258911] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-15T18:16:46.258999] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELS took 25.8s. Estimated remaining: 2h 53m 16s. Rate: 9.5 symbols/min [2025-09-15T18:16:46.431257] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:46.435382] [DEBUG] [LOCAL ] EMF: Loaded 2183 existing records from primary storage. [2025-09-15T18:16:46.435465] [INFO ] [MAIN ] EMF: Loaded 2183 existing records. [2025-09-15T18:16:46.614323] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:46.614680] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-15T18:16:46.614872] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-15T18:16:46.620183] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-15T18:16:46.628858] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-15T18:16:46.712186] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:16:46.863036] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-15T18:16:46.996555] [INFO ] [REMOTE ] EMF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:47.657933] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-15T18:16:48.015089] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:16:48.035829] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:16:48.165491] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:16:48.457852] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-15T18:16:49.257872] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-15T18:16:49.880113] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:16:50.057958] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-15T18:16:50.857967] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-15T18:16:50.988002] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:16:50.994343] [INFO ] [REMOTE ] ELV: Full fetch complete (54443 records). [2025-09-15T18:16:50.994526] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-15T18:16:50.995342] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:50.995458] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:50.995498] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:50.995545] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-15T18:16:50.995605] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-15T18:16:50.995663] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-15T18:16:50.995961] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-09-15T18:16:50.997181] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELV took 29.4s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-15T18:16:51.169461] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:51.217809] [DEBUG] [LOCAL ] EMN: Loaded 38189 existing records from primary storage. [2025-09-15T18:16:51.217954] [INFO ] [MAIN ] EMN: Loaded 38189 existing records. [2025-09-15T18:16:51.394350] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:51.394581] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-15T18:16:51.394629] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-15T18:16:51.395541] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-15T18:16:51.395595] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-15T18:16:51.662540] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T18:16:51.661874] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-15T18:16:51.779079] [INFO ] [REMOTE ] EMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:51.812267] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T18:16:52.457906] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-15T18:16:52.798576] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:16:53.257880] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-15T18:16:53.587612] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:16:53.969034] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:16:54.057909] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-15T18:16:54.857903] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-15T18:16:55.355065] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:16:55.510949] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T18:16:55.657891] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-15T18:16:56.457893] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-15T18:16:56.950829] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:16:57.257913] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-15T18:16:57.952189] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:16:58.057855] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-15T18:16:58.504213] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:16:58.776873] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:16:58.857868] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-15T18:16:59.657874] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-15T18:17:00.389567] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:17:00.457852] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-15T18:17:00.694864] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:17:01.257879] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-15T18:17:01.846358] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:17:02.057839] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-15T18:17:02.274539] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:17:02.277159] [INFO ] [REMOTE ] EMD: Full fetch complete (23795 records). [2025-09-15T18:17:02.277240] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-15T18:17:02.579219] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:17:02.666090] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-15T18:17:02.666180] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-15T18:17:02.666826] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-15T18:17:02.666880] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-15T18:17:02.667579] [DEBUG] [LOCAL ] EMD: Trimmed 23795 records to 14899 (keeping 150 days of data) [2025-09-15T18:17:02.763476] [DEBUG] [LOCAL ] EMD: Primary data saved (14899 records). [2025-09-15T18:17:02.763678] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-15T18:17:02.763797] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. EMD took 26.9s. Estimated remaining: 2h 53m 12s. Rate: 9.5 symbols/min [2025-09-15T18:17:02.863032] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-15T18:17:02.936900] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:02.947780] [DEBUG] [LOCAL ] EMO: Loaded 9565 existing records from primary storage. [2025-09-15T18:17:02.947903] [INFO ] [MAIN ] EMO: Loaded 9565 existing records. [2025-09-15T18:17:03.128076] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:03.128371] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-15T18:17:03.128419] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-15T18:17:03.128829] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-15T18:17:03.128883] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-15T18:17:03.486391] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T18:17:03.506491] [INFO ] [REMOTE ] EMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:03.657875] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-15T18:17:04.457894] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-15T18:17:05.153139] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:17:05.257878] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-15T18:17:05.319026] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:17:06.057886] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-15T18:17:06.742181] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:17:06.778012] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:17:06.857863] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-15T18:17:07.657880] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-15T18:17:07.754420] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:17:08.457868] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-15T18:17:08.841140] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:17:08.845021] [INFO ] [REMOTE ] EME: Full fetch complete (35268 records). [2025-09-15T18:17:08.845108] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-15T18:17:09.226936] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-15T18:17:09.227023] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-15T18:17:09.227692] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-15T18:17:09.227738] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-15T18:17:09.228703] [DEBUG] [LOCAL ] EME: Trimmed 35268 records to 22200 (keeping 150 days of data) [2025-09-15T18:17:09.290077] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-15T18:17:09.388130] [DEBUG] [LOCAL ] EME: Primary data saved (22200 records). [2025-09-15T18:17:09.388280] [INFO ] [MAIN ] EME: Full history saved. [2025-09-15T18:17:09.388380] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EME took 24.0s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-15T18:17:09.563812] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:09.568326] [DEBUG] [LOCAL ] EMP: Loaded 2192 existing records from primary storage. [2025-09-15T18:17:09.568440] [INFO ] [MAIN ] EMP: Loaded 2192 existing records. [2025-09-15T18:17:09.790352] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:09.790672] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-15T18:17:09.790859] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-15T18:17:09.791085] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-15T18:17:09.791138] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-15T18:17:09.900473] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-15T18:17:10.057835] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-15T18:17:10.203008] [INFO ] [REMOTE ] EMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:10.205985] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:17:10.601697] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:17:10.857885] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-15T18:17:11.241762] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T18:17:11.657894] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-15T18:17:12.211751] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:17:12.457878] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-15T18:17:12.878968] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T18:17:12.879883] [INFO ] [REMOTE ] EMF: Full fetch complete (4235 records). [2025-09-15T18:17:12.879955] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-15T18:17:13.233286] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-15T18:17:13.233372] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-15T18:17:13.233513] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-15T18:17:13.233554] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-15T18:17:13.233994] [DEBUG] [LOCAL ] EMF: Trimmed 4235 records to 2155 (keeping 150 days of data) [2025-09-15T18:17:13.248583] [DEBUG] [LOCAL ] EMF: Primary data saved (2155 records). [2025-09-15T18:17:13.248701] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-15T18:17:13.248797] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EMF took 27.0s. Estimated remaining: 2h 52m 55s. Rate: 9.5 symbols/min [2025-09-15T18:17:13.262985] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-15T18:17:13.421391] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:13.468412] [DEBUG] [LOCAL ] EMR: Loaded 40060 existing records from primary storage. [2025-09-15T18:17:13.468557] [INFO ] [MAIN ] EMR: Loaded 40060 existing records. [2025-09-15T18:17:13.652377] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:13.652667] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-15T18:17:13.652721] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-15T18:17:13.653724] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-15T18:17:13.653779] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-15T18:17:14.005453] [INFO ] [REMOTE ] EMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:14.057871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-15T18:17:14.132618] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:17:14.378666] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:17:14.857895] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-15T18:17:15.657890] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-15T18:17:15.926779] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:17:16.457903] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-15T18:17:17.048395] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:17:17.257853] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-15T18:17:17.375981] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:17:17.738359] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T18:17:18.057872] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-15T18:17:18.857871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-15T18:17:19.272701] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:17:19.657883] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-15T18:17:19.955817] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-15T18:17:20.457892] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-15T18:17:20.579220] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-15T18:17:21.257877] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-15T18:17:21.328400] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:17:22.057863] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-15T18:17:22.655036] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:17:22.656010] [INFO ] [REMOTE ] EMP: Full fetch complete (3149 records). [2025-09-15T18:17:22.656113] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-15T18:17:22.656487] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:17:22.656562] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:17:22.656607] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:17:22.656697] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-15T18:17:22.656791] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-15T18:17:22.656864] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-15T18:17:22.657259] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-09-15T18:17:22.657364] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMP took 13.3s. Estimated remaining: 2h 52m 55s. Rate: 9.5 symbols/min [2025-09-15T18:17:22.835269] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:22.865278] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-15T18:17:22.882711] [DEBUG] [LOCAL ] ENB: Loaded 40294 existing records from primary storage. [2025-09-15T18:17:22.882925] [INFO ] [MAIN ] ENB: Loaded 40294 existing records. [2025-09-15T18:17:23.072202] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:23.085789] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-15T18:17:23.085990] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-15T18:17:23.087093] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:17:23.092109] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-15T18:17:23.092470] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-15T18:17:23.137657] [INFO ] [REMOTE ] EMN: Full fetch complete (54276 records). [2025-09-15T18:17:23.165220] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-15T18:17:23.658203] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-15T18:17:23.747415] [INFO ] [REMOTE ] ENB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:23.845740] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-15T18:17:23.845830] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-15T18:17:23.846612] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-15T18:17:23.846672] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-15T18:17:23.848160] [DEBUG] [LOCAL ] EMN: Trimmed 54276 records to 37455 (keeping 150 days of data) [2025-09-15T18:17:24.087346] [DEBUG] [LOCAL ] EMN: Primary data saved (37455 records). [2025-09-15T18:17:24.087494] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-15T18:17:24.088776] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMN took 33.1s. Estimated remaining: 2h 52m 38s. Rate: 9.5 symbols/min [2025-09-15T18:17:24.265281] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:24.271987] [DEBUG] [LOCAL ] ENFY: Loaded 2700 existing records from primary storage. [2025-09-15T18:17:24.272299] [INFO ] [MAIN ] ENFY: Loaded 2700 existing records. [2025-09-15T18:17:24.465083] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:24.460964] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-15T18:17:24.465574] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-15T18:17:24.466673] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-15T18:17:24.467062] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-15T18:17:24.467169] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-15T18:17:24.629196] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:17:24.926910] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:24.931438] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:17:24.934537] [INFO ] [REMOTE ] EMO: Full fetch complete (12948 records). [2025-09-15T18:17:24.934727] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-15T18:17:25.271092] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-15T18:17:25.312213] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-15T18:17:25.312295] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-15T18:17:25.312628] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-15T18:17:25.312701] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-15T18:17:25.313184] [DEBUG] [LOCAL ] EMO: Trimmed 12948 records to 9432 (keeping 150 days of data) [2025-09-15T18:17:25.380294] [DEBUG] [LOCAL ] EMO: Primary data saved (9432 records). [2025-09-15T18:17:25.380471] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-15T18:17:25.380569] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMO took 22.6s. Estimated remaining: 2h 52m 20s. Rate: 9.5 symbols/min [2025-09-15T18:17:25.547611] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:25.574147] [DEBUG] [LOCAL ] ENIC: Loaded 28052 existing records from primary storage. [2025-09-15T18:17:25.574323] [INFO ] [MAIN ] ENIC: Loaded 28052 existing records. [2025-09-15T18:17:25.749178] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:25.749449] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-15T18:17:25.749496] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-15T18:17:25.750250] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-15T18:17:25.750301] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-15T18:17:26.070921] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-15T18:17:26.115720] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:26.411415] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T18:17:26.655978] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T18:17:26.857839] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-15T18:17:26.913969] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:17:27.284165] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:17:27.657873] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-15T18:17:28.457872] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-15T18:17:29.018368] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:17:29.257879] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-15T18:17:29.574733] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:17:30.057872] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-15T18:17:30.275907] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:17:30.857874] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-15T18:17:31.393132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:17:31.657883] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-15T18:17:32.457872] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-15T18:17:32.573662] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:17:33.130900] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:17:33.257866] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-15T18:17:34.057899] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-15T18:17:34.095685] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:17:34.813287] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:17:34.857898] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-15T18:17:35.389378] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:17:35.459871] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:17:35.657877] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-15T18:17:36.457884] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-15T18:17:36.674411] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:17:36.881067] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:17:37.257916] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-15T18:17:38.057883] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-15T18:17:38.522802] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:17:38.857876] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-15T18:17:39.201983] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:17:39.657892] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-15T18:17:40.153516] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:17:40.457880] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-15T18:17:40.795734] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:17:41.043799] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:17:41.045053] [INFO ] [REMOTE ] ENFY: Full fetch complete (3566 records). [2025-09-15T18:17:41.045136] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-15T18:17:41.045585] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:17:41.045700] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:17:41.045745] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:17:41.045801] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-15T18:17:41.045869] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-15T18:17:41.045912] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-09-15T18:17:41.046201] [DEBUG] [LOCAL ] ENFY: Deleted derivative data file. [2025-09-15T18:17:41.046299] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. ENFY took 17.0s. Estimated remaining: 2h 52m 35s. Rate: 9.5 symbols/min [2025-09-15T18:17:41.230492] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:41.233580] [DEBUG] [LOCAL ] ENO: Loaded 1267 existing records from primary storage. [2025-09-15T18:17:41.233672] [INFO ] [MAIN ] ENO: Loaded 1267 existing records. [2025-09-15T18:17:41.262948] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-15T18:17:41.414046] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:41.414322] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-15T18:17:41.414371] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-15T18:17:41.414559] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-15T18:17:41.414609] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-15T18:17:41.768078] [INFO ] [REMOTE ] ENO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:42.057915] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-15T18:17:42.857871] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-15T18:17:43.197378] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T18:17:43.290608] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:17:43.657882] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-15T18:17:43.969902] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T18:17:43.973168] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T18:17:44.457937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-15T18:17:44.988943] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:17:45.258044] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-15T18:17:46.057950] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-15T18:17:46.862925] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-15T18:17:46.880163] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:17:47.646905] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:17:47.652633] [INFO ] [REMOTE ] EMR: Full fetch complete (57887 records). [2025-09-15T18:17:47.652758] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-15T18:17:47.664600] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-15T18:17:48.048579] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-15T18:17:48.052961] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-15T18:17:48.053182] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T18:17:48.054329] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-15T18:17:48.056033] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-15T18:17:48.070455] [DEBUG] [LOCAL ] EMR: Trimmed 57887 records to 39273 (keeping 150 days of data) [2025-09-15T18:17:48.096697] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T18:17:48.367460] [DEBUG] [LOCAL ] EMR: Primary data saved (39273 records). [2025-09-15T18:17:48.367631] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-15T18:17:48.369149] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 35.1s. Estimated remaining: 2h 52m 31s. Rate: 9.5 symbols/min [2025-09-15T18:17:48.462943] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-15T18:17:48.545303] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:48.581922] [DEBUG] [LOCAL ] ENOV: Loaded 34517 existing records from primary storage. [2025-09-15T18:17:48.582062] [INFO ] [MAIN ] ENOV: Loaded 34517 existing records. [2025-09-15T18:17:48.764609] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:48.765035] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-15T18:17:48.765090] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-15T18:17:48.765912] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-15T18:17:48.765965] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-15T18:17:49.119392] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:49.257870] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-15T18:17:50.058065] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-15T18:17:50.316462] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:17:50.404321] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T18:17:50.833055] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:17:50.857817] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-15T18:17:51.657880] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-15T18:17:52.366804] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:17:52.457894] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-15T18:17:53.095420] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:17:53.257900] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-15T18:17:53.607255] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:17:54.057886] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-15T18:17:54.393982] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T18:17:54.857894] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-15T18:17:55.296515] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:17:55.657875] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-15T18:17:56.359482] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:17:56.365451] [INFO ] [REMOTE ] ENB: Full fetch complete (58209 records). [2025-09-15T18:17:56.365598] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-15T18:17:56.464506] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-15T18:17:56.767186] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-15T18:17:56.767764] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-15T18:17:56.768659] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-15T18:17:56.767696] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:17:56.768791] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-15T18:17:56.773289] [INFO ] [REMOTE ] ENIC: Full fetch complete (39432 records). [2025-09-15T18:17:56.773455] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-15T18:17:56.806112] [DEBUG] [LOCAL ] ENB: Trimmed 58209 records to 39511 (keeping 150 days of data) [2025-09-15T18:17:57.016470] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:17:57.279447] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-15T18:17:57.385870] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-15T18:17:57.386558] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-15T18:17:57.387630] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-15T18:17:57.388037] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-15T18:17:57.391385] [DEBUG] [LOCAL ] ENIC: Trimmed 39432 records to 27637 (keeping 150 days of data) [2025-09-15T18:17:57.572119] [DEBUG] [LOCAL ] ENIC: Primary data saved (27637 records). [2025-09-15T18:17:57.572869] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-15T18:17:57.573263] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 32.2s. Estimated remaining: 2h 52m 31s. Rate: 9.5 symbols/min [2025-09-15T18:17:57.755190] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:57.765116] [DEBUG] [LOCAL ] ENB: Primary data saved (39511 records). [2025-09-15T18:17:57.765314] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-15T18:17:57.766409] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 35.1s. Estimated remaining: 2h 52m 11s. Rate: 9.5 symbols/min [2025-09-15T18:17:57.943699] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:17:57.970517] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:57.972223] [DEBUG] [LOCAL ] ENR: Loaded 33339 existing records from primary storage. [2025-09-15T18:17:57.974141] [INFO ] [MAIN ] ENR: Loaded 33339 existing records. [2025-09-15T18:17:57.974314] [INFO ] [REMOTE ] ENO: Full fetch complete (2231 records). [2025-09-15T18:17:58.029395] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-15T18:17:58.061021] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-15T18:17:58.304834] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:58.309310] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-15T18:17:58.318886] [DEBUG] [LOCAL ] ENS: Loaded 21770 existing records from primary storage. [2025-09-15T18:17:58.329622] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-15T18:17:58.329524] [INFO ] [MAIN ] ENS: Loaded 21770 existing records. [2025-09-15T18:17:58.377215] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-15T18:17:58.409983] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-15T18:17:58.966286] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:59.042479] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-15T18:17:59.042750] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-15T18:17:59.050036] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-15T18:17:59.049975] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-15T18:17:59.067112] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-15T18:17:59.067175] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-15T18:17:59.067327] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-15T18:17:59.080285] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-15T18:17:59.173727] [DEBUG] [LOCAL ] ENO: Trimmed 2231 records to 1228 (keeping 150 days of data) [2025-09-15T18:17:59.278101] [INFO ] [REMOTE ] ENR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:59.296270] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-15T18:17:59.353052] [DEBUG] [LOCAL ] ENO: Primary data saved (1228 records). [2025-09-15T18:17:59.444888] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-15T18:17:59.468557] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 18.4s. Estimated remaining: 2h 51m 54s. Rate: 9.5 symbols/min [2025-09-15T18:17:59.688533] [INFO ] [REMOTE ] ENS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:59.694419] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-15T18:17:59.774696] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:59.803283] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:17:59.828513] [DEBUG] [LOCAL ] ENVA: Loaded 18954 existing records from primary storage. [2025-09-15T18:17:59.828715] [INFO ] [MAIN ] ENVA: Loaded 18954 existing records. [2025-09-15T18:18:00.033249] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:00.033530] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-15T18:18:00.033600] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-15T18:18:00.034122] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-15T18:18:00.034185] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-15T18:18:00.386737] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:00.457837] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-15T18:18:00.549143] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:18:01.257927] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-15T18:18:01.371955] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:18:01.597779] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:18:02.057876] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-15T18:18:02.857902] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-15T18:18:03.138533] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:18:03.657877] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-15T18:18:04.457891] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-15T18:18:04.625932] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T18:18:05.257881] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-15T18:18:05.554836] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:18:06.057840] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-15T18:18:06.136295] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-15T18:18:06.421467] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-15T18:18:06.523489] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:18:06.857882] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-15T18:18:07.657885] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-15T18:18:07.957414] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:18:08.074856] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:18:08.457909] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-15T18:18:09.061849] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:18:09.257864] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-15T18:18:10.057915] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-15T18:18:10.127221] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:18:10.191822] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T18:18:10.857870] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-15T18:18:11.460779] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:18:11.657872] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-15T18:18:12.245949] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:18:12.457868] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-15T18:18:13.223089] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:18:13.227919] [INFO ] [REMOTE ] ENOV: Full fetch complete (48321 records). [2025-09-15T18:18:13.228020] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-15T18:18:13.228666] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:18:13.228743] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:18:13.228813] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:18:13.228861] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-15T18:18:13.228917] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-15T18:18:13.228952] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-09-15T18:18:13.229226] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-09-15T18:18:13.229324] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 24.9s. Estimated remaining: 2h 52m 4s. Rate: 9.5 symbols/min [2025-09-15T18:18:13.262955] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-15T18:18:13.408783] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:13.422431] [DEBUG] [LOCAL ] EOD: Loaded 11000 existing records from primary storage. [2025-09-15T18:18:13.422559] [INFO ] [MAIN ] EOD: Loaded 11000 existing records. [2025-09-15T18:18:13.600250] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:13.600483] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-15T18:18:13.600527] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-15T18:18:13.600955] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-15T18:18:13.601029] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-15T18:18:13.959445] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:14.057900] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-15T18:18:14.086762] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:18:14.747893] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:18:14.857887] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-15T18:18:15.244091] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:18:15.657921] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-15T18:18:15.872793] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T18:18:16.457893] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-15T18:18:17.177745] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:18:17.257873] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-15T18:18:17.933447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:18:18.057874] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-15T18:18:18.859837] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-15T18:18:18.865366] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:18:19.111751] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:18:19.115023] [INFO ] [REMOTE ] ENVA: Full fetch complete (27971 records). [2025-09-15T18:18:19.115119] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-15T18:18:19.474340] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-15T18:18:19.474433] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-15T18:18:19.474968] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-15T18:18:19.475012] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-15T18:18:19.475758] [DEBUG] [LOCAL ] ENVA: Trimmed 27971 records to 18662 (keeping 150 days of data) [2025-09-15T18:18:19.593806] [DEBUG] [LOCAL ] ENVA: Primary data saved (18662 records). [2025-09-15T18:18:19.593962] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-15T18:18:19.594071] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENVA took 20.1s. Estimated remaining: 2h 51m 58s. Rate: 9.5 symbols/min [2025-09-15T18:18:19.662914] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-15T18:18:19.766726] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:19.808214] [DEBUG] [LOCAL ] EOG: Loaded 40135 existing records from primary storage. [2025-09-15T18:18:19.808355] [INFO ] [MAIN ] EOG: Loaded 40135 existing records. [2025-09-15T18:18:19.982409] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:19.982676] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-15T18:18:19.982724] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-15T18:18:19.983629] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-15T18:18:19.983718] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-15T18:18:20.347368] [INFO ] [REMOTE ] EOG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:20.356116] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:18:20.375723] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:18:20.457813] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-15T18:18:21.257902] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-15T18:18:21.536734] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:18:21.540232] [INFO ] [REMOTE ] ENS: Full fetch complete (31995 records). [2025-09-15T18:18:21.540305] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-15T18:18:21.928143] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-15T18:18:21.928224] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-15T18:18:21.928781] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-15T18:18:21.928832] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-15T18:18:21.929698] [DEBUG] [LOCAL ] ENS: Trimmed 31995 records to 21455 (keeping 150 days of data) [2025-09-15T18:18:22.063187] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-15T18:18:22.066703] [DEBUG] [LOCAL ] ENS: Primary data saved (21455 records). [2025-09-15T18:18:22.067740] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-15T18:18:22.067863] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 24.3s. Estimated remaining: 2h 51m 43s. Rate: 9.5 symbols/min [2025-09-15T18:18:22.243725] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:22.252564] [DEBUG] [LOCAL ] EOI: Loaded 7034 existing records from primary storage. [2025-09-15T18:18:22.252721] [INFO ] [MAIN ] EOI: Loaded 7034 existing records. [2025-09-15T18:18:22.453377] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:22.454064] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-15T18:18:22.454291] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-15T18:18:22.454860] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-15T18:18:22.454946] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-15T18:18:22.661764] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:18:22.869179] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-15T18:18:22.873460] [INFO ] [REMOTE ] EOI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:23.658047] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-15T18:18:23.832850] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:18:23.837544] [INFO ] [REMOTE ] ENR: Full fetch complete (45615 records). [2025-09-15T18:18:23.837673] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-15T18:18:24.245791] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T18:18:24.269596] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-15T18:18:24.270069] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-15T18:18:24.270758] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-15T18:18:24.270806] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-15T18:18:24.271704] [DEBUG] [LOCAL ] ENR: Trimmed 45615 records to 32871 (keeping 150 days of data) [2025-09-15T18:18:24.458612] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-15T18:18:24.473782] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:18:24.496085] [DEBUG] [LOCAL ] ENR: Primary data saved (32871 records). [2025-09-15T18:18:24.496190] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-15T18:18:24.496274] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENR took 26.9s. Estimated remaining: 2h 51m 28s. Rate: 9.5 symbols/min [2025-09-15T18:18:24.664079] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:24.674698] [DEBUG] [LOCAL ] EOS: Loaded 10469 existing records from primary storage. [2025-09-15T18:18:24.674790] [INFO ] [MAIN ] EOS: Loaded 10469 existing records. [2025-09-15T18:18:24.849327] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:24.849587] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-15T18:18:24.849632] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-15T18:18:24.849994] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-15T18:18:24.850039] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-15T18:18:25.203960] [INFO ] [REMOTE ] EOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:25.257872] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-15T18:18:25.469264] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:18:26.057874] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-15T18:18:26.403546] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:18:26.847167] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:18:26.857818] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-15T18:18:27.658093] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-15T18:18:27.902933] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:18:28.457875] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-15T18:18:28.958987] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:18:29.257913] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-15T18:18:29.296211] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:18:30.057888] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-15T18:18:30.272166] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:18:30.857910] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-15T18:18:31.657899] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-15T18:18:31.791715] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:18:31.889251] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:18:32.457868] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-15T18:18:32.472256] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:18:33.257865] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-15T18:18:34.057869] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-15T18:18:34.330494] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T18:18:34.411327] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:18:34.857874] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-15T18:18:35.123743] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:18:35.657899] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-15T18:18:35.672321] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:18:36.457929] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-15T18:18:37.006827] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:18:37.101210] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:18:37.257869] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-15T18:18:38.057880] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-15T18:18:38.094169] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:18:38.096000] [INFO ] [REMOTE ] EOD: Full fetch complete (15413 records). [2025-09-15T18:18:38.096073] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-15T18:18:38.457815] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-15T18:18:38.457950] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-15T18:18:38.458308] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-15T18:18:38.458349] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-15T18:18:38.458899] [DEBUG] [LOCAL ] EOD: Trimmed 15413 records to 10829 (keeping 150 days of data) [2025-09-15T18:18:38.524138] [DEBUG] [LOCAL ] EOD: Primary data saved (10829 records). [2025-09-15T18:18:38.524267] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-15T18:18:38.524410] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 25.3s. Estimated remaining: 2h 51m 39s. Rate: 9.5 symbols/min [2025-09-15T18:18:38.694724] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:38.701216] [DEBUG] [LOCAL ] EOT: Loaded 5036 existing records from primary storage. [2025-09-15T18:18:38.701315] [INFO ] [MAIN ] EOT: Loaded 5036 existing records. [2025-09-15T18:18:38.866223] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-15T18:18:38.886723] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:38.888141] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-15T18:18:38.894804] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-15T18:18:38.895631] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:18:38.898769] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-15T18:18:38.898867] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-15T18:18:39.254920] [INFO ] [REMOTE ] EOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:39.657873] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-15T18:18:40.457847] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-15T18:18:40.841033] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T18:18:40.865758] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:18:40.952389] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T18:18:40.953963] [INFO ] [REMOTE ] EOI: Full fetch complete (11582 records). [2025-09-15T18:18:40.954058] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-15T18:18:41.262953] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-15T18:18:41.332901] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-15T18:18:41.333000] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-15T18:18:41.333338] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-15T18:18:41.333390] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-15T18:18:41.334023] [DEBUG] [LOCAL ] EOI: Trimmed 11582 records to 6869 (keeping 150 days of data) [2025-09-15T18:18:41.380713] [DEBUG] [LOCAL ] EOI: Primary data saved (6869 records). [2025-09-15T18:18:41.380874] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-15T18:18:41.380977] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOI took 19.3s. Estimated remaining: 2h 51m 25s. Rate: 9.5 symbols/min [2025-09-15T18:18:41.554918] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:41.577683] [DEBUG] [LOCAL ] EPAC: Loaded 19349 existing records from primary storage. [2025-09-15T18:18:41.577880] [INFO ] [MAIN ] EPAC: Loaded 19349 existing records. [2025-09-15T18:18:41.760468] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:41.760722] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-15T18:18:41.760768] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-15T18:18:41.761374] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-15T18:18:41.761423] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-15T18:18:42.063064] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-15T18:18:42.119886] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:42.862945] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-15T18:18:42.879221] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:18:42.956959] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:18:43.657872] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-15T18:18:43.691771] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T18:18:44.457905] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-15T18:18:45.201860] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:18:45.207938] [INFO ] [REMOTE ] EOG: Full fetch complete (58010 records). [2025-09-15T18:18:45.208050] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-15T18:18:45.265665] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-15T18:18:45.599569] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-15T18:18:45.599735] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-15T18:18:45.600551] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-15T18:18:45.600657] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-15T18:18:45.616219] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:18:45.621211] [DEBUG] [LOCAL ] EOG: Trimmed 58010 records to 39357 (keeping 150 days of data) [2025-09-15T18:18:45.884260] [DEBUG] [LOCAL ] EOG: Primary data saved (39357 records). [2025-09-15T18:18:45.884522] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-15T18:18:45.885941] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOG took 26.3s. Estimated remaining: 2h 51m 14s. Rate: 9.5 symbols/min [2025-09-15T18:18:46.057854] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-15T18:18:46.058969] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:46.097322] [DEBUG] [LOCAL ] EPAM: Loaded 29270 existing records from primary storage. [2025-09-15T18:18:46.097478] [INFO ] [MAIN ] EPAM: Loaded 29270 existing records. [2025-09-15T18:18:46.276686] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:46.276959] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-15T18:18:46.277006] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-15T18:18:46.277746] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-15T18:18:46.277797] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-15T18:18:46.461350] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:18:46.652826] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:46.659140] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:18:46.857922] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-15T18:18:47.657897] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-15T18:18:48.020213] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:18:48.235662] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:18:48.457890] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-15T18:18:49.257937] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-15T18:18:49.691451] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:18:50.057907] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-15T18:18:50.760075] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:18:50.774398] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:18:50.857869] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-15T18:18:51.509557] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:18:51.657882] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-15T18:18:52.040628] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:18:52.457912] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-15T18:18:53.257893] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-15T18:18:53.507392] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:18:53.892054] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T18:18:54.057870] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-15T18:18:54.846434] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:18:54.849019] [INFO ] [REMOTE ] EOS: Full fetch complete (16999 records). [2025-09-15T18:18:54.849121] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-15T18:18:54.862963] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-15T18:18:55.213565] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-15T18:18:55.213671] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-15T18:18:55.214058] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-15T18:18:55.214098] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-15T18:18:55.214726] [DEBUG] [LOCAL ] EOS: Trimmed 16999 records to 10119 (keeping 150 days of data) [2025-09-15T18:18:55.281753] [DEBUG] [LOCAL ] EOS: Primary data saved (10119 records). [2025-09-15T18:18:55.281913] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-15T18:18:55.282020] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOS took 30.8s. Estimated remaining: 2h 51m 15s. Rate: 9.5 symbols/min [2025-09-15T18:18:55.457374] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:55.492320] [DEBUG] [LOCAL ] EPC: Loaded 30114 existing records from primary storage. [2025-09-15T18:18:55.492474] [INFO ] [MAIN ] EPC: Loaded 30114 existing records. [2025-09-15T18:18:55.667068] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-15T18:18:55.672286] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:55.673319] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-15T18:18:55.673403] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-15T18:18:55.674563] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-15T18:18:55.674624] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-15T18:18:56.103777] [INFO ] [REMOTE ] EPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:56.195362] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:18:56.457844] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-15T18:18:56.604428] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:18:57.257928] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-15T18:18:57.892989] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:18:57.937712] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:18:58.057949] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-15T18:18:58.857888] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-15T18:18:59.546140] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:18:59.657889] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-15T18:18:59.924952] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:19:00.457897] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-15T18:19:01.030621] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:19:01.032120] [INFO ] [REMOTE ] EOT: Full fetch complete (7490 records). [2025-09-15T18:19:01.032193] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-15T18:19:01.264100] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-15T18:19:01.423557] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-15T18:19:01.423760] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-15T18:19:01.424098] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-15T18:19:01.424175] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-15T18:19:01.425517] [DEBUG] [LOCAL ] EOT: Trimmed 7490 records to 4995 (keeping 150 days of data) [2025-09-15T18:19:01.485688] [DEBUG] [LOCAL ] EOT: Primary data saved (4995 records). [2025-09-15T18:19:01.486441] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-15T18:19:01.487765] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T18:19:01.487943] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOT took 23.0s. Estimated remaining: 2h 51m 8s. Rate: 9.5 symbols/min [2025-09-15T18:19:01.670005] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:01.714138] [DEBUG] [LOCAL ] EPD: Loaded 40362 existing records from primary storage. [2025-09-15T18:19:01.714329] [INFO ] [MAIN ] EPD: Loaded 40362 existing records. [2025-09-15T18:19:01.891607] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:01.891898] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-15T18:19:01.891947] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-15T18:19:01.892814] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-15T18:19:01.892867] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-15T18:19:02.068364] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-15T18:19:02.252359] [INFO ] [REMOTE ] EPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:02.267782] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:19:02.857931] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-15T18:19:03.622521] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:19:03.657827] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-15T18:19:04.219692] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:19:04.457892] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-15T18:19:05.038375] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:19:05.257880] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-15T18:19:06.057893] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-15T18:19:06.427221] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T18:19:06.445307] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:19:06.448411] [INFO ] [REMOTE ] EPAC: Full fetch complete (29043 records). [2025-09-15T18:19:06.448624] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-15T18:19:06.809995] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-15T18:19:06.810103] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-15T18:19:06.810673] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-15T18:19:06.810730] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-15T18:19:06.811464] [DEBUG] [LOCAL ] EPAC: Trimmed 29043 records to 18981 (keeping 150 days of data) [2025-09-15T18:19:06.863530] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-15T18:19:06.929203] [DEBUG] [LOCAL ] EPAC: Primary data saved (18981 records). [2025-09-15T18:19:06.929362] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-15T18:19:06.929488] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 25.5s. Estimated remaining: 2h 50m 60s. Rate: 9.5 symbols/min [2025-09-15T18:19:07.097608] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:07.136532] [DEBUG] [LOCAL ] EPR: Loaded 33117 existing records from primary storage. [2025-09-15T18:19:07.136761] [INFO ] [MAIN ] EPR: Loaded 33117 existing records. [2025-09-15T18:19:07.313487] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:07.313740] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-15T18:19:07.313790] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-15T18:19:07.315096] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-15T18:19:07.315152] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-15T18:19:07.663529] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-15T18:19:07.668965] [INFO ] [REMOTE ] EPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:07.755412] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:19:08.313236] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:19:08.457853] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-15T18:19:09.257921] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-15T18:19:09.554210] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T18:19:09.905031] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:19:10.057892] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-15T18:19:10.600032] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:19:10.857896] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-15T18:19:11.468565] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:19:11.657892] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-15T18:19:12.106604] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:19:12.457876] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-15T18:19:13.257920] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-15T18:19:13.596829] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:19:13.883019] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:19:13.887847] [INFO ] [REMOTE ] EPAM: Full fetch complete (43212 records). [2025-09-15T18:19:13.887961] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-15T18:19:14.062865] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-15T18:19:14.267515] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-15T18:19:14.267594] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-15T18:19:14.268231] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-15T18:19:14.268275] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-15T18:19:14.270014] [DEBUG] [LOCAL ] EPAM: Trimmed 43212 records to 28631 (keeping 150 days of data) [2025-09-15T18:19:14.449423] [DEBUG] [LOCAL ] EPAM: Primary data saved (28631 records). [2025-09-15T18:19:14.449569] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-15T18:19:14.449678] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAM took 28.6s. Estimated remaining: 2h 50m 56s. Rate: 9.5 symbols/min [2025-09-15T18:19:14.618482] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:14.653462] [DEBUG] [LOCAL ] EPRT: Loaded 36216 existing records from primary storage. [2025-09-15T18:19:14.653622] [INFO ] [MAIN ] EPRT: Loaded 36216 existing records. [2025-09-15T18:19:14.831045] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:14.831398] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-15T18:19:14.831470] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-15T18:19:14.832362] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-15T18:19:14.832416] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-15T18:19:14.865496] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-15T18:19:14.988659] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:19:15.226251] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:15.657875] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-15T18:19:15.762569] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:19:16.457878] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-15T18:19:16.629127] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:19:17.046128] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:19:17.257955] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-15T18:19:17.690420] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:19:18.057886] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-15T18:19:18.814380] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:19:18.857823] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-15T18:19:19.290568] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:19:19.657889] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-15T18:19:20.457922] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-15T18:19:20.712693] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:19:21.256611] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:19:21.265065] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-15T18:19:21.671607] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:19:22.057883] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-15T18:19:22.279145] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:19:22.857879] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-15T18:19:23.657848] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-15T18:19:23.732525] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:19:23.847357] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:19:23.851945] [INFO ] [REMOTE ] EPC: Full fetch complete (43741 records). [2025-09-15T18:19:23.852036] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-15T18:19:24.228279] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-15T18:19:24.228370] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-15T18:19:24.229022] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-15T18:19:24.229072] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-15T18:19:24.230217] [DEBUG] [LOCAL ] EPC: Trimmed 43741 records to 29617 (keeping 150 days of data) [2025-09-15T18:19:24.433380] [DEBUG] [LOCAL ] EPC: Primary data saved (29617 records). [2025-09-15T18:19:24.433517] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-15T18:19:24.433602] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPC took 29.2s. Estimated remaining: 2h 50m 58s. Rate: 9.5 symbols/min [2025-09-15T18:19:24.465498] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-15T18:19:24.615691] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:24.625732] [DEBUG] [LOCAL ] EQBK: Loaded 8151 existing records from primary storage. [2025-09-15T18:19:24.625835] [INFO ] [MAIN ] EQBK: Loaded 8151 existing records. [2025-09-15T18:19:24.804154] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:24.804490] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-15T18:19:24.804541] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-15T18:19:24.804871] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-15T18:19:24.804922] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-15T18:19:25.154995] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:25.232021] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:19:25.257823] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-15T18:19:26.001155] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T18:19:26.057825] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-15T18:19:26.822680] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:19:26.857820] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-15T18:19:27.657927] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-15T18:19:28.079839] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T18:19:28.251198] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T18:19:28.465462] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-15T18:19:28.466772] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:19:28.472608] [INFO ] [REMOTE ] EPR: Full fetch complete (47889 records). [2025-09-15T18:19:28.472743] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-15T18:19:28.473458] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:19:28.473542] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:19:28.473581] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:19:28.473620] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-15T18:19:28.473726] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-15T18:19:28.473768] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-09-15T18:19:28.474043] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-09-15T18:19:28.474128] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPR took 21.5s. Estimated remaining: 2h 50m 46s. Rate: 9.5 symbols/min [2025-09-15T18:19:28.651000] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:28.693501] [DEBUG] [LOCAL ] EQH: Loaded 39546 existing records from primary storage. [2025-09-15T18:19:28.693709] [INFO ] [MAIN ] EQH: Loaded 39546 existing records. [2025-09-15T18:19:28.873156] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:28.873402] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-15T18:19:28.873450] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-15T18:19:28.874405] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-15T18:19:28.874469] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-15T18:19:29.235061] [INFO ] [REMOTE ] EQH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:29.257850] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-15T18:19:29.803283] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:19:30.057856] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-15T18:19:30.853417] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:19:30.863119] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-15T18:19:31.657871] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-15T18:19:31.683688] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:19:31.930404] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T18:19:31.936714] [INFO ] [REMOTE ] EPD: Full fetch complete (58292 records). [2025-09-15T18:19:31.936834] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-15T18:19:32.317915] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-15T18:19:32.317995] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-15T18:19:32.318743] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-15T18:19:32.318789] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-15T18:19:32.320076] [DEBUG] [LOCAL ] EPD: Trimmed 58292 records to 39582 (keeping 150 days of data) [2025-09-15T18:19:32.505130] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-15T18:19:32.577154] [DEBUG] [LOCAL ] EPD: Primary data saved (39582 records). [2025-09-15T18:19:32.577313] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-15T18:19:32.577401] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 31.1s. Estimated remaining: 2h 50m 35s. Rate: 9.5 symbols/min [2025-09-15T18:19:32.749469] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:32.788249] [DEBUG] [LOCAL ] EQNR: Loaded 39924 existing records from primary storage. [2025-09-15T18:19:32.788437] [INFO ] [MAIN ] EQNR: Loaded 39924 existing records. [2025-09-15T18:19:32.970746] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:32.971133] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-15T18:19:32.985911] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-15T18:19:32.999142] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:19:32.999195] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-15T18:19:32.999319] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-15T18:19:33.262928] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-15T18:19:33.377319] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:34.057880] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-15T18:19:34.223780] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:19:34.555733] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:19:34.857847] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-15T18:19:34.884620] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:19:35.657863] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-15T18:19:36.457888] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-15T18:19:36.690552] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:19:37.163623] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T18:19:37.169106] [INFO ] [REMOTE ] EPRT: Full fetch complete (52828 records). [2025-09-15T18:19:37.169200] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-15T18:19:37.262939] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-15T18:19:37.564723] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-15T18:19:37.565123] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-15T18:19:37.566437] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-15T18:19:37.566498] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-15T18:19:37.568087] [DEBUG] [LOCAL ] EPRT: Trimmed 52828 records to 35533 (keeping 150 days of data) [2025-09-15T18:19:37.791421] [DEBUG] [LOCAL ] EPRT: Primary data saved (35533 records). [2025-09-15T18:19:37.791706] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-15T18:19:37.793884] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EPRT took 23.3s. Estimated remaining: 2h 50m 26s. Rate: 9.5 symbols/min [2025-09-15T18:19:37.968446] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:38.008885] [DEBUG] [LOCAL ] EQR: Loaded 38710 existing records from primary storage. [2025-09-15T18:19:38.009040] [INFO ] [MAIN ] EQR: Loaded 38710 existing records. [2025-09-15T18:19:38.073052] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-15T18:19:38.182692] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:19:38.206583] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:38.206873] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-15T18:19:38.206927] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-15T18:19:38.207775] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-15T18:19:38.207826] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-15T18:19:38.580003] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:38.610371] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-15T18:19:38.857930] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-15T18:19:39.657904] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-15T18:19:39.791198] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:19:40.156708] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:19:40.457912] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-15T18:19:41.257895] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-15T18:19:41.384073] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:19:41.506747] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T18:19:42.057892] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-15T18:19:42.561034] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:19:42.609268] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:19:42.857886] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-15T18:19:43.657933] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-15T18:19:43.668065] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:19:44.457936] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-15T18:19:45.270345] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-15T18:19:45.295320] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T18:19:46.057888] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-15T18:19:46.229725] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:19:46.857892] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-15T18:19:46.911430] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:19:47.657908] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-15T18:19:47.701632] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:19:48.427088] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:19:48.457826] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-15T18:19:49.263065] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-15T18:19:49.279476] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:19:49.612940] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:19:49.898451] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:19:49.900305] [INFO ] [REMOTE ] EQBK: Full fetch complete (11444 records). [2025-09-15T18:19:49.900374] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-15T18:19:50.062955] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-15T18:19:50.294605] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-15T18:19:50.294828] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-15T18:19:50.295438] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-15T18:19:50.295502] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-15T18:19:50.296941] [DEBUG] [LOCAL ] EQBK: Trimmed 11444 records to 7957 (keeping 150 days of data) [2025-09-15T18:19:50.358953] [DEBUG] [LOCAL ] EQBK: Primary data saved (7957 records). [2025-09-15T18:19:50.359196] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-15T18:19:50.359366] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EQBK took 25.9s. Estimated remaining: 2h 50m 33s. Rate: 9.5 symbols/min [2025-09-15T18:19:50.560096] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:50.560397] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-15T18:19:50.560437] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-15T18:19:50.560599] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-15T18:19:50.560660] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-15T18:19:50.560709] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-15T18:19:50.560746] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-15T18:19:50.863269] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-15T18:19:51.093355] [INFO ] [REMOTE ] EQS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:51.657921] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-15T18:19:51.897975] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T18:19:52.464463] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-15T18:19:52.484497] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:19:52.930438] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:19:53.257883] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-15T18:19:53.683285] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:19:54.057882] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-15T18:19:54.167842] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:19:54.857911] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-15T18:19:55.590278] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:19:55.596473] [INFO ] [REMOTE ] EQH: Full fetch complete (57285 records). [2025-09-15T18:19:55.596635] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-15T18:19:55.663058] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-15T18:19:56.018810] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-15T18:19:56.019082] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-15T18:19:56.019827] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-15T18:19:56.019871] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-15T18:19:56.021110] [DEBUG] [LOCAL ] EQH: Trimmed 57285 records to 38767 (keeping 150 days of data) [2025-09-15T18:19:56.090975] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:19:56.284384] [DEBUG] [LOCAL ] EQH: Primary data saved (38767 records). [2025-09-15T18:19:56.284557] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-15T18:19:56.285207] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQH took 27.8s. Estimated remaining: 2h 50m 26s. Rate: 9.5 symbols/min [2025-09-15T18:19:56.459318] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-15T18:19:56.459194] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:56.506196] [DEBUG] [LOCAL ] EQT: Loaded 40425 existing records from primary storage. [2025-09-15T18:19:56.506360] [INFO ] [MAIN ] EQT: Loaded 40425 existing records. [2025-09-15T18:19:56.703258] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:56.703630] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-15T18:19:56.703743] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-15T18:19:56.704875] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-15T18:19:56.704931] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-15T18:19:56.883579] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T18:19:57.055659] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:19:57.121690] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:57.257874] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-15T18:19:58.057887] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-15T18:19:58.857850] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-15T18:19:59.185930] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T18:19:59.262958] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-15T18:19:59.657938] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-15T18:20:00.295542] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T18:20:00.335522] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-15T18:20:00.457842] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-15T18:20:01.257904] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-15T18:20:02.057891] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-15T18:20:02.277190] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:20:02.283111] [INFO ] [REMOTE ] EQNR: Full fetch complete (57336 records). [2025-09-15T18:20:02.283330] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-15T18:20:02.284223] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:20:02.284376] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:20:02.284439] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:20:02.284491] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-15T18:20:02.284554] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-15T18:20:02.284606] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-09-15T18:20:02.284976] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-09-15T18:20:02.285070] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 29.7s. Estimated remaining: 2h 50m 19s. Rate: 9.5 symbols/min [2025-09-15T18:20:02.857941] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-15T18:20:03.232319] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-15T18:20:03.266060] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T18:20:03.403628] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:20:03.409983] [INFO ] [REMOTE ] EQR: Full fetch complete (55603 records). [2025-09-15T18:20:03.410119] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-15T18:20:03.663113] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-15T18:20:03.816517] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-15T18:20:03.816664] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-15T18:20:03.817866] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-15T18:20:03.817924] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-15T18:20:03.819774] [DEBUG] [LOCAL ] EQR: Trimmed 55603 records to 37964 (keeping 150 days of data) [2025-09-15T18:20:04.081626] [DEBUG] [LOCAL ] EQR: Primary data saved (37964 records). [2025-09-15T18:20:04.081912] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-15T18:20:04.082938] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQR took 26.3s. Estimated remaining: 2h 50m 3s. Rate: 9.5 symbols/min [2025-09-15T18:20:04.457971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-15T18:20:05.168234] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:20:05.257941] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-15T18:20:05.505762] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:20:05.781169] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:20:05.782315] [INFO ] [REMOTE ] EQS: Full fetch complete (1849 records). [2025-09-15T18:20:05.782383] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-15T18:20:05.957223] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T18:20:05.957458] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:20:05.957503] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:20:05.957554] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-15T18:20:05.957617] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-15T18:20:05.957695] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-15T18:20:05.957761] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-15T18:20:05.957831] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQS took 15.6s. Estimated remaining: 2h 49m 47s. Rate: 9.5 symbols/min [2025-09-15T18:20:06.057943] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-15T18:20:07.739421] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:20:07.750782] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-15T18:20:10.092115] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-15T18:20:10.108630] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-15T18:20:12.287482] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-15T18:20:12.299525] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-15T18:20:13.657080] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:20:13.668457] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-15T18:20:15.404100] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:20:15.410093] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-15T18:20:15.410228] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-15T18:20:15.790435] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-15T18:20:15.790552] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-15T18:20:15.791330] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-15T18:20:15.791379] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-15T18:20:15.792843] [DEBUG] [LOCAL ] EQT: Trimmed 58361 records to 39645 (keeping 150 days of data) [2025-09-15T18:20:16.037151] [DEBUG] [LOCAL ] EQT: Primary data saved (39645 records). [2025-09-15T18:20:16.037304] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-15T18:20:16.037865] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 19.8s. Estimated remaining: 2h 49m 49s. Rate: 9.5 symbols/min [2025-09-15T18:20:16.662619] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.613745] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.691707] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.741861] [DEBUG] [LOCAL ] EQV: Loaded 2163 existing records from primary storage. [2025-09-15T18:20:16.743040] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.743364] [INFO ] [MAIN ] EQV: Loaded 2163 existing records. [2025-09-15T18:20:16.898545] [DEBUG] [LOCAL ] ERO: Loaded 30409 existing records from primary storage. [2025-09-15T18:20:16.930839] [INFO ] [MAIN ] ERO: Loaded 30409 existing records. [2025-09-15T18:20:16.965103] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.014794] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.043303] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-15T18:20:17.043249] [DEBUG] [LOCAL ] ERJ: Loaded 38090 existing records from primary storage. [2025-09-15T18:20:17.058865] [INFO ] [MAIN ] ERJ: Loaded 38090 existing records. [2025-09-15T18:20:17.117505] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-15T18:20:17.189282] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-15T18:20:17.274020] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.359889] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.399346] [DEBUG] [LOCAL ] ES: Loaded 39539 existing records from primary storage. [2025-09-15T18:20:17.451465] [INFO ] [MAIN ] ES: Loaded 39539 existing records. [2025-09-15T18:20:17.456744] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.440564] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-15T18:20:17.486434] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.504610] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-15T18:20:17.525952] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-15T18:20:17.515696] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-15T18:20:17.570898] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-15T18:20:17.605984] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-15T18:20:18.070523] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:18.132968] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-15T18:20:18.179286] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-15T18:20:18.284188] [INFO ] [REMOTE ] EQV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.289383] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-15T18:20:18.294892] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-15T18:20:18.357400] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-15T18:20:18.609043] [INFO ] [REMOTE ] ERO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.614520] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-15T18:20:18.806088] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.867845] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-15T18:20:19.006079] [INFO ] [REMOTE ] ES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:19.006400] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-15T18:20:19.054728] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:20:19.056415] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-15T18:20:19.389202] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-15T18:20:19.390758] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-15T18:20:19.793773] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T18:20:19.795108] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-15T18:20:20.094769] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:20:20.103218] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-15T18:20:20.112305] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T18:20:20.113731] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-15T18:20:20.308365] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:20:20.318460] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-15T18:20:20.409080] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:20:20.419260] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-15T18:20:20.761027] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:20:20.762531] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-15T18:20:21.206962] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:20:21.208252] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-15T18:20:21.379986] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:20:21.389574] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-15T18:20:21.820609] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-15T18:20:21.823049] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-15T18:20:22.127494] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:20:22.138731] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-15T18:20:22.212040] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:20:22.212923] [INFO ] [REMOTE ] EQV: Full fetch complete (3381 records). [2025-09-15T18:20:22.212991] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-15T18:20:22.636731] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-15T18:20:22.637093] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-15T18:20:22.638946] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T18:20:22.639112] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-15T18:20:22.654054] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-15T18:20:22.655431] [DEBUG] [LOCAL ] EQV: Trimmed 3381 records to 2157 (keeping 150 days of data) [2025-09-15T18:20:22.669185] [DEBUG] [LOCAL ] EQV: Primary data saved (2157 records). [2025-09-15T18:20:22.669307] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-15T18:20:22.669406] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 6.6s. Estimated remaining: 2h 49m 43s. Rate: 9.5 symbols/min [2025-09-15T18:20:22.846409] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:22.863248] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-15T18:20:22.875505] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:20:22.898025] [DEBUG] [LOCAL ] ESAB: Loaded 18378 existing records from primary storage. [2025-09-15T18:20:22.898153] [INFO ] [MAIN ] ESAB: Loaded 18378 existing records. [2025-09-15T18:20:23.075465] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:23.075785] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-15T18:20:23.075842] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-15T18:20:23.076367] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-15T18:20:23.076424] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-15T18:20:23.456141] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:23.657926] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-15T18:20:24.003330] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T18:20:24.233487] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T18:20:24.457887] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-15T18:20:24.761102] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:20:25.257924] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-15T18:20:26.008304] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:20:26.057880] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-15T18:20:26.543699] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:20:26.857878] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-15T18:20:27.410073] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:20:27.657869] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-15T18:20:28.120459] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T18:20:28.457895] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-15T18:20:29.187313] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:20:29.257886] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-15T18:20:29.545593] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:20:30.057893] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-15T18:20:30.809771] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:20:30.857824] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-15T18:20:30.933564] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T18:20:31.657936] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-15T18:20:32.206431] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:20:32.457871] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-15T18:20:32.739572] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T18:20:33.257872] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-15T18:20:34.057926] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-15T18:20:34.470403] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:20:34.589075] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T18:20:34.594869] [INFO ] [REMOTE ] ERO: Full fetch complete (44901 records). [2025-09-15T18:20:34.594966] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-15T18:20:34.859304] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-15T18:20:34.978913] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-15T18:20:34.979155] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-15T18:20:34.993050] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-15T18:20:34.993244] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-15T18:20:34.994896] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T18:20:35.001232] [DEBUG] [LOCAL ] ERO: Trimmed 44901 records to 29843 (keeping 150 days of data) [2025-09-15T18:20:35.178214] [DEBUG] [LOCAL ] ERO: Primary data saved (29843 records). [2025-09-15T18:20:35.178353] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-15T18:20:35.178439] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 19.1s. Estimated remaining: 2h 49m 50s. Rate: 9.5 symbols/min [2025-09-15T18:20:35.344122] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:35.357070] [DEBUG] [LOCAL ] ESE: Loaded 12305 existing records from primary storage. [2025-09-15T18:20:35.357221] [INFO ] [MAIN ] ESE: Loaded 12305 existing records. [2025-09-15T18:20:35.532271] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:35.532559] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-15T18:20:35.532607] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-15T18:20:35.533080] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-15T18:20:35.533132] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-15T18:20:35.662982] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-15T18:20:35.890186] [INFO ] [REMOTE ] ESE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:36.462972] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-15T18:20:36.468492] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:20:36.866865] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:20:37.257917] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-15T18:20:37.738338] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:20:38.057867] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-15T18:20:38.603591] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:20:38.857882] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-15T18:20:39.263365] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T18:20:39.646671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:20:39.657814] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-15T18:20:40.457871] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-15T18:20:40.657040] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:20:41.257912] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-15T18:20:41.476723] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:20:41.479956] [INFO ] [REMOTE ] ESAB: Full fetch complete (27531 records). [2025-09-15T18:20:41.480092] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-15T18:20:41.869908] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-15T18:20:41.869988] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-15T18:20:41.870508] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-15T18:20:41.870557] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-15T18:20:41.871457] [DEBUG] [LOCAL ] ESAB: Trimmed 27531 records to 18188 (keeping 150 days of data) [2025-09-15T18:20:41.989130] [DEBUG] [LOCAL ] ESAB: Primary data saved (18188 records). [2025-09-15T18:20:41.989437] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-15T18:20:41.989580] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ESAB took 19.3s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-15T18:20:42.059144] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-15T18:20:42.181180] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:42.185886] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T18:20:42.228034] [DEBUG] [LOCAL ] ESI: Loaded 37839 existing records from primary storage. [2025-09-15T18:20:42.228181] [INFO ] [MAIN ] ESI: Loaded 37839 existing records. [2025-09-15T18:20:42.409121] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:42.409405] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-15T18:20:42.409453] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-15T18:20:42.410271] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-15T18:20:42.410364] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-15T18:20:42.764718] [INFO ] [REMOTE ] ESI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:42.857853] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-15T18:20:43.657878] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-15T18:20:43.852967] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T18:20:43.859691] [INFO ] [REMOTE ] ERJ: Full fetch complete (55401 records). [2025-09-15T18:20:43.859923] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-15T18:20:44.430948] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T18:20:44.460524] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-15T18:20:44.571020] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-15T18:20:44.571171] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-15T18:20:44.572755] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-15T18:20:44.572872] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-15T18:20:44.575280] [DEBUG] [LOCAL ] ERJ: Trimmed 55401 records to 37326 (keeping 150 days of data) [2025-09-15T18:20:44.880317] [DEBUG] [LOCAL ] ERJ: Primary data saved (37326 records). [2025-09-15T18:20:44.880518] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-15T18:20:44.880623] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ERJ took 28.8s. Estimated remaining: 2h 49m 31s. Rate: 9.5 symbols/min [2025-09-15T18:20:45.067913] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:45.103998] [DEBUG] [LOCAL ] ESNT: Loaded 28299 existing records from primary storage. [2025-09-15T18:20:45.104178] [INFO ] [MAIN ] ESNT: Loaded 28299 existing records. [2025-09-15T18:20:45.288299] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-15T18:20:45.332620] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:45.332902] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-15T18:20:45.332963] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-15T18:20:45.333847] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-15T18:20:45.334487] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-15T18:20:45.336788] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:20:45.723129] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:45.734945] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:20:46.057903] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-15T18:20:46.857884] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-15T18:20:46.894413] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:20:47.657940] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-15T18:20:47.759182] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:20:47.774518] [INFO ] [REMOTE ] ES: Full fetch complete (57162 records). [2025-09-15T18:20:47.774714] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-15T18:20:48.132417] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:20:48.172135] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-15T18:20:48.172224] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-15T18:20:48.173137] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-15T18:20:48.173186] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-15T18:20:48.174423] [DEBUG] [LOCAL ] ES: Trimmed 57162 records to 38782 (keeping 150 days of data) [2025-09-15T18:20:48.416892] [DEBUG] [LOCAL ] ES: Primary data saved (38782 records). [2025-09-15T18:20:48.417056] [INFO ] [MAIN ] ES: Full history saved. [2025-09-15T18:20:48.417171] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ES took 32.4s. Estimated remaining: 2h 49m 19s. Rate: 9.5 symbols/min [2025-09-15T18:20:48.463100] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-15T18:20:48.596869] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:48.631785] [DEBUG] [LOCAL ] ESRT: Loaded 34810 existing records from primary storage. [2025-09-15T18:20:48.631947] [INFO ] [MAIN ] ESRT: Loaded 34810 existing records. [2025-09-15T18:20:48.822485] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:48.822793] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-15T18:20:48.822842] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-15T18:20:48.823613] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-15T18:20:48.823688] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-15T18:20:49.182854] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:49.198721] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T18:20:49.244263] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:20:49.257816] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-15T18:20:50.057976] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-15T18:20:50.495249] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:20:50.814711] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:20:50.857916] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-15T18:20:51.657990] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-15T18:20:52.457953] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-15T18:20:52.508138] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:20:52.528990] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:20:52.533182] [INFO ] [REMOTE ] ESE: Full fetch complete (17826 records). [2025-09-15T18:20:52.533298] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-15T18:20:52.899198] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-15T18:20:52.899287] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-15T18:20:52.899718] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-15T18:20:52.899762] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-15T18:20:52.900294] [DEBUG] [LOCAL ] ESE: Trimmed 17826 records to 12123 (keeping 150 days of data) [2025-09-15T18:20:52.983160] [DEBUG] [LOCAL ] ESE: Primary data saved (12123 records). [2025-09-15T18:20:52.983336] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-15T18:20:52.983444] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 17.8s. Estimated remaining: 2h 49m 9s. Rate: 9.5 symbols/min [2025-09-15T18:20:53.151801] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:53.174407] [DEBUG] [LOCAL ] ESS: Loaded 22486 existing records from primary storage. [2025-09-15T18:20:53.174532] [INFO ] [MAIN ] ESS: Loaded 22486 existing records. [2025-09-15T18:20:53.263141] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-15T18:20:53.365517] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:53.365969] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-15T18:20:53.366050] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-15T18:20:53.366694] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-15T18:20:53.366751] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-15T18:20:53.734358] [INFO ] [REMOTE ] ESS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:53.792979] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:20:54.057884] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-15T18:20:54.742742] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:20:54.857859] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-15T18:20:55.582705] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:20:55.657915] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-15T18:20:56.463200] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-15T18:20:56.483349] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:20:56.753868] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T18:20:57.257917] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-15T18:20:58.057887] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-15T18:20:58.083939] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:20:58.625171] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:20:58.857863] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-15T18:20:59.515051] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:20:59.657879] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-15T18:21:00.106463] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T18:21:00.457881] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-15T18:21:01.257909] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-15T18:21:01.317692] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:21:01.323389] [INFO ] [REMOTE ] ESI: Full fetch complete (55163 records). [2025-09-15T18:21:01.323548] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-15T18:21:01.706699] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-15T18:21:01.706798] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-15T18:21:01.707612] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-15T18:21:01.707727] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-15T18:21:01.709108] [DEBUG] [LOCAL ] ESI: Trimmed 55163 records to 37061 (keeping 150 days of data) [2025-09-15T18:21:01.953907] [DEBUG] [LOCAL ] ESI: Primary data saved (37061 records). [2025-09-15T18:21:01.954091] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-15T18:21:01.954291] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESI took 20.0s. Estimated remaining: 2h 49m 8s. Rate: 9.5 symbols/min [2025-09-15T18:21:02.058864] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-15T18:21:02.131519] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:02.150817] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:21:02.190441] [DEBUG] [LOCAL ] ESTC: Loaded 37899 existing records from primary storage. [2025-09-15T18:21:02.190661] [INFO ] [MAIN ] ESTC: Loaded 37899 existing records. [2025-09-15T18:21:02.367413] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:02.367709] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-15T18:21:02.367757] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-15T18:21:02.368539] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-15T18:21:02.368586] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-15T18:21:02.717427] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:02.857853] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-15T18:21:03.342778] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T18:21:03.657870] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-15T18:21:04.457869] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-15T18:21:05.581167] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-15T18:21:05.591312] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-15T18:21:05.644209] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:21:05.805328] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-15T18:21:06.057872] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-15T18:21:06.857925] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-15T18:21:06.916036] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (4.06 seconds). [2025-09-15T18:21:07.109481] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:21:07.129536] [INFO ] [REMOTE ] ESNT: Full fetch complete (42537 records). [2025-09-15T18:21:07.139734] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-15T18:21:07.142335] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:21:07.142005] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:21:07.142575] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:21:07.155663] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:21:07.155763] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-15T18:21:07.155861] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-15T18:21:07.156237] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-09-15T18:21:07.156599] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-09-15T18:21:07.156742] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESNT took 22.3s. Estimated remaining: 2h 48m 59s. Rate: 9.5 symbols/min [2025-09-15T18:21:07.326782] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:07.374368] [DEBUG] [LOCAL ] ET: Loaded 40530 existing records from primary storage. [2025-09-15T18:21:07.374532] [INFO ] [MAIN ] ET: Loaded 40530 existing records. [2025-09-15T18:21:07.556193] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:07.556462] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-15T18:21:07.556509] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-15T18:21:07.557405] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-15T18:21:07.557461] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-15T18:21:07.661696] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-15T18:21:07.918835] [INFO ] [REMOTE ] ET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:07.965008] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:21:08.457902] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-15T18:21:09.257890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-15T18:21:10.007424] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-15T18:21:10.057864] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-15T18:21:10.407486] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:21:10.452179] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-15T18:21:10.857884] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-15T18:21:11.417964] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:21:11.657875] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-15T18:21:12.279614] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:21:12.457873] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-15T18:21:12.861012] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T18:21:13.257842] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-15T18:21:13.297504] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:21:14.057873] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-15T18:21:14.838499] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:21:14.857843] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-15T18:21:15.657930] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-15T18:21:16.457991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-15T18:21:17.204590] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-09-15T18:21:17.250979] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-15T18:21:17.261146] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-15T18:21:18.051358] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-15T18:21:18.054606] [INFO ] [REMOTE ] ESS: Full fetch complete (32699 records). [2025-09-15T18:21:18.054719] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-15T18:21:18.086486] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-15T18:21:18.425296] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-15T18:21:18.425378] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-15T18:21:18.426002] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-15T18:21:18.426047] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-15T18:21:18.426890] [DEBUG] [LOCAL ] ESS: Trimmed 32699 records to 21846 (keeping 150 days of data) [2025-09-15T18:21:18.570883] [DEBUG] [LOCAL ] ESS: Primary data saved (21846 records). [2025-09-15T18:21:18.571020] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-15T18:21:18.571123] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESS took 25.6s. Estimated remaining: 2h 49m 4s. Rate: 9.5 symbols/min [2025-09-15T18:21:18.752695] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:18.764087] [DEBUG] [LOCAL ] ETB: Loaded 8298 existing records from primary storage. [2025-09-15T18:21:18.764246] [INFO ] [MAIN ] ETB: Loaded 8298 existing records. [2025-09-15T18:21:18.946120] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:18.946839] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-15T18:21:18.946918] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-15T18:21:18.947283] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-15T18:21:18.947459] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-15T18:21:19.200087] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-15T18:21:19.307447] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-15T18:21:19.396164] [INFO ] [REMOTE ] ETB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:19.657938] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-15T18:21:19.868052] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-15T18:21:19.961696] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:21:20.457870] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-15T18:21:20.663957] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:21:20.705563] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T18:21:21.257884] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-15T18:21:21.809066] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T18:21:21.834746] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:21:22.057863] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-15T18:21:22.857935] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-15T18:21:23.000454] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:21:23.657923] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-15T18:21:24.457891] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-15T18:21:24.536629] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:21:25.257899] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-15T18:21:25.306790] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:21:25.857585] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T18:21:26.057870] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-15T18:21:26.857873] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-15T18:21:26.951427] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:21:27.178934] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-15T18:21:27.185372] [INFO ] [REMOTE ] ESTC: Full fetch complete (54528 records). [2025-09-15T18:21:27.185572] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-15T18:21:27.573949] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-15T18:21:27.574056] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-15T18:21:27.575099] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-15T18:21:27.575152] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-15T18:21:27.576698] [DEBUG] [LOCAL ] ESTC: Trimmed 54528 records to 37222 (keeping 150 days of data) [2025-09-15T18:21:27.664807] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-15T18:21:27.807163] [DEBUG] [LOCAL ] ESTC: Primary data saved (37222 records). [2025-09-15T18:21:27.807326] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-15T18:21:27.807418] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESTC took 25.9s. Estimated remaining: 2h 49m 3s. Rate: 9.5 symbols/min [2025-09-15T18:21:27.992277] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:28.011757] [DEBUG] [LOCAL ] ETD: Loaded 20670 existing records from primary storage. [2025-09-15T18:21:28.011877] [INFO ] [MAIN ] ETD: Loaded 20670 existing records. [2025-09-15T18:21:28.184780] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:28.185024] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-15T18:21:28.185070] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-15T18:21:28.185565] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-15T18:21:28.185611] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-15T18:21:28.461278] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-15T18:21:28.540881] [INFO ] [REMOTE ] ETD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:28.649773] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:21:29.257845] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-15T18:21:29.344410] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-15T18:21:30.057865] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-15T18:21:30.203880] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:21:30.486483] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-15T18:21:30.491412] [INFO ] [REMOTE ] ESRT: Full fetch complete (50103 records). [2025-09-15T18:21:30.491505] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-15T18:21:30.869917] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-15T18:21:30.872829] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-15T18:21:30.873891] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-15T18:21:30.874884] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-15T18:21:30.875052] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-15T18:21:30.876397] [DEBUG] [LOCAL ] ESRT: Trimmed 50103 records to 34095 (keeping 150 days of data) [2025-09-15T18:21:31.079873] [DEBUG] [LOCAL ] ESRT: Primary data saved (34095 records). [2025-09-15T18:21:31.080044] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-15T18:21:31.080152] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESRT took 42.7s. Estimated remaining: 2h 48m 51s. Rate: 9.5 symbols/min [2025-09-15T18:21:31.276019] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:31.297004] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:21:31.315416] [DEBUG] [LOCAL ] ETG: Loaded 12352 existing records from primary storage. [2025-09-15T18:21:31.315607] [INFO ] [MAIN ] ETG: Loaded 12352 existing records. [2025-09-15T18:21:31.502130] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:31.502402] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-15T18:21:31.502473] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-15T18:21:31.503026] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-15T18:21:31.503097] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-15T18:21:31.665059] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-15T18:21:31.894043] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:21:31.893901] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:31.895636] [INFO ] [REMOTE ] ETB: Full fetch complete (13809 records). [2025-09-15T18:21:31.895730] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-15T18:21:31.896100] [FATAL] [VALIDATOR ] ETB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:21:31.896175] [FATAL] [MAIN ] ETB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:21:31.896211] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:21:31.896254] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-15T18:21:31.896310] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-15T18:21:31.896386] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-09-15T18:21:31.896686] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-09-15T18:21:31.896773] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 13.3s. Estimated remaining: 2h 48m 33s. Rate: 9.5 symbols/min [2025-09-15T18:21:32.063139] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:32.074312] [DEBUG] [LOCAL ] ETJ: Loaded 11407 existing records from primary storage. [2025-09-15T18:21:32.074405] [INFO ] [MAIN ] ETJ: Loaded 11407 existing records. [2025-09-15T18:21:32.250625] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:32.250915] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-15T18:21:32.250962] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-15T18:21:32.251301] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-15T18:21:32.251348] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-15T18:21:32.465226] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-15T18:21:32.625895] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:32.878540] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:21:33.257913] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-15T18:21:34.057899] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-15T18:21:34.384595] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:21:34.471859] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:21:34.857892] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-15T18:21:35.185058] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:21:35.657881] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-15T18:21:36.457918] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-15T18:21:36.674603] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T18:21:36.902044] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:21:37.229479] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:21:37.258000] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-15T18:21:38.057937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-15T18:21:38.614436] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:21:38.857897] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-15T18:21:39.657965] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-15T18:21:39.768423] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T18:21:39.774856] [INFO ] [REMOTE ] ET: Full fetch complete (58470 records). [2025-09-15T18:21:39.774983] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-15T18:21:40.168282] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-15T18:21:40.168424] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-15T18:21:40.169223] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-15T18:21:40.169275] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-15T18:21:40.171357] [DEBUG] [LOCAL ] ET: Trimmed 58470 records to 39750 (keeping 150 days of data) [2025-09-15T18:21:40.434186] [DEBUG] [LOCAL ] ET: Primary data saved (39750 records). [2025-09-15T18:21:40.434554] [INFO ] [MAIN ] ET: Full history saved. [2025-09-15T18:21:40.436270] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 33.3s. Estimated remaining: 2h 48m 31s. Rate: 9.5 symbols/min [2025-09-15T18:21:40.473327] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-15T18:21:40.564198] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T18:21:40.646352] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:40.660774] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T18:21:40.702358] [DEBUG] [LOCAL ] ETN: Loaded 39663 existing records from primary storage. [2025-09-15T18:21:40.702530] [INFO ] [MAIN ] ETN: Loaded 39663 existing records. [2025-09-15T18:21:40.892885] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:40.893237] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-15T18:21:40.893294] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-15T18:21:40.894309] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-15T18:21:40.894362] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-15T18:21:41.245301] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:41.257873] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-15T18:21:41.386155] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T18:21:42.057880] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-15T18:21:42.857877] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-15T18:21:43.005804] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:21:43.397840] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-15T18:21:43.661026] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-15T18:21:43.661976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:21:44.457888] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-15T18:21:44.754999] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T18:21:45.257903] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-15T18:21:45.415479] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T18:21:46.057871] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-15T18:21:46.181723] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:21:46.857879] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-15T18:21:47.085312] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:21:47.619802] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T18:21:47.657922] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-15T18:21:48.457888] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-15T18:21:49.233008] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:21:49.257838] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-15T18:21:49.378700] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:21:50.057910] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-15T18:21:50.857891] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-15T18:21:50.880576] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:21:50.882621] [INFO ] [REMOTE ] ETG: Full fetch complete (18405 records). [2025-09-15T18:21:50.882714] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-15T18:21:51.259881] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-15T18:21:51.260137] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-15T18:21:51.260699] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-15T18:21:51.260790] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-15T18:21:51.261963] [DEBUG] [LOCAL ] ETG: Trimmed 18405 records to 12094 (keeping 150 days of data) [2025-09-15T18:21:51.366409] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T18:21:51.382676] [DEBUG] [LOCAL ] ETG: Primary data saved (12094 records). [2025-09-15T18:21:51.382796] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-15T18:21:51.382875] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETG took 20.3s. Estimated remaining: 2h 48m 34s. Rate: 9.5 symbols/min [2025-09-15T18:21:51.556970] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:51.568490] [DEBUG] [LOCAL ] ETO: Loaded 4919 existing records from primary storage. [2025-09-15T18:21:51.568627] [INFO ] [MAIN ] ETO: Loaded 4919 existing records. [2025-09-15T18:21:51.662980] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-15T18:21:51.791236] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:51.791539] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-15T18:21:51.791591] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-15T18:21:51.791952] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-15T18:21:51.792005] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-15T18:21:52.180300] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:21:52.183910] [INFO ] [REMOTE ] ETO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:52.457885] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-15T18:21:52.704813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T18:21:53.257876] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-15T18:21:53.798400] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T18:21:53.984531] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:21:54.057892] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-15T18:21:54.857928] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-15T18:21:55.420481] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:21:55.424002] [INFO ] [REMOTE ] ETD: Full fetch complete (29582 records). [2025-09-15T18:21:55.424106] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-15T18:21:55.669629] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-15T18:21:55.803470] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-15T18:21:55.803553] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-15T18:21:55.804100] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-15T18:21:55.804144] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-15T18:21:55.805008] [DEBUG] [LOCAL ] ETD: Trimmed 29582 records to 20372 (keeping 150 days of data) [2025-09-15T18:21:55.929499] [DEBUG] [LOCAL ] ETD: Primary data saved (20372 records). [2025-09-15T18:21:55.929631] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-15T18:21:55.929730] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETD took 28.1s. Estimated remaining: 2h 48m 24s. Rate: 9.5 symbols/min [2025-09-15T18:21:56.099816] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:56.136673] [DEBUG] [LOCAL ] ETR: Loaded 40047 existing records from primary storage. [2025-09-15T18:21:56.136814] [INFO ] [MAIN ] ETR: Loaded 40047 existing records. [2025-09-15T18:21:56.318178] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:56.318548] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-15T18:21:56.322667] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-15T18:21:56.323298] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T18:21:56.324802] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-15T18:21:56.325378] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-15T18:21:56.464743] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-15T18:21:56.688248] [INFO ] [REMOTE ] ETR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:56.720791] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T18:21:57.257867] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-15T18:21:57.326785] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:21:58.057928] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-15T18:21:58.770162] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:21:58.857876] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-15T18:21:58.990274] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:21:59.439293] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:21:59.657878] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-15T18:22:00.457869] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-15T18:22:00.737344] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T18:22:01.257916] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-15T18:22:02.057929] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-15T18:22:02.587452] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:22:02.659868] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:22:02.857898] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-15T18:22:03.656011] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-15T18:22:03.667090] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-15T18:22:04.457881] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-15T18:22:04.493635] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:22:04.572964] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:22:05.257905] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-15T18:22:06.057924] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-15T18:22:06.388667] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:22:06.652323] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:22:06.653499] [INFO ] [REMOTE ] ETO: Full fetch complete (7165 records). [2025-09-15T18:22:06.653572] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-15T18:22:06.864862] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-15T18:22:07.020046] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-15T18:22:07.020139] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-15T18:22:07.020351] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-15T18:22:07.020391] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-15T18:22:07.020815] [DEBUG] [LOCAL ] ETO: Trimmed 7165 records to 4841 (keeping 150 days of data) [2025-09-15T18:22:07.053523] [DEBUG] [LOCAL ] ETO: Primary data saved (4841 records). [2025-09-15T18:22:07.053676] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-15T18:22:07.053791] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETO took 15.7s. Estimated remaining: 2h 48m 28s. Rate: 9.5 symbols/min [2025-09-15T18:22:07.223698] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:07.240537] [DEBUG] [LOCAL ] ETV: Loaded 15357 existing records from primary storage. [2025-09-15T18:22:07.240694] [INFO ] [MAIN ] ETV: Loaded 15357 existing records. [2025-09-15T18:22:07.416095] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:07.416460] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-15T18:22:07.416572] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-15T18:22:07.417096] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-15T18:22:07.417153] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-15T18:22:07.501365] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-15T18:22:07.553206] [INFO ] [REMOTE ] ETN: Full fetch complete (57558 records). [2025-09-15T18:22:07.568678] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-15T18:22:07.659524] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-15T18:22:07.842472] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:22:07.861022] [INFO ] [REMOTE ] ETJ: Full fetch complete (18512 records). [2025-09-15T18:22:07.888108] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-15T18:22:08.019323] [INFO ] [REMOTE ] ETV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:08.461313] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-15T18:22:08.486723] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-15T18:22:08.492579] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-15T18:22:08.493455] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-15T18:22:08.498615] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-15T18:22:08.568887] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-15T18:22:08.569014] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-15T18:22:08.569311] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-15T18:22:08.569085] [DEBUG] [LOCAL ] ETN: Trimmed 57558 records to 38883 (keeping 150 days of data) [2025-09-15T18:22:08.569377] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-15T18:22:08.570491] [DEBUG] [LOCAL ] ETJ: Trimmed 18512 records to 10939 (keeping 150 days of data) [2025-09-15T18:22:08.745845] [DEBUG] [LOCAL ] ETJ: Primary data saved (10939 records). [2025-09-15T18:22:08.753535] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-15T18:22:08.753889] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETJ took 36.9s. Estimated remaining: 2h 48m 12s. Rate: 9.5 symbols/min [2025-09-15T18:22:09.004828] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:09.057253] [DEBUG] [LOCAL ] ETW: Loaded 18395 existing records from primary storage. [2025-09-15T18:22:09.058174] [INFO ] [MAIN ] ETW: Loaded 18395 existing records. [2025-09-15T18:22:09.243942] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:09.245672] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-15T18:22:09.245953] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-15T18:22:09.247510] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-15T18:22:09.247573] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-15T18:22:09.410704] [DEBUG] [LOCAL ] ETN: Primary data saved (38883 records). [2025-09-15T18:22:09.463944] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-15T18:22:09.501153] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 29.1s. Estimated remaining: 2h 47m 54s. Rate: 9.5 symbols/min [2025-09-15T18:22:09.719659] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:09.725747] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-15T18:22:09.802536] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:09.805693] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:22:09.832586] [DEBUG] [LOCAL ] ETX: Loaded 4115 existing records from primary storage. [2025-09-15T18:22:09.842331] [INFO ] [MAIN ] ETX: Loaded 4115 existing records. [2025-09-15T18:22:09.937652] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:22:10.032944] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:10.033224] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-15T18:22:10.033272] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-15T18:22:10.033564] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-15T18:22:10.033610] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-15T18:22:10.063697] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-15T18:22:10.382694] [INFO ] [REMOTE ] ETX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:10.577286] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:22:10.857931] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-15T18:22:11.034066] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:22:11.657876] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-15T18:22:12.176759] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:22:12.457917] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-15T18:22:12.877593] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:22:13.257862] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-15T18:22:13.839084] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:22:14.057843] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-15T18:22:14.332867] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:22:14.857884] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-15T18:22:15.433625] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T18:22:15.657936] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-15T18:22:16.003215] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T18:22:16.443519] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:22:16.457820] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-15T18:22:17.257867] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-15T18:22:17.743069] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:22:18.057898] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-15T18:22:18.552519] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:22:18.558620] [INFO ] [REMOTE ] ETR: Full fetch complete (57927 records). [2025-09-15T18:22:18.558796] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-15T18:22:18.858152] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-15T18:22:18.951538] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-15T18:22:18.951622] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-15T18:22:18.952466] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-15T18:22:18.952513] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-15T18:22:18.953799] [DEBUG] [LOCAL ] ETR: Trimmed 57927 records to 39268 (keeping 150 days of data) [2025-09-15T18:22:19.086124] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:22:19.230437] [DEBUG] [LOCAL ] ETR: Primary data saved (39268 records). [2025-09-15T18:22:19.230588] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-15T18:22:19.230696] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETR took 23.3s. Estimated remaining: 2h 47m 55s. Rate: 9.5 symbols/min [2025-09-15T18:22:19.399109] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:19.415664] [DEBUG] [LOCAL ] ETY: Loaded 16489 existing records from primary storage. [2025-09-15T18:22:19.415796] [INFO ] [MAIN ] ETY: Loaded 16489 existing records. [2025-09-15T18:22:19.602845] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:19.603083] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-15T18:22:19.603128] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-15T18:22:19.603700] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-15T18:22:19.603751] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-15T18:22:19.666291] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-15T18:22:19.987722] [INFO ] [REMOTE ] ETY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:19.991688] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:22:20.457873] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-15T18:22:20.865406] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:22:21.257841] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-15T18:22:21.590731] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:22:22.057869] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-15T18:22:22.260556] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:22:22.511841] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:22:22.857867] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-15T18:22:23.657914] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-15T18:22:23.996960] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:22:24.106720] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:22:24.457905] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-15T18:22:25.257877] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-15T18:22:25.514745] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:22:25.845032] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:22:26.057887] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-15T18:22:26.775848] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:22:26.857880] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-15T18:22:27.438921] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:22:27.657885] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-15T18:22:28.457905] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-15T18:22:28.596183] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:22:28.599149] [INFO ] [REMOTE ] ETV: Full fetch complete (23232 records). [2025-09-15T18:22:28.599244] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-15T18:22:28.946961] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T18:22:28.992904] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-15T18:22:28.992999] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-15T18:22:28.993529] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-15T18:22:28.993572] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-15T18:22:28.994535] [DEBUG] [LOCAL ] ETV: Trimmed 23232 records to 14880 (keeping 150 days of data) [2025-09-15T18:22:29.088456] [DEBUG] [LOCAL ] ETV: Primary data saved (14880 records). [2025-09-15T18:22:29.088605] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-15T18:22:29.088715] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETV took 22.0s. Estimated remaining: 2h 47m 55s. Rate: 9.5 symbols/min [2025-09-15T18:22:29.258666] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:29.258795] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-15T18:22:29.274402] [DEBUG] [LOCAL ] EVC: Loaded 14021 existing records from primary storage. [2025-09-15T18:22:29.274526] [INFO ] [MAIN ] EVC: Loaded 14021 existing records. [2025-09-15T18:22:29.450763] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:29.451053] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-15T18:22:29.451100] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-15T18:22:29.451517] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-15T18:22:29.451570] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-15T18:22:29.816995] [INFO ] [REMOTE ] EVC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:30.057886] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-15T18:22:30.109152] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T18:22:30.857842] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-15T18:22:31.114203] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:22:31.657899] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-15T18:22:31.699820] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:22:32.397483] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T18:22:32.398706] [INFO ] [REMOTE ] ETX: Full fetch complete (5251 records). [2025-09-15T18:22:32.398774] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-15T18:22:32.399154] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:22:32.399230] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:22:32.399326] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:22:32.399377] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-15T18:22:32.399449] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-09-15T18:22:32.399500] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-09-15T18:22:32.399869] [DEBUG] [LOCAL ] ETX: Deleted derivative data file. [2025-09-15T18:22:32.399956] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETX took 22.9s. Estimated remaining: 2h 47m 43s. Rate: 9.5 symbols/min [2025-09-15T18:22:32.463349] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-15T18:22:32.583785] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:32.608266] [DEBUG] [LOCAL ] EVEX: Loaded 22451 existing records from primary storage. [2025-09-15T18:22:32.608409] [INFO ] [MAIN ] EVEX: Loaded 22451 existing records. [2025-09-15T18:22:32.789329] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:32.789594] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-15T18:22:32.789658] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-15T18:22:32.790109] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-15T18:22:32.790153] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-15T18:22:33.136469] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:33.257870] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-15T18:22:33.545792] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:22:33.548973] [INFO ] [REMOTE ] ETW: Full fetch complete (27153 records). [2025-09-15T18:22:33.549046] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-15T18:22:33.908116] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-15T18:22:33.908190] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-15T18:22:33.908664] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-15T18:22:33.908715] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-15T18:22:33.909460] [DEBUG] [LOCAL ] ETW: Trimmed 27153 records to 17970 (keeping 150 days of data) [2025-09-15T18:22:34.018532] [DEBUG] [LOCAL ] ETW: Primary data saved (17970 records). [2025-09-15T18:22:34.018681] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-15T18:22:34.018801] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETW took 25.3s. Estimated remaining: 2h 47m 27s. Rate: 9.5 symbols/min [2025-09-15T18:22:34.063057] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-15T18:22:34.194095] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:34.202474] [DEBUG] [LOCAL ] EVF: Loaded 6509 existing records from primary storage. [2025-09-15T18:22:34.202562] [INFO ] [MAIN ] EVF: Loaded 6509 existing records. [2025-09-15T18:22:34.377900] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:34.378154] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-15T18:22:34.378207] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-15T18:22:34.383873] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-15T18:22:34.389841] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-15T18:22:34.433791] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:22:34.746198] [INFO ] [REMOTE ] EVF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:34.857855] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-15T18:22:35.357523] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:22:35.455015] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:22:35.657880] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-15T18:22:36.457900] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-15T18:22:36.956784] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:22:37.257886] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-15T18:22:37.745940] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:22:37.967078] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T18:22:38.057851] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-15T18:22:38.857864] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-15T18:22:39.064220] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:22:39.657874] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-15T18:22:39.797002] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:22:40.413242] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:22:40.457846] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-15T18:22:41.231477] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T18:22:41.257823] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-15T18:22:41.973348] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T18:22:42.057861] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-15T18:22:42.857869] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-15T18:22:43.299498] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:22:43.657859] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-15T18:22:43.882088] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T18:22:44.457908] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-15T18:22:44.624836] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:22:45.039813] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:22:45.257869] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-15T18:22:46.057886] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-15T18:22:46.140392] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:22:46.857899] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-15T18:22:47.151075] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:22:47.657871] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-15T18:22:47.790086] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:22:48.457873] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-15T18:22:49.217935] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:22:49.257872] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-15T18:22:49.532333] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:22:50.057943] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-15T18:22:50.225954] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:22:50.857949] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-15T18:22:51.619426] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:22:51.657811] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-15T18:22:51.806754] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:22:52.457881] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-15T18:22:53.148837] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T18:22:53.154146] [INFO ] [REMOTE ] EVEX: Full fetch complete (30709 records). [2025-09-15T18:22:53.154294] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-15T18:22:53.262944] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-15T18:22:53.459254] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:22:53.561787] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-15T18:22:53.561892] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-15T18:22:53.562529] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-15T18:22:53.562594] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-15T18:22:53.564403] [DEBUG] [LOCAL ] EVEX: Trimmed 30709 records to 22449 (keeping 150 days of data) [2025-09-15T18:22:53.719506] [DEBUG] [LOCAL ] EVEX: Primary data saved (22449 records). [2025-09-15T18:22:53.719735] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-15T18:22:53.719881] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. EVEX took 21.3s. Estimated remaining: 2h 47m 48s. Rate: 9.5 symbols/min [2025-09-15T18:22:53.893928] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:53.901138] [DEBUG] [LOCAL ] EVG: Loaded 4298 existing records from primary storage. [2025-09-15T18:22:53.901236] [INFO ] [MAIN ] EVG: Loaded 4298 existing records. [2025-09-15T18:22:54.070941] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-15T18:22:54.075408] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:54.076562] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-15T18:22:54.076610] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-15T18:22:54.076886] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-15T18:22:54.076935] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-15T18:22:54.422100] [INFO ] [REMOTE ] EVG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:54.496121] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:22:54.694863] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:22:54.696353] [INFO ] [REMOTE ] EVF: Full fetch complete (9497 records). [2025-09-15T18:22:54.696423] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-15T18:22:54.868151] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-15T18:22:55.059563] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-15T18:22:55.059659] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-15T18:22:55.059887] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-15T18:22:55.059928] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-15T18:22:55.060372] [DEBUG] [LOCAL ] EVF: Trimmed 9497 records to 6398 (keeping 150 days of data) [2025-09-15T18:22:55.098651] [DEBUG] [LOCAL ] EVF: Primary data saved (6398 records). [2025-09-15T18:22:55.098781] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-15T18:22:55.098869] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVF took 21.1s. Estimated remaining: 2h 47m 31s. Rate: 9.5 symbols/min [2025-09-15T18:22:55.267881] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:55.307186] [DEBUG] [LOCAL ] EVH: Loaded 37038 existing records from primary storage. [2025-09-15T18:22:55.307339] [INFO ] [MAIN ] EVH: Loaded 37038 existing records. [2025-09-15T18:22:55.485096] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:55.485383] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-15T18:22:55.485437] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-15T18:22:55.486226] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-15T18:22:55.486276] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-15T18:22:55.662983] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-15T18:22:55.847204] [INFO ] [REMOTE ] EVH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:55.995125] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:22:55.997607] [INFO ] [REMOTE ] EVC: Full fetch complete (22103 records). [2025-09-15T18:22:55.997720] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-15T18:22:56.364202] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-15T18:22:56.364302] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-15T18:22:56.364834] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-15T18:22:56.364880] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-15T18:22:56.365524] [DEBUG] [LOCAL ] EVC: Trimmed 22103 records to 13742 (keeping 150 days of data) [2025-09-15T18:22:56.451516] [DEBUG] [LOCAL ] EVC: Primary data saved (13742 records). [2025-09-15T18:22:56.451684] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-15T18:22:56.451782] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 27.4s. Estimated remaining: 2h 47m 15s. Rate: 9.5 symbols/min [2025-09-15T18:22:56.463217] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-15T18:22:56.628489] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:56.635862] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:22:56.638401] [INFO ] [REMOTE ] ETY: Full fetch complete (25332 records). [2025-09-15T18:22:56.638480] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-15T18:22:56.641099] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:22:56.641211] [FATAL] [MAIN ] ETY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:22:56.641251] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:22:56.641289] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-15T18:22:56.641347] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-09-15T18:22:56.641414] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-09-15T18:22:56.641739] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-09-15T18:22:56.641861] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. ETY took 37.4s. Estimated remaining: 2h 46m 56s. Rate: 9.5 symbols/min [2025-09-15T18:22:56.690057] [DEBUG] [LOCAL ] EVN: Loaded 7883 existing records from primary storage. [2025-09-15T18:22:56.725661] [INFO ] [MAIN ] EVN: Loaded 7883 existing records. [2025-09-15T18:22:56.950945] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:57.018982] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:57.019371] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-15T18:22:57.019426] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-15T18:22:57.019782] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-15T18:22:57.019834] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-15T18:22:57.211408] [DEBUG] [LOCAL ] EVR: Loaded 25593 existing records from primary storage. [2025-09-15T18:22:57.212146] [INFO ] [MAIN ] EVR: Loaded 25593 existing records. [2025-09-15T18:22:57.291092] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-15T18:22:57.497904] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:22:57.537885] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:57.548327] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-15T18:22:57.558570] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-15T18:22:57.593695] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-15T18:22:57.611031] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-15T18:22:57.614548] [INFO ] [REMOTE ] EVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:57.992112] [INFO ] [REMOTE ] EVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:58.057886] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-15T18:22:58.857865] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-15T18:22:58.999512] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:22:59.120198] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:22:59.657920] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-15T18:23:00.457897] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-15T18:23:01.257923] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-15T18:23:01.894557] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:23:02.020568] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:23:02.057832] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-15T18:23:02.857889] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-15T18:23:03.670075] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:23:03.680597] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-15T18:23:05.007383] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (6.15 seconds). [2025-09-15T18:23:05.009165] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-15T18:23:06.113939] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T18:23:06.116430] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-15T18:23:06.297488] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (6.64 seconds). [2025-09-15T18:23:06.315164] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-15T18:23:06.315571] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-09-15T18:23:06.495380] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-15T18:23:06.671134] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:23:06.857961] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-15T18:23:07.657931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-15T18:23:07.969409] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:23:08.219662] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:23:08.457929] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-15T18:23:09.257892] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-15T18:23:09.291485] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:23:09.915520] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:23:10.057897] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-15T18:23:10.626778] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:23:10.857910] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-15T18:23:11.588293] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:23:11.657904] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-15T18:23:12.062727] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (5.20 seconds). [2025-09-15T18:23:12.457934] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-15T18:23:12.484197] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:23:13.257919] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-15T18:23:13.671126] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:23:14.057881] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-15T18:23:14.220014] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:23:14.497369] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:23:14.499361] [INFO ] [REMOTE ] EVG: Full fetch complete (6192 records). [2025-09-15T18:23:14.499474] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-15T18:23:14.871741] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-15T18:23:14.879404] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-15T18:23:14.879489] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-15T18:23:14.879690] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-15T18:23:14.879748] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-15T18:23:14.880178] [DEBUG] [LOCAL ] EVG: Trimmed 6192 records to 4289 (keeping 150 days of data) [2025-09-15T18:23:14.909589] [DEBUG] [LOCAL ] EVG: Primary data saved (4289 records). [2025-09-15T18:23:14.909704] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-15T18:23:14.909805] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVG took 21.2s. Estimated remaining: 2h 47m 14s. Rate: 9.5 symbols/min [2025-09-15T18:23:15.083912] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:15.098777] [DEBUG] [LOCAL ] EVT: Loaded 12781 existing records from primary storage. [2025-09-15T18:23:15.098933] [INFO ] [MAIN ] EVT: Loaded 12781 existing records. [2025-09-15T18:23:15.278384] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:15.278666] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-15T18:23:15.278716] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-15T18:23:15.279148] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-15T18:23:15.279195] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-15T18:23:15.628143] [INFO ] [REMOTE ] EVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:15.657895] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-15T18:23:16.438625] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:23:16.438464] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:23:16.450836] [INFO ] [REMOTE ] EVN: Full fetch complete (11970 records). [2025-09-15T18:23:16.450952] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-15T18:23:16.451708] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:16.451783] [FATAL] [MAIN ] EVN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:16.451820] [WARN ] [MAIN ] EVN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:16.451865] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-15T18:23:16.451945] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-15T18:23:16.451983] [INFO ] [LOCAL ] EVN: Starting deletion of derivative data. [2025-09-15T18:23:16.452339] [DEBUG] [LOCAL ] EVN: Deleted derivative data file. [2025-09-15T18:23:16.452421] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVN took 20.0s. Estimated remaining: 2h 46m 58s. Rate: 9.5 symbols/min [2025-09-15T18:23:16.463197] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-15T18:23:16.625181] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:16.645951] [DEBUG] [LOCAL ] EVTC: Loaded 19605 existing records from primary storage. [2025-09-15T18:23:16.646097] [INFO ] [MAIN ] EVTC: Loaded 19605 existing records. [2025-09-15T18:23:16.820240] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:16.820525] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-15T18:23:16.820572] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-15T18:23:16.821137] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-15T18:23:16.821190] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-15T18:23:17.187289] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:17.257892] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-15T18:23:18.064438] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-15T18:23:18.067521] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T18:23:18.154709] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:23:18.857869] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-15T18:23:19.006279] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:23:19.657876] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-15T18:23:20.227991] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:23:20.457874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-15T18:23:20.557825] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:23:21.257915] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-15T18:23:21.929546] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:23:21.935164] [INFO ] [REMOTE ] EVH: Full fetch complete (53729 records). [2025-09-15T18:23:21.935279] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-15T18:23:22.062944] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-15T18:23:22.314225] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-15T18:23:22.314348] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-15T18:23:22.315145] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-15T18:23:22.315192] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-15T18:23:22.316292] [DEBUG] [LOCAL ] EVH: Trimmed 53729 records to 36311 (keeping 150 days of data) [2025-09-15T18:23:22.523941] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:23:22.561069] [DEBUG] [LOCAL ] EVH: Primary data saved (36311 records). [2025-09-15T18:23:22.561229] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-15T18:23:22.561324] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVH took 27.5s. Estimated remaining: 2h 46m 51s. Rate: 9.5 symbols/min [2025-09-15T18:23:22.731346] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:22.759210] [DEBUG] [LOCAL ] EVTL: Loaded 29725 existing records from primary storage. [2025-09-15T18:23:22.759359] [INFO ] [MAIN ] EVTL: Loaded 29725 existing records. [2025-09-15T18:23:22.861326] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-15T18:23:22.944875] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:22.945149] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-15T18:23:22.945202] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-15T18:23:22.945872] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-15T18:23:22.945927] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-15T18:23:23.307593] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:23.339773] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:23:23.657869] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-15T18:23:23.957174] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:23:24.457916] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-15T18:23:24.698608] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:23:25.257898] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-15T18:23:25.720366] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:23:26.057907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-15T18:23:26.857909] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-15T18:23:26.973778] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:23:27.657951] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-15T18:23:28.099788] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T18:23:28.327141] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T18:23:28.457847] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-15T18:23:28.556474] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-15T18:23:29.257881] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-15T18:23:29.786188] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:23:30.057874] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-15T18:23:30.248806] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:23:30.845039] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:23:30.857830] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-15T18:23:31.657907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-15T18:23:31.827147] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:23:31.830441] [INFO ] [REMOTE ] EVTC: Full fetch complete (28941 records). [2025-09-15T18:23:31.830539] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-15T18:23:32.201506] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-15T18:23:32.201592] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-15T18:23:32.202160] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-15T18:23:32.202205] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-15T18:23:32.202994] [DEBUG] [LOCAL ] EVTC: Trimmed 28941 records to 19286 (keeping 150 days of data) [2025-09-15T18:23:32.328076] [DEBUG] [LOCAL ] EVTC: Primary data saved (19286 records). [2025-09-15T18:23:32.328263] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-15T18:23:32.328361] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVTC took 15.9s. Estimated remaining: 2h 46m 52s. Rate: 9.5 symbols/min [2025-09-15T18:23:32.472149] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-15T18:23:32.503731] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:32.522431] [DEBUG] [LOCAL ] EVTR: Loaded 17332 existing records from primary storage. [2025-09-15T18:23:32.522584] [INFO ] [MAIN ] EVTR: Loaded 17332 existing records. [2025-09-15T18:23:32.698454] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:32.698891] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-15T18:23:32.698956] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-15T18:23:32.699577] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-15T18:23:32.699746] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-15T18:23:32.828298] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:23:33.078098] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:33.181590] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:23:33.257913] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-15T18:23:34.057890] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-15T18:23:34.177427] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:23:34.857868] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-15T18:23:35.093707] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:23:35.657894] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-15T18:23:36.457896] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-15T18:23:36.754956] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:23:37.182676] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:23:37.257828] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-15T18:23:38.057936] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-15T18:23:38.139947] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:23:38.403390] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:23:38.405666] [INFO ] [REMOTE ] EVT: Full fetch complete (19247 records). [2025-09-15T18:23:38.405741] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-15T18:23:38.768583] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-15T18:23:38.768719] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-15T18:23:38.769201] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-15T18:23:38.769245] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-15T18:23:38.769842] [DEBUG] [LOCAL ] EVT: Trimmed 19247 records to 12619 (keeping 150 days of data) [2025-09-15T18:23:38.848441] [DEBUG] [LOCAL ] EVT: Primary data saved (12619 records). [2025-09-15T18:23:38.848579] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-15T18:23:38.848687] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 23.9s. Estimated remaining: 2h 46m 46s. Rate: 9.5 symbols/min [2025-09-15T18:23:38.862919] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-15T18:23:39.023855] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:39.033626] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:23:39.037281] [INFO ] [REMOTE ] EVR: Full fetch complete (39177 records). [2025-09-15T18:23:39.037392] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-15T18:23:39.038077] [FATAL] [VALIDATOR ] EVR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:39.038172] [FATAL] [MAIN ] EVR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:39.038213] [WARN ] [MAIN ] EVR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:39.038251] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-15T18:23:39.038312] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-09-15T18:23:39.038351] [INFO ] [LOCAL ] EVR: Starting deletion of derivative data. [2025-09-15T18:23:39.038760] [DEBUG] [LOCAL ] EVR: Deleted derivative data file. [2025-09-15T18:23:39.038859] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVR took 42.4s. Estimated remaining: 2h 46m 27s. Rate: 9.5 symbols/min [2025-09-15T18:23:39.221713] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:39.235566] [DEBUG] [LOCAL ] EW: Loaded 40167 existing records from primary storage. [2025-09-15T18:23:39.235774] [INFO ] [MAIN ] EW: Loaded 40167 existing records. [2025-09-15T18:23:39.446197] [DEBUG] [LOCAL ] EXG: Loaded 25562 existing records from primary storage. [2025-09-15T18:23:39.446383] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:39.446730] [INFO ] [MAIN ] EXG: Loaded 25562 existing records. [2025-09-15T18:23:39.529218] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-15T18:23:39.550760] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-15T18:23:39.604458] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-15T18:23:39.630742] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-15T18:23:39.630941] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:39.654220] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-15T18:23:39.667626] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-15T18:23:39.667575] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-15T18:23:39.682003] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-15T18:23:39.691952] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-15T18:23:40.438887] [INFO ] [REMOTE ] EXG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:40.471164] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-15T18:23:40.475583] [INFO ] [REMOTE ] EW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:40.497817] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:23:40.704093] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:23:41.257914] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-15T18:23:41.891983] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:23:42.057893] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-15T18:23:42.792043] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:23:42.857873] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-15T18:23:42.964432] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:23:43.582792] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:23:43.657961] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-15T18:23:44.457932] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-15T18:23:44.649769] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:23:45.257868] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-15T18:23:45.989719] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:23:46.057863] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-15T18:23:46.144676] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T18:23:46.857879] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-15T18:23:47.440141] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:23:47.622298] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T18:23:47.626252] [INFO ] [REMOTE ] EVTR: Full fetch complete (24374 records). [2025-09-15T18:23:47.626354] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-15T18:23:47.662983] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-15T18:23:48.005092] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-15T18:23:48.005193] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-15T18:23:48.005806] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-15T18:23:48.005859] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-15T18:23:48.006608] [DEBUG] [LOCAL ] EVTR: Trimmed 24374 records to 17176 (keeping 150 days of data) [2025-09-15T18:23:48.113815] [DEBUG] [LOCAL ] EVTR: Primary data saved (17176 records). [2025-09-15T18:23:48.113969] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-15T18:23:48.114056] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTR took 15.8s. Estimated remaining: 2h 46m 26s. Rate: 9.5 symbols/min [2025-09-15T18:23:48.291678] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:48.333504] [DEBUG] [LOCAL ] EXK: Loaded 39936 existing records from primary storage. [2025-09-15T18:23:48.333669] [INFO ] [MAIN ] EXK: Loaded 39936 existing records. [2025-09-15T18:23:48.463016] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-15T18:23:48.521047] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:48.521447] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-15T18:23:48.521519] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-15T18:23:48.522534] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-15T18:23:48.522594] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-15T18:23:48.884829] [INFO ] [REMOTE ] EXK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:49.257936] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-15T18:23:50.057941] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-15T18:23:50.696775] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-15T18:23:50.791422] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:23:50.857860] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-15T18:23:50.942959] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T18:23:51.657889] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-15T18:23:51.819670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:23:51.898125] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T18:23:52.457899] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-15T18:23:52.978660] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:23:53.257940] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-15T18:23:53.398288] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:23:54.057878] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-15T18:23:54.857854] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-15T18:23:55.007273] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T18:23:55.008615] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:23:55.657866] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-15T18:23:56.110431] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:23:56.115400] [INFO ] [REMOTE ] EVTL: Full fetch complete (39251 records). [2025-09-15T18:23:56.115510] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-15T18:23:56.458135] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-15T18:23:56.489576] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-15T18:23:56.489685] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-15T18:23:56.490328] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-15T18:23:56.490373] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-15T18:23:56.491266] [DEBUG] [LOCAL ] EVTL: Trimmed 39251 records to 29727 (keeping 150 days of data) [2025-09-15T18:23:56.661493] [DEBUG] [LOCAL ] EVTL: Primary data saved (29727 records). [2025-09-15T18:23:56.661631] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-15T18:23:56.661733] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 34.1s. Estimated remaining: 2h 46m 24s. Rate: 9.5 symbols/min [2025-09-15T18:23:56.833173] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:56.854328] [DEBUG] [LOCAL ] EXP: Loaded 22227 existing records from primary storage. [2025-09-15T18:23:56.854461] [INFO ] [MAIN ] EXP: Loaded 22227 existing records. [2025-09-15T18:23:57.037988] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:57.038233] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-15T18:23:57.038281] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-15T18:23:57.039005] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-15T18:23:57.039058] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-15T18:23:57.263093] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-15T18:23:57.407951] [INFO ] [REMOTE ] EXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:57.442588] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T18:23:58.057902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-15T18:23:58.173293] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:23:58.453575] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:23:58.457199] [INFO ] [REMOTE ] EXG: Full fetch complete (37750 records). [2025-09-15T18:23:58.457314] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-15T18:23:58.458027] [FATAL] [VALIDATOR ] EXG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:58.458107] [FATAL] [MAIN ] EXG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:58.458144] [WARN ] [MAIN ] EXG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:58.458183] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-15T18:23:58.458241] [DEBUG] [LOCAL ] EXG: No primary data file found to delete. [2025-09-15T18:23:58.458286] [INFO ] [LOCAL ] EXG: Starting deletion of derivative data. [2025-09-15T18:23:58.458570] [DEBUG] [LOCAL ] EXG: Deleted derivative data file. [2025-09-15T18:23:58.458679] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EXG took 19.4s. Estimated remaining: 2h 46m 9s. Rate: 9.5 symbols/min [2025-09-15T18:23:58.625098] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:58.664479] [DEBUG] [LOCAL ] EXPD: Loaded 36005 existing records from primary storage. [2025-09-15T18:23:58.664614] [INFO ] [MAIN ] EXPD: Loaded 36005 existing records. [2025-09-15T18:23:58.842694] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:58.842973] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-15T18:23:58.843032] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-15T18:23:58.843757] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-15T18:23:58.843806] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-15T18:23:58.864500] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-15T18:23:59.199454] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:59.374878] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T18:23:59.657877] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-15T18:24:00.414195] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:24:00.457858] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-15T18:24:01.037551] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:01.257920] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-15T18:24:01.841440] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:02.057874] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-15T18:24:02.790369] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:24:02.857863] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-15T18:24:03.657902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-15T18:24:03.714229] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:24:04.375390] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:24:04.457826] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-15T18:24:04.803324] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:24:05.257872] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-15T18:24:05.774676] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:24:06.057870] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-15T18:24:06.857913] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-15T18:24:07.053195] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:24:07.288538] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:24:07.657917] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-15T18:24:08.169439] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:24:08.175415] [INFO ] [REMOTE ] EW: Full fetch complete (58059 records). [2025-09-15T18:24:08.175525] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-15T18:24:08.462974] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-15T18:24:08.584177] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-15T18:24:08.584303] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-15T18:24:08.585119] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-15T18:24:08.585166] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-15T18:24:08.586446] [DEBUG] [LOCAL ] EW: Trimmed 58059 records to 39389 (keeping 150 days of data) [2025-09-15T18:24:08.831953] [DEBUG] [LOCAL ] EW: Primary data saved (39389 records). [2025-09-15T18:24:08.832108] [INFO ] [MAIN ] EW: Full history saved. [2025-09-15T18:24:08.834229] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EW took 30.0s. Estimated remaining: 2h 46m 11s. Rate: 9.5 symbols/min [2025-09-15T18:24:09.016254] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:09.034087] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:09.080766] [DEBUG] [LOCAL ] EXR: Loaded 34050 existing records from primary storage. [2025-09-15T18:24:09.080987] [INFO ] [MAIN ] EXR: Loaded 34050 existing records. [2025-09-15T18:24:09.255770] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:09.256075] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-15T18:24:09.256146] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-15T18:24:09.257083] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-15T18:24:09.257148] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-15T18:24:09.268188] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-15T18:24:09.606923] [INFO ] [REMOTE ] EXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:10.057868] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-15T18:24:10.161296] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:24:10.857924] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-15T18:24:10.915094] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:24:11.049494] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:24:11.657863] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-15T18:24:12.206500] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:24:12.457952] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-15T18:24:12.923412] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:24:13.257887] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-15T18:24:13.902065] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:24:14.057921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-15T18:24:14.857935] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-15T18:24:15.221932] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T18:24:15.227552] [INFO ] [REMOTE ] EXK: Full fetch complete (57213 records). [2025-09-15T18:24:15.227692] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-15T18:24:15.228418] [FATAL] [VALIDATOR ] EXK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:24:15.228496] [FATAL] [MAIN ] EXK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:24:15.228532] [WARN ] [MAIN ] EXK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:24:15.228571] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-15T18:24:15.228631] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-15T18:24:15.228687] [INFO ] [LOCAL ] EXK: Starting deletion of derivative data. [2025-09-15T18:24:15.228967] [DEBUG] [LOCAL ] EXK: Deleted derivative data file. [2025-09-15T18:24:15.229560] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXK took 27.1s. Estimated remaining: 2h 46m 4s. Rate: 9.5 symbols/min [2025-09-15T18:24:15.559119] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:24:15.657908] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-15T18:24:16.317436] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:24:16.457860] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-15T18:24:17.265612] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-15T18:24:17.284009] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:24:18.057886] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-15T18:24:18.357038] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:24:18.427765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:24:18.857921] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-15T18:24:19.475064] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:24:19.647353] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:24:19.650847] [INFO ] [REMOTE ] EXP: Full fetch complete (32890 records). [2025-09-15T18:24:19.650936] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-15T18:24:19.663103] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-15T18:24:20.036060] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-15T18:24:20.036161] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-15T18:24:20.036827] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-15T18:24:20.036920] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-15T18:24:20.037865] [DEBUG] [LOCAL ] EXP: Trimmed 32890 records to 21794 (keeping 150 days of data) [2025-09-15T18:24:20.172778] [DEBUG] [LOCAL ] EXP: Primary data saved (21794 records). [2025-09-15T18:24:20.172915] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-15T18:24:20.173000] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 23.5s. Estimated remaining: 2h 45m 55s. Rate: 9.5 symbols/min [2025-09-15T18:24:20.457895] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-15T18:24:21.279031] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:24:21.292893] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-15T18:24:21.711845] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:24:22.057875] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-15T18:24:22.767707] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:24:22.857822] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-15T18:24:23.160231] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:24:23.657933] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-15T18:24:24.431674] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:24:24.457863] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-15T18:24:25.068488] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:24:25.073795] [INFO ] [REMOTE ] EXR: Full fetch complete (49507 records). [2025-09-15T18:24:25.073895] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-15T18:24:25.447362] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-15T18:24:25.447445] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-15T18:24:25.448209] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-15T18:24:25.448256] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-15T18:24:25.449358] [DEBUG] [LOCAL ] EXR: Trimmed 49507 records to 33469 (keeping 150 days of data) [2025-09-15T18:24:25.676329] [DEBUG] [LOCAL ] EXR: Primary data saved (33469 records). [2025-09-15T18:24:25.676501] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-15T18:24:25.676604] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXR took 16.8s. Estimated remaining: 2h 45m 47s. Rate: 9.5 symbols/min [2025-09-15T18:24:25.937943] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:24:25.950492] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-15T18:24:27.493279] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:24:27.498828] [INFO ] [REMOTE ] EXPD: Full fetch complete (52526 records). [2025-09-15T18:24:27.498988] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-15T18:24:27.895297] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-15T18:24:27.895377] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-15T18:24:27.896113] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-15T18:24:27.896159] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-15T18:24:27.897320] [DEBUG] [LOCAL ] EXPD: Trimmed 52526 records to 35289 (keeping 150 days of data) [2025-09-15T18:24:28.142867] [DEBUG] [LOCAL ] EXPD: Primary data saved (35289 records). [2025-09-15T18:24:28.143036] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-15T18:24:28.143929] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXPD took 29.7s. Estimated remaining: 2h 45m 33s. Rate: 9.5 symbols/min [2025-09-15T18:24:28.764209] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.786165] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.820518] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.844364] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.896284] [DEBUG] [LOCAL ] FBK: Loaded 19646 existing records from primary storage. [2025-09-15T18:24:28.896437] [INFO ] [MAIN ] FBK: Loaded 19646 existing records. [2025-09-15T18:24:29.031251] [DEBUG] [LOCAL ] FAF: Loaded 31749 existing records from primary storage. [2025-09-15T18:24:29.037128] [DEBUG] [LOCAL ] FBIN: Loaded 38076 existing records from primary storage. [2025-09-15T18:24:29.049586] [DEBUG] [LOCAL ] F: Loaded 40560 existing records from primary storage. [2025-09-15T18:24:29.049844] [INFO ] [MAIN ] FAF: Loaded 31749 existing records. [2025-09-15T18:24:29.049773] [INFO ] [MAIN ] F: Loaded 40560 existing records. [2025-09-15T18:24:29.071397] [INFO ] [MAIN ] FBIN: Loaded 38076 existing records. [2025-09-15T18:24:29.268053] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.393433] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.425841] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-15T18:24:29.472634] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-15T18:24:29.537255] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-15T18:24:29.691454] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.695033] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.719813] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.770333] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.808345] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-15T18:24:29.853376] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.830964] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-15T18:24:29.853701] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.864508] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-15T18:24:29.864429] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-15T18:24:29.911561] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-15T18:24:29.929759] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-15T18:24:29.929892] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-15T18:24:29.911625] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-15T18:24:30.019505] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-15T18:24:30.691698] [INFO ] [REMOTE ] FBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:30.730428] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-15T18:24:31.068251] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.123518] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-15T18:24:31.127943] [INFO ] [REMOTE ] F: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.177406] [INFO ] [REMOTE ] FAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.177995] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-15T18:24:31.177681] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-15T18:24:31.522235] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:24:31.525629] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-15T18:24:32.192573] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:24:32.199472] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-15T18:24:32.465934] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T18:24:32.470155] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-15T18:24:32.782828] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:24:32.792674] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-15T18:24:33.188998] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:24:33.197681] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-15T18:24:33.295929] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T18:24:33.305792] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-15T18:24:33.689002] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:24:34.057926] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-15T18:24:34.459367] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:24:34.545595] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:24:34.857871] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-15T18:24:35.113619] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:24:35.208548] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:24:35.657877] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-15T18:24:36.336389] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:24:36.457983] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-15T18:24:37.257892] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-15T18:24:37.853374] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:24:38.057851] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-15T18:24:38.212728] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-15T18:24:38.470938] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T18:24:38.857887] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-15T18:24:39.122322] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:24:39.657881] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-15T18:24:40.086203] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:24:40.457876] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-15T18:24:40.958008] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:24:41.257922] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-15T18:24:42.057882] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-15T18:24:42.450395] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:24:42.580264] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-15T18:24:42.857883] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-15T18:24:43.444880] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:24:43.631620] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:24:43.657839] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-15T18:24:44.457915] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-15T18:24:45.026878] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:24:45.257917] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-15T18:24:45.766674] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:24:46.057907] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-15T18:24:46.574549] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:24:46.579344] [INFO ] [REMOTE ] FAF: Full fetch complete (45163 records). [2025-09-15T18:24:46.579438] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-15T18:24:46.865286] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-15T18:24:46.956348] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-15T18:24:46.956444] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-15T18:24:46.957165] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-15T18:24:46.957233] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-15T18:24:46.958470] [DEBUG] [LOCAL ] FAF: Trimmed 45163 records to 31072 (keeping 150 days of data) [2025-09-15T18:24:47.156911] [DEBUG] [LOCAL ] FAF: Primary data saved (31072 records). [2025-09-15T18:24:47.157095] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-15T18:24:47.157235] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 19.0s. Estimated remaining: 2h 45m 52s. Rate: 9.5 symbols/min [2025-09-15T18:24:47.335535] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:47.352884] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:24:47.360482] [INFO ] [REMOTE ] FBIN: Full fetch complete (54900 records). [2025-09-15T18:24:47.360613] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-15T18:24:47.554210] [DEBUG] [LOCAL ] FBP: Loaded 34097 existing records from primary storage. [2025-09-15T18:24:47.601417] [INFO ] [MAIN ] FBP: Loaded 34097 existing records. [2025-09-15T18:24:47.662946] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-15T18:24:47.946560] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:47.946755] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-15T18:24:47.946980] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-15T18:24:47.947943] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-15T18:24:47.948350] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-15T18:24:47.948255] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-15T18:24:47.948499] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-15T18:24:47.956336] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-15T18:24:47.967301] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-15T18:24:47.990039] [DEBUG] [LOCAL ] FBIN: Trimmed 54900 records to 37347 (keeping 150 days of data) [2025-09-15T18:24:47.980254] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:24:48.454765] [INFO ] [REMOTE ] FBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:48.460917] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-15T18:24:48.580663] [DEBUG] [LOCAL ] FBIN: Primary data saved (37347 records). [2025-09-15T18:24:48.580811] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-15T18:24:48.580933] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 20.4s. Estimated remaining: 2h 45m 36s. Rate: 9.5 symbols/min [2025-09-15T18:24:48.747633] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:48.774369] [DEBUG] [LOCAL ] FBRT: Loaded 25573 existing records from primary storage. [2025-09-15T18:24:48.774517] [INFO ] [MAIN ] FBRT: Loaded 25573 existing records. [2025-09-15T18:24:48.951314] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:48.951605] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-15T18:24:48.951673] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-15T18:24:48.952280] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-15T18:24:48.952332] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-15T18:24:49.263309] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-15T18:24:49.354150] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:49.592161] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:24:49.594804] [INFO ] [REMOTE ] FBK: Full fetch complete (26240 records). [2025-09-15T18:24:49.594896] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-15T18:24:49.595460] [FATAL] [VALIDATOR ] FBK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:24:49.595550] [FATAL] [MAIN ] FBK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:24:49.595613] [WARN ] [MAIN ] FBK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:24:49.595702] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-15T18:24:49.595767] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-15T18:24:49.595803] [INFO ] [LOCAL ] FBK: Starting deletion of derivative data. [2025-09-15T18:24:49.596038] [DEBUG] [LOCAL ] FBK: Deleted derivative data file. [2025-09-15T18:24:49.596138] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FBK took 21.5s. Estimated remaining: 2h 45m 19s. Rate: 9.5 symbols/min [2025-09-15T18:24:49.769318] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:49.788022] [DEBUG] [LOCAL ] FC: Loaded 10642 existing records from primary storage. [2025-09-15T18:24:49.788171] [INFO ] [MAIN ] FC: Loaded 10642 existing records. [2025-09-15T18:24:49.962533] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:49.962858] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-15T18:24:49.962918] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-15T18:24:49.963269] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-15T18:24:49.963313] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-15T18:24:50.062957] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-15T18:24:50.330766] [INFO ] [REMOTE ] FC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:50.426309] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-15T18:24:50.496062] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:24:50.857878] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-15T18:24:51.657833] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-15T18:24:51.815230] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T18:24:52.118723] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T18:24:52.457881] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-15T18:24:53.257909] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-15T18:24:53.677816] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:24:54.057910] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-15T18:24:54.134461] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T18:24:54.675467] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:24:54.857887] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-15T18:24:55.030004] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:24:55.657952] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-15T18:24:56.457837] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-15T18:24:56.505216] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:24:56.911614] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T18:24:57.257945] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-15T18:24:57.424898] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:24:58.057887] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-15T18:24:58.713303] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T18:24:58.857904] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-15T18:24:59.341591] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T18:24:59.569719] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-15T18:24:59.577696] [INFO ] [REMOTE ] F: Full fetch complete (58500 records). [2025-09-15T18:24:59.577870] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-15T18:24:59.662954] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-15T18:24:59.966202] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-15T18:24:59.966294] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-15T18:24:59.967121] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-15T18:24:59.967201] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-15T18:24:59.968514] [DEBUG] [LOCAL ] F: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T18:25:00.235340] [DEBUG] [LOCAL ] F: Primary data saved (39780 records). [2025-09-15T18:25:00.235502] [INFO ] [MAIN ] F: Full history saved. [2025-09-15T18:25:00.237421] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 32.1s. Estimated remaining: 2h 45m 21s. Rate: 9.5 symbols/min [2025-09-15T18:25:00.406148] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:00.446922] [DEBUG] [LOCAL ] FCF: Loaded 28808 existing records from primary storage. [2025-09-15T18:25:00.447069] [INFO ] [MAIN ] FCF: Loaded 28808 existing records. [2025-09-15T18:25:00.467626] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-15T18:25:00.626349] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:00.626572] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-15T18:25:00.626617] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-15T18:25:00.627271] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-15T18:25:00.627320] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-15T18:25:00.983445] [INFO ] [REMOTE ] FCF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:01.077206] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:25:01.257946] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-15T18:25:02.042535] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:25:02.062955] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-15T18:25:02.090478] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:25:02.857883] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-15T18:25:03.169852] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:25:03.657895] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-15T18:25:04.360464] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:25:04.457869] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-15T18:25:04.895176] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:25:05.257884] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-15T18:25:05.340481] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:25:06.057903] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-15T18:25:06.602350] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:25:06.857917] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-15T18:25:07.371948] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:25:07.377406] [INFO ] [REMOTE ] FBRT: Full fetch complete (37183 records). [2025-09-15T18:25:07.377571] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-15T18:25:07.667699] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-15T18:25:07.763903] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-15T18:25:07.763985] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-15T18:25:07.764637] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-15T18:25:07.764699] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-15T18:25:07.765552] [DEBUG] [LOCAL ] FBRT: Trimmed 37183 records to 24991 (keeping 150 days of data) [2025-09-15T18:25:07.841025] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T18:25:07.935317] [DEBUG] [LOCAL ] FBRT: Primary data saved (24991 records). [2025-09-15T18:25:07.935464] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-15T18:25:07.935547] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBRT took 19.4s. Estimated remaining: 2h 45m 18s. Rate: 9.5 symbols/min [2025-09-15T18:25:08.107598] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:08.130832] [DEBUG] [LOCAL ] FCN: Loaded 19410 existing records from primary storage. [2025-09-15T18:25:08.131039] [INFO ] [MAIN ] FCN: Loaded 19410 existing records. [2025-09-15T18:25:08.324420] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:08.324803] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-15T18:25:08.324853] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-15T18:25:08.325719] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-15T18:25:08.325974] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-15T18:25:08.462968] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-15T18:25:08.694318] [INFO ] [REMOTE ] FCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:09.221561] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:25:09.257812] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-15T18:25:09.555104] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:25:09.557204] [INFO ] [REMOTE ] FC: Full fetch complete (16767 records). [2025-09-15T18:25:09.557274] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-15T18:25:09.924435] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-15T18:25:09.924588] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-15T18:25:09.925081] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-15T18:25:09.925131] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-15T18:25:09.925980] [DEBUG] [LOCAL ] FC: Trimmed 16767 records to 10433 (keeping 150 days of data) [2025-09-15T18:25:09.991220] [DEBUG] [LOCAL ] FC: Primary data saved (10433 records). [2025-09-15T18:25:09.991380] [INFO ] [MAIN ] FC: Full history saved. [2025-09-15T18:25:09.991487] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FC took 20.4s. Estimated remaining: 2h 45m 3s. Rate: 9.5 symbols/min [2025-09-15T18:25:10.065044] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-15T18:25:10.204818] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:10.231796] [DEBUG] [LOCAL ] FCPT: Loaded 27113 existing records from primary storage. [2025-09-15T18:25:10.231975] [INFO ] [MAIN ] FCPT: Loaded 27113 existing records. [2025-09-15T18:25:10.412581] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:10.412853] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-15T18:25:10.412903] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-15T18:25:10.413576] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-15T18:25:10.413630] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-15T18:25:10.773023] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:10.796603] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:25:10.857821] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-15T18:25:11.657936] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-15T18:25:11.801514] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T18:25:11.867186] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:25:12.457870] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-15T18:25:13.099416] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:25:13.257890] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-15T18:25:13.757958] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T18:25:14.057863] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-15T18:25:14.390125] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T18:25:14.857881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-15T18:25:15.557667] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:25:15.657861] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-15T18:25:15.960061] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:25:16.457876] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-15T18:25:17.060733] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:25:17.257884] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-15T18:25:17.355845] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:25:18.057867] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-15T18:25:18.713199] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:25:18.857847] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-15T18:25:19.338855] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:25:19.657890] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-15T18:25:20.390284] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:25:20.395159] [INFO ] [REMOTE ] FBP: Full fetch complete (50226 records). [2025-09-15T18:25:20.395304] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-15T18:25:20.463122] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-15T18:25:20.779779] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-15T18:25:20.779861] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-15T18:25:20.780539] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-15T18:25:20.780579] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-15T18:25:20.781591] [DEBUG] [LOCAL ] FBP: Trimmed 50226 records to 33317 (keeping 150 days of data) [2025-09-15T18:25:21.009666] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T18:25:21.026290] [DEBUG] [LOCAL ] FBP: Primary data saved (33317 records). [2025-09-15T18:25:21.035838] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-15T18:25:21.035988] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBP took 33.9s. Estimated remaining: 2h 45m 6s. Rate: 9.5 symbols/min [2025-09-15T18:25:21.218180] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:21.218429] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-15T18:25:21.218471] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-15T18:25:21.218609] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-15T18:25:21.218677] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-15T18:25:21.218725] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-15T18:25:21.218760] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-15T18:25:21.263153] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-15T18:25:21.605479] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:21.627285] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:25:22.057880] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-15T18:25:22.403049] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T18:25:22.857867] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-15T18:25:23.204745] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:25:23.657881] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-15T18:25:24.188587] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:25:24.457889] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-15T18:25:24.817896] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:25:24.934297] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:25:25.257873] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-15T18:25:25.502548] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-15T18:25:26.057885] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-15T18:25:26.857879] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-15T18:25:27.271173] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:25:27.657912] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-15T18:25:28.379402] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:25:28.383776] [INFO ] [REMOTE ] FCF: Full fetch complete (43295 records). [2025-09-15T18:25:28.383862] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-15T18:25:28.462975] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-15T18:25:28.793770] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-15T18:25:28.794167] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-15T18:25:28.795285] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-15T18:25:28.795394] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-15T18:25:28.830209] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:25:28.834819] [DEBUG] [LOCAL ] FCF: Trimmed 43295 records to 28033 (keeping 150 days of data) [2025-09-15T18:25:29.047456] [DEBUG] [LOCAL ] FCF: Primary data saved (28033 records). [2025-09-15T18:25:29.047628] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-15T18:25:29.047746] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FCF took 28.8s. Estimated remaining: 2h 45m 3s. Rate: 9.5 symbols/min [2025-09-15T18:25:29.256671] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:29.257846] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-15T18:25:29.271280] [DEBUG] [LOCAL ] FCT: Loaded 10451 existing records from primary storage. [2025-09-15T18:25:29.271448] [INFO ] [MAIN ] FCT: Loaded 10451 existing records. [2025-09-15T18:25:29.526554] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:29.527459] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-15T18:25:29.527570] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-15T18:25:29.528130] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-15T18:25:29.528273] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-15T18:25:29.630752] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:25:29.741824] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T18:25:30.052891] [INFO ] [REMOTE ] FCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:30.057851] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-15T18:25:30.626151] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:25:30.857881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-15T18:25:31.657879] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-15T18:25:31.877447] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:25:32.286363] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:25:32.457881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-15T18:25:33.257874] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-15T18:25:33.434787] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:25:33.437347] [INFO ] [REMOTE ] FCN: Full fetch complete (28420 records). [2025-09-15T18:25:33.437421] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-15T18:25:33.437952] [FATAL] [VALIDATOR ] FCN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:25:33.438029] [FATAL] [MAIN ] FCN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:25:33.438065] [WARN ] [MAIN ] FCN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:25:33.438102] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-15T18:25:33.438204] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-15T18:25:33.438242] [INFO ] [LOCAL ] FCN: Starting deletion of derivative data. [2025-09-15T18:25:33.438589] [DEBUG] [LOCAL ] FCN: Deleted derivative data file. [2025-09-15T18:25:33.438685] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCN took 25.5s. Estimated remaining: 2h 44m 52s. Rate: 9.5 symbols/min [2025-09-15T18:25:33.609100] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:33.648970] [DEBUG] [LOCAL ] FCX: Loaded 40442 existing records from primary storage. [2025-09-15T18:25:33.649149] [INFO ] [MAIN ] FCX: Loaded 40442 existing records. [2025-09-15T18:25:33.823752] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:33.823973] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-15T18:25:33.824018] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-15T18:25:33.824920] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-15T18:25:33.824971] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-15T18:25:33.991318] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T18:25:34.068232] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-15T18:25:34.202554] [INFO ] [REMOTE ] FCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:34.457090] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T18:25:34.857871] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-15T18:25:35.657955] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-15T18:25:36.057607] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:25:36.062293] [INFO ] [REMOTE ] FCPT: Full fetch complete (40826 records). [2025-09-15T18:25:36.062459] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-15T18:25:36.439898] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-15T18:25:36.439979] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-15T18:25:36.440606] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-15T18:25:36.440671] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-15T18:25:36.441612] [DEBUG] [LOCAL ] FCPT: Trimmed 40826 records to 26579 (keeping 150 days of data) [2025-09-15T18:25:36.493352] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-15T18:25:36.603100] [DEBUG] [LOCAL ] FCPT: Primary data saved (26579 records). [2025-09-15T18:25:36.603235] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-15T18:25:36.603318] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCPT took 26.6s. Estimated remaining: 2h 44m 40s. Rate: 9.5 symbols/min [2025-09-15T18:25:36.778841] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:36.801544] [DEBUG] [LOCAL ] FDP: Loaded 22780 existing records from primary storage. [2025-09-15T18:25:36.801716] [INFO ] [MAIN ] FDP: Loaded 22780 existing records. [2025-09-15T18:25:36.990755] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:36.991139] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-15T18:25:36.991197] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-15T18:25:36.992073] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-15T18:25:36.992128] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-15T18:25:37.149609] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:25:37.263945] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-15T18:25:37.364405] [INFO ] [REMOTE ] FDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:37.430041] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:25:37.555989] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-15T18:25:38.057886] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-15T18:25:38.857899] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-15T18:25:39.318228] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:25:39.657905] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-15T18:25:39.685552] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T18:25:39.920531] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-15T18:25:40.457946] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-15T18:25:41.257954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-15T18:25:41.617544] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T18:25:41.618382] [INFO ] [REMOTE ] FCRX: Full fetch complete (1254 records). [2025-09-15T18:25:41.618451] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-15T18:25:41.795828] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-15T18:25:41.796021] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:25:41.796063] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:25:41.796122] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-15T18:25:41.796181] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-15T18:25:41.796217] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-15T18:25:41.796256] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-15T18:25:41.796327] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCRX took 20.8s. Estimated remaining: 2h 44m 31s. Rate: 9.5 symbols/min [2025-09-15T18:25:41.977103] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:41.995046] [DEBUG] [LOCAL ] FDS: Loaded 18399 existing records from primary storage. [2025-09-15T18:25:41.995173] [INFO ] [MAIN ] FDS: Loaded 18399 existing records. [2025-09-15T18:25:42.063006] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-15T18:25:42.179996] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:42.180276] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-15T18:25:42.180327] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-15T18:25:42.180888] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-15T18:25:42.180941] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-15T18:25:42.544472] [INFO ] [REMOTE ] FDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:42.581554] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-15T18:25:42.857879] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-15T18:25:43.085489] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:25:43.657920] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-15T18:25:44.457865] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-15T18:25:44.488433] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T18:25:44.536742] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T18:25:45.257883] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-15T18:25:45.405438] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:25:46.057872] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-15T18:25:46.081888] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:25:46.596886] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T18:25:46.857893] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-15T18:25:47.657919] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-15T18:25:47.806489] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:25:47.809455] [INFO ] [REMOTE ] FCT: Full fetch complete (15475 records). [2025-09-15T18:25:47.809545] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-15T18:25:48.192556] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-15T18:25:48.192659] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-15T18:25:48.193028] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-15T18:25:48.193071] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-15T18:25:48.193618] [DEBUG] [LOCAL ] FCT: Trimmed 15475 records to 10373 (keeping 150 days of data) [2025-09-15T18:25:48.256790] [DEBUG] [LOCAL ] FCT: Primary data saved (10373 records). [2025-09-15T18:25:48.256930] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-15T18:25:48.257038] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCT took 19.2s. Estimated remaining: 2h 44m 25s. Rate: 9.5 symbols/min [2025-09-15T18:25:48.426406] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:48.463441] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-15T18:25:48.466286] [DEBUG] [LOCAL ] FDX: Loaded 38650 existing records from primary storage. [2025-09-15T18:25:48.466486] [INFO ] [MAIN ] FDX: Loaded 38650 existing records. [2025-09-15T18:25:48.650443] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:48.650830] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-15T18:25:48.650987] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-15T18:25:48.652132] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-15T18:25:48.652190] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-15T18:25:48.816537] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:25:49.045273] [INFO ] [REMOTE ] FDX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:49.257928] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-15T18:25:50.057913] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-15T18:25:50.454801] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:25:50.857890] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-15T18:25:51.072492] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:25:51.386855] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T18:25:51.657904] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-15T18:25:52.401481] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:25:52.457884] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-15T18:25:52.967205] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:25:53.257877] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-15T18:25:54.057900] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-15T18:25:54.515085] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:25:54.545344] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:25:54.857887] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-15T18:25:55.310430] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T18:25:55.657874] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-15T18:25:56.457955] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-15T18:25:56.560892] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:25:56.583154] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:25:57.257892] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-15T18:25:57.696963] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:25:58.057890] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-15T18:25:58.144975] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T18:25:58.857839] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-15T18:25:59.326138] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:25:59.657890] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-15T18:26:00.457831] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-15T18:26:00.872718] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:26:00.933606] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:26:01.257919] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-15T18:26:02.057899] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-15T18:26:02.493757] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:26:02.681746] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T18:26:02.857868] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-15T18:26:03.171726] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:26:03.175264] [INFO ] [REMOTE ] FDS: Full fetch complete (27027 records). [2025-09-15T18:26:03.175340] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-15T18:26:03.582755] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-15T18:26:03.582872] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-15T18:26:03.583607] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-15T18:26:03.583681] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-15T18:26:03.584783] [DEBUG] [LOCAL ] FDS: Trimmed 27027 records to 18187 (keeping 150 days of data) [2025-09-15T18:26:03.671160] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-15T18:26:03.708008] [DEBUG] [LOCAL ] FDS: Primary data saved (18187 records). [2025-09-15T18:26:03.708227] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-15T18:26:03.708353] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FDS took 21.9s. Estimated remaining: 2h 44m 36s. Rate: 9.5 symbols/min [2025-09-15T18:26:03.883047] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:03.920081] [DEBUG] [LOCAL ] FE: Loaded 40224 existing records from primary storage. [2025-09-15T18:26:03.920252] [INFO ] [MAIN ] FE: Loaded 40224 existing records. [2025-09-15T18:26:04.101629] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:04.102008] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-15T18:26:04.102073] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-15T18:26:04.108737] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-15T18:26:04.108957] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-15T18:26:04.145397] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:26:04.219599] [INFO ] [REMOTE ] FDP: Full fetch complete (32961 records). [2025-09-15T18:26:04.243707] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-15T18:26:04.257375] [FATAL] [VALIDATOR ] FDP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:04.272780] [FATAL] [MAIN ] FDP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:04.286990] [WARN ] [MAIN ] FDP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:04.330393] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-15T18:26:04.400691] [DEBUG] [LOCAL ] FDP: No primary data file found to delete. [2025-09-15T18:26:04.427911] [INFO ] [LOCAL ] FDP: Starting deletion of derivative data. [2025-09-15T18:26:04.428319] [DEBUG] [LOCAL ] FDP: Deleted derivative data file. [2025-09-15T18:26:04.433757] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FDP took 27.8s. Estimated remaining: 2h 44m 19s. Rate: 9.5 symbols/min [2025-09-15T18:26:04.492887] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-15T18:26:04.540704] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:04.676164] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:04.676356] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-15T18:26:04.676393] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-15T18:26:04.676516] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-15T18:26:04.676554] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-15T18:26:04.676594] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-15T18:26:04.676626] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-15T18:26:05.032946] [INFO ] [REMOTE ] FENG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:05.257882] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-15T18:26:05.492285] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:26:05.497914] [INFO ] [REMOTE ] FCX: Full fetch complete (57989 records). [2025-09-15T18:26:05.498038] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-15T18:26:05.498883] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:05.498982] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:05.499020] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:05.499059] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-15T18:26:05.499117] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-09-15T18:26:05.499152] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-09-15T18:26:05.499350] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-09-15T18:26:05.500624] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FCX took 32.1s. Estimated remaining: 2h 44m 3s. Rate: 9.5 symbols/min [2025-09-15T18:26:05.679028] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:05.722845] [DEBUG] [LOCAL ] FERG: Loaded 36237 existing records from primary storage. [2025-09-15T18:26:05.722987] [INFO ] [MAIN ] FERG: Loaded 36237 existing records. [2025-09-15T18:26:05.829251] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:26:05.908381] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:05.908666] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-15T18:26:05.908716] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-15T18:26:05.909454] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-15T18:26:05.909502] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-15T18:26:06.062755] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-15T18:26:06.297060] [INFO ] [REMOTE ] FERG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:06.680373] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T18:26:06.857883] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-15T18:26:07.657875] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-15T18:26:07.773890] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:26:08.457881] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-15T18:26:08.731402] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T18:26:08.815522] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:26:08.869865] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:26:09.257894] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-15T18:26:10.057874] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-15T18:26:10.857876] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-15T18:26:11.071876] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:26:11.443453] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:26:11.657891] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-15T18:26:11.845146] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-15T18:26:11.972719] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:26:12.457912] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-15T18:26:13.257881] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-15T18:26:14.023145] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:26:14.057814] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-15T18:26:14.857903] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-15T18:26:15.142133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:26:15.657871] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-15T18:26:16.007812] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T18:26:16.113529] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:26:16.457889] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-15T18:26:16.729591] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:26:17.257918] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-15T18:26:17.586010] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T18:26:18.057866] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-15T18:26:18.133813] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:26:18.343327] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T18:26:18.857944] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-15T18:26:19.300544] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:26:19.301419] [INFO ] [REMOTE ] FENG: Full fetch complete (1662 records). [2025-09-15T18:26:19.301486] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-15T18:26:19.301887] [FATAL] [VALIDATOR ] FENG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:19.301978] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:19.302031] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:19.302075] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-15T18:26:19.302131] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-15T18:26:19.302166] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-15T18:26:19.302204] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-15T18:26:19.302256] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FENG took 14.9s. Estimated remaining: 2h 44m 11s. Rate: 9.5 symbols/min [2025-09-15T18:26:19.474788] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:19.484348] [DEBUG] [LOCAL ] FET: Loaded 9010 existing records from primary storage. [2025-09-15T18:26:19.484443] [INFO ] [MAIN ] FET: Loaded 9010 existing records. [2025-09-15T18:26:19.661898] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-15T18:26:19.687186] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:19.688199] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-15T18:26:19.688255] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-15T18:26:19.688594] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-15T18:26:19.688700] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-15T18:26:20.049000] [INFO ] [REMOTE ] FET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:20.457881] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-15T18:26:20.949811] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T18:26:21.115323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:26:21.257871] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-15T18:26:22.057883] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-15T18:26:22.674831] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:26:22.857886] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-15T18:26:22.963007] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:26:23.657910] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-15T18:26:24.395173] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:26:24.457905] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-15T18:26:25.257871] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-15T18:26:25.406241] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:26:25.425688] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:26:25.431415] [INFO ] [REMOTE ] FDX: Full fetch complete (55829 records). [2025-09-15T18:26:25.431520] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-15T18:26:25.806256] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-15T18:26:25.806352] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-15T18:26:25.807104] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-15T18:26:25.807150] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-15T18:26:25.808421] [DEBUG] [LOCAL ] FDX: Trimmed 55829 records to 37922 (keeping 150 days of data) [2025-09-15T18:26:26.059684] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-15T18:26:26.059586] [DEBUG] [LOCAL ] FDX: Primary data saved (37922 records). [2025-09-15T18:26:26.060623] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-15T18:26:26.061771] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 37.8s. Estimated remaining: 2h 44m 5s. Rate: 9.5 symbols/min [2025-09-15T18:26:26.241624] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:26.263580] [DEBUG] [LOCAL ] FF: Loaded 18158 existing records from primary storage. [2025-09-15T18:26:26.263771] [INFO ] [MAIN ] FF: Loaded 18158 existing records. [2025-09-15T18:26:26.443850] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:26.444150] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-15T18:26:26.444208] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-15T18:26:26.444746] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-15T18:26:26.444806] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-15T18:26:26.817261] [INFO ] [REMOTE ] FF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:26.857815] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-15T18:26:26.865625] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T18:26:27.316234] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T18:26:27.657883] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-15T18:26:27.915697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T18:26:28.457871] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-15T18:26:29.095956] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:26:29.247463] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T18:26:29.257813] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-15T18:26:29.824762] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:26:30.057869] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-15T18:26:30.857928] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-15T18:26:31.553070] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:26:31.657859] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-15T18:26:32.457847] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-15T18:26:32.569935] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T18:26:32.735929] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:26:33.210167] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:26:33.257869] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-15T18:26:34.057870] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-15T18:26:34.196707] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:26:34.857864] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-15T18:26:35.571740] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:26:35.657843] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-15T18:26:36.457886] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-15T18:26:36.516627] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:26:36.524435] [INFO ] [REMOTE ] FE: Full fetch complete (58099 records). [2025-09-15T18:26:36.524555] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-15T18:26:36.910896] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-15T18:26:36.910993] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-15T18:26:36.911764] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-15T18:26:36.911832] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-15T18:26:36.913135] [DEBUG] [LOCAL ] FE: Trimmed 58099 records to 39450 (keeping 150 days of data) [2025-09-15T18:26:37.185069] [DEBUG] [LOCAL ] FE: Primary data saved (39450 records). [2025-09-15T18:26:37.185261] [INFO ] [MAIN ] FE: Full history saved. [2025-09-15T18:26:37.185408] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FE took 33.5s. Estimated remaining: 2h 44m 8s. Rate: 9.4 symbols/min [2025-09-15T18:26:37.262931] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-15T18:26:37.365630] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:37.382796] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T18:26:37.390969] [DEBUG] [LOCAL ] FFA: Loaded 3498 existing records from primary storage. [2025-09-15T18:26:37.391110] [INFO ] [MAIN ] FFA: Loaded 3498 existing records. [2025-09-15T18:26:37.433559] [INFO ] [REMOTE ] FERG: Full fetch complete (52822 records). [2025-09-15T18:26:37.465364] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-15T18:26:37.494468] [FATAL] [VALIDATOR ] FERG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:37.494639] [FATAL] [MAIN ] FERG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:37.494961] [WARN ] [MAIN ] FERG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:37.505480] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-15T18:26:37.515772] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-15T18:26:37.520946] [INFO ] [LOCAL ] FERG: Starting deletion of derivative data. [2025-09-15T18:26:37.550411] [DEBUG] [LOCAL ] FERG: Deleted derivative data file. [2025-09-15T18:26:37.553625] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FERG took 32.1s. Estimated remaining: 2h 43m 50s. Rate: 9.5 symbols/min [2025-09-15T18:26:37.573793] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:37.630698] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-15T18:26:37.644826] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-15T18:26:37.686633] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:26:37.686383] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-15T18:26:37.697186] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-15T18:26:37.709680] [INFO ] [REMOTE ] FET: Full fetch complete (13581 records). [2025-09-15T18:26:37.797139] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:37.804047] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-15T18:26:38.007591] [DEBUG] [LOCAL ] FFC: Loaded 12077 existing records from primary storage. [2025-09-15T18:26:38.012921] [INFO ] [MAIN ] FFC: Loaded 12077 existing records. [2025-09-15T18:26:38.673830] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:38.724781] [INFO ] [REMOTE ] FFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:38.728637] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-15T18:26:38.729191] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-15T18:26:38.729083] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-15T18:26:38.729614] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-15T18:26:38.729462] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-15T18:26:38.730067] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-15T18:26:38.731271] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-15T18:26:38.731351] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-15T18:26:38.742824] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-15T18:26:38.801879] [DEBUG] [LOCAL ] FET: Trimmed 13581 records to 8868 (keeping 150 days of data) [2025-09-15T18:26:38.919443] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:26:39.027140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-15T18:26:39.179841] [INFO ] [REMOTE ] FFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:39.184382] [DEBUG] [LOCAL ] FET: Primary data saved (8868 records). [2025-09-15T18:26:39.184877] [INFO ] [MAIN ] FET: Full history saved. [2025-09-15T18:26:39.185004] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 19.9s. Estimated remaining: 2h 43m 35s. Rate: 9.5 symbols/min [2025-09-15T18:26:39.358296] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:39.384945] [DEBUG] [LOCAL ] FFWM: Loaded 26759 existing records from primary storage. [2025-09-15T18:26:39.385088] [INFO ] [MAIN ] FFWM: Loaded 26759 existing records. [2025-09-15T18:26:39.500034] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:26:39.565550] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:39.565831] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-15T18:26:39.565879] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-15T18:26:39.566502] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-15T18:26:39.566553] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-15T18:26:39.664955] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-15T18:26:39.927575] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:39.966577] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:26:40.409597] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:26:40.457892] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-15T18:26:41.257956] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-15T18:26:41.583129] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:26:41.942918] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:26:42.057906] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-15T18:26:42.857886] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-15T18:26:43.120090] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:26:43.123041] [INFO ] [REMOTE ] FF: Full fetch complete (28119 records). [2025-09-15T18:26:43.123122] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-15T18:26:43.493320] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-15T18:26:43.493401] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-15T18:26:43.493939] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-15T18:26:43.493983] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-15T18:26:43.494678] [DEBUG] [LOCAL ] FF: Trimmed 28119 records to 17610 (keeping 150 days of data) [2025-09-15T18:26:43.601246] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T18:26:43.620414] [DEBUG] [LOCAL ] FF: Primary data saved (17610 records). [2025-09-15T18:26:43.620547] [INFO ] [MAIN ] FF: Full history saved. [2025-09-15T18:26:43.620663] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FF took 17.6s. Estimated remaining: 2h 43m 25s. Rate: 9.5 symbols/min [2025-09-15T18:26:43.663041] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-15T18:26:43.791667] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:43.807949] [DEBUG] [LOCAL ] FG: Loaded 15506 existing records from primary storage. [2025-09-15T18:26:43.808073] [INFO ] [MAIN ] FG: Loaded 15506 existing records. [2025-09-15T18:26:43.988738] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:43.989110] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-15T18:26:43.989173] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-15T18:26:43.989667] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-15T18:26:43.989721] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-15T18:26:44.347458] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:44.457917] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-15T18:26:45.096312] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:26:45.257866] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-15T18:26:45.267868] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:26:46.057892] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-15T18:26:46.622081] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:26:46.635349] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T18:26:46.857927] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-15T18:26:47.657901] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-15T18:26:48.309969] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:26:48.430800] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:26:48.457911] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-15T18:26:49.257920] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-15T18:26:49.773509] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:26:50.057840] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-15T18:26:50.294565] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:26:50.857889] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-15T18:26:50.993885] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:26:51.657862] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-15T18:26:52.064950] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:26:52.340945] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:26:52.457874] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-15T18:26:53.257883] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-15T18:26:53.522206] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:26:53.800393] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T18:26:54.057886] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-15T18:26:54.857854] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-15T18:26:55.283406] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:26:55.449963] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:26:55.657925] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-15T18:26:56.457921] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-15T18:26:56.876952] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:26:57.257910] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-15T18:26:57.570048] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:26:58.057898] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-15T18:26:58.655417] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:26:58.802707] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:26:58.857818] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-15T18:26:59.657898] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-15T18:26:59.842445] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:27:00.457958] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-15T18:27:00.898444] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:27:00.902359] [INFO ] [REMOTE ] FFWM: Full fetch complete (39468 records). [2025-09-15T18:27:00.902470] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-15T18:27:00.998214] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T18:27:01.011347] [INFO ] [REMOTE ] FFA: Full fetch complete (5990 records). [2025-09-15T18:27:01.027829] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-15T18:27:01.264098] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-15T18:27:01.641045] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-15T18:27:01.652860] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-15T18:27:01.662018] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-15T18:27:01.664846] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-15T18:27:01.721760] [DEBUG] [LOCAL ] FFWM: Trimmed 39468 records to 26071 (keeping 150 days of data) [2025-09-15T18:27:01.748281] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-15T18:27:01.748382] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-15T18:27:01.748497] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-15T18:27:01.803582] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-15T18:27:01.837497] [DEBUG] [LOCAL ] FFA: Trimmed 5990 records to 3377 (keeping 150 days of data) [2025-09-15T18:27:01.877389] [DEBUG] [LOCAL ] FFA: Primary data saved (3377 records). [2025-09-15T18:27:01.883454] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-15T18:27:01.885769] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FFA took 24.7s. Estimated remaining: 2h 43m 41s. Rate: 9.5 symbols/min [2025-09-15T18:27:02.062149] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-15T18:27:02.111790] [DEBUG] [LOCAL ] FFWM: Primary data saved (26071 records). [2025-09-15T18:27:02.113131] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:02.113337] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-15T18:27:02.113479] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFWM took 22.9s. Estimated remaining: 2h 43m 23s. Rate: 9.5 symbols/min [2025-09-15T18:27:02.220342] [DEBUG] [LOCAL ] FGN: Loaded 2766 existing records from primary storage. [2025-09-15T18:27:02.220530] [INFO ] [MAIN ] FGN: Loaded 2766 existing records. [2025-09-15T18:27:02.415872] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:02.474599] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:02.475010] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-15T18:27:02.475096] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-15T18:27:02.477795] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-15T18:27:02.478001] [DEBUG] [LOCAL ] FGSN: Loaded 3585 existing records from primary storage. [2025-09-15T18:27:02.478068] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-15T18:27:02.478235] [INFO ] [MAIN ] FGSN: Loaded 3585 existing records. [2025-09-15T18:27:02.875301] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:02.937111] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-15T18:27:02.947451] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-15T18:27:02.958537] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-15T18:27:02.968914] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-15T18:27:03.070946] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:03.081866] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-15T18:27:03.349273] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T18:27:03.431898] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:03.657871] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-15T18:27:04.182062] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-15T18:27:04.457879] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-15T18:27:04.790398] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:27:04.864539] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T18:27:05.257879] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-15T18:27:05.719979] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:27:05.722415] [INFO ] [REMOTE ] FG: Full fetch complete (23156 records). [2025-09-15T18:27:05.722491] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-15T18:27:05.852605] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:27:06.063036] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-15T18:27:06.111876] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-15T18:27:06.111974] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-15T18:27:06.112528] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-15T18:27:06.112574] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-15T18:27:06.114026] [DEBUG] [LOCAL ] FG: Trimmed 23156 records to 15163 (keeping 150 days of data) [2025-09-15T18:27:06.207362] [DEBUG] [LOCAL ] FG: Primary data saved (15163 records). [2025-09-15T18:27:06.207522] [INFO ] [MAIN ] FG: Full history saved. [2025-09-15T18:27:06.207615] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 22.6s. Estimated remaining: 2h 43m 13s. Rate: 9.5 symbols/min [2025-09-15T18:27:06.381517] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:06.417024] [DEBUG] [LOCAL ] FHI: Loaded 30397 existing records from primary storage. [2025-09-15T18:27:06.417202] [INFO ] [MAIN ] FHI: Loaded 30397 existing records. [2025-09-15T18:27:06.595450] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:06.595710] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-15T18:27:06.595779] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-15T18:27:06.596437] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-15T18:27:06.596485] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-15T18:27:06.863124] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-15T18:27:06.971624] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:07.136496] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:27:07.464057] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:27:07.657885] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-15T18:27:08.457885] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-15T18:27:08.609635] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:27:08.972351] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:27:09.257877] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-15T18:27:09.792274] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:27:10.057871] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-15T18:27:10.431235] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T18:27:10.857905] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-15T18:27:11.657908] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-15T18:27:11.771822] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:27:11.773872] [INFO ] [REMOTE ] FFC: Full fetch complete (18073 records). [2025-09-15T18:27:11.773947] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-15T18:27:12.152483] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-15T18:27:12.152592] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-15T18:27:12.153227] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-15T18:27:12.153275] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-15T18:27:12.154045] [DEBUG] [LOCAL ] FFC: Trimmed 18073 records to 11958 (keeping 150 days of data) [2025-09-15T18:27:12.228803] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:27:12.251581] [DEBUG] [LOCAL ] FFC: Primary data saved (11958 records). [2025-09-15T18:27:12.251842] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-15T18:27:12.251976] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FFC took 34.7s. Estimated remaining: 2h 43m 6s. Rate: 9.5 symbols/min [2025-09-15T18:27:12.429374] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:12.463843] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-15T18:27:12.481660] [DEBUG] [LOCAL ] FHN: Loaded 40144 existing records from primary storage. [2025-09-15T18:27:12.481807] [INFO ] [MAIN ] FHN: Loaded 40144 existing records. [2025-09-15T18:27:12.660853] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:12.661132] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-15T18:27:12.661181] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-15T18:27:12.662135] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-15T18:27:12.662188] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-15T18:27:13.012049] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:13.051656] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:27:13.257880] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-15T18:27:14.057892] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-15T18:27:14.353665] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:27:14.354885] [INFO ] [REMOTE ] FGSN: Full fetch complete (5558 records). [2025-09-15T18:27:14.354957] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-15T18:27:14.705724] [DEBUG] [VALIDATOR ] FGSN: All expected trading days are present. [2025-09-15T18:27:14.705805] [DEBUG] [VALIDATOR ] FGSN: Primary data validation passed. [2025-09-15T18:27:14.705980] [INFO ] [MAIN ] FGSN: Fetched primary data is valid. [2025-09-15T18:27:14.706019] [DEBUG] [LOCAL ] FGSN: Saving primary data. [2025-09-15T18:27:14.706403] [DEBUG] [LOCAL ] FGSN: Trimmed 5558 records to 3496 (keeping 150 days of data) [2025-09-15T18:27:14.727840] [DEBUG] [LOCAL ] FGSN: Primary data saved (3496 records). [2025-09-15T18:27:14.727934] [INFO ] [MAIN ] FGSN: Full history saved. [2025-09-15T18:27:14.728017] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FGSN took 12.6s. Estimated remaining: 2h 42m 52s. Rate: 9.5 symbols/min [2025-09-15T18:27:14.866416] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-15T18:27:14.899205] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:14.943088] [DEBUG] [LOCAL ] FI: Loaded 40371 existing records from primary storage. [2025-09-15T18:27:14.943263] [INFO ] [MAIN ] FI: Loaded 40371 existing records. [2025-09-15T18:27:15.119234] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:15.119508] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-15T18:27:15.119576] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-15T18:27:15.120498] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-15T18:27:15.120561] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-15T18:27:15.465783] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:15.550695] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:27:15.657859] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-15T18:27:15.980627] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:27:16.457896] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-15T18:27:17.257952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-15T18:27:17.336006] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:27:18.058768] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-15T18:27:18.058690] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:27:18.535446] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:27:18.857881] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-15T18:27:19.453131] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:27:19.657887] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-15T18:27:20.003299] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:27:20.457887] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-15T18:27:21.257861] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-15T18:27:21.429659] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:27:21.523250] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:27:21.714581] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:27:22.057870] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-15T18:27:22.857876] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-15T18:27:23.481005] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:27:23.513243] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:27:23.657868] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-15T18:27:24.457906] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-15T18:27:25.262979] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-15T18:27:25.280921] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:27:25.698962] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:27:26.057879] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-15T18:27:26.300191] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:27:26.387029] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T18:27:26.857872] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-15T18:27:27.657894] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-15T18:27:28.149908] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:27:28.457916] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-15T18:27:29.124193] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:27:29.257870] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-15T18:27:30.057853] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-15T18:27:30.120381] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:27:30.575460] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:27:30.576406] [INFO ] [REMOTE ] FGN: Full fetch complete (4350 records). [2025-09-15T18:27:30.576473] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-15T18:27:30.863051] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-15T18:27:30.931445] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-15T18:27:30.931620] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-15T18:27:30.931814] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-15T18:27:30.931866] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-15T18:27:30.932396] [DEBUG] [LOCAL ] FGN: Trimmed 4350 records to 2723 (keeping 150 days of data) [2025-09-15T18:27:30.953767] [DEBUG] [LOCAL ] FGN: Primary data saved (2723 records). [2025-09-15T18:27:30.953872] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-15T18:27:30.953955] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FGN took 29.1s. Estimated remaining: 2h 43m 5s. Rate: 9.5 symbols/min [2025-09-15T18:27:31.126733] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:31.165506] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T18:27:31.193469] [DEBUG] [LOCAL ] FICO: Loaded 16252 existing records from primary storage. [2025-09-15T18:27:31.193672] [INFO ] [MAIN ] FICO: Loaded 16252 existing records. [2025-09-15T18:27:31.374632] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:31.374913] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-15T18:27:31.374960] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-15T18:27:31.375487] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-15T18:27:31.375535] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-15T18:27:31.663011] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-15T18:27:31.722575] [INFO ] [REMOTE ] FICO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:32.329174] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:27:32.457883] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-15T18:27:33.257872] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-15T18:27:33.516772] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:27:33.555045] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:27:34.057869] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-15T18:27:34.857882] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-15T18:27:35.384100] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T18:27:35.657928] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-15T18:27:35.735588] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:27:35.959951] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:27:36.457878] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-15T18:27:37.158038] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:27:37.257856] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-15T18:27:37.616140] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T18:27:38.057928] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-15T18:27:38.457937] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:27:38.857889] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-15T18:27:39.412805] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:27:39.418577] [INFO ] [REMOTE ] FHN: Full fetch complete (58019 records). [2025-09-15T18:27:39.418707] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-15T18:27:39.664557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-15T18:27:39.804930] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-15T18:27:39.805010] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-15T18:27:39.805894] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-15T18:27:39.805940] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-15T18:27:39.807101] [DEBUG] [LOCAL ] FHN: Trimmed 58019 records to 39364 (keeping 150 days of data) [2025-09-15T18:27:40.056480] [DEBUG] [LOCAL ] FHN: Primary data saved (39364 records). [2025-09-15T18:27:40.056625] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-15T18:27:40.057669] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FHN took 27.8s. Estimated remaining: 2h 43m 3s. Rate: 9.5 symbols/min [2025-09-15T18:27:40.239122] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:40.240202] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-15T18:27:40.240097] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:27:40.240279] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-15T18:27:40.244454] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-15T18:27:40.244514] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-15T18:27:40.244566] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-15T18:27:40.244607] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-15T18:27:40.249902] [INFO ] [REMOTE ] FHI: Full fetch complete (43909 records). [2025-09-15T18:27:40.282412] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-15T18:27:40.461773] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-15T18:27:41.030554] [INFO ] [REMOTE ] FIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:41.046114] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-15T18:27:41.046178] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-15T18:27:41.047055] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-15T18:27:41.047102] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-15T18:27:41.048113] [DEBUG] [LOCAL ] FHI: Trimmed 43909 records to 29782 (keeping 150 days of data) [2025-09-15T18:27:41.233804] [DEBUG] [LOCAL ] FHI: Primary data saved (29782 records). [2025-09-15T18:27:41.233960] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-15T18:27:41.234069] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHI took 35.0s. Estimated remaining: 2h 42m 47s. Rate: 9.5 symbols/min [2025-09-15T18:27:41.267771] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-15T18:27:41.415193] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:41.450139] [DEBUG] [LOCAL ] FIGS: Loaded 36665 existing records from primary storage. [2025-09-15T18:27:41.450314] [INFO ] [MAIN ] FIGS: Loaded 36665 existing records. [2025-09-15T18:27:41.636555] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:41.636925] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-15T18:27:41.637047] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-15T18:27:41.637774] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-15T18:27:41.637824] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-15T18:27:41.757629] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T18:27:41.781533] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-15T18:27:41.856457] [INFO ] [REMOTE ] FI: Full fetch complete (58125 records). [2025-09-15T18:27:41.876017] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-15T18:27:42.127868] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:42.107149] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-15T18:27:42.215308] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T18:27:42.423661] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-15T18:27:42.423741] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-15T18:27:42.424512] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-15T18:27:42.424554] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-15T18:27:42.425799] [DEBUG] [LOCAL ] FI: Trimmed 58125 records to 39603 (keeping 150 days of data) [2025-09-15T18:27:42.525241] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T18:27:42.685904] [DEBUG] [LOCAL ] FI: Primary data saved (39603 records). [2025-09-15T18:27:42.686106] [INFO ] [MAIN ] FI: Full history saved. [2025-09-15T18:27:42.686773] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FI took 28.0s. Estimated remaining: 2h 42m 32s. Rate: 9.5 symbols/min [2025-09-15T18:27:42.855591] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:42.857899] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-15T18:27:42.887879] [DEBUG] [LOCAL ] FIHL: Loaded 29260 existing records from primary storage. [2025-09-15T18:27:42.888042] [INFO ] [MAIN ] FIHL: Loaded 29260 existing records. [2025-09-15T18:27:43.061681] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:43.061928] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-15T18:27:43.061975] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-15T18:27:43.062667] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-15T18:27:43.062718] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-15T18:27:43.412827] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:43.657899] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-15T18:27:43.968815] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T18:27:43.985142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-15T18:27:44.457888] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-15T18:27:45.257922] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-15T18:27:45.788871] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:27:46.057924] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-15T18:27:46.815878] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:27:46.857812] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-15T18:27:47.620000] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:27:47.657845] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-15T18:27:48.082485] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:27:48.457937] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-15T18:27:48.821857] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:27:49.257937] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-15T18:27:49.565295] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:27:49.855861] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:27:50.057873] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-15T18:27:50.159957] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-15T18:27:50.160243] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-15T18:27:50.857897] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-15T18:27:51.657877] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-15T18:27:51.996759] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:27:52.260968] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:27:52.457935] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-15T18:27:53.257908] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-15T18:27:53.681261] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:27:54.057871] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-15T18:27:54.633867] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:27:54.857920] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-15T18:27:55.454970] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:27:55.657868] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-15T18:27:56.136329] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:27:56.457869] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-15T18:27:57.205358] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:27:57.257888] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-15T18:27:57.818589] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:27:58.057906] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-15T18:27:58.865250] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-15T18:27:58.883786] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:27:59.203950] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:27:59.657889] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-15T18:28:00.457884] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-15T18:28:01.169089] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:28:01.257921] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-15T18:28:01.647901] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-15T18:28:02.057930] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-15T18:28:02.420704] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T18:28:02.423241] [INFO ] [REMOTE ] FICO: Full fetch complete (21761 records). [2025-09-15T18:28:02.423362] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-15T18:28:02.800546] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-15T18:28:02.800662] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-15T18:28:02.801171] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-15T18:28:02.801219] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-15T18:28:02.801869] [DEBUG] [LOCAL ] FICO: Trimmed 21761 records to 16098 (keeping 150 days of data) [2025-09-15T18:28:02.879432] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-15T18:28:02.901787] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:28:02.908443] [INFO ] [REMOTE ] FIHL: Full fetch complete (43764 records). [2025-09-15T18:28:02.909060] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-15T18:28:03.334795] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-15T18:28:03.338260] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-15T18:28:03.338212] [DEBUG] [LOCAL ] FICO: Primary data saved (16098 records). [2025-09-15T18:28:03.339097] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-15T18:28:03.339029] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-15T18:28:03.339269] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FICO took 32.4s. Estimated remaining: 2h 42m 52s. Rate: 9.4 symbols/min [2025-09-15T18:28:03.339177] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-15T18:28:03.441599] [DEBUG] [LOCAL ] FIHL: Trimmed 43764 records to 28558 (keeping 150 days of data) [2025-09-15T18:28:03.622099] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:03.644937] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:28:03.657374] [INFO ] [REMOTE ] FIGS: Full fetch complete (53264 records). [2025-09-15T18:28:03.658069] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-15T18:28:03.657663] [DEBUG] [LOCAL ] FINS: Loaded 6552 existing records from primary storage. [2025-09-15T18:28:03.659400] [INFO ] [MAIN ] FINS: Loaded 6552 existing records. [2025-09-15T18:28:04.040680] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:04.075576] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-15T18:28:04.075957] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-15T18:28:04.092497] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-15T18:28:04.099947] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-15T18:28:04.388256] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-15T18:28:04.408574] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-15T18:28:04.418497] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-15T18:28:04.441927] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-15T18:28:04.523188] [DEBUG] [LOCAL ] FIGS: Trimmed 53264 records to 36014 (keeping 150 days of data) [2025-09-15T18:28:04.754040] [INFO ] [REMOTE ] FINS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:04.757883] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-15T18:28:04.875980] [DEBUG] [LOCAL ] FIHL: Primary data saved (28558 records). [2025-09-15T18:28:04.876704] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-15T18:28:04.877140] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FIHL took 22.2s. Estimated remaining: 2h 42m 37s. Rate: 9.5 symbols/min [2025-09-15T18:28:05.071078] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:05.080825] [DEBUG] [LOCAL ] FIGS: Primary data saved (36014 records). [2025-09-15T18:28:05.080951] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-15T18:28:05.081067] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIGS took 23.8s. Estimated remaining: 2h 42m 19s. Rate: 9.5 symbols/min [2025-09-15T18:28:05.277783] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:05.279571] [DEBUG] [LOCAL ] FINV: Loaded 33673 existing records from primary storage. [2025-09-15T18:28:05.279747] [INFO ] [MAIN ] FINV: Loaded 33673 existing records. [2025-09-15T18:28:05.409731] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:28:05.441739] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-15T18:28:05.482924] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:05.483165] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-15T18:28:05.483212] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-15T18:28:05.483951] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-15T18:28:05.484005] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-15T18:28:05.612126] [DEBUG] [LOCAL ] FIS: Loaded 40130 existing records from primary storage. [2025-09-15T18:28:05.628253] [INFO ] [MAIN ] FIS: Loaded 40130 existing records. [2025-09-15T18:28:05.978261] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:05.979123] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-15T18:28:05.994703] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-15T18:28:06.036365] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-15T18:28:06.036531] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-15T18:28:06.066375] [INFO ] [REMOTE ] FINV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:06.117479] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-09-15T18:28:06.117949] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-15T18:28:06.155322] [INFO ] [REMOTE ] FIG: Full fetch complete (12562 records). [2025-09-15T18:28:06.190153] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-15T18:28:06.191081] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:28:06.193152] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-15T18:28:06.624103] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-15T18:28:06.650782] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:28:06.656156] [INFO ] [REMOTE ] FIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:06.656345] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:28:06.656713] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-15T18:28:06.656792] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-15T18:28:06.656833] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-15T18:28:06.656885] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-15T18:28:06.656960] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIG took 26.6s. Estimated remaining: 2h 42m 4s. Rate: 9.5 symbols/min [2025-09-15T18:28:06.835785] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:06.858097] [DEBUG] [LOCAL ] FIX: Loaded 21542 existing records from primary storage. [2025-09-15T18:28:06.858213] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-15T18:28:06.858532] [INFO ] [MAIN ] FIX: Loaded 21542 existing records. [2025-09-15T18:28:07.034500] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:07.034768] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-15T18:28:07.034847] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-15T18:28:07.035380] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-15T18:28:07.035427] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-15T18:28:07.224546] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:28:07.399449] [INFO ] [REMOTE ] FIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:07.657938] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-15T18:28:07.835958] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T18:28:08.457879] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-15T18:28:08.684170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:28:08.832947] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:28:09.257903] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-15T18:28:10.046381] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:28:10.063498] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-15T18:28:10.074902] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:28:10.837776] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:28:10.857866] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-15T18:28:11.657889] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-15T18:28:12.390862] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:28:12.457859] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-15T18:28:13.262948] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-15T18:28:13.277824] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:28:14.057880] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-15T18:28:14.317745] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T18:28:14.471664] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:28:14.857890] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-15T18:28:14.928882] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:28:15.657877] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-15T18:28:16.457860] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-15T18:28:16.686893] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:28:16.832775] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T18:28:17.254770] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:28:17.257818] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-15T18:28:17.792794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:28:17.794278] [INFO ] [REMOTE ] FINS: Full fetch complete (8851 records). [2025-09-15T18:28:17.794357] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-15T18:28:18.063093] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-15T18:28:18.164668] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-15T18:28:18.164768] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-15T18:28:18.165020] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-15T18:28:18.165061] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-15T18:28:18.165482] [DEBUG] [LOCAL ] FINS: Trimmed 8851 records to 6401 (keeping 150 days of data) [2025-09-15T18:28:18.205270] [DEBUG] [LOCAL ] FINS: Primary data saved (6401 records). [2025-09-15T18:28:18.205373] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-15T18:28:18.205487] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FINS took 14.9s. Estimated remaining: 2h 42m 7s. Rate: 9.5 symbols/min [2025-09-15T18:28:18.372811] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:18.372990] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-15T18:28:18.373030] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-15T18:28:18.373151] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-15T18:28:18.373189] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-15T18:28:18.373239] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-15T18:28:18.373288] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-15T18:28:18.734966] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:18.857932] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-15T18:28:19.377953] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:28:19.657928] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-15T18:28:20.290356] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:28:20.457882] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-15T18:28:21.008063] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:28:21.257875] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-15T18:28:21.763916] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:28:22.057873] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-15T18:28:22.250916] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:22.251237] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-15T18:28:22.315286] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:28:22.857880] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-15T18:28:23.093740] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:23.094062] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-15T18:28:23.657924] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-15T18:28:24.457984] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-15T18:28:24.687123] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:24.687580] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-15T18:28:24.987091] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:28:25.257881] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-15T18:28:26.057878] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-15T18:28:26.270470] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:26.270896] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-15T18:28:26.777248] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:28:26.857852] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-15T18:28:27.657939] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-15T18:28:28.119340] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:28:28.129923] [INFO ] [REMOTE ] FINV: Full fetch complete (48877 records). [2025-09-15T18:28:28.130169] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-15T18:28:28.463152] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-15T18:28:28.656617] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-15T18:28:28.656839] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-15T18:28:28.657838] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-15T18:28:28.657915] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-15T18:28:28.659461] [DEBUG] [LOCAL ] FINV: Trimmed 48877 records to 32958 (keeping 150 days of data) [2025-09-15T18:28:28.874026] [DEBUG] [LOCAL ] FINV: Primary data saved (32958 records). [2025-09-15T18:28:28.874217] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-15T18:28:28.875104] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINV took 24.0s. Estimated remaining: 2h 42m 9s. Rate: 9.5 symbols/min [2025-09-15T18:28:29.054222] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:29.064602] [DEBUG] [LOCAL ] FLC: Loaded 3956 existing records from primary storage. [2025-09-15T18:28:29.064858] [INFO ] [MAIN ] FLC: Loaded 3956 existing records. [2025-09-15T18:28:29.186841] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:28:29.269291] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-15T18:28:29.304036] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:29.258846] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:28:29.311065] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-15T18:28:29.311868] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-15T18:28:29.312566] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-15T18:28:29.312634] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-15T18:28:29.679670] [INFO ] [REMOTE ] FLC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:29.869447] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:28:30.057918] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-15T18:28:30.482309] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:28:30.857948] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-15T18:28:31.583387] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:28:31.584554] [INFO ] [REMOTE ] FIXT: Full fetch complete (1634 records). [2025-09-15T18:28:31.584634] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-15T18:28:31.663061] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-15T18:28:31.775939] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 63 unique days, need 150 days [2025-09-15T18:28:31.776151] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:28:31.776203] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:28:31.776252] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-15T18:28:31.776316] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-15T18:28:31.776370] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-15T18:28:31.776415] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-15T18:28:31.776479] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 13.6s. Estimated remaining: 2h 41m 56s. Rate: 9.5 symbols/min [2025-09-15T18:28:32.457881] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-15T18:28:32.793770] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:28:33.257884] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-15T18:28:33.953445] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:28:34.057860] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-15T18:28:34.400635] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:28:34.551790] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T18:28:34.857895] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-15T18:28:35.324824] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:28:35.657932] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-15T18:28:36.457879] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-15T18:28:37.257925] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-15T18:28:37.448310] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T18:28:37.834169] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:28:37.841129] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T18:28:37.843024] [INFO ] [REMOTE ] FIX: Full fetch complete (34782 records). [2025-09-15T18:28:37.843341] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-15T18:28:38.066960] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-15T18:28:38.228669] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-15T18:28:38.228754] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-15T18:28:38.229388] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-15T18:28:38.229431] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-15T18:28:38.230367] [DEBUG] [LOCAL ] FIX: Trimmed 34782 records to 21071 (keeping 150 days of data) [2025-09-15T18:28:38.375762] [DEBUG] [LOCAL ] FIX: Primary data saved (21071 records). [2025-09-15T18:28:38.375898] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-15T18:28:38.375987] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FIX took 31.7s. Estimated remaining: 2h 41m 50s. Rate: 9.5 symbols/min [2025-09-15T18:28:38.776628] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:28:38.857872] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-15T18:28:39.211524] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:28:39.657897] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-15T18:28:40.457954] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-15T18:28:40.873476] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:28:41.257878] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-15T18:28:41.437374] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T18:28:41.443513] [INFO ] [REMOTE ] FIS: Full fetch complete (58053 records). [2025-09-15T18:28:41.443707] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-15T18:28:41.753672] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T18:28:41.790052] [INFO ] [REMOTE ] FLC: Full fetch complete (6105 records). [2025-09-15T18:28:41.808046] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-15T18:28:41.929772] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-15T18:28:41.952690] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-15T18:28:41.953827] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-15T18:28:41.954181] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-15T18:28:42.080079] [DEBUG] [LOCAL ] FIS: Trimmed 58053 records to 39350 (keeping 150 days of data) [2025-09-15T18:28:42.319176] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-15T18:28:42.319521] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-15T18:28:42.320076] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-15T18:28:42.320341] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-15T18:28:42.322022] [DEBUG] [LOCAL ] FLC: Trimmed 6105 records to 3882 (keeping 150 days of data) [2025-09-15T18:28:42.350628] [DEBUG] [LOCAL ] FLC: Primary data saved (3882 records). [2025-09-15T18:28:42.351514] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-15T18:28:42.351963] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FLC took 13.5s. Estimated remaining: 2h 41m 40s. Rate: 9.5 symbols/min [2025-09-15T18:28:42.507834] [DEBUG] [LOCAL ] FIS: Primary data saved (39350 records). [2025-09-15T18:28:42.507996] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-15T18:28:42.508511] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 37.4s. Estimated remaining: 2h 41m 22s. Rate: 9.5 symbols/min [2025-09-15T18:28:43.055871] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.153960] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.185350] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.241580] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.268089] [DEBUG] [LOCAL ] FLOC: Loaded 20938 existing records from primary storage. [2025-09-15T18:28:43.268743] [INFO ] [MAIN ] FLOC: Loaded 20938 existing records. [2025-09-15T18:28:43.344282] [DEBUG] [LOCAL ] FLNG: Loaded 25164 existing records from primary storage. [2025-09-15T18:28:43.355375] [INFO ] [MAIN ] FLNG: Loaded 25164 existing records. [2025-09-15T18:28:43.606208] [DEBUG] [LOCAL ] FLG: Loaded 40127 existing records from primary storage. [2025-09-15T18:28:43.611052] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:43.612438] [DEBUG] [LOCAL ] FLO: Loaded 39052 existing records from primary storage. [2025-09-15T18:28:43.611221] [INFO ] [MAIN ] FLG: Loaded 40127 existing records. [2025-09-15T18:28:43.628187] [INFO ] [MAIN ] FLO: Loaded 39052 existing records. [2025-09-15T18:28:43.628244] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-15T18:28:43.706406] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-15T18:28:43.776552] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:43.823998] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-15T18:28:43.823944] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-15T18:28:43.872900] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-15T18:28:43.867749] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-15T18:28:43.919164] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-15T18:28:43.944694] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-15T18:28:44.242325] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:44.258624] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:44.301340] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-15T18:28:44.348314] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-15T18:28:44.348160] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-15T18:28:44.378480] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-15T18:28:44.420265] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-15T18:28:44.430798] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-15T18:28:44.516109] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-15T18:28:44.613589] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-15T18:28:45.024314] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.092827] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-15T18:28:45.240167] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.293814] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-15T18:28:45.592319] [INFO ] [REMOTE ] FLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.594401] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-15T18:28:45.614299] [INFO ] [REMOTE ] FLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.614709] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-15T18:28:46.388135] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:28:46.394032] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-15T18:28:46.570743] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:28:46.578540] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-15T18:28:46.901983] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:28:46.915605] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-15T18:28:47.393263] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T18:28:47.657855] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-15T18:28:47.792005] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:28:48.036473] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:28:48.261048] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:28:48.457876] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-15T18:28:49.257839] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-15T18:28:49.382958] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:28:49.797854] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:28:50.057906] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-15T18:28:50.383098] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:28:50.857956] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-15T18:28:51.657904] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-15T18:28:51.792232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T18:28:52.457929] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-15T18:28:52.687444] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:28:52.700807] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:28:53.257921] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-15T18:28:54.057935] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-15T18:28:54.243797] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:28:54.629938] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:28:54.857913] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-15T18:28:55.515767] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:28:55.657872] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-15T18:28:56.234303] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:28:56.457914] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-15T18:28:57.257903] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-15T18:28:57.354934] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:28:57.585692] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:28:58.057894] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-15T18:28:58.857896] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-15T18:28:59.112229] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:28:59.144915] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:28:59.657903] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-15T18:29:00.457877] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-15T18:29:00.775025] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:29:00.798221] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:29:00.802991] [INFO ] [REMOTE ] FLNG: Full fetch complete (37676 records). [2025-09-15T18:29:00.803101] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-15T18:29:01.178588] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-15T18:29:01.178719] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-15T18:29:01.179427] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-15T18:29:01.179485] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-15T18:29:01.180823] [DEBUG] [LOCAL ] FLNG: Trimmed 37676 records to 24804 (keeping 150 days of data) [2025-09-15T18:29:01.276547] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-15T18:29:01.343605] [DEBUG] [LOCAL ] FLNG: Primary data saved (24804 records). [2025-09-15T18:29:01.343784] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-15T18:29:01.343887] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLNG took 18.8s. Estimated remaining: 2h 41m 39s. Rate: 9.5 symbols/min [2025-09-15T18:29:01.516212] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:01.554816] [DEBUG] [LOCAL ] FLR: Loaded 40081 existing records from primary storage. [2025-09-15T18:29:01.554997] [INFO ] [MAIN ] FLR: Loaded 40081 existing records. [2025-09-15T18:29:01.744402] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:01.744725] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-15T18:29:01.744776] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-15T18:29:01.745558] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-15T18:29:01.745613] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-15T18:29:02.073690] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-15T18:29:02.113380] [INFO ] [REMOTE ] FLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:02.193943] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:29:02.869114] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-15T18:29:02.875318] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:29:03.187492] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:29:03.657911] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-15T18:29:04.457882] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-15T18:29:04.775255] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T18:29:04.781111] [INFO ] [REMOTE ] FLO: Full fetch complete (56353 records). [2025-09-15T18:29:04.781219] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-15T18:29:05.172807] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-15T18:29:05.172928] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-15T18:29:05.174045] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-15T18:29:05.174124] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-15T18:29:05.190304] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:29:05.195906] [DEBUG] [LOCAL ] FLO: Trimmed 56353 records to 38409 (keeping 150 days of data) [2025-09-15T18:29:05.196877] [INFO ] [REMOTE ] FLG: Full fetch complete (58013 records). [2025-09-15T18:29:05.197259] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-15T18:29:05.262561] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-15T18:29:05.779153] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:29:05.773327] [DEBUG] [LOCAL ] FLO: Primary data saved (38409 records). [2025-09-15T18:29:05.789572] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-15T18:29:05.859992] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLO took 23.3s. Estimated remaining: 2h 41m 29s. Rate: 9.5 symbols/min [2025-09-15T18:29:05.863146] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-15T18:29:05.863591] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-15T18:29:05.895492] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-15T18:29:05.927580] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-15T18:29:05.971700] [DEBUG] [LOCAL ] FLG: Trimmed 58013 records to 39349 (keeping 150 days of data) [2025-09-15T18:29:06.037117] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:06.096112] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-15T18:29:06.183184] [DEBUG] [LOCAL ] FLS: Loaded 37556 existing records from primary storage. [2025-09-15T18:29:06.191902] [INFO ] [MAIN ] FLS: Loaded 37556 existing records. [2025-09-15T18:29:06.484667] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:06.494683] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-15T18:29:06.497705] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-15T18:29:06.504273] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-15T18:29:06.505017] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-15T18:29:06.654885] [DEBUG] [LOCAL ] FLG: Primary data saved (39349 records). [2025-09-15T18:29:06.672846] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-15T18:29:06.712460] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLG took 24.2s. Estimated remaining: 2h 41m 13s. Rate: 9.5 symbols/min [2025-09-15T18:29:06.976865] [INFO ] [REMOTE ] FLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:06.982736] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-15T18:29:07.051405] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:07.096056] [DEBUG] [LOCAL ] FLUT: Loaded 38069 existing records from primary storage. [2025-09-15T18:29:07.096238] [INFO ] [MAIN ] FLUT: Loaded 38069 existing records. [2025-09-15T18:29:07.318547] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T18:29:07.318844] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:07.329991] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-15T18:29:07.330112] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-15T18:29:07.336172] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-15T18:29:07.345602] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-15T18:29:07.353200] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T18:29:07.663022] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-15T18:29:07.723127] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:08.354926] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:29:08.457863] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-15T18:29:09.257905] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-15T18:29:09.575147] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T18:29:10.057843] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-15T18:29:10.157350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:29:10.630174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:29:10.857872] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-15T18:29:11.511716] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:29:11.657885] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-15T18:29:12.457900] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-15T18:29:12.764001] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T18:29:13.257885] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-15T18:29:13.320756] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T18:29:13.801006] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:29:14.057911] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-15T18:29:14.812074] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:29:14.857899] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-15T18:29:15.611000] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:29:15.657860] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-15T18:29:16.457936] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-15T18:29:16.531224] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:29:17.257886] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-15T18:29:17.384354] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:29:18.057903] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-15T18:29:18.173496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:29:18.857859] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-15T18:29:18.906171] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:29:19.113445] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:29:19.657870] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-15T18:29:20.457937] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-15T18:29:20.578865] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T18:29:20.905525] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:29:20.911144] [INFO ] [REMOTE ] FLOC: Full fetch complete (31646 records). [2025-09-15T18:29:20.911360] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-15T18:29:21.266265] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-15T18:29:21.404069] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-09-15T18:29:21.404162] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-09-15T18:29:21.404820] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-09-15T18:29:21.404869] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-09-15T18:29:21.406422] [DEBUG] [LOCAL ] FLOC: Trimmed 31646 records to 20511 (keeping 150 days of data) [2025-09-15T18:29:21.540720] [DEBUG] [LOCAL ] FLOC: Primary data saved (20511 records). [2025-09-15T18:29:21.540878] [INFO ] [MAIN ] FLOC: Full history saved. [2025-09-15T18:29:21.541010] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLOC took 39.0s. Estimated remaining: 2h 41m 22s. Rate: 9.5 symbols/min [2025-09-15T18:29:21.709662] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:21.730131] [DEBUG] [LOCAL ] FLXR: Loaded 15326 existing records from primary storage. [2025-09-15T18:29:21.730266] [INFO ] [MAIN ] FLXR: Loaded 15326 existing records. [2025-09-15T18:29:21.907481] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:21.907756] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-15T18:29:21.907803] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-15T18:29:21.908231] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-15T18:29:21.908276] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-15T18:29:22.059257] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-15T18:29:22.260417] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:22.447435] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T18:29:22.857836] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-15T18:29:23.196690] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T18:29:23.501484] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:29:23.657869] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-15T18:29:24.230479] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:29:24.457888] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-15T18:29:25.126163] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:29:25.131768] [INFO ] [REMOTE ] FLR: Full fetch complete (57363 records). [2025-09-15T18:29:25.131943] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-15T18:29:25.134217] [FATAL] [VALIDATOR ] FLR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:29:25.134343] [FATAL] [MAIN ] FLR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:29:25.134391] [WARN ] [MAIN ] FLR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:29:25.134439] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-15T18:29:25.134497] [DEBUG] [LOCAL ] FLR: No primary data file found to delete. [2025-09-15T18:29:25.134534] [INFO ] [LOCAL ] FLR: Starting deletion of derivative data. [2025-09-15T18:29:25.134902] [DEBUG] [LOCAL ] FLR: Deleted derivative data file. [2025-09-15T18:29:25.135866] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 23.8s. Estimated remaining: 2h 41m 10s. Rate: 9.5 symbols/min [2025-09-15T18:29:25.262983] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-15T18:29:25.321283] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:25.372756] [DEBUG] [LOCAL ] FMC: Loaded 38798 existing records from primary storage. [2025-09-15T18:29:25.372932] [INFO ] [MAIN ] FMC: Loaded 38798 existing records. [2025-09-15T18:29:25.548255] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:25.548553] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-15T18:29:25.548612] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-15T18:29:25.549552] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-15T18:29:25.549602] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-15T18:29:25.898164] [INFO ] [REMOTE ] FMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:26.057867] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-15T18:29:26.134961] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T18:29:26.140603] [INFO ] [REMOTE ] FLUT: Full fetch complete (55462 records). [2025-09-15T18:29:26.140761] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-15T18:29:26.526015] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-15T18:29:26.526129] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-15T18:29:26.527065] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-15T18:29:26.527128] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-15T18:29:26.528551] [DEBUG] [LOCAL ] FLUT: Trimmed 55462 records to 37330 (keeping 150 days of data) [2025-09-15T18:29:26.657261] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:29:26.802554] [DEBUG] [LOCAL ] FLUT: Primary data saved (37330 records). [2025-09-15T18:29:26.802727] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-15T18:29:26.802829] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLUT took 20.1s. Estimated remaining: 2h 40m 56s. Rate: 9.5 symbols/min [2025-09-15T18:29:26.865790] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-15T18:29:26.974302] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:26.980089] [DEBUG] [LOCAL ] FMN: Loaded 3943 existing records from primary storage. [2025-09-15T18:29:26.980192] [INFO ] [MAIN ] FMN: Loaded 3943 existing records. [2025-09-15T18:29:27.159235] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:27.159492] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-15T18:29:27.159537] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-15T18:29:27.159782] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-15T18:29:27.159840] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-15T18:29:27.514139] [INFO ] [REMOTE ] FMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:27.657875] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-15T18:29:28.038916] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-15T18:29:28.158604] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:29:28.164537] [INFO ] [REMOTE ] FLS: Full fetch complete (54263 records). [2025-09-15T18:29:28.164665] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-15T18:29:28.440578] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T18:29:28.458936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-15T18:29:28.552914] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-15T18:29:28.553000] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-15T18:29:28.553878] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-15T18:29:28.553960] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-15T18:29:28.555326] [DEBUG] [LOCAL ] FLS: Trimmed 54263 records to 36835 (keeping 150 days of data) [2025-09-15T18:29:28.784589] [DEBUG] [LOCAL ] FLS: Primary data saved (36835 records). [2025-09-15T18:29:28.784749] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-15T18:29:28.784856] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLS took 22.9s. Estimated remaining: 2h 40m 41s. Rate: 9.5 symbols/min [2025-09-15T18:29:28.958720] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:28.982832] [DEBUG] [LOCAL ] FMS: Loaded 22575 existing records from primary storage. [2025-09-15T18:29:28.983009] [INFO ] [MAIN ] FMS: Loaded 22575 existing records. [2025-09-15T18:29:29.161213] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:29.161438] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-15T18:29:29.161483] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-15T18:29:29.162061] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-15T18:29:29.162124] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-15T18:29:29.262098] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-15T18:29:29.503084] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:29:29.527503] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:30.017988] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:29:30.057871] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-15T18:29:30.753355] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T18:29:30.857838] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-15T18:29:31.657870] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-15T18:29:31.849909] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:29:32.208695] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:29:32.457876] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-15T18:29:33.257871] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-15T18:29:33.467492] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:29:34.057865] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-15T18:29:34.759391] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T18:29:34.857865] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-15T18:29:35.134207] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:29:35.657907] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-15T18:29:35.922066] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:29:36.244517] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:29:36.457896] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-15T18:29:37.257873] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-15T18:29:37.779195] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:29:38.057928] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-15T18:29:38.225127] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T18:29:38.702695] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T18:29:38.857882] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-15T18:29:39.517050] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T18:29:39.657891] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-15T18:29:40.457897] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-15T18:29:40.734044] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:29:41.118988] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:29:41.120202] [INFO ] [REMOTE ] FMN: Full fetch complete (6821 records). [2025-09-15T18:29:41.120269] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-15T18:29:41.262959] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-15T18:29:41.485533] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-15T18:29:41.485619] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-15T18:29:41.485828] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-15T18:29:41.485868] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-15T18:29:41.486257] [DEBUG] [LOCAL ] FMN: Trimmed 6821 records to 3809 (keeping 150 days of data) [2025-09-15T18:29:41.512632] [DEBUG] [LOCAL ] FMN: Primary data saved (3809 records). [2025-09-15T18:29:41.512829] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-15T18:29:41.512930] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FMN took 14.7s. Estimated remaining: 2h 40m 46s. Rate: 9.5 symbols/min [2025-09-15T18:29:41.682780] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:41.712772] [DEBUG] [LOCAL ] FMX: Loaded 30463 existing records from primary storage. [2025-09-15T18:29:41.712926] [INFO ] [MAIN ] FMX: Loaded 30463 existing records. [2025-09-15T18:29:41.891238] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:41.891505] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-15T18:29:41.891550] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-15T18:29:41.892328] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-15T18:29:41.892378] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-15T18:29:42.063599] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-15T18:29:42.255064] [INFO ] [REMOTE ] FMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:42.753162] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:29:42.857841] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-15T18:29:43.457505] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:29:43.657872] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-15T18:29:44.457869] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-15T18:29:44.507945] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T18:29:44.748574] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:29:45.257870] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-15T18:29:45.659365] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:29:46.023532] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:29:46.057887] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-15T18:29:46.857934] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-15T18:29:47.631726] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:29:47.657884] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-15T18:29:47.816820] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:29:48.457870] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-15T18:29:49.257891] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-15T18:29:49.364193] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:29:49.588364] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:29:50.057888] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-15T18:29:50.358203] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:29:50.857919] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-15T18:29:51.475893] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:29:51.657896] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-15T18:29:52.448892] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:29:52.457961] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-15T18:29:53.150373] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T18:29:53.257832] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-15T18:29:53.611634] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:29:53.615497] [INFO ] [REMOTE ] FMS: Full fetch complete (32830 records). [2025-09-15T18:29:53.615595] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-15T18:29:53.981308] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-15T18:29:53.981392] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-15T18:29:53.981957] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-15T18:29:53.982030] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-15T18:29:53.982806] [DEBUG] [LOCAL ] FMS: Trimmed 32830 records to 22098 (keeping 150 days of data) [2025-09-15T18:29:54.070743] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-15T18:29:54.118987] [DEBUG] [LOCAL ] FMS: Primary data saved (22098 records). [2025-09-15T18:29:54.119154] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-15T18:29:54.119252] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FMS took 25.3s. Estimated remaining: 2h 40m 51s. Rate: 9.4 symbols/min [2025-09-15T18:29:54.294182] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:54.297350] [DEBUG] [LOCAL ] FMY: Loaded 1043 existing records from primary storage. [2025-09-15T18:29:54.297461] [INFO ] [MAIN ] FMY: Loaded 1043 existing records. [2025-09-15T18:29:54.477714] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:54.478020] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-15T18:29:54.478070] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-15T18:29:54.478271] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-15T18:29:54.478316] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-15T18:29:54.833682] [INFO ] [REMOTE ] FMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:54.852795] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:29:54.859481] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-15T18:29:54.861739] [INFO ] [REMOTE ] FMC: Full fetch complete (56503 records). [2025-09-15T18:29:54.861974] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-15T18:29:55.260402] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-15T18:29:55.260670] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-15T18:29:55.261596] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-15T18:29:55.261764] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-15T18:29:55.276179] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:29:55.280293] [INFO ] [REMOTE ] FLXR: Full fetch complete (20518 records). [2025-09-15T18:29:55.280422] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-15T18:29:55.280561] [DEBUG] [LOCAL ] FMC: Trimmed 56503 records to 38090 (keeping 150 days of data) [2025-09-15T18:29:55.661143] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-15T18:29:55.896678] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-15T18:29:55.896770] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-15T18:29:55.897226] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-15T18:29:55.898320] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-15T18:29:55.916023] [DEBUG] [LOCAL ] FMC: Primary data saved (38090 records). [2025-09-15T18:29:55.916420] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-15T18:29:55.918352] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMC took 30.8s. Estimated remaining: 2h 40m 37s. Rate: 9.5 symbols/min [2025-09-15T18:29:55.916346] [DEBUG] [LOCAL ] FLXR: Trimmed 20518 records to 15177 (keeping 150 days of data) [2025-09-15T18:29:56.172022] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:56.196882] [DEBUG] [LOCAL ] FLXR: Primary data saved (15177 records). [2025-09-15T18:29:56.197211] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-15T18:29:56.204364] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FLXR took 34.7s. Estimated remaining: 2h 40m 20s. Rate: 9.5 symbols/min [2025-09-15T18:29:56.294550] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:29:56.339307] [DEBUG] [LOCAL ] FN: Loaded 28785 existing records from primary storage. [2025-09-15T18:29:56.364135] [INFO ] [MAIN ] FN: Loaded 28785 existing records. [2025-09-15T18:29:56.428780] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:56.473479] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-15T18:29:56.590000] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:56.590942] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-15T18:29:56.591003] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-15T18:29:56.591770] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-15T18:29:56.591843] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-15T18:29:56.800782] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:29:56.837558] [DEBUG] [LOCAL ] FNB: Loaded 39382 existing records from primary storage. [2025-09-15T18:29:56.868096] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:29:56.897407] [INFO ] [MAIN ] FNB: Loaded 39382 existing records. [2025-09-15T18:29:57.213398] [INFO ] [REMOTE ] FN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:57.218972] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:57.219539] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-15T18:29:57.219590] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-15T18:29:57.220503] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-15T18:29:57.220557] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-15T18:29:57.263043] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-15T18:29:57.582581] [INFO ] [REMOTE ] FNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:58.057879] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-15T18:29:58.761141] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:29:58.857941] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-15T18:29:59.657894] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-15T18:29:59.789756] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:30:00.125968] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:30:00.162767] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:30:00.457887] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-15T18:30:01.257917] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-15T18:30:02.057980] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-15T18:30:02.100561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:30:02.857981] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-15T18:30:03.521319] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T18:30:03.657965] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-15T18:30:04.457994] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-15T18:30:05.171844] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-15T18:30:05.207613] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:30:05.257882] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-15T18:30:05.998478] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T18:30:06.067282] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-15T18:30:06.070818] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (3.21 seconds). [2025-09-15T18:30:06.857934] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-15T18:30:07.141699] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:30:07.221334] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-15T18:30:07.657966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-15T18:30:07.782366] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:30:08.457893] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-15T18:30:09.062390] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:30:09.257844] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-15T18:30:09.943215] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:30:10.057889] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-15T18:30:10.829689] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:30:10.834288] [INFO ] [REMOTE ] FMX: Full fetch complete (43544 records). [2025-09-15T18:30:10.834398] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-15T18:30:10.835238] [FATAL] [VALIDATOR ] FMX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:30:10.835323] [FATAL] [MAIN ] FMX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:30:10.835366] [WARN ] [MAIN ] FMX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:30:10.835418] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-15T18:30:10.835484] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-15T18:30:10.835523] [INFO ] [LOCAL ] FMX: Starting deletion of derivative data. [2025-09-15T18:30:10.836052] [DEBUG] [LOCAL ] FMX: Deleted derivative data file. [2025-09-15T18:30:10.836150] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMX took 29.3s. Estimated remaining: 2h 40m 28s. Rate: 9.5 symbols/min [2025-09-15T18:30:10.867585] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-15T18:30:11.012500] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:11.049568] [DEBUG] [LOCAL ] FND: Loaded 39229 existing records from primary storage. [2025-09-15T18:30:11.049743] [INFO ] [MAIN ] FND: Loaded 39229 existing records. [2025-09-15T18:30:11.235251] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:11.235493] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-15T18:30:11.235542] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-15T18:30:11.236351] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-15T18:30:11.236404] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-15T18:30:11.419531] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:30:11.612728] [INFO ] [REMOTE ] FND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:11.645863] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:30:11.657810] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-15T18:30:12.457936] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-15T18:30:12.909417] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:30:13.257977] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-15T18:30:13.437658] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T18:30:14.057930] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-15T18:30:14.857874] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-15T18:30:15.255223] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:30:15.657871] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-15T18:30:16.179935] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T18:30:16.457947] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-15T18:30:16.644147] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T18:30:16.828861] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:30:16.829670] [INFO ] [REMOTE ] FMY: Full fetch complete (1510 records). [2025-09-15T18:30:16.829742] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-15T18:30:17.213971] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-15T18:30:17.214108] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-15T18:30:17.214353] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-15T18:30:17.214453] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-15T18:30:17.215210] [DEBUG] [LOCAL ] FMY: Trimmed 1510 records to 1018 (keeping 150 days of data) [2025-09-15T18:30:17.223456] [DEBUG] [LOCAL ] FMY: Primary data saved (1018 records). [2025-09-15T18:30:17.223540] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-15T18:30:17.223664] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMY took 23.1s. Estimated remaining: 2h 40m 22s. Rate: 9.5 symbols/min [2025-09-15T18:30:17.262978] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-15T18:30:17.426679] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:30:17.457761] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:17.502909] [DEBUG] [LOCAL ] FNF: Loaded 36881 existing records from primary storage. [2025-09-15T18:30:17.503126] [INFO ] [MAIN ] FNF: Loaded 36881 existing records. [2025-09-15T18:30:17.691129] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:17.691516] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-15T18:30:17.691572] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-15T18:30:17.692479] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-15T18:30:17.692539] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-15T18:30:18.051679] [INFO ] [REMOTE ] FNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:18.057834] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-15T18:30:18.857899] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-15T18:30:19.004365] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:30:19.010728] [INFO ] [REMOTE ] FNB: Full fetch complete (56924 records). [2025-09-15T18:30:19.010894] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-15T18:30:19.410061] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-15T18:30:19.410176] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-15T18:30:19.411200] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-15T18:30:19.411271] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-15T18:30:19.412814] [DEBUG] [LOCAL ] FNB: Trimmed 56924 records to 38602 (keeping 150 days of data) [2025-09-15T18:30:19.658139] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-15T18:30:19.665364] [DEBUG] [LOCAL ] FNB: Primary data saved (38602 records). [2025-09-15T18:30:19.665572] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-15T18:30:19.666716] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FNB took 23.5s. Estimated remaining: 2h 40m 9s. Rate: 9.5 symbols/min [2025-09-15T18:30:19.843001] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:19.871447] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:30:19.916434] [DEBUG] [LOCAL ] FNV: Loaded 34341 existing records from primary storage. [2025-09-15T18:30:19.916702] [INFO ] [MAIN ] FNV: Loaded 34341 existing records. [2025-09-15T18:30:20.126561] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:20.126844] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-15T18:30:20.126895] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-15T18:30:20.127733] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-15T18:30:20.127794] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-15T18:30:20.462219] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-15T18:30:20.484702] [INFO ] [REMOTE ] FNV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:20.537760] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:30:21.209624] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:30:21.213790] [INFO ] [REMOTE ] FN: Full fetch complete (43173 records). [2025-09-15T18:30:21.213878] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-15T18:30:21.214529] [FATAL] [VALIDATOR ] FN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:30:21.214613] [FATAL] [MAIN ] FN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:30:21.214677] [WARN ] [MAIN ] FN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:30:21.214727] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-15T18:30:21.214787] [DEBUG] [LOCAL ] FN: No primary data file found to delete. [2025-09-15T18:30:21.214834] [INFO ] [LOCAL ] FN: Starting deletion of derivative data. [2025-09-15T18:30:21.215144] [DEBUG] [LOCAL ] FN: Deleted derivative data file. [2025-09-15T18:30:21.215234] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 25.3s. Estimated remaining: 2h 39m 54s. Rate: 9.5 symbols/min [2025-09-15T18:30:21.270015] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-15T18:30:21.389419] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:21.400039] [DEBUG] [LOCAL ] FOA: Loaded 9277 existing records from primary storage. [2025-09-15T18:30:21.400193] [INFO ] [MAIN ] FOA: Loaded 9277 existing records. [2025-09-15T18:30:21.580971] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:21.581239] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-15T18:30:21.581287] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-15T18:30:21.581619] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-15T18:30:21.581693] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-15T18:30:21.936996] [INFO ] [REMOTE ] FOA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:22.057895] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-15T18:30:22.183818] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:30:22.748240] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:30:22.857901] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-15T18:30:23.272254] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:30:23.657892] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-15T18:30:24.437116] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:30:24.457829] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-15T18:30:24.727313] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:30:25.257925] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-15T18:30:26.049782] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:30:26.057808] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-15T18:30:26.503198] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:30:26.857879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-15T18:30:26.997591] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:30:27.657876] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-15T18:30:28.457871] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-15T18:30:28.546843] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:30:29.079192] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:30:29.099888] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:30:29.257857] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-15T18:30:30.057892] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-15T18:30:30.729128] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:30:30.857836] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-15T18:30:31.657864] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-15T18:30:31.871688] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T18:30:32.291238] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:30:32.434394] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:30:32.457874] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-15T18:30:33.257917] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-15T18:30:33.912623] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:30:34.057999] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-15T18:30:34.103578] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:30:34.858017] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-15T18:30:35.608415] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:30:35.643526] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:30:35.657815] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-15T18:30:36.457874] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-15T18:30:36.755669] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:30:37.257866] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-15T18:30:38.057851] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-15T18:30:38.098441] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:30:38.631882] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T18:30:38.637462] [INFO ] [REMOTE ] FNV: Full fetch complete (50341 records). [2025-09-15T18:30:38.637579] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-15T18:30:38.867177] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-15T18:30:39.054566] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-15T18:30:39.054763] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-15T18:30:39.055876] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-15T18:30:39.056045] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-15T18:30:39.057787] [DEBUG] [LOCAL ] FNV: Trimmed 50341 records to 33565 (keeping 150 days of data) [2025-09-15T18:30:39.287598] [DEBUG] [LOCAL ] FNV: Primary data saved (33565 records). [2025-09-15T18:30:39.287888] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-15T18:30:39.288015] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNV took 19.6s. Estimated remaining: 2h 40m 8s. Rate: 9.4 symbols/min [2025-09-15T18:30:39.463394] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:39.472625] [DEBUG] [LOCAL ] FOF: Loaded 5849 existing records from primary storage. [2025-09-15T18:30:39.472807] [INFO ] [MAIN ] FOF: Loaded 5849 existing records. [2025-09-15T18:30:39.660338] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-15T18:30:39.747175] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:39.748864] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-15T18:30:39.748949] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-15T18:30:39.749444] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-15T18:30:39.749512] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-15T18:30:40.060909] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:30:40.080692] [INFO ] [REMOTE ] FOA: Full fetch complete (14727 records). [2025-09-15T18:30:40.086017] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-15T18:30:40.307025] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T18:30:40.330892] [INFO ] [REMOTE ] FOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:40.464784] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-15T18:30:40.604388] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-15T18:30:40.604471] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-15T18:30:40.604845] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-15T18:30:40.604893] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-15T18:30:40.605402] [DEBUG] [LOCAL ] FOA: Trimmed 14727 records to 9145 (keeping 150 days of data) [2025-09-15T18:30:40.659609] [DEBUG] [LOCAL ] FOA: Primary data saved (9145 records). [2025-09-15T18:30:40.659759] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-15T18:30:40.659841] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FOA took 19.4s. Estimated remaining: 2h 39m 53s. Rate: 9.5 symbols/min [2025-09-15T18:30:40.828471] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:40.843439] [DEBUG] [LOCAL ] FOR: Loaded 14946 existing records from primary storage. [2025-09-15T18:30:40.843583] [INFO ] [MAIN ] FOR: Loaded 14946 existing records. [2025-09-15T18:30:41.027332] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:41.027632] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-15T18:30:41.027705] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-15T18:30:41.028113] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-15T18:30:41.028174] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-15T18:30:41.267587] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-15T18:30:41.403670] [INFO ] [REMOTE ] FOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:41.593523] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T18:30:41.599354] [INFO ] [REMOTE ] FND: Full fetch complete (56667 records). [2025-09-15T18:30:41.599474] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-15T18:30:41.982886] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-15T18:30:41.982969] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-15T18:30:41.983721] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-15T18:30:41.983765] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-15T18:30:41.984972] [DEBUG] [LOCAL ] FND: Trimmed 56667 records to 38434 (keeping 150 days of data) [2025-09-15T18:30:42.074297] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-15T18:30:42.209737] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:30:42.247636] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:30:42.279084] [DEBUG] [LOCAL ] FND: Primary data saved (38434 records). [2025-09-15T18:30:42.279275] [INFO ] [MAIN ] FND: Full history saved. [2025-09-15T18:30:42.279377] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FND took 31.4s. Estimated remaining: 2h 39m 38s. Rate: 9.5 symbols/min [2025-09-15T18:30:42.469408] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:42.505488] [DEBUG] [LOCAL ] FOUR: Loaded 36977 existing records from primary storage. [2025-09-15T18:30:42.505697] [INFO ] [MAIN ] FOUR: Loaded 36977 existing records. [2025-09-15T18:30:42.694492] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:42.694816] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-15T18:30:42.694867] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-15T18:30:42.695900] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-15T18:30:42.695987] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-15T18:30:42.867924] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-15T18:30:43.070432] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:43.284735] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:30:43.657909] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-15T18:30:44.457891] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-15T18:30:44.694199] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T18:30:44.897457] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T18:30:45.262940] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-15T18:30:45.278601] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:30:46.057886] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-15T18:30:46.834450] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:30:46.851848] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:30:46.857807] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-15T18:30:47.603808] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:30:47.657895] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-15T18:30:48.457906] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-15T18:30:49.148522] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:30:49.257873] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-15T18:30:49.405607] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:30:49.412962] [INFO ] [REMOTE ] FNF: Full fetch complete (53492 records). [2025-09-15T18:30:49.413121] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-15T18:30:49.792869] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-15T18:30:49.792960] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-15T18:30:49.793716] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-15T18:30:49.793775] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-15T18:30:49.794908] [DEBUG] [LOCAL ] FNF: Trimmed 53492 records to 36151 (keeping 150 days of data) [2025-09-15T18:30:50.015618] [DEBUG] [LOCAL ] FNF: Primary data saved (36151 records). [2025-09-15T18:30:50.015782] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-15T18:30:50.017222] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNF took 32.8s. Estimated remaining: 2h 39m 34s. Rate: 9.5 symbols/min [2025-09-15T18:30:50.062954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-15T18:30:50.190135] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:50.205842] [DEBUG] [LOCAL ] FPF: Loaded 13063 existing records from primary storage. [2025-09-15T18:30:50.205997] [INFO ] [MAIN ] FPF: Loaded 13063 existing records. [2025-09-15T18:30:50.388029] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:50.388308] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-15T18:30:50.388353] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-15T18:30:50.388750] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-15T18:30:50.388800] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-15T18:30:50.744908] [INFO ] [REMOTE ] FPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:50.761333] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:30:50.857837] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-15T18:30:51.657873] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-15T18:30:51.720983] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:30:51.865076] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T18:30:52.457907] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-15T18:30:52.734121] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:30:53.257921] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-15T18:30:53.844407] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:30:54.057876] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-15T18:30:54.244717] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:30:54.693672] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:30:54.857881] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-15T18:30:55.657882] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-15T18:30:55.875851] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T18:30:56.457835] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-15T18:30:56.469340] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:30:57.257867] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-15T18:30:57.774672] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T18:30:58.057900] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-15T18:30:58.272397] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:30:58.654209] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:30:58.857882] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-15T18:30:59.579858] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:30:59.657855] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-15T18:31:00.457923] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-15T18:31:00.789315] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:31:01.257875] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-15T18:31:01.808387] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:31:02.057873] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-15T18:31:02.857862] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-15T18:31:02.928182] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:31:02.929961] [INFO ] [REMOTE ] FOF: Full fetch complete (8737 records). [2025-09-15T18:31:02.930034] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-15T18:31:03.267244] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-15T18:31:03.348249] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-15T18:31:03.348331] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-15T18:31:03.348684] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-15T18:31:03.348740] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-15T18:31:03.349245] [DEBUG] [LOCAL ] FOF: Trimmed 8737 records to 5732 (keeping 150 days of data) [2025-09-15T18:31:03.386886] [DEBUG] [LOCAL ] FOF: Primary data saved (5732 records). [2025-09-15T18:31:03.386998] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-15T18:31:03.387118] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOF took 24.1s. Estimated remaining: 2h 39m 40s. Rate: 9.5 symbols/min [2025-09-15T18:31:03.561334] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:03.578487] [DEBUG] [LOCAL ] FPH: Loaded 14659 existing records from primary storage. [2025-09-15T18:31:03.578616] [INFO ] [MAIN ] FPH: Loaded 14659 existing records. [2025-09-15T18:31:03.662957] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-15T18:31:03.762343] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:03.762624] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-15T18:31:03.762703] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-15T18:31:03.763144] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-15T18:31:03.763210] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-15T18:31:04.127032] [INFO ] [REMOTE ] FPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:04.138834] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:31:04.349319] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:31:04.351729] [INFO ] [REMOTE ] FOR: Full fetch complete (22348 records). [2025-09-15T18:31:04.351803] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-15T18:31:04.462954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-15T18:31:04.721860] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-15T18:31:04.721946] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-15T18:31:04.722488] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-15T18:31:04.722533] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-15T18:31:04.723394] [DEBUG] [LOCAL ] FOR: Trimmed 22348 records to 14480 (keeping 150 days of data) [2025-09-15T18:31:04.822829] [DEBUG] [LOCAL ] FOR: Primary data saved (14480 records). [2025-09-15T18:31:04.822992] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-15T18:31:04.823100] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOR took 24.2s. Estimated remaining: 2h 39m 26s. Rate: 9.5 symbols/min [2025-09-15T18:31:04.997975] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:05.028819] [DEBUG] [LOCAL ] FPI: Loaded 23691 existing records from primary storage. [2025-09-15T18:31:05.029047] [INFO ] [MAIN ] FPI: Loaded 23691 existing records. [2025-09-15T18:31:05.207952] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:05.208281] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-15T18:31:05.208348] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-15T18:31:05.208988] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-15T18:31:05.209042] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-15T18:31:05.263236] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-15T18:31:05.570359] [INFO ] [REMOTE ] FPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:06.020081] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T18:31:06.057816] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-15T18:31:06.251254] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:31:06.857872] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-15T18:31:07.051344] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:31:07.657889] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-15T18:31:07.788626] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T18:31:08.457907] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-15T18:31:08.621560] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:31:08.624063] [INFO ] [REMOTE ] FPF: Full fetch complete (19020 records). [2025-09-15T18:31:08.624152] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-15T18:31:09.006409] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-15T18:31:09.006499] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-15T18:31:09.006954] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-15T18:31:09.007003] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-15T18:31:09.007730] [DEBUG] [LOCAL ] FPF: Trimmed 19020 records to 12774 (keeping 150 days of data) [2025-09-15T18:31:09.096065] [DEBUG] [LOCAL ] FPF: Primary data saved (12774 records). [2025-09-15T18:31:09.096221] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-15T18:31:09.096319] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FPF took 19.1s. Estimated remaining: 2h 39m 16s. Rate: 9.5 symbols/min [2025-09-15T18:31:09.271694] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:09.268324] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-15T18:31:09.313291] [DEBUG] [LOCAL ] FR: Loaded 35051 existing records from primary storage. [2025-09-15T18:31:09.313435] [INFO ] [MAIN ] FR: Loaded 35051 existing records. [2025-09-15T18:31:09.512383] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:09.513141] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-15T18:31:09.529598] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-15T18:31:09.531250] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:31:09.531300] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-15T18:31:09.531503] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-15T18:31:09.905165] [INFO ] [REMOTE ] FR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:10.057883] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-15T18:31:10.857903] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-15T18:31:10.898207] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:31:11.063918] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:31:11.657878] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-15T18:31:11.853682] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:31:12.457892] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-15T18:31:12.631828] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:31:13.257917] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-15T18:31:14.057881] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-15T18:31:14.161700] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T18:31:14.228085] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:31:14.857871] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-15T18:31:15.657882] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-15T18:31:15.815216] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T18:31:15.820855] [INFO ] [REMOTE ] FOUR: Full fetch complete (54066 records). [2025-09-15T18:31:15.821002] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-15T18:31:16.128948] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:31:16.244793] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-15T18:31:16.244895] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-15T18:31:16.245689] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-15T18:31:16.245750] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-15T18:31:16.247152] [DEBUG] [LOCAL ] FOUR: Trimmed 54066 records to 36302 (keeping 150 days of data) [2025-09-15T18:31:16.458143] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-15T18:31:16.481556] [DEBUG] [LOCAL ] FOUR: Primary data saved (36302 records). [2025-09-15T18:31:16.481720] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-15T18:31:16.481841] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 34.2s. Estimated remaining: 2h 39m 11s. Rate: 9.5 symbols/min [2025-09-15T18:31:16.658817] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:16.669861] [DEBUG] [LOCAL ] FRA: Loaded 10144 existing records from primary storage. [2025-09-15T18:31:16.669972] [INFO ] [MAIN ] FRA: Loaded 10144 existing records. [2025-09-15T18:31:16.853918] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:16.854201] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-15T18:31:16.854263] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-15T18:31:16.854828] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-15T18:31:16.854881] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-15T18:31:17.222309] [INFO ] [REMOTE ] FRA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:17.241817] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:31:17.257819] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-15T18:31:17.375832] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:31:18.057873] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-15T18:31:18.634377] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:31:18.857890] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-15T18:31:19.246719] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:31:19.657853] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-15T18:31:20.026336] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:31:20.457873] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-15T18:31:21.063293] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:31:21.257865] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-15T18:31:21.411915] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:31:21.414689] [INFO ] [REMOTE ] FPH: Full fetch complete (22142 records). [2025-09-15T18:31:21.414774] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-15T18:31:21.825246] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-15T18:31:21.825333] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-15T18:31:21.825855] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-15T18:31:21.825900] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-15T18:31:21.826547] [DEBUG] [LOCAL ] FPH: Trimmed 22142 records to 14437 (keeping 150 days of data) [2025-09-15T18:31:21.915203] [DEBUG] [LOCAL ] FPH: Primary data saved (14437 records). [2025-09-15T18:31:21.915358] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-15T18:31:21.915446] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPH took 18.5s. Estimated remaining: 2h 39m 3s. Rate: 9.5 symbols/min [2025-09-15T18:31:22.062988] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-15T18:31:22.087926] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:22.101235] [DEBUG] [LOCAL ] FRGE: Loaded 11995 existing records from primary storage. [2025-09-15T18:31:22.101428] [INFO ] [MAIN ] FRGE: Loaded 11995 existing records. [2025-09-15T18:31:22.286678] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:22.286936] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-15T18:31:22.287001] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-15T18:31:22.287420] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-15T18:31:22.287469] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-15T18:31:22.658663] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:22.679953] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:31:22.857901] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-15T18:31:22.973382] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T18:31:23.657928] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-15T18:31:24.141165] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:31:24.221754] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:31:24.457877] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-15T18:31:25.257936] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-15T18:31:25.534325] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:31:26.057973] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-15T18:31:26.212988] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:31:26.857879] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-15T18:31:27.657878] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-15T18:31:27.812101] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:31:27.939929] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T18:31:28.457860] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-15T18:31:28.893526] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:31:29.257864] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-15T18:31:29.441215] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:31:30.057832] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-15T18:31:30.076954] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:31:30.080070] [INFO ] [REMOTE ] FPI: Full fetch complete (33637 records). [2025-09-15T18:31:30.080145] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-15T18:31:30.080715] [FATAL] [VALIDATOR ] FPI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:31:30.080793] [FATAL] [MAIN ] FPI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:31:30.080829] [WARN ] [MAIN ] FPI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:31:30.080865] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-15T18:31:30.080960] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-09-15T18:31:30.081000] [INFO ] [LOCAL ] FPI: Starting deletion of derivative data. [2025-09-15T18:31:30.081324] [DEBUG] [LOCAL ] FPI: Deleted derivative data file. [2025-09-15T18:31:30.081403] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPI took 25.3s. Estimated remaining: 2h 38m 60s. Rate: 9.5 symbols/min [2025-09-15T18:31:30.252635] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:30.295091] [DEBUG] [LOCAL ] FRO: Loaded 38882 existing records from primary storage. [2025-09-15T18:31:30.295233] [INFO ] [MAIN ] FRO: Loaded 38882 existing records. [2025-09-15T18:31:30.471568] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:30.471817] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-15T18:31:30.471863] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-15T18:31:30.472871] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-15T18:31:30.472927] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-15T18:31:30.827830] [INFO ] [REMOTE ] FRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:30.857842] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-15T18:31:30.879964] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:31:31.657868] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-15T18:31:32.013680] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:31:32.457924] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-15T18:31:32.579929] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:31:33.257860] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-15T18:31:33.462459] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T18:31:34.057897] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-15T18:31:34.488093] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:31:34.857887] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-15T18:31:35.657845] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-15T18:31:35.800038] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:31:36.457855] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-15T18:31:36.501244] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:31:36.549938] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:31:37.257889] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-15T18:31:37.912526] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:31:38.057874] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-15T18:31:38.764225] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:31:38.857876] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-15T18:31:39.657879] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-15T18:31:39.703511] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:31:39.839183] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:31:39.844235] [INFO ] [REMOTE ] FR: Full fetch complete (50718 records). [2025-09-15T18:31:39.844346] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-15T18:31:40.252284] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-15T18:31:40.252372] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-15T18:31:40.253158] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-15T18:31:40.253213] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-15T18:31:40.254575] [DEBUG] [LOCAL ] FR: Trimmed 50718 records to 34195 (keeping 150 days of data) [2025-09-15T18:31:40.457971] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-15T18:31:40.487407] [DEBUG] [LOCAL ] FR: Primary data saved (34195 records). [2025-09-15T18:31:40.487805] [INFO ] [MAIN ] FR: Full history saved. [2025-09-15T18:31:40.489151] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FR took 31.4s. Estimated remaining: 2h 39m 1s. Rate: 9.5 symbols/min [2025-09-15T18:31:40.665353] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:40.675312] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T18:31:40.715452] [DEBUG] [LOCAL ] FRT: Loaded 31420 existing records from primary storage. [2025-09-15T18:31:40.715603] [INFO ] [MAIN ] FRT: Loaded 31420 existing records. [2025-09-15T18:31:40.900739] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:40.901129] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-15T18:31:40.901188] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-15T18:31:40.902320] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-15T18:31:40.902419] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-15T18:31:41.258290] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-15T18:31:41.278467] [INFO ] [REMOTE ] FRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:42.057870] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-15T18:31:42.149321] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:31:42.183358] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:31:42.857884] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-15T18:31:43.495246] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T18:31:43.657877] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-15T18:31:44.457898] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-15T18:31:44.679726] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T18:31:44.869782] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:31:45.257890] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-15T18:31:45.384997] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:31:45.882074] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:31:45.883774] [INFO ] [REMOTE ] FRGE: Full fetch complete (22019 records). [2025-09-15T18:31:45.883851] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-15T18:31:45.884813] [FATAL] [VALIDATOR ] FRGE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:31:45.885045] [FATAL] [MAIN ] FRGE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:31:45.885099] [WARN ] [MAIN ] FRGE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:31:45.885148] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-15T18:31:45.885220] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-09-15T18:31:45.885260] [INFO ] [LOCAL ] FRGE: Starting deletion of derivative data. [2025-09-15T18:31:45.885613] [DEBUG] [LOCAL ] FRGE: Deleted derivative data file. [2025-09-15T18:31:45.885743] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRGE took 24.0s. Estimated remaining: 2h 38m 53s. Rate: 9.5 symbols/min [2025-09-15T18:31:46.058947] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-15T18:31:46.079066] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:46.106035] [DEBUG] [LOCAL ] FSCO: Loaded 27469 existing records from primary storage. [2025-09-15T18:31:46.106181] [INFO ] [MAIN ] FSCO: Loaded 27469 existing records. [2025-09-15T18:31:46.284358] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:46.284631] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-15T18:31:46.284698] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-15T18:31:46.285336] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-15T18:31:46.285385] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-15T18:31:46.636325] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:46.857907] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-15T18:31:46.923604] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:31:46.926092] [INFO ] [REMOTE ] FRA: Full fetch complete (16411 records). [2025-09-15T18:31:46.926231] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-15T18:31:47.304292] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-15T18:31:47.304422] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-15T18:31:47.304807] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-15T18:31:47.304850] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-15T18:31:47.305363] [DEBUG] [LOCAL ] FRA: Trimmed 16411 records to 9987 (keeping 150 days of data) [2025-09-15T18:31:47.368024] [DEBUG] [LOCAL ] FRA: Primary data saved (9987 records). [2025-09-15T18:31:47.368183] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-15T18:31:47.368276] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRA took 30.9s. Estimated remaining: 2h 38m 38s. Rate: 9.5 symbols/min [2025-09-15T18:31:47.538743] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:47.575289] [DEBUG] [LOCAL ] FSK: Loaded 36388 existing records from primary storage. [2025-09-15T18:31:47.575435] [INFO ] [MAIN ] FSK: Loaded 36388 existing records. [2025-09-15T18:31:47.664922] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-15T18:31:47.754703] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:47.754957] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-15T18:31:47.755002] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-15T18:31:47.755980] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-15T18:31:47.756032] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-15T18:31:48.102520] [INFO ] [REMOTE ] FSK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:48.184692] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:31:48.457880] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-15T18:31:49.257843] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-15T18:31:49.425738] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:31:49.493693] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T18:31:50.057889] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-15T18:31:50.857876] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-15T18:31:50.988185] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:31:51.664815] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-15T18:31:51.669687] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:31:52.277134] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T18:31:52.457874] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-15T18:31:52.560218] [DEBUG] [REMOTE ] FSCO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-15T18:31:52.560584] [WARN ] [REMOTE ] FSCO: No data returned for month 2025-05 [2025-09-15T18:31:53.257868] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-15T18:31:53.307746] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:31:54.057872] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-15T18:31:54.857890] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-15T18:31:55.061505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T18:31:55.350741] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:31:55.657880] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-15T18:31:56.424966] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:31:56.431072] [INFO ] [REMOTE ] FRO: Full fetch complete (56509 records). [2025-09-15T18:31:56.431224] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-15T18:31:56.464761] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-15T18:31:56.842012] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-15T18:31:56.842137] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-15T18:31:56.843121] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-15T18:31:56.843190] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-15T18:31:56.844662] [DEBUG] [LOCAL ] FRO: Trimmed 56509 records to 38124 (keeping 150 days of data) [2025-09-15T18:31:57.105425] [DEBUG] [LOCAL ] FRO: Primary data saved (38124 records). [2025-09-15T18:31:57.105689] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-15T18:31:57.107780] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRO took 27.0s. Estimated remaining: 2h 38m 37s. Rate: 9.5 symbols/min [2025-09-15T18:31:57.259355] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-15T18:31:57.304722] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:57.334670] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:31:57.379892] [DEBUG] [LOCAL ] FSLY: Loaded 38359 existing records from primary storage. [2025-09-15T18:31:57.380057] [INFO ] [MAIN ] FSLY: Loaded 38359 existing records. [2025-09-15T18:31:57.558007] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:57.558250] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-15T18:31:57.558310] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-15T18:31:57.559040] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-15T18:31:57.559092] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-15T18:31:57.920686] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:58.044257] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:31:58.057826] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-15T18:31:58.783660] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:31:58.857908] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-15T18:31:59.456400] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:31:59.657894] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-15T18:32:00.457965] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-15T18:32:01.258000] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-15T18:32:01.365773] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T18:32:01.824974] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T18:32:01.829396] [INFO ] [REMOTE ] FSCO: Full fetch complete (34270 records). [2025-09-15T18:32:01.829509] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-15T18:32:02.026170] [WARN ] [VALIDATOR ] FSCO: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:32:02.027036] [FATAL] [MAIN ] FSCO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:02.027092] [WARN ] [MAIN ] FSCO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:02.027134] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-15T18:32:02.027304] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-09-15T18:32:02.027346] [INFO ] [LOCAL ] FSCO: Starting deletion of derivative data. [2025-09-15T18:32:02.027884] [DEBUG] [LOCAL ] FSCO: Deleted derivative data file. [2025-09-15T18:32:02.027994] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 16.1s. Estimated remaining: 2h 38m 29s. Rate: 9.5 symbols/min [2025-09-15T18:32:02.060634] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-15T18:32:02.221138] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:02.267098] [DEBUG] [LOCAL ] FSM: Loaded 40060 existing records from primary storage. [2025-09-15T18:32:02.267255] [INFO ] [MAIN ] FSM: Loaded 40060 existing records. [2025-09-15T18:32:02.467820] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:02.468120] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-15T18:32:02.468171] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-15T18:32:02.469081] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-15T18:32:02.469141] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-15T18:32:02.849305] [INFO ] [REMOTE ] FSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:02.861832] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-15T18:32:02.885864] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-15T18:32:02.933874] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:32:03.535125] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:32:03.657888] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-15T18:32:04.457871] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-15T18:32:04.634903] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:32:05.258876] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-15T18:32:05.258739] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:32:05.910195] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:32:06.057884] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-15T18:32:06.723469] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T18:32:06.857818] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-15T18:32:07.512114] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:32:07.657821] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-15T18:32:08.457887] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-15T18:32:08.613315] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:32:09.257916] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-15T18:32:09.538818] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T18:32:09.908822] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:32:10.057861] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-15T18:32:10.668148] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:32:10.857857] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-15T18:32:11.657876] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-15T18:32:11.788876] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:32:12.457922] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-15T18:32:12.539963] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T18:32:12.544444] [INFO ] [REMOTE ] FRT: Full fetch complete (45666 records). [2025-09-15T18:32:12.544534] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-15T18:32:12.545327] [FATAL] [VALIDATOR ] FRT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:12.545414] [FATAL] [MAIN ] FRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:12.545451] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:12.545489] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-15T18:32:12.545563] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-09-15T18:32:12.545609] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-09-15T18:32:12.545920] [DEBUG] [LOCAL ] FRT: Deleted derivative data file. [2025-09-15T18:32:12.546037] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRT took 32.1s. Estimated remaining: 2h 38m 29s. Rate: 9.5 symbols/min [2025-09-15T18:32:12.718657] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:12.746223] [DEBUG] [LOCAL ] FSS: Loaded 25400 existing records from primary storage. [2025-09-15T18:32:12.746367] [INFO ] [MAIN ] FSS: Loaded 25400 existing records. [2025-09-15T18:32:12.925089] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:12.925444] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-15T18:32:12.925505] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-15T18:32:12.926237] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-15T18:32:12.926292] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-15T18:32:13.268014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-15T18:32:13.303771] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:13.671512] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T18:32:14.057885] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-15T18:32:14.188203] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:32:14.857837] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-15T18:32:14.968816] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:32:15.657861] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-15T18:32:16.457938] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-15T18:32:16.509747] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-15T18:32:16.763751] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T18:32:17.257740] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:32:17.257888] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-15T18:32:17.264423] [INFO ] [REMOTE ] FSK: Full fetch complete (53600 records). [2025-09-15T18:32:17.264525] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-15T18:32:17.671356] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-15T18:32:17.671532] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-15T18:32:17.672299] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-15T18:32:17.672411] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-15T18:32:17.673865] [DEBUG] [LOCAL ] FSK: Trimmed 53600 records to 35641 (keeping 150 days of data) [2025-09-15T18:32:17.692244] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:32:17.919105] [DEBUG] [LOCAL ] FSK: Primary data saved (35641 records). [2025-09-15T18:32:17.919264] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-15T18:32:17.919373] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 30.6s. Estimated remaining: 2h 38m 21s. Rate: 9.5 symbols/min [2025-09-15T18:32:18.062995] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-15T18:32:18.094439] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:18.101042] [DEBUG] [LOCAL ] FT: Loaded 4756 existing records from primary storage. [2025-09-15T18:32:18.101198] [INFO ] [MAIN ] FT: Loaded 4756 existing records. [2025-09-15T18:32:18.279545] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:18.279809] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-15T18:32:18.279855] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-15T18:32:18.280161] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-15T18:32:18.280208] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-15T18:32:18.632306] [INFO ] [REMOTE ] FT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:18.786980] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T18:32:18.857844] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-15T18:32:19.546520] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:32:19.555983] [INFO ] [REMOTE ] FSLY: Full fetch complete (55901 records). [2025-09-15T18:32:19.556206] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-15T18:32:19.666758] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-15T18:32:20.157195] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-15T18:32:20.157319] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-15T18:32:20.158599] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-15T18:32:20.158703] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-15T18:32:20.160480] [DEBUG] [LOCAL ] FSLY: Trimmed 55901 records to 37625 (keeping 150 days of data) [2025-09-15T18:32:20.475636] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-15T18:32:20.479954] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:32:20.529098] [DEBUG] [LOCAL ] FSLY: Primary data saved (37625 records). [2025-09-15T18:32:20.529268] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-15T18:32:20.530409] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSLY took 23.4s. Estimated remaining: 2h 38m 9s. Rate: 9.5 symbols/min [2025-09-15T18:32:20.743104] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:20.755262] [DEBUG] [LOCAL ] FTHY: Loaded 8675 existing records from primary storage. [2025-09-15T18:32:20.755396] [INFO ] [MAIN ] FTHY: Loaded 8675 existing records. [2025-09-15T18:32:20.938752] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:20.939076] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-15T18:32:20.939132] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-15T18:32:20.939498] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-15T18:32:20.939548] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-15T18:32:21.262928] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-15T18:32:21.269531] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:32:21.362292] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:21.394519] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:32:22.057867] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-15T18:32:22.652230] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:32:22.688134] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:32:22.694192] [INFO ] [REMOTE ] FSM: Full fetch complete (57907 records). [2025-09-15T18:32:22.694352] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-15T18:32:22.864845] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-15T18:32:23.099764] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-15T18:32:23.099857] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-15T18:32:23.100605] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-15T18:32:23.100669] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-15T18:32:23.101948] [DEBUG] [LOCAL ] FSM: Trimmed 57907 records to 39280 (keeping 150 days of data) [2025-09-15T18:32:23.351317] [DEBUG] [LOCAL ] FSM: Primary data saved (39280 records). [2025-09-15T18:32:23.351507] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-15T18:32:23.352358] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSM took 21.3s. Estimated remaining: 2h 37m 56s. Rate: 9.5 symbols/min [2025-09-15T18:32:23.535323] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:23.577093] [DEBUG] [LOCAL ] FTI: Loaded 40086 existing records from primary storage. [2025-09-15T18:32:23.577271] [INFO ] [MAIN ] FTI: Loaded 40086 existing records. [2025-09-15T18:32:23.663039] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-15T18:32:23.790769] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:23.791041] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-15T18:32:23.791091] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-15T18:32:23.791971] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-15T18:32:23.792025] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-15T18:32:23.983824] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:32:24.201780] [INFO ] [REMOTE ] FTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:24.226404] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T18:32:24.457889] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-15T18:32:25.257852] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-15T18:32:25.816545] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:32:26.062559] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-15T18:32:26.067688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:32:26.857867] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-15T18:32:27.584633] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T18:32:27.657852] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-15T18:32:27.809915] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:32:28.247382] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:32:28.457864] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-15T18:32:29.056767] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T18:32:29.257853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-15T18:32:29.958165] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:32:30.057875] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-15T18:32:30.648243] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:32:30.857860] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-15T18:32:31.657886] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-15T18:32:31.713300] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T18:32:32.457895] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-15T18:32:33.257900] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-15T18:32:33.299334] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:32:33.471449] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:32:34.057909] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-15T18:32:34.811356] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:32:34.857829] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-15T18:32:35.657878] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-15T18:32:35.929572] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:32:36.181635] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:32:36.228750] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T18:32:36.457890] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-15T18:32:37.136740] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:32:37.139152] [INFO ] [REMOTE ] FTHY: Full fetch complete (12664 records). [2025-09-15T18:32:37.139311] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-15T18:32:37.262539] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-15T18:32:37.562339] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-15T18:32:37.562435] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-15T18:32:37.562774] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-15T18:32:37.562827] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-15T18:32:37.563471] [DEBUG] [LOCAL ] FTHY: Trimmed 12664 records to 8497 (keeping 150 days of data) [2025-09-15T18:32:37.621562] [DEBUG] [LOCAL ] FTHY: Primary data saved (8497 records). [2025-09-15T18:32:37.621757] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-15T18:32:37.621863] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FTHY took 17.1s. Estimated remaining: 2h 38m 4s. Rate: 9.5 symbols/min [2025-09-15T18:32:37.795472] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:37.821341] [DEBUG] [LOCAL ] FTK: Loaded 25122 existing records from primary storage. [2025-09-15T18:32:37.821490] [INFO ] [MAIN ] FTK: Loaded 25122 existing records. [2025-09-15T18:32:38.007195] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:38.007480] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-15T18:32:38.007541] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-15T18:32:38.008243] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-15T18:32:38.008316] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-15T18:32:38.069289] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-15T18:32:38.374434] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:38.516096] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:32:38.857883] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-15T18:32:39.584400] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:32:39.657901] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-15T18:32:40.096285] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:32:40.457885] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-15T18:32:40.996813] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:32:41.258979] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-15T18:32:41.260697] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:32:42.054122] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:32:42.060210] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-15T18:32:42.737204] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:32:42.738575] [INFO ] [REMOTE ] FT: Full fetch complete (6682 records). [2025-09-15T18:32:42.738666] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-15T18:32:42.862992] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-15T18:32:43.103507] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-15T18:32:43.103600] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-15T18:32:43.103818] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-15T18:32:43.103862] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-15T18:32:43.104348] [DEBUG] [LOCAL ] FT: Trimmed 6682 records to 4670 (keeping 150 days of data) [2025-09-15T18:32:43.133953] [DEBUG] [LOCAL ] FT: Primary data saved (4670 records). [2025-09-15T18:32:43.134086] [INFO ] [MAIN ] FT: Full history saved. [2025-09-15T18:32:43.134196] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FT took 25.2s. Estimated remaining: 2h 37m 56s. Rate: 9.5 symbols/min [2025-09-15T18:32:43.303343] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:43.337556] [DEBUG] [LOCAL ] FTS: Loaded 31771 existing records from primary storage. [2025-09-15T18:32:43.337730] [INFO ] [MAIN ] FTS: Loaded 31771 existing records. [2025-09-15T18:32:43.512754] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:43.513029] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-15T18:32:43.513096] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-15T18:32:43.514727] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-15T18:32:43.514818] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-15T18:32:43.662990] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-15T18:32:43.876992] [INFO ] [REMOTE ] FTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:44.058399] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:32:44.061895] [INFO ] [REMOTE ] FSS: Full fetch complete (38161 records). [2025-09-15T18:32:44.061984] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-15T18:32:44.440373] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-15T18:32:44.440484] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-15T18:32:44.441166] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-15T18:32:44.441214] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-15T18:32:44.442247] [DEBUG] [LOCAL ] FSS: Trimmed 38161 records to 24725 (keeping 150 days of data) [2025-09-15T18:32:44.504187] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-15T18:32:44.615226] [DEBUG] [LOCAL ] FSS: Primary data saved (24725 records). [2025-09-15T18:32:44.615387] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-15T18:32:44.615499] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FSS took 32.1s. Estimated remaining: 2h 37m 41s. Rate: 9.5 symbols/min [2025-09-15T18:32:45.257910] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-15T18:32:45.535294] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T18:32:46.003463] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:32:46.057852] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-15T18:32:46.498757] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T18:32:46.857893] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-15T18:32:47.219975] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:32:47.657877] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-15T18:32:47.982530] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T18:32:48.457936] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-15T18:32:49.095800] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:32:49.257821] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-15T18:32:50.057969] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-15T18:32:50.229572] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:32:50.369272] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:32:50.857907] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-15T18:32:51.207223] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:32:51.657868] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-15T18:32:52.263975] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:32:52.457913] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-15T18:32:52.702680] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T18:32:53.257886] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-15T18:32:53.358301] [DEBUG] [REMOTE ] FTI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-15T18:32:53.358602] [WARN ] [REMOTE ] FTI: No data returned for month 2025-09 [2025-09-15T18:32:53.358724] [INFO ] [REMOTE ] FTI: Full fetch complete (54060 records). [2025-09-15T18:32:53.358793] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-15T18:32:53.360468] [FATAL] [VALIDATOR ] FTI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:53.360555] [FATAL] [MAIN ] FTI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:53.360627] [WARN ] [MAIN ] FTI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:53.360703] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-15T18:32:53.360772] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-15T18:32:53.360811] [INFO ] [LOCAL ] FTI: Starting deletion of derivative data. [2025-09-15T18:32:53.361105] [DEBUG] [LOCAL ] FTI: Deleted derivative data file. [2025-09-15T18:32:53.361487] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FTI took 30.0s. Estimated remaining: 2h 37m 39s. Rate: 9.5 symbols/min [2025-09-15T18:32:54.069258] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-15T18:32:54.074816] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:32:54.857956] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-15T18:32:55.176624] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:32:55.657928] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-15T18:32:56.402995] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:32:56.457841] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-15T18:32:56.965949] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:32:57.257939] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-15T18:32:57.902672] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T18:32:57.908867] [INFO ] [REMOTE ] FTS: Full fetch complete (45925 records). [2025-09-15T18:32:57.909034] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-15T18:32:58.284982] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-15T18:32:58.285096] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-15T18:32:58.285781] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-15T18:32:58.285826] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-15T18:32:58.286832] [DEBUG] [LOCAL ] FTS: Trimmed 45925 records to 31167 (keeping 150 days of data) [2025-09-15T18:32:58.412181] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:32:58.436058] [INFO ] [REMOTE ] FTK: Full fetch complete (33328 records). [2025-09-15T18:32:58.436330] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-15T18:32:58.466400] [FATAL] [VALIDATOR ] FTK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:58.488468] [FATAL] [MAIN ] FTK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:58.493183] [WARN ] [MAIN ] FTK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:58.493995] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-15T18:32:58.494350] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-15T18:32:58.494735] [INFO ] [LOCAL ] FTK: Starting deletion of derivative data. [2025-09-15T18:32:58.495576] [DEBUG] [LOCAL ] FTK: Deleted derivative data file. [2025-09-15T18:32:58.496242] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 20.9s. Estimated remaining: 2h 37m 31s. Rate: 9.5 symbols/min [2025-09-15T18:32:58.510305] [DEBUG] [LOCAL ] FTS: Primary data saved (31167 records). [2025-09-15T18:32:58.510390] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-15T18:32:58.510478] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTS took 15.4s. Estimated remaining: 2h 37m 13s. Rate: 9.5 symbols/min [2025-09-15T18:32:59.189850] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.207403] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.228544] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.209697] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.237040] [DEBUG] [LOCAL ] FTWO: Loaded 1288 existing records from primary storage. [2025-09-15T18:32:59.237305] [INFO ] [MAIN ] FTWO: Loaded 1288 existing records. [2025-09-15T18:32:59.472179] [DEBUG] [LOCAL ] FUL: Loaded 23457 existing records from primary storage. [2025-09-15T18:32:59.476783] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:59.478015] [INFO ] [MAIN ] FUL: Loaded 23457 existing records. [2025-09-15T18:32:59.496867] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-15T18:32:59.496990] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-15T18:32:59.497244] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-15T18:32:59.527681] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-15T18:32:59.544513] [DEBUG] [LOCAL ] FUBO: Loaded 40467 existing records from primary storage. [2025-09-15T18:32:59.611034] [INFO ] [MAIN ] FUBO: Loaded 40467 existing records. [2025-09-15T18:32:59.645001] [DEBUG] [LOCAL ] FTV: Loaded 39924 existing records from primary storage. [2025-09-15T18:32:59.789731] [INFO ] [MAIN ] FTV: Loaded 39924 existing records. [2025-09-15T18:33:00.172772] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.277064] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.250756] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.291878] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-15T18:33:00.297515] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.324535] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-15T18:33:00.324666] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-15T18:33:00.372159] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-15T18:33:00.382572] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-15T18:33:00.382436] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-15T18:33:00.459344] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.505974] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.595274] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:00.569353] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-15T18:33:00.650843] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-15T18:33:00.676777] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-15T18:33:00.703274] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-15T18:33:01.347954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:33:01.489423] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-15T18:33:01.526817] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.579687] [INFO ] [REMOTE ] FUL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.581227] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-15T18:33:01.581601] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-15T18:33:01.663124] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.663473] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-15T18:33:03.931905] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-15T18:33:03.933156] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-15T18:33:04.129005] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-15T18:33:04.135756] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-15T18:33:04.604707] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-15T18:33:04.614597] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-15T18:33:05.084377] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:33:05.085574] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-15T18:33:05.121899] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (3.54 seconds). [2025-09-15T18:33:05.257920] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-15T18:33:05.436577] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T18:33:05.802780] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:33:06.057882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-15T18:33:06.244034] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T18:33:06.504279] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T18:33:06.857833] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-15T18:33:07.354267] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-15T18:33:07.657878] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-15T18:33:08.275407] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:33:08.457865] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-15T18:33:09.049466] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:33:09.257869] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-15T18:33:09.579072] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:33:10.057893] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-15T18:33:10.255767] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T18:33:10.420226] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:33:10.857870] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-15T18:33:11.367659] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:33:11.368502] [INFO ] [REMOTE ] FTWO: Full fetch complete (2020 records). [2025-09-15T18:33:11.368573] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-15T18:33:11.662929] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-15T18:33:11.727990] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-15T18:33:11.728068] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-15T18:33:11.728165] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-15T18:33:11.728217] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-15T18:33:11.728570] [DEBUG] [LOCAL ] FTWO: Trimmed 2020 records to 1273 (keeping 150 days of data) [2025-09-15T18:33:11.737617] [DEBUG] [LOCAL ] FTWO: Primary data saved (1273 records). [2025-09-15T18:33:11.737725] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-15T18:33:11.737820] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 13.2s. Estimated remaining: 2h 37m 19s. Rate: 9.5 symbols/min [2025-09-15T18:33:11.908998] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:11.954820] [DEBUG] [LOCAL ] FUN: Loaded 39041 existing records from primary storage. [2025-09-15T18:33:11.955021] [INFO ] [MAIN ] FUN: Loaded 39041 existing records. [2025-09-15T18:33:12.134309] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:12.134561] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-15T18:33:12.134609] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-15T18:33:12.135425] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-15T18:33:12.135491] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-15T18:33:12.463570] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-15T18:33:12.491492] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:13.257956] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-15T18:33:14.048726] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-15T18:33:14.060005] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-15T18:33:14.516511] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:33:14.857926] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-15T18:33:14.970919] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T18:33:15.657917] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-15T18:33:16.457941] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-15T18:33:16.619394] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-15T18:33:17.096376] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T18:33:17.257869] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-15T18:33:17.791163] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:33:18.057882] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-15T18:33:18.149416] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-15T18:33:18.740893] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:33:18.857882] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-15T18:33:19.453023] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:33:19.657887] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-15T18:33:20.457945] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-15T18:33:20.688100] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T18:33:21.234805] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:33:21.241891] [INFO ] [REMOTE ] FTV: Full fetch complete (57505 records). [2025-09-15T18:33:21.242156] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-15T18:33:21.267366] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-15T18:33:21.642025] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-15T18:33:21.642109] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-15T18:33:21.642905] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-15T18:33:21.642951] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-15T18:33:21.644104] [DEBUG] [LOCAL ] FTV: Trimmed 57505 records to 39181 (keeping 150 days of data) [2025-09-15T18:33:21.895970] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:33:21.937149] [DEBUG] [LOCAL ] FTV: Primary data saved (39181 records). [2025-09-15T18:33:21.937312] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-15T18:33:21.937405] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTV took 23.4s. Estimated remaining: 2h 37m 19s. Rate: 9.5 symbols/min [2025-09-15T18:33:22.062949] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-15T18:33:22.109971] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:22.126792] [DEBUG] [LOCAL ] FVR: Loaded 16555 existing records from primary storage. [2025-09-15T18:33:22.126924] [INFO ] [MAIN ] FVR: Loaded 16555 existing records. [2025-09-15T18:33:22.301776] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:22.302016] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-15T18:33:22.302064] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-15T18:33:22.302564] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-15T18:33:22.302615] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-15T18:33:22.649990] [INFO ] [REMOTE ] FVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:22.857882] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-15T18:33:23.364225] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:33:23.443886] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:33:23.505477] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:33:23.657891] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-15T18:33:24.457887] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-15T18:33:25.214523] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:33:25.257833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-15T18:33:26.057871] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-15T18:33:26.520232] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-15T18:33:26.857873] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-15T18:33:27.099094] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:33:27.471852] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:33:27.657906] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-15T18:33:28.457880] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-15T18:33:28.725724] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:33:28.729262] [INFO ] [REMOTE ] FUL: Full fetch complete (35446 records). [2025-09-15T18:33:28.729336] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-15T18:33:28.729901] [FATAL] [VALIDATOR ] FUL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:33:28.729976] [FATAL] [MAIN ] FUL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:33:28.730013] [WARN ] [MAIN ] FUL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:33:28.730051] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-15T18:33:28.730132] [DEBUG] [LOCAL ] FUL: No primary data file found to delete. [2025-09-15T18:33:28.730170] [INFO ] [LOCAL ] FUL: Starting deletion of derivative data. [2025-09-15T18:33:28.730496] [DEBUG] [LOCAL ] FUL: Deleted derivative data file. [2025-09-15T18:33:28.730588] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FUL took 30.2s. Estimated remaining: 2h 37m 13s. Rate: 9.5 symbols/min [2025-09-15T18:33:28.899823] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:28.931946] [DEBUG] [LOCAL ] FVRR: Loaded 30096 existing records from primary storage. [2025-09-15T18:33:28.932169] [INFO ] [MAIN ] FVRR: Loaded 30096 existing records. [2025-09-15T18:33:29.113825] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:29.114246] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-15T18:33:29.114356] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-15T18:33:29.120315] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-15T18:33:29.129911] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-15T18:33:29.175482] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T18:33:29.252284] [INFO ] [REMOTE ] FUBO: Full fetch complete (58379 records). [2025-09-15T18:33:29.262724] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-15T18:33:29.291503] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-15T18:33:29.666499] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:29.918967] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-15T18:33:29.919531] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:33:29.919666] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-15T18:33:29.925360] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-15T18:33:29.926081] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-15T18:33:29.927227] [DEBUG] [LOCAL ] FUBO: Trimmed 58379 records to 39688 (keeping 150 days of data) [2025-09-15T18:33:30.058447] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-15T18:33:30.177457] [DEBUG] [LOCAL ] FUBO: Primary data saved (39688 records). [2025-09-15T18:33:30.177613] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-15T18:33:30.177729] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 31.7s. Estimated remaining: 2h 36m 59s. Rate: 9.5 symbols/min [2025-09-15T18:33:30.352785] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:30.355564] [DEBUG] [LOCAL ] FXED: Loaded 881 existing records from primary storage. [2025-09-15T18:33:30.355664] [INFO ] [MAIN ] FXED: Loaded 881 existing records. [2025-09-15T18:33:30.575256] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:30.575583] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-15T18:33:30.575674] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-15T18:33:30.575894] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-15T18:33:30.575961] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-15T18:33:30.860102] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-15T18:33:30.943740] [INFO ] [REMOTE ] FXED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:30.958117] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:33:30.994858] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:33:31.657813] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-15T18:33:32.457908] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-15T18:33:32.622114] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:33:32.748284] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:33:33.257878] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-15T18:33:33.940500] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:33:34.057837] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-15T18:33:34.732100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:33:34.857890] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-15T18:33:35.657856] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-15T18:33:35.692872] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:33:35.698738] [INFO ] [REMOTE ] FUN: Full fetch complete (55573 records). [2025-09-15T18:33:35.698852] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-15T18:33:36.083295] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-15T18:33:36.083380] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-15T18:33:36.084122] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-15T18:33:36.084170] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-15T18:33:36.085411] [DEBUG] [LOCAL ] FUN: Trimmed 55573 records to 38428 (keeping 150 days of data) [2025-09-15T18:33:36.139480] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T18:33:36.314485] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T18:33:36.352887] [DEBUG] [LOCAL ] FUN: Primary data saved (38428 records). [2025-09-15T18:33:36.353066] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-15T18:33:36.354394] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FUN took 24.6s. Estimated remaining: 2h 36m 52s. Rate: 9.5 symbols/min [2025-09-15T18:33:36.462930] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-15T18:33:36.528738] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:36.568144] [DEBUG] [LOCAL ] G: Loaded 37400 existing records from primary storage. [2025-09-15T18:33:36.568284] [INFO ] [MAIN ] G: Loaded 37400 existing records. [2025-09-15T18:33:36.742159] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:36.742422] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-15T18:33:36.742469] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-15T18:33:36.743469] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-15T18:33:36.743523] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-15T18:33:36.917119] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:33:37.105310] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:37.257893] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-15T18:33:38.057886] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-15T18:33:38.857893] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-15T18:33:39.008087] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:33:39.638365] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:33:39.657834] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-15T18:33:39.936255] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:33:40.457886] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-15T18:33:40.636897] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:33:41.239939] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:33:41.257814] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-15T18:33:42.057938] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-15T18:33:42.276059] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:33:42.857931] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-15T18:33:43.663797] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-15T18:33:43.683531] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:33:44.292917] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T18:33:44.332368] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:33:44.457825] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-15T18:33:45.257890] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-15T18:33:45.672278] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:33:46.057895] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-15T18:33:46.226997] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:33:46.441371] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:33:46.857874] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-15T18:33:47.657907] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-15T18:33:48.457883] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-15T18:33:48.575651] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:33:48.642473] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:33:48.644962] [INFO ] [REMOTE ] FVR: Full fetch complete (23342 records). [2025-09-15T18:33:48.645068] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-15T18:33:49.033185] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-15T18:33:49.033271] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-15T18:33:49.033853] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-15T18:33:49.033908] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-15T18:33:49.034598] [DEBUG] [LOCAL ] FVR: Trimmed 23342 records to 16121 (keeping 150 days of data) [2025-09-15T18:33:49.137391] [DEBUG] [LOCAL ] FVR: Primary data saved (16121 records). [2025-09-15T18:33:49.137556] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-15T18:33:49.137673] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FVR took 27.2s. Estimated remaining: 2h 36m 57s. Rate: 9.4 symbols/min [2025-09-15T18:33:49.262952] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-15T18:33:49.318032] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:49.337117] [DEBUG] [LOCAL ] GAB: Loaded 19836 existing records from primary storage. [2025-09-15T18:33:49.337242] [INFO ] [MAIN ] GAB: Loaded 19836 existing records. [2025-09-15T18:33:49.540196] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:49.540518] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-15T18:33:49.540577] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-15T18:33:49.541305] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-15T18:33:49.541362] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-15T18:33:49.644815] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T18:33:49.908970] [INFO ] [REMOTE ] GAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:50.057869] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-15T18:33:50.175618] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:33:50.560451] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:33:50.857880] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-15T18:33:51.657930] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-15T18:33:52.432159] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:33:52.457830] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-15T18:33:52.931518] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:33:53.257871] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-15T18:33:54.062935] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-15T18:33:54.081502] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:33:54.230702] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:33:54.591304] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:33:54.592107] [INFO ] [REMOTE ] FXED: Full fetch complete (1283 records). [2025-09-15T18:33:54.592179] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-15T18:33:54.863001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-15T18:33:54.958971] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-15T18:33:54.959059] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-15T18:33:54.959147] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-15T18:33:54.959186] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-15T18:33:54.959522] [DEBUG] [LOCAL ] FXED: Trimmed 1283 records to 868 (keeping 150 days of data) [2025-09-15T18:33:54.965591] [DEBUG] [LOCAL ] FXED: Primary data saved (868 records). [2025-09-15T18:33:54.965669] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-15T18:33:54.965761] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FXED took 24.8s. Estimated remaining: 2h 36m 49s. Rate: 9.5 symbols/min [2025-09-15T18:33:55.140257] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:55.145564] [DEBUG] [LOCAL ] GAM: Loaded 2802 existing records from primary storage. [2025-09-15T18:33:55.145698] [INFO ] [MAIN ] GAM: Loaded 2802 existing records. [2025-09-15T18:33:55.324033] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:55.324327] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-15T18:33:55.324386] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-15T18:33:55.324608] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-15T18:33:55.324681] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-15T18:33:55.673066] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-15T18:33:55.677167] [INFO ] [REMOTE ] GAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:56.263719] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:33:56.457887] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-15T18:33:56.962716] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:33:57.245077] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:33:57.257814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-15T18:33:58.057887] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-15T18:33:58.857846] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-15T18:33:58.875449] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:33:58.919092] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:33:58.924695] [INFO ] [REMOTE ] G: Full fetch complete (54200 records). [2025-09-15T18:33:58.924818] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-15T18:33:59.311740] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-15T18:33:59.311830] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-15T18:33:59.312583] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-15T18:33:59.312623] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-15T18:33:59.313788] [DEBUG] [LOCAL ] G: Trimmed 54200 records to 36743 (keeping 150 days of data) [2025-09-15T18:33:59.547632] [DEBUG] [LOCAL ] G: Primary data saved (36743 records). [2025-09-15T18:33:59.547791] [INFO ] [MAIN ] G: Full history saved. [2025-09-15T18:33:59.547938] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. G took 23.2s. Estimated remaining: 2h 36m 40s. Rate: 9.5 symbols/min [2025-09-15T18:33:59.663005] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-15T18:33:59.722901] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:59.762560] [DEBUG] [LOCAL ] GAP: Loaded 40398 existing records from primary storage. [2025-09-15T18:33:59.762723] [INFO ] [MAIN ] GAP: Loaded 40398 existing records. [2025-09-15T18:33:59.948809] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:59.949152] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-15T18:33:59.949207] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-15T18:33:59.950242] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-15T18:33:59.950300] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-15T18:34:00.316711] [INFO ] [REMOTE ] GAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:00.329998] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:34:00.334410] [INFO ] [REMOTE ] FVRR: Full fetch complete (44022 records). [2025-09-15T18:34:00.334529] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-15T18:34:00.462939] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-15T18:34:00.722889] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-15T18:34:00.722987] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-15T18:34:00.723690] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-15T18:34:00.723736] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-15T18:34:00.724839] [DEBUG] [LOCAL ] FVRR: Trimmed 44022 records to 29697 (keeping 150 days of data) [2025-09-15T18:34:00.901320] [DEBUG] [LOCAL ] FVRR: Primary data saved (29697 records). [2025-09-15T18:34:00.901483] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-15T18:34:00.901601] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 32.2s. Estimated remaining: 2h 36m 25s. Rate: 9.5 symbols/min [2025-09-15T18:34:01.079979] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:01.098478] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:34:01.117238] [DEBUG] [LOCAL ] GATX: Loaded 13288 existing records from primary storage. [2025-09-15T18:34:01.117381] [INFO ] [MAIN ] GATX: Loaded 13288 existing records. [2025-09-15T18:34:01.262922] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-15T18:34:01.298863] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:01.299101] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-15T18:34:01.299150] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-15T18:34:01.299596] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-15T18:34:01.299674] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-15T18:34:01.472166] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:34:01.682413] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:02.057934] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-15T18:34:02.416019] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:34:02.857907] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-15T18:34:03.042471] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:34:03.657884] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-15T18:34:04.362339] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:34:04.457826] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-15T18:34:04.521434] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:34:05.257918] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-15T18:34:05.525317] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:34:06.057910] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-15T18:34:06.242571] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:34:06.246043] [INFO ] [REMOTE ] GAB: Full fetch complete (29411 records). [2025-09-15T18:34:06.246142] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-15T18:34:06.625996] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-15T18:34:06.626087] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-15T18:34:06.626633] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-15T18:34:06.626705] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-15T18:34:06.627578] [DEBUG] [LOCAL ] GAB: Trimmed 29411 records to 19323 (keeping 150 days of data) [2025-09-15T18:34:06.718045] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T18:34:06.748866] [DEBUG] [LOCAL ] GAB: Primary data saved (19323 records). [2025-09-15T18:34:06.749048] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-15T18:34:06.749145] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. GAB took 17.6s. Estimated remaining: 2h 36m 18s. Rate: 9.5 symbols/min [2025-09-15T18:34:06.862999] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-15T18:34:06.922341] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:06.933522] [DEBUG] [LOCAL ] GBAB: Loaded 9681 existing records from primary storage. [2025-09-15T18:34:06.933693] [INFO ] [MAIN ] GBAB: Loaded 9681 existing records. [2025-09-15T18:34:07.114891] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:07.115173] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-15T18:34:07.115220] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-15T18:34:07.115671] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-15T18:34:07.115725] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-15T18:34:07.525927] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:07.657958] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-15T18:34:07.852205] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:34:08.014710] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T18:34:08.457874] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-15T18:34:09.044884] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:34:09.257870] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-15T18:34:10.045417] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:34:10.057815] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-15T18:34:10.705603] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T18:34:10.857861] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-15T18:34:11.657875] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-15T18:34:11.950263] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:34:11.951243] [INFO ] [REMOTE ] GAM: Full fetch complete (4968 records). [2025-09-15T18:34:11.951315] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-15T18:34:12.319789] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-15T18:34:12.319877] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-15T18:34:12.320036] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-15T18:34:12.320076] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-15T18:34:12.320447] [DEBUG] [LOCAL ] GAM: Trimmed 4968 records to 2775 (keeping 150 days of data) [2025-09-15T18:34:12.338988] [DEBUG] [LOCAL ] GAM: Primary data saved (2775 records). [2025-09-15T18:34:12.339145] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-15T18:34:12.339237] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAM took 17.4s. Estimated remaining: 2h 36m 11s. Rate: 9.5 symbols/min [2025-09-15T18:34:12.463060] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-15T18:34:12.526978] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:12.561024] [DEBUG] [LOCAL ] GBCI: Loaded 29959 existing records from primary storage. [2025-09-15T18:34:12.561210] [INFO ] [MAIN ] GBCI: Loaded 29959 existing records. [2025-09-15T18:34:12.740707] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:12.741031] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-15T18:34:12.741078] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-15T18:34:12.741781] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-15T18:34:12.741831] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-15T18:34:13.098624] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:13.257905] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-15T18:34:13.330750] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:34:13.670258] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:34:14.057953] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-15T18:34:14.075534] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T18:34:14.857936] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-15T18:34:15.657941] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-15T18:34:16.457931] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-15T18:34:16.631595] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-15T18:34:16.725732] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:34:16.912179] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T18:34:17.257878] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-15T18:34:17.291990] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T18:34:17.886885] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T18:34:18.057873] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-15T18:34:18.857884] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-15T18:34:19.409665] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:34:19.657932] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-15T18:34:20.109028] [DEBUG] [REMOTE ] GBCI: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-15T18:34:20.109199] [WARN ] [REMOTE ] GBCI: No data returned for month 2025-03 [2025-09-15T18:34:20.457904] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-15T18:34:20.630844] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:34:20.633194] [INFO ] [REMOTE ] GATX: Full fetch complete (18808 records). [2025-09-15T18:34:20.633276] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-15T18:34:20.633794] [FATAL] [VALIDATOR ] GATX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:34:20.633877] [FATAL] [MAIN ] GATX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:20.633916] [WARN ] [MAIN ] GATX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:20.633955] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-15T18:34:20.634013] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-15T18:34:20.634069] [INFO ] [LOCAL ] GATX: Starting deletion of derivative data. [2025-09-15T18:34:20.634388] [DEBUG] [LOCAL ] GATX: Deleted derivative data file. [2025-09-15T18:34:20.634474] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GATX took 19.7s. Estimated remaining: 2h 36m 8s. Rate: 9.5 symbols/min [2025-09-15T18:34:20.804610] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:20.804850] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-15T18:34:20.804891] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-15T18:34:20.805012] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-15T18:34:20.805050] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-15T18:34:20.805090] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-15T18:34:20.805123] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-15T18:34:21.178823] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:21.257863] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-15T18:34:21.410998] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:34:21.956675] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:34:22.057919] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-15T18:34:22.857875] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-15T18:34:23.230584] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T18:34:23.531380] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:34:23.657862] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-15T18:34:24.457936] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-15T18:34:25.144604] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:34:25.257888] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-15T18:34:26.057908] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-15T18:34:26.311071] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:34:26.538799] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:34:26.788192] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:34:26.857909] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-15T18:34:27.221804] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-15T18:34:27.657874] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-15T18:34:28.457890] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-15T18:34:28.863754] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:34:29.257868] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-15T18:34:29.897127] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-15T18:34:30.057872] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-15T18:34:30.170333] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:34:30.857872] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-15T18:34:31.093288] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-15T18:34:31.457906] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:34:31.657883] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-15T18:34:31.979258] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:34:32.457880] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-15T18:34:33.257917] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-15T18:34:33.462980] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:34:34.057969] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-15T18:34:34.807561] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:34:34.857908] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-15T18:34:35.061802] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:34:35.645184] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:34:35.657808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-15T18:34:36.457894] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-15T18:34:36.464873] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T18:34:36.466829] [INFO ] [REMOTE ] GBAB: Full fetch complete (14412 records). [2025-09-15T18:34:36.466916] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-15T18:34:36.823216] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-15T18:34:36.823295] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-15T18:34:36.823602] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-15T18:34:36.823657] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-15T18:34:36.824146] [DEBUG] [LOCAL ] GBAB: Trimmed 14412 records to 9535 (keeping 150 days of data) [2025-09-15T18:34:36.881249] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:34:36.889452] [DEBUG] [LOCAL ] GBAB: Primary data saved (9535 records). [2025-09-15T18:34:36.889532] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-15T18:34:36.889614] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GBAB took 30.1s. Estimated remaining: 2h 36m 18s. Rate: 9.4 symbols/min [2025-09-15T18:34:37.066151] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:37.093899] [DEBUG] [LOCAL ] GBTG: Loaded 30281 existing records from primary storage. [2025-09-15T18:34:37.094038] [INFO ] [MAIN ] GBTG: Loaded 30281 existing records. [2025-09-15T18:34:37.260885] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-15T18:34:37.279294] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:37.280276] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-15T18:34:37.280344] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-15T18:34:37.281119] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-15T18:34:37.281206] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-15T18:34:37.668765] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:37.963326] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:34:37.964132] [INFO ] [REMOTE ] GBLI: Full fetch complete (1052 records). [2025-09-15T18:34:37.964201] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-15T18:34:38.062961] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-15T18:34:38.149392] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:34:38.149671] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:38.149725] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:38.149774] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-15T18:34:38.149847] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-15T18:34:38.149886] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-15T18:34:38.149928] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-15T18:34:38.149999] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GBLI took 17.5s. Estimated remaining: 2h 36m 3s. Rate: 9.5 symbols/min [2025-09-15T18:34:38.330189] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:38.354841] [DEBUG] [LOCAL ] GBX: Loaded 21172 existing records from primary storage. [2025-09-15T18:34:38.355015] [INFO ] [MAIN ] GBX: Loaded 21172 existing records. [2025-09-15T18:34:38.550485] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:38.550809] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-15T18:34:38.550872] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-15T18:34:38.551488] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-15T18:34:38.551561] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-15T18:34:38.863013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-15T18:34:38.931389] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:39.657917] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-15T18:34:39.974035] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T18:34:40.024274] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:34:40.457871] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-15T18:34:41.082335] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:34:41.257887] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-15T18:34:41.903667] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:34:41.908088] [INFO ] [REMOTE ] GBCI: Full fetch complete (37432 records). [2025-09-15T18:34:41.908182] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-15T18:34:42.059878] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-15T18:34:42.097191] [WARN ] [VALIDATOR ] GBCI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:34:42.097768] [FATAL] [MAIN ] GBCI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:42.097852] [WARN ] [MAIN ] GBCI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:42.097921] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-15T18:34:42.098020] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-15T18:34:42.098075] [INFO ] [LOCAL ] GBCI: Starting deletion of derivative data. [2025-09-15T18:34:42.098334] [DEBUG] [LOCAL ] GBCI: Deleted derivative data file. [2025-09-15T18:34:42.098429] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBCI took 29.8s. Estimated remaining: 2h 35m 53s. Rate: 9.5 symbols/min [2025-09-15T18:34:42.270180] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:42.301759] [DEBUG] [LOCAL ] GCI: Loaded 33004 existing records from primary storage. [2025-09-15T18:34:42.301902] [INFO ] [MAIN ] GCI: Loaded 33004 existing records. [2025-09-15T18:34:42.479327] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:42.479600] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-15T18:34:42.479664] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-15T18:34:42.480266] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-15T18:34:42.480315] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-15T18:34:42.842878] [INFO ] [REMOTE ] GCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:42.857825] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-15T18:34:43.170672] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:34:43.230687] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T18:34:43.239105] [INFO ] [REMOTE ] GAP: Full fetch complete (58330 records). [2025-09-15T18:34:43.239354] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-15T18:34:43.655555] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-15T18:34:43.655664] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-15T18:34:43.656442] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-15T18:34:43.656502] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-15T18:34:43.657754] [DEBUG] [LOCAL ] GAP: Trimmed 58330 records to 39617 (keeping 150 days of data) [2025-09-15T18:34:43.657910] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-15T18:34:43.915402] [DEBUG] [LOCAL ] GAP: Primary data saved (39617 records). [2025-09-15T18:34:43.915595] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-15T18:34:43.916302] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GAP took 44.4s. Estimated remaining: 2h 35m 39s. Rate: 9.5 symbols/min [2025-09-15T18:34:44.087225] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:44.108164] [DEBUG] [LOCAL ] GCO: Loaded 17713 existing records from primary storage. [2025-09-15T18:34:44.108335] [INFO ] [MAIN ] GCO: Loaded 17713 existing records. [2025-09-15T18:34:44.283007] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:44.283250] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-15T18:34:44.283295] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-15T18:34:44.283879] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-15T18:34:44.283930] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-15T18:34:44.488477] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-15T18:34:44.642750] [INFO ] [REMOTE ] GCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:44.683480] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:34:45.069389] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:34:45.257892] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-15T18:34:45.859204] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T18:34:46.057870] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-15T18:34:46.565735] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:34:46.857835] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-15T18:34:47.254950] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:34:47.657884] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-15T18:34:48.290135] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:34:48.457863] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-15T18:34:48.753893] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:34:49.257866] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-15T18:34:49.325813] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:34:50.057877] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-15T18:34:50.287275] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:34:50.857868] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-15T18:34:51.071129] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:34:51.657880] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-15T18:34:52.243955] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:34:52.457886] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-15T18:34:53.095481] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:34:53.257869] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-15T18:34:53.805111] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:34:54.057886] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-15T18:34:54.624174] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:34:54.857922] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-15T18:34:55.142464] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:34:55.145582] [INFO ] [REMOTE ] GBX: Full fetch complete (32561 records). [2025-09-15T18:34:55.145739] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-15T18:34:55.523199] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-15T18:34:55.523283] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-15T18:34:55.523956] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-15T18:34:55.524002] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-15T18:34:55.524839] [DEBUG] [LOCAL ] GBX: Trimmed 32561 records to 20311 (keeping 150 days of data) [2025-09-15T18:34:55.658379] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-15T18:34:55.660029] [DEBUG] [LOCAL ] GBX: Primary data saved (20311 records). [2025-09-15T18:34:55.660920] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-15T18:34:55.661009] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBX took 17.5s. Estimated remaining: 2h 35m 41s. Rate: 9.5 symbols/min [2025-09-15T18:34:55.838686] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:55.855780] [DEBUG] [LOCAL ] GCTS: Loaded 15783 existing records from primary storage. [2025-09-15T18:34:55.855906] [INFO ] [MAIN ] GCTS: Loaded 15783 existing records. [2025-09-15T18:34:56.033424] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:56.033726] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-15T18:34:56.033776] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-15T18:34:56.034199] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-15T18:34:56.034266] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-15T18:34:56.388052] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:56.414342] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:34:56.457836] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-15T18:34:56.857368] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:34:57.257898] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-15T18:34:57.921491] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:34:58.041795] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:34:58.057825] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-15T18:34:58.857851] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-15T18:34:59.081617] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T18:34:59.657895] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-15T18:34:59.957960] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:34:59.962603] [INFO ] [REMOTE ] GBTG: Full fetch complete (43485 records). [2025-09-15T18:34:59.962791] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-15T18:35:00.347451] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-15T18:35:00.347539] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-15T18:35:00.348284] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-15T18:35:00.348337] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-15T18:35:00.349332] [DEBUG] [LOCAL ] GBTG: Trimmed 43485 records to 29741 (keeping 150 days of data) [2025-09-15T18:35:00.463043] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-15T18:35:00.534188] [DEBUG] [LOCAL ] GBTG: Primary data saved (29741 records). [2025-09-15T18:35:00.534345] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-15T18:35:00.534448] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBTG took 23.6s. Estimated remaining: 2h 35m 32s. Rate: 9.5 symbols/min [2025-09-15T18:35:00.707054] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:00.713855] [DEBUG] [LOCAL ] GCV: Loaded 5535 existing records from primary storage. [2025-09-15T18:35:00.713974] [INFO ] [MAIN ] GCV: Loaded 5535 existing records. [2025-09-15T18:35:00.891591] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:00.892151] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-15T18:35:00.892243] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-15T18:35:00.900416] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-15T18:35:00.900927] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-15T18:35:00.901231] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:35:01.261696] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:01.261753] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-15T18:35:01.689832] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:35:02.057927] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-15T18:35:02.803799] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T18:35:02.824405] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:35:02.857827] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-15T18:35:03.657889] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-15T18:35:04.002047] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:35:04.005196] [INFO ] [REMOTE ] GCO: Full fetch complete (27896 records). [2025-09-15T18:35:04.005268] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-15T18:35:04.374266] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-15T18:35:04.374394] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-15T18:35:04.375228] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-15T18:35:04.375333] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-15T18:35:04.386118] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T18:35:04.391244] [DEBUG] [LOCAL ] GCO: Trimmed 27896 records to 17261 (keeping 150 days of data) [2025-09-15T18:35:04.466880] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-15T18:35:04.496980] [DEBUG] [LOCAL ] GCO: Primary data saved (17261 records). [2025-09-15T18:35:04.497097] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-15T18:35:04.497193] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 20.6s. Estimated remaining: 2h 35m 22s. Rate: 9.5 symbols/min [2025-09-15T18:35:04.665171] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:04.702135] [DEBUG] [LOCAL ] GD: Loaded 35042 existing records from primary storage. [2025-09-15T18:35:04.702313] [INFO ] [MAIN ] GD: Loaded 35042 existing records. [2025-09-15T18:35:04.884279] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:04.884803] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-15T18:35:04.884873] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-15T18:35:04.885912] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-15T18:35:04.886000] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-15T18:35:05.263430] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-15T18:35:05.270904] [INFO ] [REMOTE ] GD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:05.626137] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:35:06.057934] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-15T18:35:06.532332] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:35:06.857884] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-15T18:35:07.657835] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-15T18:35:07.700256] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:35:07.757513] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T18:35:08.457918] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-15T18:35:08.510706] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:35:09.257875] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-15T18:35:09.832506] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T18:35:10.014987] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:35:10.057868] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-15T18:35:10.857907] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-15T18:35:11.482753] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:35:11.657845] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-15T18:35:12.073476] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T18:35:12.221004] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:35:12.457870] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-15T18:35:12.849400] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T18:35:13.257881] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-15T18:35:13.957093] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:35:14.057854] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-15T18:35:14.810809] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:35:14.857881] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-15T18:35:15.657866] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-15T18:35:16.455114] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:35:16.458530] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-15T18:35:16.570768] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T18:35:17.257897] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-15T18:35:17.368321] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:35:17.370153] [INFO ] [REMOTE ] GCV: Full fetch complete (7491 records). [2025-09-15T18:35:17.370232] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-15T18:35:17.737455] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-15T18:35:17.737560] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-15T18:35:17.737784] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-15T18:35:17.737840] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-15T18:35:17.738253] [DEBUG] [LOCAL ] GCV: Trimmed 7491 records to 5377 (keeping 150 days of data) [2025-09-15T18:35:17.772191] [DEBUG] [LOCAL ] GCV: Primary data saved (5377 records). [2025-09-15T18:35:17.772344] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-15T18:35:17.772479] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCV took 17.2s. Estimated remaining: 2h 35m 27s. Rate: 9.4 symbols/min [2025-09-15T18:35:17.950007] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:17.993062] [DEBUG] [LOCAL ] GDDY: Loaded 37225 existing records from primary storage. [2025-09-15T18:35:17.993214] [INFO ] [MAIN ] GDDY: Loaded 37225 existing records. [2025-09-15T18:35:18.063001] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-15T18:35:18.185909] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:18.186187] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-15T18:35:18.186240] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-15T18:35:18.187253] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-15T18:35:18.187345] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-15T18:35:18.722961] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:18.772179] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T18:35:18.858053] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-15T18:35:19.204966] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T18:35:19.657867] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-15T18:35:20.457862] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-15T18:35:20.825443] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T18:35:20.866071] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:35:20.868429] [INFO ] [REMOTE ] GCTS: Full fetch complete (20403 records). [2025-09-15T18:35:20.868498] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-15T18:35:20.868960] [FATAL] [VALIDATOR ] GCTS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:35:20.869035] [FATAL] [MAIN ] GCTS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:35:20.869090] [WARN ] [MAIN ] GCTS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:35:20.869133] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-15T18:35:20.869208] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-15T18:35:20.869257] [INFO ] [LOCAL ] GCTS: Starting deletion of derivative data. [2025-09-15T18:35:20.869724] [DEBUG] [LOCAL ] GCTS: Deleted derivative data file. [2025-09-15T18:35:20.869841] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 25.2s. Estimated remaining: 2h 35m 16s. Rate: 9.5 symbols/min [2025-09-15T18:35:21.043203] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:21.048130] [DEBUG] [LOCAL ] GDIV: Loaded 2692 existing records from primary storage. [2025-09-15T18:35:21.048260] [INFO ] [MAIN ] GDIV: Loaded 2692 existing records. [2025-09-15T18:35:21.239077] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:21.239347] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-15T18:35:21.239393] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-15T18:35:21.239670] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-15T18:35:21.239720] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-15T18:35:21.263095] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-15T18:35:21.603293] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:22.057871] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-15T18:35:22.350185] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T18:35:22.857867] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-15T18:35:22.936511] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T18:35:23.625887] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:35:23.657867] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-15T18:35:24.457846] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-15T18:35:24.557619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T18:35:25.257884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-15T18:35:25.332390] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:35:25.725919] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:35:26.057913] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-15T18:35:26.821907] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:35:26.859026] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-15T18:35:26.862231] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:35:27.657914] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-15T18:35:28.211563] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:35:28.457874] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-15T18:35:28.846075] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:35:29.135361] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:35:29.140834] [INFO ] [REMOTE ] GD: Full fetch complete (52179 records). [2025-09-15T18:35:29.141023] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-15T18:35:29.263047] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-15T18:35:29.583265] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-15T18:35:29.583380] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-15T18:35:29.584145] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-15T18:35:29.584204] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-15T18:35:29.585553] [DEBUG] [LOCAL ] GD: Trimmed 52179 records to 34238 (keeping 150 days of data) [2025-09-15T18:35:29.804110] [DEBUG] [LOCAL ] GD: Primary data saved (34238 records). [2025-09-15T18:35:29.804279] [INFO ] [MAIN ] GD: Full history saved. [2025-09-15T18:35:29.804366] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GD took 25.3s. Estimated remaining: 2h 35m 13s. Rate: 9.5 symbols/min [2025-09-15T18:35:29.977696] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:29.983326] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:35:29.988120] [DEBUG] [LOCAL ] GDL: Loaded 1759 existing records from primary storage. [2025-09-15T18:35:29.988201] [INFO ] [MAIN ] GDL: Loaded 1759 existing records. [2025-09-15T18:35:30.063029] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-15T18:35:30.169430] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:30.169731] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-15T18:35:30.169784] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-15T18:35:30.170016] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-15T18:35:30.170063] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-15T18:35:30.540522] [INFO ] [REMOTE ] GDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:30.857866] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-15T18:35:31.225707] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:35:31.538099] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:35:31.543905] [INFO ] [REMOTE ] GCI: Full fetch complete (47974 records). [2025-09-15T18:35:31.544060] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-15T18:35:31.659962] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-15T18:35:31.949360] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-15T18:35:31.949462] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-15T18:35:31.950289] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-15T18:35:31.950343] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-15T18:35:31.951452] [DEBUG] [LOCAL ] GCI: Trimmed 47974 records to 32264 (keeping 150 days of data) [2025-09-15T18:35:32.146887] [DEBUG] [LOCAL ] GCI: Primary data saved (32264 records). [2025-09-15T18:35:32.147044] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-15T18:35:32.147158] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCI took 50.0s. Estimated remaining: 2h 35m 1s. Rate: 9.5 symbols/min [2025-09-15T18:35:32.321372] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:32.328725] [DEBUG] [LOCAL ] GDO: Loaded 4390 existing records from primary storage. [2025-09-15T18:35:32.328838] [INFO ] [MAIN ] GDO: Loaded 4390 existing records. [2025-09-15T18:35:32.463026] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-15T18:35:32.515874] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:32.516288] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-15T18:35:32.516337] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-15T18:35:32.516610] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-15T18:35:32.516681] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-15T18:35:32.871003] [INFO ] [REMOTE ] GDO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:33.257908] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-15T18:35:33.313527] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:35:33.354493] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:35:34.002267] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:35:34.057849] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-15T18:35:34.670027] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:35:34.857909] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-15T18:35:35.298724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:35:35.657891] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-15T18:35:36.268750] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T18:35:36.457891] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-15T18:35:37.107920] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:35:37.257916] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-15T18:35:37.593699] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:35:38.057867] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-15T18:35:38.495731] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:35:38.857955] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-15T18:35:39.456161] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:35:39.657899] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-15T18:35:40.386994] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T18:35:40.457833] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-15T18:35:40.748124] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:35:41.257925] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-15T18:35:42.057882] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-15T18:35:42.535552] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T18:35:42.857867] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-15T18:35:43.021571] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:35:43.277102] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T18:35:43.657885] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-15T18:35:44.457868] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-15T18:35:45.068348] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T18:35:45.069338] [INFO ] [REMOTE ] GDIV: Full fetch complete (4172 records). [2025-09-15T18:35:45.069411] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-15T18:35:45.266867] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-15T18:35:45.424823] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-15T18:35:45.424904] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-15T18:35:45.425049] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-15T18:35:45.425093] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-15T18:35:45.425445] [DEBUG] [LOCAL ] GDIV: Trimmed 4172 records to 2590 (keeping 150 days of data) [2025-09-15T18:35:45.441741] [DEBUG] [LOCAL ] GDIV: Primary data saved (2590 records). [2025-09-15T18:35:45.441801] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-15T18:35:45.441868] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDIV took 24.6s. Estimated remaining: 2h 35m 6s. Rate: 9.4 symbols/min [2025-09-15T18:35:45.614006] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:45.659531] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-15T18:35:45.682447] [DEBUG] [LOCAL ] GDOT: Loaded 27838 existing records from primary storage. [2025-09-15T18:35:45.682621] [INFO ] [MAIN ] GDOT: Loaded 27838 existing records. [2025-09-15T18:35:45.789129] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:35:45.869746] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:45.869999] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-15T18:35:45.870046] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-15T18:35:45.870744] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-15T18:35:45.870797] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-15T18:35:46.064731] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-15T18:35:46.222453] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:46.857883] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-15T18:35:47.656025] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:35:47.657987] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-15T18:35:47.662573] [INFO ] [REMOTE ] GDDY: Full fetch complete (54351 records). [2025-09-15T18:35:47.662682] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-15T18:35:48.043984] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-15T18:35:48.044077] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-15T18:35:48.044858] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-15T18:35:48.044907] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-15T18:35:48.046169] [DEBUG] [LOCAL ] GDDY: Trimmed 54351 records to 36534 (keeping 150 days of data) [2025-09-15T18:35:48.113343] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:35:48.189512] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:35:48.301428] [DEBUG] [LOCAL ] GDDY: Primary data saved (36534 records). [2025-09-15T18:35:48.301573] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-15T18:35:48.302280] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDDY took 30.5s. Estimated remaining: 2h 34m 54s. Rate: 9.5 symbols/min [2025-09-15T18:35:48.478276] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:48.474706] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-15T18:35:48.496115] [DEBUG] [LOCAL ] GDV: Loaded 14594 existing records from primary storage. [2025-09-15T18:35:48.496263] [INFO ] [MAIN ] GDV: Loaded 14594 existing records. [2025-09-15T18:35:48.680902] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:48.681288] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-15T18:35:48.681345] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-15T18:35:48.681832] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-15T18:35:48.681883] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-15T18:35:49.031680] [INFO ] [REMOTE ] GDV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:49.257858] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-15T18:35:49.780614] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:35:50.056948] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:35:50.058878] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-15T18:35:50.509738] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:35:50.857868] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-15T18:35:51.361282] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T18:35:51.362296] [INFO ] [REMOTE ] GDL: Full fetch complete (2560 records). [2025-09-15T18:35:51.362364] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-15T18:35:51.662951] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-15T18:35:51.735505] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-15T18:35:51.735583] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-15T18:35:51.735715] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-15T18:35:51.735758] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-15T18:35:51.736164] [DEBUG] [LOCAL ] GDL: Trimmed 2560 records to 1737 (keeping 150 days of data) [2025-09-15T18:35:51.747166] [DEBUG] [LOCAL ] GDL: Primary data saved (1737 records). [2025-09-15T18:35:51.747236] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-15T18:35:51.747310] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDL took 21.9s. Estimated remaining: 2h 34m 42s. Rate: 9.5 symbols/min [2025-09-15T18:35:51.931824] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:51.970842] [DEBUG] [LOCAL ] GE: Loaded 40461 existing records from primary storage. [2025-09-15T18:35:51.970984] [INFO ] [MAIN ] GE: Loaded 40461 existing records. [2025-09-15T18:35:52.165385] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:52.165846] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-15T18:35:52.165897] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-15T18:35:52.166917] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-15T18:35:52.166973] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-15T18:35:52.463045] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-15T18:35:52.520241] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:35:52.542627] [INFO ] [REMOTE ] GE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:52.544864] [INFO ] [REMOTE ] GDO: Full fetch complete (6483 records). [2025-09-15T18:35:52.545301] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-15T18:35:52.918896] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-15T18:35:52.918979] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-15T18:35:52.919145] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-15T18:35:52.919185] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-15T18:35:52.919660] [DEBUG] [LOCAL ] GDO: Trimmed 6483 records to 4329 (keeping 150 days of data) [2025-09-15T18:35:52.949814] [DEBUG] [LOCAL ] GDO: Primary data saved (4329 records). [2025-09-15T18:35:52.949979] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-15T18:35:52.950072] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 20.8s. Estimated remaining: 2h 34m 28s. Rate: 9.5 symbols/min [2025-09-15T18:35:53.120961] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:53.137270] [DEBUG] [LOCAL ] GEF: Loaded 15434 existing records from primary storage. [2025-09-15T18:35:53.137400] [INFO ] [MAIN ] GEF: Loaded 15434 existing records. [2025-09-15T18:35:53.263019] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-15T18:35:53.323433] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:53.323725] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-15T18:35:53.323781] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-15T18:35:53.324301] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-15T18:35:53.324347] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-15T18:35:53.677080] [INFO ] [REMOTE ] GEF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:53.700205] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:35:54.057902] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-15T18:35:54.629828] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:35:54.857890] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-15T18:35:55.657879] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-15T18:35:55.730188] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:35:55.910399] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T18:35:56.457929] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-15T18:35:56.715440] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:35:57.257871] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-15T18:35:57.575287] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T18:35:58.057936] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-15T18:35:58.857898] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-15T18:35:59.038975] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:35:59.450661] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T18:35:59.657906] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-15T18:36:00.071153] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:36:00.457890] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-15T18:36:00.938448] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:36:01.257895] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-15T18:36:01.709402] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:36:02.036626] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T18:36:02.057825] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-15T18:36:02.857880] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-15T18:36:03.657903] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-15T18:36:04.457933] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-15T18:36:06.007935] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (3.95 seconds). [2025-09-15T18:36:06.012661] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-15T18:36:08.654791] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (4.20 seconds). [2025-09-15T18:36:08.663271] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-15T18:36:08.947007] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-15T18:36:08.952516] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-15T18:36:09.021404] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (6.16 seconds). [2025-09-15T18:36:09.026117] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-15T18:36:09.937088] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:36:09.944555] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-15T18:36:10.739867] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-15T18:36:10.744764] [INFO ] [REMOTE ] GDOT: Full fetch complete (41157 records). [2025-09-15T18:36:10.744930] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-15T18:36:11.239678] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-15T18:36:11.239828] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-15T18:36:11.240549] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-15T18:36:11.240629] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-15T18:36:11.242062] [DEBUG] [LOCAL ] GDOT: Trimmed 41157 records to 27340 (keeping 150 days of data) [2025-09-15T18:36:11.468418] [DEBUG] [LOCAL ] GDOT: Primary data saved (27340 records). [2025-09-15T18:36:11.468594] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-15T18:36:11.468745] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDOT took 26.0s. Estimated remaining: 2h 34m 41s. Rate: 9.4 symbols/min [2025-09-15T18:36:11.700007] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:11.733472] [DEBUG] [LOCAL ] GEL: Loaded 25309 existing records from primary storage. [2025-09-15T18:36:11.733681] [INFO ] [MAIN ] GEL: Loaded 25309 existing records. [2025-09-15T18:36:12.021264] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:12.021571] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-15T18:36:12.021635] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-15T18:36:12.023027] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-15T18:36:12.023096] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-15T18:36:12.397928] [INFO ] [REMOTE ] GEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:12.398318] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-15T18:36:12.454725] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (8.80 seconds). [2025-09-15T18:36:12.471438] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-15T18:36:12.832273] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-15T18:36:12.837821] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-15T18:36:13.327419] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (4.30 seconds). [2025-09-15T18:36:13.332999] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-15T18:36:13.504015] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:36:13.509099] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-15T18:36:14.153196] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:36:14.160872] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-15T18:36:14.173993] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:36:14.178744] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-15T18:36:14.214195] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:36:14.548110] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:36:14.551276] [INFO ] [REMOTE ] GEF: Full fetch complete (22210 records). [2025-09-15T18:36:14.551355] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-15T18:36:14.863049] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-15T18:36:14.918295] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-15T18:36:14.918375] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-15T18:36:14.918847] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-15T18:36:14.918891] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-15T18:36:14.919943] [DEBUG] [LOCAL ] GEF: Trimmed 22210 records to 15263 (keeping 150 days of data) [2025-09-15T18:36:15.013544] [DEBUG] [LOCAL ] GEF: Primary data saved (15263 records). [2025-09-15T18:36:15.013708] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-15T18:36:15.013798] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GEF took 22.1s. Estimated remaining: 2h 34m 30s. Rate: 9.4 symbols/min [2025-09-15T18:36:15.181081] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:15.223663] [DEBUG] [LOCAL ] GENI: Loaded 39790 existing records from primary storage. [2025-09-15T18:36:15.223849] [INFO ] [MAIN ] GENI: Loaded 39790 existing records. [2025-09-15T18:36:15.397458] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:15.397739] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-15T18:36:15.397786] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-15T18:36:15.398744] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-15T18:36:15.398796] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-15T18:36:15.754155] [INFO ] [REMOTE ] GENI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:15.754527] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-15T18:36:15.760758] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:36:15.763280] [INFO ] [REMOTE ] GDV: Full fetch complete (21867 records). [2025-09-15T18:36:15.763356] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-15T18:36:16.125828] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-15T18:36:16.125916] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-15T18:36:16.126361] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-15T18:36:16.126400] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-15T18:36:16.127044] [DEBUG] [LOCAL ] GDV: Trimmed 21867 records to 14265 (keeping 150 days of data) [2025-09-15T18:36:16.215883] [DEBUG] [LOCAL ] GDV: Primary data saved (14265 records). [2025-09-15T18:36:16.216034] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-15T18:36:16.216122] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDV took 27.9s. Estimated remaining: 2h 34m 16s. Rate: 9.5 symbols/min [2025-09-15T18:36:16.384434] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:16.425078] [DEBUG] [LOCAL ] GEO: Loaded 39206 existing records from primary storage. [2025-09-15T18:36:16.425240] [INFO ] [MAIN ] GEO: Loaded 39206 existing records. [2025-09-15T18:36:16.604864] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:16.605111] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-15T18:36:16.605245] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-15T18:36:16.606091] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-15T18:36:16.652790] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-15T18:36:16.750344] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-15T18:36:16.786296] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-15T18:36:17.031258] [INFO ] [REMOTE ] GEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:17.257885] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-15T18:36:17.879820] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-15T18:36:18.033209] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:36:18.057813] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-15T18:36:18.255878] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-15T18:36:18.857876] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-15T18:36:19.350271] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:36:19.663900] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-15T18:36:19.679618] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-15T18:36:20.457937] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-15T18:36:20.785259] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:36:20.863883] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:36:21.257898] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-15T18:36:21.974212] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:36:22.057818] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-15T18:36:22.695180] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:36:22.857895] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-15T18:36:23.657869] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-15T18:36:23.814742] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:36:24.457867] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-15T18:36:24.742283] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T18:36:25.058576] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:36:25.257865] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-15T18:36:26.057922] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-15T18:36:26.549259] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T18:36:26.857941] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-15T18:36:27.013169] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:36:27.657870] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-15T18:36:27.976354] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:36:28.457838] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-15T18:36:28.524668] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T18:36:28.530825] [INFO ] [REMOTE ] GE: Full fetch complete (58387 records). [2025-09-15T18:36:28.530937] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-15T18:36:28.917209] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-15T18:36:28.917295] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-15T18:36:28.918074] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-15T18:36:28.918121] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-15T18:36:28.919341] [DEBUG] [LOCAL ] GE: Trimmed 58387 records to 39678 (keeping 150 days of data) [2025-09-15T18:36:29.196558] [DEBUG] [LOCAL ] GE: Primary data saved (39678 records). [2025-09-15T18:36:29.196778] [INFO ] [MAIN ] GE: Full history saved. [2025-09-15T18:36:29.197458] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 37.5s. Estimated remaining: 2h 34m 20s. Rate: 9.4 symbols/min [2025-09-15T18:36:29.262299] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-15T18:36:29.373889] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:29.440114] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:36:29.451473] [DEBUG] [LOCAL ] GES: Loaded 28871 existing records from primary storage. [2025-09-15T18:36:29.451941] [INFO ] [MAIN ] GES: Loaded 28871 existing records. [2025-09-15T18:36:29.632459] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:29.632762] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-15T18:36:29.632815] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-15T18:36:29.633547] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-15T18:36:29.633618] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-15T18:36:29.989426] [INFO ] [REMOTE ] GES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:30.057827] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-15T18:36:30.310507] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:36:30.762828] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:36:30.766325] [INFO ] [REMOTE ] GEL: Full fetch complete (37792 records). [2025-09-15T18:36:30.766407] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-15T18:36:30.867261] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-15T18:36:31.159907] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-15T18:36:31.159997] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-15T18:36:31.160703] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-15T18:36:31.160776] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-15T18:36:31.161835] [DEBUG] [LOCAL ] GEL: Trimmed 37792 records to 24836 (keeping 150 days of data) [2025-09-15T18:36:31.321117] [DEBUG] [LOCAL ] GEL: Primary data saved (24836 records). [2025-09-15T18:36:31.321263] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-15T18:36:31.321382] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 19.9s. Estimated remaining: 2h 34m 7s. Rate: 9.5 symbols/min [2025-09-15T18:36:31.492225] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:31.518050] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:36:31.549786] [DEBUG] [LOCAL ] GETY: Loaded 26329 existing records from primary storage. [2025-09-15T18:36:31.549965] [INFO ] [MAIN ] GETY: Loaded 26329 existing records. [2025-09-15T18:36:31.662933] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-15T18:36:31.732955] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:31.733172] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-15T18:36:31.733218] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-15T18:36:31.733857] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-15T18:36:31.733907] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-15T18:36:32.094423] [INFO ] [REMOTE ] GETY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:32.417388] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:36:32.457861] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-15T18:36:33.264851] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-15T18:36:33.286122] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:36:34.057907] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-15T18:36:34.308157] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:36:34.821824] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:36:34.857892] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-15T18:36:35.628766] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:36:35.657856] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-15T18:36:36.006632] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:36:36.012510] [INFO ] [REMOTE ] GENI: Full fetch complete (57199 records). [2025-09-15T18:36:36.012614] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-15T18:36:36.392222] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-15T18:36:36.392347] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-15T18:36:36.393132] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-15T18:36:36.393181] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-15T18:36:36.394373] [DEBUG] [LOCAL ] GENI: Trimmed 57199 records to 38999 (keeping 150 days of data) [2025-09-15T18:36:36.458909] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-15T18:36:36.635498] [DEBUG] [LOCAL ] GENI: Primary data saved (38999 records). [2025-09-15T18:36:36.635659] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-15T18:36:36.637690] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 21.6s. Estimated remaining: 2h 33m 59s. Rate: 9.5 symbols/min [2025-09-15T18:36:36.807617] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:36.850047] [DEBUG] [LOCAL ] GEV: Loaded 39972 existing records from primary storage. [2025-09-15T18:36:36.850216] [INFO ] [MAIN ] GEV: Loaded 39972 existing records. [2025-09-15T18:36:37.029113] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:37.029384] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-15T18:36:37.029433] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-15T18:36:37.030280] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-15T18:36:37.030331] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-15T18:36:37.266820] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-15T18:36:37.384237] [INFO ] [REMOTE ] GEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:37.416274] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T18:36:38.057858] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-15T18:36:38.447635] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:36:38.664355] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:36:38.857878] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-15T18:36:39.657881] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-15T18:36:40.208429] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-15T18:36:40.239276] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:36:40.457873] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-15T18:36:41.263239] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-15T18:36:41.265073] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:36:41.271014] [INFO ] [REMOTE ] GEO: Full fetch complete (56865 records). [2025-09-15T18:36:41.271103] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-15T18:36:41.658495] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-15T18:36:41.658579] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-15T18:36:41.659334] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-15T18:36:41.659380] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-15T18:36:41.660571] [DEBUG] [LOCAL ] GEO: Trimmed 56865 records to 38450 (keeping 150 days of data) [2025-09-15T18:36:41.898162] [DEBUG] [LOCAL ] GEO: Primary data saved (38450 records). [2025-09-15T18:36:41.898320] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-15T18:36:41.899088] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEO took 25.7s. Estimated remaining: 2h 33m 51s. Rate: 9.5 symbols/min [2025-09-15T18:36:42.062739] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-15T18:36:42.082037] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:42.086401] [DEBUG] [LOCAL ] GF: Loaded 2145 existing records from primary storage. [2025-09-15T18:36:42.086496] [INFO ] [MAIN ] GF: Loaded 2145 existing records. [2025-09-15T18:36:42.266820] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:42.267163] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-15T18:36:42.267248] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-15T18:36:42.267481] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-15T18:36:42.267531] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-15T18:36:42.628805] [INFO ] [REMOTE ] GF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:42.662477] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-15T18:36:42.803384] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:36:42.857925] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-15T18:36:43.657895] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-15T18:36:43.831467] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:36:44.338536] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T18:36:44.457884] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-15T18:36:45.072240] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T18:36:45.257875] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-15T18:36:45.892924] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:36:46.057918] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-15T18:36:46.844922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:36:46.857816] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-15T18:36:47.398752] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T18:36:47.546188] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-15T18:36:47.657870] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-15T18:36:48.457879] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-15T18:36:49.257876] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-15T18:36:49.613467] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T18:36:49.849394] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:36:49.915860] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:36:50.057834] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-15T18:36:50.857886] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-15T18:36:51.120297] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:36:51.657892] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-15T18:36:52.334110] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:36:52.457921] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-15T18:36:53.257970] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-15T18:36:53.261093] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T18:36:54.066452] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-15T18:36:54.068819] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:36:54.197511] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:36:54.494846] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T18:36:54.857878] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-15T18:36:55.657892] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-15T18:36:56.060909] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T18:36:56.457837] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-15T18:36:56.950486] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T18:36:57.257838] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-15T18:36:57.468073] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:36:58.057925] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-15T18:36:58.488454] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:36:58.598005] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T18:36:58.598792] [INFO ] [REMOTE ] GF: Full fetch complete (4019 records). [2025-09-15T18:36:58.598860] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-15T18:36:58.862948] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-15T18:36:58.955244] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-15T18:36:58.955333] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-15T18:36:58.955493] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-15T18:36:58.955542] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-15T18:36:58.955936] [DEBUG] [LOCAL ] GF: Trimmed 4019 records to 2108 (keeping 150 days of data) [2025-09-15T18:36:58.969268] [DEBUG] [LOCAL ] GF: Primary data saved (2108 records). [2025-09-15T18:36:58.969336] [INFO ] [MAIN ] GF: Full history saved. [2025-09-15T18:36:58.969411] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GF took 17.1s. Estimated remaining: 2h 34m 1s. Rate: 9.4 symbols/min [2025-09-15T18:36:59.135326] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:59.161068] [DEBUG] [LOCAL ] GFF: Loaded 22815 existing records from primary storage. [2025-09-15T18:36:59.161222] [INFO ] [MAIN ] GFF: Loaded 22815 existing records. [2025-09-15T18:36:59.343970] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:59.344260] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-15T18:36:59.344314] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-15T18:36:59.344871] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-15T18:36:59.344936] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-15T18:36:59.672998] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-15T18:36:59.712310] [INFO ] [REMOTE ] GFF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:00.395991] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:37:00.402517] [INFO ] [REMOTE ] GES: Full fetch complete (44503 records). [2025-09-15T18:37:00.402655] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-15T18:37:00.464888] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-15T18:37:00.777297] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-15T18:37:00.777389] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-15T18:37:00.778217] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-15T18:37:00.778459] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-15T18:37:00.780964] [DEBUG] [LOCAL ] GES: Trimmed 44503 records to 28051 (keeping 150 days of data) [2025-09-15T18:37:00.897666] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:37:00.904986] [INFO ] [REMOTE ] GETY: Full fetch complete (40606 records). [2025-09-15T18:37:00.905367] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-15T18:37:01.274734] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-15T18:37:01.364487] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-15T18:37:01.367062] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-15T18:37:01.370555] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-15T18:37:01.373350] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-15T18:37:01.377797] [DEBUG] [LOCAL ] GES: Primary data saved (28051 records). [2025-09-15T18:37:01.377984] [INFO ] [MAIN ] GES: Full history saved. [2025-09-15T18:37:01.378124] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GES took 32.2s. Estimated remaining: 2h 33m 49s. Rate: 9.4 symbols/min [2025-09-15T18:37:01.423816] [DEBUG] [LOCAL ] GETY: Trimmed 40606 records to 25721 (keeping 150 days of data) [2025-09-15T18:37:01.647786] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:01.740045] [DEBUG] [LOCAL ] GFI: Loaded 39887 existing records from primary storage. [2025-09-15T18:37:01.741891] [INFO ] [MAIN ] GFI: Loaded 39887 existing records. [2025-09-15T18:37:01.831962] [DEBUG] [LOCAL ] GETY: Primary data saved (25721 records). [2025-09-15T18:37:01.853624] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-15T18:37:01.853946] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GETY took 30.5s. Estimated remaining: 2h 33m 33s. Rate: 9.5 symbols/min [2025-09-15T18:37:01.931865] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:01.932149] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-15T18:37:01.932195] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-15T18:37:01.933061] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-15T18:37:01.933112] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-15T18:37:02.296132] [INFO ] [REMOTE ] GFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:02.296492] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-15T18:37:02.695023] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T18:37:02.702354] [INFO ] [REMOTE ] GEV: Full fetch complete (57821 records). [2025-09-15T18:37:02.702506] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-15T18:37:03.131012] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-15T18:37:03.131094] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-15T18:37:03.131922] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-15T18:37:03.131968] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-15T18:37:03.134221] [DEBUG] [LOCAL ] GEV: Trimmed 57821 records to 39188 (keeping 150 days of data) [2025-09-15T18:37:03.387529] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-15T18:37:03.395989] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-15T18:37:03.425456] [DEBUG] [LOCAL ] GEV: Primary data saved (39188 records). [2025-09-15T18:37:03.425722] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-15T18:37:03.426729] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GEV took 26.8s. Estimated remaining: 2h 33m 19s. Rate: 9.5 symbols/min [2025-09-15T18:37:03.793921] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:37:03.804700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-15T18:37:04.547778] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:37:04.557824] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-15T18:37:05.848228] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T18:37:05.859670] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-15T18:37:06.001787] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:37:06.057886] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-15T18:37:07.291118] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:37:07.298554] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-15T18:37:08.086488] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-15T18:37:08.098978] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-15T18:37:08.137314] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T18:37:08.457941] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-15T18:37:09.654594] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:37:09.662019] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-15T18:37:09.767113] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:37:10.057934] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-15T18:37:10.535733] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:37:10.857931] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-15T18:37:11.819723] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:37:11.831559] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-15T18:37:12.070682] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:37:12.074412] [INFO ] [REMOTE ] GFF: Full fetch complete (33957 records). [2025-09-15T18:37:12.074498] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-15T18:37:12.453884] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-15T18:37:12.454018] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-15T18:37:12.454750] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-15T18:37:12.454807] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-15T18:37:12.455737] [DEBUG] [LOCAL ] GFF: Trimmed 33957 records to 22267 (keeping 150 days of data) [2025-09-15T18:37:12.601592] [DEBUG] [LOCAL ] GFF: Primary data saved (22267 records). [2025-09-15T18:37:12.601753] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-15T18:37:12.601856] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 13.6s. Estimated remaining: 2h 33m 17s. Rate: 9.5 symbols/min [2025-09-15T18:37:13.873726] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-15T18:37:13.885444] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-15T18:37:15.426163] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:37:15.437564] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-15T18:37:17.325663] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:37:17.332601] [INFO ] [REMOTE ] GFI: Full fetch complete (57718 records). [2025-09-15T18:37:17.332729] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-15T18:37:17.759697] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-15T18:37:17.759813] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-15T18:37:17.760716] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-15T18:37:17.760777] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-15T18:37:17.762183] [DEBUG] [LOCAL ] GFI: Trimmed 57718 records to 39110 (keeping 150 days of data) [2025-09-15T18:37:18.017036] [DEBUG] [LOCAL ] GFI: Primary data saved (39110 records). [2025-09-15T18:37:18.017197] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-15T18:37:18.017943] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFI took 16.6s. Estimated remaining: 2h 33m 10s. Rate: 9.5 symbols/min [2025-09-15T18:37:18.619326] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.731483] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.749827] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.768384] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.789356] [DEBUG] [LOCAL ] GFR: Loaded 5201 existing records from primary storage. [2025-09-15T18:37:18.789529] [INFO ] [MAIN ] GFR: Loaded 5201 existing records. [2025-09-15T18:37:18.911880] [DEBUG] [LOCAL ] GGG: Loaded 30224 existing records from primary storage. [2025-09-15T18:37:18.951882] [INFO ] [MAIN ] GGG: Loaded 30224 existing records. [2025-09-15T18:37:18.998042] [DEBUG] [LOCAL ] GGB: Loaded 38585 existing records from primary storage. [2025-09-15T18:37:19.052805] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.058084] [INFO ] [MAIN ] GGB: Loaded 38585 existing records. [2025-09-15T18:37:19.108445] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.161954] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-15T18:37:19.181831] [DEBUG] [LOCAL ] GFL: Loaded 35480 existing records from primary storage. [2025-09-15T18:37:19.230199] [INFO ] [MAIN ] GFL: Loaded 35480 existing records. [2025-09-15T18:37:19.230022] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-15T18:37:19.330216] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-15T18:37:19.575028] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.556455] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.600618] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.631704] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-15T18:37:19.649060] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.670159] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-15T18:37:19.695764] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-15T18:37:19.730490] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-15T18:37:19.730558] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-15T18:37:19.768715] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-15T18:37:19.795879] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.860953] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-15T18:37:20.026458] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-15T18:37:20.052989] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-15T18:37:20.080619] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-15T18:37:20.509310] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:20.578472] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-15T18:37:21.024608] [INFO ] [REMOTE ] GGG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.047411] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-15T18:37:21.051155] [INFO ] [REMOTE ] GGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.052598] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-15T18:37:21.136557] [INFO ] [REMOTE ] GFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.137303] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-15T18:37:21.720432] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:37:21.722729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-15T18:37:22.532990] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:37:22.536356] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-15T18:37:22.636731] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:37:22.644895] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-15T18:37:22.758869] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:37:22.769234] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-15T18:37:22.843453] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:37:22.852952] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-15T18:37:23.002408] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:37:23.006038] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-15T18:37:23.738935] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:37:23.742152] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-15T18:37:23.930687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:37:23.941581] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-15T18:37:24.139863] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:37:24.148827] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-15T18:37:24.212182] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T18:37:24.457882] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-15T18:37:24.571139] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:37:24.932602] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:37:25.257880] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-15T18:37:25.653318] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:37:25.733540] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:37:25.786730] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T18:37:26.057890] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-15T18:37:26.677156] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:37:26.678225] [INFO ] [REMOTE ] GFR: Full fetch complete (9135 records). [2025-09-15T18:37:26.678296] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-15T18:37:26.862992] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-15T18:37:27.035190] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-15T18:37:27.035271] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-15T18:37:27.035526] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-15T18:37:27.035580] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-15T18:37:27.036033] [DEBUG] [LOCAL ] GFR: Trimmed 9135 records to 5085 (keeping 150 days of data) [2025-09-15T18:37:27.066846] [DEBUG] [LOCAL ] GFR: Primary data saved (5085 records). [2025-09-15T18:37:27.066973] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-15T18:37:27.067077] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 9.0s. Estimated remaining: 2h 33m 8s. Rate: 9.5 symbols/min [2025-09-15T18:37:27.233580] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:27.245039] [DEBUG] [LOCAL ] GGT: Loaded 11004 existing records from primary storage. [2025-09-15T18:37:27.245169] [INFO ] [MAIN ] GGT: Loaded 11004 existing records. [2025-09-15T18:37:27.420217] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:27.420517] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-15T18:37:27.420564] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-15T18:37:27.420952] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-15T18:37:27.421001] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-15T18:37:27.668902] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-15T18:37:27.789323] [INFO ] [REMOTE ] GGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:28.457886] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-15T18:37:28.714120] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:37:29.087212] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:37:29.223165] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:37:29.257818] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-15T18:37:30.057874] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-15T18:37:30.860161] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-15T18:37:30.862696] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T18:37:31.125015] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:37:31.653808] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:37:31.657803] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-15T18:37:32.171760] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:37:32.457865] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-15T18:37:33.257875] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-15T18:37:34.057944] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-15T18:37:34.523123] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T18:37:34.857921] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-15T18:37:34.898966] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:37:35.664111] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-15T18:37:35.680800] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:37:35.983189] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:37:36.457944] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-15T18:37:36.833977] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:37:37.257885] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-15T18:37:37.572242] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:37:38.057904] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-15T18:37:38.772406] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:37:38.857839] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-15T18:37:38.873826] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:37:38.879928] [INFO ] [REMOTE ] GGB: Full fetch complete (55446 records). [2025-09-15T18:37:38.880067] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-15T18:37:39.261008] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-15T18:37:39.261093] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-15T18:37:39.261845] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-15T18:37:39.261890] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-15T18:37:39.263105] [DEBUG] [LOCAL ] GGB: Trimmed 55446 records to 37887 (keeping 150 days of data) [2025-09-15T18:37:39.489618] [DEBUG] [LOCAL ] GGB: Primary data saved (37887 records). [2025-09-15T18:37:39.489787] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-15T18:37:39.489878] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 21.5s. Estimated remaining: 2h 33m 11s. Rate: 9.4 symbols/min [2025-09-15T18:37:39.664427] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:39.664566] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-15T18:37:39.670061] [DEBUG] [LOCAL ] GGZ: Loaded 1716 existing records from primary storage. [2025-09-15T18:37:39.670182] [INFO ] [MAIN ] GGZ: Loaded 1716 existing records. [2025-09-15T18:37:39.856553] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:39.856917] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-15T18:37:39.856975] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-15T18:37:39.857216] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-15T18:37:39.857286] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-15T18:37:40.008259] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:37:40.244611] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:40.457890] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-15T18:37:40.761458] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:37:41.174730] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T18:37:41.257879] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-15T18:37:41.826526] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:37:42.057903] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-15T18:37:42.857883] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-15T18:37:43.403222] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:37:43.502439] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T18:37:43.657931] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-15T18:37:44.457869] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-15T18:37:45.265770] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-15T18:37:45.271061] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:37:45.350730] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:37:45.352907] [INFO ] [REMOTE ] GGT: Full fetch complete (14928 records). [2025-09-15T18:37:45.352976] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-15T18:37:45.712367] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-15T18:37:45.712456] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-15T18:37:45.712797] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-15T18:37:45.712842] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-15T18:37:45.713361] [DEBUG] [LOCAL ] GGT: Trimmed 14928 records to 11031 (keeping 150 days of data) [2025-09-15T18:37:45.778363] [DEBUG] [LOCAL ] GGT: Primary data saved (11031 records). [2025-09-15T18:37:45.778496] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-15T18:37:45.778579] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GGT took 18.7s. Estimated remaining: 2h 33m 4s. Rate: 9.4 symbols/min [2025-09-15T18:37:45.950672] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:45.954575] [DEBUG] [LOCAL ] GHC: Loaded 2078 existing records from primary storage. [2025-09-15T18:37:45.954676] [INFO ] [MAIN ] GHC: Loaded 2078 existing records. [2025-09-15T18:37:46.057847] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-15T18:37:46.136395] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:46.136684] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-15T18:37:46.136759] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-15T18:37:46.136934] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-15T18:37:46.136977] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-15T18:37:46.501515] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T18:37:46.506798] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:46.519016] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:37:46.523049] [INFO ] [REMOTE ] GGG: Full fetch complete (44520 records). [2025-09-15T18:37:46.523132] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-15T18:37:46.861022] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-15T18:37:46.894799] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-15T18:37:46.894871] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-15T18:37:46.895532] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-15T18:37:46.895573] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-15T18:37:46.896567] [DEBUG] [LOCAL ] GGG: Trimmed 44520 records to 29577 (keeping 150 days of data) [2025-09-15T18:37:47.087081] [DEBUG] [LOCAL ] GGG: Primary data saved (29577 records). [2025-09-15T18:37:47.087223] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-15T18:37:47.087309] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GGG took 29.1s. Estimated remaining: 2h 32m 50s. Rate: 9.5 symbols/min [2025-09-15T18:37:47.256431] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:47.260496] [DEBUG] [LOCAL ] GHG: Loaded 2514 existing records from primary storage. [2025-09-15T18:37:47.260580] [INFO ] [MAIN ] GHG: Loaded 2514 existing records. [2025-09-15T18:37:47.436520] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:47.436903] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-15T18:37:47.436971] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-15T18:37:47.437307] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-15T18:37:47.437376] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-15T18:37:47.663465] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-15T18:37:47.806523] [INFO ] [REMOTE ] GHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:48.112697] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:37:48.457903] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-15T18:37:49.097791] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T18:37:49.257887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-15T18:37:49.317296] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:37:49.322712] [INFO ] [REMOTE ] GFL: Full fetch complete (52361 records). [2025-09-15T18:37:49.322841] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-15T18:37:49.707384] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-15T18:37:49.707473] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-15T18:37:49.708239] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-15T18:37:49.708285] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-15T18:37:49.709339] [DEBUG] [LOCAL ] GFL: Trimmed 52361 records to 34741 (keeping 150 days of data) [2025-09-15T18:37:49.804852] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:37:49.925212] [DEBUG] [LOCAL ] GFL: Primary data saved (34741 records). [2025-09-15T18:37:49.925362] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-15T18:37:49.925450] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GFL took 31.9s. Estimated remaining: 2h 32m 38s. Rate: 9.5 symbols/min [2025-09-15T18:37:50.063013] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-15T18:37:50.109032] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:50.116239] [DEBUG] [LOCAL ] GHI: Loaded 5287 existing records from primary storage. [2025-09-15T18:37:50.116836] [INFO ] [MAIN ] GHI: Loaded 5287 existing records. [2025-09-15T18:37:50.291048] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:50.291345] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-15T18:37:50.291401] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-15T18:37:50.291729] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-15T18:37:50.291777] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-15T18:37:50.636853] [INFO ] [REMOTE ] GHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:50.650934] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:37:50.857916] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-15T18:37:51.657978] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-15T18:37:51.898857] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:37:52.204605] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T18:37:52.457900] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-15T18:37:52.832516] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:37:53.257891] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-15T18:37:53.890894] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T18:37:54.057896] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-15T18:37:54.770895] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T18:37:54.857894] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-15T18:37:55.650112] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:37:55.657826] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-15T18:37:56.273481] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T18:37:56.457925] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-15T18:37:56.924661] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T18:37:57.257884] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-15T18:37:57.683316] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T18:37:58.057880] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-15T18:37:58.678744] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:37:58.857873] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-15T18:37:59.636561] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:37:59.657823] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-15T18:38:00.207757] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:38:00.458000] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-15T18:38:00.925503] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:38:01.257893] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-15T18:38:01.741820] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T18:38:02.057891] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-15T18:38:02.633879] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T18:38:02.634879] [INFO ] [REMOTE ] GGZ: Full fetch complete (2732 records). [2025-09-15T18:38:02.634956] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-15T18:38:02.863984] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-15T18:38:02.992214] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-15T18:38:02.992304] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-15T18:38:02.992411] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-15T18:38:02.992451] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-15T18:38:02.992909] [DEBUG] [LOCAL ] GGZ: Trimmed 2732 records to 1696 (keeping 150 days of data) [2025-09-15T18:38:03.004453] [DEBUG] [LOCAL ] GGZ: Primary data saved (1696 records). [2025-09-15T18:38:03.004603] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-15T18:38:03.004735] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGZ took 23.5s. Estimated remaining: 2h 32m 42s. Rate: 9.4 symbols/min [2025-09-15T18:38:03.179868] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:03.184846] [DEBUG] [LOCAL ] GHLD: Loaded 3308 existing records from primary storage. [2025-09-15T18:38:03.184929] [INFO ] [MAIN ] GHLD: Loaded 3308 existing records. [2025-09-15T18:38:03.361181] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:03.361474] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-15T18:38:03.361529] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-15T18:38:03.361901] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-15T18:38:03.361949] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-15T18:38:03.587772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:38:03.662998] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-15T18:38:03.726351] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:04.219338] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:38:04.457878] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-15T18:38:04.876898] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:38:05.257941] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-15T18:38:05.696308] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T18:38:06.057885] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-15T18:38:06.512046] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:38:06.857899] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-15T18:38:07.657914] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-15T18:38:07.727713] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T18:38:08.128698] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T18:38:08.457866] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-15T18:38:09.200943] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:38:09.257879] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-15T18:38:09.783070] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:38:10.057933] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-15T18:38:10.358494] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T18:38:10.857873] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-15T18:38:11.627937] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T18:38:11.629278] [INFO ] [REMOTE ] GHI: Full fetch complete (7578 records). [2025-09-15T18:38:11.629362] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-15T18:38:11.662993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-15T18:38:12.055594] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-15T18:38:12.055706] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-15T18:38:12.055928] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-15T18:38:12.055970] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-15T18:38:12.056395] [DEBUG] [LOCAL ] GHI: Trimmed 7578 records to 5230 (keeping 150 days of data) [2025-09-15T18:38:12.088180] [DEBUG] [LOCAL ] GHI: Primary data saved (5230 records). [2025-09-15T18:38:12.088256] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-15T18:38:12.088333] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GHI took 22.2s. Estimated remaining: 2h 32m 40s. Rate: 9.4 symbols/min [2025-09-15T18:38:12.253216] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:38:12.261375] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:12.273906] [DEBUG] [LOCAL ] GHM: Loaded 10444 existing records from primary storage. [2025-09-15T18:38:12.273997] [INFO ] [MAIN ] GHM: Loaded 10444 existing records. [2025-09-15T18:38:12.451976] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:12.452285] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-15T18:38:12.452332] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-15T18:38:12.452764] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-15T18:38:12.452813] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-15T18:38:12.463519] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-15T18:38:12.803057] [INFO ] [REMOTE ] GHM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:12.996480] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:38:13.257868] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-15T18:38:14.057889] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-15T18:38:14.410822] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:38:14.812827] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T18:38:14.813729] [INFO ] [REMOTE ] GHC: Full fetch complete (2693 records). [2025-09-15T18:38:14.813799] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-15T18:38:14.866747] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-15T18:38:15.172993] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-15T18:38:15.173076] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-15T18:38:15.173180] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-15T18:38:15.173219] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-15T18:38:15.173566] [DEBUG] [LOCAL ] GHC: Trimmed 2693 records to 2054 (keeping 150 days of data) [2025-09-15T18:38:15.187152] [DEBUG] [LOCAL ] GHC: Primary data saved (2054 records). [2025-09-15T18:38:15.187217] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-15T18:38:15.187287] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 29.4s. Estimated remaining: 2h 32m 29s. Rate: 9.5 symbols/min [2025-09-15T18:38:15.362886] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:15.379673] [DEBUG] [LOCAL ] GHY: Loaded 15424 existing records from primary storage. [2025-09-15T18:38:15.379812] [INFO ] [MAIN ] GHY: Loaded 15424 existing records. [2025-09-15T18:38:15.553897] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:15.554174] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-15T18:38:15.554232] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-15T18:38:15.554750] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-15T18:38:15.554800] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-15T18:38:15.656879] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:38:15.662328] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-15T18:38:15.707892] [INFO ] [REMOTE ] GHG: Full fetch complete (3332 records). [2025-09-15T18:38:15.715800] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-15T18:38:15.732225] [FATAL] [VALIDATOR ] GHG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:38:15.741389] [FATAL] [MAIN ] GHG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:38:15.773268] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:38:15.813490] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-15T18:38:15.843015] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-15T18:38:15.843357] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-15T18:38:15.884330] [DEBUG] [LOCAL ] GHG: Deleted derivative data file. [2025-09-15T18:38:15.902601] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHG took 28.8s. Estimated remaining: 2h 32m 14s. Rate: 9.5 symbols/min [2025-09-15T18:38:15.957608] [INFO ] [REMOTE ] GHY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:16.099552] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:16.122088] [DEBUG] [LOCAL ] GIB: Loaded 23149 existing records from primary storage. [2025-09-15T18:38:16.122232] [INFO ] [MAIN ] GIB: Loaded 23149 existing records. [2025-09-15T18:38:16.299671] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:16.299905] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-15T18:38:16.299950] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-15T18:38:16.300582] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-15T18:38:16.300637] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-15T18:38:16.411503] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T18:38:16.465794] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-15T18:38:16.681096] [INFO ] [REMOTE ] GIB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:17.154722] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T18:38:17.257912] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-15T18:38:18.057926] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-15T18:38:18.494599] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:38:18.673558] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:38:18.857897] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-15T18:38:19.657888] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-15T18:38:19.855458] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:38:20.405119] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T18:38:20.457890] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-15T18:38:21.132674] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:38:21.257841] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-15T18:38:21.830573] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:38:21.831761] [INFO ] [REMOTE ] GHLD: Full fetch complete (4052 records). [2025-09-15T18:38:21.831829] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-15T18:38:22.067446] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-15T18:38:22.185102] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-15T18:38:22.185189] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-15T18:38:22.185313] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-15T18:38:22.185352] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-15T18:38:22.185744] [DEBUG] [LOCAL ] GHLD: Trimmed 4052 records to 3305 (keeping 150 days of data) [2025-09-15T18:38:22.208102] [DEBUG] [LOCAL ] GHLD: Primary data saved (3305 records). [2025-09-15T18:38:22.208217] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-15T18:38:22.208319] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHLD took 19.2s. Estimated remaining: 2h 32m 7s. Rate: 9.5 symbols/min [2025-09-15T18:38:22.377338] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:22.388596] [DEBUG] [LOCAL ] GIC: Loaded 10183 existing records from primary storage. [2025-09-15T18:38:22.388731] [INFO ] [MAIN ] GIC: Loaded 10183 existing records. [2025-09-15T18:38:22.567703] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:22.567988] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-15T18:38:22.568037] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-15T18:38:22.568446] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-15T18:38:22.568497] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-15T18:38:22.863325] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-15T18:38:22.946006] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:22.969632] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:38:23.657926] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-15T18:38:24.357165] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:38:24.457870] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-15T18:38:24.622683] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:38:25.257874] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-15T18:38:25.616477] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:38:26.057882] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-15T18:38:26.238120] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T18:38:26.857893] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-15T18:38:27.514781] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:38:27.555840] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:38:27.657901] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-15T18:38:28.457875] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-15T18:38:28.875578] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:38:29.257870] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-15T18:38:29.706496] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:38:30.057868] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-15T18:38:30.523112] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:38:30.857850] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-15T18:38:31.102425] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:38:31.567144] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:38:31.657882] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-15T18:38:32.457912] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-15T18:38:32.629414] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:38:32.632011] [INFO ] [REMOTE ] GHY: Full fetch complete (23051 records). [2025-09-15T18:38:32.632108] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-15T18:38:33.015221] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-15T18:38:33.015340] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-15T18:38:33.016132] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-15T18:38:33.016195] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-15T18:38:33.017339] [DEBUG] [LOCAL ] GHY: Trimmed 23051 records to 14869 (keeping 150 days of data) [2025-09-15T18:38:33.120497] [DEBUG] [LOCAL ] GHY: Primary data saved (14869 records). [2025-09-15T18:38:33.120743] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-15T18:38:33.120858] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHY took 17.9s. Estimated remaining: 2h 32m 8s. Rate: 9.5 symbols/min [2025-09-15T18:38:33.271462] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-15T18:38:33.306728] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:33.349140] [DEBUG] [LOCAL ] GIL: Loaded 32288 existing records from primary storage. [2025-09-15T18:38:33.349371] [INFO ] [MAIN ] GIL: Loaded 32288 existing records. [2025-09-15T18:38:33.540172] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:33.540727] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-15T18:38:33.540803] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-15T18:38:33.547501] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-15T18:38:33.559102] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-15T18:38:33.566733] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:38:33.934443] [INFO ] [REMOTE ] GIL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:34.057901] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-15T18:38:34.284208] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:38:34.857897] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-15T18:38:35.528009] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T18:38:35.657888] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-15T18:38:35.804395] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:38:36.457911] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-15T18:38:37.038427] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:38:37.257917] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-15T18:38:37.563800] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:38:38.057892] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-15T18:38:38.650728] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:38:38.857885] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-15T18:38:38.978104] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:38:39.647777] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:38:39.657816] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-15T18:38:40.357528] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T18:38:40.457867] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-15T18:38:41.257892] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-15T18:38:41.399474] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:38:41.401433] [INFO ] [REMOTE ] GHM: Full fetch complete (16195 records). [2025-09-15T18:38:41.401522] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-15T18:38:41.762625] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-15T18:38:41.762728] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-15T18:38:41.763081] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-15T18:38:41.763172] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-15T18:38:41.764063] [DEBUG] [LOCAL ] GHM: Trimmed 16195 records to 10420 (keeping 150 days of data) [2025-09-15T18:38:41.829609] [DEBUG] [LOCAL ] GHM: Primary data saved (10420 records). [2025-09-15T18:38:41.829781] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-15T18:38:41.829884] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHM took 29.7s. Estimated remaining: 2h 32m 5s. Rate: 9.4 symbols/min [2025-09-15T18:38:42.010687] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:42.011489] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:38:42.052519] [DEBUG] [LOCAL ] GIS: Loaded 40420 existing records from primary storage. [2025-09-15T18:38:42.052703] [INFO ] [MAIN ] GIS: Loaded 40420 existing records. [2025-09-15T18:38:42.063566] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-15T18:38:42.235717] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:42.236012] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-15T18:38:42.236069] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-15T18:38:42.236927] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-15T18:38:42.237003] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-15T18:38:42.589266] [INFO ] [REMOTE ] GIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:42.857878] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-15T18:38:43.657872] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-15T18:38:43.684191] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:38:44.457889] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-15T18:38:44.618017] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:38:44.796812] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:38:45.257888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-15T18:38:45.443553] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:38:46.057883] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-15T18:38:46.847819] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:38:46.849976] [INFO ] [REMOTE ] GIC: Full fetch complete (15028 records). [2025-09-15T18:38:46.850050] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-15T18:38:46.850452] [FATAL] [VALIDATOR ] GIC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:38:46.850527] [FATAL] [MAIN ] GIC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:38:46.850563] [WARN ] [MAIN ] GIC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:38:46.850600] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-15T18:38:46.850674] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-09-15T18:38:46.850714] [INFO ] [LOCAL ] GIC: Starting deletion of derivative data. [2025-09-15T18:38:46.850995] [DEBUG] [LOCAL ] GIC: Deleted derivative data file. [2025-09-15T18:38:46.851071] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIC took 24.6s. Estimated remaining: 2h 31m 57s. Rate: 9.5 symbols/min [2025-09-15T18:38:46.862986] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-15T18:38:47.027523] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:47.063837] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:38:47.096446] [DEBUG] [LOCAL ] GKOS: Loaded 31951 existing records from primary storage. [2025-09-15T18:38:47.096583] [INFO ] [MAIN ] GKOS: Loaded 31951 existing records. [2025-09-15T18:38:47.269157] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:47.269425] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-15T18:38:47.269470] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-15T18:38:47.270235] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-15T18:38:47.270292] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-15T18:38:47.636098] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:47.657820] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-15T18:38:48.427841] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:38:48.457845] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-15T18:38:49.006496] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:38:49.257876] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-15T18:38:49.626758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:38:50.057869] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-15T18:38:50.254348] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:38:50.857892] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-15T18:38:51.556284] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:38:51.657900] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-15T18:38:51.905173] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:38:51.908901] [INFO ] [REMOTE ] GIB: Full fetch complete (35481 records). [2025-09-15T18:38:51.908980] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-15T18:38:52.278446] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-15T18:38:52.278530] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-15T18:38:52.279199] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-15T18:38:52.279246] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-15T18:38:52.280125] [DEBUG] [LOCAL ] GIB: Trimmed 35481 records to 22652 (keeping 150 days of data) [2025-09-15T18:38:52.430266] [DEBUG] [LOCAL ] GIB: Primary data saved (22652 records). [2025-09-15T18:38:52.430444] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-15T18:38:52.430548] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIB took 36.5s. Estimated remaining: 2h 31m 49s. Rate: 9.5 symbols/min [2025-09-15T18:38:52.465749] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-15T18:38:52.614412] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:52.645562] [DEBUG] [LOCAL ] GL: Loaded 28207 existing records from primary storage. [2025-09-15T18:38:52.645735] [INFO ] [MAIN ] GL: Loaded 28207 existing records. [2025-09-15T18:38:52.827267] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:52.827521] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-15T18:38:52.828787] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-15T18:38:52.829494] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-15T18:38:52.829548] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-15T18:38:53.187739] [INFO ] [REMOTE ] GL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:53.233240] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:38:53.238797] [INFO ] [REMOTE ] GIL: Full fetch complete (46580 records). [2025-09-15T18:38:53.238920] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-15T18:38:53.262973] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-15T18:38:53.633276] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-15T18:38:53.633376] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-15T18:38:53.634155] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-15T18:38:53.634211] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-15T18:38:53.635525] [DEBUG] [LOCAL ] GIL: Trimmed 46580 records to 31665 (keeping 150 days of data) [2025-09-15T18:38:53.849849] [DEBUG] [LOCAL ] GIL: Primary data saved (31665 records). [2025-09-15T18:38:53.850004] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-15T18:38:53.850090] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIL took 20.7s. Estimated remaining: 2h 31m 36s. Rate: 9.5 symbols/min [2025-09-15T18:38:54.029788] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:54.057923] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-15T18:38:54.071612] [DEBUG] [LOCAL ] GLOB: Loaded 35854 existing records from primary storage. [2025-09-15T18:38:54.071842] [INFO ] [MAIN ] GLOB: Loaded 35854 existing records. [2025-09-15T18:38:54.299204] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:38:54.304846] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:54.316415] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-15T18:38:54.316478] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-15T18:38:54.317285] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-15T18:38:54.317350] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-15T18:38:54.681928] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:54.820041] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:38:54.857907] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-15T18:38:55.657889] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-15T18:38:55.815605] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:38:56.273847] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:38:56.457899] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-15T18:38:57.257853] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-15T18:38:57.475114] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T18:38:58.034767] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:38:58.057825] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-15T18:38:58.813729] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:38:58.857888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-15T18:38:59.256525] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:38:59.657884] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-15T18:39:00.288312] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:39:00.457875] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-15T18:39:01.140036] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:39:01.257883] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-15T18:39:02.057908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-15T18:39:02.434731] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T18:39:02.510974] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T18:39:02.857880] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-15T18:39:03.657924] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-15T18:39:04.293255] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T18:39:04.457874] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-15T18:39:05.257951] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-15T18:39:06.103140] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T18:39:06.112080] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-15T18:39:06.178796] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-15T18:39:06.682424] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-15T18:39:06.857897] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-15T18:39:07.198085] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T18:39:07.233009] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:39:07.657889] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-15T18:39:08.078043] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:39:08.457921] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-15T18:39:09.257945] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-15T18:39:09.550396] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:39:09.556561] [INFO ] [REMOTE ] GIS: Full fetch complete (58353 records). [2025-09-15T18:39:09.556737] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-15T18:39:09.983151] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-15T18:39:09.983277] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-15T18:39:09.984313] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-15T18:39:09.984431] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-15T18:39:09.986064] [DEBUG] [LOCAL ] GIS: Trimmed 58353 records to 39641 (keeping 150 days of data) [2025-09-15T18:39:10.069181] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-15T18:39:10.204108] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T18:39:10.373378] [DEBUG] [LOCAL ] GIS: Primary data saved (39641 records). [2025-09-15T18:39:10.373582] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-15T18:39:10.373765] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIS took 28.5s. Estimated remaining: 2h 31m 45s. Rate: 9.4 symbols/min [2025-09-15T18:39:10.614501] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:10.625525] [DEBUG] [LOCAL ] GLP: Loaded 7000 existing records from primary storage. [2025-09-15T18:39:10.625717] [INFO ] [MAIN ] GLP: Loaded 7000 existing records. [2025-09-15T18:39:10.860559] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-15T18:39:10.908900] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:10.909927] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-15T18:39:10.910004] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-15T18:39:10.910364] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-15T18:39:10.910416] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-15T18:39:11.071381] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:39:11.352295] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:11.445254] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:39:11.657871] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-15T18:39:12.083564] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:39:12.457889] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-15T18:39:13.232371] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:39:13.257861] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-15T18:39:13.670787] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:39:14.057934] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-15T18:39:14.301275] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:39:14.305297] [INFO ] [REMOTE ] GL: Full fetch complete (41632 records). [2025-09-15T18:39:14.305424] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-15T18:39:14.689595] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-15T18:39:14.689728] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-15T18:39:14.690392] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-15T18:39:14.690438] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-15T18:39:14.691574] [DEBUG] [LOCAL ] GL: Trimmed 41632 records to 27677 (keeping 150 days of data) [2025-09-15T18:39:14.861633] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-15T18:39:14.875406] [DEBUG] [LOCAL ] GL: Primary data saved (27677 records). [2025-09-15T18:39:14.875482] [INFO ] [MAIN ] GL: Full history saved. [2025-09-15T18:39:14.875574] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GL took 22.4s. Estimated remaining: 2h 31m 36s. Rate: 9.4 symbols/min [2025-09-15T18:39:15.044042] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:15.083444] [DEBUG] [LOCAL ] GLW: Loaded 40377 existing records from primary storage. [2025-09-15T18:39:15.083586] [INFO ] [MAIN ] GLW: Loaded 40377 existing records. [2025-09-15T18:39:15.259863] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:15.260094] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-15T18:39:15.260138] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-15T18:39:15.261036] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-15T18:39:15.261086] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-15T18:39:15.617525] [INFO ] [REMOTE ] GLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:15.632119] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:39:15.641769] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:39:15.647608] [INFO ] [REMOTE ] GKOS: Full fetch complete (46562 records). [2025-09-15T18:39:15.647816] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-15T18:39:15.663239] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-15T18:39:16.059744] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-15T18:39:16.059841] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-15T18:39:16.060595] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-15T18:39:16.060666] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-15T18:39:16.062297] [DEBUG] [LOCAL ] GKOS: Trimmed 46562 records to 31298 (keeping 150 days of data) [2025-09-15T18:39:16.257467] [DEBUG] [LOCAL ] GKOS: Primary data saved (31298 records). [2025-09-15T18:39:16.257626] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-15T18:39:16.257783] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GKOS took 29.4s. Estimated remaining: 2h 31m 22s. Rate: 9.5 symbols/min [2025-09-15T18:39:16.434663] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:16.460199] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-15T18:39:16.478253] [DEBUG] [LOCAL ] GM: Loaded 40470 existing records from primary storage. [2025-09-15T18:39:16.478397] [INFO ] [MAIN ] GM: Loaded 40470 existing records. [2025-09-15T18:39:16.651549] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:16.651854] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-15T18:39:16.651903] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-15T18:39:16.652883] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-15T18:39:16.652936] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-15T18:39:17.052628] [INFO ] [REMOTE ] GM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:17.257892] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-15T18:39:17.992537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:39:18.057939] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-15T18:39:18.692014] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-15T18:39:18.853029] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:39:18.857808] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-15T18:39:19.604788] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:39:19.657884] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-15T18:39:19.969465] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-15T18:39:19.976408] [INFO ] [REMOTE ] GLOB: Full fetch complete (50787 records). [2025-09-15T18:39:19.976607] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-15T18:39:20.366078] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-15T18:39:20.366206] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-15T18:39:20.367312] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-15T18:39:20.367361] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-15T18:39:20.368854] [DEBUG] [LOCAL ] GLOB: Trimmed 50787 records to 35383 (keeping 150 days of data) [2025-09-15T18:39:20.471046] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-15T18:39:20.609284] [DEBUG] [LOCAL ] GLOB: Primary data saved (35383 records). [2025-09-15T18:39:20.609493] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-15T18:39:20.609609] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLOB took 26.8s. Estimated remaining: 2h 31m 12s. Rate: 9.5 symbols/min [2025-09-15T18:39:20.807457] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:20.851304] [DEBUG] [LOCAL ] GME: Loaded 40527 existing records from primary storage. [2025-09-15T18:39:20.851629] [INFO ] [MAIN ] GME: Loaded 40527 existing records. [2025-09-15T18:39:21.037363] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:21.037712] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-15T18:39:21.037765] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-15T18:39:21.038770] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-15T18:39:21.038830] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-15T18:39:21.267844] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-15T18:39:21.424001] [INFO ] [REMOTE ] GME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:21.482476] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T18:39:22.043554] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:39:22.057841] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-15T18:39:22.289529] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T18:39:22.857907] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-15T18:39:23.657946] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-15T18:39:23.877463] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:39:24.457973] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-15T18:39:24.664788] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:39:25.257885] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-15T18:39:25.584036] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T18:39:25.694859] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:39:26.057894] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-15T18:39:26.550996] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:39:26.857864] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-15T18:39:27.258224] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T18:39:27.657868] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-15T18:39:28.457917] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-15T18:39:29.257887] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-15T18:39:29.437073] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-15T18:39:29.454395] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:39:29.986594] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-15T18:39:30.057813] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-15T18:39:30.847810] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:39:30.858364] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-15T18:39:31.657903] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-15T18:39:31.747122] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:39:31.749507] [INFO ] [REMOTE ] GLP: Full fetch complete (10340 records). [2025-09-15T18:39:31.749596] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-15T18:39:31.750084] [FATAL] [VALIDATOR ] GLP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:39:31.750169] [FATAL] [MAIN ] GLP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:39:31.750206] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:39:31.750266] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-15T18:39:31.750341] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-15T18:39:31.750379] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-09-15T18:39:31.750720] [DEBUG] [LOCAL ] GLP: Deleted derivative data file. [2025-09-15T18:39:31.750808] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 21.4s. Estimated remaining: 2h 31m 13s. Rate: 9.4 symbols/min [2025-09-15T18:39:31.921335] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:31.957627] [DEBUG] [LOCAL ] GMED: Loaded 36187 existing records from primary storage. [2025-09-15T18:39:31.957805] [INFO ] [MAIN ] GMED: Loaded 36187 existing records. [2025-09-15T18:39:32.135814] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:32.136064] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-15T18:39:32.136111] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-15T18:39:32.136872] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-15T18:39:32.136922] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-15T18:39:32.469043] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-15T18:39:32.497546] [INFO ] [REMOTE ] GMED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:32.530769] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-15T18:39:33.257918] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-15T18:39:33.892688] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T18:39:34.057905] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-15T18:39:34.421892] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T18:39:34.857853] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-15T18:39:34.955606] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:39:35.657917] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-15T18:39:36.444514] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-15T18:39:36.466746] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-15T18:39:36.486193] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:39:37.257906] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-15T18:39:37.612275] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T18:39:38.057956] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-15T18:39:38.845827] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T18:39:38.857755] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-15T18:39:39.195445] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:39:39.202102] [INFO ] [REMOTE ] GLW: Full fetch complete (58307 records). [2025-09-15T18:39:39.202286] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-15T18:39:39.584094] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-15T18:39:39.584193] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-15T18:39:39.585115] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-15T18:39:39.585170] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-15T18:39:39.586554] [DEBUG] [LOCAL ] GLW: Trimmed 58307 records to 39598 (keeping 150 days of data) [2025-09-15T18:39:39.679845] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-15T18:39:39.844685] [DEBUG] [LOCAL ] GLW: Primary data saved (39598 records). [2025-09-15T18:39:39.844870] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-15T18:39:39.845602] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLW took 25.0s. Estimated remaining: 2h 31m 10s. Rate: 9.4 symbols/min [2025-09-15T18:39:40.015326] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:40.043849] [DEBUG] [LOCAL ] GMRE: Loaded 28453 existing records from primary storage. [2025-09-15T18:39:40.043997] [INFO ] [MAIN ] GMRE: Loaded 28453 existing records. [2025-09-15T18:39:40.221752] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:40.222218] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-15T18:39:40.222322] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-15T18:39:40.223055] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-15T18:39:40.223115] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-15T18:39:40.641620] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:40.643457] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-15T18:39:40.647395] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-15T18:39:40.941263] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:39:41.041660] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T18:39:41.257919] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-15T18:39:41.823123] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:39:42.057865] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-15T18:39:42.857880] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-15T18:39:43.169014] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T18:39:43.174947] [INFO ] [REMOTE ] GME: Full fetch complete (58436 records). [2025-09-15T18:39:43.175098] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-15T18:39:43.562001] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-15T18:39:43.562093] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-15T18:39:43.562878] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-15T18:39:43.562987] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-15T18:39:43.582491] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:39:43.582614] [DEBUG] [LOCAL ] GME: Trimmed 58436 records to 39747 (keeping 150 days of data) [2025-09-15T18:39:43.678516] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-15T18:39:43.834358] [DEBUG] [LOCAL ] GME: Primary data saved (39747 records). [2025-09-15T18:39:43.834507] [INFO ] [MAIN ] GME: Full history saved. [2025-09-15T18:39:43.835345] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GME took 23.2s. Estimated remaining: 2h 30m 60s. Rate: 9.5 symbols/min [2025-09-15T18:39:44.007327] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:44.023495] [DEBUG] [LOCAL ] GNE: Loaded 14647 existing records from primary storage. [2025-09-15T18:39:44.023629] [INFO ] [MAIN ] GNE: Loaded 14647 existing records. [2025-09-15T18:39:44.207978] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:44.208259] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-15T18:39:44.208353] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-15T18:39:44.208856] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-15T18:39:44.208908] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-15T18:39:44.467435] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-15T18:39:44.602532] [INFO ] [REMOTE ] GNE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:44.632434] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:39:45.053945] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:39:45.257891] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-15T18:39:45.905144] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:39:46.057874] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-15T18:39:46.857891] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-15T18:39:46.913090] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T18:39:47.657924] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-15T18:39:47.823042] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:39:48.004426] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T18:39:48.010543] [INFO ] [REMOTE ] GM: Full fetch complete (58408 records). [2025-09-15T18:39:48.010690] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-15T18:39:48.392576] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-15T18:39:48.392678] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-15T18:39:48.393514] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-15T18:39:48.393558] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-15T18:39:48.395137] [DEBUG] [LOCAL ] GM: Trimmed 58408 records to 39689 (keeping 150 days of data) [2025-09-15T18:39:48.459853] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-15T18:39:48.656550] [DEBUG] [LOCAL ] GM: Primary data saved (39689 records). [2025-09-15T18:39:48.656720] [INFO ] [MAIN ] GM: Full history saved. [2025-09-15T18:39:48.657468] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 32.4s. Estimated remaining: 2h 30m 51s. Rate: 9.5 symbols/min [2025-09-15T18:39:48.831061] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:48.863226] [DEBUG] [LOCAL ] GNK: Loaded 29950 existing records from primary storage. [2025-09-15T18:39:48.863363] [INFO ] [MAIN ] GNK: Loaded 29950 existing records. [2025-09-15T18:39:49.040091] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:49.040354] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-15T18:39:49.040400] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-15T18:39:49.041125] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-15T18:39:49.041175] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-15T18:39:49.262187] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-15T18:39:49.399244] [INFO ] [REMOTE ] GNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:49.431450] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T18:39:49.805316] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:39:50.057915] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-15T18:39:50.121981] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T18:39:50.857885] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-15T18:39:51.657809] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:39:51.657893] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-15T18:39:52.034028] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:39:52.185218] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:39:52.457860] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-15T18:39:53.095537] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:39:53.257862] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-15T18:39:54.057947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-15T18:39:54.857891] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-15T18:39:54.903610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:39:55.342845] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:39:55.657893] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-15T18:39:55.976618] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:39:56.457920] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-15T18:39:57.206167] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:39:57.257835] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-15T18:39:57.639495] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T18:39:58.057899] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-15T18:39:58.697907] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:39:58.857920] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-15T18:39:59.269091] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:39:59.657895] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-15T18:40:00.417800] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:40:00.457870] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-15T18:40:01.211951] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:40:01.257834] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-15T18:40:01.820198] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:40:02.057892] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-15T18:40:02.444548] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:40:02.450722] [INFO ] [REMOTE ] GMRE: Full fetch complete (40042 records). [2025-09-15T18:40:02.450923] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-15T18:40:02.451784] [FATAL] [VALIDATOR ] GMRE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:40:02.451914] [FATAL] [MAIN ] GMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:40:02.451970] [WARN ] [MAIN ] GMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:40:02.452029] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-15T18:40:02.452126] [DEBUG] [LOCAL ] GMRE: No primary data file found to delete. [2025-09-15T18:40:02.452183] [INFO ] [LOCAL ] GMRE: Starting deletion of derivative data. [2025-09-15T18:40:02.452594] [DEBUG] [LOCAL ] GMRE: Deleted derivative data file. [2025-09-15T18:40:02.452769] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 22.6s. Estimated remaining: 2h 30m 56s. Rate: 9.4 symbols/min [2025-09-15T18:40:02.662736] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:02.709140] [DEBUG] [LOCAL ] GNL: Loaded 35163 existing records from primary storage. [2025-09-15T18:40:02.709343] [INFO ] [MAIN ] GNL: Loaded 35163 existing records. [2025-09-15T18:40:02.863368] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-15T18:40:02.979951] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:02.980452] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-15T18:40:02.980530] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-15T18:40:02.981699] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-15T18:40:02.981793] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-15T18:40:03.577828] [INFO ] [REMOTE ] GNL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:03.609381] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:40:03.657960] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-15T18:40:04.218058] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:40:04.220626] [INFO ] [REMOTE ] GNE: Full fetch complete (18098 records). [2025-09-15T18:40:04.220745] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-15T18:40:04.470121] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-15T18:40:04.607588] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-15T18:40:04.607691] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-15T18:40:04.608141] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-15T18:40:04.608190] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-15T18:40:04.608777] [DEBUG] [LOCAL ] GNE: Trimmed 18098 records to 14550 (keeping 150 days of data) [2025-09-15T18:40:04.701959] [DEBUG] [LOCAL ] GNE: Primary data saved (14550 records). [2025-09-15T18:40:04.702121] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-15T18:40:04.702207] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 20.9s. Estimated remaining: 2h 30m 43s. Rate: 9.4 symbols/min [2025-09-15T18:40:04.876557] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:04.913830] [DEBUG] [LOCAL ] GNRC: Loaded 33818 existing records from primary storage. [2025-09-15T18:40:04.913999] [INFO ] [MAIN ] GNRC: Loaded 33818 existing records. [2025-09-15T18:40:05.096004] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:05.096295] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-15T18:40:05.096345] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-15T18:40:05.097172] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-15T18:40:05.097231] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-15T18:40:05.259155] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-15T18:40:05.489524] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:05.494096] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:40:05.672282] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:40:06.057882] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-15T18:40:06.857944] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-15T18:40:06.996526] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:40:07.408560] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:40:07.413373] [INFO ] [REMOTE ] GNK: Full fetch complete (44425 records). [2025-09-15T18:40:07.413555] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-15T18:40:07.670038] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-15T18:40:07.810967] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-15T18:40:07.811075] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-15T18:40:07.811893] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-15T18:40:07.811953] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-15T18:40:07.813217] [DEBUG] [LOCAL ] GNK: Trimmed 44425 records to 29366 (keeping 150 days of data) [2025-09-15T18:40:07.997685] [DEBUG] [LOCAL ] GNK: Primary data saved (29366 records). [2025-09-15T18:40:07.997845] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-15T18:40:07.997936] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GNK took 19.3s. Estimated remaining: 2h 30m 32s. Rate: 9.5 symbols/min [2025-09-15T18:40:08.172759] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:08.207101] [DEBUG] [LOCAL ] GNT: Loaded 5911 existing records from primary storage. [2025-09-15T18:40:08.207273] [INFO ] [MAIN ] GNT: Loaded 5911 existing records. [2025-09-15T18:40:08.253038] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:40:08.410742] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:08.411107] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-15T18:40:08.411159] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-15T18:40:08.411716] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-15T18:40:08.411964] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-15T18:40:08.467962] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-15T18:40:08.778150] [INFO ] [REMOTE ] GNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:08.883100] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:40:09.258005] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-15T18:40:09.913027] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:40:10.057869] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-15T18:40:10.172755] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T18:40:10.857961] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-15T18:40:11.628127] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:40:11.657815] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-15T18:40:12.307761] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:40:12.313372] [INFO ] [REMOTE ] GMED: Full fetch complete (52590 records). [2025-09-15T18:40:12.313488] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-15T18:40:12.463098] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-15T18:40:12.715300] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-15T18:40:12.715405] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-15T18:40:12.716325] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-15T18:40:12.716386] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-15T18:40:12.717631] [DEBUG] [LOCAL ] GMED: Trimmed 52590 records to 35554 (keeping 150 days of data) [2025-09-15T18:40:12.941921] [DEBUG] [LOCAL ] GMED: Primary data saved (35554 records). [2025-09-15T18:40:12.942156] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-15T18:40:12.942386] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GMED took 41.2s. Estimated remaining: 2h 30m 24s. Rate: 9.5 symbols/min [2025-09-15T18:40:13.048976] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:40:13.155754] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:13.162271] [DEBUG] [LOCAL ] GNTY: Loaded 5735 existing records from primary storage. [2025-09-15T18:40:13.162347] [INFO ] [MAIN ] GNTY: Loaded 5735 existing records. [2025-09-15T18:40:13.260097] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-15T18:40:13.336593] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:13.336837] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-15T18:40:13.336892] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-15T18:40:13.337179] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-15T18:40:13.337229] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-15T18:40:13.718867] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:13.884918] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:40:14.057819] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-15T18:40:14.085237] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:40:14.796044] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:40:14.857827] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-15T18:40:15.657875] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-15T18:40:16.241328] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:40:16.457889] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-15T18:40:16.471013] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:40:17.257879] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-15T18:40:17.693157] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:40:17.970830] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T18:40:18.057883] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-15T18:40:18.857930] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-15T18:40:19.421882] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:40:19.658464] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:40:19.658555] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-15T18:40:20.457889] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-15T18:40:20.471508] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:40:21.257869] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-15T18:40:21.934413] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:40:22.057869] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-15T18:40:22.117788] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T18:40:22.716782] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T18:40:22.857872] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-15T18:40:23.657875] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-15T18:40:24.149503] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:40:24.171387] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:40:24.173276] [INFO ] [REMOTE ] GNT: Full fetch complete (8280 records). [2025-09-15T18:40:24.173350] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-15T18:40:24.459773] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-15T18:40:24.546731] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-15T18:40:24.546826] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-15T18:40:24.547055] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-15T18:40:24.547100] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-15T18:40:24.547528] [DEBUG] [LOCAL ] GNT: Trimmed 8280 records to 5815 (keeping 150 days of data) [2025-09-15T18:40:24.582610] [DEBUG] [LOCAL ] GNT: Primary data saved (5815 records). [2025-09-15T18:40:24.582790] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-15T18:40:24.582916] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNT took 16.6s. Estimated remaining: 2h 30m 26s. Rate: 9.4 symbols/min [2025-09-15T18:40:24.751884] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:24.787573] [DEBUG] [LOCAL ] GNW: Loaded 38622 existing records from primary storage. [2025-09-15T18:40:24.787743] [INFO ] [MAIN ] GNW: Loaded 38622 existing records. [2025-09-15T18:40:24.976229] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:24.976469] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-15T18:40:24.976515] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-15T18:40:24.977240] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-15T18:40:24.977297] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-15T18:40:25.104129] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T18:40:25.260672] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-15T18:40:25.342188] [INFO ] [REMOTE ] GNW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:26.057878] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-15T18:40:26.857875] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-15T18:40:27.079415] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T18:40:27.326202] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:40:27.657924] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-15T18:40:28.075138] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:40:28.080099] [INFO ] [REMOTE ] GNRC: Full fetch complete (49277 records). [2025-09-15T18:40:28.080226] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-15T18:40:28.465348] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-15T18:40:28.468095] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-15T18:40:28.469085] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-15T18:40:28.469884] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-15T18:40:28.469939] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-15T18:40:28.471193] [DEBUG] [LOCAL ] GNRC: Trimmed 49277 records to 33188 (keeping 150 days of data) [2025-09-15T18:40:28.690946] [DEBUG] [LOCAL ] GNRC: Primary data saved (33188 records). [2025-09-15T18:40:28.691134] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-15T18:40:28.691224] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNRC took 24.0s. Estimated remaining: 2h 30m 16s. Rate: 9.5 symbols/min [2025-09-15T18:40:28.864031] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:28.897160] [DEBUG] [LOCAL ] GOF: Loaded 31610 existing records from primary storage. [2025-09-15T18:40:28.897306] [INFO ] [MAIN ] GOF: Loaded 31610 existing records. [2025-09-15T18:40:29.081381] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:29.081817] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-15T18:40:29.081898] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-15T18:40:29.082754] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-15T18:40:29.082813] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-15T18:40:29.261303] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-15T18:40:29.351029] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:40:29.496078] [INFO ] [REMOTE ] GOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:29.893489] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T18:40:30.035251] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:40:30.057880] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-15T18:40:30.857899] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-15T18:40:31.657920] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-15T18:40:31.710259] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:40:32.174152] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:40:32.179952] [INFO ] [REMOTE ] GNL: Full fetch complete (51582 records). [2025-09-15T18:40:32.180174] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-15T18:40:32.463171] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-15T18:40:32.576106] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-15T18:40:32.576207] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-15T18:40:32.577187] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-15T18:40:32.577243] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-15T18:40:32.578569] [DEBUG] [LOCAL ] GNL: Trimmed 51582 records to 34319 (keeping 150 days of data) [2025-09-15T18:40:32.782192] [DEBUG] [LOCAL ] GNL: Primary data saved (34319 records). [2025-09-15T18:40:32.782347] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-15T18:40:32.782446] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNL took 30.3s. Estimated remaining: 2h 30m 6s. Rate: 9.5 symbols/min [2025-09-15T18:40:32.955756] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:32.978313] [DEBUG] [LOCAL ] GOLF: Loaded 23261 existing records from primary storage. [2025-09-15T18:40:32.978463] [INFO ] [MAIN ] GOLF: Loaded 23261 existing records. [2025-09-15T18:40:33.161516] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:33.161833] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-15T18:40:33.161885] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-15T18:40:33.162493] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-15T18:40:33.162548] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-15T18:40:33.260744] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-15T18:40:33.401842] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T18:40:33.547241] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:33.573299] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:40:34.057876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-15T18:40:34.857875] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-15T18:40:34.930932] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:40:35.634016] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:40:35.657813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-15T18:40:35.736378] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T18:40:36.457936] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-15T18:40:37.195857] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T18:40:37.257906] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-15T18:40:38.057969] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-15T18:40:38.347763] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:40:38.402000] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T18:40:38.857876] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-15T18:40:39.250622] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:40:39.657876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-15T18:40:40.457903] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-15T18:40:40.508946] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:40:40.817244] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:40:41.257876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-15T18:40:41.738051] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:40:42.057884] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-15T18:40:42.857919] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-15T18:40:42.906969] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:40:43.054304] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T18:40:43.635069] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T18:40:43.657829] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-15T18:40:44.323429] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T18:40:44.324981] [INFO ] [REMOTE ] GNTY: Full fetch complete (7279 records). [2025-09-15T18:40:44.325058] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-15T18:40:44.325542] [FATAL] [VALIDATOR ] GNTY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:40:44.325663] [FATAL] [MAIN ] GNTY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:40:44.325706] [WARN ] [MAIN ] GNTY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:40:44.325749] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-15T18:40:44.325816] [DEBUG] [LOCAL ] GNTY: No primary data file found to delete. [2025-09-15T18:40:44.325854] [INFO ] [LOCAL ] GNTY: Starting deletion of derivative data. [2025-09-15T18:40:44.326189] [DEBUG] [LOCAL ] GNTY: Deleted derivative data file. [2025-09-15T18:40:44.326329] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNTY took 31.4s. Estimated remaining: 2h 30m 7s. Rate: 9.4 symbols/min [2025-09-15T18:40:44.466360] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-15T18:40:44.499377] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:44.538507] [DEBUG] [LOCAL ] GOOS: Loaded 34330 existing records from primary storage. [2025-09-15T18:40:44.538762] [INFO ] [MAIN ] GOOS: Loaded 34330 existing records. [2025-09-15T18:40:44.740353] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:44.740725] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-15T18:40:44.740793] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-15T18:40:44.741517] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-15T18:40:44.741575] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-15T18:40:45.112549] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:45.257922] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-15T18:40:46.031427] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:40:46.057862] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-15T18:40:46.633778] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:40:46.857879] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-15T18:40:47.564519] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T18:40:47.569401] [INFO ] [REMOTE ] GOF: Full fetch complete (46806 records). [2025-09-15T18:40:47.569509] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-15T18:40:47.663040] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-15T18:40:47.941413] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:40:47.978055] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-15T18:40:47.978180] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-15T18:40:47.979033] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-15T18:40:47.979096] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-15T18:40:47.980410] [DEBUG] [LOCAL ] GOF: Trimmed 46806 records to 30983 (keeping 150 days of data) [2025-09-15T18:40:48.183305] [DEBUG] [LOCAL ] GOF: Primary data saved (30983 records). [2025-09-15T18:40:48.183473] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-15T18:40:48.183565] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 19.5s. Estimated remaining: 2h 29m 57s. Rate: 9.4 symbols/min [2025-09-15T18:40:48.354923] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:48.381539] [DEBUG] [LOCAL ] GOTU: Loaded 28001 existing records from primary storage. [2025-09-15T18:40:48.381703] [INFO ] [MAIN ] GOTU: Loaded 28001 existing records. [2025-09-15T18:40:48.463023] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-15T18:40:48.560297] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:48.560568] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-15T18:40:48.560624] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-15T18:40:48.561261] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-15T18:40:48.561323] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-15T18:40:48.918844] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:49.257874] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-15T18:40:49.364470] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:40:49.876519] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:40:50.057867] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-15T18:40:50.780581] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:40:50.857819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-15T18:40:51.117778] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:40:51.657883] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-15T18:40:52.108926] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:40:52.457875] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-15T18:40:53.223275] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:40:53.229305] [INFO ] [REMOTE ] GNW: Full fetch complete (55728 records). [2025-09-15T18:40:53.229427] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-15T18:40:53.262943] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-15T18:40:53.611369] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-15T18:40:53.611447] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-15T18:40:53.612204] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-15T18:40:53.612258] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-15T18:40:53.613417] [DEBUG] [LOCAL ] GNW: Trimmed 55728 records to 37886 (keeping 150 days of data) [2025-09-15T18:40:53.838394] [DEBUG] [LOCAL ] GNW: Primary data saved (37886 records). [2025-09-15T18:40:53.838549] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-15T18:40:53.839073] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 29.3s. Estimated remaining: 2h 29m 50s. Rate: 9.5 symbols/min [2025-09-15T18:40:54.008506] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:54.060072] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-15T18:40:54.073391] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:40:54.074317] [DEBUG] [LOCAL ] GPC: Loaded 34452 existing records from primary storage. [2025-09-15T18:40:54.084277] [INFO ] [MAIN ] GPC: Loaded 34452 existing records. [2025-09-15T18:40:54.267065] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:54.267416] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-15T18:40:54.267561] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-15T18:40:54.268428] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-15T18:40:54.268497] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-15T18:40:54.450144] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:40:54.656026] [INFO ] [REMOTE ] GPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:54.857875] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-15T18:40:55.568609] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T18:40:55.657934] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-15T18:40:56.463317] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-15T18:40:56.474610] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:40:56.676708] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:40:56.680347] [INFO ] [REMOTE ] GOLF: Full fetch complete (35769 records). [2025-09-15T18:40:56.680512] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-15T18:40:57.092398] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-15T18:40:57.092493] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-15T18:40:57.093176] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-15T18:40:57.093223] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-15T18:40:57.094635] [DEBUG] [LOCAL ] GOLF: Trimmed 35769 records to 22665 (keeping 150 days of data) [2025-09-15T18:40:57.255870] [DEBUG] [LOCAL ] GOLF: Primary data saved (22665 records). [2025-09-15T18:40:57.256026] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-15T18:40:57.256138] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOLF took 24.5s. Estimated remaining: 2h 29m 39s. Rate: 9.5 symbols/min [2025-09-15T18:40:57.267854] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-15T18:40:57.443934] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:57.455945] [DEBUG] [LOCAL ] GPI: Loaded 10289 existing records from primary storage. [2025-09-15T18:40:57.456104] [INFO ] [MAIN ] GPI: Loaded 10289 existing records. [2025-09-15T18:40:57.642549] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:57.642851] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-15T18:40:57.642902] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-15T18:40:57.643275] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-15T18:40:57.643324] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-15T18:40:57.999107] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:58.034698] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:40:58.057872] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-15T18:40:58.857915] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-15T18:40:58.927590] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T18:40:59.419688] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:40:59.657918] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-15T18:40:59.788087] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T18:41:00.457879] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-15T18:41:01.101300] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:41:01.257861] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-15T18:41:02.057923] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-15T18:41:02.177424] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:41:02.862957] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-15T18:41:02.879509] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:41:03.085185] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:41:03.657888] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-15T18:41:04.305072] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:41:04.457917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-15T18:41:04.839070] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:41:05.257873] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-15T18:41:05.864967] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:41:06.057938] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-15T18:41:06.592727] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:41:06.857886] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-15T18:41:07.561295] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:41:07.566270] [INFO ] [REMOTE ] GOTU: Full fetch complete (44025 records). [2025-09-15T18:41:07.566362] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-15T18:41:07.662937] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-15T18:41:07.937607] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-15T18:41:07.937772] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-15T18:41:07.938468] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-15T18:41:07.938513] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-15T18:41:07.939677] [DEBUG] [LOCAL ] GOTU: Trimmed 44025 records to 27638 (keeping 150 days of data) [2025-09-15T18:41:08.109126] [DEBUG] [LOCAL ] GOTU: Primary data saved (27638 records). [2025-09-15T18:41:08.109365] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-15T18:41:08.109507] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOTU took 19.9s. Estimated remaining: 2h 29m 40s. Rate: 9.4 symbols/min [2025-09-15T18:41:08.295949] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:08.302079] [DEBUG] [LOCAL ] GPJA: Loaded 3110 existing records from primary storage. [2025-09-15T18:41:08.302187] [INFO ] [MAIN ] GPJA: Loaded 3110 existing records. [2025-09-15T18:41:08.458788] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-15T18:41:08.480399] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:08.480612] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-15T18:41:08.480688] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-15T18:41:08.480964] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-15T18:41:08.481013] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-15T18:41:08.843865] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:08.922116] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:41:08.928170] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T18:41:09.257910] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-15T18:41:10.057853] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-15T18:41:10.098403] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:41:10.715126] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T18:41:10.762407] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T18:41:10.857826] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-15T18:41:11.657917] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-15T18:41:12.457926] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-15T18:41:12.580110] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:41:12.597520] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:41:13.257927] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-15T18:41:13.407540] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:41:13.799584] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:41:14.057895] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-15T18:41:14.460009] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T18:41:14.857879] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-15T18:41:15.657870] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-15T18:41:16.131687] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:41:16.457885] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-15T18:41:17.257883] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-15T18:41:17.402238] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:41:17.407716] [INFO ] [REMOTE ] GOOS: Full fetch complete (50117 records). [2025-09-15T18:41:17.407900] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-15T18:41:17.795702] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-15T18:41:17.795786] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-15T18:41:17.796475] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-15T18:41:17.796516] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-15T18:41:17.797522] [DEBUG] [LOCAL ] GOOS: Trimmed 50117 records to 33701 (keeping 150 days of data) [2025-09-15T18:41:18.007067] [DEBUG] [LOCAL ] GOOS: Primary data saved (33701 records). [2025-09-15T18:41:18.007198] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-15T18:41:18.007281] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GOOS took 33.7s. Estimated remaining: 2h 29m 39s. Rate: 9.4 symbols/min [2025-09-15T18:41:18.076187] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-15T18:41:18.186617] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:18.212192] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:41:18.213331] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T18:41:18.222857] [INFO ] [REMOTE ] GPC: Full fetch complete (51267 records). [2025-09-15T18:41:18.222959] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-15T18:41:18.485730] [DEBUG] [LOCAL ] GPK: Loaded 39725 existing records from primary storage. [2025-09-15T18:41:18.507964] [INFO ] [MAIN ] GPK: Loaded 39725 existing records. [2025-09-15T18:41:18.574273] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:41:18.767001] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-15T18:41:18.795493] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-15T18:41:18.823498] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-15T18:41:18.823609] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:18.823749] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-15T18:41:18.824026] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-15T18:41:18.824076] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-15T18:41:18.825133] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-15T18:41:18.825208] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-15T18:41:18.825091] [DEBUG] [LOCAL ] GPC: Trimmed 51267 records to 33780 (keeping 150 days of data) [2025-09-15T18:41:18.862923] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-15T18:41:19.298552] [INFO ] [REMOTE ] GPK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:19.411995] [DEBUG] [LOCAL ] GPC: Primary data saved (33780 records). [2025-09-15T18:41:19.412141] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-15T18:41:19.412848] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GPC took 25.6s. Estimated remaining: 2h 29m 25s. Rate: 9.5 symbols/min [2025-09-15T18:41:19.657861] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-15T18:41:19.682799] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:41:20.457873] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-15T18:41:21.257876] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-15T18:41:21.396935] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:41:21.574317] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:41:21.678677] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:41:22.057878] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-15T18:41:22.857917] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-15T18:41:23.553200] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:41:23.555233] [INFO ] [REMOTE ] GPI: Full fetch complete (16114 records). [2025-09-15T18:41:23.555312] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-15T18:41:23.658406] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-15T18:41:23.927880] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-15T18:41:23.927985] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-15T18:41:23.928448] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-15T18:41:23.928532] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-15T18:41:23.929331] [DEBUG] [LOCAL ] GPI: Trimmed 16114 records to 10095 (keeping 150 days of data) [2025-09-15T18:41:24.023616] [DEBUG] [LOCAL ] GPI: Primary data saved (10095 records). [2025-09-15T18:41:24.024252] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-15T18:41:24.024368] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 26.8s. Estimated remaining: 2h 29m 16s. Rate: 9.5 symbols/min [2025-09-15T18:41:24.025444] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T18:41:24.425106] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:41:24.457901] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-15T18:41:25.257897] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-15T18:41:25.862745] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:41:25.863903] [INFO ] [REMOTE ] GPJA: Full fetch complete (4332 records). [2025-09-15T18:41:25.863977] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-15T18:41:26.222164] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-15T18:41:26.222333] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-15T18:41:26.222518] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-15T18:41:26.222571] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-15T18:41:26.223134] [DEBUG] [LOCAL ] GPJA: Trimmed 4332 records to 3082 (keeping 150 days of data) [2025-09-15T18:41:26.271011] [DEBUG] [LOCAL ] GPJA: Primary data saved (3082 records). [2025-09-15T18:41:26.271479] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-15T18:41:26.272725] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPJA took 18.2s. Estimated remaining: 2h 29m 4s. Rate: 9.5 symbols/min [2025-09-15T18:41:26.272539] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T18:41:26.283942] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-15T18:41:28.097766] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:41:28.109135] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-15T18:41:29.590613] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:41:29.601553] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-15T18:41:30.786303] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T18:41:30.797950] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-15T18:41:32.321595] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:41:32.333443] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-15T18:41:33.972117] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:41:33.978036] [INFO ] [REMOTE ] GPK: Full fetch complete (57062 records). [2025-09-15T18:41:33.978158] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-15T18:41:34.360092] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-15T18:41:34.360195] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-15T18:41:34.361115] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-15T18:41:34.361179] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-15T18:41:34.362562] [DEBUG] [LOCAL ] GPK: Trimmed 57062 records to 39013 (keeping 150 days of data) [2025-09-15T18:41:34.620730] [DEBUG] [LOCAL ] GPK: Primary data saved (39013 records). [2025-09-15T18:41:34.620875] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-15T18:41:34.620959] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 16.6s. Estimated remaining: 2h 29m 0s. Rate: 9.5 symbols/min [2025-09-15T18:41:35.185117] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.240114] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.270049] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.315895] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.359931] [DEBUG] [LOCAL ] GPRK: Loaded 28993 existing records from primary storage. [2025-09-15T18:41:35.361071] [INFO ] [MAIN ] GPRK: Loaded 28993 existing records. [2025-09-15T18:41:35.360758] [DEBUG] [LOCAL ] GPOR: Loaded 16535 existing records from primary storage. [2025-09-15T18:41:35.403427] [INFO ] [MAIN ] GPOR: Loaded 16535 existing records. [2025-09-15T18:41:35.498215] [DEBUG] [LOCAL ] GPMT: Loaded 20904 existing records from primary storage. [2025-09-15T18:41:35.535574] [DEBUG] [LOCAL ] GPN: Loaded 39199 existing records from primary storage. [2025-09-15T18:41:35.534604] [INFO ] [MAIN ] GPMT: Loaded 20904 existing records. [2025-09-15T18:41:35.551149] [INFO ] [MAIN ] GPN: Loaded 39199 existing records. [2025-09-15T18:41:36.013001] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.012821] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.081300] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.105252] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-15T18:41:36.124981] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-15T18:41:36.128372] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.128760] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-15T18:41:36.128984] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-15T18:41:36.128896] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.128502] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.150165] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-15T18:41:36.159793] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.170294] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.199626] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-15T18:41:36.199395] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-15T18:41:36.199548] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-15T18:41:36.236671] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-15T18:41:36.236863] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-15T18:41:36.220568] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-15T18:41:36.273168] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-15T18:41:37.517950] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.567062] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-15T18:41:37.581628] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.618354] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-15T18:41:37.679360] [INFO ] [REMOTE ] GPN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.734048] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-15T18:41:37.741159] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.742569] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-15T18:41:38.717456] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:41:38.722325] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-15T18:41:39.080280] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:41:39.085286] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-15T18:41:39.482568] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:41:39.491088] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-15T18:41:39.578473] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T18:41:39.589211] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-15T18:41:39.622593] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:41:39.628048] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-15T18:41:40.053082] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:41:40.058874] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-15T18:41:40.977224] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:41:40.985861] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-15T18:41:41.181537] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:41:41.189308] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-15T18:41:41.250552] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T18:41:41.257168] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-15T18:41:41.358633] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:41:41.369674] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-15T18:41:41.965097] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:41:41.970337] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-15T18:41:42.152722] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:41:42.161987] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-15T18:41:42.223141] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:41:42.618604] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:41:42.857910] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-15T18:41:42.928381] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T18:41:43.356973] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T18:41:43.657892] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-15T18:41:44.222811] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:41:44.462343] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-15T18:41:44.466996] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:41:45.263159] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-15T18:41:45.272913] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:41:46.057887] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-15T18:41:46.857879] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-15T18:41:47.097760] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:41:47.121296] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:41:47.657901] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-15T18:41:47.873618] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:41:48.457891] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-15T18:41:48.972224] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:41:49.257871] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-15T18:41:50.056465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:41:50.064282] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-15T18:41:50.498438] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:41:50.857875] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-15T18:41:51.110051] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:41:51.112187] [INFO ] [REMOTE ] GPMT: Full fetch complete (29205 records). [2025-09-15T18:41:51.112261] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-15T18:41:51.483242] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-15T18:41:51.483366] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-15T18:41:51.484615] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-15T18:41:51.484693] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-15T18:41:51.485836] [DEBUG] [LOCAL ] GPMT: Trimmed 29205 records to 20224 (keeping 150 days of data) [2025-09-15T18:41:51.616801] [DEBUG] [LOCAL ] GPMT: Primary data saved (20224 records). [2025-09-15T18:41:51.616995] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-15T18:41:51.617155] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPMT took 17.0s. Estimated remaining: 2h 29m 9s. Rate: 9.4 symbols/min [2025-09-15T18:41:51.663119] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-15T18:41:51.812743] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:51.835074] [DEBUG] [LOCAL ] GRBK: Loaded 19882 existing records from primary storage. [2025-09-15T18:41:51.835289] [INFO ] [MAIN ] GRBK: Loaded 19882 existing records. [2025-09-15T18:41:52.021179] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:52.021529] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-15T18:41:52.021581] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-15T18:41:52.022196] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-15T18:41:52.022251] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-15T18:41:52.417164] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:52.453802] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:41:52.458349] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-15T18:41:52.926917] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:41:52.930508] [INFO ] [REMOTE ] GPOR: Full fetch complete (24937 records). [2025-09-15T18:41:52.930604] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-15T18:41:53.263092] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-15T18:41:53.295100] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-15T18:41:53.295171] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-15T18:41:53.295687] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-15T18:41:53.295735] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-15T18:41:53.296405] [DEBUG] [LOCAL ] GPOR: Trimmed 24937 records to 16284 (keeping 150 days of data) [2025-09-15T18:41:53.399373] [DEBUG] [LOCAL ] GPOR: Primary data saved (16284 records). [2025-09-15T18:41:53.399533] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-15T18:41:53.399622] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPOR took 18.8s. Estimated remaining: 2h 28m 56s. Rate: 9.4 symbols/min [2025-09-15T18:41:53.564889] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:53.572575] [DEBUG] [LOCAL ] GRC: Loaded 6363 existing records from primary storage. [2025-09-15T18:41:53.572894] [INFO ] [MAIN ] GRC: Loaded 6363 existing records. [2025-09-15T18:41:53.748836] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:53.749229] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-15T18:41:53.749343] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-15T18:41:53.749723] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-15T18:41:53.749786] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-15T18:41:53.869853] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:41:54.063032] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-15T18:41:54.126334] [INFO ] [REMOTE ] GRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:54.857900] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-15T18:41:55.052834] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:41:55.287018] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:41:55.657932] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-15T18:41:56.035613] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:41:56.457886] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-15T18:41:56.681945] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:41:56.685878] [INFO ] [REMOTE ] GPRK: Full fetch complete (42558 records). [2025-09-15T18:41:56.685974] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-15T18:41:57.082710] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-15T18:41:57.082798] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-15T18:41:57.083450] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-15T18:41:57.083491] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-15T18:41:57.084599] [DEBUG] [LOCAL ] GPRK: Trimmed 42558 records to 28378 (keeping 150 days of data) [2025-09-15T18:41:57.248387] [DEBUG] [LOCAL ] GPRK: Primary data saved (28378 records). [2025-09-15T18:41:57.248531] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-15T18:41:57.248620] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPRK took 22.6s. Estimated remaining: 2h 28m 46s. Rate: 9.5 symbols/min [2025-09-15T18:41:57.262947] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-15T18:41:57.417937] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:57.432340] [DEBUG] [LOCAL ] GRDN: Loaded 15117 existing records from primary storage. [2025-09-15T18:41:57.432446] [INFO ] [MAIN ] GRDN: Loaded 15117 existing records. [2025-09-15T18:41:57.604912] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:57.605167] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-15T18:41:57.605223] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-15T18:41:57.605628] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-15T18:41:57.605711] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-15T18:41:57.957965] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:58.057907] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-15T18:41:58.312690] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:41:58.349012] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:41:58.615835] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:41:58.857886] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-15T18:41:59.657906] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-15T18:42:00.215464] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:42:00.221063] [INFO ] [REMOTE ] GPN: Full fetch complete (56620 records). [2025-09-15T18:42:00.221184] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-15T18:42:00.463907] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-15T18:42:00.577299] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:42:00.625805] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-15T18:42:00.625877] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-15T18:42:00.626681] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-15T18:42:00.626728] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-15T18:42:00.627776] [DEBUG] [LOCAL ] GPN: Trimmed 56620 records to 38444 (keeping 150 days of data) [2025-09-15T18:42:00.867050] [DEBUG] [LOCAL ] GPN: Primary data saved (38444 records). [2025-09-15T18:42:00.867231] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-15T18:42:00.867313] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 26.2s. Estimated remaining: 2h 28m 36s. Rate: 9.5 symbols/min [2025-09-15T18:42:01.035550] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:01.066078] [DEBUG] [LOCAL ] GRMN: Loaded 30492 existing records from primary storage. [2025-09-15T18:42:01.066219] [INFO ] [MAIN ] GRMN: Loaded 30492 existing records. [2025-09-15T18:42:01.239899] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:01.240154] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-15T18:42:01.240203] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-15T18:42:01.241043] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-15T18:42:01.241094] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-15T18:42:01.263040] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-15T18:42:01.596535] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:02.059865] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-15T18:42:02.062547] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T18:42:02.857889] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-15T18:42:03.005508] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:42:03.657880] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-15T18:42:04.457920] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-15T18:42:04.488146] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:42:05.257838] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-15T18:42:05.350045] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (3.29 seconds). [2025-09-15T18:42:05.483635] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:42:05.728458] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T18:42:05.966667] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:42:06.057931] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-15T18:42:06.857875] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-15T18:42:06.929901] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T18:42:07.657894] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-15T18:42:08.108992] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:42:08.185844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T18:42:08.457869] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-15T18:42:09.257923] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-15T18:42:09.842092] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:42:10.057937] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-15T18:42:10.456079] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:42:10.751873] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:42:10.753282] [INFO ] [REMOTE ] GRC: Full fetch complete (9638 records). [2025-09-15T18:42:10.753353] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-15T18:42:10.858539] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-15T18:42:11.116332] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-15T18:42:11.116411] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-15T18:42:11.116629] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-15T18:42:11.116693] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-15T18:42:11.117131] [DEBUG] [LOCAL ] GRC: Trimmed 9638 records to 6266 (keeping 150 days of data) [2025-09-15T18:42:11.156776] [DEBUG] [LOCAL ] GRC: Primary data saved (6266 records). [2025-09-15T18:42:11.156893] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-15T18:42:11.156985] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 17.8s. Estimated remaining: 2h 28m 36s. Rate: 9.4 symbols/min [2025-09-15T18:42:11.326965] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:11.367226] [DEBUG] [LOCAL ] GRND: Loaded 37643 existing records from primary storage. [2025-09-15T18:42:11.367382] [INFO ] [MAIN ] GRND: Loaded 37643 existing records. [2025-09-15T18:42:11.547524] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:11.547832] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-15T18:42:11.547889] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-15T18:42:11.549375] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-15T18:42:11.549433] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-15T18:42:11.662962] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-15T18:42:11.913492] [INFO ] [REMOTE ] GRND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:11.924844] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:42:12.457915] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-15T18:42:13.257903] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-15T18:42:13.424612] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:42:13.446393] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:42:14.057906] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-15T18:42:14.226284] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:42:14.229419] [INFO ] [REMOTE ] GRBK: Full fetch complete (30128 records). [2025-09-15T18:42:14.229493] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-15T18:42:14.597763] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-15T18:42:14.597846] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-15T18:42:14.598451] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-15T18:42:14.598492] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-15T18:42:14.599233] [DEBUG] [LOCAL ] GRBK: Trimmed 30128 records to 19511 (keeping 150 days of data) [2025-09-15T18:42:14.713675] [DEBUG] [LOCAL ] GRBK: Primary data saved (19511 records). [2025-09-15T18:42:14.713839] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-15T18:42:14.713947] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 23.1s. Estimated remaining: 2h 28m 25s. Rate: 9.5 symbols/min [2025-09-15T18:42:14.858684] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-15T18:42:14.890622] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:14.922724] [DEBUG] [LOCAL ] GRNT: Loaded 25252 existing records from primary storage. [2025-09-15T18:42:14.922945] [INFO ] [MAIN ] GRNT: Loaded 25252 existing records. [2025-09-15T18:42:15.108169] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:15.108413] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-15T18:42:15.108460] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-15T18:42:15.109432] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-15T18:42:15.109485] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-15T18:42:15.460476] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:15.498717] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:42:15.657872] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-15T18:42:16.457898] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-15T18:42:16.945739] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:42:17.257916] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-15T18:42:17.460472] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-15T18:42:17.516502] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T18:42:18.057883] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-15T18:42:18.857877] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-15T18:42:18.897830] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:42:19.657833] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-15T18:42:19.918200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T18:42:20.003884] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:42:20.457878] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-15T18:42:20.854674] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:42:21.257941] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-15T18:42:22.057861] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-15T18:42:22.281431] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:42:22.284630] [INFO ] [REMOTE ] GRDN: Full fetch complete (19300 records). [2025-09-15T18:42:22.284749] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-15T18:42:22.285210] [FATAL] [VALIDATOR ] GRDN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:42:22.285293] [FATAL] [MAIN ] GRDN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:42:22.285331] [WARN ] [MAIN ] GRDN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:42:22.285369] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-15T18:42:22.285426] [DEBUG] [LOCAL ] GRDN: No primary data file found to delete. [2025-09-15T18:42:22.285473] [INFO ] [LOCAL ] GRDN: Starting deletion of derivative data. [2025-09-15T18:42:22.285915] [DEBUG] [LOCAL ] GRDN: Deleted derivative data file. [2025-09-15T18:42:22.286013] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 25.0s. Estimated remaining: 2h 28m 21s. Rate: 9.5 symbols/min [2025-09-15T18:42:22.461191] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:22.506002] [DEBUG] [LOCAL ] GROV: Loaded 6894 existing records from primary storage. [2025-09-15T18:42:22.506176] [INFO ] [MAIN ] GROV: Loaded 6894 existing records. [2025-09-15T18:42:22.589680] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T18:42:22.704374] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:22.704693] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-15T18:42:22.704749] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-15T18:42:22.705041] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-15T18:42:22.705087] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-15T18:42:22.861708] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-15T18:42:23.061896] [INFO ] [REMOTE ] GROV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:23.649631] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:42:23.659340] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-15T18:42:24.457894] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-15T18:42:24.840804] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-15T18:42:24.960853] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:42:25.257869] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-15T18:42:25.717032] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:42:26.057886] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-15T18:42:26.554973] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:42:26.857878] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-15T18:42:27.557914] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:42:27.562513] [INFO ] [REMOTE ] GRMN: Full fetch complete (45736 records). [2025-09-15T18:42:27.562605] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-15T18:42:27.663133] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-15T18:42:27.951986] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-15T18:42:27.952092] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-15T18:42:27.952831] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-15T18:42:27.952874] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-15T18:42:27.953813] [DEBUG] [LOCAL ] GRMN: Trimmed 45736 records to 29826 (keeping 150 days of data) [2025-09-15T18:42:28.149947] [DEBUG] [LOCAL ] GRMN: Primary data saved (29826 records). [2025-09-15T18:42:28.150114] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-15T18:42:28.150230] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRMN took 27.3s. Estimated remaining: 2h 28m 13s. Rate: 9.5 symbols/min [2025-09-15T18:42:28.324041] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:28.329191] [DEBUG] [LOCAL ] GRX: Loaded 3275 existing records from primary storage. [2025-09-15T18:42:28.329284] [INFO ] [MAIN ] GRX: Loaded 3275 existing records. [2025-09-15T18:42:28.473830] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-15T18:42:28.512061] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:28.513117] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-15T18:42:28.513163] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-15T18:42:28.513431] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-15T18:42:28.513496] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-15T18:42:28.875131] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:28.904653] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T18:42:29.181115] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:42:29.257811] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-15T18:42:29.351340] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:42:30.057896] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-15T18:42:30.857951] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-15T18:42:31.398005] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T18:42:31.464548] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:42:31.519918] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T18:42:31.657876] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-15T18:42:32.457925] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-15T18:42:32.627563] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:42:33.257894] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-15T18:42:34.057933] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-15T18:42:34.210254] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:42:34.399741] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T18:42:34.781437] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:42:34.857937] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-15T18:42:35.657890] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-15T18:42:35.992429] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:42:36.457939] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-15T18:42:37.005283] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:42:37.118349] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:42:37.124556] [INFO ] [REMOTE ] GRND: Full fetch complete (54259 records). [2025-09-15T18:42:37.124820] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-15T18:42:37.274151] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-15T18:42:37.519778] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-15T18:42:37.519861] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-15T18:42:37.520679] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-15T18:42:37.520724] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-15T18:42:37.521902] [DEBUG] [LOCAL ] GRND: Trimmed 54259 records to 36943 (keeping 150 days of data) [2025-09-15T18:42:37.751040] [DEBUG] [LOCAL ] GRND: Primary data saved (36943 records). [2025-09-15T18:42:37.751208] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-15T18:42:37.752515] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRND took 26.6s. Estimated remaining: 2h 28m 12s. Rate: 9.4 symbols/min [2025-09-15T18:42:37.912211] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T18:42:37.930615] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:37.975388] [DEBUG] [LOCAL ] GS: Loaded 39082 existing records from primary storage. [2025-09-15T18:42:37.975543] [INFO ] [MAIN ] GS: Loaded 39082 existing records. [2025-09-15T18:42:38.063123] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-15T18:42:38.155342] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:38.155690] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-15T18:42:38.155740] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-15T18:42:38.156850] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-15T18:42:38.156904] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-15T18:42:38.513662] [INFO ] [REMOTE ] GS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:38.857894] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-15T18:42:39.494132] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:42:39.498529] [INFO ] [REMOTE ] GRNT: Full fetch complete (36531 records). [2025-09-15T18:42:39.498629] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-15T18:42:39.662758] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-15T18:42:39.715553] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:42:39.885995] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-15T18:42:39.886087] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-15T18:42:39.886756] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-15T18:42:39.886801] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-15T18:42:39.887765] [DEBUG] [LOCAL ] GRNT: Trimmed 36531 records to 24663 (keeping 150 days of data) [2025-09-15T18:42:40.044891] [DEBUG] [LOCAL ] GRNT: Primary data saved (24663 records). [2025-09-15T18:42:40.045084] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-15T18:42:40.045214] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRNT took 25.3s. Estimated remaining: 2h 27m 60s. Rate: 9.5 symbols/min [2025-09-15T18:42:40.219619] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:40.249038] [DEBUG] [LOCAL ] GSBD: Loaded 28373 existing records from primary storage. [2025-09-15T18:42:40.249192] [INFO ] [MAIN ] GSBD: Loaded 28373 existing records. [2025-09-15T18:42:40.428055] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:40.428321] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-15T18:42:40.428367] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-15T18:42:40.429125] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-15T18:42:40.429177] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-15T18:42:40.463004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-15T18:42:40.785907] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:41.126718] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:42:41.257872] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-15T18:42:42.031263] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-15T18:42:42.057819] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-15T18:42:42.448036] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:42:42.857924] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-15T18:42:43.310599] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:42:43.657933] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-15T18:42:43.932105] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:42:44.194053] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T18:42:44.457867] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-15T18:42:45.007105] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:42:45.257907] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-15T18:42:46.057881] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-15T18:42:46.269325] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:42:46.857881] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-15T18:42:47.474252] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:42:47.571559] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:42:47.657888] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-15T18:42:48.457885] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-15T18:42:49.029626] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:42:49.031005] [INFO ] [REMOTE ] GRX: Full fetch complete (4511 records). [2025-09-15T18:42:49.031079] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-15T18:42:49.269670] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-15T18:42:49.346629] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:42:49.441677] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-15T18:42:49.441762] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-15T18:42:49.441903] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-15T18:42:49.441950] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-15T18:42:49.442345] [DEBUG] [LOCAL ] GRX: Trimmed 4511 records to 3278 (keeping 150 days of data) [2025-09-15T18:42:49.463679] [DEBUG] [LOCAL ] GRX: Primary data saved (3278 records). [2025-09-15T18:42:49.463824] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-15T18:42:49.463928] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRX took 21.3s. Estimated remaining: 2h 27m 58s. Rate: 9.4 symbols/min [2025-09-15T18:42:49.637068] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:49.674808] [DEBUG] [LOCAL ] GSK: Loaded 40276 existing records from primary storage. [2025-09-15T18:42:49.674988] [INFO ] [MAIN ] GSK: Loaded 40276 existing records. [2025-09-15T18:42:49.850341] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:49.850628] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-15T18:42:49.850696] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-15T18:42:49.851703] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-15T18:42:49.851755] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-15T18:42:50.067708] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-15T18:42:50.225676] [INFO ] [REMOTE ] GSK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:50.857901] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-15T18:42:50.930999] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T18:42:51.276503] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:42:51.657894] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-15T18:42:51.962466] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T18:42:52.457892] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-15T18:42:53.057508] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:42:53.058726] [INFO ] [REMOTE ] GROV: Full fetch complete (10079 records). [2025-09-15T18:42:53.058791] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-15T18:42:53.263042] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-15T18:42:53.434813] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-15T18:42:53.434911] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-15T18:42:53.435180] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-15T18:42:53.435229] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-15T18:42:53.435904] [DEBUG] [LOCAL ] GROV: Trimmed 10079 records to 6809 (keeping 150 days of data) [2025-09-15T18:42:53.500449] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T18:42:53.517776] [DEBUG] [LOCAL ] GROV: Primary data saved (6809 records). [2025-09-15T18:42:53.517860] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-15T18:42:53.517942] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GROV took 31.2s. Estimated remaining: 2h 27m 48s. Rate: 9.5 symbols/min [2025-09-15T18:42:53.683549] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:53.706488] [DEBUG] [LOCAL ] GSL: Loaded 24791 existing records from primary storage. [2025-09-15T18:42:53.706609] [INFO ] [MAIN ] GSL: Loaded 24791 existing records. [2025-09-15T18:42:53.883199] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:53.883485] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-15T18:42:53.883532] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-15T18:42:53.884298] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-15T18:42:53.884358] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-15T18:42:54.068553] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-15T18:42:54.242888] [INFO ] [REMOTE ] GSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:54.864024] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-15T18:42:54.877892] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:42:55.657941] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-15T18:42:55.793429] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:42:56.402419] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:42:56.457829] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-15T18:42:57.145246] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:42:57.257865] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-15T18:42:57.899476] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:42:58.057864] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-15T18:42:58.350525] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:42:58.857881] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-15T18:42:59.441259] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:42:59.657896] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-15T18:43:00.457920] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-15T18:43:00.798369] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:43:01.215328] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:43:01.257815] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-15T18:43:02.057935] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-15T18:43:02.152540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:43:02.358520] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:43:02.857935] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-15T18:43:03.629547] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:43:03.657819] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-15T18:43:04.457977] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-15T18:43:04.962820] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:43:05.257885] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-15T18:43:05.328684] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:43:06.063909] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-15T18:43:06.077730] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:43:06.857945] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-15T18:43:07.237437] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T18:43:07.658150] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-15T18:43:07.689512] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:43:07.908223] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:43:07.912134] [INFO ] [REMOTE ] GSBD: Full fetch complete (42238 records). [2025-09-15T18:43:07.912224] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-15T18:43:07.912870] [FATAL] [VALIDATOR ] GSBD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:43:07.912947] [FATAL] [MAIN ] GSBD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:43:07.912984] [WARN ] [MAIN ] GSBD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:43:07.913022] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-15T18:43:07.913079] [DEBUG] [LOCAL ] GSBD: No primary data file found to delete. [2025-09-15T18:43:07.913137] [INFO ] [LOCAL ] GSBD: Starting deletion of derivative data. [2025-09-15T18:43:07.913429] [DEBUG] [LOCAL ] GSBD: Deleted derivative data file. [2025-09-15T18:43:07.913515] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GSBD took 27.9s. Estimated remaining: 2h 27m 53s. Rate: 9.4 symbols/min [2025-09-15T18:43:08.082577] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:08.119172] [DEBUG] [LOCAL ] GTES: Loaded 37744 existing records from primary storage. [2025-09-15T18:43:08.119355] [INFO ] [MAIN ] GTES: Loaded 37744 existing records. [2025-09-15T18:43:08.299428] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:08.299746] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-15T18:43:08.299794] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-15T18:43:08.300527] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-15T18:43:08.300581] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-15T18:43:08.470536] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-15T18:43:08.653675] [INFO ] [REMOTE ] GTES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:09.257898] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-15T18:43:09.570133] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T18:43:09.603273] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:43:10.057896] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-15T18:43:10.857902] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-15T18:43:10.945303] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:43:11.657896] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-15T18:43:11.879896] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:43:12.265699] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:43:12.269572] [INFO ] [REMOTE ] GSL: Full fetch complete (37030 records). [2025-09-15T18:43:12.269686] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-15T18:43:12.462978] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-15T18:43:12.660631] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-15T18:43:12.660727] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-15T18:43:12.661354] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-15T18:43:12.661408] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-15T18:43:12.662525] [DEBUG] [LOCAL ] GSL: Trimmed 37030 records to 24348 (keeping 150 days of data) [2025-09-15T18:43:12.819465] [DEBUG] [LOCAL ] GSL: Primary data saved (24348 records). [2025-09-15T18:43:12.819624] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-15T18:43:12.819747] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSL took 19.3s. Estimated remaining: 2h 27m 45s. Rate: 9.4 symbols/min [2025-09-15T18:43:12.992282] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:13.026200] [DEBUG] [LOCAL ] GTLS: Loaded 32460 existing records from primary storage. [2025-09-15T18:43:13.026346] [INFO ] [MAIN ] GTLS: Loaded 32460 existing records. [2025-09-15T18:43:13.213547] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:13.214037] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-15T18:43:13.214137] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-15T18:43:13.215044] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-15T18:43:13.215100] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-15T18:43:13.258186] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-15T18:43:13.537547] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:43:13.626947] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:14.041860] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:43:14.049237] [INFO ] [REMOTE ] GS: Full fetch complete (56916 records). [2025-09-15T18:43:14.049365] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-15T18:43:14.063381] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-15T18:43:14.448818] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-15T18:43:14.448933] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-15T18:43:14.449856] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-15T18:43:14.449909] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-15T18:43:14.452916] [DEBUG] [LOCAL ] GS: Trimmed 56916 records to 38263 (keeping 150 days of data) [2025-09-15T18:43:14.739568] [DEBUG] [LOCAL ] GS: Primary data saved (38263 records). [2025-09-15T18:43:14.739753] [INFO ] [MAIN ] GS: Full history saved. [2025-09-15T18:43:14.741284] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GS took 37.0s. Estimated remaining: 2h 27m 32s. Rate: 9.4 symbols/min [2025-09-15T18:43:14.863018] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-15T18:43:14.919566] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:14.962737] [DEBUG] [LOCAL ] GTN: Loaded 33979 existing records from primary storage. [2025-09-15T18:43:14.962926] [INFO ] [MAIN ] GTN: Loaded 33979 existing records. [2025-09-15T18:43:15.143480] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:15.143745] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-15T18:43:15.143794] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-15T18:43:15.144483] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-15T18:43:15.144540] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-15T18:43:15.489377] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T18:43:15.522028] [INFO ] [REMOTE ] GTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:15.529525] [INFO ] [REMOTE ] GSK: Full fetch complete (58180 records). [2025-09-15T18:43:15.529710] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-15T18:43:15.660403] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-15T18:43:15.856436] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T18:43:15.952045] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-15T18:43:15.952146] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-15T18:43:15.953037] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-15T18:43:15.953087] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-15T18:43:15.954525] [DEBUG] [LOCAL ] GSK: Trimmed 58180 records to 39497 (keeping 150 days of data) [2025-09-15T18:43:16.243365] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:43:16.262965] [DEBUG] [LOCAL ] GSK: Primary data saved (39497 records). [2025-09-15T18:43:16.263208] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-15T18:43:16.263957] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSK took 26.8s. Estimated remaining: 2h 27m 19s. Rate: 9.5 symbols/min [2025-09-15T18:43:16.437383] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:16.461237] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-15T18:43:16.462859] [DEBUG] [LOCAL ] GTY: Loaded 22048 existing records from primary storage. [2025-09-15T18:43:16.463019] [INFO ] [MAIN ] GTY: Loaded 22048 existing records. [2025-09-15T18:43:16.637741] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:16.638046] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-15T18:43:16.638104] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-15T18:43:16.638603] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-15T18:43:16.638676] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-15T18:43:17.002456] [INFO ] [REMOTE ] GTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:17.257880] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-15T18:43:17.622707] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-15T18:43:17.688723] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:43:18.056470] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:43:18.058479] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-15T18:43:18.857864] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-15T18:43:19.537721] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:43:19.657822] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-15T18:43:20.227916] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:43:20.457933] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-15T18:43:20.980429] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:43:21.257880] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-15T18:43:21.721361] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:43:22.057888] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-15T18:43:22.561755] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:43:22.857903] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-15T18:43:23.664049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-15T18:43:23.666773] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:43:24.417099] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:43:24.457929] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-15T18:43:24.945586] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:43:25.257911] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-15T18:43:25.635850] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T18:43:26.057877] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-15T18:43:26.432436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:43:26.857889] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-15T18:43:27.657912] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-15T18:43:27.761741] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:43:28.198599] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:43:28.457939] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-15T18:43:29.257854] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-15T18:43:29.293091] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:43:29.963352] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:43:30.057865] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-15T18:43:30.857840] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-15T18:43:30.910840] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:43:31.529242] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:43:31.657850] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-15T18:43:32.304481] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:43:32.457882] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-15T18:43:33.168279] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:43:33.257831] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-15T18:43:34.057912] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-15T18:43:34.169323] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:43:34.857870] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-15T18:43:34.897623] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:43:35.657987] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-15T18:43:35.796306] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:43:36.113115] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:43:36.118432] [INFO ] [REMOTE ] GTLS: Full fetch complete (46445 records). [2025-09-15T18:43:36.118561] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-15T18:43:36.468011] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-15T18:43:36.512265] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-15T18:43:36.512358] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-15T18:43:36.513127] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-15T18:43:36.513186] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-15T18:43:36.514159] [DEBUG] [LOCAL ] GTLS: Trimmed 46445 records to 31961 (keeping 150 days of data) [2025-09-15T18:43:36.647776] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:43:36.659956] [INFO ] [REMOTE ] GTY: Full fetch complete (32915 records). [2025-09-15T18:43:36.691149] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-15T18:43:37.112227] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-15T18:43:37.112866] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-15T18:43:37.114197] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-15T18:43:37.114868] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-15T18:43:37.118202] [DEBUG] [LOCAL ] GTY: Trimmed 32915 records to 21698 (keeping 150 days of data) [2025-09-15T18:43:37.122655] [DEBUG] [LOCAL ] GTLS: Primary data saved (31961 records). [2025-09-15T18:43:37.122743] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-15T18:43:37.122847] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTLS took 24.3s. Estimated remaining: 2h 27m 33s. Rate: 9.4 symbols/min [2025-09-15T18:43:37.261201] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-15T18:43:37.474384] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:37.475816] [DEBUG] [LOCAL ] GTY: Primary data saved (21698 records). [2025-09-15T18:43:37.476263] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-15T18:43:37.476375] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTY took 21.2s. Estimated remaining: 2h 27m 18s. Rate: 9.4 symbols/min [2025-09-15T18:43:37.597509] [DEBUG] [LOCAL ] GUG: Loaded 9060 existing records from primary storage. [2025-09-15T18:43:37.607902] [INFO ] [MAIN ] GUG: Loaded 9060 existing records. [2025-09-15T18:43:37.769218] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:37.850399] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:37.850757] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-15T18:43:37.850810] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-15T18:43:37.851310] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-15T18:43:37.856025] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-15T18:43:37.925213] [DEBUG] [LOCAL ] GUT: Loaded 11603 existing records from primary storage. [2025-09-15T18:43:37.956834] [INFO ] [MAIN ] GUT: Loaded 11603 existing records. [2025-09-15T18:43:38.327766] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:38.351982] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-15T18:43:38.355860] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-15T18:43:38.434343] [INFO ] [REMOTE ] GUG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:38.434420] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-15T18:43:38.434846] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-15T18:43:38.435150] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-15T18:43:38.532494] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:43:38.578345] [INFO ] [REMOTE ] GTES: Full fetch complete (55314 records). [2025-09-15T18:43:38.601943] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-15T18:43:39.017532] [INFO ] [REMOTE ] GUT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:39.050070] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-15T18:43:39.138091] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T18:43:39.198719] [INFO ] [REMOTE ] GTN: Full fetch complete (49861 records). [2025-09-15T18:43:39.199770] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:43:39.199327] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-15T18:43:39.332938] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-15T18:43:39.347801] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-15T18:43:39.359606] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-15T18:43:39.359798] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-15T18:43:39.420590] [DEBUG] [LOCAL ] GTES: Trimmed 55314 records to 37017 (keeping 150 days of data) [2025-09-15T18:43:39.658781] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-15T18:43:39.734851] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-15T18:43:39.735177] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-15T18:43:39.736524] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-15T18:43:39.736839] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-15T18:43:39.740542] [DEBUG] [LOCAL ] GTN: Trimmed 49861 records to 33382 (keeping 150 days of data) [2025-09-15T18:43:39.851307] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:43:40.080251] [DEBUG] [LOCAL ] GTN: Primary data saved (33382 records). [2025-09-15T18:43:40.080918] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-15T18:43:40.081256] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 25.3s. Estimated remaining: 2h 27m 7s. Rate: 9.4 symbols/min [2025-09-15T18:43:40.258213] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:40.260779] [DEBUG] [LOCAL ] GTES: Primary data saved (37017 records). [2025-09-15T18:43:40.261159] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-15T18:43:40.262293] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTES took 32.3s. Estimated remaining: 2h 26m 52s. Rate: 9.5 symbols/min [2025-09-15T18:43:40.447498] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:40.456330] [DEBUG] [LOCAL ] GVA: Loaded 24401 existing records from primary storage. [2025-09-15T18:43:40.456507] [INFO ] [MAIN ] GVA: Loaded 24401 existing records. [2025-09-15T18:43:40.468327] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-15T18:43:40.626535] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:43:40.626015] [DEBUG] [LOCAL ] GWH: Loaded 12881 existing records from primary storage. [2025-09-15T18:43:40.662584] [INFO ] [MAIN ] GWH: Loaded 12881 existing records. [2025-09-15T18:43:40.710244] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:40.767864] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-15T18:43:40.770499] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-15T18:43:40.776211] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-15T18:43:40.786477] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-15T18:43:40.928296] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:40.952600] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-15T18:43:40.968209] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-15T18:43:41.001115] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-15T18:43:41.026571] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-15T18:43:41.260849] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-15T18:43:41.418864] [INFO ] [REMOTE ] GVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:41.572905] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:41.573861] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:43:42.057929] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-15T18:43:42.080565] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:43:42.857872] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-15T18:43:42.882614] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:43:43.399472] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:43:43.657867] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-15T18:43:44.457912] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-15T18:43:44.614740] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:43:44.883218] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:43:45.257905] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-15T18:43:46.057897] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-15T18:43:46.677505] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:43:46.835427] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T18:43:46.857820] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-15T18:43:47.657859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-15T18:43:47.846434] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:43:48.457933] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-15T18:43:48.493106] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T18:43:49.169692] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:43:49.257924] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-15T18:43:50.057893] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-15T18:43:50.640116] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:43:50.857902] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-15T18:43:51.126497] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:43:51.657871] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-15T18:43:51.813284] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:43:52.457914] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-15T18:43:52.770538] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:43:53.257937] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-15T18:43:53.525550] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:43:54.057885] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-15T18:43:54.076526] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:43:54.831393] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:43:54.857859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-15T18:43:55.450841] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:43:55.452820] [INFO ] [REMOTE ] GUG: Full fetch complete (13486 records). [2025-09-15T18:43:55.452940] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-15T18:43:55.663145] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-15T18:43:56.036771] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-15T18:43:56.036909] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-15T18:43:56.037535] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-15T18:43:56.037610] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-15T18:43:56.038750] [DEBUG] [LOCAL ] GUG: Trimmed 13486 records to 8754 (keeping 150 days of data) [2025-09-15T18:43:56.106887] [DEBUG] [LOCAL ] GUG: Primary data saved (8754 records). [2025-09-15T18:43:56.107098] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-15T18:43:56.107210] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 19.0s. Estimated remaining: 2h 26m 59s. Rate: 9.4 symbols/min [2025-09-15T18:43:56.323669] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:56.339125] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:43:56.384791] [DEBUG] [LOCAL ] GWRE: Loaded 30251 existing records from primary storage. [2025-09-15T18:43:56.384953] [INFO ] [MAIN ] GWRE: Loaded 30251 existing records. [2025-09-15T18:43:56.463035] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-15T18:43:56.577685] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:56.577966] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-15T18:43:56.578014] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-15T18:43:56.578936] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-15T18:43:56.578999] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-15T18:43:56.942776] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:57.257884] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-15T18:43:57.841383] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:43:58.057899] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-15T18:43:58.108034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:43:58.110165] [INFO ] [REMOTE ] GUT: Full fetch complete (16936 records). [2025-09-15T18:43:58.110236] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-15T18:43:58.471310] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-15T18:43:58.471388] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-15T18:43:58.471777] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-15T18:43:58.471822] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-15T18:43:58.472386] [DEBUG] [LOCAL ] GUT: Trimmed 16936 records to 11442 (keeping 150 days of data) [2025-09-15T18:43:58.540610] [DEBUG] [LOCAL ] GUT: Primary data saved (11442 records). [2025-09-15T18:43:58.540768] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-15T18:43:58.540855] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 21.1s. Estimated remaining: 2h 26m 47s. Rate: 9.4 symbols/min [2025-09-15T18:43:58.708806] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:58.724613] [DEBUG] [LOCAL ] GWW: Loaded 14121 existing records from primary storage. [2025-09-15T18:43:58.724768] [INFO ] [MAIN ] GWW: Loaded 14121 existing records. [2025-09-15T18:43:58.863029] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-15T18:43:58.931057] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:58.931376] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-15T18:43:58.931428] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-15T18:43:58.932184] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-15T18:43:58.932424] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-15T18:43:59.123025] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T18:43:59.316248] [INFO ] [REMOTE ] GWW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:59.657931] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-15T18:44:00.457904] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-15T18:44:00.661547] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:44:00.664065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:44:00.670507] [INFO ] [REMOTE ] GWH: Full fetch complete (16172 records). [2025-09-15T18:44:00.678824] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-15T18:44:01.048160] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-15T18:44:01.048242] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-15T18:44:01.048611] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-15T18:44:01.048671] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-15T18:44:01.049224] [DEBUG] [LOCAL ] GWH: Trimmed 16172 records to 12801 (keeping 150 days of data) [2025-09-15T18:44:01.124826] [DEBUG] [LOCAL ] GWH: Primary data saved (12801 records). [2025-09-15T18:44:01.124973] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-15T18:44:01.125060] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 20.9s. Estimated remaining: 2h 26m 35s. Rate: 9.5 symbols/min [2025-09-15T18:44:01.271611] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-15T18:44:01.305196] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:01.341553] [DEBUG] [LOCAL ] GXO: Loaded 34988 existing records from primary storage. [2025-09-15T18:44:01.341788] [INFO ] [MAIN ] GXO: Loaded 34988 existing records. [2025-09-15T18:44:01.529106] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:01.529404] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-15T18:44:01.529466] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-15T18:44:01.530316] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-15T18:44:01.530402] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-15T18:44:01.888724] [INFO ] [REMOTE ] GXO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:01.910795] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:44:02.057869] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-15T18:44:02.862279] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-15T18:44:02.868138] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:44:03.241185] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:44:03.657881] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-15T18:44:04.457896] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-15T18:44:04.664113] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:44:04.706933] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:44:05.257889] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-15T18:44:05.923983] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:44:06.057901] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-15T18:44:06.857900] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-15T18:44:06.933135] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:44:07.347574] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:44:07.657838] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-15T18:44:07.723768] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T18:44:08.457875] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-15T18:44:09.257897] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-15T18:44:09.328941] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:44:09.430391] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:44:10.057901] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-15T18:44:10.215967] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:44:10.219439] [INFO ] [REMOTE ] GVA: Full fetch complete (37254 records). [2025-09-15T18:44:10.219526] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-15T18:44:10.615936] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-15T18:44:10.616016] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-15T18:44:10.616701] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-15T18:44:10.616755] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-15T18:44:10.617600] [DEBUG] [LOCAL ] GVA: Trimmed 37254 records to 23856 (keeping 150 days of data) [2025-09-15T18:44:10.760598] [DEBUG] [LOCAL ] GVA: Primary data saved (23856 records). [2025-09-15T18:44:10.760742] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-15T18:44:10.760839] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GVA took 30.7s. Estimated remaining: 2h 26m 33s. Rate: 9.5 symbols/min [2025-09-15T18:44:10.859622] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-15T18:44:10.929282] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:10.932178] [DEBUG] [LOCAL ] GYLD: Loaded 1127 existing records from primary storage. [2025-09-15T18:44:10.932250] [INFO ] [MAIN ] GYLD: Loaded 1127 existing records. [2025-09-15T18:44:11.108396] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:11.108681] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-15T18:44:11.108728] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-15T18:44:11.108890] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-15T18:44:11.108933] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-15T18:44:11.461347] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:11.657847] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-15T18:44:11.700270] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:44:11.740009] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:44:12.021797] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:44:12.457925] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-15T18:44:12.884206] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:44:13.257885] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-15T18:44:14.057876] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-15T18:44:14.862944] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-15T18:44:14.878752] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:44:15.015717] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:44:15.657938] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-15T18:44:16.160412] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:44:16.411298] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:44:16.457911] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-15T18:44:17.257885] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-15T18:44:17.465439] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T18:44:18.057878] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-15T18:44:18.649559] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:44:18.685150] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:44:18.857874] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-15T18:44:19.657962] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-15T18:44:20.356250] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:44:20.457864] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-15T18:44:21.091130] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:44:21.257911] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-15T18:44:22.054502] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:44:22.058903] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-15T18:44:22.060358] [INFO ] [REMOTE ] GWRE: Full fetch complete (45330 records). [2025-09-15T18:44:22.060449] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-15T18:44:22.441085] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-15T18:44:22.441187] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-15T18:44:22.441962] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-15T18:44:22.442019] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-15T18:44:22.443291] [DEBUG] [LOCAL ] GWRE: Trimmed 45330 records to 29708 (keeping 150 days of data) [2025-09-15T18:44:22.633320] [DEBUG] [LOCAL ] GWRE: Primary data saved (29708 records). [2025-09-15T18:44:22.633552] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-15T18:44:22.633811] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 26.5s. Estimated remaining: 2h 26m 35s. Rate: 9.4 symbols/min [2025-09-15T18:44:22.768789] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:44:22.850001] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:22.857908] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-15T18:44:22.887559] [DEBUG] [LOCAL ] H: Loaded 33612 existing records from primary storage. [2025-09-15T18:44:22.887727] [INFO ] [MAIN ] H: Loaded 33612 existing records. [2025-09-15T18:44:23.082528] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:23.082816] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-15T18:44:23.082862] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-15T18:44:23.083798] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-15T18:44:23.083850] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-15T18:44:23.449852] [INFO ] [REMOTE ] H: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:23.452768] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:44:23.468163] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T18:44:23.657814] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-15T18:44:24.457917] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-15T18:44:24.893744] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:44:25.257837] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-15T18:44:25.326417] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:44:25.539365] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-15T18:44:26.057874] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-15T18:44:26.857885] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-15T18:44:27.311006] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:44:27.657883] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-15T18:44:28.106074] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-15T18:44:28.106923] [INFO ] [REMOTE ] GYLD: Full fetch complete (1628 records). [2025-09-15T18:44:28.106994] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-15T18:44:28.457917] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-15T18:44:28.480752] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-15T18:44:28.481813] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-15T18:44:28.482120] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-15T18:44:28.482202] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-15T18:44:28.482872] [DEBUG] [LOCAL ] GYLD: Trimmed 1628 records to 1104 (keeping 150 days of data) [2025-09-15T18:44:28.491381] [DEBUG] [LOCAL ] GYLD: Primary data saved (1104 records). [2025-09-15T18:44:28.491483] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-15T18:44:28.491681] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GYLD took 17.7s. Estimated remaining: 2h 26m 28s. Rate: 9.4 symbols/min [2025-09-15T18:44:28.679978] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:44:28.697390] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:28.734968] [DEBUG] [LOCAL ] HAE: Loaded 28379 existing records from primary storage. [2025-09-15T18:44:28.735187] [INFO ] [MAIN ] HAE: Loaded 28379 existing records. [2025-09-15T18:44:28.909230] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:28.909513] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-15T18:44:28.909573] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-15T18:44:28.910274] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-15T18:44:28.910325] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-15T18:44:29.263051] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-15T18:44:29.267206] [INFO ] [REMOTE ] HAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:29.888175] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:44:30.057836] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-15T18:44:30.802485] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:44:30.807574] [INFO ] [REMOTE ] GXO: Full fetch complete (52519 records). [2025-09-15T18:44:30.807720] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-15T18:44:30.870230] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-15T18:44:31.189495] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-15T18:44:31.189584] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-15T18:44:31.190336] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-15T18:44:31.190386] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-15T18:44:31.191532] [DEBUG] [LOCAL ] GXO: Trimmed 52519 records to 34160 (keeping 150 days of data) [2025-09-15T18:44:31.399820] [DEBUG] [LOCAL ] GXO: Primary data saved (34160 records). [2025-09-15T18:44:31.399972] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-15T18:44:31.400595] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GXO took 30.3s. Estimated remaining: 2h 26m 17s. Rate: 9.4 symbols/min [2025-09-15T18:44:31.567062] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:31.600235] [DEBUG] [LOCAL ] HAFN: Loaded 32231 existing records from primary storage. [2025-09-15T18:44:31.600382] [INFO ] [MAIN ] HAFN: Loaded 32231 existing records. [2025-09-15T18:44:31.664966] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-15T18:44:31.781397] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:31.781954] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-15T18:44:31.782039] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-15T18:44:31.797722] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-15T18:44:31.805447] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-15T18:44:31.864956] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:44:31.935152] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:44:32.214759] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:32.457863] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-15T18:44:33.206988] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:44:33.257833] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-15T18:44:34.057871] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-15T18:44:34.322592] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:44:34.846145] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:44:34.857802] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-15T18:44:35.428789] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:44:35.657864] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-15T18:44:36.387128] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:44:36.457831] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-15T18:44:36.834471] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:44:36.837057] [INFO ] [REMOTE ] GWW: Full fetch complete (21713 records). [2025-09-15T18:44:36.837127] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-15T18:44:37.220046] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-15T18:44:37.220136] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-15T18:44:37.220619] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-15T18:44:37.220684] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-15T18:44:37.221345] [DEBUG] [LOCAL ] GWW: Trimmed 21713 records to 13875 (keeping 150 days of data) [2025-09-15T18:44:37.261552] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-15T18:44:37.315353] [DEBUG] [LOCAL ] GWW: Primary data saved (13875 records). [2025-09-15T18:44:37.315510] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-15T18:44:37.315598] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GWW took 38.8s. Estimated remaining: 2h 26m 10s. Rate: 9.4 symbols/min [2025-09-15T18:44:37.489225] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:37.529489] [DEBUG] [LOCAL ] HAL: Loaded 40458 existing records from primary storage. [2025-09-15T18:44:37.529687] [INFO ] [MAIN ] HAL: Loaded 40458 existing records. [2025-09-15T18:44:37.711086] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:37.711350] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-15T18:44:37.711395] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-15T18:44:37.712417] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-15T18:44:37.712469] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-15T18:44:38.058121] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-15T18:44:38.081550] [INFO ] [REMOTE ] HAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:38.102836] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:44:38.849610] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:44:38.859764] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-15T18:44:39.658432] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-15T18:44:39.660925] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:44:40.457896] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-15T18:44:40.523395] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:44:41.084588] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:44:41.257920] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-15T18:44:42.067752] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-15T18:44:42.072896] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:44:42.857909] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-15T18:44:42.972519] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:44:43.565440] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:44:43.657827] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-15T18:44:44.457949] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-15T18:44:44.955979] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-15T18:44:45.155302] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:44:45.257906] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-15T18:44:46.057882] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-15T18:44:46.268230] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:44:46.530673] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:44:46.535869] [INFO ] [REMOTE ] HAE: Full fetch complete (43944 records). [2025-09-15T18:44:46.536001] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-15T18:44:46.863638] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-15T18:44:46.911500] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-15T18:44:46.911575] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-15T18:44:46.912253] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-15T18:44:46.912296] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-15T18:44:46.913297] [DEBUG] [LOCAL ] HAE: Trimmed 43944 records to 27848 (keeping 150 days of data) [2025-09-15T18:44:47.097117] [DEBUG] [LOCAL ] HAE: Primary data saved (27848 records). [2025-09-15T18:44:47.097265] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-15T18:44:47.097370] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. HAE took 18.6s. Estimated remaining: 2h 26m 8s. Rate: 9.4 symbols/min [2025-09-15T18:44:47.282795] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:47.321813] [DEBUG] [LOCAL ] HASI: Loaded 35913 existing records from primary storage. [2025-09-15T18:44:47.321962] [INFO ] [MAIN ] HASI: Loaded 35913 existing records. [2025-09-15T18:44:47.503029] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:47.503304] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-15T18:44:47.503352] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-15T18:44:47.504236] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-15T18:44:47.504313] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-15T18:44:47.664419] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-15T18:44:47.885169] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:44:47.905881] [INFO ] [REMOTE ] HASI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:47.910879] [INFO ] [REMOTE ] H: Full fetch complete (49112 records). [2025-09-15T18:44:47.910989] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-15T18:44:48.477177] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-15T18:44:48.514072] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-15T18:44:48.517840] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:44:48.530563] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-15T18:44:48.533682] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-15T18:44:48.534679] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-15T18:44:48.536889] [DEBUG] [LOCAL ] H: Trimmed 49112 records to 32936 (keeping 150 days of data) [2025-09-15T18:44:48.855702] [DEBUG] [LOCAL ] H: Primary data saved (32936 records). [2025-09-15T18:44:48.855875] [INFO ] [MAIN ] H: Full history saved. [2025-09-15T18:44:48.855983] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. H took 26.2s. Estimated remaining: 2h 25m 55s. Rate: 9.5 symbols/min [2025-09-15T18:44:49.078150] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:49.123875] [DEBUG] [LOCAL ] HAYW: Loaded 36396 existing records from primary storage. [2025-09-15T18:44:49.124057] [INFO ] [MAIN ] HAYW: Loaded 36396 existing records. [2025-09-15T18:44:49.275718] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-15T18:44:49.318190] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:49.318480] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-15T18:44:49.318553] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-15T18:44:49.319485] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-15T18:44:49.319550] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-15T18:44:49.688934] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:49.724910] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-15T18:44:49.823479] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:44:50.057879] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-15T18:44:50.857905] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-15T18:44:50.951973] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T18:44:51.215123] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:44:51.657877] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-15T18:44:52.458981] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-15T18:44:52.461334] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:44:53.010142] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:44:53.257908] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-15T18:44:54.057920] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-15T18:44:54.184834] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T18:44:54.806183] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:44:54.857890] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-15T18:44:55.286466] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:44:55.657929] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-15T18:44:56.457883] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-15T18:44:56.504513] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:44:56.509888] [INFO ] [REMOTE ] HAFN: Full fetch complete (48403 records). [2025-09-15T18:44:56.510082] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-15T18:44:56.911402] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-15T18:44:56.911543] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-15T18:44:56.912305] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-15T18:44:56.912389] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-15T18:44:56.913598] [DEBUG] [LOCAL ] HAFN: Trimmed 48403 records to 31519 (keeping 150 days of data) [2025-09-15T18:44:57.034624] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:44:57.143335] [DEBUG] [LOCAL ] HAFN: Primary data saved (31519 records). [2025-09-15T18:44:57.143477] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-15T18:44:57.143571] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 25.7s. Estimated remaining: 2h 25m 52s. Rate: 9.4 symbols/min [2025-09-15T18:44:57.262985] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-15T18:44:57.324675] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:57.331566] [DEBUG] [LOCAL ] HBB: Loaded 4952 existing records from primary storage. [2025-09-15T18:44:57.331756] [INFO ] [MAIN ] HBB: Loaded 4952 existing records. [2025-09-15T18:44:57.520151] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:57.520477] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-15T18:44:57.520543] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-15T18:44:57.520888] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-15T18:44:57.520961] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-15T18:44:57.880813] [INFO ] [REMOTE ] HBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:57.932816] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:44:58.057867] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-15T18:44:58.857889] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-15T18:44:59.432524] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T18:44:59.657887] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-15T18:44:59.680125] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:44:59.718861] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:45:00.457894] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-15T18:45:01.257900] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-15T18:45:01.439287] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T18:45:02.057928] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-15T18:45:02.101210] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:45:02.293480] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T18:45:02.857917] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-15T18:45:03.657918] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-15T18:45:04.399379] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-15T18:45:04.457877] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-15T18:45:05.183804] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-15T18:45:05.257888] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-15T18:45:05.716394] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:45:05.987714] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:45:06.057916] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-15T18:45:06.241595] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-15T18:45:06.857876] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-15T18:45:07.657910] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-15T18:45:07.725080] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:45:08.410901] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:45:08.416910] [INFO ] [REMOTE ] HAL: Full fetch complete (58398 records). [2025-09-15T18:45:08.417107] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-15T18:45:08.463025] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-15T18:45:08.801841] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-15T18:45:08.801935] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-15T18:45:08.802731] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-15T18:45:08.802776] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-15T18:45:08.804075] [DEBUG] [LOCAL ] HAL: Trimmed 58398 records to 39678 (keeping 150 days of data) [2025-09-15T18:45:09.037378] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T18:45:09.069042] [DEBUG] [LOCAL ] HAL: Primary data saved (39678 records). [2025-09-15T18:45:09.069180] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-15T18:45:09.070054] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 31.8s. Estimated remaining: 2h 25m 53s. Rate: 9.4 symbols/min [2025-09-15T18:45:09.239443] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:09.254059] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:45:09.258719] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-15T18:45:09.260282] [INFO ] [REMOTE ] HASI: Full fetch complete (51399 records). [2025-09-15T18:45:09.260389] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-15T18:45:09.553182] [DEBUG] [LOCAL ] HBI: Loaded 39850 existing records from primary storage. [2025-09-15T18:45:09.564595] [INFO ] [MAIN ] HBI: Loaded 39850 existing records. [2025-09-15T18:45:09.846913] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-15T18:45:09.851263] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:09.851342] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-15T18:45:09.852331] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-15T18:45:09.851572] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-15T18:45:09.852461] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-15T18:45:09.852431] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-15T18:45:09.853361] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-15T18:45:09.853426] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-15T18:45:09.884901] [DEBUG] [LOCAL ] HASI: Trimmed 51399 records to 35139 (keeping 150 days of data) [2025-09-15T18:45:10.083829] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-15T18:45:10.361760] [INFO ] [REMOTE ] HBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:10.481952] [DEBUG] [LOCAL ] HASI: Primary data saved (35139 records). [2025-09-15T18:45:10.482091] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-15T18:45:10.482176] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 23.4s. Estimated remaining: 2h 25m 40s. Rate: 9.4 symbols/min [2025-09-15T18:45:10.657575] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:10.695633] [DEBUG] [LOCAL ] HBM: Loaded 39770 existing records from primary storage. [2025-09-15T18:45:10.695791] [INFO ] [MAIN ] HBM: Loaded 39770 existing records. [2025-09-15T18:45:10.857838] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-15T18:45:10.877408] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:10.878480] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-15T18:45:10.878587] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-15T18:45:10.879452] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-15T18:45:10.879504] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-15T18:45:11.134138] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:45:11.209405] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:45:11.309388] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:11.657885] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-15T18:45:12.378452] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T18:45:12.457891] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-15T18:45:12.623865] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:45:12.945681] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T18:45:12.946574] [INFO ] [REMOTE ] HBB: Full fetch complete (7573 records). [2025-09-15T18:45:12.946660] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-15T18:45:12.947042] [FATAL] [VALIDATOR ] HBB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:45:12.947120] [FATAL] [MAIN ] HBB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:45:12.947157] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:45:12.947194] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-15T18:45:12.947250] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-09-15T18:45:12.947297] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-09-15T18:45:12.947609] [DEBUG] [LOCAL ] HBB: Deleted derivative data file. [2025-09-15T18:45:12.947708] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 15.8s. Estimated remaining: 2h 25m 28s. Rate: 9.5 symbols/min [2025-09-15T18:45:13.116082] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:13.152576] [DEBUG] [LOCAL ] HCA: Loaded 35505 existing records from primary storage. [2025-09-15T18:45:13.152766] [INFO ] [MAIN ] HCA: Loaded 35505 existing records. [2025-09-15T18:45:13.263027] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-15T18:45:13.335266] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:13.335539] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-15T18:45:13.335606] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-15T18:45:13.336639] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-15T18:45:13.336730] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-15T18:45:13.708159] [INFO ] [REMOTE ] HCA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:14.057876] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-15T18:45:14.857875] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-15T18:45:15.108993] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T18:45:15.494741] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:45:15.657875] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-15T18:45:16.457867] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-15T18:45:17.257850] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-15T18:45:17.338102] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T18:45:17.989420] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-15T18:45:17.995122] [INFO ] [REMOTE ] HAYW: Full fetch complete (53053 records). [2025-09-15T18:45:17.995227] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-15T18:45:18.064781] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-15T18:45:18.389945] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-15T18:45:18.390053] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-15T18:45:18.391122] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-15T18:45:18.391177] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-15T18:45:18.392540] [DEBUG] [LOCAL ] HAYW: Trimmed 53053 records to 35753 (keeping 150 days of data) [2025-09-15T18:45:18.619890] [DEBUG] [LOCAL ] HAYW: Primary data saved (35753 records). [2025-09-15T18:45:18.620040] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-15T18:45:18.620158] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HAYW took 29.8s. Estimated remaining: 2h 25m 21s. Rate: 9.5 symbols/min [2025-09-15T18:45:18.850443] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:18.882897] [DEBUG] [LOCAL ] HCC: Loaded 34006 existing records from primary storage. [2025-09-15T18:45:18.883043] [INFO ] [MAIN ] HCC: Loaded 34006 existing records. [2025-09-15T18:45:19.067442] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:19.067748] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-15T18:45:19.067800] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-15T18:45:19.068500] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-15T18:45:19.068556] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-15T18:45:19.436089] [INFO ] [REMOTE ] HCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:19.436544] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-15T18:45:19.470986] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-15T18:45:19.515696] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T18:45:19.657876] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-15T18:45:20.069561] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T18:45:20.457864] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-15T18:45:20.905062] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:45:21.133477] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:45:21.257879] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-15T18:45:22.057882] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-15T18:45:22.096046] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:45:22.614811] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T18:45:22.857883] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-15T18:45:23.657887] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-15T18:45:23.890149] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:45:24.244160] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:45:24.457860] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-15T18:45:25.257861] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-15T18:45:25.315951] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:45:26.057866] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-15T18:45:26.458308] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:45:26.857876] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-15T18:45:26.993030] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:45:27.441371] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:45:27.657823] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-15T18:45:28.457891] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-15T18:45:28.490942] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:45:29.257844] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-15T18:45:29.302534] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T18:45:30.057865] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-15T18:45:30.167982] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:45:30.697316] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:45:30.857867] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-15T18:45:31.516454] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:45:31.522441] [INFO ] [REMOTE ] HBM: Full fetch complete (57558 records). [2025-09-15T18:45:31.522563] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-15T18:45:31.666997] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-15T18:45:31.915663] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-15T18:45:31.915795] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-15T18:45:31.916657] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-15T18:45:31.916732] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-15T18:45:31.919215] [DEBUG] [LOCAL ] HBM: Trimmed 57558 records to 38996 (keeping 150 days of data) [2025-09-15T18:45:32.165724] [DEBUG] [LOCAL ] HBM: Primary data saved (38996 records). [2025-09-15T18:45:32.165871] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-15T18:45:32.166660] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBM took 21.7s. Estimated remaining: 2h 25m 24s. Rate: 9.4 symbols/min [2025-09-15T18:45:32.338505] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:32.353031] [DEBUG] [LOCAL ] HCI: Loaded 10468 existing records from primary storage. [2025-09-15T18:45:32.353165] [INFO ] [MAIN ] HCI: Loaded 10468 existing records. [2025-09-15T18:45:32.462959] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-15T18:45:32.537937] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:32.538381] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-15T18:45:32.538595] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-15T18:45:32.539094] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-15T18:45:32.539157] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-15T18:45:32.939819] [INFO ] [REMOTE ] HCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:32.945283] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-15T18:45:33.000511] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:45:33.257907] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-15T18:45:34.067432] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-15T18:45:34.088111] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:45:34.436090] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:45:34.857874] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-15T18:45:34.982434] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:45:35.657888] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-15T18:45:36.457906] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-15T18:45:36.706397] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:45:37.079029] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:45:37.257899] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-15T18:45:37.983332] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:45:38.057830] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-15T18:45:38.424972] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:45:38.857915] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-15T18:45:39.657889] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-15T18:45:39.769311] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T18:45:39.778977] [INFO ] [REMOTE ] HCA: Full fetch complete (51819 records). [2025-09-15T18:45:39.779251] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-15T18:45:40.155888] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-15T18:45:40.155980] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-15T18:45:40.156720] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-15T18:45:40.156822] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-15T18:45:40.158589] [DEBUG] [LOCAL ] HCA: Trimmed 51819 records to 34822 (keeping 150 days of data) [2025-09-15T18:45:40.387668] [DEBUG] [LOCAL ] HCA: Primary data saved (34822 records). [2025-09-15T18:45:40.387824] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-15T18:45:40.388394] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCA took 27.4s. Estimated remaining: 2h 25m 21s. Rate: 9.4 symbols/min [2025-09-15T18:45:40.457869] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-15T18:45:40.609610] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:45:40.617158] [INFO ] [REMOTE ] HBI: Full fetch complete (57724 records). [2025-09-15T18:45:40.617280] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-15T18:45:40.997754] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-15T18:45:40.997911] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-15T18:45:40.998828] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-15T18:45:40.998911] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-15T18:45:41.012544] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:45:41.012676] [DEBUG] [LOCAL ] HBI: Trimmed 57724 records to 39082 (keeping 150 days of data) [2025-09-15T18:45:41.017728] [INFO ] [REMOTE ] HCC: Full fetch complete (49549 records). [2025-09-15T18:45:41.017805] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-15T18:45:41.295332] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:45:41.354043] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-15T18:45:41.521974] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-15T18:45:41.523688] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-15T18:45:41.525094] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-15T18:45:41.525457] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-15T18:45:41.530033] [DEBUG] [LOCAL ] HCC: Trimmed 49549 records to 33376 (keeping 150 days of data) [2025-09-15T18:45:41.834075] [DEBUG] [LOCAL ] HCC: Primary data saved (33376 records). [2025-09-15T18:45:41.835893] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-15T18:45:41.837105] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCC took 23.2s. Estimated remaining: 2h 25m 8s. Rate: 9.4 symbols/min [2025-09-15T18:45:41.859180] [DEBUG] [LOCAL ] HBI: Primary data saved (39082 records). [2025-09-15T18:45:41.859347] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-15T18:45:41.860183] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBI took 32.8s. Estimated remaining: 2h 24m 52s. Rate: 9.5 symbols/min [2025-09-15T18:45:42.062124] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T18:45:42.065723] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-15T18:45:42.973811] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T18:45:42.977387] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-15T18:45:43.720847] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:45:43.724845] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-15T18:45:44.693121] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:45:44.697152] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-15T18:45:45.638472] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:45:45.641865] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-15T18:45:46.594463] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:45:46.596520] [INFO ] [REMOTE ] HCI: Full fetch complete (14966 records). [2025-09-15T18:45:46.596604] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-15T18:45:46.967419] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-15T18:45:46.967498] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-15T18:45:46.967837] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-15T18:45:46.967881] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-15T18:45:46.968390] [DEBUG] [LOCAL ] HCI: Trimmed 14966 records to 10345 (keeping 150 days of data) [2025-09-15T18:45:47.036183] [DEBUG] [LOCAL ] HCI: Primary data saved (10345 records). [2025-09-15T18:45:47.036325] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-15T18:45:47.036409] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 14.9s. Estimated remaining: 2h 24m 45s. Rate: 9.5 symbols/min [2025-09-15T18:45:47.578605] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.706590] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.749827] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-15T18:45:47.756255] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.771376] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-15T18:45:47.773602] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.774659] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-15T18:45:47.775062] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-15T18:45:47.775326] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-15T18:45:47.775369] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-15T18:45:48.079379] [DEBUG] [LOCAL ] HDB: Loaded 38803 existing records from primary storage. [2025-09-15T18:45:48.085786] [DEBUG] [LOCAL ] HE: Loaded 36684 existing records from primary storage. [2025-09-15T18:45:48.104431] [INFO ] [MAIN ] HE: Loaded 36684 existing records. [2025-09-15T18:45:48.099051] [INFO ] [MAIN ] HDB: Loaded 38803 existing records. [2025-09-15T18:45:48.227697] [DEBUG] [LOCAL ] HD: Loaded 40285 existing records from primary storage. [2025-09-15T18:45:48.276081] [INFO ] [MAIN ] HD: Loaded 40285 existing records. [2025-09-15T18:45:48.555306] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:48.628378] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-15T18:45:48.695963] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.731287] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.731146] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.741848] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-15T18:45:48.752847] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-15T18:45:48.783911] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-15T18:45:48.747417] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.794361] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-15T18:45:48.866868] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.873094] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-15T18:45:48.894456] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.899749] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-15T18:45:48.931376] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-15T18:45:49.011145] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-15T18:45:49.061539] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-15T18:45:49.299370] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T18:45:49.404095] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-15T18:45:49.733821] [INFO ] [REMOTE ] HDB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:49.777069] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-15T18:45:49.837979] [INFO ] [REMOTE ] HE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:49.861055] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-15T18:45:49.920129] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T18:45:49.939782] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-15T18:45:49.942812] [INFO ] [REMOTE ] HD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:50.057837] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-15T18:45:50.169144] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:45:50.857920] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-15T18:45:51.395333] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:45:51.426010] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:45:51.505092] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:45:51.657877] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-15T18:45:51.910631] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T18:45:52.124342] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T18:45:52.457912] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-15T18:45:53.257880] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-15T18:45:53.508274] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-15T18:45:54.057869] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-15T18:45:54.181315] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:45:54.294791] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-15T18:45:54.857878] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-15T18:45:55.249577] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:45:55.250291] [INFO ] [REMOTE ] HCXY: Full fetch complete (388 records). [2025-09-15T18:45:55.250362] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-15T18:45:55.429929] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 119 unique days, need 150 days [2025-09-15T18:45:55.430120] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:45:55.430180] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:45:55.430229] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-15T18:45:55.430325] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-15T18:45:55.430363] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-15T18:45:55.430424] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-15T18:45:55.430495] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 8.4s. Estimated remaining: 2h 24m 41s. Rate: 9.5 symbols/min [2025-09-15T18:45:55.604098] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:55.630008] [DEBUG] [LOCAL ] HEI: Loaded 23960 existing records from primary storage. [2025-09-15T18:45:55.630162] [INFO ] [MAIN ] HEI: Loaded 23960 existing records. [2025-09-15T18:45:55.662966] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-15T18:45:55.815708] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:55.815954] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-15T18:45:55.816000] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-15T18:45:55.816862] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-15T18:45:55.816919] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-15T18:45:56.166928] [INFO ] [REMOTE ] HEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:56.457896] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-15T18:45:57.257903] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-15T18:45:57.855389] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T18:45:58.057898] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-15T18:45:58.148363] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:45:58.278122] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:45:58.857870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-15T18:45:59.657912] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-15T18:45:59.980606] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:46:00.288390] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:46:00.457940] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-15T18:46:01.257948] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-15T18:46:01.556924] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:46:01.960937] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:46:02.057885] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-15T18:46:02.857912] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-15T18:46:03.251117] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:46:03.437616] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:46:03.657878] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-15T18:46:04.457860] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-15T18:46:04.750041] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T18:46:05.257839] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-15T18:46:05.697723] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T18:46:05.708995] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:46:06.057885] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-15T18:46:06.857882] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-15T18:46:07.009314] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:46:07.657832] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-15T18:46:07.927003] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T18:46:08.421444] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:46:08.457830] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-15T18:46:09.257870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-15T18:46:09.328492] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:46:09.629486] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:46:10.057928] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-15T18:46:10.865896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-15T18:46:10.890813] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:46:11.657915] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-15T18:46:11.825917] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T18:46:12.457916] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-15T18:46:12.977324] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-15T18:46:13.110505] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:46:13.257870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-15T18:46:13.935375] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:46:14.057884] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-15T18:46:14.578178] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:46:14.583987] [INFO ] [REMOTE ] HDB: Full fetch complete (56504 records). [2025-09-15T18:46:14.584121] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-15T18:46:14.864429] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-15T18:46:14.967137] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-15T18:46:14.967241] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-15T18:46:14.968233] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-15T18:46:14.968288] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-15T18:46:14.969581] [DEBUG] [LOCAL ] HDB: Trimmed 56504 records to 38022 (keeping 150 days of data) [2025-09-15T18:46:15.212568] [DEBUG] [LOCAL ] HDB: Primary data saved (38022 records). [2025-09-15T18:46:15.212904] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-15T18:46:15.213493] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HDB took 28.2s. Estimated remaining: 2h 24m 53s. Rate: 9.4 symbols/min [2025-09-15T18:46:15.379378] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T18:46:15.409918] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:15.417786] [DEBUG] [LOCAL ] HEQ: Loaded 4247 existing records from primary storage. [2025-09-15T18:46:15.417922] [INFO ] [MAIN ] HEQ: Loaded 4247 existing records. [2025-09-15T18:46:15.597006] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:15.597304] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-15T18:46:15.597370] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-15T18:46:15.597756] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-15T18:46:15.597827] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-15T18:46:15.662955] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-15T18:46:15.947198] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:16.457916] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-15T18:46:16.931124] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T18:46:17.043909] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-15T18:46:17.049820] [INFO ] [REMOTE ] HD: Full fetch complete (58179 records). [2025-09-15T18:46:17.049941] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-15T18:46:17.264774] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-15T18:46:17.365810] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:46:17.418914] [INFO ] [REMOTE ] HE: Full fetch complete (53951 records). [2025-09-15T18:46:17.448849] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-15T18:46:17.535694] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-15T18:46:17.546771] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-15T18:46:17.565696] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-15T18:46:17.567943] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-15T18:46:17.641875] [DEBUG] [LOCAL ] HD: Trimmed 58179 records to 39510 (keeping 150 days of data) [2025-09-15T18:46:17.954722] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-15T18:46:17.955997] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-15T18:46:17.957782] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-15T18:46:17.960898] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-15T18:46:17.966224] [DEBUG] [LOCAL ] HE: Trimmed 53951 records to 35907 (keeping 150 days of data) [2025-09-15T18:46:18.035208] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:46:18.062358] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-15T18:46:18.308667] [DEBUG] [LOCAL ] HD: Primary data saved (39510 records). [2025-09-15T18:46:18.309080] [INFO ] [MAIN ] HD: Full history saved. [2025-09-15T18:46:18.309867] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HD took 31.3s. Estimated remaining: 2h 24m 42s. Rate: 9.4 symbols/min [2025-09-15T18:46:18.485794] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:18.500981] [DEBUG] [LOCAL ] HE: Primary data saved (35907 records). [2025-09-15T18:46:18.501135] [INFO ] [MAIN ] HE: Full history saved. [2025-09-15T18:46:18.501272] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HE took 31.4s. Estimated remaining: 2h 24m 27s. Rate: 9.4 symbols/min [2025-09-15T18:46:18.648777] [DEBUG] [LOCAL ] HESM: Loaded 36270 existing records from primary storage. [2025-09-15T18:46:18.674858] [INFO ] [MAIN ] HESM: Loaded 36270 existing records. [2025-09-15T18:46:18.769136] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:18.804289] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-15T18:46:18.806571] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-15T18:46:18.817474] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-15T18:46:18.832899] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-15T18:46:18.862485] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-15T18:46:18.884924] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-15T18:46:18.885959] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:18.886268] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-15T18:46:18.886317] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-15T18:46:18.886108] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-15T18:46:18.892946] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-15T18:46:18.933417] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-15T18:46:19.611204] [INFO ] [REMOTE ] HF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:19.630987] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:19.653880] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T18:46:19.661125] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-15T18:46:19.670062] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:46:20.085582] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:46:20.457864] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-15T18:46:21.257879] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-15T18:46:21.698744] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:46:21.702611] [INFO ] [REMOTE ] HEI: Full fetch complete (36388 records). [2025-09-15T18:46:21.702783] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-15T18:46:22.069554] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-15T18:46:22.084590] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-15T18:46:22.084695] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-15T18:46:22.085366] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-15T18:46:22.085415] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-15T18:46:22.086446] [DEBUG] [LOCAL ] HEI: Trimmed 36388 records to 23374 (keeping 150 days of data) [2025-09-15T18:46:22.240886] [DEBUG] [LOCAL ] HEI: Primary data saved (23374 records). [2025-09-15T18:46:22.241036] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-15T18:46:22.241139] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 26.8s. Estimated remaining: 2h 24m 18s. Rate: 9.5 symbols/min [2025-09-15T18:46:22.414273] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:22.414479] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-15T18:46:22.414516] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-15T18:46:22.414635] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-15T18:46:22.414694] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-15T18:46:22.414735] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-15T18:46:22.414766] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-15T18:46:22.770002] [INFO ] [REMOTE ] HFND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:22.841071] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:46:22.857815] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-15T18:46:22.930911] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:46:23.657925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-15T18:46:24.457888] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-15T18:46:24.477352] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:46:24.515343] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:46:24.851574] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:46:25.257875] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-15T18:46:25.511662] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T18:46:26.057900] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-15T18:46:26.727383] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T18:46:26.857872] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-15T18:46:27.657874] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-15T18:46:27.887281] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:46:28.462936] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-15T18:46:28.480866] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:46:28.773227] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:46:29.257882] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-15T18:46:30.057875] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-15T18:46:30.290354] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-15T18:46:30.759695] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T18:46:30.857840] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-15T18:46:31.657874] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-15T18:46:32.388778] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:46:32.417463] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:46:32.457815] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-15T18:46:33.257869] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-15T18:46:33.529214] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-15T18:46:34.057957] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-15T18:46:34.147957] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:46:34.749733] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:46:34.751419] [INFO ] [REMOTE ] HEQ: Full fetch complete (6530 records). [2025-09-15T18:46:34.751495] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-15T18:46:34.862338] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-15T18:46:35.133423] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-15T18:46:35.133524] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-15T18:46:35.133760] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-15T18:46:35.133804] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-15T18:46:35.134268] [DEBUG] [LOCAL ] HEQ: Trimmed 6530 records to 4271 (keeping 150 days of data) [2025-09-15T18:46:35.162524] [DEBUG] [LOCAL ] HEQ: Primary data saved (4271 records). [2025-09-15T18:46:35.162696] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-15T18:46:35.162851] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 19.9s. Estimated remaining: 2h 24m 20s. Rate: 9.4 symbols/min [2025-09-15T18:46:35.349939] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T18:46:35.354288] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:35.371916] [DEBUG] [LOCAL ] HFRO: Loaded 12029 existing records from primary storage. [2025-09-15T18:46:35.372162] [INFO ] [MAIN ] HFRO: Loaded 12029 existing records. [2025-09-15T18:46:35.568009] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:35.568378] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-15T18:46:35.568458] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-15T18:46:35.569090] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-15T18:46:35.569148] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-15T18:46:35.663123] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-15T18:46:35.944400] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:46:35.947443] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:36.457872] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-15T18:46:36.683748] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-15T18:46:37.257877] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-15T18:46:37.580295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T18:46:37.581132] [INFO ] [REMOTE ] HF: Full fetch complete (291 records). [2025-09-15T18:46:37.581219] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-15T18:46:37.792270] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-15T18:46:37.792478] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:46:37.792528] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:46:37.792573] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-15T18:46:37.792636] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-15T18:46:37.792707] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-15T18:46:37.792763] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-15T18:46:37.792861] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HF took 19.3s. Estimated remaining: 2h 24m 9s. Rate: 9.4 symbols/min [2025-09-15T18:46:37.963272] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:37.974368] [DEBUG] [LOCAL ] HGER: Loaded 10025 existing records from primary storage. [2025-09-15T18:46:37.974488] [INFO ] [MAIN ] HGER: Loaded 10025 existing records. [2025-09-15T18:46:38.063234] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-15T18:46:38.156165] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:38.156393] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-15T18:46:38.156441] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-15T18:46:38.156801] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-15T18:46:38.156850] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-15T18:46:38.432896] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:46:38.508390] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:38.857942] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-15T18:46:39.657913] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-15T18:46:39.853455] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:46:39.894032] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-15T18:46:40.457855] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-15T18:46:41.054141] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:46:41.257892] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-15T18:46:41.576058] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:46:42.057886] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-15T18:46:42.342014] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-15T18:46:42.857864] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-15T18:46:43.300633] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:46:43.301455] [INFO ] [REMOTE ] HFND: Full fetch complete (1352 records). [2025-09-15T18:46:43.301534] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-15T18:46:43.478750] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:46:43.478954] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:46:43.479021] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:46:43.479077] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-15T18:46:43.479157] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-15T18:46:43.479209] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-15T18:46:43.479284] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-15T18:46:43.479386] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HFND took 21.2s. Estimated remaining: 2h 24m 1s. Rate: 9.4 symbols/min [2025-09-15T18:46:43.647098] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:43.654861] [DEBUG] [LOCAL ] HGLB: Loaded 6627 existing records from primary storage. [2025-09-15T18:46:43.654951] [INFO ] [MAIN ] HGLB: Loaded 6627 existing records. [2025-09-15T18:46:43.665839] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-15T18:46:43.835110] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:43.835389] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-15T18:46:43.835434] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-15T18:46:43.835790] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-15T18:46:43.835840] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-15T18:46:44.201173] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:44.457865] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-15T18:46:45.257861] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-15T18:46:45.307366] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:46:45.569165] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:46:45.772307] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:46:46.057930] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-15T18:46:46.857979] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-15T18:46:46.878131] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:46:47.657949] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-15T18:46:47.707958] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:46:48.279606] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T18:46:48.457878] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-15T18:46:49.257944] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-15T18:46:50.057881] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-15T18:46:50.146950] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T18:46:50.152799] [INFO ] [REMOTE ] HESM: Full fetch complete (52505 records). [2025-09-15T18:46:50.152950] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-15T18:46:50.390969] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:46:50.554147] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-15T18:46:50.557711] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-15T18:46:50.558522] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-15T18:46:50.558574] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-15T18:46:50.559916] [DEBUG] [LOCAL ] HESM: Trimmed 52505 records to 35628 (keeping 150 days of data) [2025-09-15T18:46:50.632805] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T18:46:50.792516] [DEBUG] [LOCAL ] HESM: Primary data saved (35628 records). [2025-09-15T18:46:50.792689] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-15T18:46:50.792792] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HESM took 32.5s. Estimated remaining: 2h 23m 56s. Rate: 9.4 symbols/min [2025-09-15T18:46:50.863004] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-15T18:46:50.962305] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:50.973057] [DEBUG] [LOCAL ] HGTY: Loaded 9766 existing records from primary storage. [2025-09-15T18:46:50.973169] [INFO ] [MAIN ] HGTY: Loaded 9766 existing records. [2025-09-15T18:46:51.145429] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:51.145731] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-15T18:46:51.145780] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-15T18:46:51.146101] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-15T18:46:51.146145] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-15T18:46:51.500105] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:51.657880] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-15T18:46:51.743231] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T18:46:52.252998] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:46:52.457883] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-15T18:46:52.981796] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T18:46:53.257914] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-15T18:46:54.057930] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-15T18:46:54.288380] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:46:54.857934] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-15T18:46:54.924552] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T18:46:55.657910] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-15T18:46:55.854247] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:46:55.856812] [INFO ] [REMOTE ] HGER: Full fetch complete (12894 records). [2025-09-15T18:46:55.856905] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-15T18:46:56.219836] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-15T18:46:56.219977] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-15T18:46:56.220275] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-15T18:46:56.227523] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-15T18:46:56.228425] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T18:46:56.232144] [DEBUG] [LOCAL ] HGER: Trimmed 12894 records to 9870 (keeping 150 days of data) [2025-09-15T18:46:56.292237] [DEBUG] [LOCAL ] HGER: Primary data saved (9870 records). [2025-09-15T18:46:56.292380] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-15T18:46:56.292466] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HGER took 18.5s. Estimated remaining: 2h 23m 49s. Rate: 9.4 symbols/min [2025-09-15T18:46:56.463207] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-15T18:46:56.466235] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:56.501593] [DEBUG] [LOCAL ] HGV: Loaded 35452 existing records from primary storage. [2025-09-15T18:46:56.501775] [INFO ] [MAIN ] HGV: Loaded 35452 existing records. [2025-09-15T18:46:56.677007] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:56.677270] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-15T18:46:56.677319] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-15T18:46:56.678179] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-15T18:46:56.678239] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-15T18:46:57.047192] [INFO ] [REMOTE ] HGV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:57.257873] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-15T18:46:57.492526] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:46:58.057878] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-15T18:46:58.232585] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:46:58.857922] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-15T18:46:58.910858] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T18:46:59.385714] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:46:59.657868] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-15T18:47:00.218554] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:47:00.457860] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-15T18:47:01.207124] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T18:47:01.257865] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-15T18:47:02.019793] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T18:47:02.057882] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-15T18:47:02.857931] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-15T18:47:03.657887] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-15T18:47:03.703680] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:47:03.738506] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:47:04.214264] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:47:04.457864] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-15T18:47:05.191478] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:47:05.257911] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-15T18:47:05.821513] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T18:47:06.057897] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-15T18:47:06.844139] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:47:06.857822] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-15T18:47:07.657919] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-15T18:47:07.917256] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:47:08.457882] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-15T18:47:08.667344] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:47:09.257910] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-15T18:47:09.925584] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:47:10.057876] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-15T18:47:10.149532] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:47:10.152063] [INFO ] [REMOTE ] HFRO: Full fetch complete (19730 records). [2025-09-15T18:47:10.152140] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-15T18:47:10.549361] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-15T18:47:10.549448] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-15T18:47:10.549877] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-15T18:47:10.549919] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-15T18:47:10.550476] [DEBUG] [LOCAL ] HFRO: Trimmed 19730 records to 11867 (keeping 150 days of data) [2025-09-15T18:47:10.620156] [DEBUG] [LOCAL ] HFRO: Primary data saved (11867 records). [2025-09-15T18:47:10.620300] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-15T18:47:10.620394] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HFRO took 35.5s. Estimated remaining: 2h 23m 53s. Rate: 9.4 symbols/min [2025-09-15T18:47:10.821103] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:10.845946] [DEBUG] [LOCAL ] HHH: Loaded 25705 existing records from primary storage. [2025-09-15T18:47:10.846103] [INFO ] [MAIN ] HHH: Loaded 25705 existing records. [2025-09-15T18:47:10.866406] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-15T18:47:10.963008] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:47:10.993719] [INFO ] [REMOTE ] HGLB: Full fetch complete (10839 records). [2025-09-15T18:47:11.009128] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-15T18:47:11.062606] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:11.123201] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-15T18:47:11.133825] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-15T18:47:11.139659] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-15T18:47:11.149926] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-15T18:47:11.661546] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-15T18:47:11.672833] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-15T18:47:11.680417] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-15T18:47:11.684551] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-15T18:47:11.684886] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-15T18:47:11.741752] [DEBUG] [LOCAL ] HGLB: Trimmed 10839 records to 6515 (keeping 150 days of data) [2025-09-15T18:47:11.764918] [INFO ] [REMOTE ] HHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:11.805972] [DEBUG] [LOCAL ] HGLB: Primary data saved (6515 records). [2025-09-15T18:47:11.806086] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-15T18:47:11.806175] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 28.3s. Estimated remaining: 2h 23m 40s. Rate: 9.4 symbols/min [2025-09-15T18:47:11.978908] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:12.004321] [DEBUG] [LOCAL ] HI: Loaded 26236 existing records from primary storage. [2025-09-15T18:47:12.004466] [INFO ] [MAIN ] HI: Loaded 26236 existing records. [2025-09-15T18:47:12.192924] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:47:12.221157] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:12.221718] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-15T18:47:12.221773] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-15T18:47:12.222452] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-15T18:47:12.222502] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-15T18:47:12.463971] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-15T18:47:12.581985] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:12.593259] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T18:47:12.596848] [INFO ] [REMOTE ] HGTY: Full fetch complete (13034 records). [2025-09-15T18:47:12.597034] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-15T18:47:12.967469] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-15T18:47:12.967554] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-15T18:47:12.967931] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-15T18:47:12.967978] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-15T18:47:12.968523] [DEBUG] [LOCAL ] HGTY: Trimmed 13034 records to 9760 (keeping 150 days of data) [2025-09-15T18:47:13.026847] [DEBUG] [LOCAL ] HGTY: Primary data saved (9760 records). [2025-09-15T18:47:13.027000] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-15T18:47:13.027104] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 22.2s. Estimated remaining: 2h 23m 27s. Rate: 9.5 symbols/min [2025-09-15T18:47:13.197549] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:13.236891] [DEBUG] [LOCAL ] HIG: Loaded 38704 existing records from primary storage. [2025-09-15T18:47:13.237045] [INFO ] [MAIN ] HIG: Loaded 38704 existing records. [2025-09-15T18:47:13.267416] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-15T18:47:13.420476] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:13.420776] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-15T18:47:13.420827] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-15T18:47:13.421713] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-15T18:47:13.421771] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-15T18:47:13.775129] [INFO ] [REMOTE ] HIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:13.839368] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T18:47:14.057919] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-15T18:47:14.341014] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:47:14.848595] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:47:14.857805] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-15T18:47:15.657869] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-15T18:47:16.072049] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:47:16.457868] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-15T18:47:17.193061] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:47:17.257819] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-15T18:47:17.456574] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:47:18.057920] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-15T18:47:18.857916] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-15T18:47:18.983149] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:47:19.605660] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:47:19.657839] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-15T18:47:20.408313] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:47:20.457908] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-15T18:47:21.016414] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:47:21.257892] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-15T18:47:21.436502] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:47:22.057882] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-15T18:47:22.465045] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:47:22.470166] [INFO ] [REMOTE ] HGV: Full fetch complete (51006 records). [2025-09-15T18:47:22.470290] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-15T18:47:22.853120] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-15T18:47:22.853202] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-15T18:47:22.853958] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-15T18:47:22.854013] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-15T18:47:22.855575] [DEBUG] [LOCAL ] HGV: Trimmed 51006 records to 34755 (keeping 150 days of data) [2025-09-15T18:47:22.857951] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-15T18:47:23.070631] [DEBUG] [LOCAL ] HGV: Primary data saved (34755 records). [2025-09-15T18:47:23.070792] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-15T18:47:23.070879] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 26.8s. Estimated remaining: 2h 23m 25s. Rate: 9.4 symbols/min [2025-09-15T18:47:23.239872] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:23.264715] [DEBUG] [LOCAL ] HII: Loaded 24776 existing records from primary storage. [2025-09-15T18:47:23.264858] [INFO ] [MAIN ] HII: Loaded 24776 existing records. [2025-09-15T18:47:23.442920] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:23.443280] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-15T18:47:23.443340] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-15T18:47:23.444172] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-15T18:47:23.444314] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-15T18:47:23.663450] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-15T18:47:23.851545] [INFO ] [REMOTE ] HII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:23.853160] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T18:47:24.348979] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:47:24.457823] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-15T18:47:24.747051] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:47:25.257865] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-15T18:47:25.744036] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:47:26.057928] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-15T18:47:26.547389] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:47:26.857873] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-15T18:47:27.640297] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:47:27.657828] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-15T18:47:27.906557] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:47:28.457914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-15T18:47:29.257901] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-15T18:47:29.352375] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:47:29.917383] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:47:30.057918] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-15T18:47:30.305977] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:47:30.857951] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-15T18:47:31.444823] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:47:31.657865] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-15T18:47:32.310713] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:47:32.314602] [INFO ] [REMOTE ] HHH: Full fetch complete (35932 records). [2025-09-15T18:47:32.314715] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-15T18:47:32.462919] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-15T18:47:32.684742] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-15T18:47:32.684832] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-15T18:47:32.685537] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-15T18:47:32.685618] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-15T18:47:32.687703] [DEBUG] [LOCAL ] HHH: Trimmed 35932 records to 25501 (keeping 150 days of data) [2025-09-15T18:47:32.846689] [DEBUG] [LOCAL ] HHH: Primary data saved (25501 records). [2025-09-15T18:47:32.846823] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-15T18:47:32.846940] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HHH took 22.2s. Estimated remaining: 2h 23m 24s. Rate: 9.4 symbols/min [2025-09-15T18:47:33.030122] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:33.081232] [DEBUG] [LOCAL ] HIMS: Loaded 40557 existing records from primary storage. [2025-09-15T18:47:33.081444] [INFO ] [MAIN ] HIMS: Loaded 40557 existing records. [2025-09-15T18:47:33.281102] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:33.275817] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-15T18:47:33.284794] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-15T18:47:33.284917] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-15T18:47:33.286852] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-15T18:47:33.286794] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:47:33.286998] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-15T18:47:33.653801] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:33.907305] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:47:34.057879] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-15T18:47:34.722314] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:47:34.857865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-15T18:47:35.450208] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:47:35.454497] [INFO ] [REMOTE ] HI: Full fetch complete (38052 records). [2025-09-15T18:47:35.454599] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-15T18:47:35.666919] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-15T18:47:35.840607] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-15T18:47:35.840712] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-15T18:47:35.841377] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-15T18:47:35.841420] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-15T18:47:35.842954] [DEBUG] [LOCAL ] HI: Trimmed 38052 records to 25684 (keeping 150 days of data) [2025-09-15T18:47:36.004562] [DEBUG] [LOCAL ] HI: Primary data saved (25684 records). [2025-09-15T18:47:36.004729] [INFO ] [MAIN ] HI: Full history saved. [2025-09-15T18:47:36.004830] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 24.2s. Estimated remaining: 2h 23m 13s. Rate: 9.4 symbols/min [2025-09-15T18:47:36.174624] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:36.189765] [DEBUG] [LOCAL ] HIO: Loaded 16072 existing records from primary storage. [2025-09-15T18:47:36.189879] [INFO ] [MAIN ] HIO: Loaded 16072 existing records. [2025-09-15T18:47:36.368679] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:36.368924] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-15T18:47:36.368976] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-15T18:47:36.369400] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-15T18:47:36.369445] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-15T18:47:36.468018] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-15T18:47:36.725229] [INFO ] [REMOTE ] HIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:36.760329] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T18:47:37.257879] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-15T18:47:37.851952] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-15T18:47:37.945596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:47:38.057907] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-15T18:47:38.752264] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:47:38.857933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-15T18:47:39.459844] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:47:39.657890] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-15T18:47:40.463004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-15T18:47:40.479574] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:47:41.003823] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:47:41.257960] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-15T18:47:41.565690] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:47:42.057871] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-15T18:47:42.857876] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-15T18:47:43.464946] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:47:43.469091] [INFO ] [REMOTE ] HII: Full fetch complete (39791 records). [2025-09-15T18:47:43.469187] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-15T18:47:43.688632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-15T18:47:43.850304] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-15T18:47:43.850476] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-15T18:47:43.851159] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-15T18:47:43.851273] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-15T18:47:43.852566] [DEBUG] [LOCAL ] HII: Trimmed 39791 records to 24141 (keeping 150 days of data) [2025-09-15T18:47:44.012120] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-15T18:47:44.064880] [DEBUG] [LOCAL ] HII: Primary data saved (24141 records). [2025-09-15T18:47:44.065054] [INFO ] [MAIN ] HII: Full history saved. [2025-09-15T18:47:44.065173] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HII took 21.0s. Estimated remaining: 2h 23m 9s. Rate: 9.4 symbols/min [2025-09-15T18:47:44.237192] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:44.255431] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:47:44.262212] [INFO ] [REMOTE ] HIG: Full fetch complete (55559 records). [2025-09-15T18:47:44.262441] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-15T18:47:44.382568] [DEBUG] [LOCAL ] HIPO: Loaded 16864 existing records from primary storage. [2025-09-15T18:47:44.388218] [INFO ] [MAIN ] HIPO: Loaded 16864 existing records. [2025-09-15T18:47:44.465392] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-15T18:47:44.758529] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:44.766751] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-15T18:47:44.782201] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-15T18:47:44.818448] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-15T18:47:44.819321] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-15T18:47:44.912371] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-15T18:47:44.921748] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-15T18:47:44.934533] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-15T18:47:44.939719] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-15T18:47:45.070316] [DEBUG] [LOCAL ] HIG: Trimmed 55559 records to 37942 (keeping 150 days of data) [2025-09-15T18:47:45.384445] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:45.388454] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-15T18:47:45.388090] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:47:45.528326] [DEBUG] [LOCAL ] HIG: Primary data saved (37942 records). [2025-09-15T18:47:45.528510] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-15T18:47:45.528630] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HIG took 32.5s. Estimated remaining: 2h 22m 56s. Rate: 9.5 symbols/min [2025-09-15T18:47:45.699794] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:45.731767] [DEBUG] [LOCAL ] HIW: Loaded 33336 existing records from primary storage. [2025-09-15T18:47:45.731925] [INFO ] [MAIN ] HIW: Loaded 33336 existing records. [2025-09-15T18:47:45.907811] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:45.908063] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-15T18:47:45.908111] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-15T18:47:45.908992] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-15T18:47:45.909045] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-15T18:47:46.060033] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-15T18:47:46.263688] [INFO ] [REMOTE ] HIW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:46.277302] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:47:46.857938] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-15T18:47:47.176481] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-15T18:47:47.312670] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:47:47.648615] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:47:47.657857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-15T18:47:48.457939] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-15T18:47:48.771298] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:47:49.257930] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-15T18:47:49.802202] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:47:50.057871] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-15T18:47:50.367800] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:47:50.857899] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-15T18:47:51.576845] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:47:51.657911] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-15T18:47:51.847707] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:47:52.457923] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-15T18:47:52.947460] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:47:53.083092] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T18:47:53.257938] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-15T18:47:54.048391] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T18:47:54.057807] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-15T18:47:54.772870] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:47:54.857842] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-15T18:47:55.657924] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-15T18:47:55.852443] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:47:56.457871] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-15T18:47:57.203852] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:47:57.256240] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T18:47:57.260464] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-15T18:47:58.057885] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-15T18:47:58.677961] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:47:58.857840] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-15T18:47:59.115289] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:47:59.118201] [INFO ] [REMOTE ] HIPO: Full fetch complete (24444 records). [2025-09-15T18:47:59.118280] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-15T18:47:59.521155] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-15T18:47:59.521233] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-15T18:47:59.521730] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-15T18:47:59.521773] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-15T18:47:59.522411] [DEBUG] [LOCAL ] HIPO: Trimmed 24444 records to 16581 (keeping 150 days of data) [2025-09-15T18:47:59.619567] [DEBUG] [LOCAL ] HIPO: Primary data saved (16581 records). [2025-09-15T18:47:59.619728] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-15T18:47:59.619815] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIPO took 15.6s. Estimated remaining: 2h 22m 60s. Rate: 9.4 symbols/min [2025-09-15T18:47:59.663021] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-15T18:47:59.792079] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:59.807352] [DEBUG] [LOCAL ] HIX: Loaded 15096 existing records from primary storage. [2025-09-15T18:47:59.807475] [INFO ] [MAIN ] HIX: Loaded 15096 existing records. [2025-09-15T18:47:59.986547] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:59.986805] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-15T18:47:59.986852] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-15T18:47:59.987399] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-15T18:47:59.987450] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-15T18:48:00.347198] [INFO ] [REMOTE ] HIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:00.373308] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:48:00.457843] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-15T18:48:01.257862] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-15T18:48:01.543957] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T18:48:02.057892] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-15T18:48:02.867976] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-15T18:48:02.902806] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-15T18:48:03.392944] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-15T18:48:03.657893] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-15T18:48:04.457960] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-15T18:48:04.839812] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-15T18:48:04.862592] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-15T18:48:05.229942] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:48:05.235303] [INFO ] [REMOTE ] HIW: Full fetch complete (48967 records). [2025-09-15T18:48:05.235420] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-15T18:48:05.266668] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-15T18:48:05.615062] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-15T18:48:05.615149] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-15T18:48:05.615973] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-15T18:48:05.616019] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-15T18:48:05.617167] [DEBUG] [LOCAL ] HIW: Trimmed 48967 records to 32873 (keeping 150 days of data) [2025-09-15T18:48:05.822384] [DEBUG] [LOCAL ] HIW: Primary data saved (32873 records). [2025-09-15T18:48:05.822526] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-15T18:48:05.822612] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIW took 20.3s. Estimated remaining: 2h 22m 53s. Rate: 9.4 symbols/min [2025-09-15T18:48:05.990525] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:06.004830] [DEBUG] [LOCAL ] HKD: Loaded 13529 existing records from primary storage. [2025-09-15T18:48:06.004978] [INFO ] [MAIN ] HKD: Loaded 13529 existing records. [2025-09-15T18:48:06.067497] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-15T18:48:06.183914] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:06.184175] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-15T18:48:06.184253] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-15T18:48:06.184710] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-15T18:48:06.184772] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-15T18:48:06.549190] [INFO ] [REMOTE ] HKD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:06.563823] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:48:06.857870] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-15T18:48:07.026219] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:48:07.030234] [INFO ] [REMOTE ] HIO: Full fetch complete (26944 records). [2025-09-15T18:48:07.030414] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-15T18:48:07.244091] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-15T18:48:07.458982] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-15T18:48:07.459063] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-15T18:48:07.459677] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-15T18:48:07.459723] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-15T18:48:07.460410] [DEBUG] [LOCAL ] HIO: Trimmed 26944 records to 15857 (keeping 150 days of data) [2025-09-15T18:48:07.555328] [DEBUG] [LOCAL ] HIO: Primary data saved (15857 records). [2025-09-15T18:48:07.555470] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-15T18:48:07.555574] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIO took 31.6s. Estimated remaining: 2h 22m 41s. Rate: 9.4 symbols/min [2025-09-15T18:48:07.658099] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-15T18:48:07.731445] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:07.772940] [DEBUG] [LOCAL ] HL: Loaded 40416 existing records from primary storage. [2025-09-15T18:48:07.773092] [INFO ] [MAIN ] HL: Loaded 40416 existing records. [2025-09-15T18:48:07.952381] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:07.952810] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-15T18:48:07.952890] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-15T18:48:07.958948] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-15T18:48:07.965805] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-15T18:48:07.997835] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:48:08.328099] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:08.457865] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-15T18:48:09.257972] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-15T18:48:09.601456] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:48:09.893948] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T18:48:10.057868] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-15T18:48:10.316236] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:48:10.857880] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-15T18:48:11.510938] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:48:11.657884] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-15T18:48:12.455934] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-15T18:48:12.466412] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-15T18:48:12.718462] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:48:13.257895] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-15T18:48:14.067211] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-15T18:48:14.068423] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:48:14.221264] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:48:14.857871] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-15T18:48:15.657942] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-15T18:48:16.457871] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-15T18:48:16.726442] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:48:17.111446] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-09-15T18:48:17.117395] [INFO ] [REMOTE ] HIMS: Full fetch complete (58497 records). [2025-09-15T18:48:17.117496] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-15T18:48:17.259303] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-15T18:48:17.305300] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:48:17.345406] [INFO ] [REMOTE ] HIX: Full fetch complete (21839 records). [2025-09-15T18:48:17.394760] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-15T18:48:17.633289] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-15T18:48:17.633852] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-15T18:48:17.640948] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-15T18:48:17.651445] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-15T18:48:17.779768] [DEBUG] [LOCAL ] HIMS: Trimmed 58497 records to 39777 (keeping 150 days of data) [2025-09-15T18:48:17.938761] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-09-15T18:48:18.060950] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-15T18:48:18.061227] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-15T18:48:18.062519] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-15T18:48:18.068517] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-15T18:48:18.071536] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-15T18:48:18.097732] [DEBUG] [LOCAL ] HIX: Trimmed 21839 records to 14901 (keeping 150 days of data) [2025-09-15T18:48:18.303973] [DEBUG] [LOCAL ] HIMS: Primary data saved (39777 records). [2025-09-15T18:48:18.318847] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-15T18:48:18.320623] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIMS took 45.5s. Estimated remaining: 2h 22m 40s. Rate: 9.4 symbols/min [2025-09-15T18:48:18.323506] [DEBUG] [LOCAL ] HIX: Primary data saved (14901 records). [2025-09-15T18:48:18.321203] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:48:18.323960] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-15T18:48:18.329174] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 18.7s. Estimated remaining: 2h 22m 26s. Rate: 9.5 symbols/min [2025-09-15T18:48:18.665419] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:18.668214] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:18.691767] [DEBUG] [LOCAL ] HLI: Loaded 22943 existing records from primary storage. [2025-09-15T18:48:18.691903] [INFO ] [MAIN ] HLI: Loaded 22943 existing records. [2025-09-15T18:48:18.842827] [DEBUG] [LOCAL ] HLF: Loaded 36855 existing records from primary storage. [2025-09-15T18:48:18.860144] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-15T18:48:18.878663] [INFO ] [MAIN ] HLF: Loaded 36855 existing records. [2025-09-15T18:48:18.898881] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:18.977015] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-15T18:48:19.000311] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-15T18:48:19.008229] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-15T18:48:19.018521] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-15T18:48:19.181834] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:19.197932] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-15T18:48:19.203114] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-15T18:48:19.222158] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-15T18:48:19.240062] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-15T18:48:19.659090] [INFO ] [REMOTE ] HLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:19.692539] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-15T18:48:19.811263] [INFO ] [REMOTE ] HLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:19.967356] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:48:20.022541] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:48:20.457926] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-15T18:48:21.060130] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:48:21.137363] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:48:21.257864] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-15T18:48:22.057934] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-15T18:48:22.195979] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:48:22.857888] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-15T18:48:23.338970] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:48:23.657926] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-15T18:48:24.457945] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-15T18:48:24.500501] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:48:24.826078] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:48:25.257823] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-15T18:48:25.558190] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:48:25.561132] [INFO ] [REMOTE ] HKD: Full fetch complete (20120 records). [2025-09-15T18:48:25.561211] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-15T18:48:25.918098] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-15T18:48:25.918179] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-15T18:48:25.918623] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-15T18:48:25.918680] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-15T18:48:25.919258] [DEBUG] [LOCAL ] HKD: Trimmed 20120 records to 13415 (keeping 150 days of data) [2025-09-15T18:48:26.003919] [DEBUG] [LOCAL ] HKD: Primary data saved (13415 records). [2025-09-15T18:48:26.004300] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-15T18:48:26.004465] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 20.2s. Estimated remaining: 2h 22m 21s. Rate: 9.4 symbols/min [2025-09-15T18:48:26.068328] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-15T18:48:26.178468] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:26.203953] [DEBUG] [LOCAL ] HLIO: Loaded 22033 existing records from primary storage. [2025-09-15T18:48:26.204130] [INFO ] [MAIN ] HLIO: Loaded 22033 existing records. [2025-09-15T18:48:26.386828] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:26.387087] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-15T18:48:26.387148] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-15T18:48:26.387883] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-15T18:48:26.387958] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-15T18:48:26.744502] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:26.844161] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T18:48:26.857808] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-15T18:48:27.657842] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-15T18:48:27.758727] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:48:28.063235] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:48:28.307930] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:48:28.457862] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-15T18:48:29.257886] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-15T18:48:30.057875] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-15T18:48:30.380083] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T18:48:30.598717] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:48:30.857885] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-15T18:48:31.123076] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:48:31.657863] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-15T18:48:32.457871] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-15T18:48:32.789906] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T18:48:32.861471] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:48:33.257870] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-15T18:48:34.057873] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-15T18:48:34.143303] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:48:34.857885] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-15T18:48:35.192500] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T18:48:35.213738] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T18:48:35.217428] [INFO ] [REMOTE ] HLI: Full fetch complete (34088 records). [2025-09-15T18:48:35.217513] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-15T18:48:35.607514] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-15T18:48:35.607602] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-15T18:48:35.608251] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-15T18:48:35.608308] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-15T18:48:35.609205] [DEBUG] [LOCAL ] HLI: Trimmed 34088 records to 22468 (keeping 150 days of data) [2025-09-15T18:48:35.669266] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-15T18:48:35.758977] [DEBUG] [LOCAL ] HLI: Primary data saved (22468 records). [2025-09-15T18:48:35.759109] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-15T18:48:35.759201] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLI took 17.4s. Estimated remaining: 2h 22m 19s. Rate: 9.4 symbols/min [2025-09-15T18:48:35.934336] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:35.957862] [DEBUG] [LOCAL ] HLLY: Loaded 24903 existing records from primary storage. [2025-09-15T18:48:35.958025] [INFO ] [MAIN ] HLLY: Loaded 24903 existing records. [2025-09-15T18:48:36.139727] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:36.140035] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-15T18:48:36.140086] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-15T18:48:36.140775] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-15T18:48:36.140830] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-15T18:48:36.458708] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-15T18:48:36.526683] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:36.558433] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:48:37.257883] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-15T18:48:37.553731] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T18:48:37.763106] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:48:38.057884] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-15T18:48:38.836601] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:48:38.857831] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-15T18:48:39.393935] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T18:48:39.657941] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-15T18:48:40.356104] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:48:40.457938] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-15T18:48:41.059305] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:48:41.066124] [INFO ] [REMOTE ] HL: Full fetch complete (58348 records). [2025-09-15T18:48:41.066440] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-15T18:48:41.267458] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-15T18:48:41.455335] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-15T18:48:41.455544] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-15T18:48:41.456502] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-15T18:48:41.463033] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-15T18:48:41.475442] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:48:41.483109] [DEBUG] [LOCAL ] HL: Trimmed 58348 records to 39637 (keeping 150 days of data) [2025-09-15T18:48:41.735950] [DEBUG] [LOCAL ] HL: Primary data saved (39637 records). [2025-09-15T18:48:41.736114] [INFO ] [MAIN ] HL: Full history saved. [2025-09-15T18:48:41.736840] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HL took 34.2s. Estimated remaining: 2h 22m 12s. Rate: 9.4 symbols/min [2025-09-15T18:48:41.919462] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:41.962702] [DEBUG] [LOCAL ] HLN: Loaded 39960 existing records from primary storage. [2025-09-15T18:48:41.962891] [INFO ] [MAIN ] HLN: Loaded 39960 existing records. [2025-09-15T18:48:42.061721] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-15T18:48:42.138198] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:42.138426] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-15T18:48:42.138470] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-15T18:48:42.139366] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-15T18:48:42.139418] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-15T18:48:42.491552] [INFO ] [REMOTE ] HLN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:42.507115] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:48:42.857880] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-15T18:48:43.463435] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:48:43.657931] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-15T18:48:44.386873] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T18:48:44.457895] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-15T18:48:44.583258] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T18:48:45.257936] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-15T18:48:45.632146] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T18:48:46.057928] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-15T18:48:46.361332] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:48:46.367014] [INFO ] [REMOTE ] HLF: Full fetch complete (53456 records). [2025-09-15T18:48:46.367174] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-15T18:48:46.754613] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-15T18:48:46.754726] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-15T18:48:46.755517] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-15T18:48:46.755561] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-15T18:48:46.756700] [DEBUG] [LOCAL ] HLF: Trimmed 53456 records to 36076 (keeping 150 days of data) [2025-09-15T18:48:46.858904] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-15T18:48:46.968750] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T18:48:47.001030] [DEBUG] [LOCAL ] HLF: Primary data saved (36076 records). [2025-09-15T18:48:47.001163] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-15T18:48:47.001257] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLF took 28.7s. Estimated remaining: 2h 22m 5s. Rate: 9.4 symbols/min [2025-09-15T18:48:47.168849] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:47.203876] [DEBUG] [LOCAL ] HLT: Loaded 37911 existing records from primary storage. [2025-09-15T18:48:47.204015] [INFO ] [MAIN ] HLT: Loaded 37911 existing records. [2025-09-15T18:48:47.379401] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:47.379673] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-15T18:48:47.379720] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-15T18:48:47.380570] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-15T18:48:47.380619] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-15T18:48:47.657848] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-15T18:48:47.736171] [INFO ] [REMOTE ] HLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:48.429017] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:48:48.457818] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-15T18:48:48.649709] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:48:49.257881] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-15T18:48:50.057869] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-15T18:48:50.143959] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:48:50.708713] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:48:50.857852] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-15T18:48:51.090370] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T18:48:51.093184] [INFO ] [REMOTE ] HLIO: Full fetch complete (29730 records). [2025-09-15T18:48:51.093267] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-15T18:48:51.458863] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-15T18:48:51.458946] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-15T18:48:51.459593] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-15T18:48:51.459655] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-15T18:48:51.460443] [DEBUG] [LOCAL ] HLIO: Trimmed 29730 records to 21669 (keeping 150 days of data) [2025-09-15T18:48:51.595579] [DEBUG] [LOCAL ] HLIO: Primary data saved (21669 records). [2025-09-15T18:48:51.595734] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-15T18:48:51.595822] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLIO took 25.6s. Estimated remaining: 2h 21m 56s. Rate: 9.4 symbols/min [2025-09-15T18:48:51.663095] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-15T18:48:51.770051] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:51.808451] [DEBUG] [LOCAL ] HLX: Loaded 35929 existing records from primary storage. [2025-09-15T18:48:51.808627] [INFO ] [MAIN ] HLX: Loaded 35929 existing records. [2025-09-15T18:48:51.982576] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:51.982852] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-15T18:48:51.982899] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-15T18:48:51.983623] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-15T18:48:51.983702] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-15T18:48:52.354263] [INFO ] [REMOTE ] HLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:52.457966] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-15T18:48:52.464190] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:48:53.033718] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:48:53.257875] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-15T18:48:54.000289] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:48:54.057823] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-15T18:48:54.352957] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:48:54.857895] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-15T18:48:55.516014] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:48:55.657913] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-15T18:48:56.457889] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-15T18:48:56.626242] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:48:57.146378] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:48:57.257862] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-15T18:48:57.281708] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:48:58.057862] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-15T18:48:58.671187] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T18:48:58.857921] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-15T18:48:59.122394] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:48:59.657943] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-15T18:49:00.006333] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:49:00.457937] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-15T18:49:00.733629] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:49:00.737927] [INFO ] [REMOTE ] HLLY: Full fetch complete (34894 records). [2025-09-15T18:49:00.738040] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-15T18:49:01.112675] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-15T18:49:01.112754] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-15T18:49:01.113355] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-15T18:49:01.113394] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-15T18:49:01.114181] [DEBUG] [LOCAL ] HLLY: Trimmed 34894 records to 24451 (keeping 150 days of data) [2025-09-15T18:49:01.252162] [DEBUG] [LOCAL ] HLLY: Primary data saved (24451 records). [2025-09-15T18:49:01.252291] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-15T18:49:01.252372] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 25.5s. Estimated remaining: 2h 21m 54s. Rate: 9.4 symbols/min [2025-09-15T18:49:01.263434] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-15T18:49:01.428607] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:01.463857] [DEBUG] [LOCAL ] HMC: Loaded 34740 existing records from primary storage. [2025-09-15T18:49:01.463995] [INFO ] [MAIN ] HMC: Loaded 34740 existing records. [2025-09-15T18:49:01.646077] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:01.646475] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-15T18:49:01.646627] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-15T18:49:01.647521] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-15T18:49:01.647580] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-15T18:49:01.776553] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:49:02.062975] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-15T18:49:02.067094] [INFO ] [REMOTE ] HMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:02.857923] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-15T18:49:03.046996] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:49:03.657903] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-15T18:49:03.956418] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T18:49:04.417290] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:49:04.457878] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-15T18:49:05.257948] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-15T18:49:05.318510] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:49:05.878800] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:49:06.057862] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-15T18:49:06.857896] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-15T18:49:06.939443] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T18:49:07.363757] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:49:07.657889] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-15T18:49:08.425189] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:49:08.457850] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-15T18:49:09.257370] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:49:09.267608] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-15T18:49:10.054107] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:49:10.059431] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-15T18:49:10.061039] [INFO ] [REMOTE ] HLN: Full fetch complete (57683 records). [2025-09-15T18:49:10.061133] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-15T18:49:10.447738] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-15T18:49:10.447833] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-15T18:49:10.448672] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-15T18:49:10.448731] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-15T18:49:10.450038] [DEBUG] [LOCAL ] HLN: Trimmed 57683 records to 39179 (keeping 150 days of data) [2025-09-15T18:49:10.698544] [DEBUG] [LOCAL ] HLN: Primary data saved (39179 records). [2025-09-15T18:49:10.698702] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-15T18:49:10.699244] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLN took 29.0s. Estimated remaining: 2h 21m 52s. Rate: 9.4 symbols/min [2025-09-15T18:49:10.870817] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:10.868469] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-15T18:49:10.890635] [DEBUG] [LOCAL ] HMN: Loaded 18068 existing records from primary storage. [2025-09-15T18:49:10.890792] [INFO ] [MAIN ] HMN: Loaded 18068 existing records. [2025-09-15T18:49:11.068338] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:11.068809] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-15T18:49:11.068868] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-15T18:49:11.069394] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-15T18:49:11.069448] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-15T18:49:11.379881] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-15T18:49:11.465371] [INFO ] [REMOTE ] HMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:11.657833] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-15T18:49:11.735755] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:49:12.456328] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:49:12.460813] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-15T18:49:12.462102] [INFO ] [REMOTE ] HLX: Full fetch complete (52317 records). [2025-09-15T18:49:12.462222] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-15T18:49:12.774176] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:49:12.860305] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-15T18:49:12.860381] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-15T18:49:12.861128] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-15T18:49:12.861181] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-15T18:49:12.863597] [DEBUG] [LOCAL ] HLX: Trimmed 52317 records to 35148 (keeping 150 days of data) [2025-09-15T18:49:13.060137] [DEBUG] [LOCAL ] HLX: Primary data saved (35148 records). [2025-09-15T18:49:13.060270] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-15T18:49:13.060363] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 21.5s. Estimated remaining: 2h 21m 40s. Rate: 9.4 symbols/min [2025-09-15T18:49:13.230203] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:13.257887] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-15T18:49:13.272162] [DEBUG] [LOCAL ] HMY: Loaded 39927 existing records from primary storage. [2025-09-15T18:49:13.272318] [INFO ] [MAIN ] HMY: Loaded 39927 existing records. [2025-09-15T18:49:13.468115] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:13.468389] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-15T18:49:13.468434] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-15T18:49:13.469323] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-15T18:49:13.469381] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-15T18:49:13.824473] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:13.889746] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:49:14.057876] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-15T18:49:14.239255] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:49:14.857871] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-15T18:49:15.657950] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-15T18:49:15.853358] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:49:15.909510] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:49:16.457891] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-15T18:49:17.005698] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:49:17.257904] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-15T18:49:17.810319] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:49:17.815957] [INFO ] [REMOTE ] HLT: Full fetch complete (55243 records). [2025-09-15T18:49:17.816078] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-15T18:49:18.064601] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-15T18:49:18.200093] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-15T18:49:18.200171] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-15T18:49:18.201059] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-15T18:49:18.201112] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-15T18:49:18.204025] [DEBUG] [LOCAL ] HLT: Trimmed 55243 records to 37122 (keeping 150 days of data) [2025-09-15T18:49:18.439191] [DEBUG] [LOCAL ] HLT: Primary data saved (37122 records). [2025-09-15T18:49:18.439331] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-15T18:49:18.439449] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLT took 31.4s. Estimated remaining: 2h 21m 32s. Rate: 9.4 symbols/min [2025-09-15T18:49:18.608284] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:18.608487] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-15T18:49:18.608527] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-15T18:49:18.608679] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-15T18:49:18.608722] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-15T18:49:18.608766] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-15T18:49:18.608801] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-15T18:49:18.858060] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-15T18:49:18.968680] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:18.999966] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:49:19.025054] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:49:19.657858] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-15T18:49:20.213588] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:49:20.457863] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-15T18:49:20.650446] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:20.650735] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-15T18:49:21.257910] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-15T18:49:21.851945] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T18:49:22.057866] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-15T18:49:22.205563] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:49:22.857869] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-15T18:49:23.657905] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-15T18:49:23.721065] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T18:49:23.850472] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:23.850826] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-15T18:49:23.998396] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:49:24.457861] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-15T18:49:25.093129] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T18:49:25.257870] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-15T18:49:26.057873] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-15T18:49:26.249710] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:26.250076] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-15T18:49:26.857872] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-15T18:49:27.073751] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T18:49:27.578837] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:49:27.581599] [INFO ] [REMOTE ] HMN: Full fetch complete (24846 records). [2025-09-15T18:49:27.581700] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-15T18:49:27.662926] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-15T18:49:27.984950] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-15T18:49:27.985044] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-15T18:49:27.985702] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-15T18:49:27.985758] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-15T18:49:27.986578] [DEBUG] [LOCAL ] HMN: Trimmed 24846 records to 17769 (keeping 150 days of data) [2025-09-15T18:49:28.101081] [DEBUG] [LOCAL ] HMN: Primary data saved (17769 records). [2025-09-15T18:49:28.101243] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-15T18:49:28.101365] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HMN took 17.4s. Estimated remaining: 2h 21m 30s. Rate: 9.4 symbols/min [2025-09-15T18:49:28.273743] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:28.295726] [DEBUG] [LOCAL ] HNI: Loaded 21400 existing records from primary storage. [2025-09-15T18:49:28.295858] [INFO ] [MAIN ] HNI: Loaded 21400 existing records. [2025-09-15T18:49:28.466339] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-15T18:49:28.490323] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:28.490679] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-15T18:49:28.490736] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-15T18:49:28.491538] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-15T18:49:28.491635] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-15T18:49:28.882201] [INFO ] [REMOTE ] HNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:29.257938] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-15T18:49:29.543142] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:49:29.819787] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:49:30.057924] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-15T18:49:30.177533] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:49:30.857891] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-15T18:49:31.513987] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:49:31.519985] [INFO ] [REMOTE ] HMC: Full fetch complete (51282 records). [2025-09-15T18:49:31.520174] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-15T18:49:31.665370] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-15T18:49:31.906451] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-15T18:49:31.906532] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-15T18:49:31.907286] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-15T18:49:31.907331] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-15T18:49:31.908445] [DEBUG] [LOCAL ] HMC: Trimmed 51282 records to 33997 (keeping 150 days of data) [2025-09-15T18:49:32.153151] [DEBUG] [LOCAL ] HMC: Primary data saved (33997 records). [2025-09-15T18:49:32.153325] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-15T18:49:32.153417] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMC took 30.9s. Estimated remaining: 2h 21m 21s. Rate: 9.4 symbols/min [2025-09-15T18:49:32.330425] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:49:32.375245] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:32.419572] [DEBUG] [LOCAL ] HOG: Loaded 38253 existing records from primary storage. [2025-09-15T18:49:32.419806] [INFO ] [MAIN ] HOG: Loaded 38253 existing records. [2025-09-15T18:49:32.463491] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-15T18:49:32.612103] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:32.612397] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-15T18:49:32.612524] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-15T18:49:32.619503] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-15T18:49:32.620901] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-15T18:49:32.626844] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:49:33.008515] [INFO ] [REMOTE ] HOG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:33.257903] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-15T18:49:34.057867] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-15T18:49:34.118337] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:49:34.388118] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:49:34.857878] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-15T18:49:35.623714] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:49:35.657838] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-15T18:49:36.457886] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-15T18:49:36.514551] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:49:37.015226] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:49:37.257846] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-15T18:49:37.577849] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T18:49:38.057878] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-15T18:49:38.490256] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:49:38.857884] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-15T18:49:39.082750] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:49:39.657868] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-15T18:49:40.088105] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:49:40.094666] [INFO ] [REMOTE ] HNGE: Full fetch complete (23933 records). [2025-09-15T18:49:40.094808] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-15T18:49:40.289933] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 79 unique days, need 150 days [2025-09-15T18:49:40.290362] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:49:40.290425] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:49:40.290476] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-15T18:49:40.290563] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-15T18:49:40.290616] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-15T18:49:40.290704] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-15T18:49:40.290802] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HNGE took 21.9s. Estimated remaining: 2h 21m 17s. Rate: 9.4 symbols/min [2025-09-15T18:49:40.466320] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-15T18:49:40.469387] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:40.507292] [DEBUG] [LOCAL ] HOMB: Loaded 32060 existing records from primary storage. [2025-09-15T18:49:40.507541] [INFO ] [MAIN ] HOMB: Loaded 32060 existing records. [2025-09-15T18:49:40.686068] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:40.686391] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-15T18:49:40.686615] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-15T18:49:40.693175] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-15T18:49:40.700122] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-15T18:49:40.734443] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T18:49:41.063002] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:41.257885] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-15T18:49:42.057936] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-15T18:49:42.425655] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T18:49:42.611077] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:49:42.857887] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-15T18:49:43.509857] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:49:43.657865] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-15T18:49:44.457863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-15T18:49:44.745704] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:49:44.751682] [INFO ] [REMOTE ] HMY: Full fetch complete (57767 records). [2025-09-15T18:49:44.751827] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-15T18:49:45.163847] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-15T18:49:45.164120] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-15T18:49:45.180051] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-15T18:49:45.189517] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-15T18:49:45.191865] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:49:45.201851] [DEBUG] [LOCAL ] HMY: Trimmed 57767 records to 39146 (keeping 150 days of data) [2025-09-15T18:49:45.262943] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-15T18:49:45.449098] [DEBUG] [LOCAL ] HMY: Primary data saved (39146 records). [2025-09-15T18:49:45.449246] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-15T18:49:45.449332] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMY took 32.4s. Estimated remaining: 2h 21m 9s. Rate: 9.4 symbols/min [2025-09-15T18:49:45.619113] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:45.650083] [DEBUG] [LOCAL ] HOUS: Loaded 33145 existing records from primary storage. [2025-09-15T18:49:45.650219] [INFO ] [MAIN ] HOUS: Loaded 33145 existing records. [2025-09-15T18:49:45.826716] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:45.826942] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-15T18:49:45.826986] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-15T18:49:45.827818] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-15T18:49:45.827882] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-15T18:49:46.063867] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-15T18:49:46.179173] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:46.219911] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:49:46.746026] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:49:46.750612] [INFO ] [REMOTE ] HNI: Full fetch complete (31256 records). [2025-09-15T18:49:46.750740] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-15T18:49:46.863094] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-15T18:49:47.125801] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-15T18:49:47.125886] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-15T18:49:47.126526] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-15T18:49:47.126568] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-15T18:49:47.127362] [DEBUG] [LOCAL ] HNI: Trimmed 31256 records to 21203 (keeping 150 days of data) [2025-09-15T18:49:47.262706] [DEBUG] [LOCAL ] HNI: Primary data saved (21203 records). [2025-09-15T18:49:47.262859] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-15T18:49:47.263098] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 19.2s. Estimated remaining: 2h 20m 57s. Rate: 9.5 symbols/min [2025-09-15T18:49:47.291472] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:49:47.657901] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-15T18:49:48.280542] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:49:48.457861] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-15T18:49:48.745605] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:49:49.257898] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-15T18:49:49.920311] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:49:50.057866] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-15T18:49:50.493706] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:49:50.857889] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-15T18:49:51.657932] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-15T18:49:51.727118] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:49:52.005565] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:49:52.457881] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-15T18:49:52.675584] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:49:53.257915] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-15T18:49:54.036508] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:49:54.057857] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-15T18:49:54.586257] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:49:54.857885] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-15T18:49:55.657947] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-15T18:49:55.774853] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:49:55.951960] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:49:56.457918] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-15T18:49:57.149087] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:49:57.257897] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-15T18:49:58.057983] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-15T18:49:58.178286] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:49:58.346697] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T18:49:58.857893] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-15T18:49:59.209540] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:49:59.214447] [INFO ] [REMOTE ] HOMB: Full fetch complete (47578 records). [2025-09-15T18:49:59.214544] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-15T18:49:59.598991] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-15T18:49:59.599097] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-15T18:49:59.599818] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-15T18:49:59.599865] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-15T18:49:59.601064] [DEBUG] [LOCAL ] HOMB: Trimmed 47578 records to 31393 (keeping 150 days of data) [2025-09-15T18:49:59.659578] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-15T18:49:59.808052] [DEBUG] [LOCAL ] HOMB: Primary data saved (31393 records). [2025-09-15T18:49:59.808200] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-15T18:49:59.808289] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOMB took 19.5s. Estimated remaining: 2h 20m 58s. Rate: 9.4 symbols/min [2025-09-15T18:50:00.073470] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:50:00.457904] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-15T18:50:01.398825] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:50:01.404893] [INFO ] [REMOTE ] HOG: Full fetch complete (55938 records). [2025-09-15T18:50:01.405094] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-15T18:50:01.902750] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-15T18:50:01.902867] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-15T18:50:01.903902] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-15T18:50:01.903983] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-15T18:50:01.905462] [DEBUG] [LOCAL ] HOG: Trimmed 55938 records to 37469 (keeping 150 days of data) [2025-09-15T18:50:02.201134] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:50:02.214601] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-15T18:50:02.221437] [DEBUG] [LOCAL ] HOG: Primary data saved (37469 records). [2025-09-15T18:50:02.221619] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-15T18:50:02.221745] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOG took 30.1s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-15T18:50:04.370800] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-15T18:50:04.376169] [INFO ] [REMOTE ] HOUS: Full fetch complete (47526 records). [2025-09-15T18:50:04.376326] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-15T18:50:04.760829] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-15T18:50:04.760918] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-15T18:50:04.761714] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-15T18:50:04.761764] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-15T18:50:04.762896] [DEBUG] [LOCAL ] HOUS: Trimmed 47526 records to 32545 (keeping 150 days of data) [2025-09-15T18:50:04.946251] [DEBUG] [LOCAL ] HOUS: Primary data saved (32545 records). [2025-09-15T18:50:04.946394] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-15T18:50:04.946504] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 19.5s. Estimated remaining: 2h 20m 36s. Rate: 9.5 symbols/min [2025-09-15T18:50:05.612635] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.611668] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.660801] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.657811] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.670681] [DEBUG] [LOCAL ] HPF: Loaded 5597 existing records from primary storage. [2025-09-15T18:50:05.673164] [INFO ] [MAIN ] HPF: Loaded 5597 existing records. [2025-09-15T18:50:05.760684] [DEBUG] [LOCAL ] HOV: Loaded 10650 existing records from primary storage. [2025-09-15T18:50:05.792135] [INFO ] [MAIN ] HOV: Loaded 10650 existing records. [2025-09-15T18:50:06.003424] [DEBUG] [LOCAL ] HP: Loaded 39084 existing records from primary storage. [2025-09-15T18:50:06.002742] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.003959] [INFO ] [MAIN ] HP: Loaded 39084 existing records. [2025-09-15T18:50:06.058544] [DEBUG] [LOCAL ] HPE: Loaded 40437 existing records from primary storage. [2025-09-15T18:50:06.036408] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.087743] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-15T18:50:06.139987] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.129966] [INFO ] [MAIN ] HPE: Loaded 40437 existing records. [2025-09-15T18:50:06.187259] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.190379] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-15T18:50:06.200772] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-15T18:50:06.242816] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-15T18:50:06.268526] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-15T18:50:06.346615] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-15T18:50:06.537779] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.629801] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.640456] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-15T18:50:06.757482] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-15T18:50:06.731173] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.781610] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.795355] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-15T18:50:06.795400] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-15T18:50:06.870455] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-15T18:50:06.981704] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-15T18:50:07.371659] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.531407] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-15T18:50:07.646855] [INFO ] [REMOTE ] HOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.688589] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-15T18:50:07.901954] [INFO ] [REMOTE ] HP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.951505] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-15T18:50:07.951269] [INFO ] [REMOTE ] HPE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.952458] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-15T18:50:08.398995] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T18:50:08.400887] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-15T18:50:08.605493] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:50:08.608373] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-15T18:50:08.822843] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T18:50:08.824734] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-15T18:50:09.355420] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:50:09.365304] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-15T18:50:09.423735] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:50:09.427132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-15T18:50:09.661940] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:50:09.664079] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-15T18:50:09.716863] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:50:10.057902] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-15T18:50:10.308532] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T18:50:10.356171] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T18:50:10.857900] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-15T18:50:11.047504] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:50:11.464865] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T18:50:11.631200] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:50:11.657847] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-15T18:50:12.457899] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-15T18:50:12.927347] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:50:13.257834] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-15T18:50:13.754036] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T18:50:14.021235] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:50:14.057831] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-15T18:50:14.857878] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-15T18:50:15.647761] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:50:15.658274] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-15T18:50:15.769654] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T18:50:16.457889] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-15T18:50:17.257880] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-15T18:50:17.596768] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:50:18.057928] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-15T18:50:18.607547] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:50:18.857879] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-15T18:50:19.454037] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-15T18:50:19.455535] [INFO ] [REMOTE ] HPF: Full fetch complete (7710 records). [2025-09-15T18:50:19.455606] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-15T18:50:19.671477] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-15T18:50:19.825234] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-15T18:50:19.825315] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-15T18:50:19.825559] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-15T18:50:19.825599] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-15T18:50:19.826045] [DEBUG] [LOCAL ] HPF: Trimmed 7710 records to 5553 (keeping 150 days of data) [2025-09-15T18:50:19.862893] [DEBUG] [LOCAL ] HPF: Primary data saved (5553 records). [2025-09-15T18:50:19.863033] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-15T18:50:19.863133] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 14.9s. Estimated remaining: 2h 20m 41s. Rate: 9.4 symbols/min [2025-09-15T18:50:20.042735] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:20.051551] [DEBUG] [LOCAL ] HPI: Loaded 7619 existing records from primary storage. [2025-09-15T18:50:20.051638] [INFO ] [MAIN ] HPI: Loaded 7619 existing records. [2025-09-15T18:50:20.236512] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:20.236940] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-15T18:50:20.237022] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-15T18:50:20.237420] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-15T18:50:20.237555] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-15T18:50:20.513099] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-15T18:50:20.557145] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-15T18:50:20.634747] [INFO ] [REMOTE ] HPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:20.649434] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:50:21.257871] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-15T18:50:21.506411] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:50:22.057828] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-15T18:50:22.133319] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:50:22.235571] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T18:50:22.857872] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-15T18:50:23.657859] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-15T18:50:23.754514] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:50:23.756036] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T18:50:24.450908] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:50:24.452746] [INFO ] [REMOTE ] HOV: Full fetch complete (14791 records). [2025-09-15T18:50:24.452818] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-15T18:50:24.464020] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-15T18:50:24.839110] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-15T18:50:24.839229] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-15T18:50:24.839684] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-15T18:50:24.839745] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-15T18:50:24.840321] [DEBUG] [LOCAL ] HOV: Trimmed 14791 records to 10490 (keeping 150 days of data) [2025-09-15T18:50:24.906118] [DEBUG] [LOCAL ] HOV: Primary data saved (10490 records). [2025-09-15T18:50:24.906278] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-15T18:50:24.906369] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 20.0s. Estimated remaining: 2h 20m 33s. Rate: 9.4 symbols/min [2025-09-15T18:50:25.111331] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:25.147323] [DEBUG] [LOCAL ] HPP: Loaded 38521 existing records from primary storage. [2025-09-15T18:50:25.147475] [INFO ] [MAIN ] HPP: Loaded 38521 existing records. [2025-09-15T18:50:25.257858] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-15T18:50:25.367523] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:25.373891] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:50:25.377576] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-15T18:50:25.377687] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-15T18:50:25.378600] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-15T18:50:25.378833] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-15T18:50:25.743995] [INFO ] [REMOTE ] HPP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:26.057901] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-15T18:50:26.751089] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T18:50:26.857881] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-15T18:50:27.223727] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:50:27.647592] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:50:27.657849] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-15T18:50:28.375564] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:50:28.457884] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-15T18:50:29.257927] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-15T18:50:30.057951] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-15T18:50:30.358739] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T18:50:30.365131] [INFO ] [REMOTE ] HPE: Full fetch complete (58377 records). [2025-09-15T18:50:30.365274] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-15T18:50:30.752249] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-15T18:50:30.752346] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-15T18:50:30.753261] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-15T18:50:30.753331] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-15T18:50:30.754737] [DEBUG] [LOCAL ] HPE: Trimmed 58377 records to 39657 (keeping 150 days of data) [2025-09-15T18:50:30.857901] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-15T18:50:31.007707] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:50:31.038384] [DEBUG] [LOCAL ] HPE: Primary data saved (39657 records). [2025-09-15T18:50:31.038537] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-15T18:50:31.038633] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPE took 26.1s. Estimated remaining: 2h 20m 26s. Rate: 9.4 symbols/min [2025-09-15T18:50:31.212103] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:31.249757] [DEBUG] [LOCAL ] HPQ: Loaded 40412 existing records from primary storage. [2025-09-15T18:50:31.249924] [INFO ] [MAIN ] HPQ: Loaded 40412 existing records. [2025-09-15T18:50:31.432142] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:31.432568] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-15T18:50:31.432730] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-15T18:50:31.439588] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-15T18:50:31.440553] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-15T18:50:31.440511] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:50:31.663345] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-15T18:50:31.806091] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:31.843795] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:50:32.457878] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-15T18:50:33.257877] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-15T18:50:33.272071] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:50:33.340050] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:50:34.057869] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-15T18:50:34.659249] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:50:34.661597] [INFO ] [REMOTE ] HPI: Full fetch complete (10181 records). [2025-09-15T18:50:34.661696] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-15T18:50:34.861533] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-15T18:50:34.992865] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:50:35.090903] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-15T18:50:35.091038] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-15T18:50:35.091515] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-15T18:50:35.091565] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-15T18:50:35.092125] [DEBUG] [LOCAL ] HPI: Trimmed 10181 records to 7603 (keeping 150 days of data) [2025-09-15T18:50:35.144496] [DEBUG] [LOCAL ] HPI: Primary data saved (7603 records). [2025-09-15T18:50:35.144781] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-15T18:50:35.144920] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 15.3s. Estimated remaining: 2h 20m 17s. Rate: 9.4 symbols/min [2025-09-15T18:50:35.320396] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:35.331043] [DEBUG] [LOCAL ] HPS: Loaded 7697 existing records from primary storage. [2025-09-15T18:50:35.331220] [INFO ] [MAIN ] HPS: Loaded 7697 existing records. [2025-09-15T18:50:35.521062] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:35.521477] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-15T18:50:35.521533] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-15T18:50:35.521959] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-15T18:50:35.522019] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-15T18:50:35.666912] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-15T18:50:35.886769] [INFO ] [REMOTE ] HPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:36.378144] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:50:36.457899] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-15T18:50:37.257857] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-15T18:50:37.485173] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:50:37.640894] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T18:50:38.057881] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-15T18:50:38.582561] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:50:38.857875] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-15T18:50:39.657923] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-15T18:50:39.981382] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:50:40.420980] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:50:40.438346] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T18:50:40.457839] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-15T18:50:41.257890] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-15T18:50:41.999054] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:50:42.057864] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-15T18:50:42.857898] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-15T18:50:43.165634] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T18:50:43.309847] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T18:50:43.576839] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:50:43.657829] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-15T18:50:44.457902] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-15T18:50:45.261715] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-15T18:50:45.273171] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:50:45.859302] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:50:46.057947] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-15T18:50:46.837032] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:50:46.843451] [INFO ] [REMOTE ] HP: Full fetch complete (56271 records). [2025-09-15T18:50:46.843719] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-15T18:50:46.868185] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-15T18:50:47.264497] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-15T18:50:47.264629] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-15T18:50:47.265472] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-15T18:50:47.265536] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-15T18:50:47.281485] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:50:47.287466] [DEBUG] [LOCAL ] HP: Trimmed 56271 records to 38311 (keeping 150 days of data) [2025-09-15T18:50:47.287594] [INFO ] [REMOTE ] HPP: Full fetch complete (54547 records). [2025-09-15T18:50:47.288200] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-15T18:50:47.289340] [FATAL] [VALIDATOR ] HPP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:50:47.289427] [FATAL] [MAIN ] HPP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:50:47.289488] [WARN ] [MAIN ] HPP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:50:47.289531] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-15T18:50:47.289593] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-09-15T18:50:47.289664] [INFO ] [LOCAL ] HPP: Starting deletion of derivative data. [2025-09-15T18:50:47.290061] [DEBUG] [LOCAL ] HPP: Deleted derivative data file. [2025-09-15T18:50:47.291095] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPP took 22.4s. Estimated remaining: 2h 20m 18s. Rate: 9.4 symbols/min [2025-09-15T18:50:47.574455] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:47.607325] [DEBUG] [LOCAL ] HQH: Loaded 18918 existing records from primary storage. [2025-09-15T18:50:47.608098] [INFO ] [MAIN ] HQH: Loaded 18918 existing records. [2025-09-15T18:50:47.666568] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-15T18:50:47.802901] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:47.803748] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-15T18:50:47.804112] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-15T18:50:47.805212] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-15T18:50:47.805553] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-15T18:50:48.267755] [INFO ] [REMOTE ] HQH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:48.290436] [DEBUG] [LOCAL ] HP: Primary data saved (38311 records). [2025-09-15T18:50:48.290591] [INFO ] [MAIN ] HP: Full history saved. [2025-09-15T18:50:48.290722] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HP took 43.3s. Estimated remaining: 2h 20m 5s. Rate: 9.4 symbols/min [2025-09-15T18:50:48.459241] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:48.459328] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-15T18:50:48.467085] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:50:48.479704] [DEBUG] [LOCAL ] HQL: Loaded 11831 existing records from primary storage. [2025-09-15T18:50:48.479820] [INFO ] [MAIN ] HQL: Loaded 11831 existing records. [2025-09-15T18:50:48.655717] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:48.656117] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-15T18:50:48.656202] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-15T18:50:48.656573] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-15T18:50:48.656622] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-15T18:50:48.980066] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T18:50:49.057789] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:49.257912] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-15T18:50:49.458963] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:50:50.057937] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-15T18:50:50.657220] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:50:50.857876] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-15T18:50:50.986708] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T18:50:51.657885] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-15T18:50:51.798052] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:50:52.322353] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T18:50:52.457850] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-15T18:50:52.913727] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T18:50:53.257869] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-15T18:50:53.973838] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:50:53.975483] [INFO ] [REMOTE ] HPS: Full fetch complete (11403 records). [2025-09-15T18:50:53.975579] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-15T18:50:54.062998] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-15T18:50:54.368954] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-15T18:50:54.369032] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-15T18:50:54.369328] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-15T18:50:54.369368] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-15T18:50:54.369853] [DEBUG] [LOCAL ] HPS: Trimmed 11403 records to 7654 (keeping 150 days of data) [2025-09-15T18:50:54.416396] [DEBUG] [LOCAL ] HPS: Primary data saved (7654 records). [2025-09-15T18:50:54.416510] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-15T18:50:54.416591] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPS took 19.3s. Estimated remaining: 2h 19m 58s. Rate: 9.4 symbols/min [2025-09-15T18:50:54.583447] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:54.622848] [DEBUG] [LOCAL ] HR: Loaded 39162 existing records from primary storage. [2025-09-15T18:50:54.622992] [INFO ] [MAIN ] HR: Loaded 39162 existing records. [2025-09-15T18:50:54.802679] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:54.802933] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-15T18:50:54.802979] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-15T18:50:54.803890] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-15T18:50:54.803991] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-15T18:50:54.864849] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-15T18:50:54.918949] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T18:50:55.181887] [INFO ] [REMOTE ] HR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:55.657899] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-15T18:50:56.457911] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-15T18:50:56.568064] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:50:56.574345] [INFO ] [REMOTE ] HPQ: Full fetch complete (58348 records). [2025-09-15T18:50:56.574490] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-15T18:50:56.903947] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:50:56.985255] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-15T18:50:56.985343] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-15T18:50:56.986193] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-15T18:50:56.986243] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-15T18:50:56.987625] [DEBUG] [LOCAL ] HPQ: Trimmed 58348 records to 39632 (keeping 150 days of data) [2025-09-15T18:50:57.192917] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T18:50:57.256385] [DEBUG] [LOCAL ] HPQ: Primary data saved (39632 records). [2025-09-15T18:50:57.256525] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-15T18:50:57.258318] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPQ took 26.2s. Estimated remaining: 2h 19m 47s. Rate: 9.5 symbols/min [2025-09-15T18:50:57.258371] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-15T18:50:57.435730] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:57.475093] [DEBUG] [LOCAL ] HRB: Loaded 36481 existing records from primary storage. [2025-09-15T18:50:57.475274] [INFO ] [MAIN ] HRB: Loaded 36481 existing records. [2025-09-15T18:50:57.655607] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:57.655890] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-15T18:50:57.655940] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-15T18:50:57.656632] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-15T18:50:57.656734] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-15T18:50:58.017267] [INFO ] [REMOTE ] HRB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:58.057858] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-15T18:50:58.307370] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:50:58.857870] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-15T18:50:59.489529] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:50:59.657869] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-15T18:50:59.733788] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:51:00.457921] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-15T18:51:00.964611] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:51:01.257896] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-15T18:51:02.057944] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-15T18:51:02.108315] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:51:02.857887] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-15T18:51:03.581422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-15T18:51:03.657828] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-15T18:51:03.847108] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:51:04.457925] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-15T18:51:05.071720] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:51:05.257893] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-15T18:51:05.451089] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (3.39 seconds). [2025-09-15T18:51:05.607738] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:51:06.057915] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-15T18:51:06.515922] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:51:06.858064] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-15T18:51:06.857966] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:51:07.657934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-15T18:51:07.823795] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T18:51:08.457907] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-15T18:51:09.218044] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:51:09.257886] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-15T18:51:09.645008] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T18:51:10.057919] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-15T18:51:10.473817] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:51:10.857890] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-15T18:51:11.405128] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:51:11.657831] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-15T18:51:11.815306] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:51:12.457920] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-15T18:51:13.257877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-15T18:51:13.735589] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T18:51:13.769030] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:51:13.773028] [INFO ] [REMOTE ] HQH: Full fetch complete (27214 records). [2025-09-15T18:51:13.773167] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-15T18:51:14.065696] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-15T18:51:14.157748] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-15T18:51:14.157834] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-15T18:51:14.158469] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-15T18:51:14.158520] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-15T18:51:14.159748] [DEBUG] [LOCAL ] HQH: Trimmed 27214 records to 18689 (keeping 150 days of data) [2025-09-15T18:51:14.277906] [DEBUG] [LOCAL ] HQH: Primary data saved (18689 records). [2025-09-15T18:51:14.278062] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-15T18:51:14.278172] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 27.0s. Estimated remaining: 2h 19m 54s. Rate: 9.4 symbols/min [2025-09-15T18:51:14.454440] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:14.484518] [DEBUG] [LOCAL ] HRI: Loaded 24307 existing records from primary storage. [2025-09-15T18:51:14.484730] [INFO ] [MAIN ] HRI: Loaded 24307 existing records. [2025-09-15T18:51:14.663109] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:14.663388] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-15T18:51:14.663435] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-15T18:51:14.664136] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-15T18:51:14.664193] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-15T18:51:14.881285] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-15T18:51:15.033738] [INFO ] [REMOTE ] HRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:15.234303] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-15T18:51:15.236418] [INFO ] [REMOTE ] HQL: Full fetch complete (17889 records). [2025-09-15T18:51:15.236497] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-15T18:51:15.604276] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-15T18:51:15.604360] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-15T18:51:15.604770] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-15T18:51:15.604814] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-15T18:51:15.605437] [DEBUG] [LOCAL ] HQL: Trimmed 17889 records to 11683 (keeping 150 days of data) [2025-09-15T18:51:15.665101] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-15T18:51:15.688530] [DEBUG] [LOCAL ] HQL: Primary data saved (11683 records). [2025-09-15T18:51:15.688717] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-15T18:51:15.688863] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 27.4s. Estimated remaining: 2h 19m 42s. Rate: 9.4 symbols/min [2025-09-15T18:51:15.873232] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:15.923488] [DEBUG] [LOCAL ] HRL: Loaded 39940 existing records from primary storage. [2025-09-15T18:51:15.923724] [INFO ] [MAIN ] HRL: Loaded 39940 existing records. [2025-09-15T18:51:16.108845] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:16.109189] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-15T18:51:16.109239] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-15T18:51:16.110111] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-15T18:51:16.110176] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-15T18:51:16.494249] [INFO ] [REMOTE ] HRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:16.494745] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-15T18:51:16.530554] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-15T18:51:16.658694] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:51:16.713662] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:51:17.257879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-15T18:51:17.812890] [DEBUG] [REMOTE ] HRL: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-15T18:51:17.813052] [WARN ] [REMOTE ] HRL: No data returned for month 2025-02 [2025-09-15T18:51:18.057901] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-15T18:51:18.426067] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:51:18.432410] [INFO ] [REMOTE ] HRB: Full fetch complete (52876 records). [2025-09-15T18:51:18.432541] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-15T18:51:18.825327] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-15T18:51:18.825414] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-15T18:51:18.826320] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-15T18:51:18.826390] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-15T18:51:18.828228] [DEBUG] [LOCAL ] HRB: Trimmed 52876 records to 35716 (keeping 150 days of data) [2025-09-15T18:51:18.892632] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-15T18:51:19.066823] [DEBUG] [LOCAL ] HRB: Primary data saved (35716 records). [2025-09-15T18:51:19.066975] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-15T18:51:19.068154] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HRB took 21.8s. Estimated remaining: 2h 19m 32s. Rate: 9.4 symbols/min [2025-09-15T18:51:19.243455] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:19.272633] [DEBUG] [LOCAL ] HRTG: Loaded 25534 existing records from primary storage. [2025-09-15T18:51:19.272789] [INFO ] [MAIN ] HRTG: Loaded 25534 existing records. [2025-09-15T18:51:19.461269] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:19.461771] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-15T18:51:19.461919] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-15T18:51:19.462554] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-15T18:51:19.462603] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-15T18:51:19.665349] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-15T18:51:19.741494] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:51:19.854006] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:20.457905] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-15T18:51:20.550860] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:51:21.257877] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-15T18:51:21.462260] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:51:21.534592] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:51:22.057883] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-15T18:51:22.156261] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T18:51:22.857894] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-15T18:51:23.291802] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:51:23.657884] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-15T18:51:23.700552] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:51:24.457892] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-15T18:51:24.545414] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:51:25.257870] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-15T18:51:26.057894] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-15T18:51:26.204935] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:51:26.368545] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:51:26.857886] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-15T18:51:27.662986] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-15T18:51:27.686853] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T18:51:28.325743] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:51:28.332988] [INFO ] [REMOTE ] HR: Full fetch complete (56347 records). [2025-09-15T18:51:28.333116] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-15T18:51:28.462982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-15T18:51:28.715332] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-15T18:51:28.715488] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-15T18:51:28.716287] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-15T18:51:28.716344] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-15T18:51:28.717690] [DEBUG] [LOCAL ] HR: Trimmed 56347 records to 38391 (keeping 150 days of data) [2025-09-15T18:51:28.865160] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:51:29.003191] [DEBUG] [LOCAL ] HR: Primary data saved (38391 records). [2025-09-15T18:51:29.003348] [INFO ] [MAIN ] HR: Full history saved. [2025-09-15T18:51:29.003449] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HR took 34.6s. Estimated remaining: 2h 19m 30s. Rate: 9.4 symbols/min [2025-09-15T18:51:29.225910] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:29.265175] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-15T18:51:29.268114] [DEBUG] [LOCAL ] HSBC: Loaded 38237 existing records from primary storage. [2025-09-15T18:51:29.268347] [INFO ] [MAIN ] HSBC: Loaded 38237 existing records. [2025-09-15T18:51:29.454038] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:29.454303] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-15T18:51:29.454355] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-15T18:51:29.455179] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-15T18:51:29.455234] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-15T18:51:29.827552] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:30.057880] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-15T18:51:30.211833] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:51:30.215285] [INFO ] [REMOTE ] HRI: Full fetch complete (36667 records). [2025-09-15T18:51:30.215358] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-15T18:51:30.586124] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-15T18:51:30.586202] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-15T18:51:30.586861] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-15T18:51:30.586905] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-15T18:51:30.587954] [DEBUG] [LOCAL ] HRI: Trimmed 36667 records to 23844 (keeping 150 days of data) [2025-09-15T18:51:30.722836] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-15T18:51:30.787162] [DEBUG] [LOCAL ] HRI: Primary data saved (23844 records). [2025-09-15T18:51:30.787307] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-15T18:51:30.787432] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 16.5s. Estimated remaining: 2h 19m 18s. Rate: 9.4 symbols/min [2025-09-15T18:51:30.863000] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-15T18:51:30.962301] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:30.975349] [DEBUG] [LOCAL ] HSHP: Loaded 10277 existing records from primary storage. [2025-09-15T18:51:30.975519] [INFO ] [MAIN ] HSHP: Loaded 10277 existing records. [2025-09-15T18:51:31.157358] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:31.157677] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-15T18:51:31.157726] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-15T18:51:31.158108] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-15T18:51:31.158154] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-15T18:51:31.507508] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:31.668600] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-15T18:51:31.671446] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T18:51:32.457877] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-15T18:51:32.638739] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:51:32.696877] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T18:51:33.257883] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-15T18:51:34.057862] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-15T18:51:34.312943] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T18:51:34.390417] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:51:34.857862] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-15T18:51:35.533842] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:51:35.657876] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-15T18:51:36.408009] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:51:36.457826] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-15T18:51:37.257849] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-15T18:51:37.334288] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:51:37.781816] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:51:37.829496] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:51:38.057893] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-15T18:51:38.857927] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-15T18:51:39.050280] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:51:39.657888] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-15T18:51:40.457894] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-15T18:51:40.810342] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T18:51:40.816726] [INFO ] [REMOTE ] HRL: Full fetch complete (52309 records). [2025-09-15T18:51:40.816958] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-15T18:51:41.015092] [WARN ] [VALIDATOR ] HRL: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T18:51:41.015890] [FATAL] [MAIN ] HRL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:51:41.025349] [WARN ] [MAIN ] HRL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:51:41.038420] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-15T18:51:41.041235] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-09-15T18:51:41.041298] [INFO ] [LOCAL ] HRL: Starting deletion of derivative data. [2025-09-15T18:51:41.042900] [DEBUG] [LOCAL ] HRL: Deleted derivative data file. [2025-09-15T18:51:41.042833] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:51:41.043926] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 25.4s. Estimated remaining: 2h 19m 16s. Rate: 9.4 symbols/min [2025-09-15T18:51:41.232417] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:41.259869] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-15T18:51:41.277834] [DEBUG] [LOCAL ] HSY: Loaded 38032 existing records from primary storage. [2025-09-15T18:51:41.277989] [INFO ] [MAIN ] HSY: Loaded 38032 existing records. [2025-09-15T18:51:41.457986] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:41.458341] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-15T18:51:41.458504] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-15T18:51:41.459451] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-15T18:51:41.459507] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-15T18:51:41.648461] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:51:41.871528] [INFO ] [REMOTE ] HSY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:42.057881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-15T18:51:42.206170] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:51:42.857886] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-15T18:51:43.426765] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T18:51:43.450398] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:51:43.657868] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-15T18:51:44.457875] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-15T18:51:44.698732] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:51:45.257918] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-15T18:51:45.890623] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:51:45.993568] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:51:46.057839] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-15T18:51:46.857874] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-15T18:51:47.013611] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:51:47.657880] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-15T18:51:48.214842] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T18:51:48.344977] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:51:48.457846] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-15T18:51:49.182420] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:51:49.184460] [INFO ] [REMOTE ] HSHP: Full fetch complete (17510 records). [2025-09-15T18:51:49.184546] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-15T18:51:49.262999] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-15T18:51:49.560082] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-15T18:51:49.560166] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-15T18:51:49.560613] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-15T18:51:49.560688] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-15T18:51:49.561290] [DEBUG] [LOCAL ] HSHP: Trimmed 17510 records to 10106 (keeping 150 days of data) [2025-09-15T18:51:49.620655] [DEBUG] [LOCAL ] HSHP: Primary data saved (10106 records). [2025-09-15T18:51:49.620810] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-15T18:51:49.620901] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HSHP took 18.8s. Estimated remaining: 2h 19m 13s. Rate: 9.4 symbols/min [2025-09-15T18:51:49.789631] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:49.789843] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-15T18:51:49.789882] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-15T18:51:49.790006] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-15T18:51:49.790048] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-15T18:51:49.790112] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-15T18:51:49.790148] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-15T18:51:50.063122] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-15T18:51:50.142309] [INFO ] [REMOTE ] HTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:50.565226] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T18:51:50.568624] [INFO ] [REMOTE ] HRTG: Full fetch complete (33724 records). [2025-09-15T18:51:50.568722] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-15T18:51:50.863047] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-15T18:51:50.934829] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-15T18:51:50.935000] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-15T18:51:50.935604] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-15T18:51:50.935664] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-15T18:51:50.936495] [DEBUG] [LOCAL ] HRTG: Trimmed 33724 records to 25072 (keeping 150 days of data) [2025-09-15T18:51:51.090438] [DEBUG] [LOCAL ] HRTG: Primary data saved (25072 records). [2025-09-15T18:51:51.090576] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-15T18:51:51.090677] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HRTG took 32.0s. Estimated remaining: 2h 19m 0s. Rate: 9.4 symbols/min [2025-09-15T18:51:51.259662] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:51.270131] [DEBUG] [LOCAL ] HTD: Loaded 9986 existing records from primary storage. [2025-09-15T18:51:51.270234] [INFO ] [MAIN ] HTD: Loaded 9986 existing records. [2025-09-15T18:51:51.446074] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:51.446314] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-15T18:51:51.446359] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-15T18:51:51.446787] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-15T18:51:51.446839] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-15T18:51:51.662950] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-15T18:51:51.809011] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:51.881615] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T18:51:51.905609] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-15T18:51:52.457881] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-15T18:51:52.579941] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:51:53.257850] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-15T18:51:53.436472] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:51:54.057923] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-15T18:51:54.664074] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:51:54.669539] [INFO ] [REMOTE ] HSBC: Full fetch complete (55790 records). [2025-09-15T18:51:54.669666] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-15T18:51:54.863065] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-15T18:51:55.066870] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-15T18:51:55.067277] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-15T18:51:55.067208] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:51:55.068230] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-15T18:51:55.071460] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-15T18:51:55.072920] [DEBUG] [LOCAL ] HSBC: Trimmed 55790 records to 37442 (keeping 150 days of data) [2025-09-15T18:51:55.306402] [DEBUG] [LOCAL ] HSBC: Primary data saved (37442 records). [2025-09-15T18:51:55.306578] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-15T18:51:55.306714] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSBC took 26.3s. Estimated remaining: 2h 18m 51s. Rate: 9.4 symbols/min [2025-09-15T18:51:55.476813] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:55.477006] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-15T18:51:55.477045] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-15T18:51:55.477162] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-15T18:51:55.477202] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-15T18:51:55.477242] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-15T18:51:55.477274] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-15T18:51:55.663273] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-15T18:51:55.826498] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T18:51:55.846423] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:56.457848] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-15T18:51:56.525369] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:51:57.257877] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-15T18:51:57.999466] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T18:51:58.029104] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:51:58.057814] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-15T18:51:58.857873] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-15T18:51:59.625329] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:51:59.657880] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-15T18:51:59.843823] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:52:00.281071] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:52:00.457882] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-15T18:52:01.075788] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T18:52:01.257919] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-15T18:52:02.057924] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-15T18:52:02.770544] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:52:02.857836] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-15T18:52:02.957864] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:52:03.432497] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:52:03.437541] [INFO ] [REMOTE ] HTD: Full fetch complete (14194 records). [2025-09-15T18:52:03.437636] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-15T18:52:03.666836] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-15T18:52:03.794486] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-15T18:52:03.794563] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-15T18:52:03.794907] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-15T18:52:03.794954] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-15T18:52:03.795444] [DEBUG] [LOCAL ] HTD: Trimmed 14194 records to 9858 (keeping 150 days of data) [2025-09-15T18:52:03.858888] [DEBUG] [LOCAL ] HTD: Primary data saved (9858 records). [2025-09-15T18:52:03.859029] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-15T18:52:03.859125] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HTD took 12.8s. Estimated remaining: 2h 18m 48s. Rate: 9.4 symbols/min [2025-09-15T18:52:04.026930] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:04.065331] [DEBUG] [LOCAL ] HTGC: Loaded 35510 existing records from primary storage. [2025-09-15T18:52:04.065471] [INFO ] [MAIN ] HTGC: Loaded 35510 existing records. [2025-09-15T18:52:04.252312] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:04.252884] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-15T18:52:04.252937] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-15T18:52:04.254113] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-15T18:52:04.254170] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-15T18:52:04.463066] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-15T18:52:04.553814] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:52:04.640473] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:05.257880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-15T18:52:05.941526] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:52:06.057913] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-15T18:52:06.200267] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:52:06.857892] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-15T18:52:07.354810] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T18:52:07.636344] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:52:07.657826] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-15T18:52:08.457949] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-15T18:52:08.939808] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:52:09.257883] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-15T18:52:09.988528] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:52:10.057894] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-15T18:52:10.570499] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:52:10.784727] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:52:10.857947] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-15T18:52:11.657909] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-15T18:52:12.242279] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:52:12.457892] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-15T18:52:13.190475] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:52:13.195979] [INFO ] [REMOTE ] HSY: Full fetch complete (55094 records). [2025-09-15T18:52:13.196106] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-15T18:52:13.263076] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-15T18:52:13.598217] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-15T18:52:13.598314] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-15T18:52:13.599095] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-15T18:52:13.599139] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-15T18:52:13.600535] [DEBUG] [LOCAL ] HSY: Trimmed 55094 records to 37273 (keeping 150 days of data) [2025-09-15T18:52:13.844043] [DEBUG] [LOCAL ] HSY: Primary data saved (37273 records). [2025-09-15T18:52:13.844190] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-15T18:52:13.844839] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 32.8s. Estimated remaining: 2h 18m 46s. Rate: 9.4 symbols/min [2025-09-15T18:52:14.019732] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:14.046575] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:52:14.048515] [INFO ] [REMOTE ] HTB: Full fetch complete (6939 records). [2025-09-15T18:52:14.048746] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-15T18:52:14.070117] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-15T18:52:14.186286] [DEBUG] [LOCAL ] HTH: Loaded 25401 existing records from primary storage. [2025-09-15T18:52:14.190669] [INFO ] [MAIN ] HTH: Loaded 25401 existing records. [2025-09-15T18:52:14.190504] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:52:14.397483] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-15T18:52:14.431375] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:52:14.445059] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:52:14.461247] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-15T18:52:14.461357] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-15T18:52:14.462485] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-15T18:52:14.466008] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-15T18:52:14.466162] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTB took 24.8s. Estimated remaining: 2h 18m 32s. Rate: 9.4 symbols/min [2025-09-15T18:52:14.465940] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:14.516902] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T18:52:14.516776] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-15T18:52:14.547744] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-15T18:52:14.583303] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-15T18:52:14.603976] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-15T18:52:14.755534] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:14.863000] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-15T18:52:15.024538] [INFO ] [REMOTE ] HTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:15.035449] [DEBUG] [LOCAL ] HUBB: Loaded 27177 existing records from primary storage. [2025-09-15T18:52:15.035612] [INFO ] [MAIN ] HUBB: Loaded 27177 existing records. [2025-09-15T18:52:15.222936] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:15.223200] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-15T18:52:15.223255] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-15T18:52:15.224114] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-15T18:52:15.224166] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-15T18:52:15.577030] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:15.657881] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-15T18:52:16.457842] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-15T18:52:16.530867] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T18:52:16.826515] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:52:17.257869] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-15T18:52:17.790219] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:52:18.057948] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-15T18:52:18.337977] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-15T18:52:18.582676] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:52:18.857916] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-15T18:52:19.182492] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:52:19.657877] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-15T18:52:20.457901] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-15T18:52:20.972058] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:52:21.257953] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-15T18:52:21.905059] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:52:22.057883] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-15T18:52:22.434436] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:52:22.857879] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-15T18:52:23.165079] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:52:23.444190] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:52:23.657913] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-15T18:52:24.457891] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-15T18:52:24.755509] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T18:52:24.939801] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:52:25.257928] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-15T18:52:26.057868] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-15T18:52:26.291123] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:52:26.857867] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-15T18:52:27.077520] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T18:52:27.518363] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:52:27.523356] [INFO ] [REMOTE ] HTGC: Full fetch complete (51769 records). [2025-09-15T18:52:27.523467] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-15T18:52:27.663317] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-15T18:52:27.903100] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-15T18:52:27.903188] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-15T18:52:27.903937] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-15T18:52:27.903982] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-15T18:52:27.905134] [DEBUG] [LOCAL ] HTGC: Trimmed 51769 records to 34840 (keeping 150 days of data) [2025-09-15T18:52:28.006108] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T18:52:28.131524] [DEBUG] [LOCAL ] HTGC: Primary data saved (34840 records). [2025-09-15T18:52:28.131692] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-15T18:52:28.131801] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTGC took 24.3s. Estimated remaining: 2h 18m 35s. Rate: 9.4 symbols/min [2025-09-15T18:52:28.304080] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:28.335693] [DEBUG] [LOCAL ] HUBS: Loaded 29603 existing records from primary storage. [2025-09-15T18:52:28.335834] [INFO ] [MAIN ] HUBS: Loaded 29603 existing records. [2025-09-15T18:52:28.473394] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-15T18:52:28.511211] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:28.511410] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-15T18:52:28.511457] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-15T18:52:28.512117] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-15T18:52:28.512169] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-15T18:52:28.888700] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:28.951871] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T18:52:28.952467] [INFO ] [REMOTE ] HTFC: Full fetch complete (627 records). [2025-09-15T18:52:28.952533] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-15T18:52:29.141981] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T18:52:29.142203] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:52:29.142250] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:52:29.142309] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-15T18:52:29.142387] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-15T18:52:29.142429] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-15T18:52:29.142487] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-15T18:52:29.142594] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTFC took 33.8s. Estimated remaining: 2h 18m 22s. Rate: 9.4 symbols/min [2025-09-15T18:52:29.262958] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-15T18:52:29.321233] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:29.357990] [DEBUG] [LOCAL ] HUM: Loaded 36925 existing records from primary storage. [2025-09-15T18:52:29.358144] [INFO ] [MAIN ] HUM: Loaded 36925 existing records. [2025-09-15T18:52:29.542072] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:29.542346] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-15T18:52:29.542396] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-15T18:52:29.543393] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-15T18:52:29.543458] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-15T18:52:29.919327] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:30.057878] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-15T18:52:30.467262] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:52:30.857898] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-15T18:52:31.400269] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T18:52:31.657954] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-15T18:52:31.797823] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:52:32.457905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-15T18:52:33.088715] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:52:33.257864] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-15T18:52:33.865217] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T18:52:34.057866] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-15T18:52:34.853154] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:52:34.859068] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-15T18:52:34.932991] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:52:35.657853] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-15T18:52:36.126095] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T18:52:36.457881] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-15T18:52:36.788176] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:52:36.792288] [INFO ] [REMOTE ] HUBB: Full fetch complete (41339 records). [2025-09-15T18:52:36.792393] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-15T18:52:37.165207] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-15T18:52:37.165295] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-15T18:52:37.165961] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-15T18:52:37.166007] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-15T18:52:37.166910] [DEBUG] [LOCAL ] HUBB: Trimmed 41339 records to 26654 (keeping 150 days of data) [2025-09-15T18:52:37.263166] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-15T18:52:37.342453] [DEBUG] [LOCAL ] HUBB: Primary data saved (26654 records). [2025-09-15T18:52:37.342590] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-15T18:52:37.342715] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HUBB took 22.9s. Estimated remaining: 2h 18m 18s. Rate: 9.4 symbols/min [2025-09-15T18:52:37.512618] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:37.551625] [DEBUG] [LOCAL ] HUN: Loaded 40015 existing records from primary storage. [2025-09-15T18:52:37.551785] [INFO ] [MAIN ] HUN: Loaded 40015 existing records. [2025-09-15T18:52:37.728256] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:37.728480] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-15T18:52:37.728526] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-15T18:52:37.729394] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-15T18:52:37.729445] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-15T18:52:38.081666] [INFO ] [REMOTE ] HUN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:38.076821] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-15T18:52:38.112471] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:52:38.733432] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:52:38.857867] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-15T18:52:39.081901] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:52:39.657932] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-15T18:52:40.148865] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:52:40.457863] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-15T18:52:41.257887] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-15T18:52:41.575198] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T18:52:41.659828] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:52:42.057886] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-15T18:52:42.478883] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:52:42.857927] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-15T18:52:43.508680] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:52:43.657908] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-15T18:52:44.236547] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:52:44.457906] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-15T18:52:45.257874] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-15T18:52:45.430427] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:52:45.579471] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T18:52:45.583406] [INFO ] [REMOTE ] HTH: Full fetch complete (36514 records). [2025-09-15T18:52:45.583480] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-15T18:52:45.952191] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-15T18:52:45.952270] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-15T18:52:45.952926] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-15T18:52:45.952978] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-15T18:52:45.953813] [DEBUG] [LOCAL ] HTH: Trimmed 36514 records to 24977 (keeping 150 days of data) [2025-09-15T18:52:46.057908] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-15T18:52:46.108961] [DEBUG] [LOCAL ] HTH: Primary data saved (24977 records). [2025-09-15T18:52:46.109108] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-15T18:52:46.109194] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HTH took 32.3s. Estimated remaining: 2h 18m 15s. Rate: 9.4 symbols/min [2025-09-15T18:52:46.276371] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:46.309456] [DEBUG] [LOCAL ] HUYA: Loaded 32446 existing records from primary storage. [2025-09-15T18:52:46.309601] [INFO ] [MAIN ] HUYA: Loaded 32446 existing records. [2025-09-15T18:52:46.490861] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:46.491304] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-15T18:52:46.491373] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-15T18:52:46.492680] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-15T18:52:46.492736] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-15T18:52:46.804640] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:52:46.884433] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:46.861852] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-15T18:52:47.657877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-15T18:52:47.807610] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:52:48.457861] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-15T18:52:48.543430] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:52:49.106288] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:52:49.257869] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-15T18:52:49.860794] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:52:50.057884] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-15T18:52:50.840824] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:52:50.857832] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-15T18:52:51.301175] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:52:51.657877] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-15T18:52:52.087118] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:52:52.457892] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-15T18:52:53.103345] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:52:53.257891] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-15T18:52:54.010859] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:52:54.015475] [INFO ] [REMOTE ] HUBS: Full fetch complete (43329 records). [2025-09-15T18:52:54.015585] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-15T18:52:54.070099] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-15T18:52:54.392395] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-15T18:52:54.392490] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-15T18:52:54.393255] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-15T18:52:54.393305] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-15T18:52:54.394387] [DEBUG] [LOCAL ] HUBS: Trimmed 43329 records to 28996 (keeping 150 days of data) [2025-09-15T18:52:54.580152] [DEBUG] [LOCAL ] HUBS: Primary data saved (28996 records). [2025-09-15T18:52:54.580349] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-15T18:52:54.580447] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBS took 26.4s. Estimated remaining: 2h 18m 11s. Rate: 9.4 symbols/min [2025-09-15T18:52:54.755364] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:54.768104] [DEBUG] [LOCAL ] HVT: Loaded 11292 existing records from primary storage. [2025-09-15T18:52:54.768261] [INFO ] [MAIN ] HVT: Loaded 11292 existing records. [2025-09-15T18:52:54.862718] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-15T18:52:54.953536] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:54.953875] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-15T18:52:54.953931] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-15T18:52:54.954352] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-15T18:52:54.954403] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-15T18:52:55.292809] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T18:52:55.370869] [INFO ] [REMOTE ] HVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:55.657910] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-15T18:52:55.878968] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T18:52:55.885393] [INFO ] [REMOTE ] HUM: Full fetch complete (53301 records). [2025-09-15T18:52:55.885531] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-15T18:52:56.290830] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-15T18:52:56.291001] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-15T18:52:56.291915] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-15T18:52:56.291996] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-15T18:52:56.293493] [DEBUG] [LOCAL ] HUM: Trimmed 53301 records to 36176 (keeping 150 days of data) [2025-09-15T18:52:56.420207] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:52:56.459519] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-15T18:52:56.573021] [DEBUG] [LOCAL ] HUM: Primary data saved (36176 records). [2025-09-15T18:52:56.573188] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-15T18:52:56.573323] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUM took 27.4s. Estimated remaining: 2h 17m 59s. Rate: 9.4 symbols/min [2025-09-15T18:52:56.754058] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:56.793336] [DEBUG] [LOCAL ] HWM: Loaded 39910 existing records from primary storage. [2025-09-15T18:52:56.793489] [INFO ] [MAIN ] HWM: Loaded 39910 existing records. [2025-09-15T18:52:56.972807] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:56.973103] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-15T18:52:56.973149] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-15T18:52:56.974051] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-15T18:52:56.974105] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-15T18:52:57.264377] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-15T18:52:57.351775] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:57.354262] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:52:57.361243] [INFO ] [REMOTE ] HUN: Full fetch complete (57829 records). [2025-09-15T18:52:57.361401] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-15T18:52:57.684974] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:52:57.787248] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-15T18:52:57.787367] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-15T18:52:57.788302] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-15T18:52:57.788357] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-15T18:52:57.789767] [DEBUG] [LOCAL ] HUN: Trimmed 57829 records to 39242 (keeping 150 days of data) [2025-09-15T18:52:58.059963] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-15T18:52:58.063541] [DEBUG] [LOCAL ] HUN: Primary data saved (39242 records). [2025-09-15T18:52:58.064911] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-15T18:52:58.065491] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUN took 20.7s. Estimated remaining: 2h 17m 47s. Rate: 9.4 symbols/min [2025-09-15T18:52:58.243958] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:58.281493] [DEBUG] [LOCAL ] HXL: Loaded 34690 existing records from primary storage. [2025-09-15T18:52:58.281662] [INFO ] [MAIN ] HXL: Loaded 34690 existing records. [2025-09-15T18:52:58.465382] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:58.465633] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-15T18:52:58.465700] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-15T18:52:58.466495] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-15T18:52:58.466559] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-15T18:52:58.828790] [INFO ] [REMOTE ] HXL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:58.857873] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-15T18:52:58.910914] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:52:59.140485] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:52:59.657913] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-15T18:53:00.163363] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:53:00.457896] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-15T18:53:01.243555] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:53:01.258940] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-15T18:53:01.268945] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:53:02.057931] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-15T18:53:02.340245] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:53:02.857888] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-15T18:53:03.352098] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:53:03.657937] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-15T18:53:04.090974] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:53:04.457914] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-15T18:53:05.087983] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:53:05.257885] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-15T18:53:06.047822] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:53:06.058490] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-15T18:53:06.174402] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:53:06.857921] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-15T18:53:07.394041] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T18:53:07.500418] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T18:53:07.657815] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-15T18:53:08.457863] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-15T18:53:09.223491] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:53:09.257825] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-15T18:53:09.408791] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:53:10.057876] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-15T18:53:10.689113] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:53:10.857918] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-15T18:53:11.562368] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:53:11.657889] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-15T18:53:11.913566] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:53:12.457880] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-15T18:53:13.245468] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:53:13.257814] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-15T18:53:13.485818] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:53:13.917088] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:53:13.919248] [INFO ] [REMOTE ] HVT: Full fetch complete (17940 records). [2025-09-15T18:53:13.919331] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-15T18:53:14.063491] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-15T18:53:14.288135] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-15T18:53:14.288216] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-15T18:53:14.288587] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-15T18:53:14.288627] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-15T18:53:14.289734] [DEBUG] [LOCAL ] HVT: Trimmed 17940 records to 10975 (keeping 150 days of data) [2025-09-15T18:53:14.366018] [DEBUG] [LOCAL ] HVT: Primary data saved (10975 records). [2025-09-15T18:53:14.366165] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-15T18:53:14.366281] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HVT took 19.8s. Estimated remaining: 2h 17m 53s. Rate: 9.4 symbols/min [2025-09-15T18:53:14.535983] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:14.545766] [DEBUG] [LOCAL ] HY: Loaded 7350 existing records from primary storage. [2025-09-15T18:53:14.545873] [INFO ] [MAIN ] HY: Loaded 7350 existing records. [2025-09-15T18:53:14.720747] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:14.720985] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-15T18:53:14.721030] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-15T18:53:14.721380] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-15T18:53:14.721428] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-15T18:53:14.865355] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-15T18:53:15.079819] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:15.318460] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:53:15.657864] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-15T18:53:16.320831] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:53:16.327315] [INFO ] [REMOTE ] HXL: Full fetch complete (50076 records). [2025-09-15T18:53:16.327426] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-15T18:53:16.463010] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-15T18:53:16.723369] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-15T18:53:16.723528] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-15T18:53:16.724822] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-15T18:53:16.725037] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-15T18:53:16.727054] [DEBUG] [LOCAL ] HXL: Trimmed 50076 records to 33913 (keeping 150 days of data) [2025-09-15T18:53:16.855208] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:53:16.993990] [DEBUG] [LOCAL ] HXL: Primary data saved (33913 records). [2025-09-15T18:53:16.994177] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-15T18:53:16.995103] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HXL took 18.9s. Estimated remaining: 2h 17m 42s. Rate: 9.4 symbols/min [2025-09-15T18:53:17.168450] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:17.168676] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-15T18:53:17.168716] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-15T18:53:17.168860] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-15T18:53:17.168899] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-15T18:53:17.168939] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-15T18:53:17.168971] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-15T18:53:17.260240] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-15T18:53:17.342441] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:53:17.545736] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:18.057874] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-15T18:53:18.490625] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:53:18.858153] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-15T18:53:18.861864] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:53:19.662721] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-15T18:53:19.663717] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:53:20.457879] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-15T18:53:21.257921] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-15T18:53:21.291512] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T18:53:21.503858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T18:53:21.544545] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:53:22.057899] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-15T18:53:22.857879] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-15T18:53:23.091302] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:53:23.657897] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-15T18:53:23.810533] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:53:23.959862] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T18:53:24.457905] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-15T18:53:24.936492] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T18:53:25.257872] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-15T18:53:25.817694] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:53:26.057886] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-15T18:53:26.382858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T18:53:26.857876] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-15T18:53:27.657880] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-15T18:53:27.942191] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:53:28.457906] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-15T18:53:28.583530] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:53:28.589399] [INFO ] [REMOTE ] HWM: Full fetch complete (57688 records). [2025-09-15T18:53:28.589532] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-15T18:53:28.711281] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-15T18:53:28.987762] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-15T18:53:28.987874] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-15T18:53:28.988750] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-15T18:53:28.988824] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-15T18:53:28.990202] [DEBUG] [LOCAL ] HWM: Trimmed 57688 records to 39128 (keeping 150 days of data) [2025-09-15T18:53:29.262879] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-15T18:53:29.277543] [DEBUG] [LOCAL ] HWM: Primary data saved (39128 records). [2025-09-15T18:53:29.277834] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-15T18:53:29.277983] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HWM took 32.7s. Estimated remaining: 2h 17m 43s. Rate: 9.4 symbols/min [2025-09-15T18:53:29.497189] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:29.497438] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-15T18:53:29.497480] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-15T18:53:29.497622] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-15T18:53:29.497693] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-15T18:53:29.497739] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-15T18:53:29.497774] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-15T18:53:29.868213] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:29.876015] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T18:53:30.057876] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-15T18:53:30.829749] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:53:30.857854] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-15T18:53:31.641660] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:53:31.644555] [INFO ] [REMOTE ] HY: Full fetch complete (11428 records). [2025-09-15T18:53:31.644674] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-15T18:53:31.665999] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-15T18:53:32.062414] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T18:53:32.068687] [INFO ] [REMOTE ] HYAC: Full fetch complete (661 records). [2025-09-15T18:53:32.100581] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-15T18:53:32.102225] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:53:32.101081] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-15T18:53:32.102409] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:53:32.102576] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-15T18:53:32.103368] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-15T18:53:32.102715] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:53:32.103486] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-15T18:53:32.103673] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-15T18:53:32.103792] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-15T18:53:32.104041] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-15T18:53:32.104488] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-15T18:53:32.104780] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HYAC took 15.1s. Estimated remaining: 2h 17m 32s. Rate: 9.4 symbols/min [2025-09-15T18:53:32.110563] [DEBUG] [LOCAL ] HY: Trimmed 11428 records to 7126 (keeping 150 days of data) [2025-09-15T18:53:32.330673] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:32.343633] [DEBUG] [LOCAL ] HY: Primary data saved (7126 records). [2025-09-15T18:53:32.343909] [INFO ] [MAIN ] HY: Full history saved. [2025-09-15T18:53:32.344021] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HY took 18.0s. Estimated remaining: 2h 17m 18s. Rate: 9.4 symbols/min [2025-09-15T18:53:32.445896] [DEBUG] [LOCAL ] HYI: Loaded 6514 existing records from primary storage. [2025-09-15T18:53:32.458739] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-15T18:53:32.479819] [INFO ] [MAIN ] HYI: Loaded 6514 existing records. [2025-09-15T18:53:32.574586] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:32.729029] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:32.735080] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-15T18:53:32.735151] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-15T18:53:32.735545] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-15T18:53:32.735610] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-15T18:53:32.849725] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:53:32.854345] [DEBUG] [LOCAL ] HYT: Loaded 24744 existing records from primary storage. [2025-09-15T18:53:32.855614] [INFO ] [MAIN ] HYT: Loaded 24744 existing records. [2025-09-15T18:53:33.258224] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-15T18:53:33.258143] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:33.300856] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-15T18:53:33.300096] [INFO ] [REMOTE ] HYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:33.300965] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-15T18:53:33.301897] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-15T18:53:33.301958] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-15T18:53:33.651796] [INFO ] [REMOTE ] HYT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:34.057870] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-15T18:53:34.836581] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:53:34.841774] [INFO ] [REMOTE ] HUYA: Full fetch complete (48064 records). [2025-09-15T18:53:34.841912] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-15T18:53:34.863741] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-15T18:53:34.997429] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:53:35.257168] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-15T18:53:35.257299] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-15T18:53:35.258444] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-15T18:53:35.258499] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-15T18:53:35.260219] [DEBUG] [LOCAL ] HUYA: Trimmed 48064 records to 31968 (keeping 150 days of data) [2025-09-15T18:53:35.467097] [DEBUG] [LOCAL ] HUYA: Primary data saved (31968 records). [2025-09-15T18:53:35.467333] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-15T18:53:35.467469] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HUYA took 49.4s. Estimated remaining: 2h 17m 8s. Rate: 9.5 symbols/min [2025-09-15T18:53:35.636637] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:35.640850] [DEBUG] [LOCAL ] HYTR: Loaded 2256 existing records from primary storage. [2025-09-15T18:53:35.640930] [INFO ] [MAIN ] HYTR: Loaded 2256 existing records. [2025-09-15T18:53:35.662970] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-15T18:53:35.819212] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:35.819477] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-15T18:53:35.819523] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-15T18:53:35.819752] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-15T18:53:35.819798] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-15T18:53:36.005240] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:53:36.184336] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:36.205497] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:53:36.457910] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-15T18:53:36.689079] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:53:37.257916] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-15T18:53:37.801822] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:53:38.057908] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-15T18:53:38.857889] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-15T18:53:39.167890] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:53:39.457847] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:53:39.657885] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-15T18:53:39.959173] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T18:53:40.457895] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-15T18:53:40.974558] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:53:41.257924] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-15T18:53:41.569527] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T18:53:42.057911] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-15T18:53:42.352201] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-15T18:53:42.857876] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-15T18:53:43.127456] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-15T18:53:43.657929] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-15T18:53:44.457961] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-15T18:53:44.716248] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T18:53:45.243269] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:53:45.257818] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-15T18:53:45.808702] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:53:46.057915] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-15T18:53:46.371321] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-15T18:53:46.857931] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-15T18:53:47.657938] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-15T18:53:47.721717] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:53:48.328883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T18:53:48.457907] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-15T18:53:49.257871] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-15T18:53:49.343883] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:53:49.649989] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:53:49.650699] [INFO ] [REMOTE ] HYBX: Full fetch complete (488 records). [2025-09-15T18:53:49.650774] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-15T18:53:49.831572] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-15T18:53:49.831803] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:53:49.831852] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:53:49.831902] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-15T18:53:49.831978] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-15T18:53:49.832020] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-15T18:53:49.832069] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-15T18:53:49.832148] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HYBX took 20.6s. Estimated remaining: 2h 17m 11s. Rate: 9.4 symbols/min [2025-09-15T18:53:50.005705] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:50.026040] [DEBUG] [LOCAL ] HZO: Loaded 21209 existing records from primary storage. [2025-09-15T18:53:50.026174] [INFO ] [MAIN ] HZO: Loaded 21209 existing records. [2025-09-15T18:53:50.063045] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-15T18:53:50.208820] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:50.209090] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-15T18:53:50.209140] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-15T18:53:50.209712] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-15T18:53:50.209763] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-15T18:53:50.558594] [INFO ] [REMOTE ] HZO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:50.857882] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-15T18:53:51.011890] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:53:51.636015] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:53:51.657833] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-15T18:53:52.399551] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:53:52.457854] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-15T18:53:53.145579] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:53:53.146820] [INFO ] [REMOTE ] HYI: Full fetch complete (9739 records). [2025-09-15T18:53:53.146894] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-15T18:53:53.262957] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-15T18:53:53.506043] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-15T18:53:53.506125] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-15T18:53:53.506380] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-15T18:53:53.506419] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-15T18:53:53.506957] [DEBUG] [LOCAL ] HYI: Trimmed 9739 records to 6436 (keeping 150 days of data) [2025-09-15T18:53:53.548259] [DEBUG] [LOCAL ] HYI: Primary data saved (6436 records). [2025-09-15T18:53:53.548407] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-15T18:53:53.548494] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYI took 21.4s. Estimated remaining: 2h 17m 2s. Rate: 9.4 symbols/min [2025-09-15T18:53:53.720955] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:53.727009] [DEBUG] [LOCAL ] IAE: Loaded 4197 existing records from primary storage. [2025-09-15T18:53:53.727114] [INFO ] [MAIN ] IAE: Loaded 4197 existing records. [2025-09-15T18:53:53.905904] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:53.906189] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-15T18:53:53.906237] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-15T18:53:53.906472] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-15T18:53:53.906518] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-15T18:53:54.065586] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-15T18:53:54.269171] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:54.283427] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:53:54.523572] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:53:54.857879] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-15T18:53:55.354331] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T18:53:55.657867] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-15T18:53:56.101868] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:53:56.457872] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-15T18:53:56.858591] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T18:53:57.257942] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-15T18:53:57.762434] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:53:58.057914] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-15T18:53:58.644028] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:53:58.857928] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-15T18:53:59.657887] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-15T18:54:00.134575] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:54:00.274160] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:54:00.275131] [INFO ] [REMOTE ] HYTR: Full fetch complete (3469 records). [2025-09-15T18:54:00.275200] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-15T18:54:00.465754] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-15T18:54:00.631857] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-15T18:54:00.631938] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-15T18:54:00.632075] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-15T18:54:00.632114] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-15T18:54:00.632463] [DEBUG] [LOCAL ] HYTR: Trimmed 3469 records to 2215 (keeping 150 days of data) [2025-09-15T18:54:00.646684] [DEBUG] [LOCAL ] HYTR: Primary data saved (2215 records). [2025-09-15T18:54:00.646743] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-15T18:54:00.646813] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 25.2s. Estimated remaining: 2h 16m 56s. Rate: 9.4 symbols/min [2025-09-15T18:54:00.815904] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:00.855474] [DEBUG] [LOCAL ] IAG: Loaded 40237 existing records from primary storage. [2025-09-15T18:54:00.855616] [INFO ] [MAIN ] IAG: Loaded 40237 existing records. [2025-09-15T18:54:01.032843] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:01.033100] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-15T18:54:01.033145] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-15T18:54:01.034172] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-15T18:54:01.034237] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-15T18:54:01.263470] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-15T18:54:01.430728] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:01.904482] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:54:02.057852] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-15T18:54:02.822736] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:54:02.857853] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-15T18:54:03.283747] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:54:03.657884] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-15T18:54:04.202246] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:54:04.207056] [INFO ] [REMOTE ] HYT: Full fetch complete (36040 records). [2025-09-15T18:54:04.207198] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-15T18:54:04.462941] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-15T18:54:04.586065] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-15T18:54:04.586163] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-15T18:54:04.586894] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-15T18:54:04.586951] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-15T18:54:04.588082] [DEBUG] [LOCAL ] HYT: Trimmed 36040 records to 24150 (keeping 150 days of data) [2025-09-15T18:54:04.742500] [DEBUG] [LOCAL ] HYT: Primary data saved (24150 records). [2025-09-15T18:54:04.742750] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-15T18:54:04.742893] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYT took 32.4s. Estimated remaining: 2h 16m 47s. Rate: 9.4 symbols/min [2025-09-15T18:54:04.760616] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:54:05.065545] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T18:54:05.257909] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-15T18:54:05.665032] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:54:06.057887] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-15T18:54:06.857884] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-15T18:54:07.045279] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:54:07.657909] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-15T18:54:08.457897] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-15T18:54:08.621393] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:54:08.766902] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:54:08.889197] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T18:54:09.257888] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-15T18:54:10.057888] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-15T18:54:10.773486] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:54:10.857838] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-15T18:54:10.969755] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:54:10.972616] [INFO ] [REMOTE ] HZO: Full fetch complete (31512 records). [2025-09-15T18:54:10.972704] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-15T18:54:11.341330] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-15T18:54:11.341409] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-15T18:54:11.342064] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-15T18:54:11.342109] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-15T18:54:11.342886] [DEBUG] [LOCAL ] HZO: Trimmed 31512 records to 20526 (keeping 150 days of data) [2025-09-15T18:54:11.462520] [DEBUG] [LOCAL ] HZO: Primary data saved (20526 records). [2025-09-15T18:54:11.462677] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-15T18:54:11.462761] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. HZO took 21.6s. Estimated remaining: 2h 16m 41s. Rate: 9.4 symbols/min [2025-09-15T18:54:11.657900] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-15T18:54:12.288284] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:54:12.352976] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:54:12.457894] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-15T18:54:13.257878] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-15T18:54:13.873487] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:54:13.875853] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T18:54:14.057881] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-15T18:54:14.662634] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:54:14.663935] [INFO ] [REMOTE ] IAE: Full fetch complete (6341 records). [2025-09-15T18:54:14.664007] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-15T18:54:14.858242] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-15T18:54:15.068580] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-15T18:54:15.068682] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-15T18:54:15.068902] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-15T18:54:15.068960] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-15T18:54:15.069408] [DEBUG] [LOCAL ] IAE: Trimmed 6341 records to 4215 (keeping 150 days of data) [2025-09-15T18:54:15.098222] [DEBUG] [LOCAL ] IAE: Primary data saved (4215 records). [2025-09-15T18:54:15.098349] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-15T18:54:15.098439] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. IAE took 21.5s. Estimated remaining: 2h 16m 32s. Rate: 9.4 symbols/min [2025-09-15T18:54:16.884182] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-15T18:54:16.895257] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-15T18:54:18.327520] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:54:18.338974] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-15T18:54:19.975236] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:54:19.986570] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-15T18:54:21.793833] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T18:54:21.799735] [INFO ] [REMOTE ] IAG: Full fetch complete (58099 records). [2025-09-15T18:54:21.799857] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-15T18:54:22.198157] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-15T18:54:22.198247] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-15T18:54:22.199071] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-15T18:54:22.199119] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-15T18:54:22.200399] [DEBUG] [LOCAL ] IAG: Trimmed 58099 records to 39458 (keeping 150 days of data) [2025-09-15T18:54:22.432993] [DEBUG] [LOCAL ] IAG: Primary data saved (39458 records). [2025-09-15T18:54:22.433157] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-15T18:54:22.433774] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 21.8s. Estimated remaining: 2h 16m 26s. Rate: 9.4 symbols/min [2025-09-15T18:54:23.106404] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.063465] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.155010] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.157388] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.179888] [DEBUG] [LOCAL ] IBP: Loaded 21904 existing records from primary storage. [2025-09-15T18:54:23.188024] [INFO ] [MAIN ] IBP: Loaded 21904 existing records. [2025-09-15T18:54:23.303094] [DEBUG] [LOCAL ] IBTA: Loaded 26676 existing records from primary storage. [2025-09-15T18:54:23.316804] [INFO ] [MAIN ] IBTA: Loaded 26676 existing records. [2025-09-15T18:54:23.432886] [DEBUG] [LOCAL ] IBM: Loaded 40393 existing records from primary storage. [2025-09-15T18:54:23.497860] [DEBUG] [LOCAL ] IBN: Loaded 39792 existing records from primary storage. [2025-09-15T18:54:23.491802] [INFO ] [MAIN ] IBM: Loaded 40393 existing records. [2025-09-15T18:54:23.497147] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:23.513437] [INFO ] [MAIN ] IBN: Loaded 39792 existing records. [2025-09-15T18:54:23.576125] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-15T18:54:23.614532] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-15T18:54:23.655290] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-15T18:54:23.713540] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-15T18:54:23.843235] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.013183] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.013086] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.070082] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.069909] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.070442] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-15T18:54:24.050337] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-15T18:54:24.109920] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.119234] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-15T18:54:24.127094] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-15T18:54:24.127195] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-15T18:54:24.147146] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-15T18:54:24.155751] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-15T18:54:24.176824] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-15T18:54:24.196103] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-15T18:54:24.649338] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:24.670579] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-15T18:54:25.305848] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.377516] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-15T18:54:25.381830] [INFO ] [REMOTE ] IBN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.406289] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-15T18:54:25.435444] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.436581] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-15T18:54:26.032805] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:54:26.038716] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-15T18:54:26.614248] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:54:26.620743] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-15T18:54:26.859746] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:54:26.871303] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-15T18:54:26.923787] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:54:26.930669] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-15T18:54:27.266670] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T18:54:27.277896] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-15T18:54:27.727259] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:54:27.737943] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-15T18:54:27.786046] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:54:27.792476] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-15T18:54:28.256543] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:54:28.268497] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-15T18:54:28.907932] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:54:28.918223] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-15T18:54:28.937258] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:54:28.943984] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-15T18:54:29.364615] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T18:54:29.375740] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-15T18:54:29.585362] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:54:29.924019] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:54:30.057879] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-15T18:54:30.193618] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T18:54:30.857824] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-15T18:54:31.305403] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:54:31.657838] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-15T18:54:31.781250] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:54:32.024871] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:54:32.457883] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-15T18:54:32.555735] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:54:33.257880] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-15T18:54:33.836493] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:54:34.057920] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-15T18:54:34.318069] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:54:34.857878] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-15T18:54:35.332322] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:54:35.657871] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-15T18:54:36.151533] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:54:36.155072] [INFO ] [REMOTE ] IBP: Full fetch complete (32210 records). [2025-09-15T18:54:36.155154] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-15T18:54:36.463067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-15T18:54:36.533175] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-15T18:54:36.533263] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-15T18:54:36.534180] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-15T18:54:36.534250] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-15T18:54:36.535737] [DEBUG] [LOCAL ] IBP: Trimmed 32210 records to 21527 (keeping 150 days of data) [2025-09-15T18:54:36.692285] [DEBUG] [LOCAL ] IBP: Primary data saved (21527 records). [2025-09-15T18:54:36.692438] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-15T18:54:36.692555] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 14.3s. Estimated remaining: 2h 16m 30s. Rate: 9.4 symbols/min [2025-09-15T18:54:36.923186] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:36.975769] [DEBUG] [LOCAL ] ICE: Loaded 39805 existing records from primary storage. [2025-09-15T18:54:36.975943] [INFO ] [MAIN ] ICE: Loaded 39805 existing records. [2025-09-15T18:54:37.212454] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:37.212938] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-15T18:54:37.213149] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-15T18:54:37.214404] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-15T18:54:37.214470] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-15T18:54:37.260151] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-15T18:54:37.699972] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-15T18:54:37.808145] [INFO ] [REMOTE ] ICE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:37.829806] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:54:38.057936] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-15T18:54:38.860274] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-15T18:54:38.867277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:54:39.521900] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:54:39.657890] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-15T18:54:40.457837] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-15T18:54:40.910288] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:54:40.953362] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:54:41.257871] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-15T18:54:41.528071] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T18:54:42.057872] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-15T18:54:42.857840] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-15T18:54:43.408246] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T18:54:43.433728] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:54:43.438635] [INFO ] [REMOTE ] IBTA: Full fetch complete (40471 records). [2025-09-15T18:54:43.438769] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-15T18:54:43.664959] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-15T18:54:43.820569] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-15T18:54:43.820673] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-15T18:54:43.821330] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-15T18:54:43.821372] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-15T18:54:43.822287] [DEBUG] [LOCAL ] IBTA: Trimmed 40471 records to 25982 (keeping 150 days of data) [2025-09-15T18:54:43.975131] [DEBUG] [LOCAL ] IBTA: Primary data saved (25982 records). [2025-09-15T18:54:43.975268] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-15T18:54:43.975361] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBTA took 21.5s. Estimated remaining: 2h 16m 24s. Rate: 9.4 symbols/min [2025-09-15T18:54:44.148507] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:44.175878] [DEBUG] [LOCAL ] ICL: Loaded 28754 existing records from primary storage. [2025-09-15T18:54:44.176048] [INFO ] [MAIN ] ICL: Loaded 28754 existing records. [2025-09-15T18:54:44.353717] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:44.354022] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-15T18:54:44.354154] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-15T18:54:44.354834] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-15T18:54:44.354887] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-15T18:54:44.459495] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-15T18:54:44.737402] [INFO ] [REMOTE ] ICL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:44.757842] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:54:45.257911] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-15T18:54:46.027004] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:54:46.057982] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-15T18:54:46.059761] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:54:46.065568] [INFO ] [REMOTE ] IBN: Full fetch complete (57541 records). [2025-09-15T18:54:46.065687] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-15T18:54:46.446459] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-15T18:54:46.446601] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-15T18:54:46.447727] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-15T18:54:46.447834] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-15T18:54:46.449199] [DEBUG] [LOCAL ] IBN: Trimmed 57541 records to 38999 (keeping 150 days of data) [2025-09-15T18:54:46.534972] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:54:46.718350] [DEBUG] [LOCAL ] IBN: Primary data saved (38999 records). [2025-09-15T18:54:46.718495] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-15T18:54:46.718579] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 24.3s. Estimated remaining: 2h 16m 14s. Rate: 9.4 symbols/min [2025-09-15T18:54:46.858248] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-15T18:54:46.888283] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:46.912460] [DEBUG] [LOCAL ] IDA: Loaded 25071 existing records from primary storage. [2025-09-15T18:54:46.912590] [INFO ] [MAIN ] IDA: Loaded 25071 existing records. [2025-09-15T18:54:47.090696] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:47.090951] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-15T18:54:47.090996] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-15T18:54:47.091745] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-15T18:54:47.091795] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-15T18:54:47.449960] [INFO ] [REMOTE ] IDA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:47.657896] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-15T18:54:47.958951] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T18:54:48.001565] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:54:48.457883] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-15T18:54:48.601812] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:54:49.257990] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-15T18:54:49.779251] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:54:49.785619] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-15T18:54:49.785784] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-15T18:54:50.059312] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-15T18:54:50.177569] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-15T18:54:50.177721] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-15T18:54:50.178705] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-15T18:54:50.178768] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-15T18:54:50.181044] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 39615 (keeping 150 days of data) [2025-09-15T18:54:50.207226] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T18:54:50.474563] [DEBUG] [LOCAL ] IBM: Primary data saved (39615 records). [2025-09-15T18:54:50.474749] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-15T18:54:50.476584] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 28.0s. Estimated remaining: 2h 16m 4s. Rate: 9.4 symbols/min [2025-09-15T18:54:50.650059] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:50.659438] [DEBUG] [LOCAL ] IDE: Loaded 6576 existing records from primary storage. [2025-09-15T18:54:50.659612] [INFO ] [MAIN ] IDE: Loaded 6576 existing records. [2025-09-15T18:54:50.834984] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:50.835260] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-15T18:54:50.835307] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-15T18:54:50.835613] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-15T18:54:50.835685] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-15T18:54:50.865682] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-15T18:54:51.187714] [INFO ] [REMOTE ] IDE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:51.557760] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:54:51.657882] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-15T18:54:52.253060] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:54:52.457819] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-15T18:54:53.254971] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:54:53.265353] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-15T18:54:53.894368] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:54:53.951002] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T18:54:54.057885] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-15T18:54:54.857909] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-15T18:54:55.129473] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:54:55.657890] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-15T18:54:56.462954] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-15T18:54:56.476332] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:54:56.653487] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T18:54:56.927315] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T18:54:57.257914] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-15T18:54:58.057884] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-15T18:54:58.592934] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:54:58.857908] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-15T18:54:59.504994] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:54:59.510908] [INFO ] [REMOTE ] ICE: Full fetch complete (57647 records). [2025-09-15T18:54:59.511071] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-15T18:54:59.683892] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-15T18:54:59.894320] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-15T18:54:59.894423] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-15T18:54:59.895244] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-15T18:54:59.895296] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-15T18:54:59.896672] [DEBUG] [LOCAL ] ICE: Trimmed 57647 records to 39028 (keeping 150 days of data) [2025-09-15T18:55:00.174234] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:55:00.197283] [DEBUG] [LOCAL ] ICE: Primary data saved (39028 records). [2025-09-15T18:55:00.197460] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-15T18:55:00.198192] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICE took 23.5s. Estimated remaining: 2h 16m 2s. Rate: 9.4 symbols/min [2025-09-15T18:55:00.379382] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:00.394488] [DEBUG] [LOCAL ] IDT: Loaded 13144 existing records from primary storage. [2025-09-15T18:55:00.394660] [INFO ] [MAIN ] IDT: Loaded 13144 existing records. [2025-09-15T18:55:00.463154] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-15T18:55:00.580805] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:00.581051] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-15T18:55:00.581096] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-15T18:55:00.581580] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-15T18:55:00.581636] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-15T18:55:00.940509] [INFO ] [REMOTE ] IDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:01.147774] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:55:01.257886] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-15T18:55:01.317873] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:55:02.026222] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:55:02.057916] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-15T18:55:02.857877] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-15T18:55:03.405388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:55:03.657934] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-15T18:55:04.001729] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:55:04.005914] [INFO ] [REMOTE ] ICL: Full fetch complete (42377 records). [2025-09-15T18:55:04.006008] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-15T18:55:04.378200] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-15T18:55:04.378277] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-15T18:55:04.378945] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-15T18:55:04.378990] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-15T18:55:04.379862] [DEBUG] [LOCAL ] ICL: Trimmed 42377 records to 28261 (keeping 150 days of data) [2025-09-15T18:55:04.467122] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-15T18:55:04.546428] [DEBUG] [LOCAL ] ICL: Primary data saved (28261 records). [2025-09-15T18:55:04.546563] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-15T18:55:04.546666] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. ICL took 20.6s. Estimated remaining: 2h 15m 53s. Rate: 9.4 symbols/min [2025-09-15T18:55:04.718284] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:04.748209] [DEBUG] [LOCAL ] IEX: Loaded 28982 existing records from primary storage. [2025-09-15T18:55:04.748342] [INFO ] [MAIN ] IEX: Loaded 28982 existing records. [2025-09-15T18:55:04.927123] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:04.927513] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-15T18:55:04.927576] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-15T18:55:04.928358] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-15T18:55:04.928436] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-15T18:55:05.067844] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T18:55:05.263728] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-15T18:55:05.307576] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:55:05.337711] [INFO ] [REMOTE ] IEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:06.057897] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-15T18:55:06.624585] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:55:06.857935] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-15T18:55:07.479066] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:55:07.657889] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-15T18:55:07.899250] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:55:08.457940] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-15T18:55:08.728388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:55:08.731424] [INFO ] [REMOTE ] IDA: Full fetch complete (34460 records). [2025-09-15T18:55:08.731519] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-15T18:55:09.099522] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-15T18:55:09.099603] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-15T18:55:09.100228] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-15T18:55:09.100289] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-15T18:55:09.101177] [DEBUG] [LOCAL ] IDA: Trimmed 34460 records to 24568 (keeping 150 days of data) [2025-09-15T18:55:09.258851] [DEBUG] [LOCAL ] IDA: Primary data saved (24568 records). [2025-09-15T18:55:09.259242] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-15T18:55:09.258961] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-15T18:55:09.260164] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDA took 22.5s. Estimated remaining: 2h 15m 45s. Rate: 9.4 symbols/min [2025-09-15T18:55:09.431060] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:09.467600] [DEBUG] [LOCAL ] IFF: Loaded 38270 existing records from primary storage. [2025-09-15T18:55:09.467756] [INFO ] [MAIN ] IFF: Loaded 38270 existing records. [2025-09-15T18:55:09.642636] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:09.642865] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-15T18:55:09.642910] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-15T18:55:09.643550] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-15T18:55:09.643595] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-15T18:55:10.047748] [INFO ] [REMOTE ] IFF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:10.055725] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:55:10.058254] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-15T18:55:10.083464] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T18:55:10.523433] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:55:10.857876] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-15T18:55:11.657958] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-15T18:55:11.801760] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:55:12.209731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:55:12.457865] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-15T18:55:13.135170] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:55:13.136691] [INFO ] [REMOTE ] IDE: Full fetch complete (8992 records). [2025-09-15T18:55:13.136764] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-15T18:55:13.262929] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-15T18:55:13.516981] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-15T18:55:13.517073] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-15T18:55:13.517386] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-15T18:55:13.517435] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-15T18:55:13.518243] [DEBUG] [LOCAL ] IDE: Trimmed 8992 records to 6534 (keeping 150 days of data) [2025-09-15T18:55:13.562154] [DEBUG] [LOCAL ] IDE: Primary data saved (6534 records). [2025-09-15T18:55:13.562270] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-15T18:55:13.562374] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDE took 23.1s. Estimated remaining: 2h 15m 36s. Rate: 9.4 symbols/min [2025-09-15T18:55:13.740126] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:13.762725] [DEBUG] [LOCAL ] IFN: Loaded 13786 existing records from primary storage. [2025-09-15T18:55:13.762865] [INFO ] [MAIN ] IFN: Loaded 13786 existing records. [2025-09-15T18:55:13.944562] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:13.944851] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-15T18:55:13.944900] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-15T18:55:13.945341] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-15T18:55:13.945394] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-15T18:55:14.063052] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-15T18:55:14.315657] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:14.723225] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T18:55:14.857834] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-15T18:55:15.156534] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:55:15.657906] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-15T18:55:15.983484] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:55:16.457878] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-15T18:55:16.847423] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:55:17.257869] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-15T18:55:17.713706] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:55:18.013340] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T18:55:18.057849] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-15T18:55:18.857873] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-15T18:55:19.357129] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:55:19.657885] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-15T18:55:19.798931] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:55:20.457909] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-15T18:55:20.615544] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T18:55:21.196734] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:55:21.257873] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-15T18:55:22.047167] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:55:22.057817] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-15T18:55:22.857876] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-15T18:55:23.128268] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T18:55:23.564053] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T18:55:23.566862] [INFO ] [REMOTE ] IDT: Full fetch complete (18145 records). [2025-09-15T18:55:23.566935] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-15T18:55:23.666305] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-15T18:55:23.941698] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-15T18:55:23.941801] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-15T18:55:23.942260] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-15T18:55:23.942302] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-15T18:55:23.943194] [DEBUG] [LOCAL ] IDT: Trimmed 18145 records to 13084 (keeping 150 days of data) [2025-09-15T18:55:24.030949] [DEBUG] [LOCAL ] IDT: Primary data saved (13084 records). [2025-09-15T18:55:24.031110] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-15T18:55:24.031236] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 23.8s. Estimated remaining: 2h 15m 35s. Rate: 9.4 symbols/min [2025-09-15T18:55:24.209549] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:24.227600] [DEBUG] [LOCAL ] IFS: Loaded 16626 existing records from primary storage. [2025-09-15T18:55:24.227766] [INFO ] [MAIN ] IFS: Loaded 16626 existing records. [2025-09-15T18:55:24.410307] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:24.410587] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-15T18:55:24.410665] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-15T18:55:24.411047] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-15T18:55:24.411094] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-15T18:55:24.466866] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-15T18:55:24.778570] [INFO ] [REMOTE ] IFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:24.884595] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:55:25.130190] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:55:25.257858] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-15T18:55:26.038477] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T18:55:26.057810] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-15T18:55:26.857898] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-15T18:55:26.877751] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:55:27.657869] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-15T18:55:28.435861] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:55:28.457821] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-15T18:55:28.768953] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:55:29.257888] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-15T18:55:29.844321] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:55:30.057931] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-15T18:55:30.721609] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:55:30.727060] [INFO ] [REMOTE ] IEX: Full fetch complete (41263 records). [2025-09-15T18:55:30.727258] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-15T18:55:30.860264] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-15T18:55:31.162348] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-15T18:55:31.162431] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-15T18:55:31.163115] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-15T18:55:31.163188] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-15T18:55:31.164228] [DEBUG] [LOCAL ] IEX: Trimmed 41263 records to 28450 (keeping 150 days of data) [2025-09-15T18:55:31.297522] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:55:31.379840] [DEBUG] [LOCAL ] IEX: Primary data saved (28450 records). [2025-09-15T18:55:31.379989] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-15T18:55:31.380110] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IEX took 26.8s. Estimated remaining: 2h 15m 29s. Rate: 9.4 symbols/min [2025-09-15T18:55:31.547319] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:31.555837] [DEBUG] [LOCAL ] IGA: Loaded 6969 existing records from primary storage. [2025-09-15T18:55:31.555928] [INFO ] [MAIN ] IGA: Loaded 6969 existing records. [2025-09-15T18:55:31.662991] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-15T18:55:31.732081] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:31.732312] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-15T18:55:31.732357] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-15T18:55:31.732768] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-15T18:55:31.732821] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-15T18:55:32.090264] [INFO ] [REMOTE ] IGA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:32.179253] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:55:32.457897] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-15T18:55:32.490307] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:55:33.257842] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-15T18:55:33.446972] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:55:34.057894] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-15T18:55:34.143295] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:55:34.857928] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-15T18:55:35.325561] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:55:35.565062] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T18:55:35.657863] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-15T18:55:36.457881] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-15T18:55:36.661733] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:55:37.257883] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-15T18:55:37.917506] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:55:38.057872] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-15T18:55:38.391151] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T18:55:38.857908] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-15T18:55:39.390919] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:55:39.579592] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:55:39.581916] [INFO ] [REMOTE ] IFN: Full fetch complete (20535 records). [2025-09-15T18:55:39.582000] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-15T18:55:39.662945] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-15T18:55:39.953345] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-15T18:55:39.953427] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-15T18:55:39.953880] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-15T18:55:39.953922] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-15T18:55:39.954566] [DEBUG] [LOCAL ] IFN: Trimmed 20535 records to 13576 (keeping 150 days of data) [2025-09-15T18:55:40.047408] [DEBUG] [LOCAL ] IFN: Primary data saved (13576 records). [2025-09-15T18:55:40.047548] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-15T18:55:40.047629] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 26.5s. Estimated remaining: 2h 15m 26s. Rate: 9.4 symbols/min [2025-09-15T18:55:40.215597] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:40.229523] [DEBUG] [LOCAL ] IGD: Loaded 14033 existing records from primary storage. [2025-09-15T18:55:40.229677] [INFO ] [MAIN ] IGD: Loaded 14033 existing records. [2025-09-15T18:55:40.404485] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:40.404711] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-15T18:55:40.404758] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-15T18:55:40.405210] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-15T18:55:40.405258] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-15T18:55:40.466049] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-15T18:55:40.722716] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:55:40.776993] [INFO ] [REMOTE ] IGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:41.257924] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-15T18:55:42.052508] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:55:42.057809] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-15T18:55:42.160300] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T18:55:42.167340] [INFO ] [REMOTE ] IFF: Full fetch complete (55350 records). [2025-09-15T18:55:42.167461] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-15T18:55:42.502928] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:55:42.558395] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-15T18:55:42.558491] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-15T18:55:42.559365] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-15T18:55:42.559420] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-15T18:55:42.560717] [DEBUG] [LOCAL ] IFF: Trimmed 55350 records to 37546 (keeping 150 days of data) [2025-09-15T18:55:42.793713] [DEBUG] [LOCAL ] IFF: Primary data saved (37546 records). [2025-09-15T18:55:42.793856] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-15T18:55:42.793978] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 33.5s. Estimated remaining: 2h 15m 15s. Rate: 9.4 symbols/min [2025-09-15T18:55:42.863064] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-15T18:55:42.964617] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:42.969535] [DEBUG] [LOCAL ] IGI: Loaded 2744 existing records from primary storage. [2025-09-15T18:55:42.969657] [INFO ] [MAIN ] IGI: Loaded 2744 existing records. [2025-09-15T18:55:43.147471] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:43.147760] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-15T18:55:43.147810] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-15T18:55:43.148075] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-15T18:55:43.148124] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-15T18:55:43.524721] [INFO ] [REMOTE ] IGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:43.525612] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:55:43.657848] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-15T18:55:44.259091] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:55:44.457844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-15T18:55:45.257949] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-15T18:55:45.424294] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:55:45.970157] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:55:46.057929] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-15T18:55:46.789759] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:55:46.792555] [INFO ] [REMOTE ] IFS: Full fetch complete (25038 records). [2025-09-15T18:55:46.792627] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-15T18:55:46.863054] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-15T18:55:47.161370] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-15T18:55:47.161453] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-15T18:55:47.161991] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-15T18:55:47.162040] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-15T18:55:47.162824] [DEBUG] [LOCAL ] IFS: Trimmed 25038 records to 16343 (keeping 150 days of data) [2025-09-15T18:55:47.261431] [DEBUG] [LOCAL ] IFS: Primary data saved (16343 records). [2025-09-15T18:55:47.261570] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-15T18:55:47.261678] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFS took 23.2s. Estimated remaining: 2h 15m 7s. Rate: 9.4 symbols/min [2025-09-15T18:55:47.444702] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:47.452300] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:55:47.474037] [DEBUG] [LOCAL ] IGR: Loaded 22791 existing records from primary storage. [2025-09-15T18:55:47.474165] [INFO ] [MAIN ] IGR: Loaded 22791 existing records. [2025-09-15T18:55:47.651455] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:47.651754] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-15T18:55:47.651802] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-15T18:55:47.652347] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-15T18:55:47.652410] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-15T18:55:47.663673] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-15T18:55:48.010761] [INFO ] [REMOTE ] IGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:48.164112] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T18:55:48.457883] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-15T18:55:49.257895] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-15T18:55:49.604945] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:55:50.057950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-15T18:55:50.603515] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:55:50.655073] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:55:50.656747] [INFO ] [REMOTE ] IGA: Full fetch complete (10343 records). [2025-09-15T18:55:50.656817] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-15T18:55:50.862944] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-15T18:55:51.008814] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-15T18:55:51.008919] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-15T18:55:51.009164] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-15T18:55:51.009204] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-15T18:55:51.009665] [DEBUG] [LOCAL ] IGA: Trimmed 10343 records to 6917 (keeping 150 days of data) [2025-09-15T18:55:51.051369] [DEBUG] [LOCAL ] IGA: Primary data saved (6917 records). [2025-09-15T18:55:51.051492] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-15T18:55:51.051573] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGA took 19.7s. Estimated remaining: 2h 14m 57s. Rate: 9.4 symbols/min [2025-09-15T18:55:51.223594] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:51.227137] [DEBUG] [LOCAL ] IH: Loaded 2015 existing records from primary storage. [2025-09-15T18:55:51.227214] [INFO ] [MAIN ] IH: Loaded 2015 existing records. [2025-09-15T18:55:51.402045] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:51.402282] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-15T18:55:51.402336] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-15T18:55:51.402540] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-15T18:55:51.402584] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-15T18:55:51.663454] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-15T18:55:51.767391] [INFO ] [REMOTE ] IH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:51.780569] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:55:52.073663] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:55:52.457875] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-15T18:55:52.895851] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:55:53.257931] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-15T18:55:54.057834] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-15T18:55:54.205310] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:55:54.450704] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:55:54.857875] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-15T18:55:55.304884] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:55:55.657874] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-15T18:55:55.994730] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T18:55:56.457876] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-15T18:55:57.141281] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:55:57.257851] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-15T18:55:58.057879] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-15T18:55:58.305058] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:55:58.744725] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T18:55:58.857844] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-15T18:55:59.524512] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:55:59.657879] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-15T18:56:00.457883] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-15T18:56:00.593563] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T18:56:01.090052] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T18:56:01.091288] [INFO ] [REMOTE ] IGI: Full fetch complete (3976 records). [2025-09-15T18:56:01.091375] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-15T18:56:01.262973] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-15T18:56:01.508388] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-15T18:56:01.508509] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-15T18:56:01.508749] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-15T18:56:01.508804] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-15T18:56:01.509556] [DEBUG] [LOCAL ] IGI: Trimmed 3976 records to 2713 (keeping 150 days of data) [2025-09-15T18:56:01.528710] [DEBUG] [LOCAL ] IGI: Primary data saved (2713 records). [2025-09-15T18:56:01.528848] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-15T18:56:01.528946] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 18.7s. Estimated remaining: 2h 14m 56s. Rate: 9.4 symbols/min [2025-09-15T18:56:01.703042] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:01.709409] [DEBUG] [LOCAL ] IHD: Loaded 5208 existing records from primary storage. [2025-09-15T18:56:01.709505] [INFO ] [MAIN ] IHD: Loaded 5208 existing records. [2025-09-15T18:56:01.889257] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:01.889551] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-15T18:56:01.889599] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-15T18:56:01.889875] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-15T18:56:01.889922] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-15T18:56:02.060326] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-15T18:56:02.236214] [INFO ] [REMOTE ] IHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:02.417607] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:56:02.632149] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T18:56:02.857931] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-15T18:56:03.657888] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-15T18:56:03.689957] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T18:56:03.950496] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:56:04.457887] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-15T18:56:05.257883] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-15T18:56:05.340880] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:56:06.057913] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-15T18:56:06.136952] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:56:06.139147] [INFO ] [REMOTE ] IGD: Full fetch complete (21230 records). [2025-09-15T18:56:06.139224] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-15T18:56:06.514015] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-15T18:56:06.517996] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-15T18:56:06.518791] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-15T18:56:06.518863] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-15T18:56:06.518177] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:56:06.521346] [DEBUG] [LOCAL ] IGD: Trimmed 21230 records to 13795 (keeping 150 days of data) [2025-09-15T18:56:06.610486] [DEBUG] [LOCAL ] IGD: Primary data saved (13795 records). [2025-09-15T18:56:06.610718] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-15T18:56:06.610806] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 26.6s. Estimated remaining: 2h 14m 48s. Rate: 9.4 symbols/min [2025-09-15T18:56:06.779442] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:06.797825] [DEBUG] [LOCAL ] IHG: Loaded 18114 existing records from primary storage. [2025-09-15T18:56:06.797947] [INFO ] [MAIN ] IHG: Loaded 18114 existing records. [2025-09-15T18:56:06.863065] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-15T18:56:06.976459] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:06.976805] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-15T18:56:06.976854] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-15T18:56:06.977463] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-15T18:56:06.977519] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-15T18:56:07.326284] [INFO ] [REMOTE ] IHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:07.519946] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T18:56:07.657884] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-15T18:56:08.021370] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:56:08.457905] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-15T18:56:09.203810] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:56:09.257847] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-15T18:56:09.789172] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:56:10.057878] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-15T18:56:10.509343] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:56:10.857879] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-15T18:56:11.437833] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T18:56:11.438763] [INFO ] [REMOTE ] IH: Full fetch complete (4220 records). [2025-09-15T18:56:11.438877] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-15T18:56:11.663079] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-15T18:56:11.800902] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-15T18:56:11.800987] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-15T18:56:11.801131] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-15T18:56:11.801170] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-15T18:56:11.801560] [DEBUG] [LOCAL ] IH: Trimmed 4220 records to 2002 (keeping 150 days of data) [2025-09-15T18:56:11.813569] [DEBUG] [LOCAL ] IH: Primary data saved (2002 records). [2025-09-15T18:56:11.813635] [INFO ] [MAIN ] IH: Full history saved. [2025-09-15T18:56:11.813741] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IH took 20.8s. Estimated remaining: 2h 14m 40s. Rate: 9.4 symbols/min [2025-09-15T18:56:11.985550] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:12.018282] [DEBUG] [LOCAL ] IHS: Loaded 29543 existing records from primary storage. [2025-09-15T18:56:12.018488] [INFO ] [MAIN ] IHS: Loaded 29543 existing records. [2025-09-15T18:56:12.201072] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:12.201363] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-15T18:56:12.201413] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-15T18:56:12.202164] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-15T18:56:12.202229] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-15T18:56:12.463077] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-15T18:56:12.557459] [INFO ] [REMOTE ] IHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:13.079794] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:56:13.260749] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-15T18:56:13.263062] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:56:14.057931] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-15T18:56:14.141998] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:56:14.857871] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-15T18:56:14.976589] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:56:15.657846] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-15T18:56:16.047388] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:56:16.074508] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:56:16.457884] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-15T18:56:17.257885] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-15T18:56:17.797260] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:56:18.057897] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-15T18:56:18.394756] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T18:56:18.857889] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-15T18:56:19.439929] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:56:19.657885] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-15T18:56:20.248366] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:56:20.442342] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:56:20.457827] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-15T18:56:21.257889] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-15T18:56:21.721223] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:56:21.830299] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:56:22.057853] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-15T18:56:22.857898] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-15T18:56:23.305934] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T18:56:23.306691] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:56:23.657946] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-15T18:56:24.391158] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:56:24.393000] [INFO ] [REMOTE ] IHD: Full fetch complete (8120 records). [2025-09-15T18:56:24.393127] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-15T18:56:24.463004] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-15T18:56:24.764845] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-15T18:56:24.764934] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-15T18:56:24.765167] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-15T18:56:24.765216] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-15T18:56:24.765625] [DEBUG] [LOCAL ] IHD: Trimmed 8120 records to 5148 (keeping 150 days of data) [2025-09-15T18:56:24.796911] [DEBUG] [LOCAL ] IHD: Primary data saved (5148 records). [2025-09-15T18:56:24.797033] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-15T18:56:24.797144] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IHD took 23.3s. Estimated remaining: 2h 14m 41s. Rate: 9.4 symbols/min [2025-09-15T18:56:25.001023] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:25.007390] [DEBUG] [LOCAL ] IIF: Loaded 4212 existing records from primary storage. [2025-09-15T18:56:25.007507] [INFO ] [MAIN ] IIF: Loaded 4212 existing records. [2025-09-15T18:56:25.185442] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:25.185803] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-15T18:56:25.185871] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-15T18:56:25.186249] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-15T18:56:25.186323] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-15T18:56:25.262999] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-15T18:56:25.557842] [INFO ] [REMOTE ] IIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:25.578398] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:56:26.057893] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-15T18:56:26.658416] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:56:26.857838] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-15T18:56:27.236847] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:56:27.240330] [INFO ] [REMOTE ] IGR: Full fetch complete (33353 records). [2025-09-15T18:56:27.240411] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-15T18:56:27.615452] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-15T18:56:27.615548] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-15T18:56:27.616207] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-15T18:56:27.616317] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-15T18:56:27.617346] [DEBUG] [LOCAL ] IGR: Trimmed 33353 records to 22380 (keeping 150 days of data) [2025-09-15T18:56:27.669639] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-15T18:56:27.760274] [DEBUG] [LOCAL ] IGR: Primary data saved (22380 records). [2025-09-15T18:56:27.760433] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-15T18:56:27.760552] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IGR took 40.5s. Estimated remaining: 2h 14m 31s. Rate: 9.4 symbols/min [2025-09-15T18:56:27.956154] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:27.968492] [DEBUG] [LOCAL ] IIIN: Loaded 12082 existing records from primary storage. [2025-09-15T18:56:27.968613] [INFO ] [MAIN ] IIIN: Loaded 12082 existing records. [2025-09-15T18:56:28.150155] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:28.150401] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-15T18:56:28.150449] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-15T18:56:28.150917] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-15T18:56:28.150970] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-15T18:56:28.463057] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-15T18:56:28.522622] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:28.545730] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:56:28.697992] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:56:29.257879] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-15T18:56:29.679965] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:56:30.057883] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-15T18:56:30.457070] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:56:30.857882] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-15T18:56:31.239907] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:56:31.602032] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:56:31.657855] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-15T18:56:32.457839] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-15T18:56:32.926452] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:56:33.257881] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-15T18:56:33.495325] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:56:33.498145] [INFO ] [REMOTE ] IHG: Full fetch complete (27427 records). [2025-09-15T18:56:33.498229] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-15T18:56:33.864276] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-15T18:56:33.864360] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-15T18:56:33.864954] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-15T18:56:33.865011] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-15T18:56:33.865757] [DEBUG] [LOCAL ] IHG: Trimmed 27427 records to 17602 (keeping 150 days of data) [2025-09-15T18:56:33.984836] [DEBUG] [LOCAL ] IHG: Primary data saved (17602 records). [2025-09-15T18:56:33.984967] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-15T18:56:33.985056] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IHG took 27.4s. Estimated remaining: 2h 14m 25s. Rate: 9.4 symbols/min [2025-09-15T18:56:34.063102] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-15T18:56:34.157351] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:34.169856] [DEBUG] [LOCAL ] IIM: Loaded 11433 existing records from primary storage. [2025-09-15T18:56:34.169973] [INFO ] [MAIN ] IIM: Loaded 11433 existing records. [2025-09-15T18:56:34.344609] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:34.344856] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-15T18:56:34.344910] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-15T18:56:34.345311] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-15T18:56:34.345356] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-15T18:56:34.640017] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:56:34.693746] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:56:34.736277] [INFO ] [REMOTE ] IIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:34.857863] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-15T18:56:35.657873] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-15T18:56:35.700921] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:56:36.418027] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T18:56:36.457820] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-15T18:56:36.823877] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:56:37.257890] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-15T18:56:38.057880] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-15T18:56:38.264495] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:56:38.857914] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-15T18:56:38.952080] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:56:39.478774] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:56:39.657929] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-15T18:56:40.457908] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-15T18:56:40.911098] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:56:40.915695] [INFO ] [REMOTE ] IHS: Full fetch complete (41335 records). [2025-09-15T18:56:40.915856] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-15T18:56:41.050614] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T18:56:41.272280] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-15T18:56:41.321687] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-15T18:56:41.321787] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-15T18:56:41.322550] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-15T18:56:41.322591] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-15T18:56:41.323624] [DEBUG] [LOCAL ] IHS: Trimmed 41335 records to 29102 (keeping 150 days of data) [2025-09-15T18:56:41.496310] [DEBUG] [LOCAL ] IHS: Primary data saved (29102 records). [2025-09-15T18:56:41.496447] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-15T18:56:41.496541] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 29.7s. Estimated remaining: 2h 14m 20s. Rate: 9.4 symbols/min [2025-09-15T18:56:41.669738] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:41.689843] [DEBUG] [LOCAL ] IIPR: Loaded 20957 existing records from primary storage. [2025-09-15T18:56:41.689998] [INFO ] [MAIN ] IIPR: Loaded 20957 existing records. [2025-09-15T18:56:41.871403] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:41.871697] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-15T18:56:41.871746] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-15T18:56:41.872321] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-15T18:56:41.872368] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-15T18:56:42.059168] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-15T18:56:42.060379] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:56:42.254544] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:42.857899] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-15T18:56:43.085313] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:56:43.510506] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:56:43.657928] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-15T18:56:44.262013] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:56:44.457945] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-15T18:56:45.150333] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T18:56:45.257892] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-15T18:56:46.057871] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-15T18:56:46.520907] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:56:46.832936] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:56:46.857823] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-15T18:56:47.657886] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-15T18:56:47.734828] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:56:48.457878] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-15T18:56:48.556629] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T18:56:49.231723] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T18:56:49.234262] [INFO ] [REMOTE ] IIM: Full fetch complete (18388 records). [2025-09-15T18:56:49.234338] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-15T18:56:49.263130] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-15T18:56:49.597740] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-15T18:56:49.597823] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-15T18:56:49.598246] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-15T18:56:49.598288] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-15T18:56:49.598918] [DEBUG] [LOCAL ] IIM: Trimmed 18388 records to 11317 (keeping 150 days of data) [2025-09-15T18:56:49.670522] [DEBUG] [LOCAL ] IIM: Primary data saved (11317 records). [2025-09-15T18:56:49.670682] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-15T18:56:49.670768] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IIM took 15.7s. Estimated remaining: 2h 14m 15s. Rate: 9.4 symbols/min [2025-09-15T18:56:49.837468] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:49.872078] [DEBUG] [LOCAL ] IMAX: Loaded 32221 existing records from primary storage. [2025-09-15T18:56:49.872224] [INFO ] [MAIN ] IMAX: Loaded 32221 existing records. [2025-09-15T18:56:50.046219] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:50.046477] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-15T18:56:50.046526] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-15T18:56:50.047279] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-15T18:56:50.047330] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-15T18:56:50.067667] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-15T18:56:50.405474] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:50.681203] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:56:50.857894] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-15T18:56:51.137206] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:56:51.657913] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-15T18:56:52.017720] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:56:52.030346] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:56:52.031557] [INFO ] [REMOTE ] IIF: Full fetch complete (6530 records). [2025-09-15T18:56:52.031659] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-15T18:56:52.399036] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-15T18:56:52.399148] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-15T18:56:52.399361] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-15T18:56:52.399400] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-15T18:56:52.399809] [DEBUG] [LOCAL ] IIF: Trimmed 6530 records to 4027 (keeping 150 days of data) [2025-09-15T18:56:52.423848] [DEBUG] [LOCAL ] IIF: Primary data saved (4027 records). [2025-09-15T18:56:52.423955] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-15T18:56:52.424048] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIF took 27.6s. Estimated remaining: 2h 14m 5s. Rate: 9.4 symbols/min [2025-09-15T18:56:52.463819] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-15T18:56:52.599640] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:52.635560] [DEBUG] [LOCAL ] INFA: Loaded 37626 existing records from primary storage. [2025-09-15T18:56:52.635754] [INFO ] [MAIN ] INFA: Loaded 37626 existing records. [2025-09-15T18:56:52.815869] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:52.816139] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-15T18:56:52.816188] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-15T18:56:52.816987] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-15T18:56:52.817040] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-15T18:56:53.183682] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:53.257857] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-15T18:56:53.699122] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:56:54.057918] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-15T18:56:54.758478] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:56:54.857856] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-15T18:56:55.214625] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:56:55.657927] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-15T18:56:55.677810] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:56:56.457874] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-15T18:56:56.999478] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:56:57.173152] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:56:57.257870] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-15T18:56:58.057885] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-15T18:56:58.416248] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:56:58.857863] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-15T18:56:58.926915] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:56:58.928686] [INFO ] [REMOTE ] IIIN: Full fetch complete (18462 records). [2025-09-15T18:56:58.928756] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-15T18:56:59.289814] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-15T18:56:59.289894] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-15T18:56:59.290339] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-15T18:56:59.290379] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-15T18:56:59.290967] [DEBUG] [LOCAL ] IIIN: Trimmed 18462 records to 11671 (keeping 150 days of data) [2025-09-15T18:56:59.367251] [DEBUG] [LOCAL ] IIIN: Primary data saved (11671 records). [2025-09-15T18:56:59.367408] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-15T18:56:59.367508] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIIN took 31.6s. Estimated remaining: 2h 13m 59s. Rate: 9.4 symbols/min [2025-09-15T18:56:59.540707] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:59.582549] [DEBUG] [LOCAL ] INFY: Loaded 40348 existing records from primary storage. [2025-09-15T18:56:59.582732] [INFO ] [MAIN ] INFY: Loaded 40348 existing records. [2025-09-15T18:56:59.662980] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-15T18:56:59.762773] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:59.763018] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-15T18:56:59.763064] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-15T18:56:59.763788] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-15T18:56:59.763845] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-15T18:57:00.120374] [INFO ] [REMOTE ] INFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:00.331219] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:57:00.457847] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-15T18:57:00.603986] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:57:01.257895] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-15T18:57:01.575480] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:57:02.057915] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-15T18:57:02.577011] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:57:02.857909] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-15T18:57:03.267222] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T18:57:03.657905] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-15T18:57:04.239140] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T18:57:04.457873] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-15T18:57:05.136937] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:57:05.257917] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-15T18:57:05.936972] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:57:06.057858] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-15T18:57:06.857908] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-15T18:57:07.203615] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:57:07.249749] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:57:07.657869] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-15T18:57:08.390096] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:57:08.457915] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-15T18:57:09.119780] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:57:09.257867] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-15T18:57:09.420521] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:57:09.423673] [INFO ] [REMOTE ] IIPR: Full fetch complete (32098 records). [2025-09-15T18:57:09.423771] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-15T18:57:09.791420] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-15T18:57:09.791516] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-15T18:57:09.792110] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-15T18:57:09.792161] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-15T18:57:09.792961] [DEBUG] [LOCAL ] IIPR: Trimmed 32098 records to 20582 (keeping 150 days of data) [2025-09-15T18:57:09.923448] [DEBUG] [LOCAL ] IIPR: Primary data saved (20582 records). [2025-09-15T18:57:09.923582] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-15T18:57:09.923679] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 28.4s. Estimated remaining: 2h 13m 58s. Rate: 9.4 symbols/min [2025-09-15T18:57:10.063191] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-15T18:57:10.100454] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:10.144569] [DEBUG] [LOCAL ] ING: Loaded 38033 existing records from primary storage. [2025-09-15T18:57:10.145423] [INFO ] [MAIN ] ING: Loaded 38033 existing records. [2025-09-15T18:57:10.336575] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:10.336936] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-15T18:57:10.336989] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-15T18:57:10.337910] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-15T18:57:10.337973] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-15T18:57:10.708945] [INFO ] [REMOTE ] ING: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:10.723230] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:57:10.728820] [INFO ] [REMOTE ] IMAX: Full fetch complete (46194 records). [2025-09-15T18:57:10.728941] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-15T18:57:10.873188] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-15T18:57:11.119181] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-15T18:57:11.119264] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-15T18:57:11.120114] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-15T18:57:11.120168] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-15T18:57:11.121761] [DEBUG] [LOCAL ] IMAX: Trimmed 46194 records to 31543 (keeping 150 days of data) [2025-09-15T18:57:11.319568] [DEBUG] [LOCAL ] IMAX: Primary data saved (31543 records). [2025-09-15T18:57:11.319753] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-15T18:57:11.319865] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 21.6s. Estimated remaining: 2h 13m 46s. Rate: 9.4 symbols/min [2025-09-15T18:57:11.500827] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:11.531681] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:57:11.558896] [DEBUG] [LOCAL ] INGM: Loaded 20645 existing records from primary storage. [2025-09-15T18:57:11.559062] [INFO ] [MAIN ] INGM: Loaded 20645 existing records. [2025-09-15T18:57:11.662344] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-15T18:57:11.750087] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:11.750353] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-15T18:57:11.750402] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-15T18:57:11.751133] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-15T18:57:11.751190] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-15T18:57:12.113191] [INFO ] [REMOTE ] INGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:12.457903] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-15T18:57:12.553520] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:57:13.257886] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-15T18:57:13.343979] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:57:13.652002] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:57:14.057938] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-15T18:57:14.672605] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:57:14.857885] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-15T18:57:15.574517] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:57:15.657902] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-15T18:57:16.238735] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:57:16.457884] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-15T18:57:17.216849] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:57:17.257833] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-15T18:57:17.313632] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:57:18.057869] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-15T18:57:18.833433] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:57:18.857833] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-15T18:57:18.907440] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T18:57:19.657883] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-15T18:57:20.457875] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-15T18:57:20.627487] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:57:20.635329] [INFO ] [REMOTE ] INFY: Full fetch complete (58272 records). [2025-09-15T18:57:20.635451] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-15T18:57:21.020248] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-15T18:57:21.020377] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-15T18:57:21.021224] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-15T18:57:21.021334] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-15T18:57:21.033140] [DEBUG] [LOCAL ] INFY: Trimmed 58272 records to 39568 (keeping 150 days of data) [2025-09-15T18:57:21.051630] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:57:21.268948] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-15T18:57:21.303761] [DEBUG] [LOCAL ] INFY: Primary data saved (39568 records). [2025-09-15T18:57:21.303891] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-15T18:57:21.304453] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFY took 21.9s. Estimated remaining: 2h 13m 43s. Rate: 9.4 symbols/min [2025-09-15T18:57:21.475960] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:21.502497] [DEBUG] [LOCAL ] INGR: Loaded 24281 existing records from primary storage. [2025-09-15T18:57:21.502670] [INFO ] [MAIN ] INGR: Loaded 24281 existing records. [2025-09-15T18:57:21.717627] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:21.718108] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-15T18:57:21.718168] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-15T18:57:21.719093] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-15T18:57:21.719155] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-15T18:57:21.868248] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:57:22.062898] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-15T18:57:22.132290] [INFO ] [REMOTE ] INGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:22.498423] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:57:22.857887] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-15T18:57:23.335628] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:57:23.657879] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-15T18:57:24.101571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:57:24.457933] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-15T18:57:24.476519] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:57:25.257876] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-15T18:57:25.752558] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:57:26.057892] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-15T18:57:26.226663] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:57:26.857873] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-15T18:57:27.657856] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-15T18:57:27.740291] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:57:28.457866] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-15T18:57:28.596206] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:57:29.230184] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:57:29.235598] [INFO ] [REMOTE ] INFA: Full fetch complete (54700 records). [2025-09-15T18:57:29.235730] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-15T18:57:29.267438] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-15T18:57:29.624046] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-15T18:57:29.624162] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-15T18:57:29.625062] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-15T18:57:29.625113] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-15T18:57:29.626372] [DEBUG] [LOCAL ] INFA: Trimmed 54700 records to 36912 (keeping 150 days of data) [2025-09-15T18:57:29.856585] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:57:29.881292] [DEBUG] [LOCAL ] INFA: Primary data saved (36912 records). [2025-09-15T18:57:29.881416] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-15T18:57:29.881492] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFA took 37.5s. Estimated remaining: 2h 13m 40s. Rate: 9.4 symbols/min [2025-09-15T18:57:30.056106] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:30.057868] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-15T18:57:30.087690] [DEBUG] [LOCAL ] INN: Loaded 31920 existing records from primary storage. [2025-09-15T18:57:30.087830] [INFO ] [MAIN ] INN: Loaded 31920 existing records. [2025-09-15T18:57:30.267196] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:30.267486] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-15T18:57:30.267543] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-15T18:57:30.268271] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-15T18:57:30.268323] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-15T18:57:30.663027] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:57:30.682158] [INFO ] [REMOTE ] INN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:30.857871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-15T18:57:31.389022] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:57:31.657875] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-15T18:57:31.877580] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:57:32.457864] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-15T18:57:32.489016] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:57:33.257943] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-15T18:57:33.826924] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:57:34.057853] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-15T18:57:34.352971] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:57:34.356225] [INFO ] [REMOTE ] INGM: Full fetch complete (31575 records). [2025-09-15T18:57:34.356317] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-15T18:57:34.747468] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-15T18:57:34.747556] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-15T18:57:34.748211] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-15T18:57:34.748257] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-15T18:57:34.749049] [DEBUG] [LOCAL ] INGM: Trimmed 31575 records to 20005 (keeping 150 days of data) [2025-09-15T18:57:34.863845] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-15T18:57:34.896487] [DEBUG] [LOCAL ] INGM: Primary data saved (20005 records). [2025-09-15T18:57:34.896888] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-15T18:57:34.897031] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INGM took 23.6s. Estimated remaining: 2h 13m 32s. Rate: 9.4 symbols/min [2025-09-15T18:57:35.121614] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:35.151629] [DEBUG] [LOCAL ] INR: Loaded 19412 existing records from primary storage. [2025-09-15T18:57:35.151900] [INFO ] [MAIN ] INR: Loaded 19412 existing records. [2025-09-15T18:57:35.415290] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:35.416010] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-15T18:57:35.416091] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-15T18:57:35.429820] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-15T18:57:35.449388] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-15T18:57:35.455710] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:57:35.671213] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-15T18:57:35.974032] [INFO ] [REMOTE ] INR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:36.428252] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T18:57:36.434119] [INFO ] [REMOTE ] ING: Full fetch complete (55236 records). [2025-09-15T18:57:36.434270] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-15T18:57:36.467534] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-15T18:57:36.825026] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-15T18:57:36.825111] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-15T18:57:36.825919] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-15T18:57:36.825980] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-15T18:57:36.827210] [DEBUG] [LOCAL ] ING: Trimmed 55236 records to 37270 (keeping 150 days of data) [2025-09-15T18:57:37.067750] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:57:37.104875] [DEBUG] [LOCAL ] ING: Primary data saved (37270 records). [2025-09-15T18:57:37.105054] [INFO ] [MAIN ] ING: Full history saved. [2025-09-15T18:57:37.106214] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. ING took 27.2s. Estimated remaining: 2h 13m 21s. Rate: 9.4 symbols/min [2025-09-15T18:57:37.273538] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-15T18:57:37.277042] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:37.311837] [DEBUG] [LOCAL ] INSP: Loaded 28161 existing records from primary storage. [2025-09-15T18:57:37.311992] [INFO ] [MAIN ] INSP: Loaded 28161 existing records. [2025-09-15T18:57:37.491056] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:37.491364] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-15T18:57:37.491414] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-15T18:57:37.492193] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-15T18:57:37.492263] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-15T18:57:37.855434] [INFO ] [REMOTE ] INSP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:37.877608] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:57:38.057917] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-15T18:57:38.305080] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:57:38.857914] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-15T18:57:39.364435] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:57:39.658127] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-15T18:57:39.987825] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:57:40.457873] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-15T18:57:41.175180] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:57:41.257861] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-15T18:57:41.393224] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:57:42.057933] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-15T18:57:42.348898] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T18:57:42.857940] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-15T18:57:43.280145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:57:43.657906] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-15T18:57:43.751910] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T18:57:44.457906] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-15T18:57:44.655348] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:57:44.659596] [INFO ] [REMOTE ] INGR: Full fetch complete (36768 records). [2025-09-15T18:57:44.659734] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-15T18:57:45.034754] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-15T18:57:45.034839] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-15T18:57:45.035480] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-15T18:57:45.035520] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-15T18:57:45.036360] [DEBUG] [LOCAL ] INGR: Trimmed 36768 records to 23872 (keeping 150 days of data) [2025-09-15T18:57:45.182693] [DEBUG] [LOCAL ] INGR: Primary data saved (23872 records). [2025-09-15T18:57:45.182827] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-15T18:57:45.182928] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. INGR took 23.9s. Estimated remaining: 2h 13m 16s. Rate: 9.4 symbols/min [2025-09-15T18:57:45.263110] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-15T18:57:45.353110] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:45.382217] [DEBUG] [LOCAL ] INSW: Loaded 29866 existing records from primary storage. [2025-09-15T18:57:45.382353] [INFO ] [MAIN ] INSW: Loaded 29866 existing records. [2025-09-15T18:57:45.560007] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:45.560226] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-15T18:57:45.560316] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-15T18:57:45.561141] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-15T18:57:45.561193] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-15T18:57:45.921672] [INFO ] [REMOTE ] INSW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:45.946101] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:57:46.057887] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-15T18:57:46.511152] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:57:46.857947] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-15T18:57:47.155668] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:57:47.657878] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-15T18:57:48.245043] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:57:48.361247] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T18:57:48.457871] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-15T18:57:49.257889] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-15T18:57:49.505821] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:57:50.057872] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-15T18:57:50.519421] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T18:57:50.857941] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-15T18:57:51.109218] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:57:51.657956] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-15T18:57:52.230408] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:57:52.457865] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-15T18:57:52.590964] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:57:53.257889] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-15T18:57:53.600466] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:57:54.057821] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-15T18:57:54.458827] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:57:54.465143] [INFO ] [REMOTE ] INN: Full fetch complete (45030 records). [2025-09-15T18:57:54.465338] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-15T18:57:54.849064] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-15T18:57:54.849144] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-15T18:57:54.849855] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-15T18:57:54.849899] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-15T18:57:54.850867] [DEBUG] [LOCAL ] INN: Trimmed 45030 records to 31262 (keeping 150 days of data) [2025-09-15T18:57:54.902228] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-15T18:57:55.039955] [DEBUG] [LOCAL ] INN: Primary data saved (31262 records). [2025-09-15T18:57:55.040092] [INFO ] [MAIN ] INN: Full history saved. [2025-09-15T18:57:55.040174] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INN took 25.2s. Estimated remaining: 2h 13m 14s. Rate: 9.4 symbols/min [2025-09-15T18:57:55.217376] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:55.280873] [DEBUG] [LOCAL ] INVH: Loaded 39992 existing records from primary storage. [2025-09-15T18:57:55.282572] [INFO ] [MAIN ] INVH: Loaded 39992 existing records. [2025-09-15T18:57:55.282340] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:57:55.473990] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:55.474355] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-15T18:57:55.474415] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-15T18:57:55.475338] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-15T18:57:55.475389] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-15T18:57:55.663584] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-15T18:57:55.846526] [INFO ] [REMOTE ] INVH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:56.231793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T18:57:56.457901] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-15T18:57:56.903423] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:57:56.906863] [INFO ] [REMOTE ] INR: Full fetch complete (29767 records). [2025-09-15T18:57:56.906945] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-15T18:57:57.272321] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-15T18:57:57.287964] [DEBUG] [VALIDATOR ] INR: All expected trading days are present. [2025-09-15T18:57:57.288093] [DEBUG] [VALIDATOR ] INR: Primary data validation passed. [2025-09-15T18:57:57.288984] [INFO ] [MAIN ] INR: Fetched primary data is valid. [2025-09-15T18:57:57.289038] [DEBUG] [LOCAL ] INR: Saving primary data. [2025-09-15T18:57:57.290404] [DEBUG] [LOCAL ] INR: Trimmed 29767 records to 19051 (keeping 150 days of data) [2025-09-15T18:57:57.414580] [DEBUG] [LOCAL ] INR: Primary data saved (19051 records). [2025-09-15T18:57:57.414827] [INFO ] [MAIN ] INR: Full history saved. [2025-09-15T18:57:57.414954] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INR took 22.5s. Estimated remaining: 2h 13m 3s. Rate: 9.4 symbols/min [2025-09-15T18:57:57.593821] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:57.617843] [DEBUG] [LOCAL ] INVX: Loaded 21811 existing records from primary storage. [2025-09-15T18:57:57.618104] [INFO ] [MAIN ] INVX: Loaded 21811 existing records. [2025-09-15T18:57:57.802427] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:57.803033] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-15T18:57:57.803105] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-15T18:57:57.803862] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-15T18:57:57.803928] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-15T18:57:57.950612] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:57:58.066994] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-15T18:57:58.225385] [INFO ] [REMOTE ] INVX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:58.810254] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:57:58.857816] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-15T18:57:59.243793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:57:59.657845] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-15T18:58:00.140943] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:58:00.457909] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-15T18:58:01.257908] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-15T18:58:01.304238] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:58:02.005249] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:58:02.057887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-15T18:58:02.478632] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:58:02.483841] [INFO ] [REMOTE ] INSP: Full fetch complete (39673 records). [2025-09-15T18:58:02.483936] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-15T18:58:02.857819] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-15T18:58:02.858206] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-15T18:58:02.858029] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-15T18:58:02.858994] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-15T18:58:02.859051] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-15T18:58:02.860761] [DEBUG] [LOCAL ] INSP: Trimmed 39673 records to 27714 (keeping 150 days of data) [2025-09-15T18:58:03.032420] [DEBUG] [LOCAL ] INSP: Primary data saved (27714 records). [2025-09-15T18:58:03.032593] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-15T18:58:03.032735] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 25.9s. Estimated remaining: 2h 12m 56s. Rate: 9.4 symbols/min [2025-09-15T18:58:03.203323] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:03.242760] [DEBUG] [LOCAL ] IONQ: Loaded 40528 existing records from primary storage. [2025-09-15T18:58:03.242927] [INFO ] [MAIN ] IONQ: Loaded 40528 existing records. [2025-09-15T18:58:03.421729] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:03.422022] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-15T18:58:03.422075] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-15T18:58:03.422891] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-15T18:58:03.422942] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-15T18:58:03.668768] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-15T18:58:03.777486] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:03.814173] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:58:04.230239] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:58:04.457887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-15T18:58:05.137703] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T18:58:05.257882] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-15T18:58:06.060281] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-15T18:58:06.063279] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T18:58:06.857948] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-15T18:58:07.555440] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-15T18:58:07.612818] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:58:07.617168] [INFO ] [REMOTE ] INSW: Full fetch complete (44660 records). [2025-09-15T18:58:07.617257] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-15T18:58:07.662952] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-15T18:58:08.002983] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-15T18:58:08.003145] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-15T18:58:08.003847] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-15T18:58:08.004008] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-15T18:58:08.005110] [DEBUG] [LOCAL ] INSW: Trimmed 44660 records to 29210 (keeping 150 days of data) [2025-09-15T18:58:08.189902] [DEBUG] [LOCAL ] INSW: Primary data saved (29210 records). [2025-09-15T18:58:08.190046] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-15T18:58:08.190132] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSW took 23.0s. Estimated remaining: 2h 12m 48s. Rate: 9.4 symbols/min [2025-09-15T18:58:08.359740] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:08.398935] [DEBUG] [LOCAL ] IOT: Loaded 40234 existing records from primary storage. [2025-09-15T18:58:08.399075] [INFO ] [MAIN ] IOT: Loaded 40234 existing records. [2025-09-15T18:58:08.467715] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-15T18:58:08.583537] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:08.584159] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-15T18:58:08.584319] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-15T18:58:08.595002] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-15T18:58:08.612883] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-15T18:58:08.626079] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:58:08.743423] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:58:08.997732] [INFO ] [REMOTE ] IOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:09.257846] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-15T18:58:10.057936] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-15T18:58:10.701998] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:58:10.857833] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-15T18:58:10.951898] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-15T18:58:11.251831] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:58:11.657874] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-15T18:58:12.021142] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:58:12.457964] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-15T18:58:13.257906] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-15T18:58:13.573593] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:58:13.871205] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:58:13.877023] [INFO ] [REMOTE ] INVH: Full fetch complete (57706 records). [2025-09-15T18:58:13.877122] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-15T18:58:14.069321] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-15T18:58:14.266608] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-15T18:58:14.266703] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-15T18:58:14.267484] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-15T18:58:14.267525] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-15T18:58:14.268617] [DEBUG] [LOCAL ] INVH: Trimmed 57706 records to 39223 (keeping 150 days of data) [2025-09-15T18:58:14.509116] [DEBUG] [LOCAL ] INVH: Primary data saved (39223 records). [2025-09-15T18:58:14.509280] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-15T18:58:14.509397] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVH took 19.5s. Estimated remaining: 2h 12m 42s. Rate: 9.4 symbols/min [2025-09-15T18:58:14.678330] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:14.714798] [DEBUG] [LOCAL ] IP: Loaded 40086 existing records from primary storage. [2025-09-15T18:58:14.714941] [INFO ] [MAIN ] IP: Loaded 40086 existing records. [2025-09-15T18:58:14.862988] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-15T18:58:14.900265] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:14.900479] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-15T18:58:14.900544] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-15T18:58:14.901615] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-15T18:58:14.901706] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-15T18:58:15.251576] [INFO ] [REMOTE ] IP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:15.479824] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:58:15.517165] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-15T18:58:15.657830] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-15T18:58:16.275549] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:58:16.457837] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-15T18:58:16.832103] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T18:58:17.257866] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-15T18:58:18.057853] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-15T18:58:18.156373] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:58:18.335704] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:58:18.857912] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-15T18:58:19.657838] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-15T18:58:19.712625] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:58:20.457843] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-15T18:58:20.561010] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T18:58:21.257877] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-15T18:58:21.430937] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:58:22.057862] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-15T18:58:22.110491] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:58:22.167997] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:58:22.857871] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-15T18:58:23.516492] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:58:23.657849] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-15T18:58:23.905700] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:58:23.908853] [INFO ] [REMOTE ] INVX: Full fetch complete (31911 records). [2025-09-15T18:58:23.908950] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-15T18:58:24.283398] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-15T18:58:24.283491] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-15T18:58:24.284214] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-15T18:58:24.284271] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-15T18:58:24.285230] [DEBUG] [LOCAL ] INVX: Trimmed 31911 records to 21242 (keeping 150 days of data) [2025-09-15T18:58:24.417199] [DEBUG] [LOCAL ] INVX: Primary data saved (21242 records). [2025-09-15T18:58:24.417330] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-15T18:58:24.417443] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVX took 27.0s. Estimated remaining: 2h 12m 39s. Rate: 9.4 symbols/min [2025-09-15T18:58:24.457831] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-15T18:58:25.138337] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:58:25.257873] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-15T18:58:26.057888] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-15T18:58:26.338957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:58:26.857867] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-15T18:58:27.110883] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T18:58:27.657855] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-15T18:58:27.709853] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:58:27.715722] [INFO ] [REMOTE ] IOT: Full fetch complete (58130 records). [2025-09-15T18:58:27.715831] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-15T18:58:28.121200] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-15T18:58:28.121430] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-15T18:58:28.123076] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-15T18:58:28.123327] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-15T18:58:28.125694] [DEBUG] [LOCAL ] IOT: Trimmed 58130 records to 39479 (keeping 150 days of data) [2025-09-15T18:58:28.390373] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:58:28.441710] [DEBUG] [LOCAL ] IOT: Primary data saved (39479 records). [2025-09-15T18:58:28.441894] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-15T18:58:28.442564] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 20.3s. Estimated remaining: 2h 12m 30s. Rate: 9.4 symbols/min [2025-09-15T18:58:28.457936] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-15T18:58:30.008778] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:58:30.020341] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-15T18:58:30.059524] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T18:58:30.072365] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-15T18:58:31.549942] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:58:31.561336] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-15T18:58:32.744104] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-15T18:58:32.755571] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-15T18:58:33.030699] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:58:33.042602] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-15T18:58:34.752446] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:58:34.763801] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-15T18:58:35.242094] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-15T18:58:35.248105] [INFO ] [REMOTE ] IONQ: Full fetch complete (58468 records). [2025-09-15T18:58:35.248218] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-15T18:58:35.635459] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-15T18:58:35.635578] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-15T18:58:35.636405] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-15T18:58:35.636457] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-15T18:58:35.637614] [DEBUG] [LOCAL ] IONQ: Trimmed 58468 records to 39748 (keeping 150 days of data) [2025-09-15T18:58:35.880057] [DEBUG] [LOCAL ] IONQ: Primary data saved (39748 records). [2025-09-15T18:58:35.880203] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-15T18:58:35.880939] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 32.8s. Estimated remaining: 2h 12m 25s. Rate: 9.4 symbols/min [2025-09-15T18:58:36.282536] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:58:36.288398] [INFO ] [REMOTE ] IP: Full fetch complete (58004 records). [2025-09-15T18:58:36.288507] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-15T18:58:36.664312] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-15T18:58:36.664392] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-15T18:58:36.665196] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-15T18:58:36.665244] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-15T18:58:36.666391] [DEBUG] [LOCAL ] IP: Trimmed 58004 records to 39314 (keeping 150 days of data) [2025-09-15T18:58:36.910781] [DEBUG] [LOCAL ] IP: Primary data saved (39314 records). [2025-09-15T18:58:36.910932] [INFO ] [MAIN ] IP: Full history saved. [2025-09-15T18:58:36.911016] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 22.4s. Estimated remaining: 2h 12m 13s. Rate: 9.4 symbols/min [2025-09-15T18:58:37.550369] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.649992] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.645220] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.646563] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.673255] [DEBUG] [LOCAL ] IPI: Loaded 15746 existing records from primary storage. [2025-09-15T18:58:37.673540] [INFO ] [MAIN ] IPI: Loaded 15746 existing records. [2025-09-15T18:58:37.733083] [DEBUG] [LOCAL ] IQI: Loaded 13766 existing records from primary storage. [2025-09-15T18:58:37.750204] [INFO ] [MAIN ] IQI: Loaded 13766 existing records. [2025-09-15T18:58:38.003094] [DEBUG] [LOCAL ] IPG: Loaded 40092 existing records from primary storage. [2025-09-15T18:58:38.002020] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.009622] [INFO ] [MAIN ] IPG: Loaded 40092 existing records. [2025-09-15T18:58:38.029345] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.044632] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-15T18:58:38.092814] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-15T18:58:38.122441] [DEBUG] [LOCAL ] IQV: Loaded 37989 existing records from primary storage. [2025-09-15T18:58:38.165886] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-15T18:58:38.181406] [INFO ] [MAIN ] IQV: Loaded 37989 existing records. [2025-09-15T18:58:38.234885] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.393118] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.468418] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.492433] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.468260] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-15T18:58:38.493022] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-15T18:58:38.503536] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-15T18:58:38.524466] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-15T18:58:38.557200] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-15T18:58:38.562425] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-15T18:58:38.769007] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.905292] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.941381] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-15T18:58:39.013687] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-15T18:58:39.125262] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-15T18:58:39.283451] [INFO ] [REMOTE ] IPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.402592] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-15T18:58:39.691107] [INFO ] [REMOTE ] IPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.762290] [INFO ] [REMOTE ] IQI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.762577] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-15T18:58:39.786906] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-15T18:58:39.952137] [INFO ] [REMOTE ] IQV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.952503] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-15T18:58:40.142561] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:58:40.146591] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-15T18:58:40.544821] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:58:40.550048] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-15T18:58:40.897406] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:58:40.902576] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-15T18:58:40.990259] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:58:41.000389] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-15T18:58:41.402618] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:58:41.422506] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-15T18:58:41.423928] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T18:58:41.427941] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-15T18:58:42.009580] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:58:42.057832] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-15T18:58:42.107897] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:58:42.357394] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:58:42.857885] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-15T18:58:42.973159] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:58:43.210490] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:58:43.657910] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-15T18:58:44.168870] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:58:44.457905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-15T18:58:45.054438] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:58:45.257877] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-15T18:58:46.057849] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-15T18:58:46.151287] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:58:46.255376] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:58:46.664954] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T18:58:46.857866] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-15T18:58:47.657881] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-15T18:58:47.773022] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:58:48.457939] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-15T18:58:48.926447] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:58:49.257916] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-15T18:58:49.653029] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:58:50.057893] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-15T18:58:50.198693] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:58:50.857888] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-15T18:58:51.487255] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:58:51.657878] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-15T18:58:51.675612] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:58:52.457927] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-15T18:58:52.633525] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:58:53.257864] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-15T18:58:53.434866] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:58:53.437889] [INFO ] [REMOTE ] IPI: Full fetch complete (22864 records). [2025-09-15T18:58:53.437972] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-15T18:58:53.812808] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-15T18:58:53.812908] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-15T18:58:53.813418] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-15T18:58:53.813467] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-15T18:58:53.814143] [DEBUG] [LOCAL ] IPI: Trimmed 22864 records to 15432 (keeping 150 days of data) [2025-09-15T18:58:53.907006] [DEBUG] [LOCAL ] IPI: Primary data saved (15432 records). [2025-09-15T18:58:53.907157] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-15T18:58:53.907247] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IPI took 17.0s. Estimated remaining: 2h 12m 18s. Rate: 9.4 symbols/min [2025-09-15T18:58:54.073575] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-15T18:58:54.075974] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:54.117587] [DEBUG] [LOCAL ] IR: Loaded 39643 existing records from primary storage. [2025-09-15T18:58:54.117755] [INFO ] [MAIN ] IR: Loaded 39643 existing records. [2025-09-15T18:58:54.298612] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:54.298927] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-15T18:58:54.298975] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-15T18:58:54.299880] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-15T18:58:54.299939] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-15T18:58:54.666060] [INFO ] [REMOTE ] IR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:54.733343] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:58:54.857897] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-15T18:58:55.657899] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-15T18:58:55.867010] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:58:56.100516] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:58:56.457875] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-15T18:58:56.887100] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:58:57.257890] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-15T18:58:57.692068] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:58:57.697262] [INFO ] [REMOTE ] IQV: Full fetch complete (54907 records). [2025-09-15T18:58:57.697371] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-15T18:58:58.076324] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-15T18:58:58.095753] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-15T18:58:58.095819] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-15T18:58:58.096667] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-15T18:58:58.096715] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-15T18:58:58.099252] [DEBUG] [LOCAL ] IQV: Trimmed 54907 records to 37209 (keeping 150 days of data) [2025-09-15T18:58:58.339095] [DEBUG] [LOCAL ] IQV: Primary data saved (37209 records). [2025-09-15T18:58:58.339256] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-15T18:58:58.339383] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IQV took 21.4s. Estimated remaining: 2h 12m 10s. Rate: 9.4 symbols/min [2025-09-15T18:58:58.512141] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:58.547016] [DEBUG] [LOCAL ] IRM: Loaded 36689 existing records from primary storage. [2025-09-15T18:58:58.547156] [INFO ] [MAIN ] IRM: Loaded 36689 existing records. [2025-09-15T18:58:58.722043] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:58.722296] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-15T18:58:58.722342] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-15T18:58:58.723114] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-15T18:58:58.723166] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-15T18:58:58.867624] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-15T18:58:59.081784] [INFO ] [REMOTE ] IRM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:59.114472] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T18:58:59.657838] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-15T18:58:59.831794] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T18:58:59.962182] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:59:00.457936] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-15T18:59:01.107858] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:59:01.257871] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-15T18:59:02.057875] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-15T18:59:02.228653] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:59:02.727739] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:59:02.734096] [INFO ] [REMOTE ] IPG: Full fetch complete (58005 records). [2025-09-15T18:59:02.734237] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-15T18:59:02.873241] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-15T18:59:03.064236] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T18:59:03.113153] [INFO ] [REMOTE ] IQI: Full fetch complete (20129 records). [2025-09-15T18:59:03.131544] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-15T18:59:03.131423] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-15T18:59:03.131618] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-15T18:59:03.132568] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-15T18:59:03.132681] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-15T18:59:03.243097] [DEBUG] [LOCAL ] IPG: Trimmed 58005 records to 39313 (keeping 150 days of data) [2025-09-15T18:59:03.665717] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-15T18:59:03.751124] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-15T18:59:03.751534] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-15T18:59:03.760562] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-15T18:59:03.759992] [DEBUG] [LOCAL ] IPG: Primary data saved (39313 records). [2025-09-15T18:59:03.760743] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-15T18:59:03.760932] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-15T18:59:03.762250] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPG took 26.8s. Estimated remaining: 2h 12m 3s. Rate: 9.4 symbols/min [2025-09-15T18:59:03.828129] [DEBUG] [LOCAL ] IQI: Trimmed 20129 records to 13437 (keeping 150 days of data) [2025-09-15T18:59:04.002808] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:04.047497] [DEBUG] [LOCAL ] IRS: Loaded 16383 existing records from primary storage. [2025-09-15T18:59:04.048706] [INFO ] [MAIN ] IRS: Loaded 16383 existing records. [2025-09-15T18:59:04.132742] [DEBUG] [LOCAL ] IQI: Primary data saved (13437 records). [2025-09-15T18:59:04.151402] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-15T18:59:04.153719] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IQI took 27.2s. Estimated remaining: 2h 11m 50s. Rate: 9.4 symbols/min [2025-09-15T18:59:04.351754] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:04.367358] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-15T18:59:04.372547] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-15T18:59:04.402497] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-15T18:59:04.425268] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-15T18:59:04.426687] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:04.811774] [INFO ] [REMOTE ] IRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:04.812210] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-15T18:59:04.813112] [DEBUG] [LOCAL ] IRT: Loaded 37875 existing records from primary storage. [2025-09-15T18:59:04.813321] [INFO ] [MAIN ] IRT: Loaded 37875 existing records. [2025-09-15T18:59:05.003192] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:05.003570] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-15T18:59:05.003727] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-15T18:59:05.014504] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-15T18:59:05.032129] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-15T18:59:05.056664] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-15T18:59:05.264678] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-15T18:59:05.408119] [INFO ] [REMOTE ] IRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:05.439517] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T18:59:05.695262] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:59:06.057895] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-15T18:59:06.759988] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:59:06.813057] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:59:06.857853] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-15T18:59:07.657926] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-15T18:59:08.457898] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-15T18:59:08.620110] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:59:08.988349] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:59:09.225217] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T18:59:09.257816] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-15T18:59:10.057878] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-15T18:59:10.293361] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:59:10.857928] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-15T18:59:11.605304] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:59:11.657815] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-15T18:59:11.685450] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:59:12.457899] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-15T18:59:13.257889] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-15T18:59:13.344958] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:59:13.934042] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:59:14.057877] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-15T18:59:14.859349] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-15T18:59:14.862220] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:59:15.611964] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:59:15.659762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-15T18:59:15.665865] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:59:16.457889] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-15T18:59:16.707283] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:59:17.257886] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-15T18:59:17.861175] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:59:17.867872] [INFO ] [REMOTE ] IR: Full fetch complete (57332 records). [2025-09-15T18:59:17.868036] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-15T18:59:18.063170] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-15T18:59:18.264263] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-15T18:59:18.264396] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-15T18:59:18.265287] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-15T18:59:18.265360] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-15T18:59:18.277103] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:59:18.277232] [DEBUG] [LOCAL ] IR: Trimmed 57332 records to 38888 (keeping 150 days of data) [2025-09-15T18:59:18.282058] [INFO ] [REMOTE ] IRS: Full fetch complete (22813 records). [2025-09-15T18:59:18.282158] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-15T18:59:18.753444] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-15T18:59:18.754046] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-15T18:59:18.755127] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-15T18:59:18.755449] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-15T18:59:18.758397] [DEBUG] [LOCAL ] IRS: Trimmed 22813 records to 16167 (keeping 150 days of data) [2025-09-15T18:59:18.860073] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-15T18:59:18.871705] [DEBUG] [LOCAL ] IRS: Primary data saved (16167 records). [2025-09-15T18:59:18.872138] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-15T18:59:18.872470] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 15.1s. Estimated remaining: 2h 11m 52s. Rate: 9.4 symbols/min [2025-09-15T18:59:19.114690] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:19.158923] [DEBUG] [LOCAL ] ISD: Loaded 11353 existing records from primary storage. [2025-09-15T18:59:19.161313] [INFO ] [MAIN ] ISD: Loaded 11353 existing records. [2025-09-15T18:59:19.349589] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:19.352790] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-15T18:59:19.353888] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-15T18:59:19.355485] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-15T18:59:19.356070] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-15T18:59:19.466227] [DEBUG] [LOCAL ] IR: Primary data saved (38888 records). [2025-09-15T18:59:19.476512] [INFO ] [MAIN ] IR: Full history saved. [2025-09-15T18:59:19.477473] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 25.6s. Estimated remaining: 2h 11m 40s. Rate: 9.4 symbols/min [2025-09-15T18:59:19.853868] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:19.926693] [INFO ] [REMOTE ] ISD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:19.927027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-15T18:59:19.959796] [DEBUG] [LOCAL ] IT: Loaded 31043 existing records from primary storage. [2025-09-15T18:59:19.960022] [INFO ] [MAIN ] IT: Loaded 31043 existing records. [2025-09-15T18:59:20.093931] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:59:20.174302] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:20.174559] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-15T18:59:20.174670] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-15T18:59:20.175383] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-15T18:59:20.175436] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-15T18:59:20.462536] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-15T18:59:20.523190] [INFO ] [REMOTE ] IT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:20.556994] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T18:59:20.867240] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:59:21.257940] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-15T18:59:22.012036] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:59:22.057911] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-15T18:59:22.335554] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:59:22.857868] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-15T18:59:23.657921] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-15T18:59:24.322510] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-15T18:59:24.457863] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-15T18:59:25.257878] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-15T18:59:25.414603] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-15T18:59:25.479361] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:59:26.057887] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-15T18:59:26.160198] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:59:26.272741] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:59:26.857924] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-15T18:59:27.221670] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:59:27.657874] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-15T18:59:27.872781] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:59:28.457951] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-15T18:59:29.257945] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-15T18:59:29.382683] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T18:59:29.388301] [INFO ] [REMOTE ] IRM: Full fetch complete (54103 records). [2025-09-15T18:59:29.388448] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-15T18:59:29.783452] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-15T18:59:29.783657] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-15T18:59:29.787055] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-15T18:59:29.794240] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-15T18:59:29.808111] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:59:29.816596] [DEBUG] [LOCAL ] IRM: Trimmed 54103 records to 36011 (keeping 150 days of data) [2025-09-15T18:59:30.053510] [DEBUG] [LOCAL ] IRM: Primary data saved (36011 records). [2025-09-15T18:59:30.053672] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-15T18:59:30.053771] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 31.7s. Estimated remaining: 2h 11m 38s. Rate: 9.4 symbols/min [2025-09-15T18:59:30.065282] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-15T18:59:30.231986] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:30.255537] [DEBUG] [LOCAL ] ITGR: Loaded 22907 existing records from primary storage. [2025-09-15T18:59:30.255690] [INFO ] [MAIN ] ITGR: Loaded 22907 existing records. [2025-09-15T18:59:30.436941] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:30.437191] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-15T18:59:30.437243] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-15T18:59:30.437957] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-15T18:59:30.438008] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-15T18:59:30.805814] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:30.836849] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:59:30.857876] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-15T18:59:30.869275] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:59:31.657878] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-15T18:59:32.006957] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:59:32.457870] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-15T18:59:33.174106] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:59:33.179587] [INFO ] [REMOTE ] IRT: Full fetch complete (54776 records). [2025-09-15T18:59:33.179731] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-15T18:59:33.262955] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-15T18:59:33.571526] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-15T18:59:33.571787] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-15T18:59:33.572680] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-15T18:59:33.572779] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-15T18:59:33.580889] [DEBUG] [LOCAL ] IRT: Trimmed 54776 records to 37200 (keeping 150 days of data) [2025-09-15T18:59:33.595105] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:59:33.833850] [DEBUG] [LOCAL ] IRT: Primary data saved (37200 records). [2025-09-15T18:59:33.834009] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-15T18:59:33.834099] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRT took 29.7s. Estimated remaining: 2h 11m 29s. Rate: 9.4 symbols/min [2025-09-15T18:59:34.010165] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:34.039731] [DEBUG] [LOCAL ] ITT: Loaded 24053 existing records from primary storage. [2025-09-15T18:59:34.039991] [INFO ] [MAIN ] ITT: Loaded 24053 existing records. [2025-09-15T18:59:34.063029] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-15T18:59:34.231283] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:34.231860] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-15T18:59:34.231981] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-15T18:59:34.238013] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-15T18:59:34.242986] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-15T18:59:34.278227] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:59:34.601901] [INFO ] [REMOTE ] ITT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:34.857864] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-15T18:59:35.255261] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:59:35.536488] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:59:35.657833] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-15T18:59:36.457877] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-15T18:59:37.146048] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:59:37.257833] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-15T18:59:38.058617] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-15T18:59:38.063617] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:59:38.106565] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T18:59:38.857863] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-15T18:59:39.657951] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-15T18:59:40.215035] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-15T18:59:40.457883] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-15T18:59:40.578780] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T18:59:40.580929] [INFO ] [REMOTE ] ISD: Full fetch complete (17301 records). [2025-09-15T18:59:40.581014] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-15T18:59:40.945837] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-15T18:59:40.945983] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-15T18:59:40.946376] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-15T18:59:40.946447] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-15T18:59:40.947328] [DEBUG] [LOCAL ] ISD: Trimmed 17301 records to 11068 (keeping 150 days of data) [2025-09-15T18:59:41.016516] [DEBUG] [LOCAL ] ISD: Primary data saved (11068 records). [2025-09-15T18:59:41.016826] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-15T18:59:41.016972] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. ISD took 22.1s. Estimated remaining: 2h 11m 23s. Rate: 9.4 symbols/min [2025-09-15T18:59:41.190406] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:41.218888] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:59:41.263841] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-15T18:59:41.266987] [DEBUG] [LOCAL ] ITUB: Loaded 40153 existing records from primary storage. [2025-09-15T18:59:41.267213] [INFO ] [MAIN ] ITUB: Loaded 40153 existing records. [2025-09-15T18:59:41.457517] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:41.457994] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-15T18:59:41.458086] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-15T18:59:41.459128] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-15T18:59:41.459186] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-15T18:59:41.685041] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:59:41.875931] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:42.057840] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-15T18:59:42.857895] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-15T18:59:42.919334] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:59:42.925256] [INFO ] [REMOTE ] IT: Full fetch complete (43759 records). [2025-09-15T18:59:42.925389] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-15T18:59:43.323225] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-15T18:59:43.323338] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-15T18:59:43.324585] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-15T18:59:43.324660] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-15T18:59:43.326360] [DEBUG] [LOCAL ] IT: Trimmed 43759 records to 30721 (keeping 150 days of data) [2025-09-15T18:59:43.541009] [DEBUG] [LOCAL ] IT: Primary data saved (30721 records). [2025-09-15T18:59:43.541160] [INFO ] [MAIN ] IT: Full history saved. [2025-09-15T18:59:43.541255] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. IT took 24.1s. Estimated remaining: 2h 11m 13s. Rate: 9.4 symbols/min [2025-09-15T18:59:43.658297] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-15T18:59:43.715839] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:43.747169] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:59:43.790624] [DEBUG] [LOCAL ] ITW: Loaded 34479 existing records from primary storage. [2025-09-15T18:59:43.790800] [INFO ] [MAIN ] ITW: Loaded 34479 existing records. [2025-09-15T18:59:43.967497] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:43.967904] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-15T18:59:43.967977] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-15T18:59:43.968937] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-15T18:59:43.969008] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-15T18:59:44.171456] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:59:44.368734] [INFO ] [REMOTE ] ITW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:44.459776] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-15T18:59:44.464547] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:59:45.257932] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-15T18:59:46.058004] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-15T18:59:46.132989] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:59:46.857888] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-15T18:59:46.972860] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:59:47.377511] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T18:59:47.657960] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-15T18:59:47.804509] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:59:48.457951] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-15T18:59:49.044734] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:59:49.257937] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-15T18:59:50.057868] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-15T18:59:50.156199] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:59:50.308794] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:59:50.857911] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-15T18:59:51.657916] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-15T18:59:51.878116] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T18:59:52.323003] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:59:52.457927] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-15T18:59:53.128615] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:59:53.257828] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-15T18:59:53.338226] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:59:54.057881] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-15T18:59:54.531662] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:59:54.857945] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-15T18:59:55.293029] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:59:55.296527] [INFO ] [REMOTE ] ITGR: Full fetch complete (33910 records). [2025-09-15T18:59:55.296607] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-15T18:59:55.664588] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-15T18:59:55.664008] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-15T18:59:55.665401] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-15T18:59:55.666043] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-15T18:59:55.666087] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-15T18:59:55.666908] [DEBUG] [LOCAL ] ITGR: Trimmed 33910 records to 22027 (keeping 150 days of data) [2025-09-15T18:59:55.802919] [DEBUG] [LOCAL ] ITGR: Primary data saved (22027 records). [2025-09-15T18:59:55.803107] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-15T18:59:55.803218] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ITGR took 25.7s. Estimated remaining: 2h 11m 13s. Rate: 9.4 symbols/min [2025-09-15T18:59:55.979566] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:56.000023] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T18:59:56.038985] [DEBUG] [LOCAL ] IVR: Loaded 35633 existing records from primary storage. [2025-09-15T18:59:56.039148] [INFO ] [MAIN ] IVR: Loaded 35633 existing records. [2025-09-15T18:59:56.227060] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:56.227479] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-15T18:59:56.227531] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-15T18:59:56.228263] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-15T18:59:56.228319] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-15T18:59:56.463133] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-15T18:59:56.602758] [INFO ] [REMOTE ] IVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:57.262971] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-15T18:59:57.279596] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:59:57.774522] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:59:58.057917] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-15T18:59:58.478590] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:59:58.857881] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-15T18:59:59.380390] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T18:59:59.657911] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-15T19:00:00.421107] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T19:00:00.457879] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-15T19:00:01.257956] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-15T19:00:01.344867] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:00:01.728872] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:00:02.057968] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-15T19:00:02.857939] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-15T19:00:02.872709] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T19:00:02.877925] [INFO ] [REMOTE ] ITT: Full fetch complete (36467 records). [2025-09-15T19:00:02.878447] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-15T19:00:03.274060] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-15T19:00:03.274178] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-15T19:00:03.274933] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-15T19:00:03.274996] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-15T19:00:03.276222] [DEBUG] [LOCAL ] ITT: Trimmed 36467 records to 23217 (keeping 150 days of data) [2025-09-15T19:00:03.438583] [DEBUG] [LOCAL ] ITT: Primary data saved (23217 records). [2025-09-15T19:00:03.438895] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-15T19:00:03.439078] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 29.6s. Estimated remaining: 2h 11m 8s. Rate: 9.4 symbols/min [2025-09-15T19:00:03.623207] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:03.648608] [DEBUG] [LOCAL ] IVT: Loaded 22821 existing records from primary storage. [2025-09-15T19:00:03.648829] [INFO ] [MAIN ] IVT: Loaded 22821 existing records. [2025-09-15T19:00:03.681236] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-15T19:00:03.855400] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:03.856575] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-15T19:00:03.856671] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-15T19:00:03.857788] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-15T19:00:03.857854] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-15T19:00:04.229862] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:00:04.313456] [INFO ] [REMOTE ] IVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:04.457926] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-15T19:00:04.878859] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T19:00:05.206539] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:00:05.257907] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-15T19:00:05.611951] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T19:00:06.057942] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-15T19:00:06.857930] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-15T19:00:07.040782] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T19:00:07.047688] [INFO ] [REMOTE ] ITUB: Full fetch complete (57965 records). [2025-09-15T19:00:07.047908] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-15T19:00:07.523113] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-15T19:00:07.525561] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:00:07.525863] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-15T19:00:07.534547] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-15T19:00:07.534701] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-15T19:00:07.537191] [DEBUG] [LOCAL ] ITUB: Trimmed 57965 records to 39382 (keeping 150 days of data) [2025-09-15T19:00:07.658129] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-15T19:00:07.809753] [DEBUG] [LOCAL ] ITUB: Primary data saved (39382 records). [2025-09-15T19:00:07.809991] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-15T19:00:07.811478] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITUB took 26.8s. Estimated remaining: 2h 10m 59s. Rate: 9.4 symbols/min [2025-09-15T19:00:07.988206] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:08.040061] [DEBUG] [LOCAL ] IVZ: Loaded 39955 existing records from primary storage. [2025-09-15T19:00:08.040284] [INFO ] [MAIN ] IVZ: Loaded 39955 existing records. [2025-09-15T19:00:08.220033] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:08.220365] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-15T19:00:08.220416] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-15T19:00:08.221420] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-15T19:00:08.221502] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-15T19:00:08.465599] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-15T19:00:08.606825] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:08.622903] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:00:08.628587] [INFO ] [REMOTE ] ITW: Full fetch complete (50589 records). [2025-09-15T19:00:08.628853] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-15T19:00:09.030541] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-15T19:00:09.030812] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-15T19:00:09.032234] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-15T19:00:09.032353] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-15T19:00:09.034618] [DEBUG] [LOCAL ] ITW: Trimmed 50589 records to 33742 (keeping 150 days of data) [2025-09-15T19:00:09.061531] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:00:09.269060] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-15T19:00:09.299216] [DEBUG] [LOCAL ] ITW: Primary data saved (33742 records). [2025-09-15T19:00:09.299446] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-15T19:00:09.300125] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. ITW took 25.8s. Estimated remaining: 2h 10m 48s. Rate: 9.4 symbols/min [2025-09-15T19:00:09.488370] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:09.511742] [DEBUG] [LOCAL ] IX: Loaded 16716 existing records from primary storage. [2025-09-15T19:00:09.511951] [INFO ] [MAIN ] IX: Loaded 16716 existing records. [2025-09-15T19:00:09.696956] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:09.697297] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-15T19:00:09.697344] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-15T19:00:09.697880] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-15T19:00:09.697941] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-15T19:00:10.067319] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-15T19:00:10.074092] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:10.135281] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:00:10.474405] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:00:10.857934] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-15T19:00:11.328848] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T19:00:11.657965] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-15T19:00:12.358484] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:00:12.457954] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-15T19:00:13.257928] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-15T19:00:13.912769] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:00:14.055287] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-15T19:00:14.064269] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-15T19:00:14.524272] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:00:14.857943] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-15T19:00:15.198373] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:00:15.657963] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-15T19:00:15.991945] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T19:00:16.457929] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-15T19:00:16.795034] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:00:17.257985] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-15T19:00:18.057959] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-15T19:00:18.628254] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:00:18.857922] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-15T19:00:19.177721] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:00:19.181587] [INFO ] [REMOTE ] IVT: Full fetch complete (33847 records). [2025-09-15T19:00:19.181760] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-15T19:00:19.606624] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-15T19:00:19.606794] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-15T19:00:19.608327] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-15T19:00:19.608452] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-15T19:00:19.610459] [DEBUG] [LOCAL ] IVT: Trimmed 33847 records to 22298 (keeping 150 days of data) [2025-09-15T19:00:19.680752] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-15T19:00:19.751068] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-15T19:00:19.810805] [DEBUG] [LOCAL ] IVT: Primary data saved (22298 records). [2025-09-15T19:00:19.810972] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-15T19:00:19.811092] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 16.4s. Estimated remaining: 2h 10m 46s. Rate: 9.4 symbols/min [2025-09-15T19:00:19.986533] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:20.021714] [DEBUG] [LOCAL ] J: Loaded 29890 existing records from primary storage. [2025-09-15T19:00:20.021911] [INFO ] [MAIN ] J: Loaded 29890 existing records. [2025-09-15T19:00:20.208861] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:20.209236] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-15T19:00:20.209291] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-15T19:00:20.210128] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-15T19:00:20.210179] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-15T19:00:20.463302] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-15T19:00:20.577721] [INFO ] [REMOTE ] J: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:20.612199] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:00:21.257975] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-15T19:00:21.333998] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:00:22.058003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-15T19:00:22.198075] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T19:00:22.585132] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T19:00:22.857984] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-15T19:00:23.604304] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:00:23.632554] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T19:00:23.657886] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-15T19:00:24.457925] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-15T19:00:24.528396] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:00:25.257945] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-15T19:00:25.886384] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:00:26.057915] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-15T19:00:26.126781] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:00:26.132338] [INFO ] [REMOTE ] IVR: Full fetch complete (51799 records). [2025-09-15T19:00:26.132494] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-15T19:00:26.531688] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-15T19:00:26.531840] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-15T19:00:26.532869] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-15T19:00:26.532917] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-15T19:00:26.534246] [DEBUG] [LOCAL ] IVR: Trimmed 51799 records to 34880 (keeping 150 days of data) [2025-09-15T19:00:26.738844] [DEBUG] [LOCAL ] IVR: Primary data saved (34880 records). [2025-09-15T19:00:26.739003] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-15T19:00:26.739092] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVR took 30.9s. Estimated remaining: 2h 10m 40s. Rate: 9.4 symbols/min [2025-09-15T19:00:26.863064] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-15T19:00:26.918754] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:26.950889] [DEBUG] [LOCAL ] JBGS: Loaded 31869 existing records from primary storage. [2025-09-15T19:00:26.951043] [INFO ] [MAIN ] JBGS: Loaded 31869 existing records. [2025-09-15T19:00:27.129353] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:27.129611] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-15T19:00:27.129676] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-15T19:00:27.130557] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-15T19:00:27.130607] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-15T19:00:27.484985] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:27.549723] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T19:00:27.657868] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-15T19:00:27.679089] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:00:27.681295] [INFO ] [REMOTE ] IX: Full fetch complete (23743 records). [2025-09-15T19:00:27.681392] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-15T19:00:28.048523] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-15T19:00:28.048605] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-15T19:00:28.049102] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-15T19:00:28.049145] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-15T19:00:28.049795] [DEBUG] [LOCAL ] IX: Trimmed 23743 records to 16193 (keeping 150 days of data) [2025-09-15T19:00:28.145181] [DEBUG] [LOCAL ] IX: Primary data saved (16193 records). [2025-09-15T19:00:28.145329] [INFO ] [MAIN ] IX: Full history saved. [2025-09-15T19:00:28.145432] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IX took 18.8s. Estimated remaining: 2h 10m 28s. Rate: 9.4 symbols/min [2025-09-15T19:00:28.317412] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:28.348465] [DEBUG] [LOCAL ] JBI: Loaded 32393 existing records from primary storage. [2025-09-15T19:00:28.348616] [INFO ] [MAIN ] JBI: Loaded 32393 existing records. [2025-09-15T19:00:28.463048] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-15T19:00:28.524213] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:28.524504] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-15T19:00:28.524551] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-15T19:00:28.525209] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-15T19:00:28.525265] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-15T19:00:28.877867] [INFO ] [REMOTE ] JBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:28.910153] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T19:00:29.257876] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-15T19:00:30.057888] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-15T19:00:30.407215] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T19:00:30.718613] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:00:30.857875] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-15T19:00:31.095405] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:00:31.657890] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-15T19:00:31.865922] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T19:00:32.457869] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-15T19:00:33.223303] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:00:33.257850] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-15T19:00:33.765096] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:00:34.057867] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-15T19:00:34.681041] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:00:34.857863] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-15T19:00:35.657885] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-15T19:00:35.871528] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:00:35.931966] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:00:36.457921] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-15T19:00:36.854365] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T19:00:37.257872] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-15T19:00:37.863882] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:00:38.057923] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-15T19:00:38.437752] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:00:38.857933] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-15T19:00:39.266306] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T19:00:39.657902] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-15T19:00:39.993572] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:00:40.457914] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-15T19:00:40.835579] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:00:41.257917] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-15T19:00:41.622348] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T19:00:42.057878] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-15T19:00:42.398205] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:00:42.406064] [INFO ] [REMOTE ] IVZ: Full fetch complete (57719 records). [2025-09-15T19:00:42.406307] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-15T19:00:42.790855] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-15T19:00:42.790954] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-15T19:00:42.791855] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-15T19:00:42.791907] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-15T19:00:42.793293] [DEBUG] [LOCAL ] IVZ: Trimmed 57719 records to 39170 (keeping 150 days of data) [2025-09-15T19:00:42.859829] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-15T19:00:43.043562] [DEBUG] [LOCAL ] IVZ: Primary data saved (39170 records). [2025-09-15T19:00:43.043746] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-15T19:00:43.044552] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IVZ took 35.2s. Estimated remaining: 2h 10m 31s. Rate: 9.4 symbols/min [2025-09-15T19:00:43.231193] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:43.270914] [DEBUG] [LOCAL ] JBL: Loaded 35773 existing records from primary storage. [2025-09-15T19:00:43.271079] [INFO ] [MAIN ] JBL: Loaded 35773 existing records. [2025-09-15T19:00:43.462529] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:43.462863] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-15T19:00:43.462913] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-15T19:00:43.463725] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-15T19:00:43.463784] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-15T19:00:43.673127] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-15T19:00:43.822493] [INFO ] [REMOTE ] JBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:43.849356] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T19:00:44.078398] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:00:44.457891] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-15T19:00:44.736378] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:00:44.742352] [INFO ] [REMOTE ] JBGS: Full fetch complete (45830 records). [2025-09-15T19:00:44.742470] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-15T19:00:45.118693] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-15T19:00:45.118776] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-15T19:00:45.119493] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-15T19:00:45.119541] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-15T19:00:45.120761] [DEBUG] [LOCAL ] JBGS: Trimmed 45830 records to 31240 (keeping 150 days of data) [2025-09-15T19:00:45.276553] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-15T19:00:45.318394] [DEBUG] [LOCAL ] JBGS: Primary data saved (31240 records). [2025-09-15T19:00:45.318500] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-15T19:00:45.318593] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 18.6s. Estimated remaining: 2h 10m 21s. Rate: 9.4 symbols/min [2025-09-15T19:00:45.486033] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:45.505339] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-15T19:00:45.505461] [INFO ] [MAIN ] JBND: Loaded 19070 existing records. [2025-09-15T19:00:45.692157] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:45.692424] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-15T19:00:45.692471] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-15T19:00:45.693050] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-15T19:00:45.693104] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-15T19:00:46.044927] [INFO ] [REMOTE ] JBND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:46.057856] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-15T19:00:46.058803] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:00:46.065762] [INFO ] [REMOTE ] J: Full fetch complete (44410 records). [2025-09-15T19:00:46.065856] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-15T19:00:46.445331] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-15T19:00:46.445422] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-15T19:00:46.446271] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-15T19:00:46.446399] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-15T19:00:46.447999] [DEBUG] [LOCAL ] J: Trimmed 44410 records to 29311 (keeping 150 days of data) [2025-09-15T19:00:46.573499] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:00:46.683185] [DEBUG] [LOCAL ] J: Primary data saved (29311 records). [2025-09-15T19:00:46.683341] [INFO ] [MAIN ] J: Full history saved. [2025-09-15T19:00:46.683449] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. J took 26.9s. Estimated remaining: 2h 10m 9s. Rate: 9.4 symbols/min [2025-09-15T19:00:46.892613] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-15T19:00:46.895171] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:46.895991] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-15T19:00:46.896035] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-15T19:00:46.896151] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-15T19:00:46.896190] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-15T19:00:46.896230] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-15T19:00:46.896262] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-15T19:00:47.266489] [INFO ] [REMOTE ] JBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:47.269570] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:00:47.657941] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-15T19:00:48.457931] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-15T19:00:48.595915] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:00:48.697044] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:00:49.213334] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:00:49.257825] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-15T19:00:50.057880] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-15T19:00:50.248312] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:00:50.248897] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:50.255038] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-15T19:00:50.857881] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-15T19:00:51.657938] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-15T19:00:51.910810] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:00:52.457871] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-15T19:00:52.618211] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T19:00:53.257921] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-15T19:00:54.010530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:00:54.057824] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-15T19:00:54.292501] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:00:54.297752] [INFO ] [REMOTE ] JBI: Full fetch complete (48116 records). [2025-09-15T19:00:54.297909] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-15T19:00:54.674774] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-15T19:00:54.674851] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-15T19:00:54.675592] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-15T19:00:54.675635] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-15T19:00:54.676982] [DEBUG] [LOCAL ] JBI: Trimmed 48116 records to 31610 (keeping 150 days of data) [2025-09-15T19:00:54.859718] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-15T19:00:54.871976] [DEBUG] [LOCAL ] JBI: Primary data saved (31610 records). [2025-09-15T19:00:54.872411] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-15T19:00:54.872518] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 26.7s. Estimated remaining: 2h 10m 4s. Rate: 9.4 symbols/min [2025-09-15T19:00:55.041845] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:55.065966] [DEBUG] [LOCAL ] JBTM: Loaded 24291 existing records from primary storage. [2025-09-15T19:00:55.066101] [INFO ] [MAIN ] JBTM: Loaded 24291 existing records. [2025-09-15T19:00:55.243819] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:55.244068] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-15T19:00:55.244113] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-15T19:00:55.245181] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-15T19:00:55.245239] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-15T19:00:55.601131] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:55.634073] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:00:55.658230] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-15T19:00:55.660464] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:00:56.457871] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-15T19:00:56.839013] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:00:57.257917] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-15T19:00:57.493708] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:57.494026] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-15T19:00:57.540485] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:00:58.057876] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-15T19:00:58.295981] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:58.296349] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-15T19:00:58.857876] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-15T19:00:59.075562] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:59.075896] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-15T19:00:59.657868] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-15T19:01:00.457879] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-15T19:01:00.799774] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:01:01.257982] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-15T19:01:01.459826] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:01:02.057903] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-15T19:01:02.768310] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:01:02.857894] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-15T19:01:03.657855] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-15T19:01:03.763690] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T19:01:03.806930] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T19:01:03.811220] [INFO ] [REMOTE ] JBND: Full fetch complete (26343 records). [2025-09-15T19:01:03.811346] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-15T19:01:04.176702] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-15T19:01:04.176802] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-15T19:01:04.177322] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-15T19:01:04.177365] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-15T19:01:04.178048] [DEBUG] [LOCAL ] JBND: Trimmed 26343 records to 18819 (keeping 150 days of data) [2025-09-15T19:01:04.303625] [DEBUG] [LOCAL ] JBND: Primary data saved (18819 records). [2025-09-15T19:01:04.303791] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-15T19:01:04.303891] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBND took 19.0s. Estimated remaining: 2h 10m 1s. Rate: 9.4 symbols/min [2025-09-15T19:01:04.471474] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-15T19:01:04.474690] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:04.482766] [DEBUG] [LOCAL ] JCE: Loaded 4706 existing records from primary storage. [2025-09-15T19:01:04.482872] [INFO ] [MAIN ] JCE: Loaded 4706 existing records. [2025-09-15T19:01:04.660034] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:04.660263] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-15T19:01:04.660322] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-15T19:01:04.660612] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-15T19:01:04.660686] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-15T19:01:05.024919] [INFO ] [REMOTE ] JCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:05.042422] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:01:05.257911] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-15T19:01:06.057872] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-15T19:01:06.371152] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T19:01:06.679344] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:01:06.857869] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-15T19:01:07.148214] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:01:07.407612] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T19:01:07.657929] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-15T19:01:08.457912] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-15T19:01:09.261447] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-15T19:01:09.267132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T19:01:10.057908] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-15T19:01:10.247205] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:01:10.255999] [INFO ] [REMOTE ] JBS: Full fetch complete (24063 records). [2025-09-15T19:01:10.256183] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-15T19:01:10.449136] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 63 unique days, need 150 days [2025-09-15T19:01:10.449557] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:01:10.449613] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:01:10.449681] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-15T19:01:10.449751] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-15T19:01:10.449808] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-15T19:01:10.449889] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-15T19:01:10.449988] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBS took 23.8s. Estimated remaining: 2h 9m 55s. Rate: 9.4 symbols/min [2025-09-15T19:01:10.638557] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:10.681459] [DEBUG] [LOCAL ] JCI: Loaded 40310 existing records from primary storage. [2025-09-15T19:01:10.681608] [INFO ] [MAIN ] JCI: Loaded 40310 existing records. [2025-09-15T19:01:10.862273] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-15T19:01:10.866835] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:10.868191] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-15T19:01:10.868329] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-15T19:01:10.869342] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-15T19:01:10.869396] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-15T19:01:11.134207] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T19:01:11.255465] [INFO ] [REMOTE ] JCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:11.409812] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:01:11.415345] [INFO ] [REMOTE ] JBL: Full fetch complete (52442 records). [2025-09-15T19:01:11.415460] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-15T19:01:11.525977] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:01:11.663093] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-15T19:01:11.825074] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-15T19:01:11.825172] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-15T19:01:11.826093] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-15T19:01:11.826162] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-15T19:01:11.827444] [DEBUG] [LOCAL ] JBL: Trimmed 52442 records to 35106 (keeping 150 days of data) [2025-09-15T19:01:12.077973] [DEBUG] [LOCAL ] JBL: Primary data saved (35106 records). [2025-09-15T19:01:12.078136] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-15T19:01:12.078245] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBL took 29.0s. Estimated remaining: 2h 9m 43s. Rate: 9.4 symbols/min [2025-09-15T19:01:12.241553] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:01:12.273837] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:12.317538] [DEBUG] [LOCAL ] JEF: Loaded 37153 existing records from primary storage. [2025-09-15T19:01:12.317826] [INFO ] [MAIN ] JEF: Loaded 37153 existing records. [2025-09-15T19:01:12.463008] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-15T19:01:12.512213] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:12.513195] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-15T19:01:12.513262] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-15T19:01:12.514310] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-15T19:01:12.514367] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-15T19:01:12.864914] [INFO ] [REMOTE ] JEF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:13.059842] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:01:13.257869] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-15T19:01:13.788796] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:01:14.057899] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-15T19:01:14.857904] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-15T19:01:15.650430] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:01:15.665054] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-15T19:01:15.683188] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:01:16.457876] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-15T19:01:17.190612] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:01:17.257868] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-15T19:01:18.057926] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-15T19:01:18.146165] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T19:01:18.635006] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:01:18.857926] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-15T19:01:19.059534] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:01:19.657862] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-15T19:01:19.680879] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:01:19.682731] [INFO ] [REMOTE ] JCE: Full fetch complete (6614 records). [2025-09-15T19:01:19.682806] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-15T19:01:20.032626] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-15T19:01:20.032719] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-15T19:01:20.032887] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-15T19:01:20.032924] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-15T19:01:20.033308] [DEBUG] [LOCAL ] JCE: Trimmed 6614 records to 4686 (keeping 150 days of data) [2025-09-15T19:01:20.062347] [DEBUG] [LOCAL ] JCE: Primary data saved (4686 records). [2025-09-15T19:01:20.062417] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-15T19:01:20.062486] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JCE took 15.8s. Estimated remaining: 2h 9m 39s. Rate: 9.4 symbols/min [2025-09-15T19:01:20.229435] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:20.261839] [DEBUG] [LOCAL ] JELD: Loaded 34820 existing records from primary storage. [2025-09-15T19:01:20.261980] [INFO ] [MAIN ] JELD: Loaded 34820 existing records. [2025-09-15T19:01:20.439285] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:20.439534] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-15T19:01:20.439583] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-15T19:01:20.440361] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-15T19:01:20.440414] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-15T19:01:20.462957] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-15T19:01:20.793562] [INFO ] [REMOTE ] JELD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:21.257866] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-15T19:01:21.637388] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T19:01:22.057840] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-15T19:01:22.103130] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T19:01:22.470831] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:01:22.857886] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-15T19:01:23.657830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-15T19:01:23.798077] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:01:23.949211] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T19:01:24.457876] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-15T19:01:25.016555] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:01:25.257897] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-15T19:01:25.415482] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T19:01:26.057883] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-15T19:01:26.799386] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T19:01:26.857858] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-15T19:01:27.421670] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T19:01:27.657877] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-15T19:01:28.169005] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:01:28.457942] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-15T19:01:29.257926] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-15T19:01:29.436884] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:01:29.673669] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:01:30.057871] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-15T19:01:30.848160] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T19:01:30.858399] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-15T19:01:31.465988] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:01:31.470033] [INFO ] [REMOTE ] JBTM: Full fetch complete (35089 records). [2025-09-15T19:01:31.470182] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-15T19:01:31.664453] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-15T19:01:31.870708] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-09-15T19:01:31.870804] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-09-15T19:01:31.871508] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-09-15T19:01:31.871552] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-09-15T19:01:31.872595] [DEBUG] [LOCAL ] JBTM: Trimmed 35089 records to 23791 (keeping 150 days of data) [2025-09-15T19:01:32.024618] [DEBUG] [LOCAL ] JBTM: Primary data saved (23791 records). [2025-09-15T19:01:32.024898] [INFO ] [MAIN ] JBTM: Full history saved. [2025-09-15T19:01:32.024995] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBTM took 37.2s. Estimated remaining: 2h 9m 38s. Rate: 9.4 symbols/min [2025-09-15T19:01:32.209072] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:32.216522] [DEBUG] [LOCAL ] JEQ: Loaded 5984 existing records from primary storage. [2025-09-15T19:01:32.216610] [INFO ] [MAIN ] JEQ: Loaded 5984 existing records. [2025-09-15T19:01:32.400545] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:32.400827] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-15T19:01:32.400918] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-15T19:01:32.401257] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-15T19:01:32.401309] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-15T19:01:32.469231] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-15T19:01:32.779331] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:32.813274] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T19:01:33.258359] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-15T19:01:33.258273] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T19:01:33.749127] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:01:34.057928] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-15T19:01:34.533585] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:01:34.845499] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:01:34.857809] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-15T19:01:35.657930] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-15T19:01:36.191529] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:01:36.197799] [INFO ] [REMOTE ] JCI: Full fetch complete (58228 records). [2025-09-15T19:01:36.197912] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-15T19:01:36.463056] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-15T19:01:36.579605] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-15T19:01:36.579760] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-15T19:01:36.580558] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-15T19:01:36.580609] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-15T19:01:36.588908] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:01:36.592437] [DEBUG] [LOCAL ] JCI: Trimmed 58228 records to 39530 (keeping 150 days of data) [2025-09-15T19:01:36.841327] [DEBUG] [LOCAL ] JCI: Primary data saved (39530 records). [2025-09-15T19:01:36.841471] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-15T19:01:36.842105] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 26.4s. Estimated remaining: 2h 9m 30s. Rate: 9.4 symbols/min [2025-09-15T19:01:37.011595] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:37.033758] [DEBUG] [LOCAL ] JFR: Loaded 21807 existing records from primary storage. [2025-09-15T19:01:37.033895] [INFO ] [MAIN ] JFR: Loaded 21807 existing records. [2025-09-15T19:01:37.207992] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:37.208251] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-15T19:01:37.208302] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-15T19:01:37.208923] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-15T19:01:37.208975] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-15T19:01:37.270819] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-15T19:01:37.560004] [INFO ] [REMOTE ] JFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:38.026884] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T19:01:38.057853] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-15T19:01:38.205621] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T19:01:38.211191] [INFO ] [REMOTE ] JEF: Full fetch complete (54479 records). [2025-09-15T19:01:38.211292] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-15T19:01:38.596346] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-15T19:01:38.596458] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-15T19:01:38.597320] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-15T19:01:38.597371] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-15T19:01:38.598516] [DEBUG] [LOCAL ] JEF: Trimmed 54479 records to 36411 (keeping 150 days of data) [2025-09-15T19:01:38.808253] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:01:38.833943] [DEBUG] [LOCAL ] JEF: Primary data saved (36411 records). [2025-09-15T19:01:38.834056] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-15T19:01:38.835221] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JEF took 26.8s. Estimated remaining: 2h 9m 19s. Rate: 9.4 symbols/min [2025-09-15T19:01:38.864128] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-15T19:01:39.005611] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:39.015635] [DEBUG] [LOCAL ] JGH: Loaded 8181 existing records from primary storage. [2025-09-15T19:01:39.015775] [INFO ] [MAIN ] JGH: Loaded 8181 existing records. [2025-09-15T19:01:39.192710] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:39.192983] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-15T19:01:39.193029] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-15T19:01:39.193342] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-15T19:01:39.193397] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-15T19:01:39.541110] [INFO ] [REMOTE ] JGH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:39.657823] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-15T19:01:40.316372] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:01:40.457931] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-15T19:01:40.595490] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T19:01:40.867277] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:01:41.257922] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-15T19:01:42.057899] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-15T19:01:42.322253] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:01:42.500068] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T19:01:42.857922] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-15T19:01:43.657913] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-15T19:01:44.291685] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:01:44.324827] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:01:44.457884] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-15T19:01:45.257879] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-15T19:01:45.827673] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T19:01:45.874235] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:01:46.057888] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-15T19:01:46.857877] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-15T19:01:47.514677] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:01:47.517355] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:01:47.518782] [INFO ] [REMOTE ] JEQ: Full fetch complete (9329 records). [2025-09-15T19:01:47.529687] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-15T19:01:47.663040] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-15T19:01:47.917780] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-15T19:01:47.917873] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-15T19:01:47.918140] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-15T19:01:47.918214] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-15T19:01:47.918738] [DEBUG] [LOCAL ] JEQ: Trimmed 9329 records to 5801 (keeping 150 days of data) [2025-09-15T19:01:47.951934] [DEBUG] [LOCAL ] JEQ: Primary data saved (5801 records). [2025-09-15T19:01:47.952072] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-15T19:01:47.952161] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JEQ took 15.9s. Estimated remaining: 2h 9m 16s. Rate: 9.4 symbols/min [2025-09-15T19:01:48.126302] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:48.162479] [DEBUG] [LOCAL ] JHG: Loaded 35896 existing records from primary storage. [2025-09-15T19:01:48.162631] [INFO ] [MAIN ] JHG: Loaded 35896 existing records. [2025-09-15T19:01:48.342863] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:48.343141] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-15T19:01:48.343186] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-15T19:01:48.344025] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-15T19:01:48.344077] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-15T19:01:48.463058] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-15T19:01:48.708563] [INFO ] [REMOTE ] JHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:49.263392] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-15T19:01:49.267746] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:01:49.274164] [INFO ] [REMOTE ] JELD: Full fetch complete (49998 records). [2025-09-15T19:01:49.274368] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-15T19:01:49.717085] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-15T19:01:49.717197] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-15T19:01:49.718233] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-15T19:01:49.718284] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-15T19:01:49.719919] [DEBUG] [LOCAL ] JELD: Trimmed 49998 records to 34097 (keeping 150 days of data) [2025-09-15T19:01:49.939441] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:01:49.963238] [DEBUG] [LOCAL ] JELD: Primary data saved (34097 records). [2025-09-15T19:01:49.963459] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-15T19:01:49.963597] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JELD took 29.9s. Estimated remaining: 2h 9m 5s. Rate: 9.4 symbols/min [2025-09-15T19:01:50.064889] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-15T19:01:50.161094] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:50.171501] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T19:01:50.180232] [DEBUG] [LOCAL ] JHI: Loaded 2528 existing records from primary storage. [2025-09-15T19:01:50.180453] [INFO ] [MAIN ] JHI: Loaded 2528 existing records. [2025-09-15T19:01:50.367820] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:50.368296] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-15T19:01:50.368352] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-15T19:01:50.369138] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-15T19:01:50.369197] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-15T19:01:50.739596] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:50.857949] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-15T19:01:51.628745] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:01:51.660778] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-15T19:01:51.666658] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:01:52.457902] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-15T19:01:52.702793] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:01:52.970710] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T19:01:53.257991] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-15T19:01:54.057888] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-15T19:01:54.088358] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:01:54.857875] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-15T19:01:55.591363] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:01:55.657827] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-15T19:01:56.090370] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T19:01:56.457902] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-15T19:01:57.213080] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:01:57.257820] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-15T19:01:57.685957] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:01:58.057877] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-15T19:01:58.644329] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:01:58.857880] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-15T19:01:58.959030] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T19:01:59.195224] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-15T19:01:59.657892] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-15T19:02:00.036575] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T19:02:00.457892] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-15T19:02:01.257910] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-15T19:02:01.835900] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:02:01.859779] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:02:02.057868] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-15T19:02:02.857877] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-15T19:02:03.467142] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:02:03.657874] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-15T19:02:03.724112] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T19:02:04.457900] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-15T19:02:04.909304] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:02:05.173477] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:02:05.257884] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-15T19:02:06.057921] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-15T19:02:06.450145] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T19:02:06.475575] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:02:06.857903] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-15T19:02:07.442883] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T19:02:07.445077] [INFO ] [REMOTE ] JGH: Full fetch complete (11411 records). [2025-09-15T19:02:07.445157] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-15T19:02:07.663081] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-15T19:02:07.818508] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-15T19:02:07.818592] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-15T19:02:07.818884] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-15T19:02:07.818951] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-15T19:02:07.819423] [DEBUG] [LOCAL ] JGH: Trimmed 11411 records to 8029 (keeping 150 days of data) [2025-09-15T19:02:07.871265] [DEBUG] [LOCAL ] JGH: Primary data saved (8029 records). [2025-09-15T19:02:07.871414] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-15T19:02:07.871504] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 29.0s. Estimated remaining: 2h 9m 11s. Rate: 9.4 symbols/min [2025-09-15T19:02:08.043007] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:08.047140] [DEBUG] [LOCAL ] JHS: Loaded 2243 existing records from primary storage. [2025-09-15T19:02:08.047228] [INFO ] [MAIN ] JHS: Loaded 2243 existing records. [2025-09-15T19:02:08.236852] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:08.237124] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-15T19:02:08.237192] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-15T19:02:08.237474] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-15T19:02:08.237524] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-15T19:02:08.464381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-15T19:02:08.602841] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:08.868096] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T19:02:08.869696] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T19:02:08.874876] [INFO ] [REMOTE ] JFR: Full fetch complete (34664 records). [2025-09-15T19:02:08.874985] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-15T19:02:09.245578] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-15T19:02:09.245712] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-15T19:02:09.246447] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-15T19:02:09.246493] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-15T19:02:09.247691] [DEBUG] [LOCAL ] JFR: Trimmed 34664 records to 21424 (keeping 150 days of data) [2025-09-15T19:02:09.298350] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-15T19:02:09.381768] [DEBUG] [LOCAL ] JFR: Primary data saved (21424 records). [2025-09-15T19:02:09.381912] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-15T19:02:09.382026] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JFR took 32.5s. Estimated remaining: 2h 8m 59s. Rate: 9.4 symbols/min [2025-09-15T19:02:09.550047] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:09.589265] [DEBUG] [LOCAL ] JHX: Loaded 39971 existing records from primary storage. [2025-09-15T19:02:09.589409] [INFO ] [MAIN ] JHX: Loaded 39971 existing records. [2025-09-15T19:02:09.771907] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:09.772185] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-15T19:02:09.772232] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-15T19:02:09.773131] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-15T19:02:09.773182] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-15T19:02:09.875749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:02:10.063041] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-15T19:02:10.133289] [INFO ] [REMOTE ] JHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:10.727900] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:02:10.729546] [INFO ] [REMOTE ] JHI: Full fetch complete (4008 records). [2025-09-15T19:02:10.729625] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-15T19:02:10.872576] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-15T19:02:11.093699] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-15T19:02:11.093790] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-15T19:02:11.093932] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-15T19:02:11.093982] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-15T19:02:11.094477] [DEBUG] [LOCAL ] JHI: Trimmed 4008 records to 2473 (keeping 150 days of data) [2025-09-15T19:02:11.112693] [DEBUG] [LOCAL ] JHI: Primary data saved (2473 records). [2025-09-15T19:02:11.112846] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-15T19:02:11.112960] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 21.1s. Estimated remaining: 2h 8m 48s. Rate: 9.4 symbols/min [2025-09-15T19:02:11.284854] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:11.297181] [DEBUG] [LOCAL ] JILL: Loaded 11746 existing records from primary storage. [2025-09-15T19:02:11.297298] [INFO ] [MAIN ] JILL: Loaded 11746 existing records. [2025-09-15T19:02:11.485849] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:11.486310] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-15T19:02:11.486386] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-15T19:02:11.496946] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-15T19:02:11.496878] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:02:11.499836] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-15T19:02:11.680093] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-15T19:02:11.865625] [INFO ] [REMOTE ] JILL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:12.457917] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-15T19:02:12.783982] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:02:13.257881] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-15T19:02:13.602384] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:02:13.607677] [INFO ] [REMOTE ] JHG: Full fetch complete (52122 records). [2025-09-15T19:02:13.607797] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-15T19:02:13.878205] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:02:13.993149] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-15T19:02:13.993231] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-15T19:02:13.994007] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-15T19:02:13.994052] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-15T19:02:13.995274] [DEBUG] [LOCAL ] JHG: Trimmed 52122 records to 35163 (keeping 150 days of data) [2025-09-15T19:02:14.061343] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-15T19:02:14.220366] [DEBUG] [LOCAL ] JHG: Primary data saved (35163 records). [2025-09-15T19:02:14.220519] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-15T19:02:14.221223] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 26.3s. Estimated remaining: 2h 8m 38s. Rate: 9.4 symbols/min [2025-09-15T19:02:14.389960] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:14.421785] [DEBUG] [LOCAL ] JKS: Loaded 28986 existing records from primary storage. [2025-09-15T19:02:14.421934] [INFO ] [MAIN ] JKS: Loaded 28986 existing records. [2025-09-15T19:02:14.526324] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T19:02:14.612712] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:14.613078] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-15T19:02:14.613133] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-15T19:02:14.613811] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-15T19:02:14.613860] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-15T19:02:14.863131] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-15T19:02:14.968455] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:15.312156] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:02:15.657901] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-15T19:02:16.111157] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:02:16.457919] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-15T19:02:17.257904] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-15T19:02:17.699549] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:02:17.793368] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T19:02:18.057877] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-15T19:02:18.857873] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-15T19:02:19.523381] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:02:19.568464] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:02:19.657854] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-15T19:02:20.356091] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T19:02:20.457876] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-15T19:02:21.006866] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:02:21.257951] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-15T19:02:22.057969] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-15T19:02:22.258052] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T19:02:22.442051] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T19:02:22.857880] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-15T19:02:23.643378] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:02:23.657826] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-15T19:02:24.457919] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-15T19:02:24.654021] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:02:25.257884] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-15T19:02:25.790528] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:02:26.057865] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-15T19:02:26.383090] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:02:26.857918] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-15T19:02:27.223486] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:02:27.657924] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-15T19:02:28.457888] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-15T19:02:28.513674] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:02:28.740109] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T19:02:29.050109] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:02:29.051533] [INFO ] [REMOTE ] JHS: Full fetch complete (3283 records). [2025-09-15T19:02:29.051840] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-15T19:02:29.268088] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-15T19:02:29.424465] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-15T19:02:29.424566] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-15T19:02:29.424708] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-15T19:02:29.424753] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-15T19:02:29.425161] [DEBUG] [LOCAL ] JHS: Trimmed 3283 records to 2257 (keeping 150 days of data) [2025-09-15T19:02:29.440075] [DEBUG] [LOCAL ] JHS: Primary data saved (2257 records). [2025-09-15T19:02:29.440193] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-15T19:02:29.440293] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JHS took 21.6s. Estimated remaining: 2h 8m 41s. Rate: 9.4 symbols/min [2025-09-15T19:02:29.618791] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:29.644915] [DEBUG] [LOCAL ] JLL: Loaded 24398 existing records from primary storage. [2025-09-15T19:02:29.645076] [INFO ] [MAIN ] JLL: Loaded 24398 existing records. [2025-09-15T19:02:29.828493] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:29.828781] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-15T19:02:29.828829] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-15T19:02:29.829522] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-15T19:02:29.829575] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-15T19:02:30.062969] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-15T19:02:30.199929] [INFO ] [REMOTE ] JLL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:30.745819] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T19:02:30.857879] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-15T19:02:31.657853] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-15T19:02:31.756782] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T19:02:31.913594] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T19:02:32.457873] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-15T19:02:32.968527] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:02:33.127081] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:02:33.257871] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-15T19:02:34.057883] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-15T19:02:34.219041] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T19:02:34.857888] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-15T19:02:35.443121] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:02:35.657916] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-15T19:02:36.233735] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:02:36.238556] [INFO ] [REMOTE ] JKS: Full fetch complete (43933 records). [2025-09-15T19:02:36.238716] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-15T19:02:36.462942] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-15T19:02:36.617379] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-15T19:02:36.617468] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-15T19:02:36.618211] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-15T19:02:36.618268] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-15T19:02:36.619388] [DEBUG] [LOCAL ] JKS: Trimmed 43933 records to 28310 (keeping 150 days of data) [2025-09-15T19:02:36.792554] [DEBUG] [LOCAL ] JKS: Primary data saved (28310 records). [2025-09-15T19:02:36.792714] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-15T19:02:36.792816] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JKS took 22.6s. Estimated remaining: 2h 8m 36s. Rate: 9.4 symbols/min [2025-09-15T19:02:36.971888] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:36.977219] [DEBUG] [LOCAL ] JLS: Loaded 2934 existing records from primary storage. [2025-09-15T19:02:36.977335] [INFO ] [MAIN ] JLS: Loaded 2934 existing records. [2025-09-15T19:02:37.157162] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:37.157425] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-15T19:02:37.157479] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-15T19:02:37.157771] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-15T19:02:37.157831] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-15T19:02:37.258446] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-15T19:02:37.527086] [INFO ] [REMOTE ] JLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:37.528226] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:02:37.531211] [INFO ] [REMOTE ] JILL: Full fetch complete (17754 records). [2025-09-15T19:02:37.531287] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-15T19:02:37.849851] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T19:02:37.940392] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-15T19:02:37.940492] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-15T19:02:37.940948] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-15T19:02:37.941018] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-15T19:02:37.941684] [DEBUG] [LOCAL ] JILL: Trimmed 17754 records to 11480 (keeping 150 days of data) [2025-09-15T19:02:38.018427] [DEBUG] [LOCAL ] JILL: Primary data saved (11480 records). [2025-09-15T19:02:38.018635] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-15T19:02:38.018809] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JILL took 26.9s. Estimated remaining: 2h 8m 24s. Rate: 9.4 symbols/min [2025-09-15T19:02:38.057860] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-15T19:02:38.506925] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T19:02:38.857924] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-15T19:02:39.218009] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T19:02:39.657872] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-15T19:02:39.806788] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T19:02:39.813177] [INFO ] [REMOTE ] JHX: Full fetch complete (49417 records). [2025-09-15T19:02:39.813314] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-15T19:02:40.208740] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:02:40.208564] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-15T19:02:40.210232] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-15T19:02:40.211056] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-15T19:02:40.211105] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-15T19:02:40.213220] [DEBUG] [LOCAL ] JHX: Trimmed 49417 records to 39218 (keeping 150 days of data) [2025-09-15T19:02:40.454770] [DEBUG] [LOCAL ] JHX: Primary data saved (39218 records). [2025-09-15T19:02:40.454922] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-15T19:02:40.456026] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JHX took 31.1s. Estimated remaining: 2h 8m 14s. Rate: 9.4 symbols/min [2025-09-15T19:02:40.457864] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-15T19:02:41.257944] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-15T19:02:41.438150] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T19:02:41.834406] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:02:42.057869] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-15T19:02:42.646420] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:02:42.857950] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-15T19:02:43.657979] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-15T19:02:44.191096] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:02:44.219632] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:02:44.457880] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-15T19:02:44.934409] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:02:45.257930] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-15T19:02:45.609763] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-15T19:02:46.057900] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-15T19:02:46.623672] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:02:46.624781] [INFO ] [REMOTE ] JLS: Full fetch complete (4403 records). [2025-09-15T19:02:46.624874] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-15T19:02:46.866528] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-15T19:02:47.004430] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-15T19:02:47.004591] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-15T19:02:47.004781] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-15T19:02:47.004825] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-15T19:02:47.005205] [DEBUG] [LOCAL ] JLS: Trimmed 4403 records to 2854 (keeping 150 days of data) [2025-09-15T19:02:47.023739] [DEBUG] [LOCAL ] JLS: Primary data saved (2854 records). [2025-09-15T19:02:47.023824] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-15T19:02:47.023914] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLS took 10.2s. Estimated remaining: 2h 8m 8s. Rate: 9.4 symbols/min [2025-09-15T19:02:47.956043] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:02:47.963287] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-15T19:02:48.973228] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:02:48.980887] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-15T19:02:50.323223] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:02:50.332997] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-15T19:02:51.519170] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:02:51.522932] [INFO ] [REMOTE ] JLL: Full fetch complete (35308 records). [2025-09-15T19:02:51.523039] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-15T19:02:51.897340] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-15T19:02:51.897453] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-15T19:02:51.898243] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-15T19:02:51.898295] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-15T19:02:51.899563] [DEBUG] [LOCAL ] JLL: Trimmed 35308 records to 23872 (keeping 150 days of data) [2025-09-15T19:02:52.082317] [DEBUG] [LOCAL ] JLL: Primary data saved (23872 records). [2025-09-15T19:02:52.082552] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-15T19:02:52.082711] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 22.6s. Estimated remaining: 2h 8m 0s. Rate: 9.4 symbols/min [2025-09-15T19:02:52.685783] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.703532] [DEBUG] [LOCAL ] JMIA: No existing data file found in primary storage. [2025-09-15T19:02:52.725466] [WARN ] [MAIN ] JMIA: No existing data found, performing full refresh instead. [2025-09-15T19:02:52.787278] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.807562] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-15T19:02:52.845067] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-15T19:02:52.866065] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.879346] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-09-15T19:02:52.866154] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-15T19:02:52.879498] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-15T19:02:52.882030] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-15T19:02:52.882087] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-15T19:02:52.939697] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-15T19:02:52.940858] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.956805] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-15T19:02:52.989971] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-15T19:02:53.357113] [DEBUG] [LOCAL ] JNJ: Loaded 40493 existing records from primary storage. [2025-09-15T19:02:53.471299] [INFO ] [MAIN ] JNJ: Loaded 40493 existing records. [2025-09-15T19:02:53.622093] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:53.678764] [DEBUG] [LOCAL ] JOBY: Loaded 40550 existing records from primary storage. [2025-09-15T19:02:53.716118] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-15T19:02:53.715711] [INFO ] [MAIN ] JOBY: Loaded 40550 existing records. [2025-09-15T19:02:53.878173] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:53.944855] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-15T19:02:54.065665] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:54.095534] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-15T19:02:54.129169] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-15T19:02:54.134301] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:54.134488] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-15T19:02:54.134533] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-15T19:02:54.135382] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-15T19:02:54.135430] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-15T19:02:54.135472] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-15T19:02:54.141123] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-15T19:02:54.407978] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T19:02:54.488111] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-15T19:02:54.843167] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:54.858767] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-15T19:02:54.861813] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:54.862810] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-15T19:02:54.915118] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T19:02:54.916038] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-15T19:02:55.486959] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:02:55.488237] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-15T19:02:55.534097] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T19:02:55.657914] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-15T19:02:55.852787] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T19:02:56.457876] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-15T19:02:56.770003] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T19:02:56.895232] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T19:02:56.919694] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:02:57.257839] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-15T19:02:57.288973] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T19:02:58.057884] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-15T19:02:58.533161] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:02:58.857901] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-15T19:02:59.641794] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T19:02:59.657808] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-15T19:03:00.457886] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-15T19:03:00.788514] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T19:03:01.088000] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T19:03:01.257870] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-15T19:03:01.861327] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T19:03:02.057851] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-15T19:03:02.857918] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-15T19:03:03.657888] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-15T19:03:04.293539] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-15T19:03:04.457883] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-15T19:03:05.032421] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:03:05.033255] [INFO ] [REMOTE ] JMM: Full fetch complete (1966 records). [2025-09-15T19:03:05.033374] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-15T19:03:05.221829] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T19:03:05.222060] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:03:05.222124] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:03:05.222164] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-15T19:03:05.222486] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-15T19:03:05.222555] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-15T19:03:05.222756] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-15T19:03:05.222931] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 13.1s. Estimated remaining: 2h 8m 1s. Rate: 9.4 symbols/min [2025-09-15T19:03:05.413162] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:05.455059] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (3.40 seconds). [2025-09-15T19:03:05.515825] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-15T19:03:05.513936] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-15T19:03:05.539915] [DEBUG] [LOCAL ] JOE: Loaded 17984 existing records from primary storage. [2025-09-15T19:03:05.540135] [INFO ] [MAIN ] JOE: Loaded 17984 existing records. [2025-09-15T19:03:05.738450] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:05.738889] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-15T19:03:05.738944] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-15T19:03:05.740074] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-15T19:03:05.740162] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-15T19:03:06.062988] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-15T19:03:06.125284] [INFO ] [REMOTE ] JOE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:06.654411] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T19:03:06.857926] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-15T19:03:07.639675] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:03:07.657821] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-15T19:03:08.099914] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-15T19:03:08.302443] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:03:08.457879] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-15T19:03:08.835033] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:03:09.257896] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-15T19:03:09.593010] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T19:03:10.057944] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-15T19:03:10.857883] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-15T19:03:11.019234] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:03:11.657876] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-15T19:03:12.168024] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:03:12.259056] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T19:03:12.457911] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-15T19:03:13.257899] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-15T19:03:13.596263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T19:03:14.057949] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-15T19:03:14.467272] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T19:03:14.632993] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T19:03:14.857968] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-15T19:03:15.662963] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-15T19:03:15.680592] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T19:03:16.457926] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-15T19:03:16.983904] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-15T19:03:16.989845] [INFO ] [REMOTE ] JOBY: Full fetch complete (58475 records). [2025-09-15T19:03:16.989960] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-15T19:03:17.261760] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-15T19:03:17.395431] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-15T19:03:17.395592] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-15T19:03:17.396530] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-15T19:03:17.396607] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-15T19:03:17.430266] [DEBUG] [LOCAL ] JOBY: Trimmed 58475 records to 39771 (keeping 150 days of data) [2025-09-15T19:03:17.432923] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T19:03:17.696156] [DEBUG] [LOCAL ] JOBY: Primary data saved (39771 records). [2025-09-15T19:03:17.696329] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-15T19:03:17.696460] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOBY took 25.6s. Estimated remaining: 2h 8m 1s. Rate: 9.4 symbols/min [2025-09-15T19:03:17.877497] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:17.885217] [DEBUG] [LOCAL ] JOF: Loaded 5158 existing records from primary storage. [2025-09-15T19:03:17.885366] [INFO ] [MAIN ] JOF: Loaded 5158 existing records. [2025-09-15T19:03:18.059384] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-15T19:03:18.084080] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:18.084966] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-15T19:03:18.085016] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-15T19:03:18.085293] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-15T19:03:18.085340] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-15T19:03:18.453435] [INFO ] [REMOTE ] JOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:18.624225] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T19:03:18.630507] [INFO ] [REMOTE ] JNJ: Full fetch complete (58433 records). [2025-09-15T19:03:18.630659] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-15T19:03:18.869007] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-15T19:03:19.016976] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-15T19:03:19.017062] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-15T19:03:19.017904] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-15T19:03:19.017949] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-15T19:03:19.019212] [DEBUG] [LOCAL ] JNJ: Trimmed 58433 records to 39713 (keeping 150 days of data) [2025-09-15T19:03:19.145834] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T19:03:19.303624] [DEBUG] [LOCAL ] JNJ: Primary data saved (39713 records). [2025-09-15T19:03:19.303797] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-15T19:03:19.303884] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 27.2s. Estimated remaining: 2h 7m 49s. Rate: 9.4 symbols/min [2025-09-15T19:03:19.476112] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:03:19.477475] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:19.504698] [DEBUG] [LOCAL ] JPC: Loaded 27300 existing records from primary storage. [2025-09-15T19:03:19.504836] [INFO ] [MAIN ] JPC: Loaded 27300 existing records. [2025-09-15T19:03:19.664503] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-15T19:03:19.686526] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:19.686738] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-15T19:03:19.686786] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-15T19:03:19.687485] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-15T19:03:19.687535] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-15T19:03:20.043056] [INFO ] [REMOTE ] JPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:20.462968] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-15T19:03:20.473569] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-15T19:03:20.479787] [INFO ] [REMOTE ] JMIA: Full fetch complete (54791 records). [2025-09-15T19:03:20.479989] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-15T19:03:20.815529] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T19:03:20.894107] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-15T19:03:20.894261] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-15T19:03:20.895731] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-15T19:03:20.895799] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-15T19:03:20.897471] [DEBUG] [LOCAL ] JMIA: Trimmed 54791 records to 37586 (keeping 150 days of data) [2025-09-15T19:03:21.015991] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:03:21.141955] [DEBUG] [LOCAL ] JMIA: Primary data saved (37586 records). [2025-09-15T19:03:21.142114] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-15T19:03:21.142193] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JMIA took 29.1s. Estimated remaining: 2h 7m 38s. Rate: 9.4 symbols/min [2025-09-15T19:03:21.263011] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-15T19:03:21.315674] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:21.321907] [DEBUG] [LOCAL ] JPI: Loaded 4000 existing records from primary storage. [2025-09-15T19:03:21.322025] [INFO ] [MAIN ] JPI: Loaded 4000 existing records. [2025-09-15T19:03:21.497497] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:21.497791] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-15T19:03:21.497839] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-15T19:03:21.498108] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-15T19:03:21.498155] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-15T19:03:21.874430] [INFO ] [REMOTE ] JPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:22.057869] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-15T19:03:22.570094] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T19:03:22.629139] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:03:22.857881] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-15T19:03:23.657876] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-15T19:03:24.222202] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:03:24.248089] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:03:24.457891] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-15T19:03:25.257935] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-15T19:03:25.940051] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:03:26.010525] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:03:26.057828] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-15T19:03:26.857899] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-15T19:03:27.079255] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T19:03:27.657937] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-15T19:03:27.891484] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:03:28.051971] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T19:03:28.457868] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-15T19:03:29.257890] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-15T19:03:29.432484] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T19:03:29.960344] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:03:30.057876] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-15T19:03:30.667672] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T19:03:30.857872] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-15T19:03:31.434937] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:03:31.657857] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-15T19:03:32.235971] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T19:03:32.457862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-15T19:03:33.257870] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-15T19:03:33.607463] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:03:33.835402] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T19:03:34.057879] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-15T19:03:34.682025] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:03:34.857870] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-15T19:03:35.599317] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:03:35.602159] [INFO ] [REMOTE ] JOE: Full fetch complete (26974 records). [2025-09-15T19:03:35.602233] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-15T19:03:35.663952] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-15T19:03:35.976763] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-15T19:03:35.976846] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-15T19:03:35.977402] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-15T19:03:35.977442] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-15T19:03:35.978144] [DEBUG] [LOCAL ] JOE: Trimmed 26974 records to 17669 (keeping 150 days of data) [2025-09-15T19:03:36.087695] [DEBUG] [LOCAL ] JOE: Primary data saved (17669 records). [2025-09-15T19:03:36.087848] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-15T19:03:36.087934] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 30.9s. Estimated remaining: 2h 7m 41s. Rate: 9.4 symbols/min [2025-09-15T19:03:36.258118] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:36.303141] [DEBUG] [LOCAL ] JPM: Loaded 40534 existing records from primary storage. [2025-09-15T19:03:36.303296] [INFO ] [MAIN ] JPM: Loaded 40534 existing records. [2025-09-15T19:03:36.457921] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-15T19:03:36.480854] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:36.481107] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-15T19:03:36.481154] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-15T19:03:36.482228] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-15T19:03:36.482282] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-15T19:03:36.845494] [INFO ] [REMOTE ] JPM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:36.869351] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:03:37.065455] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:03:37.066736] [INFO ] [REMOTE ] JPI: Full fetch complete (5865 records). [2025-09-15T19:03:37.066852] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-15T19:03:37.263025] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-15T19:03:37.442185] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-15T19:03:37.442296] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-15T19:03:37.442620] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-15T19:03:37.442683] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-15T19:03:37.443186] [DEBUG] [LOCAL ] JPI: Trimmed 5865 records to 3826 (keeping 150 days of data) [2025-09-15T19:03:37.474087] [DEBUG] [LOCAL ] JPI: Primary data saved (3826 records). [2025-09-15T19:03:37.474303] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-15T19:03:37.474439] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPI took 16.3s. Estimated remaining: 2h 7m 29s. Rate: 9.4 symbols/min [2025-09-15T19:03:37.645140] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:37.668672] [DEBUG] [LOCAL ] JQC: Loaded 24817 existing records from primary storage. [2025-09-15T19:03:37.668824] [INFO ] [MAIN ] JQC: Loaded 24817 existing records. [2025-09-15T19:03:37.850502] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:37.850836] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-15T19:03:37.850884] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-15T19:03:37.851615] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-15T19:03:37.851693] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-15T19:03:38.063044] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-15T19:03:38.210911] [INFO ] [REMOTE ] JQC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:38.797367] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T19:03:38.857891] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-15T19:03:39.287073] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T19:03:39.459890] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:03:39.657939] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-15T19:03:40.244627] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:03:40.457864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-15T19:03:41.096197] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T19:03:41.097914] [INFO ] [REMOTE ] JOF: Full fetch complete (7540 records). [2025-09-15T19:03:41.098003] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-15T19:03:41.258100] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-15T19:03:41.469075] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-15T19:03:41.469178] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-15T19:03:41.469419] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-15T19:03:41.469463] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-15T19:03:41.470166] [DEBUG] [LOCAL ] JOF: Trimmed 7540 records to 5046 (keeping 150 days of data) [2025-09-15T19:03:41.502551] [DEBUG] [LOCAL ] JOF: Primary data saved (5046 records). [2025-09-15T19:03:41.502741] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-15T19:03:41.502840] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JOF took 23.8s. Estimated remaining: 2h 7m 21s. Rate: 9.4 symbols/min [2025-09-15T19:03:41.681438] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:41.694006] [DEBUG] [LOCAL ] JRI: Loaded 11176 existing records from primary storage. [2025-09-15T19:03:41.698534] [INFO ] [MAIN ] JRI: Loaded 11176 existing records. [2025-09-15T19:03:41.880564] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:41.880887] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-15T19:03:41.880939] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-15T19:03:41.881359] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-15T19:03:41.881408] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-15T19:03:42.061266] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-15T19:03:42.286976] [INFO ] [REMOTE ] JRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:42.857865] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-15T19:03:43.092302] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:03:43.657869] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-15T19:03:43.826892] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T19:03:43.847744] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:03:44.457958] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-15T19:03:44.663196] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:03:45.258006] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-15T19:03:45.780219] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:03:45.785934] [INFO ] [REMOTE ] JPC: Full fetch complete (40726 records). [2025-09-15T19:03:45.786064] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-15T19:03:46.061327] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:03:46.061450] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-15T19:03:46.204893] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-15T19:03:46.205057] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-15T19:03:46.206173] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-15T19:03:46.206244] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-15T19:03:46.207822] [DEBUG] [LOCAL ] JPC: Trimmed 40726 records to 26736 (keeping 150 days of data) [2025-09-15T19:03:46.378435] [DEBUG] [LOCAL ] JPC: Primary data saved (26736 records). [2025-09-15T19:03:46.378663] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-15T19:03:46.378788] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JPC took 27.1s. Estimated remaining: 2h 7m 13s. Rate: 9.4 symbols/min [2025-09-15T19:03:46.557998] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:46.568889] [DEBUG] [LOCAL ] JRS: Loaded 8399 existing records from primary storage. [2025-09-15T19:03:46.569054] [INFO ] [MAIN ] JRS: Loaded 8399 existing records. [2025-09-15T19:03:46.757841] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:46.758192] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-15T19:03:46.758243] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-15T19:03:46.758695] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-15T19:03:46.758750] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-15T19:03:46.864499] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-15T19:03:47.137106] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:47.587165] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:03:47.657828] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-15T19:03:48.457937] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-15T19:03:49.050492] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:03:49.097355] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:03:49.215194] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-15T19:03:49.257826] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-15T19:03:50.057923] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-15T19:03:50.857904] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-15T19:03:50.996949] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:03:51.172113] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T19:03:51.657909] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-15T19:03:51.702823] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:03:52.457888] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-15T19:03:52.554244] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T19:03:53.257874] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-15T19:03:53.641477] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:03:54.057885] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-15T19:03:54.857902] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-15T19:03:55.167622] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:03:55.391811] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T19:03:55.405996] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T19:03:55.657870] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-15T19:03:56.457899] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-15T19:03:56.875725] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:03:56.879432] [INFO ] [REMOTE ] JQC: Full fetch complete (36678 records). [2025-09-15T19:03:56.879549] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-15T19:03:57.248267] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-15T19:03:57.248345] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-15T19:03:57.249031] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-15T19:03:57.249077] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-15T19:03:57.249878] [DEBUG] [LOCAL ] JQC: Trimmed 36678 records to 24051 (keeping 150 days of data) [2025-09-15T19:03:57.299614] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-15T19:03:57.394003] [DEBUG] [LOCAL ] JQC: Primary data saved (24051 records). [2025-09-15T19:03:57.394154] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-15T19:03:57.394267] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JQC took 19.9s. Estimated remaining: 2h 7m 11s. Rate: 9.4 symbols/min [2025-09-15T19:03:57.565505] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:57.597622] [DEBUG] [LOCAL ] JXN: Loaded 33633 existing records from primary storage. [2025-09-15T19:03:57.597797] [INFO ] [MAIN ] JXN: Loaded 33633 existing records. [2025-09-15T19:03:57.769571] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:57.769882] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-15T19:03:57.769941] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-15T19:03:57.770702] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-15T19:03:57.770752] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-15T19:03:58.063105] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-15T19:03:58.131360] [INFO ] [REMOTE ] JXN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:58.133756] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T19:03:58.857838] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-15T19:03:58.951854] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-15T19:03:59.019590] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:03:59.657906] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-15T19:04:00.156245] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T19:04:00.393123] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:04:00.457891] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-15T19:04:01.257900] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-15T19:04:01.268047] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:04:02.057929] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-15T19:04:02.713760] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:04:02.857907] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-15T19:04:03.552913] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-15T19:04:03.639259] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:04:03.657851] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-15T19:04:04.407714] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:04:04.457915] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-15T19:04:05.263593] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-15T19:04:05.266613] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T19:04:05.269565] [INFO ] [REMOTE ] JRI: Full fetch complete (16746 records). [2025-09-15T19:04:05.269672] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-15T19:04:05.636769] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-15T19:04:05.636883] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-15T19:04:05.637296] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-15T19:04:05.637344] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-15T19:04:05.638277] [DEBUG] [LOCAL ] JRI: Trimmed 16746 records to 11077 (keeping 150 days of data) [2025-09-15T19:04:05.711437] [DEBUG] [LOCAL ] JRI: Primary data saved (11077 records). [2025-09-15T19:04:05.711601] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-15T19:04:05.711739] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRI took 24.2s. Estimated remaining: 2h 7m 7s. Rate: 9.4 symbols/min [2025-09-15T19:04:05.887245] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:05.927116] [DEBUG] [LOCAL ] K: Loaded 37697 existing records from primary storage. [2025-09-15T19:04:05.927270] [INFO ] [MAIN ] K: Loaded 37697 existing records. [2025-09-15T19:04:06.073277] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-15T19:04:06.114879] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:06.115171] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-15T19:04:06.115225] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-15T19:04:06.116144] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-15T19:04:06.116199] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-15T19:04:06.483483] [INFO ] [REMOTE ] K: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:06.743029] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:04:06.857922] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-15T19:04:06.920731] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:04:07.657993] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-15T19:04:08.246512] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:04:08.307357] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:04:08.310399] [INFO ] [REMOTE ] JRS: Full fetch complete (11972 records). [2025-09-15T19:04:08.310515] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-15T19:04:08.479037] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-15T19:04:08.726607] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-15T19:04:08.726753] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-15T19:04:08.727334] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-15T19:04:08.727381] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-15T19:04:08.727959] [DEBUG] [LOCAL ] JRS: Trimmed 11972 records to 8279 (keeping 150 days of data) [2025-09-15T19:04:08.781147] [DEBUG] [LOCAL ] JRS: Primary data saved (8279 records). [2025-09-15T19:04:08.781359] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-15T19:04:08.781506] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JRS took 22.4s. Estimated remaining: 2h 6m 57s. Rate: 9.4 symbols/min [2025-09-15T19:04:08.965904] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:08.977994] [DEBUG] [LOCAL ] KAI: Loaded 9945 existing records from primary storage. [2025-09-15T19:04:08.978142] [INFO ] [MAIN ] KAI: Loaded 9945 existing records. [2025-09-15T19:04:09.165998] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:09.166343] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-15T19:04:09.166394] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-15T19:04:09.166920] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-15T19:04:09.166982] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-15T19:04:09.263757] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-15T19:04:09.576793] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:09.978606] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:04:10.057892] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-15T19:04:10.857908] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-15T19:04:11.611319] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:04:11.657829] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-15T19:04:11.676407] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-15T19:04:11.682291] [INFO ] [REMOTE ] JPM: Full fetch complete (58474 records). [2025-09-15T19:04:11.682449] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-15T19:04:12.071726] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-15T19:04:12.071829] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-15T19:04:12.072694] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-15T19:04:12.072757] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-15T19:04:12.074290] [DEBUG] [LOCAL ] JPM: Trimmed 58474 records to 39754 (keeping 150 days of data) [2025-09-15T19:04:12.220690] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:04:12.392309] [DEBUG] [LOCAL ] JPM: Primary data saved (39754 records). [2025-09-15T19:04:12.392479] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-15T19:04:12.393321] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JPM took 36.3s. Estimated remaining: 2h 6m 48s. Rate: 9.4 symbols/min [2025-09-15T19:04:12.466447] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-15T19:04:12.568486] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:12.601146] [DEBUG] [LOCAL ] KAR: Loaded 29952 existing records from primary storage. [2025-09-15T19:04:12.601301] [INFO ] [MAIN ] KAR: Loaded 29952 existing records. [2025-09-15T19:04:12.790439] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:12.790763] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-15T19:04:12.790815] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-15T19:04:12.791441] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-15T19:04:12.791492] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-15T19:04:13.164912] [INFO ] [REMOTE ] KAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:13.235790] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:04:13.259407] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-15T19:04:13.262059] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:04:14.057910] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-15T19:04:14.857921] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-15T19:04:15.117732] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T19:04:15.361511] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T19:04:15.657915] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-15T19:04:16.226362] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:04:16.457937] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-15T19:04:16.861743] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T19:04:17.257885] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-15T19:04:17.736819] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:04:18.057855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-15T19:04:18.478815] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:04:18.857873] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-15T19:04:19.657884] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-15T19:04:19.861534] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T19:04:19.885812] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T19:04:20.457911] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-15T19:04:20.757081] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T19:04:21.257897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-15T19:04:22.044301] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:04:22.057816] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-15T19:04:22.328526] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:04:22.857871] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-15T19:04:23.533338] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:04:23.538273] [INFO ] [REMOTE ] JXN: Full fetch complete (50145 records). [2025-09-15T19:04:23.538375] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-15T19:04:23.662990] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-15T19:04:23.919880] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-15T19:04:23.920018] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-15T19:04:23.920789] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-15T19:04:23.920832] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-15T19:04:23.921846] [DEBUG] [LOCAL ] JXN: Trimmed 50145 records to 32954 (keeping 150 days of data) [2025-09-15T19:04:24.128149] [DEBUG] [LOCAL ] JXN: Primary data saved (32954 records). [2025-09-15T19:04:24.128287] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-15T19:04:24.128368] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. JXN took 26.7s. Estimated remaining: 2h 6m 47s. Rate: 9.4 symbols/min [2025-09-15T19:04:24.300312] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:24.325547] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:04:24.345477] [DEBUG] [LOCAL ] KB: Loaded 18330 existing records from primary storage. [2025-09-15T19:04:24.345601] [INFO ] [MAIN ] KB: Loaded 18330 existing records. [2025-09-15T19:04:24.463034] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-15T19:04:24.523124] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:24.523416] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-15T19:04:24.523480] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-15T19:04:24.524130] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-15T19:04:24.524205] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-15T19:04:24.877279] [INFO ] [REMOTE ] KB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:25.257897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-15T19:04:25.419250] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:04:25.457306] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:04:26.057937] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-15T19:04:26.792921] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T19:04:26.857875] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-15T19:04:27.371416] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:04:27.377353] [INFO ] [REMOTE ] K: Full fetch complete (53984 records). [2025-09-15T19:04:27.377524] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-15T19:04:27.662958] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-15T19:04:27.768939] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-15T19:04:27.769066] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-15T19:04:27.770144] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-15T19:04:27.770212] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-15T19:04:27.785216] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T19:04:27.784321] [DEBUG] [LOCAL ] K: Trimmed 53984 records to 37003 (keeping 150 days of data) [2025-09-15T19:04:28.033124] [DEBUG] [LOCAL ] K: Primary data saved (37003 records). [2025-09-15T19:04:28.033305] [INFO ] [MAIN ] K: Full history saved. [2025-09-15T19:04:28.035245] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 22.3s. Estimated remaining: 2h 6m 38s. Rate: 9.4 symbols/min [2025-09-15T19:04:28.205256] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:28.222693] [DEBUG] [LOCAL ] KBDC: Loaded 14766 existing records from primary storage. [2025-09-15T19:04:28.222839] [INFO ] [MAIN ] KBDC: Loaded 14766 existing records. [2025-09-15T19:04:28.398570] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:28.398848] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-15T19:04:28.398895] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-15T19:04:28.399423] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-15T19:04:28.399481] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-15T19:04:28.462852] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-15T19:04:28.803694] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:28.813955] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:04:29.257866] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-15T19:04:29.727521] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:04:29.908025] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T19:04:30.057872] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-15T19:04:30.857872] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-15T19:04:31.056367] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T19:04:31.657903] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-15T19:04:31.873292] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T19:04:32.353454] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:04:32.457939] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-15T19:04:33.257883] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-15T19:04:33.341610] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:04:34.057862] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-15T19:04:34.313723] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:04:34.857897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-15T19:04:35.049308] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:04:35.657867] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-15T19:04:36.178102] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:04:36.182984] [INFO ] [REMOTE ] KAR: Full fetch complete (43781 records). [2025-09-15T19:04:36.183116] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-15T19:04:36.458265] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-15T19:04:36.595689] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-15T19:04:36.595877] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-15T19:04:36.601894] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-15T19:04:36.601976] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-15T19:04:36.610257] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:04:36.615329] [DEBUG] [LOCAL ] KAR: Trimmed 43781 records to 29474 (keeping 150 days of data) [2025-09-15T19:04:36.797345] [DEBUG] [LOCAL ] KAR: Primary data saved (29474 records). [2025-09-15T19:04:36.797500] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-15T19:04:36.797588] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KAR took 24.4s. Estimated remaining: 2h 6m 34s. Rate: 9.4 symbols/min [2025-09-15T19:04:36.972937] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:37.015198] [DEBUG] [LOCAL ] KBH: Loaded 36402 existing records from primary storage. [2025-09-15T19:04:37.015344] [INFO ] [MAIN ] KBH: Loaded 36402 existing records. [2025-09-15T19:04:37.189287] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:37.189550] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-15T19:04:37.189595] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-15T19:04:37.190381] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-15T19:04:37.190434] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-15T19:04:37.264108] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-15T19:04:37.555606] [INFO ] [REMOTE ] KBH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:37.738135] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:04:38.057938] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-15T19:04:38.105859] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:04:38.857851] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-15T19:04:39.261197] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T19:04:39.490510] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:04:39.657891] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-15T19:04:40.457968] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-15T19:04:40.965830] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:04:41.257986] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-15T19:04:41.835656] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:04:41.976110] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T19:04:42.057938] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-15T19:04:42.857969] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-15T19:04:43.033913] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:04:43.035834] [INFO ] [REMOTE ] KAI: Full fetch complete (15359 records). [2025-09-15T19:04:43.035918] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-15T19:04:43.437332] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-15T19:04:43.437473] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-15T19:04:43.438147] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-15T19:04:43.438201] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-15T19:04:43.439061] [DEBUG] [LOCAL ] KAI: Trimmed 15359 records to 9742 (keeping 150 days of data) [2025-09-15T19:04:43.510257] [DEBUG] [LOCAL ] KAI: Primary data saved (9742 records). [2025-09-15T19:04:43.510478] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-15T19:04:43.510634] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KAI took 34.7s. Estimated remaining: 2h 6m 28s. Rate: 9.4 symbols/min [2025-09-15T19:04:43.665550] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-15T19:04:43.707284] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:43.754057] [DEBUG] [LOCAL ] KBR: Loaded 36186 existing records from primary storage. [2025-09-15T19:04:43.754303] [INFO ] [MAIN ] KBR: Loaded 36186 existing records. [2025-09-15T19:04:43.944692] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:43.945033] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-15T19:04:43.945084] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-15T19:04:43.946002] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-15T19:04:43.946057] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-15T19:04:44.327885] [INFO ] [REMOTE ] KBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:44.457941] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-15T19:04:44.510760] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:04:44.690949] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:04:45.257903] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-15T19:04:45.525888] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:04:46.057960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-15T19:04:46.321773] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:04:46.324603] [INFO ] [REMOTE ] KB: Full fetch complete (26821 records). [2025-09-15T19:04:46.324749] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-15T19:04:46.719340] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-15T19:04:46.719458] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-15T19:04:46.720467] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-15T19:04:46.720531] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-15T19:04:46.722728] [DEBUG] [LOCAL ] KB: Trimmed 26821 records to 17840 (keeping 150 days of data) [2025-09-15T19:04:46.846989] [DEBUG] [LOCAL ] KB: Primary data saved (17840 records). [2025-09-15T19:04:46.847185] [INFO ] [MAIN ] KB: Full history saved. [2025-09-15T19:04:46.847305] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KB took 22.7s. Estimated remaining: 2h 6m 19s. Rate: 9.4 symbols/min [2025-09-15T19:04:46.863072] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-15T19:04:47.039348] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:47.040633] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:04:47.046285] [INFO ] [REMOTE ] KBDC: Full fetch complete (21941 records). [2025-09-15T19:04:47.046679] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-15T19:04:47.377192] [DEBUG] [LOCAL ] KD: Loaded 39273 existing records from primary storage. [2025-09-15T19:04:47.393325] [INFO ] [MAIN ] KD: Loaded 39273 existing records. [2025-09-15T19:04:47.550530] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-15T19:04:47.569817] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-15T19:04:47.573904] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-15T19:04:47.574355] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-15T19:04:47.636607] [DEBUG] [LOCAL ] KBDC: Trimmed 21941 records to 14554 (keeping 150 days of data) [2025-09-15T19:04:47.658493] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-15T19:04:47.658723] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:47.660480] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-15T19:04:47.660610] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-15T19:04:47.661736] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-15T19:04:47.661811] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-15T19:04:48.117528] [DEBUG] [LOCAL ] KBDC: Primary data saved (14554 records). [2025-09-15T19:04:48.142424] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-15T19:04:48.152184] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBDC took 20.1s. Estimated remaining: 2h 6m 7s. Rate: 9.4 symbols/min [2025-09-15T19:04:48.225811] [INFO ] [REMOTE ] KD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:48.369011] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:48.376472] [DEBUG] [LOCAL ] KEN: Loaded 3435 existing records from primary storage. [2025-09-15T19:04:48.376629] [INFO ] [MAIN ] KEN: Loaded 3435 existing records. [2025-09-15T19:04:48.460250] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-15T19:04:48.570216] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:48.570994] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-15T19:04:48.571149] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-15T19:04:48.580828] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-15T19:04:48.595343] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-15T19:04:48.673778] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T19:04:48.986785] [INFO ] [REMOTE ] KEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:49.257952] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-15T19:04:49.466770] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:04:49.563111] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-15T19:04:49.980775] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T19:04:50.057888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-15T19:04:50.857903] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-15T19:04:51.332572] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:04:51.640528] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:04:51.657811] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-15T19:04:52.457932] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-15T19:04:53.004473] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T19:04:53.257923] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-15T19:04:53.477803] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T19:04:54.057930] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-15T19:04:54.445614] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T19:04:54.857874] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-15T19:04:54.960982] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T19:04:55.210685] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T19:04:55.657877] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-15T19:04:56.457888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-15T19:04:57.257882] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-15T19:04:57.385584] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:04:58.057912] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-15T19:04:58.162799] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T19:04:58.585375] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T19:04:58.857878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-15T19:04:59.552095] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:04:59.657926] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-15T19:05:00.457891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-15T19:05:00.547779] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:05:01.257938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-15T19:05:01.393659] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T19:05:01.758435] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T19:05:01.770973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T19:05:02.057938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-15T19:05:02.639586] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:05:02.857871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-15T19:05:03.459837] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:05:03.460882] [INFO ] [REMOTE ] KEN: Full fetch complete (4864 records). [2025-09-15T19:05:03.460953] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-15T19:05:03.663072] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-15T19:05:03.825413] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-15T19:05:03.825515] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-15T19:05:03.825729] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-15T19:05:03.825786] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-15T19:05:03.826175] [DEBUG] [LOCAL ] KEN: Trimmed 4864 records to 3286 (keeping 150 days of data) [2025-09-15T19:05:03.846803] [DEBUG] [LOCAL ] KEN: Primary data saved (3286 records). [2025-09-15T19:05:03.846905] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-15T19:05:03.846999] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KEN took 15.7s. Estimated remaining: 2h 6m 10s. Rate: 9.4 symbols/min [2025-09-15T19:05:04.015551] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:04.041211] [DEBUG] [LOCAL ] KEP: Loaded 24446 existing records from primary storage. [2025-09-15T19:05:04.041361] [INFO ] [MAIN ] KEP: Loaded 24446 existing records. [2025-09-15T19:05:04.218577] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:04.218934] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-15T19:05:04.218987] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-15T19:05:04.219690] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-15T19:05:04.219752] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-15T19:05:04.463104] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-15T19:05:04.570121] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:05.257896] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-15T19:05:05.577958] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T19:05:05.791930] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:05:05.798338] [INFO ] [REMOTE ] KBH: Full fetch complete (53020 records). [2025-09-15T19:05:05.798473] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-15T19:05:06.067068] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-15T19:05:06.187464] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-15T19:05:06.187609] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-15T19:05:06.188566] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-15T19:05:06.188822] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-15T19:05:06.202073] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T19:05:06.206371] [DEBUG] [LOCAL ] KBH: Trimmed 53020 records to 35669 (keeping 150 days of data) [2025-09-15T19:05:06.439597] [DEBUG] [LOCAL ] KBH: Primary data saved (35669 records). [2025-09-15T19:05:06.439777] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-15T19:05:06.439891] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KBH took 29.6s. Estimated remaining: 2h 6m 0s. Rate: 9.4 symbols/min [2025-09-15T19:05:06.608320] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:06.636202] [DEBUG] [LOCAL ] KEX: Loaded 28008 existing records from primary storage. [2025-09-15T19:05:06.636384] [INFO ] [MAIN ] KEX: Loaded 28008 existing records. [2025-09-15T19:05:06.811695] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:06.811995] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-15T19:05:06.812040] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-15T19:05:06.812799] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-15T19:05:06.812850] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-15T19:05:06.865667] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-15T19:05:07.166678] [INFO ] [REMOTE ] KEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:07.650301] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:05:07.660081] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-15T19:05:08.457876] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-15T19:05:08.591210] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T19:05:08.707208] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:05:09.257882] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-15T19:05:09.496128] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:05:10.057888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-15T19:05:10.330247] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:05:10.857872] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-15T19:05:11.450975] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:05:11.456820] [INFO ] [REMOTE ] KD: Full fetch complete (56901 records). [2025-09-15T19:05:11.456992] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-15T19:05:11.668129] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-15T19:05:11.861287] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-15T19:05:11.861385] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-15T19:05:11.862403] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-15T19:05:11.862455] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-15T19:05:11.863819] [DEBUG] [LOCAL ] KD: Trimmed 56901 records to 38505 (keeping 150 days of data) [2025-09-15T19:05:12.096486] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:05:12.136445] [DEBUG] [LOCAL ] KD: Primary data saved (38505 records). [2025-09-15T19:05:12.136668] [INFO ] [MAIN ] KD: Full history saved. [2025-09-15T19:05:12.136778] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KD took 25.3s. Estimated remaining: 2h 5m 53s. Rate: 9.4 symbols/min [2025-09-15T19:05:12.312466] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:12.312688] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-15T19:05:12.312732] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-15T19:05:12.312870] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-15T19:05:12.312913] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-15T19:05:12.312956] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-15T19:05:12.312993] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-15T19:05:12.463089] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-15T19:05:12.668491] [INFO ] [REMOTE ] KEY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:13.212051] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T19:05:13.257944] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-15T19:05:13.923166] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:05:14.057881] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-15T19:05:14.514041] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:05:14.857982] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-15T19:05:15.486334] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T19:05:15.657905] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-15T19:05:15.927558] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T19:05:16.457924] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-15T19:05:16.802471] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:05:17.257870] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-15T19:05:17.829713] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:05:18.057884] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-15T19:05:18.723382] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:05:18.857911] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-15T19:05:19.579685] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:05:19.657961] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-15T19:05:20.276096] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:05:20.457923] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-15T19:05:20.643801] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T19:05:21.257882] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-15T19:05:21.958690] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:05:22.057907] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-15T19:05:22.414144] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:05:22.857879] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-15T19:05:23.335405] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:05:23.341488] [INFO ] [REMOTE ] KBR: Full fetch complete (52855 records). [2025-09-15T19:05:23.341636] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-15T19:05:23.668762] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-15T19:05:23.718161] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-15T19:05:23.718242] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-15T19:05:23.719048] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-15T19:05:23.719093] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-15T19:05:23.720197] [DEBUG] [LOCAL ] KBR: Trimmed 52855 records to 35623 (keeping 150 days of data) [2025-09-15T19:05:23.946554] [DEBUG] [LOCAL ] KBR: Primary data saved (35623 records). [2025-09-15T19:05:23.946715] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-15T19:05:23.947432] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KBR took 40.4s. Estimated remaining: 2h 5m 52s. Rate: 9.4 symbols/min [2025-09-15T19:05:24.118466] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:24.153215] [DEBUG] [LOCAL ] KEYS: Loaded 32034 existing records from primary storage. [2025-09-15T19:05:24.153395] [INFO ] [MAIN ] KEYS: Loaded 32034 existing records. [2025-09-15T19:05:24.331066] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:24.331335] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-15T19:05:24.331381] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-15T19:05:24.332213] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-15T19:05:24.332266] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-15T19:05:24.459408] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-15T19:05:24.694231] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:24.733277] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T19:05:25.134623] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T19:05:25.257893] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-15T19:05:25.471779] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T19:05:25.475456] [INFO ] [REMOTE ] KEP: Full fetch complete (32007 records). [2025-09-15T19:05:25.475609] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-15T19:05:25.853215] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-15T19:05:25.853316] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-15T19:05:25.854201] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-15T19:05:25.854248] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-15T19:05:25.855282] [DEBUG] [LOCAL ] KEP: Trimmed 32007 records to 24216 (keeping 150 days of data) [2025-09-15T19:05:26.008272] [DEBUG] [LOCAL ] KEP: Primary data saved (24216 records). [2025-09-15T19:05:26.008428] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-15T19:05:26.008522] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEP took 22.2s. Estimated remaining: 2h 5m 42s. Rate: 9.4 symbols/min [2025-09-15T19:05:26.063487] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-15T19:05:26.188149] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:26.192292] [DEBUG] [LOCAL ] KF: Loaded 1764 existing records from primary storage. [2025-09-15T19:05:26.192428] [INFO ] [MAIN ] KF: Loaded 1764 existing records. [2025-09-15T19:05:26.379533] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:26.379846] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-15T19:05:26.379894] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-15T19:05:26.380094] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-15T19:05:26.380137] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-15T19:05:26.744773] [INFO ] [REMOTE ] KF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:26.777552] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:05:26.857876] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-15T19:05:27.632598] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:05:27.657824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-15T19:05:28.386019] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:05:28.457855] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-15T19:05:28.785887] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-15T19:05:29.214064] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T19:05:29.219820] [INFO ] [REMOTE ] KEX: Full fetch complete (40779 records). [2025-09-15T19:05:29.219928] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-15T19:05:29.263028] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-15T19:05:29.625008] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-15T19:05:29.625163] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-15T19:05:29.625946] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-15T19:05:29.626013] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-15T19:05:29.626992] [DEBUG] [LOCAL ] KEX: Trimmed 40779 records to 27514 (keeping 150 days of data) [2025-09-15T19:05:29.797023] [DEBUG] [LOCAL ] KEX: Primary data saved (27514 records). [2025-09-15T19:05:29.797169] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-15T19:05:29.797257] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEX took 23.4s. Estimated remaining: 2h 5m 33s. Rate: 9.4 symbols/min [2025-09-15T19:05:29.966311] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:29.983923] [DEBUG] [LOCAL ] KFRC: Loaded 14958 existing records from primary storage. [2025-09-15T19:05:29.984145] [INFO ] [MAIN ] KFRC: Loaded 14958 existing records. [2025-09-15T19:05:30.063060] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-15T19:05:30.169321] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:30.169739] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-15T19:05:30.169792] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-15T19:05:30.170445] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-15T19:05:30.170499] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-15T19:05:30.539164] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:30.857979] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-15T19:05:31.021955] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:05:31.594870] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:05:31.612794] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T19:05:31.657894] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-15T19:05:32.457945] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-15T19:05:32.911586] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:05:32.917361] [INFO ] [REMOTE ] KEY: Full fetch complete (57927 records). [2025-09-15T19:05:32.917545] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-15T19:05:33.127439] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:05:33.128321] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:05:33.128380] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:05:33.128432] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-15T19:05:33.128510] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-15T19:05:33.128551] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-15T19:05:33.128599] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-15T19:05:33.128723] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 21.0s. Estimated remaining: 2h 5m 23s. Rate: 9.4 symbols/min [2025-09-15T19:05:33.263036] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-15T19:05:33.311966] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:33.320723] [DEBUG] [LOCAL ] KFS: Loaded 6394 existing records from primary storage. [2025-09-15T19:05:33.320904] [INFO ] [MAIN ] KFS: Loaded 6394 existing records. [2025-09-15T19:05:33.512576] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:33.513011] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-15T19:05:33.513059] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-15T19:05:33.513402] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-15T19:05:33.513450] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-15T19:05:33.875985] [INFO ] [REMOTE ] KFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:34.045532] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:05:34.064120] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-15T19:05:34.081599] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:05:34.407567] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T19:05:34.857874] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-15T19:05:35.657931] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-15T19:05:36.235275] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:05:36.457909] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-15T19:05:36.510596] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:05:36.970311] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T19:05:37.257869] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-15T19:05:37.835775] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:05:38.057886] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-15T19:05:38.857896] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-15T19:05:39.046436] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:05:39.195960] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T19:05:39.657923] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-15T19:05:40.098765] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:05:40.457901] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-15T19:05:41.234907] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:05:41.257830] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-15T19:05:42.042490] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:05:42.057809] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-15T19:05:42.832194] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:05:42.857844] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-15T19:05:43.596663] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:05:43.657891] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-15T19:05:44.457909] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-15T19:05:45.141437] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:05:45.257862] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-15T19:05:45.356479] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T19:05:46.057932] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-15T19:05:46.382932] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T19:05:46.689558] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:05:46.857868] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-15T19:05:47.228818] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T19:05:47.657872] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-15T19:05:48.337827] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T19:05:48.339318] [INFO ] [REMOTE ] KFS: Full fetch complete (8355 records). [2025-09-15T19:05:48.339395] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-15T19:05:48.462977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-15T19:05:48.710541] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-15T19:05:48.710635] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-15T19:05:48.710906] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-15T19:05:48.710956] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-15T19:05:48.711407] [DEBUG] [LOCAL ] KFS: Trimmed 8355 records to 6290 (keeping 150 days of data) [2025-09-15T19:05:48.749358] [DEBUG] [LOCAL ] KFS: Primary data saved (6290 records). [2025-09-15T19:05:48.749497] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-15T19:05:48.749588] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KFS took 15.6s. Estimated remaining: 2h 5m 26s. Rate: 9.4 symbols/min [2025-09-15T19:05:48.931588] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:48.953959] [DEBUG] [LOCAL ] KFY: Loaded 22010 existing records from primary storage. [2025-09-15T19:05:48.954291] [INFO ] [MAIN ] KFY: Loaded 22010 existing records. [2025-09-15T19:05:49.136154] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:49.136480] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-15T19:05:49.136537] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-15T19:05:49.137558] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-15T19:05:49.137617] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-15T19:05:49.263059] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-15T19:05:49.495925] [INFO ] [REMOTE ] KFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:49.755306] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T19:05:49.756215] [INFO ] [REMOTE ] KF: Full fetch complete (2695 records). [2025-09-15T19:05:49.756284] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-15T19:05:50.062791] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-15T19:05:50.030387] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T19:05:50.184245] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-15T19:05:50.184328] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-15T19:05:50.184446] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-15T19:05:50.184483] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-15T19:05:50.184939] [DEBUG] [LOCAL ] KF: Trimmed 2695 records to 1744 (keeping 150 days of data) [2025-09-15T19:05:50.195977] [DEBUG] [LOCAL ] KF: Primary data saved (1744 records). [2025-09-15T19:05:50.196041] [INFO ] [MAIN ] KF: Full history saved. [2025-09-15T19:05:50.196155] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KF took 24.2s. Estimated remaining: 2h 5m 15s. Rate: 9.4 symbols/min [2025-09-15T19:05:50.362620] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:50.403300] [DEBUG] [LOCAL ] KGC: Loaded 40440 existing records from primary storage. [2025-09-15T19:05:50.403468] [INFO ] [MAIN ] KGC: Loaded 40440 existing records. [2025-09-15T19:05:50.580993] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:50.581251] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-15T19:05:50.581298] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-15T19:05:50.582358] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-15T19:05:50.582412] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-15T19:05:50.863115] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-15T19:05:50.959430] [INFO ] [REMOTE ] KGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:51.275849] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:05:51.657902] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-15T19:05:52.460231] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-15T19:05:52.467870] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T19:05:52.492158] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:05:53.257891] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-15T19:05:54.050190] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:05:54.062070] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-15T19:05:54.093831] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:05:54.857899] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-15T19:05:55.353959] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:05:55.359319] [INFO ] [REMOTE ] KEYS: Full fetch complete (47495 records). [2025-09-15T19:05:55.359459] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-15T19:05:55.663074] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-15T19:05:55.774037] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-15T19:05:55.774842] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-15T19:05:55.776697] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-15T19:05:55.775392] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:05:55.776888] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-15T19:05:55.783570] [DEBUG] [LOCAL ] KEYS: Trimmed 47495 records to 31401 (keeping 150 days of data) [2025-09-15T19:05:56.004981] [DEBUG] [LOCAL ] KEYS: Primary data saved (31401 records). [2025-09-15T19:05:56.005211] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-15T19:05:56.005341] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KEYS took 32.1s. Estimated remaining: 2h 5m 8s. Rate: 9.4 symbols/min [2025-09-15T19:05:56.180962] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:56.217912] [DEBUG] [LOCAL ] KGS: Loaded 34220 existing records from primary storage. [2025-09-15T19:05:56.218142] [INFO ] [MAIN ] KGS: Loaded 34220 existing records. [2025-09-15T19:05:56.407455] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:56.407876] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-15T19:05:56.407996] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-15T19:05:56.409171] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-15T19:05:56.409235] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-15T19:05:56.467462] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-15T19:05:56.787144] [INFO ] [REMOTE ] KGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:57.257848] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-15T19:05:57.694854] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T19:05:57.786138] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T19:05:58.057851] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-15T19:05:58.118166] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:05:58.857895] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-15T19:05:59.657874] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-15T19:06:00.137799] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T19:06:00.170726] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:06:00.457872] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-15T19:06:00.867365] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:06:01.257907] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-15T19:06:02.057931] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-15T19:06:02.857933] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-15T19:06:03.413113] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T19:06:03.519579] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-15T19:06:03.657861] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-15T19:06:04.457896] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-15T19:06:04.892455] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-15T19:06:04.895518] [INFO ] [REMOTE ] KFRC: Full fetch complete (20151 records). [2025-09-15T19:06:04.895597] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-15T19:06:05.277610] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-15T19:06:05.277741] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-15T19:06:05.278202] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-15T19:06:05.278245] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-15T19:06:05.279138] [DEBUG] [LOCAL ] KFRC: Trimmed 20151 records to 14809 (keeping 150 days of data) [2025-09-15T19:06:05.393575] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-15T19:06:05.406690] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-15T19:06:05.417751] [DEBUG] [LOCAL ] KFRC: Primary data saved (14809 records). [2025-09-15T19:06:05.417915] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-15T19:06:05.418039] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFRC took 35.6s. Estimated remaining: 2h 5m 5s. Rate: 9.4 symbols/min [2025-09-15T19:06:05.605167] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:05.647075] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-15T19:06:05.680777] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:06:05.725160] [DEBUG] [LOCAL ] KIM: Loaded 39911 existing records from primary storage. [2025-09-15T19:06:05.725319] [INFO ] [MAIN ] KIM: Loaded 39911 existing records. [2025-09-15T19:06:05.905042] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:05.905333] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-15T19:06:05.905384] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-15T19:06:05.906297] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-15T19:06:05.906350] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-15T19:06:06.061068] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-15T19:06:06.313919] [INFO ] [REMOTE ] KIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:06.679122] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:06:06.857927] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-15T19:06:07.453853] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:06:07.657861] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-15T19:06:08.040659] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:06:08.457860] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-15T19:06:08.669904] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T19:06:09.257918] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-15T19:06:09.462074] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:06:10.057870] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-15T19:06:10.517333] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:06:10.523091] [INFO ] [REMOTE ] KFY: Full fetch complete (33271 records). [2025-09-15T19:06:10.523234] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-15T19:06:10.863071] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-15T19:06:10.906906] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-15T19:06:10.906984] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-15T19:06:10.907616] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-15T19:06:10.907683] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-15T19:06:10.908544] [DEBUG] [LOCAL ] KFY: Trimmed 33271 records to 21543 (keeping 150 days of data) [2025-09-15T19:06:11.042504] [DEBUG] [LOCAL ] KFY: Primary data saved (21543 records). [2025-09-15T19:06:11.042619] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-15T19:06:11.042729] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KFY took 22.3s. Estimated remaining: 2h 4m 58s. Rate: 9.4 symbols/min [2025-09-15T19:06:11.211382] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:11.242002] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:06:11.256687] [DEBUG] [LOCAL ] KIO: Loaded 15563 existing records from primary storage. [2025-09-15T19:06:11.256808] [INFO ] [MAIN ] KIO: Loaded 15563 existing records. [2025-09-15T19:06:11.431277] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:11.431485] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-15T19:06:11.431530] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-15T19:06:11.431994] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-15T19:06:11.432047] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-15T19:06:11.667144] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-15T19:06:11.791387] [INFO ] [REMOTE ] KIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:12.456278] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:06:12.466714] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-15T19:06:13.257947] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-15T19:06:13.490153] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T19:06:14.057908] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-15T19:06:14.136406] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T19:06:14.857941] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-15T19:06:15.668060] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-15T19:06:15.673736] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-15T19:06:16.379064] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:06:16.451454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-15T19:06:16.462296] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-15T19:06:16.722549] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:06:17.257882] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-15T19:06:17.878212] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:06:18.057876] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-15T19:06:18.359674] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T19:06:18.857879] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-15T19:06:19.657884] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-15T19:06:19.700610] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T19:06:19.728858] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T19:06:20.457876] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-15T19:06:21.107376] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:06:21.238074] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:06:21.244153] [INFO ] [REMOTE ] KGS: Full fetch complete (49570 records). [2025-09-15T19:06:21.244324] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-15T19:06:21.266435] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-15T19:06:21.640167] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-15T19:06:21.640271] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-15T19:06:21.641207] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-15T19:06:21.641266] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-15T19:06:21.642572] [DEBUG] [LOCAL ] KGS: Trimmed 49570 records to 33588 (keeping 150 days of data) [2025-09-15T19:06:21.866761] [DEBUG] [LOCAL ] KGS: Primary data saved (33588 records). [2025-09-15T19:06:21.866961] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-15T19:06:21.867602] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 25.9s. Estimated remaining: 2h 4m 56s. Rate: 9.4 symbols/min [2025-09-15T19:06:22.040804] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:22.064149] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-15T19:06:22.082466] [DEBUG] [LOCAL ] KKR: Loaded 40272 existing records from primary storage. [2025-09-15T19:06:22.082607] [INFO ] [MAIN ] KKR: Loaded 40272 existing records. [2025-09-15T19:06:22.259895] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:22.260162] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-15T19:06:22.260209] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-15T19:06:22.261181] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-15T19:06:22.261232] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-15T19:06:22.568520] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:06:22.666354] [INFO ] [REMOTE ] KKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:22.857888] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-15T19:06:23.657889] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-15T19:06:23.855872] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T19:06:24.213295] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T19:06:24.457883] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-15T19:06:24.724526] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:06:25.257876] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-15T19:06:26.057900] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-15T19:06:26.218700] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:06:26.365690] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:06:26.370339] [INFO ] [REMOTE ] KIO: Full fetch complete (23378 records). [2025-09-15T19:06:26.370574] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-15T19:06:26.753004] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-15T19:06:26.753111] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-15T19:06:26.754087] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-15T19:06:26.754211] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-15T19:06:26.755038] [DEBUG] [LOCAL ] KIO: Trimmed 23378 records to 15394 (keeping 150 days of data) [2025-09-15T19:06:26.863092] [DEBUG] [LOCAL ] KIO: Primary data saved (15394 records). [2025-09-15T19:06:26.863541] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-15T19:06:26.863365] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-15T19:06:26.863718] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KIO took 15.8s. Estimated remaining: 2h 4m 48s. Rate: 9.4 symbols/min [2025-09-15T19:06:27.047673] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:27.055689] [DEBUG] [LOCAL ] KKRS: Loaded 4649 existing records from primary storage. [2025-09-15T19:06:27.055858] [INFO ] [MAIN ] KKRS: Loaded 4649 existing records. [2025-09-15T19:06:27.239117] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:27.239495] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-15T19:06:27.239545] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-15T19:06:27.239954] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-15T19:06:27.240014] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-15T19:06:27.619396] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:27.658600] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-15T19:06:27.664213] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:06:28.457862] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-15T19:06:28.667280] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T19:06:28.673169] [INFO ] [REMOTE ] KIM: Full fetch complete (57700 records). [2025-09-15T19:06:28.673275] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-15T19:06:29.054092] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-15T19:06:29.054188] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-15T19:06:29.055106] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-15T19:06:29.055152] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-15T19:06:29.056357] [DEBUG] [LOCAL ] KIM: Trimmed 57700 records to 39124 (keeping 150 days of data) [2025-09-15T19:06:29.269660] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-15T19:06:29.305584] [DEBUG] [LOCAL ] KIM: Primary data saved (39124 records). [2025-09-15T19:06:29.305715] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-15T19:06:29.306727] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIM took 23.9s. Estimated remaining: 2h 4m 38s. Rate: 9.4 symbols/min [2025-09-15T19:06:29.487679] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:29.487913] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-15T19:06:29.488039] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-15T19:06:29.488288] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-15T19:06:29.488337] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-15T19:06:29.488442] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-15T19:06:29.488544] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-15T19:06:29.606264] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T19:06:29.671818] [INFO ] [REMOTE ] KGC: Full fetch complete (58377 records). [2025-09-15T19:06:29.725472] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-15T19:06:29.896313] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T19:06:29.987781] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:30.061423] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-15T19:06:30.273970] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-15T19:06:30.274092] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-15T19:06:30.275062] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-15T19:06:30.275235] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-15T19:06:30.276739] [DEBUG] [LOCAL ] KGC: Trimmed 58377 records to 39660 (keeping 150 days of data) [2025-09-15T19:06:30.374359] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:30.375736] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-15T19:06:30.417868] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:06:30.580746] [DEBUG] [LOCAL ] KGC: Primary data saved (39660 records). [2025-09-15T19:06:30.580984] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-15T19:06:30.582150] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KGC took 40.4s. Estimated remaining: 2h 4m 27s. Rate: 9.4 symbols/min [2025-09-15T19:06:30.752125] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:30.752339] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-15T19:06:30.752380] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-15T19:06:30.752554] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-15T19:06:30.752605] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-15T19:06:30.752666] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-15T19:06:30.752703] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-15T19:06:30.862979] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-15T19:06:31.107299] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:31.180991] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:31.181270] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-15T19:06:31.657859] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-15T19:06:31.903278] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:31.903618] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-15T19:06:32.457879] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-15T19:06:33.257913] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-15T19:06:33.473755] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:33.474140] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-15T19:06:34.057931] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-15T19:06:34.249990] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:34.250352] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-15T19:06:34.431916] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T19:06:34.857874] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-15T19:06:35.241218] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T19:06:35.657867] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-15T19:06:36.457914] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-15T19:06:37.257863] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-15T19:06:37.753249] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T19:06:37.754038] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T19:06:37.782467] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T19:06:38.057875] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-15T19:06:38.634994] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:06:38.857879] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-15T19:06:39.607142] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:06:39.657866] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-15T19:06:40.426270] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:06:40.457830] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-15T19:06:41.257895] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-15T19:06:41.313126] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:06:41.666694] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:06:42.057984] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-15T19:06:42.249907] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:42.250419] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-15T19:06:42.857920] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-15T19:06:43.657903] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-15T19:06:44.217086] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:06:44.390009] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:06:44.457960] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-15T19:06:45.257966] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-15T19:06:45.687177] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:06:46.057916] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-15T19:06:46.154017] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:06:46.857980] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-15T19:06:46.938594] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T19:06:46.940524] [INFO ] [REMOTE ] KKRT: Full fetch complete (7924 records). [2025-09-15T19:06:46.940602] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-15T19:06:47.132899] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 74 unique days, need 150 days [2025-09-15T19:06:47.133246] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:06:47.133326] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:06:47.133408] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-15T19:06:47.133478] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-15T19:06:47.133519] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-15T19:06:47.133569] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-15T19:06:47.133724] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRT took 17.8s. Estimated remaining: 2h 4m 30s. Rate: 9.4 symbols/min [2025-09-15T19:06:47.309677] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:47.342388] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T19:06:47.344060] [INFO ] [REMOTE ] KKRS: Full fetch complete (6309 records). [2025-09-15T19:06:47.344138] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-15T19:06:47.462466] [DEBUG] [LOCAL ] KLC: Loaded 26667 existing records from primary storage. [2025-09-15T19:06:47.473601] [INFO ] [MAIN ] KLC: Loaded 26667 existing records. [2025-09-15T19:06:47.668262] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-15T19:06:47.937135] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-15T19:06:47.929750] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:47.937352] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-15T19:06:47.937916] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-15T19:06:47.938045] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-15T19:06:47.938210] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-15T19:06:47.938479] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-15T19:06:47.938940] [DEBUG] [LOCAL ] KKRS: Trimmed 6309 records to 4474 (keeping 150 days of data) [2025-09-15T19:06:47.939886] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-15T19:06:47.940002] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-15T19:06:48.211539] [DEBUG] [LOCAL ] KKRS: Primary data saved (4474 records). [2025-09-15T19:06:48.248761] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-15T19:06:48.269776] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKRS took 21.4s. Estimated remaining: 2h 4m 19s. Rate: 9.4 symbols/min [2025-09-15T19:06:48.458518] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-15T19:06:48.471138] [INFO ] [REMOTE ] KLC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:48.541122] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:48.584283] [DEBUG] [LOCAL ] KLG: Loaded 31211 existing records from primary storage. [2025-09-15T19:06:48.584497] [INFO ] [MAIN ] KLG: Loaded 31211 existing records. [2025-09-15T19:06:48.747079] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:48.749056] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-15T19:06:48.770177] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:48.770564] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-15T19:06:48.770621] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-15T19:06:48.771618] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-15T19:06:48.771699] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-15T19:06:49.136383] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:49.257894] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-15T19:06:49.836509] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:06:50.057891] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-15T19:06:50.324256] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T19:06:50.857980] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-15T19:06:51.341824] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:06:51.657917] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-15T19:06:51.875198] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:51.875528] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-15T19:06:52.384523] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T19:06:52.390988] [INFO ] [REMOTE ] KKR: Full fetch complete (58198 records). [2025-09-15T19:06:52.391179] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-15T19:06:52.463108] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-15T19:06:52.809391] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-15T19:06:52.809522] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-15T19:06:52.810593] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-15T19:06:52.810657] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-15T19:06:52.812341] [DEBUG] [LOCAL ] KKR: Trimmed 58198 records to 39486 (keeping 150 days of data) [2025-09-15T19:06:53.101961] [DEBUG] [LOCAL ] KKR: Primary data saved (39486 records). [2025-09-15T19:06:53.102374] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-15T19:06:53.103722] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 31.2s. Estimated remaining: 2h 4m 11s. Rate: 9.4 symbols/min [2025-09-15T19:06:53.257998] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-15T19:06:53.453416] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:53.453816] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-15T19:06:53.634363] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:06:54.057954] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-15T19:06:54.857897] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-15T19:06:55.471954] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:06:55.657886] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-15T19:06:55.859305] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:55.859693] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-15T19:06:56.457881] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-15T19:06:56.506781] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:06:57.257925] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-15T19:06:57.453325] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:06:57.456894] [INFO ] [REMOTE ] KLAR: Full fetch complete (1343 records). [2025-09-15T19:06:57.456982] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-15T19:06:57.658022] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 4 unique days, need 150 days [2025-09-15T19:06:57.658323] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:06:57.658383] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:06:57.658441] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-15T19:06:57.658517] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-15T19:06:57.658557] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-15T19:06:57.658618] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-15T19:06:57.658725] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLAR took 27.1s. Estimated remaining: 2h 4m 3s. Rate: 9.4 symbols/min [2025-09-15T19:06:58.057915] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-15T19:06:58.498719] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:06:58.857885] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-15T19:06:59.396302] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:06:59.657943] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-15T19:06:59.846816] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T19:07:00.457877] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-15T19:07:00.869395] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T19:07:01.257892] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-15T19:07:01.426726] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:07:02.057888] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-15T19:07:02.672553] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:07:02.857887] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-15T19:07:03.136879] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T19:07:03.657877] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-15T19:07:04.485800] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:07:04.496201] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-15T19:07:05.280633] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T19:07:05.286985] [INFO ] [REMOTE ] KLC: Full fetch complete (38381 records). [2025-09-15T19:07:05.287310] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-15T19:07:05.802510] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-15T19:07:05.802745] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-15T19:07:05.807419] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-15T19:07:05.807676] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-15T19:07:05.845354] [DEBUG] [LOCAL ] KLC: Trimmed 38381 records to 26104 (keeping 150 days of data) [2025-09-15T19:07:05.848229] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T19:07:05.863331] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-15T19:07:06.105273] [DEBUG] [LOCAL ] KLC: Primary data saved (26104 records). [2025-09-15T19:07:06.105488] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-15T19:07:06.105672] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLC took 19.0s. Estimated remaining: 2h 3m 58s. Rate: 9.4 symbols/min [2025-09-15T19:07:07.382764] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T19:07:07.387553] [INFO ] [REMOTE ] KLG: Full fetch complete (45805 records). [2025-09-15T19:07:07.387688] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-15T19:07:07.817475] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-15T19:07:07.817556] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-15T19:07:07.818318] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-15T19:07:07.818363] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-15T19:07:07.819379] [DEBUG] [LOCAL ] KLG: Trimmed 45805 records to 30713 (keeping 150 days of data) [2025-09-15T19:07:08.024605] [DEBUG] [LOCAL ] KLG: Primary data saved (30713 records). [2025-09-15T19:07:08.024792] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-15T19:07:08.024897] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KLG took 19.8s. Estimated remaining: 2h 3m 48s. Rate: 9.4 symbols/min [2025-09-15T19:07:08.565316] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.650254] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.656785] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.724543] [DEBUG] [LOCAL ] KMPB: Loaded 2589 existing records from primary storage. [2025-09-15T19:07:08.724244] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.724758] [INFO ] [MAIN ] KMPB: Loaded 2589 existing records. [2025-09-15T19:07:08.863750] [DEBUG] [LOCAL ] KMPR: Loaded 29412 existing records from primary storage. [2025-09-15T19:07:08.922726] [INFO ] [MAIN ] KMPR: Loaded 29412 existing records. [2025-09-15T19:07:08.941712] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:08.949290] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-15T19:07:08.954707] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-15T19:07:08.972580] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-15T19:07:08.986894] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-15T19:07:09.162424] [DEBUG] [LOCAL ] KMT: Loaded 32243 existing records from primary storage. [2025-09-15T19:07:09.151487] [DEBUG] [LOCAL ] KMI: Loaded 40433 existing records from primary storage. [2025-09-15T19:07:09.185538] [INFO ] [MAIN ] KMT: Loaded 32243 existing records. [2025-09-15T19:07:09.185836] [INFO ] [MAIN ] KMI: Loaded 40433 existing records. [2025-09-15T19:07:09.533731] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.699922] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-15T19:07:09.766412] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.771620] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-15T19:07:09.837505] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-15T19:07:09.828158] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-15T19:07:09.865574] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-15T19:07:09.885677] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-15T19:07:09.936039] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-15T19:07:09.896521] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.947698] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-15T19:07:10.002856] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.036726] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-15T19:07:10.066049] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-15T19:07:10.085663] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-15T19:07:10.157782] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-15T19:07:10.186542] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-15T19:07:10.730511] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:07:10.838065] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-15T19:07:10.805677] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.899961] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-15T19:07:10.905150] [INFO ] [REMOTE ] KMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.937871] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-15T19:07:11.117949] [INFO ] [REMOTE ] KMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:11.118368] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-15T19:07:11.426475] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:07:11.428182] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-15T19:07:11.876521] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:07:11.878062] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-15T19:07:12.248925] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T19:07:12.250315] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-15T19:07:12.309141] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:07:12.457842] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-15T19:07:12.487304] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:07:12.734686] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:07:12.874894] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T19:07:13.257894] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-15T19:07:13.647047] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:07:14.057880] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-15T19:07:14.491448] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:07:14.857876] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-15T19:07:15.595536] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:07:15.657857] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-15T19:07:16.192047] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:07:16.457908] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-15T19:07:16.626228] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T19:07:17.257900] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-15T19:07:17.695134] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:07:18.057882] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-15T19:07:18.857864] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-15T19:07:19.122369] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T19:07:19.161436] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:07:19.657913] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-15T19:07:20.244735] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:07:20.457868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-15T19:07:20.980153] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:07:21.257904] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-15T19:07:21.691517] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:07:21.813377] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:07:22.057879] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-15T19:07:22.452889] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T19:07:22.857870] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-15T19:07:23.657891] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-15T19:07:24.140595] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T19:07:24.141537] [INFO ] [REMOTE ] KMPB: Full fetch complete (3857 records). [2025-09-15T19:07:24.141606] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-15T19:07:24.462311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-15T19:07:24.533210] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-15T19:07:24.533629] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-15T19:07:24.563889] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-15T19:07:24.568022] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-15T19:07:24.569258] [DEBUG] [LOCAL ] KMPB: Trimmed 3857 records to 2557 (keeping 150 days of data) [2025-09-15T19:07:24.571855] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:07:24.601239] [DEBUG] [LOCAL ] KMPB: Primary data saved (2557 records). [2025-09-15T19:07:24.601428] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-15T19:07:24.601532] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMPB took 16.6s. Estimated remaining: 2h 3m 51s. Rate: 9.4 symbols/min [2025-09-15T19:07:24.778358] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:24.834555] [DEBUG] [LOCAL ] KMX: Loaded 40060 existing records from primary storage. [2025-09-15T19:07:24.834815] [INFO ] [MAIN ] KMX: Loaded 40060 existing records. [2025-09-15T19:07:25.013960] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:25.014289] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-15T19:07:25.014337] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-15T19:07:25.015254] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-15T19:07:25.015306] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-15T19:07:25.264322] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-15T19:07:25.382026] [INFO ] [REMOTE ] KMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:26.057906] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-15T19:07:26.168982] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:07:26.857876] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-15T19:07:27.422168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T19:07:27.554578] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T19:07:27.559940] [INFO ] [REMOTE ] KMPR: Full fetch complete (39768 records). [2025-09-15T19:07:27.560069] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-15T19:07:27.662941] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-15T19:07:27.948041] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-15T19:07:27.948128] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-15T19:07:27.949000] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-15T19:07:27.949050] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-15T19:07:27.950109] [DEBUG] [LOCAL ] KMPR: Trimmed 39768 records to 29002 (keeping 150 days of data) [2025-09-15T19:07:28.143153] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:07:28.157575] [INFO ] [REMOTE ] KMT: Full fetch complete (46910 records). [2025-09-15T19:07:28.163444] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-15T19:07:28.163385] [DEBUG] [LOCAL ] KMPR: Primary data saved (29002 records). [2025-09-15T19:07:28.163677] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-15T19:07:28.163817] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMPR took 20.1s. Estimated remaining: 2h 3m 42s. Rate: 9.4 symbols/min [2025-09-15T19:07:28.461297] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-15T19:07:28.503985] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:28.725939] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-15T19:07:28.726888] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-15T19:07:28.727679] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-15T19:07:28.728111] [DEBUG] [LOCAL ] KN: Loaded 28476 existing records from primary storage. [2025-09-15T19:07:28.728259] [INFO ] [MAIN ] KN: Loaded 28476 existing records. [2025-09-15T19:07:28.728159] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-15T19:07:28.840203] [DEBUG] [LOCAL ] KMT: Trimmed 46910 records to 31670 (keeping 150 days of data) [2025-09-15T19:07:29.007819] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:29.013700] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-15T19:07:29.015992] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-15T19:07:29.017012] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-15T19:07:29.017112] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-15T19:07:29.431741] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:29.454348] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-15T19:07:29.485385] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T19:07:29.512272] [DEBUG] [LOCAL ] KMT: Primary data saved (31670 records). [2025-09-15T19:07:29.512413] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-15T19:07:29.512509] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 21.5s. Estimated remaining: 2h 3m 31s. Rate: 9.4 symbols/min [2025-09-15T19:07:29.684138] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:29.709961] [DEBUG] [LOCAL ] KNF: Loaded 26885 existing records from primary storage. [2025-09-15T19:07:29.710100] [INFO ] [MAIN ] KNF: Loaded 26885 existing records. [2025-09-15T19:07:29.885927] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:29.886234] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-15T19:07:29.886285] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-15T19:07:29.887005] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-15T19:07:29.887056] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-15T19:07:30.062018] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-15T19:07:30.250303] [INFO ] [REMOTE ] KNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:30.289968] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T19:07:30.616385] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:07:30.857867] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-15T19:07:31.657930] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-15T19:07:31.895260] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T19:07:32.019375] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T19:07:32.457891] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-15T19:07:33.257844] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-15T19:07:33.356388] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T19:07:34.057890] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-15T19:07:34.357567] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:07:34.533890] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:07:34.857878] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-15T19:07:35.254802] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T19:07:35.657907] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-15T19:07:36.457872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-15T19:07:36.645490] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:07:36.968210] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T19:07:37.257885] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-15T19:07:37.647602] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:07:38.057909] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-15T19:07:38.857937] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-15T19:07:39.150325] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T19:07:39.491624] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T19:07:39.657885] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-15T19:07:39.981227] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:07:40.457952] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-15T19:07:41.083546] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:07:41.089697] [INFO ] [REMOTE ] KMI: Full fetch complete (58373 records). [2025-09-15T19:07:41.089832] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-15T19:07:41.263886] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-15T19:07:41.486215] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-15T19:07:41.486327] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-15T19:07:41.487248] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-15T19:07:41.487294] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-15T19:07:41.488580] [DEBUG] [LOCAL ] KMI: Trimmed 58373 records to 39653 (keeping 150 days of data) [2025-09-15T19:07:41.740655] [DEBUG] [LOCAL ] KMI: Primary data saved (39653 records). [2025-09-15T19:07:41.740838] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-15T19:07:41.740945] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMI took 33.7s. Estimated remaining: 2h 3m 30s. Rate: 9.4 symbols/min [2025-09-15T19:07:41.909812] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:41.936881] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:07:41.948526] [DEBUG] [LOCAL ] KNOP: Loaded 6675 existing records from primary storage. [2025-09-15T19:07:41.949043] [INFO ] [MAIN ] KNOP: Loaded 6675 existing records. [2025-09-15T19:07:42.063084] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-15T19:07:42.131070] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:42.131684] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-15T19:07:42.131740] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-15T19:07:42.132151] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-15T19:07:42.132199] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-15T19:07:42.476090] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:42.850336] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T19:07:42.860444] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-15T19:07:43.613862] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:07:43.657821] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-15T19:07:44.206673] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T19:07:44.457874] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-15T19:07:44.668387] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T19:07:45.257880] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-15T19:07:45.616699] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:07:46.057884] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-15T19:07:46.630189] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:07:46.634927] [INFO ] [REMOTE ] KN: Full fetch complete (42882 records). [2025-09-15T19:07:46.635033] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-15T19:07:46.752747] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:07:46.863127] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-15T19:07:47.031951] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-15T19:07:47.032062] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-15T19:07:47.033073] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-15T19:07:47.033168] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-15T19:07:47.034440] [DEBUG] [LOCAL ] KN: Trimmed 42882 records to 27770 (keeping 150 days of data) [2025-09-15T19:07:47.205276] [DEBUG] [LOCAL ] KN: Primary data saved (27770 records). [2025-09-15T19:07:47.205452] [INFO ] [MAIN ] KN: Full history saved. [2025-09-15T19:07:47.205552] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KN took 19.0s. Estimated remaining: 2h 3m 23s. Rate: 9.4 symbols/min [2025-09-15T19:07:47.375223] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:47.390580] [DEBUG] [LOCAL ] KNSL: Loaded 13657 existing records from primary storage. [2025-09-15T19:07:47.390736] [INFO ] [MAIN ] KNSL: Loaded 13657 existing records. [2025-09-15T19:07:47.597716] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:47.598050] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-15T19:07:47.598097] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-15T19:07:47.598671] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-15T19:07:47.598721] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-15T19:07:47.663092] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-15T19:07:47.954607] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:48.457902] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-15T19:07:48.481082] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:07:48.749803] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T19:07:49.257927] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-15T19:07:49.656544] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T19:07:49.872243] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:07:50.057975] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-15T19:07:50.802112] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:07:50.857820] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-15T19:07:51.331304] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T19:07:51.657876] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-15T19:07:52.457906] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-15T19:07:52.971554] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:07:53.257884] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-15T19:07:53.333903] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:07:53.894332] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T19:07:54.057894] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-15T19:07:54.857852] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-15T19:07:54.937014] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T19:07:55.657884] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-15T19:07:56.258427] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T19:07:56.457879] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-15T19:07:56.969774] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:07:56.975405] [INFO ] [REMOTE ] KNF: Full fetch complete (38686 records). [2025-09-15T19:07:56.975603] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-15T19:07:57.102403] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T19:07:57.263047] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-15T19:07:57.385042] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-15T19:07:57.385130] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-15T19:07:57.385924] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-15T19:07:57.385972] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-15T19:07:57.387035] [DEBUG] [LOCAL ] KNF: Trimmed 38686 records to 26473 (keeping 150 days of data) [2025-09-15T19:07:57.558121] [DEBUG] [LOCAL ] KNF: Primary data saved (26473 records). [2025-09-15T19:07:57.558284] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-15T19:07:57.558446] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNF took 28.0s. Estimated remaining: 2h 3m 21s. Rate: 9.4 symbols/min [2025-09-15T19:07:57.734408] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:57.770538] [DEBUG] [LOCAL ] KNTK: Loaded 35256 existing records from primary storage. [2025-09-15T19:07:57.770709] [INFO ] [MAIN ] KNTK: Loaded 35256 existing records. [2025-09-15T19:07:57.951717] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:57.952024] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-15T19:07:57.952074] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-15T19:07:57.953016] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-15T19:07:57.953074] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-15T19:07:58.063138] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-15T19:07:58.417237] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:58.436166] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:07:58.857961] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-15T19:07:59.594043] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:07:59.657875] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-15T19:07:59.848727] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:07:59.854748] [INFO ] [REMOTE ] KMX: Full fetch complete (57375 records). [2025-09-15T19:07:59.854860] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-15T19:08:00.235657] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-15T19:08:00.235786] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-15T19:08:00.236752] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-15T19:08:00.236801] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-15T19:08:00.238181] [DEBUG] [LOCAL ] KMX: Trimmed 57375 records to 39282 (keeping 150 days of data) [2025-09-15T19:08:00.461567] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-15T19:08:00.475883] [DEBUG] [LOCAL ] KMX: Primary data saved (39282 records). [2025-09-15T19:08:00.476033] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-15T19:08:00.477581] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KMX took 35.9s. Estimated remaining: 2h 3m 11s. Rate: 9.4 symbols/min [2025-09-15T19:08:00.646408] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:00.686959] [DEBUG] [LOCAL ] KNX: Loaded 39453 existing records from primary storage. [2025-09-15T19:08:00.687107] [INFO ] [MAIN ] KNX: Loaded 39453 existing records. [2025-09-15T19:08:00.864968] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:00.865220] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-15T19:08:00.865266] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-15T19:08:00.866215] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-15T19:08:00.866266] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-15T19:08:01.247523] [INFO ] [REMOTE ] KNX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:01.257915] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-15T19:08:01.287350] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:08:01.287522] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:08:01.297185] [INFO ] [REMOTE ] KNOP: Full fetch complete (10662 records). [2025-09-15T19:08:01.297263] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-15T19:08:01.653450] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-15T19:08:01.653537] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-15T19:08:01.653923] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-15T19:08:01.653988] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-15T19:08:01.654525] [DEBUG] [LOCAL ] KNOP: Trimmed 10662 records to 6609 (keeping 150 days of data) [2025-09-15T19:08:01.693679] [DEBUG] [LOCAL ] KNOP: Primary data saved (6609 records). [2025-09-15T19:08:01.693829] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-15T19:08:01.693957] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNOP took 20.0s. Estimated remaining: 2h 2m 60s. Rate: 9.4 symbols/min [2025-09-15T19:08:01.876785] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:01.914765] [DEBUG] [LOCAL ] KO: Loaded 40558 existing records from primary storage. [2025-09-15T19:08:01.914916] [INFO ] [MAIN ] KO: Loaded 40558 existing records. [2025-09-15T19:08:02.062950] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-15T19:08:02.090027] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:02.091102] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-15T19:08:02.091173] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-15T19:08:02.091973] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-15T19:08:02.092022] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-15T19:08:02.392405] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T19:08:02.473984] [INFO ] [REMOTE ] KO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:02.857883] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-15T19:08:03.625851] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:08:03.657850] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-15T19:08:04.175463] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:08:04.457875] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-15T19:08:04.887474] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T19:08:05.257841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-15T19:08:05.331034] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:08:06.057884] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-15T19:08:06.857902] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-15T19:08:07.148482] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:08:07.321804] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T19:08:07.657929] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-15T19:08:08.107092] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T19:08:08.457918] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-15T19:08:09.172363] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:08:09.175665] [INFO ] [REMOTE ] KNSL: Full fetch complete (20037 records). [2025-09-15T19:08:09.175795] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-15T19:08:09.263007] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-15T19:08:09.564961] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-15T19:08:09.565049] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-15T19:08:09.565578] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-15T19:08:09.565631] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-15T19:08:09.566299] [DEBUG] [LOCAL ] KNSL: Trimmed 20037 records to 13501 (keeping 150 days of data) [2025-09-15T19:08:09.653017] [DEBUG] [LOCAL ] KNSL: Primary data saved (13501 records). [2025-09-15T19:08:09.653171] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-15T19:08:09.653257] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNSL took 22.4s. Estimated remaining: 2h 2m 55s. Rate: 9.4 symbols/min [2025-09-15T19:08:09.825833] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:09.860847] [DEBUG] [LOCAL ] KODK: Loaded 32592 existing records from primary storage. [2025-09-15T19:08:09.861016] [INFO ] [MAIN ] KODK: Loaded 32592 existing records. [2025-09-15T19:08:10.049665] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:10.049947] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-15T19:08:10.050000] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-15T19:08:10.050695] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-15T19:08:10.050789] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-15T19:08:10.063857] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-15T19:08:10.435131] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:10.497946] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-15T19:08:10.539058] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:08:10.857882] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-15T19:08:11.657888] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-15T19:08:11.833527] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T19:08:12.457896] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-15T19:08:12.883117] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:08:13.195089] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T19:08:13.257837] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-15T19:08:13.793560] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:08:14.057899] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-15T19:08:14.813055] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T19:08:14.857843] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-15T19:08:15.533506] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:08:15.657916] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-15T19:08:16.453197] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:08:16.458310] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-15T19:08:16.460022] [INFO ] [REMOTE ] KNTK: Full fetch complete (49767 records). [2025-09-15T19:08:16.460128] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-15T19:08:16.847103] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-15T19:08:16.847198] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-15T19:08:16.848085] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-15T19:08:16.848201] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-15T19:08:16.849484] [DEBUG] [LOCAL ] KNTK: Trimmed 49767 records to 34724 (keeping 150 days of data) [2025-09-15T19:08:17.064227] [DEBUG] [LOCAL ] KNTK: Primary data saved (34724 records). [2025-09-15T19:08:17.064376] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-15T19:08:17.064467] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KNTK took 19.5s. Estimated remaining: 2h 2m 49s. Rate: 9.4 symbols/min [2025-09-15T19:08:17.237224] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:17.257709] [DEBUG] [LOCAL ] KOF: Loaded 19800 existing records from primary storage. [2025-09-15T19:08:17.257885] [INFO ] [MAIN ] KOF: Loaded 19800 existing records. [2025-09-15T19:08:17.257951] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-15T19:08:17.438523] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:17.438854] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-15T19:08:17.438919] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-15T19:08:17.439455] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-15T19:08:17.439517] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-15T19:08:17.794291] [INFO ] [REMOTE ] KOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:17.849797] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:08:18.057870] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-15T19:08:18.258368] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-15T19:08:18.857882] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-15T19:08:18.991189] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:08:19.046819] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:08:19.657908] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-15T19:08:20.457869] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-15T19:08:20.750602] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:08:21.257885] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-15T19:08:21.291120] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-15T19:08:21.973069] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:08:22.057858] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-15T19:08:22.561590] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:08:22.857865] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-15T19:08:23.657868] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-15T19:08:23.765169] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:08:23.776881] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T19:08:24.457896] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-15T19:08:25.257850] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-15T19:08:25.278908] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T19:08:26.057942] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-15T19:08:26.327010] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-15T19:08:26.451959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:08:26.458487] [INFO ] [REMOTE ] KNX: Full fetch complete (57154 records). [2025-09-15T19:08:26.458704] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-15T19:08:26.837393] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-15T19:08:26.837480] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-15T19:08:26.838397] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-15T19:08:26.838442] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-15T19:08:26.839658] [DEBUG] [LOCAL ] KNX: Trimmed 57154 records to 38684 (keeping 150 days of data) [2025-09-15T19:08:26.896880] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-15T19:08:27.102583] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:08:27.111610] [DEBUG] [LOCAL ] KNX: Primary data saved (38684 records). [2025-09-15T19:08:27.111741] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-15T19:08:27.113166] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KNX took 26.6s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-15T19:08:27.298791] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:27.313394] [DEBUG] [LOCAL ] KOP: Loaded 12894 existing records from primary storage. [2025-09-15T19:08:27.313527] [INFO ] [MAIN ] KOP: Loaded 12894 existing records. [2025-09-15T19:08:27.491805] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:27.492117] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-15T19:08:27.492166] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-15T19:08:27.492595] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-15T19:08:27.492675] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-15T19:08:27.663242] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-15T19:08:27.842417] [INFO ] [REMOTE ] KOP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:28.328835] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:08:28.457830] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-15T19:08:28.902953] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:08:29.257887] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-15T19:08:29.904347] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:08:30.057888] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-15T19:08:30.330985] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:08:30.334577] [INFO ] [REMOTE ] KOF: Full fetch complete (28698 records). [2025-09-15T19:08:30.334691] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-15T19:08:30.696685] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-15T19:08:30.696765] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-15T19:08:30.697368] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-15T19:08:30.697418] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-15T19:08:30.698502] [DEBUG] [LOCAL ] KOF: Trimmed 28698 records to 19529 (keeping 150 days of data) [2025-09-15T19:08:30.818484] [DEBUG] [LOCAL ] KOF: Primary data saved (19529 records). [2025-09-15T19:08:30.818653] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-15T19:08:30.818745] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOF took 13.8s. Estimated remaining: 2h 2m 38s. Rate: 9.4 symbols/min [2025-09-15T19:08:30.862963] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-15T19:08:30.994762] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:30.998341] [DEBUG] [LOCAL ] KORE: Loaded 1563 existing records from primary storage. [2025-09-15T19:08:30.998413] [INFO ] [MAIN ] KORE: Loaded 1563 existing records. [2025-09-15T19:08:31.171322] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:31.171547] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-15T19:08:31.171592] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-15T19:08:31.171763] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-15T19:08:31.171808] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-15T19:08:31.521604] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:31.657873] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-15T19:08:31.703152] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:08:32.394752] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T19:08:32.457832] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-15T19:08:33.257921] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-15T19:08:33.327023] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-15T19:08:33.562608] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:08:33.686835] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:08:34.057882] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-15T19:08:34.857864] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-15T19:08:34.932538] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T19:08:35.657938] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-15T19:08:36.293307] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:08:36.348675] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:08:36.457913] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-15T19:08:37.257920] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-15T19:08:38.057910] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-15T19:08:38.242618] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:08:38.325509] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-15T19:08:38.857889] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-15T19:08:39.275089] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T19:08:39.657901] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-15T19:08:39.907266] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-15T19:08:39.913245] [INFO ] [REMOTE ] KO: Full fetch complete (58498 records). [2025-09-15T19:08:39.913424] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-15T19:08:40.023001] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T19:08:40.301822] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-15T19:08:40.301905] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-15T19:08:40.302773] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-15T19:08:40.302820] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-15T19:08:40.306394] [DEBUG] [LOCAL ] KO: Trimmed 58498 records to 39778 (keeping 150 days of data) [2025-09-15T19:08:40.495136] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-15T19:08:40.569880] [DEBUG] [LOCAL ] KO: Primary data saved (39778 records). [2025-09-15T19:08:40.570048] [INFO ] [MAIN ] KO: Full history saved. [2025-09-15T19:08:40.570627] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 38.9s. Estimated remaining: 2h 2m 35s. Rate: 9.4 symbols/min [2025-09-15T19:08:40.745374] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:40.792827] [DEBUG] [LOCAL ] KOS: Loaded 39954 existing records from primary storage. [2025-09-15T19:08:40.793001] [INFO ] [MAIN ] KOS: Loaded 39954 existing records. [2025-09-15T19:08:40.968205] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:40.968557] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-15T19:08:40.968627] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-15T19:08:40.969708] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-15T19:08:40.969783] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-15T19:08:41.263090] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-15T19:08:41.321596] [INFO ] [REMOTE ] KOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:41.727722] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:08:42.062929] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-15T19:08:42.076894] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T19:08:42.857870] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-15T19:08:43.449261] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:08:43.657877] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-15T19:08:43.744420] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T19:08:44.075249] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T19:08:44.457873] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-15T19:08:45.035568] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:08:45.257873] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-15T19:08:45.701349] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T19:08:45.702386] [INFO ] [REMOTE ] KORE: Full fetch complete (2245 records). [2025-09-15T19:08:45.702469] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-15T19:08:46.065322] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-15T19:08:46.106426] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-15T19:08:46.106535] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-15T19:08:46.106699] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-15T19:08:46.106746] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-15T19:08:46.107120] [DEBUG] [LOCAL ] KORE: Trimmed 2245 records to 1525 (keeping 150 days of data) [2025-09-15T19:08:46.117815] [DEBUG] [LOCAL ] KORE: Primary data saved (1525 records). [2025-09-15T19:08:46.117876] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-15T19:08:46.117997] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KORE took 15.3s. Estimated remaining: 2h 2m 27s. Rate: 9.4 symbols/min [2025-09-15T19:08:46.289297] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:46.337364] [DEBUG] [LOCAL ] KR: Loaded 40423 existing records from primary storage. [2025-09-15T19:08:46.337606] [INFO ] [MAIN ] KR: Loaded 40423 existing records. [2025-09-15T19:08:46.514991] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:46.515313] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-15T19:08:46.515363] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-15T19:08:46.516487] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-15T19:08:46.516543] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-15T19:08:46.858625] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-15T19:08:46.939369] [INFO ] [REMOTE ] KR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:47.657959] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-15T19:08:47.944022] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T19:08:48.086000] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T19:08:48.091137] [INFO ] [REMOTE ] KODK: Full fetch complete (47179 records). [2025-09-15T19:08:48.091250] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-15T19:08:48.469989] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-15T19:08:48.467155] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-15T19:08:48.479960] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-15T19:08:48.482147] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-15T19:08:48.482414] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-15T19:08:48.483775] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:08:48.488384] [DEBUG] [LOCAL ] KODK: Trimmed 47179 records to 31957 (keeping 150 days of data) [2025-09-15T19:08:48.700386] [DEBUG] [LOCAL ] KODK: Primary data saved (31957 records). [2025-09-15T19:08:48.700579] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-15T19:08:48.700738] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KODK took 39.0s. Estimated remaining: 2h 2m 18s. Rate: 9.4 symbols/min [2025-09-15T19:08:48.875891] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:48.914534] [DEBUG] [LOCAL ] KRC: Loaded 36061 existing records from primary storage. [2025-09-15T19:08:48.914706] [INFO ] [MAIN ] KRC: Loaded 36061 existing records. [2025-09-15T19:08:49.092925] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:49.093285] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-15T19:08:49.093344] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-15T19:08:49.094167] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-15T19:08:49.094233] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-15T19:08:49.263037] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-15T19:08:49.441323] [INFO ] [REMOTE ] KRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:50.048539] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T19:08:50.057808] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-15T19:08:50.120493] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:08:50.857878] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-15T19:08:51.040580] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:08:51.043359] [INFO ] [REMOTE ] KOP: Full fetch complete (19457 records). [2025-09-15T19:08:51.043431] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-15T19:08:51.402333] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-15T19:08:51.402460] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-15T19:08:51.402938] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-15T19:08:51.402994] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-15T19:08:51.403974] [DEBUG] [LOCAL ] KOP: Trimmed 19457 records to 12639 (keeping 150 days of data) [2025-09-15T19:08:51.487868] [DEBUG] [LOCAL ] KOP: Primary data saved (12639 records). [2025-09-15T19:08:51.488021] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-15T19:08:51.488157] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KOP took 24.4s. Estimated remaining: 2h 2m 8s. Rate: 9.4 symbols/min [2025-09-15T19:08:51.657485] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:51.657917] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-15T19:08:51.688613] [DEBUG] [LOCAL ] KREF: Loaded 27613 existing records from primary storage. [2025-09-15T19:08:51.688777] [INFO ] [MAIN ] KREF: Loaded 27613 existing records. [2025-09-15T19:08:51.862851] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:51.863087] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-15T19:08:51.863134] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-15T19:08:51.863930] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-15T19:08:51.863985] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-15T19:08:52.212388] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:52.457838] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-15T19:08:52.499195] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:08:53.257937] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-15T19:08:53.558712] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:08:54.057894] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-15T19:08:54.143594] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T19:08:54.859391] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-15T19:08:54.865731] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:08:54.950767] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:08:55.657911] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-15T19:08:56.469944] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-15T19:08:56.504329] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:08:57.257943] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-15T19:08:57.304628] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:08:58.057904] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-15T19:08:58.148238] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T19:08:58.270926] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:08:58.857924] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-15T19:08:59.657919] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-15T19:08:59.738105] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T19:09:00.457888] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-15T19:09:00.542107] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T19:09:01.175930] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:09:01.257824] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-15T19:09:02.057918] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-15T19:09:02.857939] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-15T19:09:03.314550] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T19:09:03.424627] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-15T19:09:03.657828] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-15T19:09:04.457899] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-15T19:09:05.455346] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T19:09:05.467113] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-15T19:09:05.642616] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (3.58 seconds). [2025-09-15T19:09:06.034739] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T19:09:06.057830] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-15T19:09:06.270396] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-09-15T19:09:06.857901] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-15T19:09:07.012309] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T19:09:07.019236] [INFO ] [REMOTE ] KR: Full fetch complete (58358 records). [2025-09-15T19:09:07.019412] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-15T19:09:07.438713] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-15T19:09:07.441535] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-15T19:09:07.442825] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-15T19:09:07.441406] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:09:07.443097] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-15T19:09:07.453769] [DEBUG] [LOCAL ] KR: Trimmed 58358 records to 39643 (keeping 150 days of data) [2025-09-15T19:09:07.659332] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-15T19:09:07.722653] [DEBUG] [LOCAL ] KR: Primary data saved (39643 records). [2025-09-15T19:09:07.722825] [INFO ] [MAIN ] KR: Full history saved. [2025-09-15T19:09:07.722919] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KR took 21.6s. Estimated remaining: 2h 2m 11s. Rate: 9.4 symbols/min [2025-09-15T19:09:07.893140] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:07.929494] [DEBUG] [LOCAL ] KRG: Loaded 36852 existing records from primary storage. [2025-09-15T19:09:07.929667] [INFO ] [MAIN ] KRG: Loaded 36852 existing records. [2025-09-15T19:09:08.104100] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:08.104390] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-15T19:09:08.104439] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-15T19:09:08.105308] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-15T19:09:08.105360] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-15T19:09:08.459845] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-15T19:09:08.459725] [INFO ] [REMOTE ] KRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:08.491412] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T19:09:09.257895] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-15T19:09:09.476456] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T19:09:09.507063] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:09:10.057882] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-15T19:09:10.383448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T19:09:10.857927] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-15T19:09:11.621873] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T19:09:11.657955] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-15T19:09:12.117684] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:09:12.457958] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-15T19:09:13.257837] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-15T19:09:13.644046] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T19:09:13.650616] [INFO ] [REMOTE ] KOS: Full fetch complete (57713 records). [2025-09-15T19:09:13.650830] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-15T19:09:14.047032] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-15T19:09:14.047118] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-15T19:09:14.047973] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-15T19:09:14.048021] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-15T19:09:14.049256] [DEBUG] [LOCAL ] KOS: Trimmed 57713 records to 39184 (keeping 150 days of data) [2025-09-15T19:09:14.099604] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-15T19:09:14.287195] [DEBUG] [LOCAL ] KOS: Primary data saved (39184 records). [2025-09-15T19:09:14.287363] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-15T19:09:14.288302] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KOS took 33.7s. Estimated remaining: 2h 2m 5s. Rate: 9.4 symbols/min [2025-09-15T19:09:14.464822] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:14.465064] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-15T19:09:14.465106] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-15T19:09:14.465236] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-15T19:09:14.465276] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-15T19:09:14.465348] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-15T19:09:14.465400] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-15T19:09:14.828064] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:14.857827] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-15T19:09:15.040514] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-15T19:09:15.103589] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T19:09:15.107787] [INFO ] [REMOTE ] KREF: Full fetch complete (39298 records). [2025-09-15T19:09:15.107907] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-15T19:09:15.489963] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-15T19:09:15.490047] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-15T19:09:15.490858] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-15T19:09:15.490909] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-15T19:09:15.491928] [DEBUG] [LOCAL ] KREF: Trimmed 39298 records to 27019 (keeping 150 days of data) [2025-09-15T19:09:15.623040] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:09:15.659709] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-15T19:09:15.684345] [DEBUG] [LOCAL ] KREF: Primary data saved (27019 records). [2025-09-15T19:09:15.684501] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-15T19:09:15.684605] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KREF took 24.2s. Estimated remaining: 2h 1m 54s. Rate: 9.4 symbols/min [2025-09-15T19:09:15.863624] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:15.883034] [DEBUG] [LOCAL ] KRO: Loaded 19761 existing records from primary storage. [2025-09-15T19:09:15.883174] [INFO ] [MAIN ] KRO: Loaded 19761 existing records. [2025-09-15T19:09:16.057674] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:16.057976] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-15T19:09:16.058154] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-15T19:09:16.058944] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-15T19:09:16.059002] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-15T19:09:16.385630] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-15T19:09:16.454668] [INFO ] [REMOTE ] KRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:16.457815] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-15T19:09:17.152287] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:09:17.257889] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-15T19:09:17.380411] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T19:09:18.057897] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-15T19:09:18.629419] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:09:18.857926] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-15T19:09:19.657914] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-15T19:09:19.710789] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:09:19.823465] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T19:09:20.457889] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-15T19:09:21.236369] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:09:21.257826] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-15T19:09:21.648743] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:09:22.057877] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-15T19:09:22.719635] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:09:22.857877] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-15T19:09:23.201975] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:09:23.657868] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-15T19:09:24.352555] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:09:24.457911] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-15T19:09:25.129281] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:09:25.257863] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-15T19:09:26.057869] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-15T19:09:26.138590] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:09:26.785842] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:09:26.857885] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-15T19:09:27.178509] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T19:09:27.657892] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-15T19:09:28.206311] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T19:09:28.429321] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T19:09:28.457878] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-15T19:09:29.257925] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-15T19:09:29.635596] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:09:30.057943] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-15T19:09:30.748727] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T19:09:30.754318] [INFO ] [REMOTE ] KRMN: Full fetch complete (47392 records). [2025-09-15T19:09:30.754466] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-15T19:09:30.864016] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-15T19:09:30.959428] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T19:09:30.960068] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:09:30.960130] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:09:30.960192] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-15T19:09:30.960281] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-15T19:09:30.960330] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-15T19:09:30.960394] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-15T19:09:30.960479] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRMN took 16.7s. Estimated remaining: 2h 1m 56s. Rate: 9.4 symbols/min [2025-09-15T19:09:31.139384] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:31.169908] [DEBUG] [LOCAL ] KRP: Loaded 27131 existing records from primary storage. [2025-09-15T19:09:31.170109] [INFO ] [MAIN ] KRP: Loaded 27131 existing records. [2025-09-15T19:09:31.352814] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:31.353103] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-15T19:09:31.353165] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-15T19:09:31.353980] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-15T19:09:31.354032] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-15T19:09:31.657507] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:09:31.662708] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-15T19:09:31.711359] [INFO ] [REMOTE ] KRC: Full fetch complete (52806 records). [2025-09-15T19:09:31.730590] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-15T19:09:31.734146] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:32.132380] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T19:09:32.130877] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-15T19:09:32.138692] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-15T19:09:32.140070] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-15T19:09:32.140161] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-15T19:09:32.141742] [DEBUG] [LOCAL ] KRC: Trimmed 52806 records to 35359 (keeping 150 days of data) [2025-09-15T19:09:32.371579] [DEBUG] [LOCAL ] KRC: Primary data saved (35359 records). [2025-09-15T19:09:32.371915] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-15T19:09:32.372066] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRC took 43.7s. Estimated remaining: 2h 1m 45s. Rate: 9.4 symbols/min [2025-09-15T19:09:32.464313] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-15T19:09:32.548258] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:32.591125] [DEBUG] [LOCAL ] KSS: Loaded 40357 existing records from primary storage. [2025-09-15T19:09:32.591296] [INFO ] [MAIN ] KSS: Loaded 40357 existing records. [2025-09-15T19:09:32.805124] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:32.805561] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-15T19:09:32.805620] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-15T19:09:32.807097] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-15T19:09:32.807179] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-15T19:09:33.204611] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:33.220593] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T19:09:33.226454] [INFO ] [REMOTE ] KRG: Full fetch complete (53439 records). [2025-09-15T19:09:33.226665] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-15T19:09:33.262961] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-15T19:09:33.587177] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:09:33.638911] [INFO ] [REMOTE ] KRO: Full fetch complete (27003 records). [2025-09-15T19:09:33.641758] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-15T19:09:33.642125] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-15T19:09:33.642293] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-15T19:09:33.643226] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-15T19:09:33.676292] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-15T19:09:33.772565] [DEBUG] [LOCAL ] KRG: Trimmed 53439 records to 36082 (keeping 150 days of data) [2025-09-15T19:09:34.081805] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-15T19:09:34.177857] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-15T19:09:34.179816] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-15T19:09:34.182290] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-15T19:09:34.184505] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-15T19:09:34.228835] [DEBUG] [LOCAL ] KRO: Trimmed 27003 records to 19369 (keeping 150 days of data) [2025-09-15T19:09:34.385627] [DEBUG] [LOCAL ] KRO: Primary data saved (19369 records). [2025-09-15T19:09:34.386595] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-15T19:09:34.386993] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 18.7s. Estimated remaining: 2h 1m 34s. Rate: 9.4 symbols/min [2025-09-15T19:09:34.563830] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:34.570509] [DEBUG] [LOCAL ] KRG: Primary data saved (36082 records). [2025-09-15T19:09:34.570629] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-15T19:09:34.570743] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KRG took 26.8s. Estimated remaining: 2h 1m 22s. Rate: 9.4 symbols/min [2025-09-15T19:09:34.750801] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:34.764155] [DEBUG] [LOCAL ] KT: Loaded 33903 existing records from primary storage. [2025-09-15T19:09:34.764338] [INFO ] [MAIN ] KT: Loaded 33903 existing records. [2025-09-15T19:09:34.967276] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:34.963296] [DEBUG] [LOCAL ] KTB: Loaded 30714 existing records from primary storage. [2025-09-15T19:09:34.967819] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-15T19:09:34.968079] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-15T19:09:34.968166] [INFO ] [MAIN ] KTB: Loaded 30714 existing records. [2025-09-15T19:09:34.989018] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-15T19:09:34.989219] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-15T19:09:35.263031] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:35.290034] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-15T19:09:35.316790] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-15T19:09:35.327267] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-15T19:09:35.338256] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-15T19:09:35.586279] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-15T19:09:35.717957] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-15T19:09:35.746268] [INFO ] [REMOTE ] KT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:35.790716] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-15T19:09:35.948166] [INFO ] [REMOTE ] KTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:35.950102] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T19:09:36.457863] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-15T19:09:37.110385] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:09:37.257888] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-15T19:09:37.616433] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T19:09:38.041905] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:09:38.057841] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-15T19:09:38.734960] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T19:09:38.857875] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-15T19:09:39.246718] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T19:09:39.657932] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-15T19:09:40.457893] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-15T19:09:40.511800] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:09:40.845595] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:09:41.257889] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-15T19:09:42.057977] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-15T19:09:42.352400] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:09:42.444555] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T19:09:42.857914] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-15T19:09:43.465582] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:09:43.657923] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-15T19:09:44.076189] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:09:44.457917] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-15T19:09:44.663551] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:09:45.257903] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-15T19:09:46.057845] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-15T19:09:46.175923] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T19:09:46.558948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T19:09:46.857873] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-15T19:09:47.167254] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:09:47.657949] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-15T19:09:48.169710] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:09:48.173576] [INFO ] [REMOTE ] KRP: Full fetch complete (41642 records). [2025-09-15T19:09:48.173700] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-15T19:09:48.461932] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-15T19:09:48.549565] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-15T19:09:48.549679] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-15T19:09:48.550476] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-15T19:09:48.550519] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-15T19:09:48.551534] [DEBUG] [LOCAL ] KRP: Trimmed 41642 records to 26642 (keeping 150 days of data) [2025-09-15T19:09:48.725089] [DEBUG] [LOCAL ] KRP: Primary data saved (26642 records). [2025-09-15T19:09:48.725262] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-15T19:09:48.725385] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KRP took 17.8s. Estimated remaining: 2h 1m 23s. Rate: 9.4 symbols/min [2025-09-15T19:09:48.899591] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:48.909321] [DEBUG] [LOCAL ] KTF: Loaded 8981 existing records from primary storage. [2025-09-15T19:09:48.909422] [INFO ] [MAIN ] KTF: Loaded 8981 existing records. [2025-09-15T19:09:49.091907] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:49.092154] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-15T19:09:49.092204] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-15T19:09:49.092596] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-15T19:09:49.092674] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-15T19:09:49.261153] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-15T19:09:49.462481] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:49.528412] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T19:09:49.562559] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:09:50.057882] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-15T19:09:50.857963] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-15T19:09:51.160482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:09:51.662993] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-15T19:09:51.680769] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T19:09:52.268183] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:09:52.457910] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-15T19:09:52.635410] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:09:53.257925] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-15T19:09:53.590488] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:09:53.994392] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:09:54.057890] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-15T19:09:54.857919] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-15T19:09:55.480948] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T19:09:55.485350] [INFO ] [REMOTE ] KTB: Full fetch complete (45339 records). [2025-09-15T19:09:55.485448] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-15T19:09:55.660927] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-15T19:09:55.667739] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:09:55.907220] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-15T19:09:55.907341] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-15T19:09:55.908532] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-15T19:09:55.908697] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-15T19:09:55.910286] [DEBUG] [LOCAL ] KTB: Trimmed 45339 records to 30183 (keeping 150 days of data) [2025-09-15T19:09:56.111130] [DEBUG] [LOCAL ] KTB: Primary data saved (30183 records). [2025-09-15T19:09:56.111330] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-15T19:09:56.111511] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTB took 21.5s. Estimated remaining: 2h 1m 17s. Rate: 9.4 symbols/min [2025-09-15T19:09:56.287361] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:56.287690] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-15T19:09:56.287732] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-15T19:09:56.287877] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-15T19:09:56.287917] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-15T19:09:56.287957] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-15T19:09:56.287991] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-15T19:09:56.463076] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-15T19:09:56.652980] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:57.257905] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-15T19:09:57.691613] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T19:09:57.723256] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:09:58.057961] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-15T19:09:58.148175] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:09:58.857927] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-15T19:09:59.540222] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T19:09:59.640932] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:09:59.647423] [INFO ] [REMOTE ] KSS: Full fetch complete (58287 records). [2025-09-15T19:09:59.647678] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-15T19:09:59.662964] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-15T19:10:00.050887] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-15T19:10:00.050992] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-15T19:10:00.052156] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-15T19:10:00.052206] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-15T19:10:00.053836] [DEBUG] [LOCAL ] KSS: Trimmed 58287 records to 39575 (keeping 150 days of data) [2025-09-15T19:10:00.328710] [DEBUG] [LOCAL ] KSS: Primary data saved (39575 records). [2025-09-15T19:10:00.328895] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-15T19:10:00.329521] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KSS took 28.0s. Estimated remaining: 2h 1m 9s. Rate: 9.4 symbols/min [2025-09-15T19:10:00.462782] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-15T19:10:00.521808] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:10:00.527294] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:00.569480] [DEBUG] [LOCAL ] KVUE: Loaded 40407 existing records from primary storage. [2025-09-15T19:10:00.569663] [INFO ] [MAIN ] KVUE: Loaded 40407 existing records. [2025-09-15T19:10:00.744933] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:00.745234] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-15T19:10:00.745284] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-15T19:10:00.746434] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-15T19:10:00.746493] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-15T19:10:01.095894] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:01.257844] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-15T19:10:01.596364] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:10:02.057877] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-15T19:10:02.835597] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:10:02.857922] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-15T19:10:03.432072] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T19:10:03.657952] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-15T19:10:03.810952] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:10:04.458022] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-15T19:10:05.075565] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T19:10:05.257990] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-15T19:10:05.268855] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T19:10:05.271165] [INFO ] [REMOTE ] KTF: Full fetch complete (14226 records). [2025-09-15T19:10:05.271519] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-15T19:10:05.662732] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-15T19:10:05.662851] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-15T19:10:05.663311] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-15T19:10:05.663360] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-15T19:10:05.664410] [DEBUG] [LOCAL ] KTF: Trimmed 14226 records to 8631 (keeping 150 days of data) [2025-09-15T19:10:05.726115] [DEBUG] [LOCAL ] KTF: Primary data saved (8631 records). [2025-09-15T19:10:05.726343] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-15T19:10:05.726551] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KTF took 17.0s. Estimated remaining: 2h 1m 2s. Rate: 9.4 symbols/min [2025-09-15T19:10:05.845531] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:10:05.932790] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:05.973145] [DEBUG] [LOCAL ] KVYO: Loaded 37922 existing records from primary storage. [2025-09-15T19:10:05.973559] [INFO ] [MAIN ] KVYO: Loaded 37922 existing records. [2025-09-15T19:10:06.063118] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-15T19:10:06.158966] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:06.159272] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-15T19:10:06.159320] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-15T19:10:06.160260] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-15T19:10:06.160321] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-15T19:10:06.526924] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:06.857905] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-15T19:10:07.507710] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T19:10:07.657923] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-15T19:10:08.456558] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:10:08.465166] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-15T19:10:08.893284] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:10:09.257883] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-15T19:10:10.057888] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-15T19:10:10.272006] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:10:10.408376] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T19:10:10.857893] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-15T19:10:11.657875] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-15T19:10:11.755982] [DEBUG] [REMOTE ] KUKE: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-15T19:10:11.756338] [WARN ] [REMOTE ] KUKE: No data returned for month 2025-05 [2025-09-15T19:10:11.788598] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T19:10:12.081821] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:10:12.087287] [INFO ] [REMOTE ] KT: Full fetch complete (50030 records). [2025-09-15T19:10:12.087391] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-15T19:10:12.466973] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-15T19:10:12.469675] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-15T19:10:12.470004] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-15T19:10:12.471529] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-15T19:10:12.471609] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-15T19:10:12.473159] [DEBUG] [LOCAL ] KT: Trimmed 50030 records to 33182 (keeping 150 days of data) [2025-09-15T19:10:12.693115] [DEBUG] [LOCAL ] KT: Primary data saved (33182 records). [2025-09-15T19:10:12.693293] [INFO ] [MAIN ] KT: Full history saved. [2025-09-15T19:10:12.693444] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KT took 38.3s. Estimated remaining: 2h 0m 56s. Rate: 9.4 symbols/min [2025-09-15T19:10:12.862019] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:12.894710] [DEBUG] [LOCAL ] KW: Loaded 30508 existing records from primary storage. [2025-09-15T19:10:12.894880] [INFO ] [MAIN ] KW: Loaded 30508 existing records. [2025-09-15T19:10:13.069189] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:13.069457] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-15T19:10:13.069510] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-15T19:10:13.070188] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-15T19:10:13.070244] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-15T19:10:13.263157] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-15T19:10:13.457552] [INFO ] [REMOTE ] KW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:13.668074] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-15T19:10:14.057903] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-15T19:10:14.364693] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T19:10:14.857951] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-15T19:10:15.414726] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:10:15.657876] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-15T19:10:16.457955] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-15T19:10:16.644885] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T19:10:16.848388] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:10:17.257878] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-15T19:10:17.831703] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:10:18.057917] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-15T19:10:18.712743] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:10:18.857943] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-15T19:10:19.419004] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T19:10:19.657873] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-15T19:10:20.457904] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-15T19:10:20.559564] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T19:10:20.939668] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:10:20.971835] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T19:10:21.257873] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-15T19:10:22.057885] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-15T19:10:22.857890] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-15T19:10:22.996147] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T19:10:23.002099] [INFO ] [REMOTE ] KVUE: Full fetch complete (58347 records). [2025-09-15T19:10:23.002221] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-15T19:10:23.408477] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-15T19:10:23.408669] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-15T19:10:23.410187] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-15T19:10:23.410251] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-15T19:10:23.414432] [DEBUG] [LOCAL ] KVUE: Trimmed 58347 records to 39627 (keeping 150 days of data) [2025-09-15T19:10:23.659291] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-15T19:10:23.717703] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:10:23.768367] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T19:10:23.785000] [DEBUG] [LOCAL ] KVUE: Primary data saved (39627 records). [2025-09-15T19:10:23.785181] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-15T19:10:23.785964] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KVUE took 23.5s. Estimated remaining: 2h 0m 54s. Rate: 9.4 symbols/min [2025-09-15T19:10:23.958096] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:23.974609] [DEBUG] [LOCAL ] KWR: Loaded 12557 existing records from primary storage. [2025-09-15T19:10:23.974774] [INFO ] [MAIN ] KWR: Loaded 12557 existing records. [2025-09-15T19:10:24.098775] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:10:24.168321] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:24.168636] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-15T19:10:24.168711] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-15T19:10:24.169169] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-15T19:10:24.169217] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-15T19:10:24.463049] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-15T19:10:24.552173] [INFO ] [REMOTE ] KWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:25.257870] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-15T19:10:26.057873] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-15T19:10:26.090212] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:10:26.205676] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:10:26.758957] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:10:26.760138] [INFO ] [REMOTE ] KUKE: Full fetch complete (4577 records). [2025-09-15T19:10:26.760207] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-15T19:10:26.862984] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-15T19:10:26.950841] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-15T19:10:26.951165] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:10:26.951248] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:10:26.951331] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-15T19:10:26.951431] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-15T19:10:26.951503] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-15T19:10:26.951573] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-15T19:10:26.951689] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KUKE took 30.8s. Estimated remaining: 2h 0m 45s. Rate: 9.4 symbols/min [2025-09-15T19:10:27.120791] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:27.147495] [DEBUG] [LOCAL ] KYN: Loaded 22403 existing records from primary storage. [2025-09-15T19:10:27.147702] [INFO ] [MAIN ] KYN: Loaded 22403 existing records. [2025-09-15T19:10:27.323877] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:27.324236] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-15T19:10:27.324305] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-15T19:10:27.324961] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-15T19:10:27.325016] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-15T19:10:27.665182] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-15T19:10:27.687217] [INFO ] [REMOTE ] KYN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:28.306335] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:10:28.356182] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:10:28.457862] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-15T19:10:29.257907] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-15T19:10:29.514467] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T19:10:30.057883] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-15T19:10:30.294147] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:10:30.299099] [INFO ] [REMOTE ] KW: Full fetch complete (43695 records). [2025-09-15T19:10:30.299194] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-15T19:10:30.674462] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-15T19:10:30.674574] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-15T19:10:30.675340] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-15T19:10:30.675423] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-15T19:10:30.676806] [DEBUG] [LOCAL ] KW: Trimmed 43695 records to 29877 (keeping 150 days of data) [2025-09-15T19:10:30.786224] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T19:10:30.857918] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-15T19:10:30.890771] [DEBUG] [LOCAL ] KW: Primary data saved (29877 records). [2025-09-15T19:10:30.890912] [INFO ] [MAIN ] KW: Full history saved. [2025-09-15T19:10:30.891024] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KW took 18.2s. Estimated remaining: 2h 0m 36s. Rate: 9.4 symbols/min [2025-09-15T19:10:31.063117] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:31.097675] [DEBUG] [LOCAL ] L: Loaded 30602 existing records from primary storage. [2025-09-15T19:10:31.097878] [INFO ] [MAIN ] L: Loaded 30602 existing records. [2025-09-15T19:10:31.277093] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:31.277379] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-15T19:10:31.277426] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-15T19:10:31.278181] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-15T19:10:31.278232] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-15T19:10:31.640443] [INFO ] [REMOTE ] L: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:31.657826] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-15T19:10:32.457851] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-15T19:10:32.498169] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T19:10:32.898761] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:10:33.257828] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-15T19:10:33.722606] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:10:34.057875] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-15T19:10:34.519275] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:10:34.832062] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:10:34.857819] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-15T19:10:35.524476] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:10:35.657897] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-15T19:10:36.457880] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-15T19:10:37.084833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T19:10:37.257890] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-15T19:10:37.441923] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:10:38.057908] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-15T19:10:38.777380] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T19:10:38.857854] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-15T19:10:39.657877] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-15T19:10:39.746718] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:10:40.372506] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:10:40.457890] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-15T19:10:40.482105] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:10:41.257893] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-15T19:10:42.057937] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-15T19:10:42.147464] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T19:10:42.153275] [INFO ] [REMOTE ] KVYO: Full fetch complete (54067 records). [2025-09-15T19:10:42.153404] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-15T19:10:42.540435] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-15T19:10:42.540575] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-15T19:10:42.541461] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-15T19:10:42.541520] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-15T19:10:42.543342] [DEBUG] [LOCAL ] KVYO: Trimmed 54067 records to 37223 (keeping 150 days of data) [2025-09-15T19:10:42.672994] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:10:42.698125] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T19:10:42.828631] [DEBUG] [LOCAL ] KVYO: Primary data saved (37223 records). [2025-09-15T19:10:42.828804] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-15T19:10:42.828919] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. KVYO took 37.1s. Estimated remaining: 2h 0m 35s. Rate: 9.4 symbols/min [2025-09-15T19:10:42.863000] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-15T19:10:43.040990] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:43.083224] [DEBUG] [LOCAL ] LAC: Loaded 39364 existing records from primary storage. [2025-09-15T19:10:43.083450] [INFO ] [MAIN ] LAC: Loaded 39364 existing records. [2025-09-15T19:10:43.263531] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:43.263881] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-15T19:10:43.263942] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-15T19:10:43.264878] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-15T19:10:43.264961] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-15T19:10:43.650859] [INFO ] [REMOTE ] LAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:43.657824] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-15T19:10:43.904217] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:10:44.457890] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-15T19:10:45.082192] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:10:45.084231] [INFO ] [REMOTE ] KWR: Full fetch complete (18438 records). [2025-09-15T19:10:45.084320] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-15T19:10:45.258274] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-15T19:10:45.453913] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-15T19:10:45.454057] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-15T19:10:45.454532] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-15T19:10:45.454595] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-15T19:10:45.455680] [DEBUG] [LOCAL ] KWR: Trimmed 18438 records to 12280 (keeping 150 days of data) [2025-09-15T19:10:45.547372] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T19:10:45.576250] [DEBUG] [LOCAL ] KWR: Primary data saved (12280 records). [2025-09-15T19:10:45.576412] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-15T19:10:45.576537] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KWR took 21.8s. Estimated remaining: 2h 0m 25s. Rate: 9.4 symbols/min [2025-09-15T19:10:45.750559] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:45.768036] [DEBUG] [LOCAL ] LAD: Loaded 17159 existing records from primary storage. [2025-09-15T19:10:45.768203] [INFO ] [MAIN ] LAD: Loaded 17159 existing records. [2025-09-15T19:10:45.951622] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:45.951910] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-15T19:10:45.951958] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-15T19:10:45.952582] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-15T19:10:45.952638] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-15T19:10:46.063008] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-15T19:10:46.325087] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:46.652956] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:10:46.857901] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-15T19:10:47.657930] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-15T19:10:47.971746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T19:10:48.014543] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:10:48.454854] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:10:48.459877] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-15T19:10:49.257918] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-15T19:10:49.782739] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:10:50.057891] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-15T19:10:50.680799] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:10:50.857863] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-15T19:10:50.907130] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:10:51.657960] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-15T19:10:52.457912] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-15T19:10:52.562811] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:10:52.612488] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:10:53.257950] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-15T19:10:53.681314] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:10:53.685368] [INFO ] [REMOTE ] KYN: Full fetch complete (33110 records). [2025-09-15T19:10:53.685486] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-15T19:10:54.061217] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-15T19:10:54.083289] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-15T19:10:54.083404] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-15T19:10:54.084773] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-15T19:10:54.084845] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-15T19:10:54.086003] [DEBUG] [LOCAL ] KYN: Trimmed 33110 records to 21836 (keeping 150 days of data) [2025-09-15T19:10:54.250663] [DEBUG] [LOCAL ] KYN: Primary data saved (21836 records). [2025-09-15T19:10:54.250849] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-15T19:10:54.251027] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. KYN took 27.3s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-15T19:10:54.456046] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:54.492936] [DEBUG] [LOCAL ] LADR: Loaded 28952 existing records from primary storage. [2025-09-15T19:10:54.493133] [INFO ] [MAIN ] LADR: Loaded 28952 existing records. [2025-09-15T19:10:54.671289] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:54.671544] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-15T19:10:54.671595] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-15T19:10:54.672286] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-15T19:10:54.672339] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-15T19:10:54.863271] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-15T19:10:55.044762] [INFO ] [REMOTE ] LADR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:55.119457] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T19:10:55.415717] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:10:55.420319] [INFO ] [REMOTE ] L: Full fetch complete (44511 records). [2025-09-15T19:10:55.420422] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-15T19:10:55.664619] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-15T19:10:55.800362] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-15T19:10:55.800467] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-15T19:10:55.801255] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-15T19:10:55.801302] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-15T19:10:55.802413] [DEBUG] [LOCAL ] L: Trimmed 44511 records to 30026 (keeping 150 days of data) [2025-09-15T19:10:55.999590] [DEBUG] [LOCAL ] L: Primary data saved (30026 records). [2025-09-15T19:10:55.999798] [INFO ] [MAIN ] L: Full history saved. [2025-09-15T19:10:55.999896] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. L took 25.1s. Estimated remaining: 2h 0m 10s. Rate: 9.4 symbols/min [2025-09-15T19:10:56.131491] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:10:56.203370] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:56.206886] [DEBUG] [LOCAL ] LANV: Loaded 1944 existing records from primary storage. [2025-09-15T19:10:56.206968] [INFO ] [MAIN ] LANV: Loaded 1944 existing records. [2025-09-15T19:10:56.391170] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:56.391455] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-15T19:10:56.391506] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-15T19:10:56.391746] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-15T19:10:56.391796] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-15T19:10:56.463048] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-15T19:10:56.820087] [INFO ] [REMOTE ] LANV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:56.880752] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:10:57.257964] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-15T19:10:57.609326] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:10:57.738175] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:10:58.057921] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-15T19:10:58.857884] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-15T19:10:59.325968] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:10:59.367615] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:10:59.657867] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-15T19:11:00.089018] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T19:11:00.457891] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-15T19:11:01.257881] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-15T19:11:01.607137] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T19:11:01.717684] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:11:02.057907] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-15T19:11:02.521544] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:11:02.857920] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-15T19:11:03.657892] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-15T19:11:04.457957] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-15T19:11:05.257949] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-15T19:11:05.685068] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-15T19:11:05.728059] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T19:11:06.057886] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-15T19:11:06.480103] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:11:06.586992] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:11:06.857878] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-15T19:11:06.968813] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-15T19:11:07.657838] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-15T19:11:07.769844] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:11:08.458023] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-15T19:11:08.651517] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:11:09.257905] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-15T19:11:10.057879] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-15T19:11:10.251222] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:11:10.253991] [INFO ] [REMOTE ] LAD: Full fetch complete (26563 records). [2025-09-15T19:11:10.254073] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-15T19:11:10.614556] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T19:11:10.618713] [INFO ] [REMOTE ] LANV: Full fetch complete (2812 records). [2025-09-15T19:11:10.625442] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-15T19:11:10.625556] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-15T19:11:10.625675] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-15T19:11:10.637290] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-15T19:11:10.661763] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-15T19:11:10.726902] [DEBUG] [LOCAL ] LAD: Trimmed 26563 records to 16862 (keeping 150 days of data) [2025-09-15T19:11:10.879407] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-15T19:11:11.116799] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-15T19:11:11.121754] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-15T19:11:11.122835] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-15T19:11:11.123864] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-15T19:11:11.129685] [DEBUG] [LOCAL ] LANV: Trimmed 2812 records to 1908 (keeping 150 days of data) [2025-09-15T19:11:11.129571] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-15T19:11:11.156147] [DEBUG] [LOCAL ] LANV: Primary data saved (1908 records). [2025-09-15T19:11:11.157850] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-15T19:11:11.157957] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LANV took 15.2s. Estimated remaining: 2h 0m 12s. Rate: 9.4 symbols/min [2025-09-15T19:11:11.264531] [DEBUG] [LOCAL ] LAD: Primary data saved (16862 records). [2025-09-15T19:11:11.264697] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-15T19:11:11.265019] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LAD took 25.7s. Estimated remaining: 2h 0m 0s. Rate: 9.4 symbols/min [2025-09-15T19:11:11.333879] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:11.365002] [DEBUG] [LOCAL ] LAR: Loaded 33941 existing records from primary storage. [2025-09-15T19:11:11.365165] [INFO ] [MAIN ] LAR: Loaded 33941 existing records. [2025-09-15T19:11:11.539477] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:11.539712] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-15T19:11:11.539759] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-15T19:11:11.540602] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-15T19:11:11.540677] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-15T19:11:11.663009] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-15T19:11:11.896377] [INFO ] [REMOTE ] LAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:12.072358] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:11:12.457850] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-15T19:11:13.257895] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-15T19:11:13.844232] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T19:11:13.901859] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:11:14.057868] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-15T19:11:14.857926] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-15T19:11:14.943463] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:11:15.662933] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-15T19:11:15.679476] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:11:16.457831] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-15T19:11:16.616832] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:11:16.623088] [INFO ] [REMOTE ] LAC: Full fetch complete (56828 records). [2025-09-15T19:11:16.623200] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-15T19:11:17.013225] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-15T19:11:17.013366] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-15T19:11:17.014558] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-15T19:11:17.014746] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-15T19:11:17.016535] [DEBUG] [LOCAL ] LAC: Trimmed 56828 records to 38655 (keeping 150 days of data) [2025-09-15T19:11:17.040945] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T19:11:17.259502] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-15T19:11:17.288447] [DEBUG] [LOCAL ] LAC: Primary data saved (38655 records). [2025-09-15T19:11:17.288624] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-15T19:11:17.288739] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAC took 34.5s. Estimated remaining: 1h 59m 53s. Rate: 9.4 symbols/min [2025-09-15T19:11:18.857379] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-15T19:11:18.866914] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-15T19:11:19.099250] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:11:19.106109] [INFO ] [REMOTE ] LADR: Full fetch complete (41408 records). [2025-09-15T19:11:19.106252] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-15T19:11:19.487246] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-15T19:11:19.487333] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-15T19:11:19.488072] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-15T19:11:19.488119] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-15T19:11:19.489205] [DEBUG] [LOCAL ] LADR: Trimmed 41408 records to 28214 (keeping 150 days of data) [2025-09-15T19:11:19.669096] [DEBUG] [LOCAL ] LADR: Primary data saved (28214 records). [2025-09-15T19:11:19.669246] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-15T19:11:19.669334] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LADR took 25.4s. Estimated remaining: 1h 59m 43s. Rate: 9.4 symbols/min [2025-09-15T19:11:20.150731] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:11:20.160252] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-15T19:11:21.491687] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:11:21.500865] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-15T19:11:23.261272] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:11:23.272043] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-15T19:11:25.052813] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:11:25.062891] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-15T19:11:26.428721] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:11:26.436419] [INFO ] [REMOTE ] LAR: Full fetch complete (48888 records). [2025-09-15T19:11:26.436589] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-15T19:11:26.852731] [DEBUG] [VALIDATOR ] LAR: All expected trading days are present. [2025-09-15T19:11:26.852852] [DEBUG] [VALIDATOR ] LAR: Primary data validation passed. [2025-09-15T19:11:26.853768] [INFO ] [MAIN ] LAR: Fetched primary data is valid. [2025-09-15T19:11:26.853822] [DEBUG] [LOCAL ] LAR: Saving primary data. [2025-09-15T19:11:26.855267] [DEBUG] [LOCAL ] LAR: Trimmed 48888 records to 33317 (keeping 150 days of data) [2025-09-15T19:11:27.054366] [DEBUG] [LOCAL ] LAR: Primary data saved (33317 records). [2025-09-15T19:11:27.054531] [INFO ] [MAIN ] LAR: Full history saved. [2025-09-15T19:11:27.054679] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAR took 15.9s. Estimated remaining: 1h 59m 38s. Rate: 9.4 symbols/min [2025-09-15T19:11:27.752826] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.743259] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.797204] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.855668] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.880801] [DEBUG] [LOCAL ] LAW: Loaded 10652 existing records from primary storage. [2025-09-15T19:11:27.881052] [INFO ] [MAIN ] LAW: Loaded 10652 existing records. [2025-09-15T19:11:28.087826] [DEBUG] [LOCAL ] LBRT: Loaded 39791 existing records from primary storage. [2025-09-15T19:11:28.086701] [DEBUG] [LOCAL ] LB: Loaded 27942 existing records from primary storage. [2025-09-15T19:11:28.117880] [INFO ] [MAIN ] LBRT: Loaded 39791 existing records. [2025-09-15T19:11:28.138786] [INFO ] [MAIN ] LB: Loaded 27942 existing records. [2025-09-15T19:11:28.139449] [DEBUG] [LOCAL ] LAZ: Loaded 33715 existing records from primary storage. [2025-09-15T19:11:28.144798] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.216579] [INFO ] [MAIN ] LAZ: Loaded 33715 existing records. [2025-09-15T19:11:28.315268] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.360616] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-15T19:11:28.465627] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-15T19:11:28.516609] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-15T19:11:28.593966] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.704484] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.742807] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.742938] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-15T19:11:28.799094] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.799178] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-15T19:11:28.812207] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.812326] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-15T19:11:28.812688] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.812452] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-15T19:11:28.863560] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-15T19:11:28.868806] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-15T19:11:28.818204] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-15T19:11:28.920427] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-15T19:11:28.999281] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-15T19:11:29.624520] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:29.675889] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-15T19:11:30.061405] [INFO ] [REMOTE ] LB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.096873] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-15T19:11:30.110507] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.144433] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-15T19:11:30.166567] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.166859] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-15T19:11:30.693092] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T19:11:30.696768] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-15T19:11:31.353432] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:11:31.356498] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-15T19:11:31.701609] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:11:31.711875] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-15T19:11:31.755170] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:11:31.763766] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-15T19:11:31.824348] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T19:11:31.832190] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-15T19:11:31.885090] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T19:11:31.888329] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-15T19:11:32.467799] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:11:32.471345] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-15T19:11:33.112811] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:11:33.123308] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-15T19:11:33.333148] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:11:33.344803] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-15T19:11:33.355084] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:11:33.358987] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-15T19:11:33.484793] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:11:33.493579] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-15T19:11:34.202130] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:11:34.206297] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-15T19:11:34.573510] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:11:34.674808] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:11:34.772421] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T19:11:34.857828] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-15T19:11:35.006588] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T19:11:35.657934] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-15T19:11:36.462971] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-15T19:11:36.480611] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:11:37.195241] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T19:11:37.211752] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:11:37.213953] [INFO ] [REMOTE ] LAW: Full fetch complete (15453 records). [2025-09-15T19:11:37.214030] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-15T19:11:37.263121] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-15T19:11:37.610428] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-15T19:11:37.610519] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-15T19:11:37.610928] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-15T19:11:37.610975] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-15T19:11:37.611535] [DEBUG] [LOCAL ] LAW: Trimmed 15453 records to 10545 (keeping 150 days of data) [2025-09-15T19:11:37.671386] [DEBUG] [LOCAL ] LAW: Primary data saved (10545 records). [2025-09-15T19:11:37.671525] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-15T19:11:37.671620] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LAW took 10.6s. Estimated remaining: 1h 59m 36s. Rate: 9.4 symbols/min [2025-09-15T19:11:37.851525] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:37.892915] [DEBUG] [LOCAL ] LC: Loaded 35913 existing records from primary storage. [2025-09-15T19:11:37.893097] [INFO ] [MAIN ] LC: Loaded 35913 existing records. [2025-09-15T19:11:38.076102] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-15T19:11:38.082402] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:38.082677] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-15T19:11:38.082727] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-15T19:11:38.083534] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-15T19:11:38.083587] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-15T19:11:38.455510] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:38.784344] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:11:38.857827] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-15T19:11:39.663002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-15T19:11:39.673366] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T19:11:40.224534] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T19:11:40.457912] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-15T19:11:40.881785] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:11:41.257872] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-15T19:11:42.057939] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-15T19:11:42.241627] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:11:42.384880] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:11:42.857865] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-15T19:11:43.239220] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:11:43.657949] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-15T19:11:44.381926] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:11:44.457878] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-15T19:11:45.176165] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:11:45.257852] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-15T19:11:45.620456] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:11:46.057922] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-15T19:11:46.857952] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-15T19:11:47.017392] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:11:47.280759] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:11:47.657892] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-15T19:11:48.118533] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:11:48.123941] [INFO ] [REMOTE ] LAZ: Full fetch complete (49466 records). [2025-09-15T19:11:48.124119] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-15T19:11:48.466039] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-15T19:11:48.506877] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-15T19:11:48.506965] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-15T19:11:48.507797] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-15T19:11:48.507844] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-15T19:11:48.509058] [DEBUG] [LOCAL ] LAZ: Trimmed 49466 records to 33117 (keeping 150 days of data) [2025-09-15T19:11:48.732550] [DEBUG] [LOCAL ] LAZ: Primary data saved (33117 records). [2025-09-15T19:11:48.732757] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-15T19:11:48.732861] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LAZ took 21.7s. Estimated remaining: 1h 59m 33s. Rate: 9.4 symbols/min [2025-09-15T19:11:48.909236] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:48.921280] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:11:48.925707] [INFO ] [REMOTE ] LB: Full fetch complete (41542 records). [2025-09-15T19:11:48.925817] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-15T19:11:49.208244] [DEBUG] [LOCAL ] LCII: Loaded 20847 existing records from primary storage. [2025-09-15T19:11:49.246324] [INFO ] [MAIN ] LCII: Loaded 20847 existing records. [2025-09-15T19:11:49.264992] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-15T19:11:49.499878] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-15T19:11:49.510154] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-15T19:11:49.521327] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-15T19:11:49.534696] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-15T19:11:49.573675] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:49.574052] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-15T19:11:49.574260] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-15T19:11:49.574425] [DEBUG] [LOCAL ] LB: Trimmed 41542 records to 27501 (keeping 150 days of data) [2025-09-15T19:11:49.574865] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-15T19:11:49.574940] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-15T19:11:50.239013] [INFO ] [REMOTE ] LCII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:50.242211] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-15T19:11:50.252058] [DEBUG] [LOCAL ] LB: Primary data saved (27501 records). [2025-09-15T19:11:50.252696] [INFO ] [MAIN ] LB: Full history saved. [2025-09-15T19:11:50.252872] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LB took 23.2s. Estimated remaining: 1h 59m 23s. Rate: 9.4 symbols/min [2025-09-15T19:11:50.543087] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T19:11:50.594150] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:50.645582] [DEBUG] [LOCAL ] LDI: Loaded 32413 existing records from primary storage. [2025-09-15T19:11:50.645813] [INFO ] [MAIN ] LDI: Loaded 32413 existing records. [2025-09-15T19:11:50.816504] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:11:50.870277] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-15T19:11:50.982511] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:50.983044] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-15T19:11:50.983115] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-15T19:11:50.983915] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-15T19:11:50.983979] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-15T19:11:51.383887] [INFO ] [REMOTE ] LDI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:51.399545] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:11:51.657916] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-15T19:11:52.457989] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-15T19:11:52.603755] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:11:52.609924] [INFO ] [REMOTE ] LBRT: Full fetch complete (57544 records). [2025-09-15T19:11:52.610110] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-15T19:11:52.992366] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-15T19:11:52.992507] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-15T19:11:52.993589] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-15T19:11:52.993740] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-15T19:11:53.002116] [DEBUG] [LOCAL ] LBRT: Trimmed 57544 records to 39012 (keeping 150 days of data) [2025-09-15T19:11:53.016193] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:11:53.257995] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-15T19:11:53.271946] [DEBUG] [LOCAL ] LBRT: Primary data saved (39012 records). [2025-09-15T19:11:53.272126] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-15T19:11:53.274370] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 26.2s. Estimated remaining: 1h 59m 13s. Rate: 9.4 symbols/min [2025-09-15T19:11:53.457244] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:53.500729] [DEBUG] [LOCAL ] LDOS: Loaded 33900 existing records from primary storage. [2025-09-15T19:11:53.500913] [INFO ] [MAIN ] LDOS: Loaded 33900 existing records. [2025-09-15T19:11:53.684415] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:53.684771] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-15T19:11:53.684822] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-15T19:11:53.685724] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-15T19:11:53.685787] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-15T19:11:54.061053] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:11:54.086996] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:54.083507] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-15T19:11:54.722346] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:11:54.857886] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-15T19:11:55.223322] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:11:55.657881] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-15T19:11:56.411135] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:11:56.457880] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-15T19:11:57.260010] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-15T19:11:57.263371] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:11:57.995330] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:11:58.057835] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-15T19:11:58.724058] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:11:58.857889] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-15T19:11:59.343413] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:11:59.657901] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-15T19:11:59.904988] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:12:00.457919] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-15T19:12:01.257903] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-15T19:12:01.347849] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:12:01.728015] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:12:02.057875] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-15T19:12:02.535575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:12:02.857874] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-15T19:12:03.657895] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-15T19:12:04.435762] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T19:12:04.457841] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-15T19:12:05.262982] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-15T19:12:05.264879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-15T19:12:05.613609] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:12:05.747129] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:12:06.057920] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-15T19:12:06.857889] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-15T19:12:06.924562] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T19:12:06.930098] [INFO ] [REMOTE ] LC: Full fetch complete (52459 records). [2025-09-15T19:12:06.930241] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-15T19:12:07.309974] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-15T19:12:07.310062] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-15T19:12:07.310905] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-15T19:12:07.310963] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-15T19:12:07.312158] [DEBUG] [LOCAL ] LC: Trimmed 52459 records to 35229 (keeping 150 days of data) [2025-09-15T19:12:07.540570] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:12:07.548060] [INFO ] [REMOTE ] LDI: Full fetch complete (46235 records). [2025-09-15T19:12:07.548690] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-15T19:12:07.661906] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-15T19:12:07.687038] [DEBUG] [LOCAL ] LC: Primary data saved (35229 records). [2025-09-15T19:12:07.702522] [INFO ] [MAIN ] LC: Full history saved. [2025-09-15T19:12:07.754140] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LC took 30.1s. Estimated remaining: 1h 59m 14s. Rate: 9.4 symbols/min [2025-09-15T19:12:08.061791] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-15T19:12:08.061895] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-15T19:12:08.078071] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-15T19:12:08.099284] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-15T19:12:08.124365] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:08.132734] [DEBUG] [LOCAL ] LDI: Trimmed 46235 records to 31881 (keeping 150 days of data) [2025-09-15T19:12:08.143722] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:12:08.241904] [DEBUG] [LOCAL ] LDP: Loaded 9487 existing records from primary storage. [2025-09-15T19:12:08.247659] [INFO ] [MAIN ] LDP: Loaded 9487 existing records. [2025-09-15T19:12:08.471868] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-15T19:12:08.511189] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:08.512655] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-15T19:12:08.513325] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-15T19:12:08.515078] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-15T19:12:08.515769] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-15T19:12:08.823326] [DEBUG] [LOCAL ] LDI: Primary data saved (31881 records). [2025-09-15T19:12:08.824208] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-15T19:12:08.824433] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDI took 18.6s. Estimated remaining: 1h 59m 3s. Rate: 9.4 symbols/min [2025-09-15T19:12:09.009448] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:09.079782] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:09.113120] [DEBUG] [LOCAL ] LEA: Loaded 30762 existing records from primary storage. [2025-09-15T19:12:09.113267] [INFO ] [MAIN ] LEA: Loaded 30762 existing records. [2025-09-15T19:12:09.263480] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-15T19:12:09.294283] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:09.294527] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-15T19:12:09.294616] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-15T19:12:09.295409] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-15T19:12:09.295460] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-15T19:12:09.660452] [INFO ] [REMOTE ] LEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:09.672310] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:12:09.675830] [INFO ] [REMOTE ] LCII: Full fetch complete (31080 records). [2025-09-15T19:12:09.675947] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-15T19:12:09.868731] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T19:12:10.034225] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:12:10.066989] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-15T19:12:10.113094] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-15T19:12:10.113176] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-15T19:12:10.113809] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-15T19:12:10.113853] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-15T19:12:10.115137] [DEBUG] [LOCAL ] LCII: Trimmed 31080 records to 20124 (keeping 150 days of data) [2025-09-15T19:12:10.261013] [DEBUG] [LOCAL ] LCII: Primary data saved (20124 records). [2025-09-15T19:12:10.261153] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-15T19:12:10.261247] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LCII took 21.5s. Estimated remaining: 1h 58m 52s. Rate: 9.4 symbols/min [2025-09-15T19:12:10.435422] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:10.477144] [DEBUG] [LOCAL ] LEG: Loaded 37656 existing records from primary storage. [2025-09-15T19:12:10.477306] [INFO ] [MAIN ] LEG: Loaded 37656 existing records. [2025-09-15T19:12:10.654089] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:10.654353] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-15T19:12:10.654399] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-15T19:12:10.655160] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-15T19:12:10.655212] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-15T19:12:10.862932] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-15T19:12:11.010299] [INFO ] [REMOTE ] LEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:11.019513] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:12:11.657880] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-15T19:12:12.457876] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-15T19:12:12.729472] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T19:12:12.913406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:12:13.029746] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:12:13.257875] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-15T19:12:13.399197] [DEBUG] [REMOTE ] LEG: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T19:12:13.399538] [WARN ] [REMOTE ] LEG: No data returned for month 2025-02 [2025-09-15T19:12:14.057870] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-15T19:12:14.857892] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-15T19:12:15.657942] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-15T19:12:16.458963] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-15T19:12:16.461973] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-15T19:12:17.257934] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-15T19:12:17.468024] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-15T19:12:17.751462] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:12:17.923879] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-15T19:12:18.057863] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-15T19:12:18.855059] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:12:18.857931] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-15T19:12:19.037774] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T19:12:19.403164] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:12:19.657879] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-15T19:12:20.314072] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:12:20.457855] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-15T19:12:21.233616] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T19:12:21.235479] [INFO ] [REMOTE ] LDP: Full fetch complete (14172 records). [2025-09-15T19:12:21.235549] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-15T19:12:21.265116] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-15T19:12:21.592392] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-15T19:12:21.592469] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-15T19:12:21.592844] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-15T19:12:21.592889] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-15T19:12:21.593390] [DEBUG] [LOCAL ] LDP: Trimmed 14172 records to 9342 (keeping 150 days of data) [2025-09-15T19:12:21.655779] [DEBUG] [LOCAL ] LDP: Primary data saved (9342 records). [2025-09-15T19:12:21.655938] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-15T19:12:21.656059] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LDP took 13.8s. Estimated remaining: 1h 58m 50s. Rate: 9.4 symbols/min [2025-09-15T19:12:21.833923] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:21.878582] [DEBUG] [LOCAL ] LEN: Loaded 39992 existing records from primary storage. [2025-09-15T19:12:21.878790] [INFO ] [MAIN ] LEN: Loaded 39992 existing records. [2025-09-15T19:12:22.053954] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:22.054222] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-15T19:12:22.054282] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-15T19:12:22.055172] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-15T19:12:22.055226] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-15T19:12:22.066531] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-15T19:12:22.410380] [INFO ] [REMOTE ] LEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:22.857844] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-15T19:12:22.960916] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:12:23.491490] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:12:23.657891] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-15T19:12:24.302299] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:12:24.457870] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-15T19:12:24.887401] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:12:25.257869] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-15T19:12:26.057888] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-15T19:12:26.347742] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T19:12:26.857889] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-15T19:12:26.958849] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:12:27.218529] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:12:27.657833] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-15T19:12:28.005245] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:12:28.457893] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-15T19:12:28.869530] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:12:29.257890] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-15T19:12:29.988944] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:12:30.057914] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-15T19:12:30.768789] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:12:30.857883] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-15T19:12:31.356591] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:12:31.362215] [INFO ] [REMOTE ] LDOS: Full fetch complete (50562 records). [2025-09-15T19:12:31.362395] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-15T19:12:31.658326] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-15T19:12:31.769865] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-15T19:12:31.770021] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-15T19:12:31.771863] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-15T19:12:31.771974] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-15T19:12:31.773743] [DEBUG] [LOCAL ] LDOS: Trimmed 50562 records to 33182 (keeping 150 days of data) [2025-09-15T19:12:32.011673] [DEBUG] [LOCAL ] LDOS: Primary data saved (33182 records). [2025-09-15T19:12:32.011837] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-15T19:12:32.011984] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LDOS took 38.7s. Estimated remaining: 1h 58m 48s. Rate: 9.4 symbols/min [2025-09-15T19:12:32.182949] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:32.196471] [DEBUG] [LOCAL ] LEO: Loaded 12504 existing records from primary storage. [2025-09-15T19:12:32.196605] [INFO ] [MAIN ] LEO: Loaded 12504 existing records. [2025-09-15T19:12:32.398295] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:32.401246] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-15T19:12:32.401686] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-15T19:12:32.403217] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:12:32.403284] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-15T19:12:32.412173] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-15T19:12:32.459350] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-15T19:12:32.779187] [INFO ] [REMOTE ] LEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:33.257897] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-15T19:12:33.554732] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:12:34.057864] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-15T19:12:34.086493] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:12:34.092543] [INFO ] [REMOTE ] LEG: Full fetch complete (49675 records). [2025-09-15T19:12:34.092747] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-15T19:12:34.286429] [WARN ] [VALIDATOR ] LEG: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T19:12:34.287439] [FATAL] [MAIN ] LEG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:12:34.287571] [WARN ] [MAIN ] LEG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:12:34.287794] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-15T19:12:34.287907] [DEBUG] [LOCAL ] LEG: No primary data file found to delete. [2025-09-15T19:12:34.287976] [INFO ] [LOCAL ] LEG: Starting deletion of derivative data. [2025-09-15T19:12:34.293505] [DEBUG] [LOCAL ] LEG: Deleted derivative data file. [2025-09-15T19:12:34.303772] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEG took 24.0s. Estimated remaining: 1h 58m 38s. Rate: 9.4 symbols/min [2025-09-15T19:12:34.349555] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:12:34.483071] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:34.529228] [DEBUG] [LOCAL ] LEVI: Loaded 38710 existing records from primary storage. [2025-09-15T19:12:34.529393] [INFO ] [MAIN ] LEVI: Loaded 38710 existing records. [2025-09-15T19:12:34.719939] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:34.720209] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-15T19:12:34.720258] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-15T19:12:34.721188] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-15T19:12:34.721241] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-15T19:12:34.863064] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-15T19:12:35.141045] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:35.657937] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-15T19:12:35.907302] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T19:12:36.089266] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:12:36.347758] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T19:12:36.457935] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-15T19:12:37.257882] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-15T19:12:37.586028] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:12:38.057877] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-15T19:12:38.857886] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-15T19:12:38.917847] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:12:39.509402] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T19:12:39.657868] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-15T19:12:40.240313] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:12:40.247714] [INFO ] [REMOTE ] LEA: Full fetch complete (45331 records). [2025-09-15T19:12:40.247897] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-15T19:12:40.463047] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-15T19:12:40.632599] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-15T19:12:40.632708] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-15T19:12:40.633544] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-15T19:12:40.633588] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-15T19:12:40.634743] [DEBUG] [LOCAL ] LEA: Trimmed 45331 records to 30256 (keeping 150 days of data) [2025-09-15T19:12:40.841197] [DEBUG] [LOCAL ] LEA: Primary data saved (30256 records). [2025-09-15T19:12:40.841356] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-15T19:12:40.841445] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEA took 32.0s. Estimated remaining: 1h 58m 32s. Rate: 9.4 symbols/min [2025-09-15T19:12:41.016147] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:41.031930] [DEBUG] [LOCAL ] LFT: Loaded 14281 existing records from primary storage. [2025-09-15T19:12:41.032059] [INFO ] [MAIN ] LFT: Loaded 14281 existing records. [2025-09-15T19:12:41.214979] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:12:41.233801] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:41.238003] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-15T19:12:41.238074] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-15T19:12:41.238503] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-15T19:12:41.238548] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-15T19:12:41.269129] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-15T19:12:41.591573] [INFO ] [REMOTE ] LFT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:41.666584] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T19:12:42.057876] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-15T19:12:42.267783] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:12:42.857927] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-15T19:12:43.657907] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-15T19:12:43.685049] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T19:12:43.776766] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:12:44.207706] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:12:44.457900] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-15T19:12:45.257877] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-15T19:12:45.367042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:12:46.057945] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-15T19:12:46.857864] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-15T19:12:46.947101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:12:46.949233] [INFO ] [REMOTE ] LEO: Full fetch complete (19660 records). [2025-09-15T19:12:46.949305] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-15T19:12:47.354571] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-15T19:12:47.356536] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T19:12:47.354960] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-15T19:12:47.367562] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-15T19:12:47.368209] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-15T19:12:47.369210] [DEBUG] [LOCAL ] LEO: Trimmed 19660 records to 11897 (keeping 150 days of data) [2025-09-15T19:12:47.442870] [DEBUG] [LOCAL ] LEO: Primary data saved (11897 records). [2025-09-15T19:12:47.443034] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-15T19:12:47.443123] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEO took 15.4s. Estimated remaining: 1h 58m 25s. Rate: 9.4 symbols/min [2025-09-15T19:12:47.615247] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:47.623897] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:12:47.633937] [DEBUG] [LOCAL ] LGI: Loaded 7499 existing records from primary storage. [2025-09-15T19:12:47.634028] [INFO ] [MAIN ] LGI: Loaded 7499 existing records. [2025-09-15T19:12:47.663034] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-15T19:12:47.812922] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:47.813159] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-15T19:12:47.813207] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-15T19:12:47.813551] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-15T19:12:47.813600] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-15T19:12:48.165802] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:48.384196] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:12:48.457913] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-15T19:12:49.257895] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-15T19:12:49.486085] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:12:50.057912] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-15T19:12:50.634318] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:12:50.857889] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-15T19:12:51.234465] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T19:12:51.657919] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-15T19:12:52.340877] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:12:52.457922] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-15T19:12:52.866971] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:12:53.257896] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-15T19:12:53.773236] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T19:12:54.057887] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-15T19:12:54.416511] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T19:12:54.422487] [INFO ] [REMOTE ] LEN: Full fetch complete (57810 records). [2025-09-15T19:12:54.422629] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-15T19:12:54.804025] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-15T19:12:54.804144] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-15T19:12:54.805073] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-15T19:12:54.805121] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-15T19:12:54.806469] [DEBUG] [LOCAL ] LEN: Trimmed 57810 records to 39223 (keeping 150 days of data) [2025-09-15T19:12:54.869441] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-15T19:12:55.068863] [DEBUG] [LOCAL ] LEN: Primary data saved (39223 records). [2025-09-15T19:12:55.069032] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-15T19:12:55.070108] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LEN took 33.4s. Estimated remaining: 1h 58m 20s. Rate: 9.4 symbols/min [2025-09-15T19:12:55.244604] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:55.276284] [DEBUG] [LOCAL ] LH: Loaded 28629 existing records from primary storage. [2025-09-15T19:12:55.276548] [INFO ] [MAIN ] LH: Loaded 28629 existing records. [2025-09-15T19:12:55.420018] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:12:55.504457] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:55.504762] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-15T19:12:55.504831] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-15T19:12:55.511919] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-15T19:12:55.512461] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-15T19:12:55.545264] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:12:55.667631] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-15T19:12:55.886506] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:56.457946] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-15T19:12:57.257879] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-15T19:12:57.319389] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:12:57.670527] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:12:58.057837] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-15T19:12:58.407033] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:12:58.857873] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-15T19:12:59.407562] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:12:59.434255] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T19:12:59.657882] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-15T19:13:00.457887] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-15T19:13:01.257866] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-15T19:13:01.552542] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:13:01.716593] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:13:02.063837] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-15T19:13:02.068738] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T19:13:02.612948] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:13:02.857952] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-15T19:13:03.657899] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-15T19:13:04.363789] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T19:13:04.404433] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:13:04.457864] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-15T19:13:05.257921] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-15T19:13:05.551557] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:13:06.057872] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-15T19:13:06.561547] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:13:06.567561] [INFO ] [REMOTE ] LEVI: Full fetch complete (55930 records). [2025-09-15T19:13:06.567721] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-15T19:13:06.867520] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-15T19:13:06.969719] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-15T19:13:06.969886] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-15T19:13:06.970898] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-15T19:13:06.970959] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-15T19:13:06.972346] [DEBUG] [LOCAL ] LEVI: Trimmed 55930 records to 37969 (keeping 150 days of data) [2025-09-15T19:13:07.215279] [DEBUG] [LOCAL ] LEVI: Primary data saved (37969 records). [2025-09-15T19:13:07.215439] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-15T19:13:07.216143] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LEVI took 32.9s. Estimated remaining: 1h 58m 19s. Rate: 9.4 symbols/min [2025-09-15T19:13:07.392511] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:07.434968] [DEBUG] [LOCAL ] LHX: Loaded 36949 existing records from primary storage. [2025-09-15T19:13:07.435139] [INFO ] [MAIN ] LHX: Loaded 36949 existing records. [2025-09-15T19:13:07.615477] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:07.615917] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-15T19:13:07.616079] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-15T19:13:07.628659] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-15T19:13:07.628576] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T19:13:07.628865] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-15T19:13:07.663510] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-15T19:13:08.005876] [INFO ] [REMOTE ] LHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:08.044776] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T19:13:08.457863] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-15T19:13:08.510365] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T19:13:08.512288] [INFO ] [REMOTE ] LFT: Full fetch complete (18660 records). [2025-09-15T19:13:08.512361] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-15T19:13:08.887459] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-15T19:13:08.887696] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-15T19:13:08.888187] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-15T19:13:08.888237] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-15T19:13:08.888994] [DEBUG] [LOCAL ] LFT: Trimmed 18660 records to 13970 (keeping 150 days of data) [2025-09-15T19:13:08.972827] [DEBUG] [LOCAL ] LFT: Primary data saved (13970 records). [2025-09-15T19:13:08.972985] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-15T19:13:08.973092] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LFT took 28.1s. Estimated remaining: 1h 58m 8s. Rate: 9.4 symbols/min [2025-09-15T19:13:09.146368] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:09.165914] [DEBUG] [LOCAL ] LII: Loaded 20548 existing records from primary storage. [2025-09-15T19:13:09.166054] [INFO ] [MAIN ] LII: Loaded 20548 existing records. [2025-09-15T19:13:09.265731] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-15T19:13:09.348282] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:09.353210] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:13:09.353501] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-15T19:13:09.355272] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-15T19:13:09.355411] [INFO ] [REMOTE ] LGI: Full fetch complete (11049 records). [2025-09-15T19:13:09.355631] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-15T19:13:09.388746] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-15T19:13:09.420732] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-15T19:13:10.061924] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-15T19:13:10.110213] [INFO ] [REMOTE ] LII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:10.111506] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-15T19:13:10.111563] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-15T19:13:10.111875] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-15T19:13:10.111921] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-15T19:13:10.112437] [DEBUG] [LOCAL ] LGI: Trimmed 11049 records to 7281 (keeping 150 days of data) [2025-09-15T19:13:10.158533] [DEBUG] [LOCAL ] LGI: Primary data saved (7281 records). [2025-09-15T19:13:10.158666] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-15T19:13:10.158768] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LGI took 22.7s. Estimated remaining: 1h 57m 57s. Rate: 9.4 symbols/min [2025-09-15T19:13:10.330929] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:10.368596] [DEBUG] [LOCAL ] LION: Loaded 35561 existing records from primary storage. [2025-09-15T19:13:10.368757] [INFO ] [MAIN ] LION: Loaded 35561 existing records. [2025-09-15T19:13:10.559930] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:10.560289] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-15T19:13:10.560345] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-15T19:13:10.561211] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-15T19:13:10.561450] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-15T19:13:10.859218] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-15T19:13:10.942617] [INFO ] [REMOTE ] LION: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:10.972538] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:13:11.291263] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:13:11.657873] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-15T19:13:12.268475] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:13:12.457893] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-15T19:13:12.955103] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:13:12.958857] [INFO ] [REMOTE ] LH: Full fetch complete (42264 records). [2025-09-15T19:13:12.959008] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-15T19:13:13.263031] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-15T19:13:13.336296] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-15T19:13:13.336383] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-15T19:13:13.337281] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-15T19:13:13.337356] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-15T19:13:13.338335] [DEBUG] [LOCAL ] LH: Trimmed 42264 records to 27924 (keeping 150 days of data) [2025-09-15T19:13:13.521251] [DEBUG] [LOCAL ] LH: Primary data saved (27924 records). [2025-09-15T19:13:13.521428] [INFO ] [MAIN ] LH: Full history saved. [2025-09-15T19:13:13.521544] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LH took 18.5s. Estimated remaining: 1h 57m 48s. Rate: 9.4 symbols/min [2025-09-15T19:13:13.694702] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:13.699105] [DEBUG] [LOCAL ] LITB: Loaded 2497 existing records from primary storage. [2025-09-15T19:13:13.699264] [INFO ] [MAIN ] LITB: Loaded 2497 existing records. [2025-09-15T19:13:13.870987] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:13:13.906991] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:13.907601] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-15T19:13:13.907673] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-15T19:13:13.907921] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-15T19:13:13.907966] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-15T19:13:14.062960] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-15T19:13:14.286890] [INFO ] [REMOTE ] LITB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:14.306793] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:13:14.857880] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-15T19:13:15.311587] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T19:13:15.405314] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T19:13:15.657877] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-15T19:13:16.133455] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T19:13:16.457873] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-15T19:13:16.955747] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T19:13:17.257886] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-15T19:13:17.713895] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:13:18.057877] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-15T19:13:18.495488] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:13:18.857880] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-15T19:13:19.297009] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T19:13:19.657868] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-15T19:13:20.148738] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:13:20.457930] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-15T19:13:21.257879] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-15T19:13:22.057897] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-15T19:13:22.267893] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:13:22.340508] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:13:22.857865] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-15T19:13:22.954548] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:13:22.956185] [INFO ] [REMOTE ] LITB: Full fetch complete (4447 records). [2025-09-15T19:13:22.956260] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-15T19:13:23.308292] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-15T19:13:23.308385] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-15T19:13:23.308542] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-15T19:13:23.308583] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-15T19:13:23.308966] [DEBUG] [LOCAL ] LITB: Trimmed 4447 records to 2317 (keeping 150 days of data) [2025-09-15T19:13:23.322346] [DEBUG] [LOCAL ] LITB: Primary data saved (2317 records). [2025-09-15T19:13:23.322416] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-15T19:13:23.322500] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LITB took 9.8s. Estimated remaining: 1h 57m 45s. Rate: 9.4 symbols/min [2025-09-15T19:13:23.497783] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:23.541572] [DEBUG] [LOCAL ] LLY: Loaded 40112 existing records from primary storage. [2025-09-15T19:13:23.541778] [INFO ] [MAIN ] LLY: Loaded 40112 existing records. [2025-09-15T19:13:23.662949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-15T19:13:23.733397] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:23.733677] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-15T19:13:23.733729] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-15T19:13:23.734782] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-15T19:13:23.734842] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-15T19:13:24.128384] [INFO ] [REMOTE ] LLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:24.150145] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:13:24.457891] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-15T19:13:24.569750] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T19:13:25.257894] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-15T19:13:26.057903] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-15T19:13:26.298668] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T19:13:26.335741] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:13:26.857848] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-15T19:13:27.657922] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-15T19:13:27.973068] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T19:13:28.318743] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:13:28.457851] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-15T19:13:28.812924] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:13:29.257899] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-15T19:13:30.005589] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T19:13:30.057819] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-15T19:13:30.858111] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-15T19:13:30.864025] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:13:31.657906] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-15T19:13:31.704623] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:13:32.457900] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-15T19:13:33.019860] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T19:13:33.257874] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-15T19:13:33.350731] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:13:33.980262] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:13:34.057835] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-15T19:13:34.857892] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-15T19:13:35.442817] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:13:35.448309] [INFO ] [REMOTE ] LION: Full fetch complete (43869 records). [2025-09-15T19:13:35.448424] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-15T19:13:35.666121] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-15T19:13:35.800333] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-15T19:13:35.878106] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-15T19:13:35.878200] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-15T19:13:35.879163] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-15T19:13:35.879218] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-15T19:13:35.880396] [DEBUG] [LOCAL ] LION: Trimmed 43869 records to 35366 (keeping 150 days of data) [2025-09-15T19:13:36.087193] [DEBUG] [LOCAL ] LION: Primary data saved (35366 records). [2025-09-15T19:13:36.087357] [INFO ] [MAIN ] LION: Full history saved. [2025-09-15T19:13:36.087470] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LION took 25.9s. Estimated remaining: 1h 57m 44s. Rate: 9.4 symbols/min [2025-09-15T19:13:36.265295] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:36.304364] [DEBUG] [LOCAL ] LMND: Loaded 39073 existing records from primary storage. [2025-09-15T19:13:36.304591] [INFO ] [MAIN ] LMND: Loaded 39073 existing records. [2025-09-15T19:13:36.459140] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-15T19:13:36.492083] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:36.492493] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-15T19:13:36.492548] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-15T19:13:36.493416] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-15T19:13:36.493476] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-15T19:13:36.822529] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T19:13:36.900237] [INFO ] [REMOTE ] LMND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:36.922363] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T19:13:37.257897] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-15T19:13:38.057900] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-15T19:13:38.875433] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-15T19:13:38.894477] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:13:38.900354] [INFO ] [REMOTE ] LHX: Full fetch complete (53609 records). [2025-09-15T19:13:38.900510] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-15T19:13:39.285783] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-15T19:13:39.285939] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-15T19:13:39.287209] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-15T19:13:39.287295] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-15T19:13:39.289261] [DEBUG] [LOCAL ] LHX: Trimmed 53609 records to 36187 (keeping 150 days of data) [2025-09-15T19:13:39.428496] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-15T19:13:39.591807] [DEBUG] [LOCAL ] LHX: Primary data saved (36187 records). [2025-09-15T19:13:39.591961] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-15T19:13:39.594034] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LHX took 32.4s. Estimated remaining: 1h 57m 36s. Rate: 9.4 symbols/min [2025-09-15T19:13:39.658189] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-15T19:13:39.773703] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:39.802159] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T19:13:39.829388] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:13:39.869628] [DEBUG] [LOCAL ] LMT: Loaded 37406 existing records from primary storage. [2025-09-15T19:13:39.869845] [INFO ] [MAIN ] LMT: Loaded 37406 existing records. [2025-09-15T19:13:40.046332] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:40.046620] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-15T19:13:40.046689] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-15T19:13:40.047694] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-15T19:13:40.047748] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-15T19:13:40.402681] [INFO ] [REMOTE ] LMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:40.457816] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-15T19:13:41.257912] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-15T19:13:41.770363] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T19:13:42.057939] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-15T19:13:42.298820] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:13:42.318770] [INFO ] [REMOTE ] LII: Full fetch complete (31496 records). [2025-09-15T19:13:42.331605] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-15T19:13:42.381003] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T19:13:42.725005] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-15T19:13:42.725126] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-15T19:13:42.725929] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-15T19:13:42.725974] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-15T19:13:42.726876] [DEBUG] [LOCAL ] LII: Trimmed 31496 records to 20183 (keeping 150 days of data) [2025-09-15T19:13:42.859250] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-15T19:13:42.861085] [DEBUG] [LOCAL ] LII: Primary data saved (20183 records). [2025-09-15T19:13:42.861257] [INFO ] [MAIN ] LII: Full history saved. [2025-09-15T19:13:42.861349] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LII took 33.9s. Estimated remaining: 1h 57m 26s. Rate: 9.4 symbols/min [2025-09-15T19:13:43.046105] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:43.085282] [DEBUG] [LOCAL ] LNC: Loaded 38705 existing records from primary storage. [2025-09-15T19:13:43.085600] [INFO ] [MAIN ] LNC: Loaded 38705 existing records. [2025-09-15T19:13:43.271358] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:43.271818] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-15T19:13:43.271873] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-15T19:13:43.272736] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-15T19:13:43.272794] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-15T19:13:43.644612] [INFO ] [REMOTE ] LNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:43.657845] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-15T19:13:44.465746] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-15T19:13:44.492148] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-15T19:13:44.565528] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T19:13:44.977072] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:13:45.257986] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-15T19:13:46.057860] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-15T19:13:46.111396] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:13:46.857875] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-15T19:13:47.266676] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T19:13:47.657909] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-15T19:13:48.427986] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:13:48.457854] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-15T19:13:48.545461] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-15T19:13:48.939995] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:13:49.257912] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-15T19:13:50.057887] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-15T19:13:50.360957] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T19:13:50.857878] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-15T19:13:51.102305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T19:13:51.657918] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-15T19:13:52.309875] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-15T19:13:52.316904] [INFO ] [REMOTE ] LLY: Full fetch complete (57940 records). [2025-09-15T19:13:52.317142] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-15T19:13:52.462981] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-15T19:13:52.745953] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-15T19:13:52.746109] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-15T19:13:52.747065] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-15T19:13:52.747113] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-15T19:13:52.748492] [DEBUG] [LOCAL ] LLY: Trimmed 57940 records to 39337 (keeping 150 days of data) [2025-09-15T19:13:52.905192] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T19:13:53.077611] [DEBUG] [LOCAL ] LLY: Primary data saved (39337 records). [2025-09-15T19:13:53.077798] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-15T19:13:53.079144] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LLY took 29.8s. Estimated remaining: 1h 57m 24s. Rate: 9.4 symbols/min [2025-09-15T19:13:53.255946] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:53.257860] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-15T19:13:53.264534] [DEBUG] [LOCAL ] LND: Loaded 3677 existing records from primary storage. [2025-09-15T19:13:53.264750] [INFO ] [MAIN ] LND: Loaded 3677 existing records. [2025-09-15T19:13:53.449008] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:53.449413] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-15T19:13:53.449492] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-15T19:13:53.449764] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-15T19:13:53.449822] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-15T19:13:53.592582] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:13:53.886435] [INFO ] [REMOTE ] LND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:54.057893] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-15T19:13:54.548225] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T19:13:54.578104] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T19:13:54.857923] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-15T19:13:55.386155] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T19:13:55.435921] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:13:55.658016] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-15T19:13:56.326630] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T19:13:56.457956] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-15T19:13:57.257995] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-15T19:13:57.787975] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T19:13:58.057905] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-15T19:13:58.734721] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T19:13:58.857915] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-15T19:13:59.658120] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-15T19:13:59.667968] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:14:00.116164] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:14:00.457907] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-15T19:14:00.789482] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T19:14:00.798775] [INFO ] [REMOTE ] LMND: Full fetch complete (56465 records). [2025-09-15T19:14:00.798964] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-15T19:14:01.210621] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-15T19:14:01.210754] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-15T19:14:01.212257] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-15T19:14:01.212320] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-15T19:14:01.214294] [DEBUG] [LOCAL ] LMND: Trimmed 56465 records to 38437 (keeping 150 days of data) [2025-09-15T19:14:01.267089] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-15T19:14:01.456953] [DEBUG] [LOCAL ] LMND: Primary data saved (38437 records). [2025-09-15T19:14:01.457131] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-15T19:14:01.458116] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LMND took 25.4s. Estimated remaining: 1h 57m 19s. Rate: 9.4 symbols/min [2025-09-15T19:14:01.628394] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:01.669729] [DEBUG] [LOCAL ] LNG: Loaded 38725 existing records from primary storage. [2025-09-15T19:14:01.669880] [INFO ] [MAIN ] LNG: Loaded 38725 existing records. [2025-09-15T19:14:01.844629] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:01.844922] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-15T19:14:01.844970] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-15T19:14:01.845843] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-15T19:14:01.845892] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-15T19:14:02.063084] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-15T19:14:02.209524] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:02.554592] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T19:14:02.709034] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:14:02.857898] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-15T19:14:03.126912] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T19:14:03.657943] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-15T19:14:04.260328] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:14:04.457923] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-15T19:14:04.713024] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T19:14:05.257963] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-15T19:14:06.063765] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-15T19:14:06.083712] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T19:14:06.857898] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-15T19:14:06.976386] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:14:07.489636] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:14:07.657938] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-15T19:14:08.001828] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T19:14:08.457909] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-15T19:14:09.257940] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-15T19:14:09.463095] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:14:09.913411] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:14:09.920977] [INFO ] [REMOTE ] LND: Full fetch complete (5976 records). [2025-09-15T19:14:09.921275] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-15T19:14:10.065206] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-15T19:14:10.289662] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-15T19:14:10.289763] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-15T19:14:10.289964] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-15T19:14:10.290006] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-15T19:14:10.290410] [DEBUG] [LOCAL ] LND: Trimmed 5976 records to 3604 (keeping 150 days of data) [2025-09-15T19:14:10.311956] [DEBUG] [LOCAL ] LND: Primary data saved (3604 records). [2025-09-15T19:14:10.312071] [INFO ] [MAIN ] LND: Full history saved. [2025-09-15T19:14:10.312218] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LND took 17.2s. Estimated remaining: 1h 57m 15s. Rate: 9.4 symbols/min [2025-09-15T19:14:10.483725] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:10.502047] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-15T19:14:10.508281] [INFO ] [REMOTE ] LMT: Full fetch complete (54570 records). [2025-09-15T19:14:10.510850] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-15T19:14:10.594469] [DEBUG] [LOCAL ] LNN: Loaded 8309 existing records from primary storage. [2025-09-15T19:14:10.605938] [INFO ] [MAIN ] LNN: Loaded 8309 existing records. [2025-09-15T19:14:10.869117] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-15T19:14:10.932018] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:10.945944] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-15T19:14:10.946028] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-15T19:14:10.995464] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-15T19:14:11.006701] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-15T19:14:11.212086] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-15T19:14:11.222366] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-15T19:14:11.245938] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-15T19:14:11.268520] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-15T19:14:11.372930] [DEBUG] [LOCAL ] LMT: Trimmed 54570 records to 36693 (keeping 150 days of data) [2025-09-15T19:14:11.546404] [INFO ] [REMOTE ] LNN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:11.659490] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-15T19:14:11.707898] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:14:11.731994] [DEBUG] [LOCAL ] LMT: Primary data saved (36693 records). [2025-09-15T19:14:11.732114] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-15T19:14:11.732208] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LMT took 32.1s. Estimated remaining: 1h 57m 4s. Rate: 9.4 symbols/min [2025-09-15T19:14:11.898300] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:11.932918] [DEBUG] [LOCAL ] LOAR: Loaded 32743 existing records from primary storage. [2025-09-15T19:14:11.933061] [INFO ] [MAIN ] LOAR: Loaded 32743 existing records. [2025-09-15T19:14:12.107119] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:12.107348] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-15T19:14:12.107400] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-15T19:14:12.108077] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-15T19:14:12.108126] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-15T19:14:12.373224] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:14:12.466246] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-15T19:14:12.470377] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:12.626341] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:14:12.632553] [INFO ] [REMOTE ] LNC: Full fetch complete (56127 records). [2025-09-15T19:14:12.632671] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-15T19:14:13.011083] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-15T19:14:13.011246] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-15T19:14:13.012116] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-15T19:14:13.012169] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-15T19:14:13.019218] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:14:13.022248] [DEBUG] [LOCAL ] LNC: Trimmed 56127 records to 37942 (keeping 150 days of data) [2025-09-15T19:14:13.261159] [DEBUG] [LOCAL ] LNC: Primary data saved (37942 records). [2025-09-15T19:14:13.261360] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-15T19:14:13.261573] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LNC took 30.4s. Estimated remaining: 1h 56m 53s. Rate: 9.4 symbols/min [2025-09-15T19:14:13.261423] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-15T19:14:13.433624] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:13.456930] [DEBUG] [LOCAL ] LOB: Loaded 19624 existing records from primary storage. [2025-09-15T19:14:13.457115] [INFO ] [MAIN ] LOB: Loaded 19624 existing records. [2025-09-15T19:14:13.634767] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:13.635022] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-15T19:14:13.635077] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-15T19:14:13.635602] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-15T19:14:13.635676] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-15T19:14:13.988496] [INFO ] [REMOTE ] LOB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:14.057830] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-15T19:14:14.633559] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:14:14.857863] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-15T19:14:15.160091] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T19:14:15.657872] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-15T19:14:16.231137] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:14:16.457868] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-15T19:14:16.669021] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:14:17.257883] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-15T19:14:18.057918] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-15T19:14:18.308719] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T19:14:18.573358] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-15T19:14:18.857873] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-15T19:14:19.657874] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-15T19:14:19.731658] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T19:14:20.463914] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-15T19:14:20.486039] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:14:20.662320] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T19:14:21.257874] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-15T19:14:21.634575] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:14:22.057884] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-15T19:14:22.857866] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-15T19:14:23.072373] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:14:23.144706] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:14:23.657861] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-15T19:14:23.679468] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:14:24.457898] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-15T19:14:24.761475] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T19:14:25.099212] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T19:14:25.257891] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-15T19:14:26.057922] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-15T19:14:26.803162] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:14:26.857833] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-15T19:14:27.657879] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-15T19:14:27.939443] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T19:14:27.945176] [INFO ] [REMOTE ] LNG: Full fetch complete (56278 records). [2025-09-15T19:14:27.945295] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-15T19:14:28.347964] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T19:14:28.347450] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-15T19:14:28.352700] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-15T19:14:28.353765] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-15T19:14:28.353875] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-15T19:14:28.361357] [INFO ] [REMOTE ] LOAR: Full fetch complete (44297 records). [2025-09-15T19:14:28.362185] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-15T19:14:28.364224] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:14:28.365114] [DEBUG] [LOCAL ] LNG: Trimmed 56278 records to 37954 (keeping 150 days of data) [2025-09-15T19:14:28.506557] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-15T19:14:28.873907] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-15T19:14:28.874624] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-15T19:14:28.875746] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-15T19:14:28.876431] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-15T19:14:28.880128] [DEBUG] [LOCAL ] LOAR: Trimmed 44297 records to 32217 (keeping 150 days of data) [2025-09-15T19:14:29.183854] [DEBUG] [LOCAL ] LOAR: Primary data saved (32217 records). [2025-09-15T19:14:29.186414] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-15T19:14:29.186933] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LOAR took 17.5s. Estimated remaining: 1h 56m 55s. Rate: 9.4 symbols/min [2025-09-15T19:14:29.260101] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-15T19:14:29.384384] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:29.389019] [DEBUG] [LOCAL ] LNG: Primary data saved (37954 records). [2025-09-15T19:14:29.389197] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-15T19:14:29.390365] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LNG took 27.9s. Estimated remaining: 1h 56m 44s. Rate: 9.4 symbols/min [2025-09-15T19:14:29.484375] [DEBUG] [LOCAL ] LOCL: Loaded 2141 existing records from primary storage. [2025-09-15T19:14:29.497123] [INFO ] [MAIN ] LOCL: Loaded 2141 existing records. [2025-09-15T19:14:29.678954] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:29.773833] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:29.776121] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-15T19:14:29.775830] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:14:29.776390] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-15T19:14:29.786937] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-15T19:14:29.787064] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-15T19:14:29.900199] [DEBUG] [LOCAL ] LOMA: Loaded 23254 existing records from primary storage. [2025-09-15T19:14:29.906031] [INFO ] [MAIN ] LOMA: Loaded 23254 existing records. [2025-09-15T19:14:30.060410] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-15T19:14:30.280579] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:30.359874] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-15T19:14:30.360089] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-15T19:14:30.359772] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:30.414821] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-15T19:14:30.415336] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-15T19:14:30.415832] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:14:30.774257] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:30.857829] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-15T19:14:30.902872] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:14:31.657904] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-15T19:14:31.910143] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T19:14:32.457862] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-15T19:14:32.494831] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:14:33.251611] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T19:14:33.253353] [INFO ] [REMOTE ] LNN: Full fetch complete (11921 records). [2025-09-15T19:14:33.253426] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-15T19:14:33.264509] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-15T19:14:33.623787] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-15T19:14:33.623874] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-15T19:14:33.624151] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-15T19:14:33.624213] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-15T19:14:33.624734] [DEBUG] [LOCAL ] LNN: Trimmed 11921 records to 8087 (keeping 150 days of data) [2025-09-15T19:14:33.681542] [DEBUG] [LOCAL ] LNN: Primary data saved (8087 records). [2025-09-15T19:14:33.681714] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-15T19:14:33.681817] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LNN took 23.4s. Estimated remaining: 1h 56m 36s. Rate: 9.4 symbols/min [2025-09-15T19:14:33.860498] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:33.906108] [DEBUG] [LOCAL ] LOW: Loaded 39883 existing records from primary storage. [2025-09-15T19:14:33.906278] [INFO ] [MAIN ] LOW: Loaded 39883 existing records. [2025-09-15T19:14:34.067915] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-15T19:14:34.090075] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:34.090331] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-15T19:14:34.090389] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-15T19:14:34.091499] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-15T19:14:34.091551] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-15T19:14:34.459931] [INFO ] [REMOTE ] LOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:34.462339] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T19:14:34.485224] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:14:34.857888] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-15T19:14:35.657899] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-15T19:14:36.074812] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:14:36.457886] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-15T19:14:36.595635] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T19:14:37.067046] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:14:37.257898] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-15T19:14:38.057922] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-15T19:14:38.547475] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T19:14:38.692789] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:14:38.857896] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-15T19:14:39.657893] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-15T19:14:40.076285] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:14:40.457868] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-15T19:14:40.509633] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:14:41.257907] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-15T19:14:41.551391] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:14:41.615918] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T19:14:42.057882] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-15T19:14:42.857901] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-15T19:14:43.662985] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-15T19:14:43.692904] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:14:43.876992] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:14:43.880220] [INFO ] [REMOTE ] LOB: Full fetch complete (29361 records). [2025-09-15T19:14:43.880296] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-15T19:14:44.169046] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T19:14:44.265332] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-15T19:14:44.265470] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-15T19:14:44.266368] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-15T19:14:44.266442] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-15T19:14:44.267729] [DEBUG] [LOCAL ] LOB: Trimmed 29361 records to 19142 (keeping 150 days of data) [2025-09-15T19:14:44.394735] [DEBUG] [LOCAL ] LOB: Primary data saved (19142 records). [2025-09-15T19:14:44.394898] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-15T19:14:44.394987] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LOB took 31.1s. Estimated remaining: 1h 56m 33s. Rate: 9.4 symbols/min [2025-09-15T19:14:44.463127] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-15T19:14:44.568082] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:44.598949] [DEBUG] [LOCAL ] LPG: Loaded 30148 existing records from primary storage. [2025-09-15T19:14:44.599108] [INFO ] [MAIN ] LPG: Loaded 30148 existing records. [2025-09-15T19:14:44.778849] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:44.779127] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-15T19:14:44.779177] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-15T19:14:44.780143] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-15T19:14:44.780193] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-15T19:14:45.157998] [INFO ] [REMOTE ] LPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:45.162416] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:14:45.164193] [INFO ] [REMOTE ] LOCL: Full fetch complete (3312 records). [2025-09-15T19:14:45.164276] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-15T19:14:45.263218] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-15T19:14:45.551388] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-15T19:14:45.551497] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-15T19:14:45.551713] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-15T19:14:45.551773] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-15T19:14:45.552209] [DEBUG] [LOCAL ] LOCL: Trimmed 3312 records to 1941 (keeping 150 days of data) [2025-09-15T19:14:45.565122] [DEBUG] [LOCAL ] LOCL: Primary data saved (1941 records). [2025-09-15T19:14:45.565259] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-15T19:14:45.565369] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LOCL took 16.4s. Estimated remaining: 1h 56m 22s. Rate: 9.4 symbols/min [2025-09-15T19:14:45.754982] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:45.776932] [DEBUG] [LOCAL ] LPL: Loaded 19157 existing records from primary storage. [2025-09-15T19:14:45.777128] [INFO ] [MAIN ] LPL: Loaded 19157 existing records. [2025-09-15T19:14:45.973590] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:45.973942] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-15T19:14:45.973996] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-15T19:14:45.974750] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-15T19:14:45.974812] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-15T19:14:46.062993] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-15T19:14:46.352762] [INFO ] [REMOTE ] LPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:46.534194] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T19:14:46.857873] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-15T19:14:47.657982] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-15T19:14:47.936268] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:14:47.973544] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:14:48.458131] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-15T19:14:48.627026] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:14:49.257964] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-15T19:14:49.385915] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:14:50.057884] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-15T19:14:50.109930] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T19:14:50.857884] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-15T19:14:51.010023] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:14:51.657898] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-15T19:14:52.457885] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-15T19:14:52.788456] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:14:53.025041] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:14:53.257878] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-15T19:14:53.321885] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:14:54.057885] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-15T19:14:54.857972] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-15T19:14:55.181291] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T19:14:55.210341] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:14:55.657945] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-15T19:14:56.415529] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:14:56.464163] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-15T19:14:56.468137] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:14:57.257890] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-15T19:14:58.057881] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-15T19:14:58.295087] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T19:14:58.301267] [INFO ] [REMOTE ] LOW: Full fetch complete (57586 records). [2025-09-15T19:14:58.301502] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-15T19:14:58.714468] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:14:58.738261] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-15T19:14:58.738436] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-15T19:14:58.739391] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-15T19:14:58.739464] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-15T19:14:58.740988] [DEBUG] [LOCAL ] LOW: Trimmed 57586 records to 39109 (keeping 150 days of data) [2025-09-15T19:14:58.858030] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-15T19:14:58.875528] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T19:14:59.025479] [DEBUG] [LOCAL ] LOW: Primary data saved (39109 records). [2025-09-15T19:14:59.025704] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-15T19:14:59.026388] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOW took 25.3s. Estimated remaining: 1h 56m 22s. Rate: 9.4 symbols/min [2025-09-15T19:14:59.205804] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:59.239119] [DEBUG] [LOCAL ] LPX: Loaded 29818 existing records from primary storage. [2025-09-15T19:14:59.239301] [INFO ] [MAIN ] LPX: Loaded 29818 existing records. [2025-09-15T19:14:59.425432] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:59.425745] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-15T19:14:59.425801] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-15T19:14:59.426475] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-15T19:14:59.426534] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-15T19:14:59.662954] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-15T19:14:59.795404] [INFO ] [REMOTE ] LPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:00.270379] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:15:00.457871] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-15T19:15:00.629477] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:15:01.257910] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-15T19:15:01.985999] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:15:02.057874] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-15T19:15:02.857894] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-15T19:15:02.930343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T19:15:03.657901] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-15T19:15:04.457882] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-15T19:15:05.141744] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-15T19:15:05.257837] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-15T19:15:05.436074] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T19:15:05.442918] [INFO ] [REMOTE ] LPL: Full fetch complete (26236 records). [2025-09-15T19:15:05.443086] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-15T19:15:05.826488] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-15T19:15:05.826591] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-15T19:15:05.827262] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-15T19:15:05.827310] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-15T19:15:05.828352] [DEBUG] [LOCAL ] LPL: Trimmed 26236 records to 19036 (keeping 150 days of data) [2025-09-15T19:15:05.940300] [DEBUG] [LOCAL ] LPL: Primary data saved (19036 records). [2025-09-15T19:15:05.940484] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-15T19:15:05.940675] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPL took 20.4s. Estimated remaining: 1h 56m 16s. Rate: 9.4 symbols/min [2025-09-15T19:15:06.145693] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:06.148951] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T19:15:06.158110] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-15T19:15:06.191661] [DEBUG] [LOCAL ] LRN: Loaded 29698 existing records from primary storage. [2025-09-15T19:15:06.191812] [INFO ] [MAIN ] LRN: Loaded 29698 existing records. [2025-09-15T19:15:06.378008] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:06.390459] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-15T19:15:06.391040] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-15T19:15:06.391606] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-09-15T19:15:06.395873] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-15T19:15:06.396324] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-15T19:15:06.428880] [INFO ] [REMOTE ] LOMA: Full fetch complete (34170 records). [2025-09-15T19:15:06.479380] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-15T19:15:07.075468] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:07.091697] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-15T19:15:07.162689] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-15T19:15:07.162903] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-15T19:15:07.163736] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-15T19:15:07.163832] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-15T19:15:07.184124] [DEBUG] [LOCAL ] LOMA: Trimmed 34170 records to 22980 (keeping 150 days of data) [2025-09-15T19:15:07.189434] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T19:15:07.335944] [DEBUG] [LOCAL ] LOMA: Primary data saved (22980 records). [2025-09-15T19:15:07.336091] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-15T19:15:07.336179] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LOMA took 37.9s. Estimated remaining: 1h 56m 5s. Rate: 9.4 symbols/min [2025-09-15T19:15:07.523797] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:07.551550] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T19:15:07.586437] [DEBUG] [LOCAL ] LSPD: Loaded 31705 existing records from primary storage. [2025-09-15T19:15:07.586594] [INFO ] [MAIN ] LSPD: Loaded 31705 existing records. [2025-09-15T19:15:07.663024] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-15T19:15:07.764199] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:07.764438] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-15T19:15:07.764492] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-15T19:15:07.765087] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-15T19:15:07.765136] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-15T19:15:08.118631] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:08.313421] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:15:08.457892] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-15T19:15:08.710831] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:15:08.715392] [INFO ] [REMOTE ] LPG: Full fetch complete (44533 records). [2025-09-15T19:15:08.715484] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-15T19:15:09.145364] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-15T19:15:09.145601] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-15T19:15:09.146700] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-15T19:15:09.146752] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-15T19:15:09.148043] [DEBUG] [LOCAL ] LPG: Trimmed 44533 records to 29546 (keeping 150 days of data) [2025-09-15T19:15:09.257910] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-15T19:15:09.343188] [DEBUG] [LOCAL ] LPG: Primary data saved (29546 records). [2025-09-15T19:15:09.343362] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-15T19:15:09.343463] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LPG took 24.9s. Estimated remaining: 1h 55m 55s. Rate: 9.4 symbols/min [2025-09-15T19:15:09.512379] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:09.534269] [DEBUG] [LOCAL ] LTC: Loaded 22507 existing records from primary storage. [2025-09-15T19:15:09.534424] [INFO ] [MAIN ] LTC: Loaded 22507 existing records. [2025-09-15T19:15:09.710713] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:09.710986] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-15T19:15:09.711031] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-15T19:15:09.711779] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-15T19:15:09.711830] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-15T19:15:10.078286] [INFO ] [REMOTE ] LTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:10.073922] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-15T19:15:10.104669] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:15:10.776225] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:15:10.857876] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-15T19:15:11.302033] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T19:15:11.657921] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-15T19:15:11.997329] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:15:12.457892] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-15T19:15:13.250041] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:15:13.259696] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-15T19:15:13.656278] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:15:14.057929] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-15T19:15:14.150770] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:15:14.857870] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-15T19:15:15.657834] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-15T19:15:16.177364] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-15T19:15:16.457929] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-15T19:15:17.079932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T19:15:17.257943] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-15T19:15:17.688498] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T19:15:17.879427] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:15:18.057868] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-15T19:15:18.641229] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T19:15:18.857897] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-15T19:15:19.263131] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:15:19.657883] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-15T19:15:20.136123] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T19:15:20.457888] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-15T19:15:21.153745] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T19:15:21.257776] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-15T19:15:21.592139] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T19:15:22.057918] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-15T19:15:22.494292] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:15:22.857856] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-15T19:15:23.448921] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:15:23.453181] [INFO ] [REMOTE ] LRN: Full fetch complete (43318 records). [2025-09-15T19:15:23.453279] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-15T19:15:23.662981] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-15T19:15:23.835255] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-15T19:15:23.835375] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-15T19:15:23.836159] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-15T19:15:23.836279] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-15T19:15:23.853442] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:15:23.852815] [DEBUG] [LOCAL ] LRN: Trimmed 43318 records to 29198 (keeping 150 days of data) [2025-09-15T19:15:24.040986] [DEBUG] [LOCAL ] LRN: Primary data saved (29198 records). [2025-09-15T19:15:24.041137] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-15T19:15:24.041225] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LRN took 18.1s. Estimated remaining: 1h 55m 56s. Rate: 9.4 symbols/min [2025-09-15T19:15:24.216040] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:24.253223] [DEBUG] [LOCAL ] LTH: Loaded 38977 existing records from primary storage. [2025-09-15T19:15:24.253371] [INFO ] [MAIN ] LTH: Loaded 38977 existing records. [2025-09-15T19:15:24.427971] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:24.428246] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-15T19:15:24.428302] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-15T19:15:24.429192] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-15T19:15:24.429243] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-15T19:15:24.462966] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-15T19:15:24.792777] [INFO ] [REMOTE ] LTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:25.267830] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-15T19:15:25.272958] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:15:25.775241] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:15:26.057885] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-15T19:15:26.857899] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-15T19:15:27.119832] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T19:15:27.421018] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:15:27.657887] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-15T19:15:28.296720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T19:15:28.457875] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-15T19:15:29.008086] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:15:29.257947] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-15T19:15:29.767215] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:15:30.057881] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-15T19:15:30.577204] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:15:30.857932] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-15T19:15:31.425261] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:15:31.657878] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-15T19:15:32.120909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:15:32.457905] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-15T19:15:33.257885] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-15T19:15:33.349128] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:15:33.704932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:15:33.708344] [INFO ] [REMOTE ] LTC: Full fetch complete (32476 records). [2025-09-15T19:15:33.708448] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-15T19:15:34.063049] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-15T19:15:34.099622] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-15T19:15:34.099741] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-15T19:15:34.100442] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-15T19:15:34.100493] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-15T19:15:34.101302] [DEBUG] [LOCAL ] LTC: Trimmed 32476 records to 22112 (keeping 150 days of data) [2025-09-15T19:15:34.238630] [DEBUG] [LOCAL ] LTC: Primary data saved (22112 records). [2025-09-15T19:15:34.238790] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-15T19:15:34.238895] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LTC took 24.9s. Estimated remaining: 1h 55m 53s. Rate: 9.4 symbols/min [2025-09-15T19:15:34.329841] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:15:34.335789] [INFO ] [REMOTE ] LSPD: Full fetch complete (47963 records). [2025-09-15T19:15:34.335934] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-15T19:15:34.710255] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-15T19:15:34.710340] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-15T19:15:34.711145] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-15T19:15:34.711190] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-15T19:15:34.712180] [DEBUG] [LOCAL ] LSPD: Trimmed 47963 records to 30931 (keeping 150 days of data) [2025-09-15T19:15:34.861663] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-15T19:15:34.902428] [DEBUG] [LOCAL ] LSPD: Primary data saved (30931 records). [2025-09-15T19:15:34.902550] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-15T19:15:34.902631] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LSPD took 27.6s. Estimated remaining: 1h 55m 42s. Rate: 9.4 symbols/min [2025-09-15T19:15:35.688933] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:15:35.699516] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-15T19:15:36.181196] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:15:36.185590] [INFO ] [REMOTE ] LPX: Full fetch complete (43579 records). [2025-09-15T19:15:36.185791] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-15T19:15:36.552765] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-15T19:15:36.552844] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-15T19:15:36.553594] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-15T19:15:36.553655] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-15T19:15:36.554591] [DEBUG] [LOCAL ] LPX: Trimmed 43579 records to 29378 (keeping 150 days of data) [2025-09-15T19:15:36.741713] [DEBUG] [LOCAL ] LPX: Primary data saved (29378 records). [2025-09-15T19:15:36.741862] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-15T19:15:36.741967] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LPX took 37.7s. Estimated remaining: 1h 55m 32s. Rate: 9.4 symbols/min [2025-09-15T19:15:37.124196] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:15:37.136165] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-15T19:15:38.460807] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:15:38.472370] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-15T19:15:40.015064] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:15:40.020741] [INFO ] [REMOTE ] LTH: Full fetch complete (56359 records). [2025-09-15T19:15:40.020873] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-15T19:15:40.411426] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-15T19:15:40.411546] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-15T19:15:40.412578] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-15T19:15:40.412629] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-15T19:15:40.414037] [DEBUG] [LOCAL ] LTH: Trimmed 56359 records to 38227 (keeping 150 days of data) [2025-09-15T19:15:40.647058] [DEBUG] [LOCAL ] LTH: Primary data saved (38227 records). [2025-09-15T19:15:40.647222] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-15T19:15:40.648684] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LTH took 16.6s. Estimated remaining: 1h 55m 23s. Rate: 9.4 symbols/min [2025-09-15T19:15:41.296856] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.322666] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.373307] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.405490] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.440101] [DEBUG] [LOCAL ] LUCK: Loaded 17981 existing records from primary storage. [2025-09-15T19:15:41.440266] [INFO ] [MAIN ] LUCK: Loaded 17981 existing records. [2025-09-15T19:15:41.581744] [DEBUG] [LOCAL ] LU: Loaded 36936 existing records from primary storage. [2025-09-15T19:15:41.582355] [INFO ] [MAIN ] LU: Loaded 36936 existing records. [2025-09-15T19:15:41.644834] [DEBUG] [LOCAL ] LTM: Loaded 28107 existing records from primary storage. [2025-09-15T19:15:41.690399] [INFO ] [MAIN ] LTM: Loaded 28107 existing records. [2025-09-15T19:15:41.708600] [DEBUG] [LOCAL ] LUMN: Loaded 40397 existing records from primary storage. [2025-09-15T19:15:41.775513] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:41.833185] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-15T19:15:41.775666] [INFO ] [MAIN ] LUMN: Loaded 40397 existing records. [2025-09-15T19:15:41.838560] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-15T19:15:41.990686] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:41.990484] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-15T19:15:42.016473] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-15T19:15:42.124025] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.186402] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-15T19:15:42.298389] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-15T19:15:42.354935] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-15T19:15:42.670841] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:42.758924] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.726394] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:42.778215] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-15T19:15:42.817764] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-15T19:15:42.811180] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.838139] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-15T19:15:42.848978] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-15T19:15:42.977902] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-15T19:15:43.059149] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-15T19:15:43.608612] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:43.674073] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-15T19:15:43.817585] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:43.876695] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-15T19:15:44.122472] [INFO ] [REMOTE ] LTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:44.126196] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:44.126749] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-15T19:15:44.126516] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-15T19:15:44.961942] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:15:44.967473] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-15T19:15:45.277138] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:15:45.284535] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-15T19:15:45.505214] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:15:45.514855] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-15T19:15:45.601406] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T19:15:45.611374] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-15T19:15:45.839537] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:15:45.845897] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-15T19:15:46.183750] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:15:46.190102] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-15T19:15:46.698170] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:15:46.704691] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-15T19:15:46.923729] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:15:46.934044] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-15T19:15:46.975883] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:15:47.482768] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:15:47.500495] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:15:47.657835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-15T19:15:48.297555] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T19:15:48.457852] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-15T19:15:49.101499] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:15:49.257912] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-15T19:15:50.057898] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-15T19:15:50.091332] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T19:15:50.118884] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:15:50.857889] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-15T19:15:51.459000] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:15:51.657933] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-15T19:15:52.458822] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T19:15:52.458896] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-15T19:15:52.919301] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:15:53.257929] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-15T19:15:54.057937] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-15T19:15:54.154583] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:15:54.528138] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:15:54.857953] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-15T19:15:55.385773] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:15:55.391078] [INFO ] [REMOTE ] LTM: Full fetch complete (37589 records). [2025-09-15T19:15:55.391170] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-15T19:15:55.662942] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-15T19:15:55.766538] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-15T19:15:55.766632] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-15T19:15:55.767455] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-15T19:15:55.767497] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-15T19:15:55.768432] [DEBUG] [LOCAL ] LTM: Trimmed 37589 records to 27982 (keeping 150 days of data) [2025-09-15T19:15:55.937476] [DEBUG] [LOCAL ] LTM: Primary data saved (27982 records). [2025-09-15T19:15:55.937654] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-15T19:15:55.937756] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LTM took 15.3s. Estimated remaining: 1h 55m 24s. Rate: 9.4 symbols/min [2025-09-15T19:15:56.122814] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:56.162098] [DEBUG] [LOCAL ] LUV: Loaded 40429 existing records from primary storage. [2025-09-15T19:15:56.162264] [INFO ] [MAIN ] LUV: Loaded 40429 existing records. [2025-09-15T19:15:56.340057] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:56.340327] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-15T19:15:56.340374] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-15T19:15:56.341298] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-15T19:15:56.341355] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-15T19:15:56.464118] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-15T19:15:56.713528] [INFO ] [REMOTE ] LUV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:56.740402] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T19:15:57.143397] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:15:57.257861] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-15T19:15:57.708823] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T19:15:58.057914] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-15T19:15:58.857921] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-15T19:15:59.327290] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T19:15:59.605522] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T19:15:59.612491] [INFO ] [REMOTE ] LU: Full fetch complete (53156 records). [2025-09-15T19:15:59.612614] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-15T19:15:59.666896] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-15T19:15:59.993906] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-15T19:15:59.994042] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-15T19:15:59.994952] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-15T19:15:59.995018] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-15T19:16:00.010881] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:16:00.016415] [DEBUG] [LOCAL ] LU: Trimmed 53156 records to 36227 (keeping 150 days of data) [2025-09-15T19:16:00.228068] [DEBUG] [LOCAL ] LU: Primary data saved (36227 records). [2025-09-15T19:16:00.228208] [INFO ] [MAIN ] LU: Full history saved. [2025-09-15T19:16:00.228294] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LU took 19.6s. Estimated remaining: 1h 55m 16s. Rate: 9.4 symbols/min [2025-09-15T19:16:00.395071] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:00.395262] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-15T19:16:00.395302] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-15T19:16:00.395421] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-15T19:16:00.395460] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-15T19:16:00.395501] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-15T19:16:00.395535] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-15T19:16:00.463067] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-15T19:16:00.789728] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:01.258038] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-15T19:16:01.464780] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T19:16:01.937020] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:16:02.057898] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-15T19:16:02.459485] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-15T19:16:02.857906] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-15T19:16:03.111360] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:16:03.114442] [INFO ] [REMOTE ] LUCK: Full fetch complete (28886 records). [2025-09-15T19:16:03.114535] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-15T19:16:03.473531] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-09-15T19:16:03.473612] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-09-15T19:16:03.474325] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-09-15T19:16:03.474373] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-09-15T19:16:03.475130] [DEBUG] [LOCAL ] LUCK: Trimmed 28886 records to 17494 (keeping 150 days of data) [2025-09-15T19:16:03.593214] [DEBUG] [LOCAL ] LUCK: Primary data saved (17494 records). [2025-09-15T19:16:03.593448] [INFO ] [MAIN ] LUCK: Full history saved. [2025-09-15T19:16:03.593620] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUCK took 22.9s. Estimated remaining: 1h 55m 7s. Rate: 9.4 symbols/min [2025-09-15T19:16:03.663078] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-15T19:16:03.783938] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:03.827569] [DEBUG] [LOCAL ] LVS: Loaded 40317 existing records from primary storage. [2025-09-15T19:16:03.827772] [INFO ] [MAIN ] LVS: Loaded 40317 existing records. [2025-09-15T19:16:04.005415] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:04.005213] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:04.005854] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-15T19:16:04.006113] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-15T19:16:04.006744] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-15T19:16:04.007582] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-15T19:16:04.007632] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-15T19:16:04.368687] [INFO ] [REMOTE ] LVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:04.457871] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-15T19:16:04.652845] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:04.653183] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-15T19:16:04.920475] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T19:16:05.257893] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-15T19:16:06.057892] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-15T19:16:06.857879] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-15T19:16:07.149786] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:16:07.657897] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-15T19:16:07.768634] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:16:08.354797] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:16:08.457883] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-15T19:16:09.257893] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-15T19:16:09.738791] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T19:16:10.057884] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-15T19:16:10.166455] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:16:10.172874] [INFO ] [REMOTE ] LUMN: Full fetch complete (58306 records). [2025-09-15T19:16:10.173017] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-15T19:16:10.253670] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:10.280211] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-15T19:16:10.564589] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-15T19:16:10.564726] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-15T19:16:10.565735] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-15T19:16:10.565784] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-15T19:16:10.567257] [DEBUG] [LOCAL ] LUMN: Trimmed 58306 records to 39620 (keeping 150 days of data) [2025-09-15T19:16:10.805214] [DEBUG] [LOCAL ] LUMN: Primary data saved (39620 records). [2025-09-15T19:16:10.805392] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-15T19:16:10.806370] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LUMN took 30.2s. Estimated remaining: 1h 55m 2s. Rate: 9.4 symbols/min [2025-09-15T19:16:10.863924] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-15T19:16:10.991786] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:11.012285] [DEBUG] [LOCAL ] LVWR: Loaded 15617 existing records from primary storage. [2025-09-15T19:16:11.012424] [INFO ] [MAIN ] LVWR: Loaded 15617 existing records. [2025-09-15T19:16:11.199694] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:11.200027] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-15T19:16:11.200090] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-15T19:16:11.200697] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-15T19:16:11.200750] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-15T19:16:11.416460] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T19:16:11.616855] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:11.630681] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:16:11.657824] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-15T19:16:12.295908] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T19:16:12.457949] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-15T19:16:13.212416] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:16:13.257911] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-15T19:16:13.926700] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T19:16:14.057931] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-15T19:16:14.857913] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-15T19:16:15.026990] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T19:16:15.029803] [INFO ] [REMOTE ] LUXE: Full fetch complete (11662 records). [2025-09-15T19:16:15.029881] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-15T19:16:15.224516] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 94 unique days, need 150 days [2025-09-15T19:16:15.224880] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:16:15.224935] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:16:15.225017] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-15T19:16:15.225115] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-15T19:16:15.225155] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-15T19:16:15.225225] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-15T19:16:15.225297] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUXE took 15.0s. Estimated remaining: 1h 54m 54s. Rate: 9.4 symbols/min [2025-09-15T19:16:15.413022] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:15.465323] [DEBUG] [LOCAL ] LW: Loaded 38350 existing records from primary storage. [2025-09-15T19:16:15.465577] [INFO ] [MAIN ] LW: Loaded 38350 existing records. [2025-09-15T19:16:15.647409] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:15.647773] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-15T19:16:15.647841] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-15T19:16:15.648963] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-15T19:16:15.649024] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-15T19:16:15.663090] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-15T19:16:16.010506] [INFO ] [REMOTE ] LW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:16.457867] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-15T19:16:16.734119] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T19:16:17.257910] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-15T19:16:17.339912] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:16:17.820129] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:16:17.867995] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:16:18.057870] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-15T19:16:18.524565] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:16:18.857873] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-15T19:16:19.657896] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-15T19:16:20.353295] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:16:20.457868] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-15T19:16:21.065356] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:16:21.257881] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-15T19:16:22.057874] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-15T19:16:22.249290] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T19:16:22.657008] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T19:16:22.657331] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:16:22.857873] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-15T19:16:23.657876] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-15T19:16:24.418887] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:16:24.457835] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-15T19:16:25.257936] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-15T19:16:25.540536] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T19:16:26.057861] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-15T19:16:26.136077] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:16:26.857890] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-15T19:16:26.899147] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:16:26.906616] [INFO ] [REMOTE ] LUV: Full fetch complete (58368 records). [2025-09-15T19:16:26.906793] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-15T19:16:27.285374] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-15T19:16:27.285457] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-15T19:16:27.286327] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-15T19:16:27.286388] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-15T19:16:27.287678] [DEBUG] [LOCAL ] LUV: Trimmed 58368 records to 39649 (keeping 150 days of data) [2025-09-15T19:16:27.549173] [DEBUG] [LOCAL ] LUV: Primary data saved (39649 records). [2025-09-15T19:16:27.549339] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-15T19:16:27.549437] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LUV took 31.6s. Estimated remaining: 1h 54m 52s. Rate: 9.4 symbols/min [2025-09-15T19:16:27.662964] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-15T19:16:27.732974] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:27.746659] [DEBUG] [LOCAL ] LXFR: Loaded 12577 existing records from primary storage. [2025-09-15T19:16:27.746773] [INFO ] [MAIN ] LXFR: Loaded 12577 existing records. [2025-09-15T19:16:27.926998] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T19:16:27.971558] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:27.972138] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-15T19:16:27.972470] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-15T19:16:27.972953] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-15T19:16:27.973013] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-15T19:16:28.328200] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:28.357583] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T19:16:28.457869] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-15T19:16:28.703400] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:16:29.140226] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T19:16:29.257932] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-15T19:16:30.057889] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-15T19:16:30.515636] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:16:30.854473] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:16:30.860169] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-15T19:16:31.657917] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-15T19:16:32.457871] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-15T19:16:32.831839] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T19:16:33.018337] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T19:16:33.024269] [INFO ] [REMOTE ] LVS: Full fetch complete (58244 records). [2025-09-15T19:16:33.024449] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-15T19:16:33.268047] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-15T19:16:33.405717] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-15T19:16:33.405822] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-15T19:16:33.406752] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-15T19:16:33.406800] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-15T19:16:33.408182] [DEBUG] [LOCAL ] LVS: Trimmed 58244 records to 39539 (keeping 150 days of data) [2025-09-15T19:16:33.659120] [DEBUG] [LOCAL ] LVS: Primary data saved (39539 records). [2025-09-15T19:16:33.659311] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-15T19:16:33.660468] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LVS took 30.1s. Estimated remaining: 1h 54m 46s. Rate: 9.4 symbols/min [2025-09-15T19:16:33.832220] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:33.872237] [DEBUG] [LOCAL ] LXP: Loaded 38192 existing records from primary storage. [2025-09-15T19:16:33.872383] [INFO ] [MAIN ] LXP: Loaded 38192 existing records. [2025-09-15T19:16:34.053246] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:34.053527] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-15T19:16:34.053912] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-15T19:16:34.054930] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-15T19:16:34.054994] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-15T19:16:34.085357] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-15T19:16:34.261348] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T19:16:34.440400] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:34.452724] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:16:34.857913] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-15T19:16:35.668327] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-15T19:16:35.673901] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:16:35.699716] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:16:36.457943] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-15T19:16:36.731481] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:16:37.028124] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:16:37.257932] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-15T19:16:38.057979] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-15T19:16:38.108832] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T19:16:38.112788] [INFO ] [REMOTE ] LVWR: Full fetch complete (17178 records). [2025-09-15T19:16:38.112935] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-15T19:16:38.494860] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-15T19:16:38.494939] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-15T19:16:38.495323] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-15T19:16:38.495363] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-15T19:16:38.495956] [DEBUG] [LOCAL ] LVWR: Trimmed 17178 records to 15660 (keeping 150 days of data) [2025-09-15T19:16:38.590123] [DEBUG] [LOCAL ] LVWR: Primary data saved (15660 records). [2025-09-15T19:16:38.590278] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-15T19:16:38.590377] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LVWR took 27.8s. Estimated remaining: 1h 54m 38s. Rate: 9.4 symbols/min [2025-09-15T19:16:38.760512] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:38.783502] [DEBUG] [LOCAL ] LXU: Loaded 24142 existing records from primary storage. [2025-09-15T19:16:38.783678] [INFO ] [MAIN ] LXU: Loaded 24142 existing records. [2025-09-15T19:16:38.863055] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-15T19:16:38.970542] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:38.971215] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-15T19:16:38.971305] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-15T19:16:38.971990] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-15T19:16:38.972044] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-15T19:16:39.344809] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:39.347847] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:16:39.657945] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-15T19:16:40.472431] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-15T19:16:40.475518] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:16:40.718846] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:16:41.257912] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-15T19:16:42.065275] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-15T19:16:42.067493] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T19:16:42.230361] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:16:42.236008] [INFO ] [REMOTE ] LW: Full fetch complete (55909 records). [2025-09-15T19:16:42.236108] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-15T19:16:42.618478] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-15T19:16:42.618568] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-15T19:16:42.619436] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-15T19:16:42.619491] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-15T19:16:42.620689] [DEBUG] [LOCAL ] LW: Trimmed 55909 records to 37616 (keeping 150 days of data) [2025-09-15T19:16:42.855037] [DEBUG] [LOCAL ] LW: Primary data saved (37616 records). [2025-09-15T19:16:42.855189] [INFO ] [MAIN ] LW: Full history saved. [2025-09-15T19:16:42.856401] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LW took 27.6s. Estimated remaining: 1h 54m 30s. Rate: 9.4 symbols/min [2025-09-15T19:16:42.867960] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-15T19:16:43.026804] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:43.067378] [DEBUG] [LOCAL ] LYB: Loaded 40365 existing records from primary storage. [2025-09-15T19:16:43.067518] [INFO ] [MAIN ] LYB: Loaded 40365 existing records. [2025-09-15T19:16:43.258112] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:43.258513] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-15T19:16:43.258570] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-15T19:16:43.259628] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-15T19:16:43.259746] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-15T19:16:43.641767] [INFO ] [REMOTE ] LYB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:43.669183] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-15T19:16:43.677272] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:16:43.802527] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T19:16:44.457878] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-15T19:16:45.140154] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:16:45.257835] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-15T19:16:45.312945] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:16:46.057872] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-15T19:16:46.472030] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T19:16:46.857881] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-15T19:16:47.579906] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:16:47.657900] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-15T19:16:48.441339] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:16:48.457821] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-15T19:16:49.257852] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-15T19:16:49.518665] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:16:49.587971] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:16:50.057882] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-15T19:16:50.244480] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:16:50.791105] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:16:50.793139] [INFO ] [REMOTE ] LXFR: Full fetch complete (18877 records). [2025-09-15T19:16:50.793215] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-15T19:16:50.863196] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-15T19:16:51.194839] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-15T19:16:51.194995] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-15T19:16:51.195811] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-15T19:16:51.195872] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-15T19:16:51.196761] [DEBUG] [LOCAL ] LXFR: Trimmed 18877 records to 12308 (keeping 150 days of data) [2025-09-15T19:16:51.274054] [DEBUG] [LOCAL ] LXFR: Primary data saved (12308 records). [2025-09-15T19:16:51.274230] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-15T19:16:51.274319] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LXFR took 23.7s. Estimated remaining: 1h 54m 25s. Rate: 9.4 symbols/min [2025-09-15T19:16:51.440621] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:51.478761] [DEBUG] [LOCAL ] LYG: Loaded 39753 existing records from primary storage. [2025-09-15T19:16:51.478909] [INFO ] [MAIN ] LYG: Loaded 39753 existing records. [2025-09-15T19:16:51.652087] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:51.652371] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-15T19:16:51.652416] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-15T19:16:51.653323] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-15T19:16:51.653375] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-15T19:16:51.668534] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-15T19:16:52.008478] [INFO ] [REMOTE ] LYG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:52.457843] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-15T19:16:52.614670] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:16:53.056487] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:16:53.257823] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-15T19:16:53.745502] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T19:16:54.057902] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-15T19:16:54.468206] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:16:54.863976] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-15T19:16:54.881465] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:16:55.657928] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-15T19:16:56.457906] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-15T19:16:56.585209] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:16:56.713724] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:16:57.257933] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-15T19:16:57.528580] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:16:57.534192] [INFO ] [REMOTE ] LXP: Full fetch complete (54709 records). [2025-09-15T19:16:57.534294] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-15T19:16:57.907281] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-15T19:16:57.907374] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-15T19:16:57.908166] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-15T19:16:57.908215] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-15T19:16:57.909393] [DEBUG] [LOCAL ] LXP: Trimmed 54709 records to 37393 (keeping 150 days of data) [2025-09-15T19:16:58.072610] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-15T19:16:58.132972] [DEBUG] [LOCAL ] LXP: Primary data saved (37393 records). [2025-09-15T19:16:58.133089] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-15T19:16:58.133574] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LXP took 24.5s. Estimated remaining: 1h 54m 19s. Rate: 9.4 symbols/min [2025-09-15T19:16:58.301070] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:58.343407] [DEBUG] [LOCAL ] LYV: Loaded 38333 existing records from primary storage. [2025-09-15T19:16:58.343553] [INFO ] [MAIN ] LYV: Loaded 38333 existing records. [2025-09-15T19:16:58.517005] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:58.517250] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-15T19:16:58.517296] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-15T19:16:58.518173] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-15T19:16:58.518226] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-15T19:16:58.873915] [INFO ] [REMOTE ] LYV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:58.874096] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-15T19:16:58.908400] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:16:58.993811] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:16:59.657895] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-15T19:17:00.330070] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T19:17:00.457831] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-15T19:17:01.257950] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-15T19:17:01.364115] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:17:02.057882] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-15T19:17:02.389570] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T19:17:02.643114] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:17:02.857894] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-15T19:17:03.555606] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T19:17:03.657879] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-15T19:17:04.470203] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-15T19:17:04.499156] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T19:17:05.257871] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-15T19:17:05.329102] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T19:17:06.057907] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-15T19:17:06.343620] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T19:17:06.694347] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T19:17:06.700168] [INFO ] [REMOTE ] LYB: Full fetch complete (58191 records). [2025-09-15T19:17:06.700271] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-15T19:17:06.859744] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-15T19:17:07.116785] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-15T19:17:07.116917] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-15T19:17:07.118475] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-15T19:17:07.118560] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-15T19:17:07.120468] [DEBUG] [LOCAL ] LYB: Trimmed 58191 records to 39585 (keeping 150 days of data) [2025-09-15T19:17:07.392683] [DEBUG] [LOCAL ] LYB: Primary data saved (39585 records). [2025-09-15T19:17:07.392948] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-15T19:17:07.394735] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LYB took 24.5s. Estimated remaining: 1h 54m 16s. Rate: 9.4 symbols/min [2025-09-15T19:17:07.595038] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:07.628925] [DEBUG] [LOCAL ] LZB: Loaded 26397 existing records from primary storage. [2025-09-15T19:17:07.629115] [INFO ] [MAIN ] LZB: Loaded 26397 existing records. [2025-09-15T19:17:07.666427] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-15T19:17:07.815801] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:07.816223] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-15T19:17:07.816315] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-15T19:17:07.817221] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-15T19:17:07.817281] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-15T19:17:08.011266] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T19:17:08.219529] [INFO ] [REMOTE ] LZB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:08.397018] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T19:17:08.457875] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-15T19:17:08.616058] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:17:09.257922] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-15T19:17:10.057878] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-15T19:17:10.265797] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:17:10.399008] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:17:10.402253] [INFO ] [REMOTE ] LXU: Full fetch complete (34680 records). [2025-09-15T19:17:10.402362] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-15T19:17:10.773374] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-15T19:17:10.773465] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-15T19:17:10.774286] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-15T19:17:10.774363] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-15T19:17:10.775237] [DEBUG] [LOCAL ] LXU: Trimmed 34680 records to 23480 (keeping 150 days of data) [2025-09-15T19:17:10.860215] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-15T19:17:10.913587] [DEBUG] [LOCAL ] LXU: Primary data saved (23480 records). [2025-09-15T19:17:10.913738] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-15T19:17:10.913869] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LXU took 32.3s. Estimated remaining: 1h 54m 7s. Rate: 9.4 symbols/min [2025-09-15T19:17:11.085457] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:11.095913] [DEBUG] [LOCAL ] LZM: Loaded 9361 existing records from primary storage. [2025-09-15T19:17:11.096035] [INFO ] [MAIN ] LZM: Loaded 9361 existing records. [2025-09-15T19:17:11.278851] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:11.279094] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-15T19:17:11.279144] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-15T19:17:11.279448] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-15T19:17:11.279502] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-15T19:17:11.640935] [INFO ] [REMOTE ] LZM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:11.657817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-15T19:17:11.708366] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:17:12.151826] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T19:17:12.178586] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:17:12.457873] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-15T19:17:13.257881] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-15T19:17:13.638953] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T19:17:14.057875] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-15T19:17:14.857858] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-15T19:17:14.969226] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:17:14.975183] [INFO ] [REMOTE ] LYG: Full fetch complete (57505 records). [2025-09-15T19:17:14.975304] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-15T19:17:15.361583] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-15T19:17:15.361769] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-15T19:17:15.362784] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-15T19:17:15.362873] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-15T19:17:15.384099] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:17:15.391572] [DEBUG] [LOCAL ] LYG: Trimmed 57505 records to 38981 (keeping 150 days of data) [2025-09-15T19:17:15.461176] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T19:17:15.647505] [DEBUG] [LOCAL ] LYG: Primary data saved (38981 records). [2025-09-15T19:17:15.647682] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-15T19:17:15.647785] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LYG took 24.4s. Estimated remaining: 1h 53m 59s. Rate: 9.4 symbols/min [2025-09-15T19:17:15.662921] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-15T19:17:15.822942] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:15.861764] [DEBUG] [LOCAL ] M: Loaded 40298 existing records from primary storage. [2025-09-15T19:17:15.861918] [INFO ] [MAIN ] M: Loaded 40298 existing records. [2025-09-15T19:17:16.043281] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:16.043594] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-15T19:17:16.043662] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-15T19:17:16.044493] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-15T19:17:16.044550] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-15T19:17:16.408309] [INFO ] [REMOTE ] M: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:16.457881] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-15T19:17:17.003780] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T19:17:17.257878] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-15T19:17:17.774239] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:17:18.057874] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-15T19:17:18.245893] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:17:18.857874] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-15T19:17:19.482468] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:17:19.526433] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T19:17:19.657867] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-15T19:17:20.457885] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-15T19:17:21.017807] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T19:17:21.023475] [INFO ] [REMOTE ] LYV: Full fetch complete (55908 records). [2025-09-15T19:17:21.023593] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-15T19:17:21.275258] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-15T19:17:21.339742] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:17:21.416942] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-15T19:17:21.417029] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-15T19:17:21.418050] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-15T19:17:21.418098] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-15T19:17:21.419369] [DEBUG] [LOCAL ] LYV: Trimmed 55908 records to 37576 (keeping 150 days of data) [2025-09-15T19:17:21.651102] [DEBUG] [LOCAL ] LYV: Primary data saved (37576 records). [2025-09-15T19:17:21.651270] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-15T19:17:21.651812] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. LYV took 23.5s. Estimated remaining: 1h 53m 52s. Rate: 9.4 symbols/min [2025-09-15T19:17:21.820061] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:21.858462] [DEBUG] [LOCAL ] MA: Loaded 39448 existing records from primary storage. [2025-09-15T19:17:21.858608] [INFO ] [MAIN ] MA: Loaded 39448 existing records. [2025-09-15T19:17:22.031639] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:22.031909] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-15T19:17:22.031954] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-15T19:17:22.032876] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-15T19:17:22.032937] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-15T19:17:22.063236] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-15T19:17:22.392029] [INFO ] [REMOTE ] MA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:22.680576] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:17:22.857867] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-15T19:17:22.992273] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T19:17:23.657902] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-15T19:17:24.457897] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-15T19:17:24.496871] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:17:25.244739] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:17:25.257815] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-15T19:17:25.496696] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:17:25.768584] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T19:17:26.057886] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-15T19:17:26.857917] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-15T19:17:27.307301] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T19:17:27.494972] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T19:17:27.497339] [INFO ] [REMOTE ] LZM: Full fetch complete (14140 records). [2025-09-15T19:17:27.497411] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-15T19:17:27.668636] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-15T19:17:27.858351] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-15T19:17:27.858479] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-15T19:17:27.858863] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-15T19:17:27.858908] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-15T19:17:27.859673] [DEBUG] [LOCAL ] LZM: Trimmed 14140 records to 8818 (keeping 150 days of data) [2025-09-15T19:17:27.910125] [DEBUG] [LOCAL ] LZM: Primary data saved (8818 records). [2025-09-15T19:17:27.910265] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-15T19:17:27.910363] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. LZM took 17.0s. Estimated remaining: 1h 53m 46s. Rate: 9.4 symbols/min [2025-09-15T19:17:28.078244] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:28.116488] [DEBUG] [LOCAL ] MAA: Loaded 32420 existing records from primary storage. [2025-09-15T19:17:28.116619] [INFO ] [MAIN ] MAA: Loaded 32420 existing records. [2025-09-15T19:17:28.294027] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:28.294341] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-15T19:17:28.294394] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-15T19:17:28.295144] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-15T19:17:28.295196] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-15T19:17:28.462734] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-15T19:17:28.675932] [INFO ] [REMOTE ] MAA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:29.104552] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:17:29.257899] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-15T19:17:30.057955] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-15T19:17:30.207041] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:17:30.605556] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:17:30.609849] [INFO ] [REMOTE ] LZB: Full fetch complete (38884 records). [2025-09-15T19:17:30.609938] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-15T19:17:30.866056] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-15T19:17:30.993373] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-15T19:17:30.993458] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-15T19:17:30.994311] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-15T19:17:30.994373] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-15T19:17:30.995338] [DEBUG] [LOCAL ] LZB: Trimmed 38884 records to 26036 (keeping 150 days of data) [2025-09-15T19:17:31.168987] [DEBUG] [LOCAL ] LZB: Primary data saved (26036 records). [2025-09-15T19:17:31.169135] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-15T19:17:31.169234] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. LZB took 23.8s. Estimated remaining: 1h 53m 37s. Rate: 9.4 symbols/min [2025-09-15T19:17:31.339798] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:31.365056] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:17:31.407339] [DEBUG] [LOCAL ] MAC: Loaded 37163 existing records from primary storage. [2025-09-15T19:17:31.407496] [INFO ] [MAIN ] MAC: Loaded 37163 existing records. [2025-09-15T19:17:31.592550] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:31.592899] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-15T19:17:31.592948] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-15T19:17:31.593861] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-15T19:17:31.593921] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-15T19:17:31.666728] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-15T19:17:31.960394] [INFO ] [REMOTE ] MAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:32.457893] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-15T19:17:32.715817] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T19:17:33.257945] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-15T19:17:33.585031] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T19:17:33.640760] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:17:34.057893] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-15T19:17:34.857928] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-15T19:17:34.969155] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T19:17:35.533993] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:17:35.657833] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-15T19:17:36.455684] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T19:17:36.466326] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-15T19:17:37.002692] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:17:37.257897] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-15T19:17:38.057900] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-15T19:17:38.210436] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T19:17:38.858755] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-15T19:17:38.866072] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:17:39.657834] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-15T19:17:39.747789] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T19:17:40.330551] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T19:17:40.457836] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-15T19:17:41.148180] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:17:41.257841] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-15T19:17:42.026681] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:17:42.057831] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-15T19:17:42.857886] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-15T19:17:43.103845] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T19:17:43.657883] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-15T19:17:43.690512] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:17:44.138698] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:17:44.457873] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-15T19:17:45.229214] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:17:45.235067] [INFO ] [REMOTE ] MA: Full fetch complete (57192 records). [2025-09-15T19:17:45.235236] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-15T19:17:45.266590] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-15T19:17:45.621330] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-15T19:17:45.621436] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-15T19:17:45.622459] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-15T19:17:45.622525] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-15T19:17:45.623982] [DEBUG] [LOCAL ] MA: Trimmed 57192 records to 38662 (keeping 150 days of data) [2025-09-15T19:17:45.772661] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:17:45.921254] [DEBUG] [LOCAL ] MA: Primary data saved (38662 records). [2025-09-15T19:17:45.921441] [INFO ] [MAIN ] MA: Full history saved. [2025-09-15T19:17:45.922062] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MA took 24.3s. Estimated remaining: 1h 53m 38s. Rate: 9.4 symbols/min [2025-09-15T19:17:46.067064] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-15T19:17:46.091394] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:46.123401] [DEBUG] [LOCAL ] MAGN: Loaded 26412 existing records from primary storage. [2025-09-15T19:17:46.123556] [INFO ] [MAIN ] MAGN: Loaded 26412 existing records. [2025-09-15T19:17:46.304141] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:46.304389] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-15T19:17:46.304436] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-15T19:17:46.305023] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-15T19:17:46.305074] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-15T19:17:46.668816] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:46.726031] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:17:46.857850] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-15T19:17:47.659730] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:17:47.659843] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-15T19:17:48.099496] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:17:48.457943] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-15T19:17:49.064418] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T19:17:49.073096] [INFO ] [REMOTE ] M: Full fetch complete (58189 records). [2025-09-15T19:17:49.073275] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-15T19:17:49.269117] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-15T19:17:49.510872] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-15T19:17:49.510962] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-15T19:17:49.511898] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-15T19:17:49.511943] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-15T19:17:49.513236] [DEBUG] [LOCAL ] M: Trimmed 58189 records to 39519 (keeping 150 days of data) [2025-09-15T19:17:49.772500] [DEBUG] [LOCAL ] M: Primary data saved (39519 records). [2025-09-15T19:17:49.772774] [INFO ] [MAIN ] M: Full history saved. [2025-09-15T19:17:49.772885] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. M took 34.1s. Estimated remaining: 1h 53m 29s. Rate: 9.4 symbols/min [2025-09-15T19:17:49.945625] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:17:50.003130] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:50.040330] [DEBUG] [LOCAL ] MAIN: Loaded 30873 existing records from primary storage. [2025-09-15T19:17:50.040488] [INFO ] [MAIN ] MAIN: Loaded 30873 existing records. [2025-09-15T19:17:50.065236] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-15T19:17:50.226850] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:50.227097] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-15T19:17:50.227146] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-15T19:17:50.227901] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-15T19:17:50.227955] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-15T19:17:50.576787] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:50.857867] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-15T19:17:51.042414] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T19:17:51.376923] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:17:51.657893] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-15T19:17:52.198199] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:17:52.457882] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-15T19:17:53.192256] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:17:53.257885] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-15T19:17:53.495272] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:17:53.500557] [INFO ] [REMOTE ] MAA: Full fetch complete (46691 records). [2025-09-15T19:17:53.500754] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-15T19:17:53.913099] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-15T19:17:53.913226] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-15T19:17:53.914204] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-15T19:17:53.914254] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-15T19:17:53.915453] [DEBUG] [LOCAL ] MAA: Trimmed 46691 records to 31623 (keeping 150 days of data) [2025-09-15T19:17:54.083052] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-15T19:17:54.126817] [DEBUG] [LOCAL ] MAA: Primary data saved (31623 records). [2025-09-15T19:17:54.127005] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-15T19:17:54.128028] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAA took 26.2s. Estimated remaining: 1h 53m 21s. Rate: 9.4 symbols/min [2025-09-15T19:17:54.308821] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:54.352507] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:17:54.371251] [DEBUG] [LOCAL ] MAN: Loaded 33038 existing records from primary storage. [2025-09-15T19:17:54.371398] [INFO ] [MAIN ] MAN: Loaded 33038 existing records. [2025-09-15T19:17:54.554477] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:54.554784] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-15T19:17:54.554840] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-15T19:17:54.555580] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-15T19:17:54.555631] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-15T19:17:54.863089] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-15T19:17:54.943612] [INFO ] [REMOTE ] MAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:55.296275] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:17:55.657880] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-15T19:17:56.457918] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-15T19:17:56.601709] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:17:56.743930] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:17:57.257881] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-15T19:17:57.901217] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:17:58.057864] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-15T19:17:58.842343] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:17:58.857822] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-15T19:17:59.248456] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:17:59.657886] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-15T19:18:00.375821] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T19:18:00.457826] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-15T19:18:00.987167] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:18:01.257966] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-15T19:18:01.812310] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:18:02.057901] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-15T19:18:02.748716] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:18:02.857892] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-15T19:18:03.657910] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-15T19:18:03.744911] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:18:03.862576] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:18:04.457905] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-15T19:18:05.008423] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:18:05.257902] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-15T19:18:05.740474] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:18:06.057866] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-15T19:18:06.576263] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:18:06.857887] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-15T19:18:07.659425] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-15T19:18:07.663882] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T19:18:07.669023] [INFO ] [REMOTE ] MAIN: Full fetch complete (45036 records). [2025-09-15T19:18:07.669107] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-15T19:18:08.051815] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-15T19:18:08.051916] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-15T19:18:08.052712] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-15T19:18:08.052767] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-15T19:18:08.053826] [DEBUG] [LOCAL ] MAIN: Trimmed 45036 records to 30333 (keeping 150 days of data) [2025-09-15T19:18:08.244886] [DEBUG] [LOCAL ] MAIN: Primary data saved (30333 records). [2025-09-15T19:18:08.245030] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-15T19:18:08.245149] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MAIN took 18.5s. Estimated remaining: 1h 53m 21s. Rate: 9.4 symbols/min [2025-09-15T19:18:08.416778] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:08.436548] [DEBUG] [LOCAL ] MANU: Loaded 19444 existing records from primary storage. [2025-09-15T19:18:08.436782] [INFO ] [MAIN ] MANU: Loaded 19444 existing records. [2025-09-15T19:18:08.467310] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-15T19:18:08.639365] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:08.650184] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:18:08.650571] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-15T19:18:08.650987] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-15T19:18:08.656236] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:18:08.659825] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-15T19:18:08.659913] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-15T19:18:08.681001] [INFO ] [REMOTE ] MAC: Full fetch complete (53938 records). [2025-09-15T19:18:08.723322] [INFO ] [REMOTE ] MAGN: Full fetch complete (38331 records). [2025-09-15T19:18:08.723235] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-15T19:18:08.745136] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-15T19:18:09.677009] [INFO ] [REMOTE ] MANU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:09.750921] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-15T19:18:09.781074] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-15T19:18:09.784263] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-15T19:18:09.784479] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-15T19:18:09.784528] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-15T19:18:09.785545] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-15T19:18:09.786138] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-15T19:18:09.786043] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-15T19:18:09.786619] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-15T19:18:09.788435] [DEBUG] [LOCAL ] MAGN: Trimmed 38331 records to 26043 (keeping 150 days of data) [2025-09-15T19:18:09.788546] [DEBUG] [LOCAL ] MAC: Trimmed 53938 records to 36424 (keeping 150 days of data) [2025-09-15T19:18:09.995833] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:18:10.059078] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-15T19:18:10.100397] [DEBUG] [LOCAL ] MAGN: Primary data saved (26043 records). [2025-09-15T19:18:10.102033] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-15T19:18:10.104194] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MAGN took 24.2s. Estimated remaining: 1h 53m 11s. Rate: 9.4 symbols/min [2025-09-15T19:18:10.376137] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:10.400206] [DEBUG] [LOCAL ] MAC: Primary data saved (36424 records). [2025-09-15T19:18:10.400444] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-15T19:18:10.401720] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MAC took 39.2s. Estimated remaining: 1h 52m 60s. Rate: 9.4 symbols/min [2025-09-15T19:18:10.590484] [DEBUG] [LOCAL ] MAS: Loaded 39365 existing records from primary storage. [2025-09-15T19:18:10.610050] [INFO ] [MAIN ] MAS: Loaded 39365 existing records. [2025-09-15T19:18:10.609911] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:10.807534] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:10.807877] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-15T19:18:10.807930] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-15T19:18:10.808967] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-15T19:18:10.809026] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-15T19:18:10.918371] [DEBUG] [LOCAL ] MATV: Loaded 27232 existing records from primary storage. [2025-09-15T19:18:10.924048] [INFO ] [MAIN ] MATV: Loaded 27232 existing records. [2025-09-15T19:18:11.259853] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:11.277408] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-15T19:18:11.282724] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-15T19:18:11.303524] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-15T19:18:11.317242] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-15T19:18:11.414674] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:11.468542] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T19:18:11.458976] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-15T19:18:11.662506] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-15T19:18:11.758850] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:11.763391] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:18:12.457922] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-15T19:18:12.602031] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:18:12.774022] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:18:13.257875] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-15T19:18:13.664478] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:18:14.057887] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-15T19:18:14.104816] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:18:14.857892] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-15T19:18:15.642537] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:18:15.657824] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-15T19:18:16.133379] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:18:16.457879] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-15T19:18:17.124537] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T19:18:17.257871] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-15T19:18:17.859919] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:18:18.057867] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-15T19:18:18.506552] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T19:18:18.857828] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-15T19:18:19.248920] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:18:19.657926] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-15T19:18:20.463010] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-15T19:18:20.481391] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:18:20.543558] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T19:18:21.257883] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-15T19:18:21.744843] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:18:22.057877] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-15T19:18:22.748226] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T19:18:22.857876] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-15T19:18:23.345739] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T19:18:23.657956] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-15T19:18:23.777550] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:18:24.457889] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-15T19:18:25.116952] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:18:25.257834] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-15T19:18:25.638344] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T19:18:26.057922] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-15T19:18:26.857878] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-15T19:18:26.915719] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T19:18:27.077857] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:18:27.657883] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-15T19:18:28.048994] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:18:28.052837] [INFO ] [REMOTE ] MATV: Full fetch complete (41384 records). [2025-09-15T19:18:28.052958] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-15T19:18:28.421600] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-15T19:18:28.421696] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-15T19:18:28.422414] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-15T19:18:28.422454] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-15T19:18:28.423340] [DEBUG] [LOCAL ] MATV: Trimmed 41384 records to 26656 (keeping 150 days of data) [2025-09-15T19:18:28.476597] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-15T19:18:28.590285] [DEBUG] [LOCAL ] MATV: Primary data saved (26656 records). [2025-09-15T19:18:28.590418] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-15T19:18:28.590504] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MATV took 18.2s. Estimated remaining: 1h 53m 3s. Rate: 9.4 symbols/min [2025-09-15T19:18:28.761537] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:28.785586] [DEBUG] [LOCAL ] MATX: Loaded 24183 existing records from primary storage. [2025-09-15T19:18:28.785762] [INFO ] [MAIN ] MATX: Loaded 24183 existing records. [2025-09-15T19:18:28.961968] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:28.962217] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-15T19:18:28.962273] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-15T19:18:28.962855] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-15T19:18:28.962906] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-15T19:18:29.258416] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-15T19:18:29.327424] [INFO ] [REMOTE ] MATX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:29.342590] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T19:18:29.347856] [INFO ] [REMOTE ] MAN: Full fetch complete (47040 records). [2025-09-15T19:18:29.347954] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-15T19:18:29.743799] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-15T19:18:29.743992] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-15T19:18:29.745007] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-15T19:18:29.745230] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-15T19:18:29.756538] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:18:29.760704] [DEBUG] [LOCAL ] MAN: Trimmed 47040 records to 32327 (keeping 150 days of data) [2025-09-15T19:18:29.761136] [INFO ] [REMOTE ] MANU: Full fetch complete (29475 records). [2025-09-15T19:18:29.762165] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-15T19:18:30.098350] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-15T19:18:30.240679] [DEBUG] [LOCAL ] MAN: Primary data saved (32327 records). [2025-09-15T19:18:30.258392] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-15T19:18:30.267378] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MAN took 36.1s. Estimated remaining: 1h 52m 53s. Rate: 9.4 symbols/min [2025-09-15T19:18:30.494209] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-15T19:18:30.508730] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-15T19:18:30.518576] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-15T19:18:30.524065] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-15T19:18:30.544561] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:30.545732] [DEBUG] [LOCAL ] MANU: Trimmed 29475 records to 19151 (keeping 150 days of data) [2025-09-15T19:18:30.670678] [DEBUG] [LOCAL ] MANU: Primary data saved (19151 records). [2025-09-15T19:18:30.671023] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-15T19:18:30.671395] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MANU took 22.4s. Estimated remaining: 1h 52m 42s. Rate: 9.4 symbols/min [2025-09-15T19:18:30.802832] [DEBUG] [LOCAL ] MAX: Loaded 22509 existing records from primary storage. [2025-09-15T19:18:30.803543] [INFO ] [MAIN ] MAX: Loaded 22509 existing records. [2025-09-15T19:18:30.946507] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:31.065916] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:31.066297] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-15T19:18:31.066398] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-15T19:18:31.067025] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-15T19:18:31.083987] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-15T19:18:31.196141] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T19:18:31.286998] [DEBUG] [LOCAL ] MBC: Loaded 32070 existing records from primary storage. [2025-09-15T19:18:31.319778] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-15T19:18:31.344453] [INFO ] [MAIN ] MBC: Loaded 32070 existing records. [2025-09-15T19:18:31.647613] [INFO ] [REMOTE ] MAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:31.711686] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:31.711541] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-15T19:18:31.712933] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-15T19:18:31.712992] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-15T19:18:31.719055] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-15T19:18:31.728672] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-15T19:18:31.735078] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:18:32.097853] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:32.457900] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-15T19:18:32.768815] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:18:32.793497] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T19:18:32.799414] [INFO ] [REMOTE ] MAS: Full fetch complete (56781 records). [2025-09-15T19:18:32.799536] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-15T19:18:33.170858] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-15T19:18:33.170950] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-15T19:18:33.171868] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-15T19:18:33.171914] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-15T19:18:33.173141] [DEBUG] [LOCAL ] MAS: Trimmed 56781 records to 38615 (keeping 150 days of data) [2025-09-15T19:18:33.267011] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-15T19:18:33.418602] [DEBUG] [LOCAL ] MAS: Primary data saved (38615 records). [2025-09-15T19:18:33.418765] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-15T19:18:33.419422] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MAS took 23.3s. Estimated remaining: 1h 52m 32s. Rate: 9.4 symbols/min [2025-09-15T19:18:33.595238] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:33.614245] [DEBUG] [LOCAL ] MBI: Loaded 17956 existing records from primary storage. [2025-09-15T19:18:33.614384] [INFO ] [MAIN ] MBI: Loaded 17956 existing records. [2025-09-15T19:18:33.793079] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:33.793481] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-15T19:18:33.793542] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-15T19:18:33.794146] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-15T19:18:33.794266] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-15T19:18:33.910355] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T19:18:34.065489] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-15T19:18:34.174664] [INFO ] [REMOTE ] MBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:34.203044] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T19:18:34.857937] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-15T19:18:35.419373] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:18:35.657852] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-15T19:18:36.206434] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:18:36.457900] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-15T19:18:36.729669] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:18:37.257889] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-15T19:18:37.322133] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:18:38.057903] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-15T19:18:38.482563] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T19:18:38.857893] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-15T19:18:39.151821] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:18:39.657873] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-15T19:18:40.023667] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:18:40.457904] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-15T19:18:40.766763] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:18:41.257947] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-15T19:18:41.461639] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:18:42.057882] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-15T19:18:42.712627] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T19:18:42.857868] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-15T19:18:43.446181] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:18:43.657831] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-15T19:18:43.689859] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:18:44.457900] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-15T19:18:44.773961] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T19:18:45.219467] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:18:45.257882] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-15T19:18:46.057931] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-15T19:18:46.716134] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:18:46.857834] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-15T19:18:47.069951] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:18:47.657883] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-15T19:18:48.394522] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:18:48.457839] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-15T19:18:48.521954] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:18:49.257879] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-15T19:18:49.913993] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T19:18:49.919092] [INFO ] [REMOTE ] MBC: Full fetch complete (46820 records). [2025-09-15T19:18:49.919218] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-15T19:18:50.063064] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-15T19:18:50.300462] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-15T19:18:50.300549] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-15T19:18:50.301357] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-15T19:18:50.301409] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-15T19:18:50.302447] [DEBUG] [LOCAL ] MBC: Trimmed 46820 records to 31444 (keeping 150 days of data) [2025-09-15T19:18:50.502529] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:18:50.522312] [DEBUG] [LOCAL ] MBC: Primary data saved (31444 records). [2025-09-15T19:18:50.522471] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-15T19:18:50.522559] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MBC took 19.8s. Estimated remaining: 1h 52m 35s. Rate: 9.4 symbols/min [2025-09-15T19:18:50.697624] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:50.732955] [DEBUG] [LOCAL ] MC: Loaded 33022 existing records from primary storage. [2025-09-15T19:18:50.733159] [INFO ] [MAIN ] MC: Loaded 33022 existing records. [2025-09-15T19:18:50.863108] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-15T19:18:50.918154] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:50.918449] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-15T19:18:50.918498] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-15T19:18:50.919838] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-15T19:18:50.920243] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-15T19:18:51.301190] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T19:18:51.322362] [INFO ] [REMOTE ] MAX: Full fetch complete (33939 records). [2025-09-15T19:18:51.327950] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-15T19:18:51.327819] [INFO ] [REMOTE ] MC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:51.663090] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-15T19:18:51.706681] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-15T19:18:51.706766] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-15T19:18:51.707494] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-15T19:18:51.707536] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-15T19:18:51.708306] [DEBUG] [LOCAL ] MAX: Trimmed 33939 records to 22023 (keeping 150 days of data) [2025-09-15T19:18:51.858266] [DEBUG] [LOCAL ] MAX: Primary data saved (22023 records). [2025-09-15T19:18:51.858480] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-15T19:18:51.858668] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MAX took 21.6s. Estimated remaining: 1h 52m 24s. Rate: 9.4 symbols/min [2025-09-15T19:18:52.037524] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:52.048453] [DEBUG] [LOCAL ] MCB: Loaded 8245 existing records from primary storage. [2025-09-15T19:18:52.048622] [INFO ] [MAIN ] MCB: Loaded 8245 existing records. [2025-09-15T19:18:52.233725] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:52.242744] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-15T19:18:52.243404] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-15T19:18:52.243788] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:18:52.246869] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-15T19:18:52.247205] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-15T19:18:52.291397] [INFO ] [REMOTE ] MATX: Full fetch complete (34373 records). [2025-09-15T19:18:52.324148] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-15T19:18:52.463349] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-15T19:18:52.911370] [INFO ] [REMOTE ] MCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:53.052251] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:18:53.052390] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-15T19:18:53.058876] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-15T19:18:53.060187] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-15T19:18:53.060781] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-15T19:18:53.062550] [DEBUG] [LOCAL ] MATX: Trimmed 34373 records to 23548 (keeping 150 days of data) [2025-09-15T19:18:53.223505] [DEBUG] [LOCAL ] MATX: Primary data saved (23548 records). [2025-09-15T19:18:53.223736] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-15T19:18:53.223916] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MATX took 24.6s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-15T19:18:53.262996] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-15T19:18:53.399262] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:53.441968] [DEBUG] [LOCAL ] MCD: Loaded 40241 existing records from primary storage. [2025-09-15T19:18:53.442212] [INFO ] [MAIN ] MCD: Loaded 40241 existing records. [2025-09-15T19:18:53.634766] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:53.635037] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-15T19:18:53.635089] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-15T19:18:53.636055] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-15T19:18:53.636106] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-15T19:18:54.004110] [INFO ] [REMOTE ] MCD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:54.057902] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-15T19:18:54.111206] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:18:54.252926] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:18:54.857893] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-15T19:18:55.552853] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:18:55.668471] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-15T19:18:55.673891] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:18:56.389867] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T19:18:56.457896] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-15T19:18:57.201417] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:18:57.257839] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-15T19:18:58.057846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-15T19:18:58.099435] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:18:58.857906] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-15T19:18:59.510983] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T19:18:59.603826] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:18:59.657890] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-15T19:19:00.457958] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-15T19:19:01.246666] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T19:19:01.257817] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-15T19:19:01.292050] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:19:02.057879] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-15T19:19:02.616823] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:19:02.857905] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-15T19:19:03.277437] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:19:03.657911] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-15T19:19:04.372148] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:19:04.457883] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-15T19:19:05.164783] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:19:05.257870] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-15T19:19:06.057882] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-15T19:19:06.542295] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:19:06.683006] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-15T19:19:06.760767] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:19:06.763626] [INFO ] [REMOTE ] MBI: Full fetch complete (27185 records). [2025-09-15T19:19:06.763737] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-15T19:19:06.862732] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-15T19:19:07.132851] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-15T19:19:07.132966] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-15T19:19:07.133607] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-15T19:19:07.133672] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-15T19:19:07.134772] [DEBUG] [LOCAL ] MBI: Trimmed 27185 records to 17482 (keeping 150 days of data) [2025-09-15T19:19:07.234530] [DEBUG] [LOCAL ] MBI: Primary data saved (17482 records). [2025-09-15T19:19:07.234720] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-15T19:19:07.234832] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MBI took 33.8s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-15T19:19:07.404695] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:07.410940] [DEBUG] [LOCAL ] MCI: Loaded 4648 existing records from primary storage. [2025-09-15T19:19:07.411035] [INFO ] [MAIN ] MCI: Loaded 4648 existing records. [2025-09-15T19:19:07.588756] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:07.589015] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-15T19:19:07.589102] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-15T19:19:07.589341] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-15T19:19:07.589385] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-15T19:19:07.664626] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-15T19:19:07.956537] [INFO ] [REMOTE ] MCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:08.457854] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-15T19:19:08.534933] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:19:08.864525] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T19:19:09.155823] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:19:09.257939] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-15T19:19:10.057918] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-15T19:19:10.800208] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:19:10.857885] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-15T19:19:11.183318] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T19:19:11.406619] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T19:19:11.657914] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-15T19:19:12.457930] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-15T19:19:13.260112] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-15T19:19:13.261365] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:19:13.266727] [INFO ] [REMOTE ] MC: Full fetch complete (48320 records). [2025-09-15T19:19:13.266843] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-15T19:19:13.639656] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-15T19:19:13.639738] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-15T19:19:13.640458] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-15T19:19:13.640542] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-15T19:19:13.641604] [DEBUG] [LOCAL ] MC: Trimmed 48320 records to 32268 (keeping 150 days of data) [2025-09-15T19:19:13.843590] [DEBUG] [LOCAL ] MC: Primary data saved (32268 records). [2025-09-15T19:19:13.843745] [INFO ] [MAIN ] MC: Full history saved. [2025-09-15T19:19:13.843841] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MC took 23.3s. Estimated remaining: 1h 52m 8s. Rate: 9.4 symbols/min [2025-09-15T19:19:14.020724] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:14.048311] [DEBUG] [LOCAL ] MCK: Loaded 28906 existing records from primary storage. [2025-09-15T19:19:14.048440] [INFO ] [MAIN ] MCK: Loaded 28906 existing records. [2025-09-15T19:19:14.062916] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-15T19:19:14.177933] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T19:19:14.243237] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:14.243615] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-15T19:19:14.243726] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-15T19:19:14.244668] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-15T19:19:14.244731] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-15T19:19:14.626072] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:14.631377] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-15T19:19:14.789098] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:19:14.790813] [INFO ] [REMOTE ] MCB: Full fetch complete (12515 records). [2025-09-15T19:19:14.790881] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-15T19:19:14.863049] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-15T19:19:15.145764] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-15T19:19:15.145842] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-15T19:19:15.146123] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-15T19:19:15.146163] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-15T19:19:15.146623] [DEBUG] [LOCAL ] MCB: Trimmed 12515 records to 8093 (keeping 150 days of data) [2025-09-15T19:19:15.200665] [DEBUG] [LOCAL ] MCB: Primary data saved (8093 records). [2025-09-15T19:19:15.200831] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-15T19:19:15.200940] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MCB took 23.3s. Estimated remaining: 1h 51m 57s. Rate: 9.4 symbols/min [2025-09-15T19:19:15.400160] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:15.407328] [DEBUG] [LOCAL ] MCN: Loaded 6090 existing records from primary storage. [2025-09-15T19:19:15.407418] [INFO ] [MAIN ] MCN: Loaded 6090 existing records. [2025-09-15T19:19:15.583001] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:15.583272] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-15T19:19:15.583319] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-15T19:19:15.583721] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-15T19:19:15.583769] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-15T19:19:15.663091] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-15T19:19:15.948818] [INFO ] [REMOTE ] MCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:16.457924] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-15T19:19:16.626820] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:19:17.087572] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T19:19:17.099947] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T19:19:17.257858] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-15T19:19:18.057879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-15T19:19:18.680532] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:19:18.829502] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:19:18.857830] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-15T19:19:19.460820] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:19:19.657884] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-15T19:19:20.193958] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T19:19:20.457884] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-15T19:19:21.045564] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:19:21.257905] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-15T19:19:21.934953] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T19:19:22.057823] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-15T19:19:22.671966] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:19:22.857878] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-15T19:19:23.586534] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T19:19:23.657899] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-15T19:19:24.227366] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:19:24.457919] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-15T19:19:25.060797] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T19:19:25.257879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-15T19:19:25.875226] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:19:25.876567] [INFO ] [REMOTE ] MCN: Full fetch complete (8896 records). [2025-09-15T19:19:25.876675] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-15T19:19:26.065864] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-15T19:19:26.257637] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-15T19:19:26.257737] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-15T19:19:26.257968] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-15T19:19:26.258007] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-15T19:19:26.258432] [DEBUG] [LOCAL ] MCN: Trimmed 8896 records to 5926 (keeping 150 days of data) [2025-09-15T19:19:26.293610] [DEBUG] [LOCAL ] MCN: Primary data saved (5926 records). [2025-09-15T19:19:26.293726] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-15T19:19:26.293822] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCN took 11.1s. Estimated remaining: 1h 51m 55s. Rate: 9.4 symbols/min [2025-09-15T19:19:26.476941] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:26.509169] [DEBUG] [LOCAL ] MCO: Loaded 28401 existing records from primary storage. [2025-09-15T19:19:26.509393] [INFO ] [MAIN ] MCO: Loaded 28401 existing records. [2025-09-15T19:19:26.696115] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:26.696507] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-15T19:19:26.696559] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-15T19:19:26.697275] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-15T19:19:26.697340] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-15T19:19:26.858959] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-15T19:19:27.064755] [INFO ] [REMOTE ] MCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:27.664678] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-15T19:19:27.673340] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:19:28.457854] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-15T19:19:28.563457] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:19:28.569955] [INFO ] [REMOTE ] MCD: Full fetch complete (58137 records). [2025-09-15T19:19:28.570168] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-15T19:19:28.996066] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-15T19:19:28.996207] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-15T19:19:28.997577] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-15T19:19:28.997661] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-15T19:19:28.999945] [DEBUG] [LOCAL ] MCD: Trimmed 58137 records to 39466 (keeping 150 days of data) [2025-09-15T19:19:29.246628] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:19:29.264754] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-15T19:19:29.282510] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:19:29.319076] [DEBUG] [LOCAL ] MCD: Primary data saved (39466 records). [2025-09-15T19:19:29.319262] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-15T19:19:29.321097] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCD took 36.1s. Estimated remaining: 1h 51m 46s. Rate: 9.4 symbols/min [2025-09-15T19:19:29.489411] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:29.499000] [DEBUG] [LOCAL ] MCR: Loaded 6717 existing records from primary storage. [2025-09-15T19:19:29.499142] [INFO ] [MAIN ] MCR: Loaded 6717 existing records. [2025-09-15T19:19:29.684660] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:29.684955] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-15T19:19:29.685023] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-15T19:19:29.685407] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-15T19:19:29.685487] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-15T19:19:30.010888] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:19:30.062940] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-15T19:19:30.101035] [INFO ] [REMOTE ] MCR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:30.596835] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:19:30.857868] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-15T19:19:31.653967] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:19:31.655334] [INFO ] [REMOTE ] MCI: Full fetch complete (7538 records). [2025-09-15T19:19:31.655405] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-15T19:19:31.666678] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-15T19:19:32.024508] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-15T19:19:32.024588] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-15T19:19:32.024795] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-15T19:19:32.024844] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-15T19:19:32.025270] [DEBUG] [LOCAL ] MCI: Trimmed 7538 records to 4602 (keeping 150 days of data) [2025-09-15T19:19:32.054523] [DEBUG] [LOCAL ] MCI: Primary data saved (4602 records). [2025-09-15T19:19:32.054601] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-15T19:19:32.054724] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCI took 24.8s. Estimated remaining: 1h 51m 36s. Rate: 9.4 symbols/min [2025-09-15T19:19:32.225783] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:32.243477] [DEBUG] [LOCAL ] MCS: Loaded 15625 existing records from primary storage. [2025-09-15T19:19:32.243624] [INFO ] [MAIN ] MCS: Loaded 15625 existing records. [2025-09-15T19:19:32.422352] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:32.422620] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-15T19:19:32.422686] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-15T19:19:32.423188] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-15T19:19:32.423233] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-15T19:19:32.463001] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-15T19:19:32.794162] [INFO ] [REMOTE ] MCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:33.219956] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:19:33.236186] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:19:33.257893] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-15T19:19:33.789229] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:19:34.057956] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-15T19:19:34.857880] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-15T19:19:35.353840] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T19:19:35.657917] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-15T19:19:36.318633] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:19:36.457856] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-15T19:19:36.932487] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:19:37.046526] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:19:37.257925] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-15T19:19:38.057983] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-15T19:19:38.486043] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T19:19:38.565111] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T19:19:38.857847] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-15T19:19:39.523566] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:19:39.657867] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-15T19:19:40.457944] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-15T19:19:40.661837] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:19:41.257869] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-15T19:19:41.471512] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T19:19:42.057894] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-15T19:19:42.440812] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:19:42.857886] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-15T19:19:43.013324] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:19:43.657893] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-15T19:19:43.967752] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T19:19:44.457894] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-15T19:19:44.968143] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:19:45.257965] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-15T19:19:45.661380] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:19:45.666508] [INFO ] [REMOTE ] MCO: Full fetch complete (43634 records). [2025-09-15T19:19:45.666626] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-15T19:19:46.055147] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-15T19:19:46.055230] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-15T19:19:46.056115] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-15T19:19:46.056171] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-15T19:19:46.057166] [DEBUG] [LOCAL ] MCO: Trimmed 43634 records to 27717 (keeping 150 days of data) [2025-09-15T19:19:46.057938] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-15T19:19:46.244563] [DEBUG] [LOCAL ] MCO: Primary data saved (27717 records). [2025-09-15T19:19:46.244732] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-15T19:19:46.244848] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCO took 20.0s. Estimated remaining: 1h 51m 36s. Rate: 9.4 symbols/min [2025-09-15T19:19:46.372083] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:19:46.376418] [INFO ] [REMOTE ] MCK: Full fetch complete (43192 records). [2025-09-15T19:19:46.376533] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-15T19:19:46.746441] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-15T19:19:46.746531] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-15T19:19:46.747304] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-15T19:19:46.747349] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-15T19:19:46.748279] [DEBUG] [LOCAL ] MCK: Trimmed 43192 records to 28290 (keeping 150 days of data) [2025-09-15T19:19:46.858785] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-15T19:19:46.952130] [DEBUG] [LOCAL ] MCK: Primary data saved (28290 records). [2025-09-15T19:19:46.952271] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-15T19:19:46.952375] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCK took 33.1s. Estimated remaining: 1h 51m 25s. Rate: 9.4 symbols/min [2025-09-15T19:19:46.998709] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:19:47.534938] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T19:19:47.657922] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-15T19:19:48.457947] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-15T19:19:48.651737] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:19:49.211504] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T19:19:49.257875] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-15T19:19:50.015944] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:19:50.017432] [INFO ] [REMOTE ] MCR: Full fetch complete (9811 records). [2025-09-15T19:19:50.017502] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-15T19:19:50.080120] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-15T19:19:50.373215] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-15T19:19:50.373315] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-15T19:19:50.373595] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-15T19:19:50.373636] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-15T19:19:50.374119] [DEBUG] [LOCAL ] MCR: Trimmed 9811 records to 6518 (keeping 150 days of data) [2025-09-15T19:19:50.414800] [DEBUG] [LOCAL ] MCR: Primary data saved (6518 records). [2025-09-15T19:19:50.414914] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-15T19:19:50.415027] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCR took 21.1s. Estimated remaining: 1h 51m 17s. Rate: 9.4 symbols/min [2025-09-15T19:19:51.153106] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:19:51.159637] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-15T19:19:52.086513] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T19:19:52.092618] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-15T19:19:53.215485] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T19:19:53.221010] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-15T19:19:54.299895] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T19:19:54.306730] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-15T19:19:55.261809] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:19:55.265352] [INFO ] [REMOTE ] MCS: Full fetch complete (23342 records). [2025-09-15T19:19:55.265691] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-15T19:19:55.632029] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-15T19:19:55.632265] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-15T19:19:55.632841] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-15T19:19:55.632895] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-15T19:19:55.633720] [DEBUG] [LOCAL ] MCS: Trimmed 23342 records to 15437 (keeping 150 days of data) [2025-09-15T19:19:55.738838] [DEBUG] [LOCAL ] MCS: Primary data saved (15437 records). [2025-09-15T19:19:55.738995] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-15T19:19:55.739094] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MCS took 23.7s. Estimated remaining: 1h 51m 9s. Rate: 9.4 symbols/min [2025-09-15T19:19:56.359804] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.318033] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.402940] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.472720] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.481823] [DEBUG] [LOCAL ] MDST: Loaded 4014 existing records from primary storage. [2025-09-15T19:19:56.482252] [INFO ] [MAIN ] MDST: Loaded 4014 existing records. [2025-09-15T19:19:56.590927] [DEBUG] [LOCAL ] MCY: Loaded 17957 existing records from primary storage. [2025-09-15T19:19:56.601467] [INFO ] [MAIN ] MCY: Loaded 17957 existing records. [2025-09-15T19:19:56.776044] [DEBUG] [LOCAL ] MD: Loaded 29282 existing records from primary storage. [2025-09-15T19:19:56.809330] [INFO ] [MAIN ] MD: Loaded 29282 existing records. [2025-09-15T19:19:56.808782] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:56.951487] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:56.961139] [DEBUG] [LOCAL ] MDT: Loaded 40418 existing records from primary storage. [2025-09-15T19:19:56.951617] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-15T19:19:56.992136] [INFO ] [MAIN ] MDT: Loaded 40418 existing records. [2025-09-15T19:19:57.000893] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-15T19:19:57.001041] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.021227] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-15T19:19:57.035605] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-15T19:19:57.051613] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-15T19:19:57.051481] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-15T19:19:57.142693] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-15T19:19:57.203696] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:57.334688] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.381146] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-15T19:19:57.452550] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-15T19:19:57.490596] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-15T19:19:57.500045] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:57.643161] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.706904] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-15T19:19:57.747452] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-15T19:19:57.769453] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-15T19:19:58.345553] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.375310] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-15T19:19:58.577286] [INFO ] [REMOTE ] MDST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.615938] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-15T19:19:58.822915] [INFO ] [REMOTE ] MD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.838496] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-15T19:19:58.861637] [INFO ] [REMOTE ] MDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.862015] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-15T19:19:59.292758] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T19:19:59.296367] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-15T19:19:59.685206] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T19:19:59.687283] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-15T19:19:59.744867] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:19:59.756587] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-15T19:20:00.088336] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:20:00.089984] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-15T19:20:00.214655] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:20:00.441262] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T19:20:00.457813] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-15T19:20:00.585728] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T19:20:00.685534] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:20:01.257881] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-15T19:20:01.681690] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:20:01.955468] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T19:20:02.057884] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-15T19:20:02.857904] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-15T19:20:03.657913] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-15T19:20:03.885038] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T19:20:04.031379] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:20:04.457890] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-15T19:20:04.536273] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:20:04.979513] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:20:05.257883] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-15T19:20:06.057901] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-15T19:20:06.568942] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T19:20:06.857928] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-15T19:20:07.614893] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:20:07.657869] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-15T19:20:08.041605] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:20:08.457925] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-15T19:20:09.075343] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T19:20:09.257939] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-15T19:20:09.831903] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T19:20:09.914304] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:20:10.057891] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-15T19:20:10.857872] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-15T19:20:11.267612] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T19:20:11.657977] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-15T19:20:11.879065] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T19:20:12.223926] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:20:12.457894] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-15T19:20:13.065116] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:20:13.066559] [INFO ] [REMOTE ] MDST: Full fetch complete (5995 records). [2025-09-15T19:20:13.066629] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-15T19:20:13.263284] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-15T19:20:13.463284] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-15T19:20:13.463370] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-15T19:20:13.463560] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-15T19:20:13.463601] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-15T19:20:13.464032] [DEBUG] [LOCAL ] MDST: Trimmed 5995 records to 4046 (keeping 150 days of data) [2025-09-15T19:20:13.490862] [DEBUG] [LOCAL ] MDST: Primary data saved (4046 records). [2025-09-15T19:20:13.490967] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-15T19:20:13.491056] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDST took 17.7s. Estimated remaining: 1h 51m 12s. Rate: 9.4 symbols/min [2025-09-15T19:20:13.681538] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:13.747262] [DEBUG] [LOCAL ] MDU: Loaded 35398 existing records from primary storage. [2025-09-15T19:20:13.747581] [INFO ] [MAIN ] MDU: Loaded 35398 existing records. [2025-09-15T19:20:13.936047] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:13.936435] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-15T19:20:13.936486] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-15T19:20:13.937551] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-15T19:20:13.937607] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-15T19:20:14.062948] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-15T19:20:14.305232] [INFO ] [REMOTE ] MDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:14.387239] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:20:14.857863] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-15T19:20:15.657907] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-15T19:20:15.921193] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T19:20:15.942024] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T19:20:15.944893] [INFO ] [REMOTE ] MCY: Full fetch complete (29606 records). [2025-09-15T19:20:15.944998] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-15T19:20:16.306804] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-15T19:20:16.306887] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-15T19:20:16.307520] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-15T19:20:16.307562] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-15T19:20:16.308264] [DEBUG] [LOCAL ] MCY: Trimmed 29606 records to 17493 (keeping 150 days of data) [2025-09-15T19:20:16.419267] [DEBUG] [LOCAL ] MCY: Primary data saved (17493 records). [2025-09-15T19:20:16.419408] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-15T19:20:16.419759] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MCY took 20.7s. Estimated remaining: 1h 51m 3s. Rate: 9.4 symbols/min [2025-09-15T19:20:16.462965] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-15T19:20:16.596566] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:16.605128] [DEBUG] [LOCAL ] MDV: Loaded 6596 existing records from primary storage. [2025-09-15T19:20:16.605236] [INFO ] [MAIN ] MDV: Loaded 6596 existing records. [2025-09-15T19:20:16.779711] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:16.780082] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-15T19:20:16.780164] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-15T19:20:16.780621] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-15T19:20:16.780717] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-15T19:20:17.036915] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:20:17.178235] [INFO ] [REMOTE ] MDV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:17.257827] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-15T19:20:17.644770] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:20:17.740121] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:20:18.057887] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-15T19:20:18.857911] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-15T19:20:19.097600] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:20:19.657914] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-15T19:20:20.457927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-15T19:20:21.257931] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-15T19:20:21.371713] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T19:20:21.629466] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-15T19:20:21.990786] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-15T19:20:22.057889] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-15T19:20:22.545926] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T19:20:22.857894] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-15T19:20:23.317002] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:20:23.321592] [INFO ] [REMOTE ] MD: Full fetch complete (42172 records). [2025-09-15T19:20:23.321722] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-15T19:20:23.667022] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-15T19:20:23.707495] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-15T19:20:23.707588] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-15T19:20:23.708388] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-15T19:20:23.708435] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-15T19:20:23.709782] [DEBUG] [LOCAL ] MD: Trimmed 42172 records to 28839 (keeping 150 days of data) [2025-09-15T19:20:23.886717] [DEBUG] [LOCAL ] MD: Primary data saved (28839 records). [2025-09-15T19:20:23.886878] [INFO ] [MAIN ] MD: Full history saved. [2025-09-15T19:20:23.886978] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MD took 28.1s. Estimated remaining: 1h 50m 58s. Rate: 9.4 symbols/min [2025-09-15T19:20:24.055293] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:24.068038] [DEBUG] [LOCAL ] MEC: Loaded 12468 existing records from primary storage. [2025-09-15T19:20:24.068155] [INFO ] [MAIN ] MEC: Loaded 12468 existing records. [2025-09-15T19:20:24.245412] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:24.245685] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-15T19:20:24.245732] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-15T19:20:24.246150] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-15T19:20:24.246198] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-15T19:20:24.467750] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-15T19:20:24.647296] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:24.656480] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:20:24.662486] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T19:20:24.668747] [INFO ] [REMOTE ] MDT: Full fetch complete (58358 records). [2025-09-15T19:20:24.668890] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-15T19:20:25.074440] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-15T19:20:25.074572] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-15T19:20:25.076378] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-15T19:20:25.076452] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-15T19:20:25.078350] [DEBUG] [LOCAL ] MDT: Trimmed 58358 records to 39638 (keeping 150 days of data) [2025-09-15T19:20:25.272551] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-15T19:20:25.353955] [DEBUG] [LOCAL ] MDT: Primary data saved (39638 records). [2025-09-15T19:20:25.354243] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-15T19:20:25.354412] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MDT took 29.6s. Estimated remaining: 1h 50m 47s. Rate: 9.4 symbols/min [2025-09-15T19:20:25.539303] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:25.559298] [DEBUG] [LOCAL ] MED: Loaded 16010 existing records from primary storage. [2025-09-15T19:20:25.559476] [INFO ] [MAIN ] MED: Loaded 16010 existing records. [2025-09-15T19:20:25.741452] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:25.741944] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-15T19:20:25.742001] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-15T19:20:25.742518] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-15T19:20:25.742577] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-15T19:20:26.065320] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-15T19:20:26.106110] [INFO ] [REMOTE ] MED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:26.115439] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:20:26.169903] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:20:26.776142] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:20:26.857908] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-15T19:20:27.657884] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-15T19:20:28.133763] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:20:28.457917] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-15T19:20:28.639853] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:20:29.057944] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:20:29.257926] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-15T19:20:29.991786] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:20:30.057906] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-15T19:20:30.857930] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-15T19:20:31.048796] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:20:31.429542] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:20:31.657867] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-15T19:20:32.228357] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:20:32.229485] [INFO ] [REMOTE ] MDV: Full fetch complete (9375 records). [2025-09-15T19:20:32.229556] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-15T19:20:32.468142] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-15T19:20:32.601362] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-15T19:20:32.601542] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-15T19:20:32.601919] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-15T19:20:32.601969] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-15T19:20:32.602486] [DEBUG] [LOCAL ] MDV: Trimmed 9375 records to 6491 (keeping 150 days of data) [2025-09-15T19:20:32.644787] [DEBUG] [LOCAL ] MDV: Primary data saved (6491 records). [2025-09-15T19:20:32.644944] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-15T19:20:32.645047] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MDV took 16.2s. Estimated remaining: 1h 50m 42s. Rate: 9.4 symbols/min [2025-09-15T19:20:32.816344] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:32.816541] [DEBUG] [LOCAL ] MEG: No existing data file found in primary storage. [2025-09-15T19:20:32.816579] [WARN ] [MAIN ] MEG: No existing data found, performing full refresh instead. [2025-09-15T19:20:32.816734] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-15T19:20:32.816781] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-15T19:20:32.816826] [DEBUG] [LOCAL ] MEG: No primary data file found to delete. [2025-09-15T19:20:32.816861] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-15T19:20:33.183277] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:33.193420] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T19:20:33.257873] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-15T19:20:34.057932] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-15T19:20:34.285497] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:20:34.857942] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-15T19:20:35.511699] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:20:35.609842] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T19:20:35.657912] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-15T19:20:36.457933] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-15T19:20:36.540098] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:20:37.257943] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-15T19:20:38.057930] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-15T19:20:38.832130] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-15T19:20:38.857875] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-15T19:20:38.933596] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T19:20:39.022000] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:20:39.657891] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-15T19:20:40.295038] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:20:40.457905] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-15T19:20:40.573894] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:20:41.257901] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-15T19:20:41.821925] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:20:42.057871] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-15T19:20:42.577223] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:20:42.585680] [INFO ] [REMOTE ] MDU: Full fetch complete (52251 records). [2025-09-15T19:20:42.585910] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-15T19:20:42.865105] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-15T19:20:43.011472] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-15T19:20:43.011613] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-15T19:20:43.013186] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-15T19:20:43.013260] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-15T19:20:43.015001] [DEBUG] [LOCAL ] MDU: Trimmed 52251 records to 34744 (keeping 150 days of data) [2025-09-15T19:20:43.271882] [DEBUG] [LOCAL ] MDU: Primary data saved (34744 records). [2025-09-15T19:20:43.272189] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-15T19:20:43.272310] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MDU took 29.8s. Estimated remaining: 1h 50m 39s. Rate: 9.4 symbols/min [2025-09-15T19:20:43.457588] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:43.483662] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:20:43.508050] [DEBUG] [LOCAL ] MEGI: Loaded 14929 existing records from primary storage. [2025-09-15T19:20:43.508277] [INFO ] [MAIN ] MEGI: Loaded 14929 existing records. [2025-09-15T19:20:43.662845] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-15T19:20:43.698729] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:43.699096] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-15T19:20:43.699276] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-15T19:20:43.705154] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-15T19:20:43.714634] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-15T19:20:43.728813] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:20:44.076978] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:44.457927] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-15T19:20:44.803416] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:20:45.257855] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-15T19:20:45.411155] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:20:46.057940] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-15T19:20:46.272458] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T19:20:46.857928] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-15T19:20:47.657961] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-15T19:20:47.958535] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:20:48.457891] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-15T19:20:48.611910] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:20:49.257846] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-15T19:20:49.548148] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:20:50.049725] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (3.99 seconds). [2025-09-15T19:20:50.051790] [INFO ] [REMOTE ] MEC: Full fetch complete (17463 records). [2025-09-15T19:20:50.051863] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-15T19:20:50.063032] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-15T19:20:50.345597] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:20:50.454156] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-15T19:20:50.454276] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-15T19:20:50.454800] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-15T19:20:50.454851] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-15T19:20:50.455504] [DEBUG] [LOCAL ] MEC: Trimmed 17463 records to 12261 (keeping 150 days of data) [2025-09-15T19:20:50.537830] [DEBUG] [LOCAL ] MEC: Primary data saved (12261 records). [2025-09-15T19:20:50.538223] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-15T19:20:50.538399] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEC took 26.7s. Estimated remaining: 1h 50m 33s. Rate: 9.4 symbols/min [2025-09-15T19:20:50.711146] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:50.732790] [DEBUG] [LOCAL ] MEI: Loaded 23507 existing records from primary storage. [2025-09-15T19:20:50.732948] [INFO ] [MAIN ] MEI: Loaded 23507 existing records. [2025-09-15T19:20:50.873441] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-15T19:20:50.913490] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:50.913847] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-15T19:20:50.913897] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-15T19:20:50.914666] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-15T19:20:50.914732] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-15T19:20:51.279077] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:51.459459] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:20:51.657840] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-15T19:20:52.021666] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:20:52.457935] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-15T19:20:52.935886] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:20:53.257866] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-15T19:20:53.606633] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T19:20:54.057876] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-15T19:20:54.526854] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T19:20:54.531542] [INFO ] [REMOTE ] MEG: Full fetch complete (34846 records). [2025-09-15T19:20:54.531685] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-15T19:20:54.863109] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-15T19:20:54.913715] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-15T19:20:54.913816] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-15T19:20:54.914878] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-15T19:20:54.914959] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-15T19:20:54.916519] [DEBUG] [LOCAL ] MEG: Trimmed 34846 records to 22278 (keeping 150 days of data) [2025-09-15T19:20:55.056659] [DEBUG] [LOCAL ] MEG: Primary data saved (22278 records). [2025-09-15T19:20:55.056827] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-15T19:20:55.056910] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MEG took 22.4s. Estimated remaining: 1h 50m 25s. Rate: 9.4 symbols/min [2025-09-15T19:20:55.232455] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:55.273569] [DEBUG] [LOCAL ] MET: Loaded 40097 existing records from primary storage. [2025-09-15T19:20:55.273742] [INFO ] [MAIN ] MET: Loaded 40097 existing records. [2025-09-15T19:20:55.477033] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:20:55.475044] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:55.485679] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-15T19:20:55.485756] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-15T19:20:55.487160] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-15T19:20:55.487219] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-15T19:20:55.662101] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-15T19:20:55.853629] [INFO ] [REMOTE ] MET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:55.865501] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:20:56.457899] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-15T19:20:57.242848] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:20:57.257826] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-15T19:20:57.771092] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:20:58.057861] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-15T19:20:58.463109] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T19:20:58.857917] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-15T19:20:59.662946] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-15T19:20:59.682703] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:20:59.759879] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T19:21:00.457829] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-15T19:21:00.608554] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:21:01.257871] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-15T19:21:01.493395] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:21:02.057928] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-15T19:21:02.777834] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:21:02.857884] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-15T19:21:03.559508] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:21:03.657889] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-15T19:21:03.957488] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T19:21:04.457893] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-15T19:21:04.714143] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T19:21:05.257874] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-15T19:21:06.021713] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:21:06.057822] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-15T19:21:06.525697] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T19:21:06.529852] [INFO ] [REMOTE ] MEI: Full fetch complete (34663 records). [2025-09-15T19:21:06.529939] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-15T19:21:06.866390] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-15T19:21:06.907563] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-15T19:21:06.907679] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-15T19:21:06.908529] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-15T19:21:06.908574] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-15T19:21:06.909492] [DEBUG] [LOCAL ] MEI: Trimmed 34663 records to 23106 (keeping 150 days of data) [2025-09-15T19:21:07.043961] [DEBUG] [LOCAL ] MEI: Primary data saved (23106 records). [2025-09-15T19:21:07.044094] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-15T19:21:07.044201] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MEI took 16.5s. Estimated remaining: 1h 50m 23s. Rate: 9.4 symbols/min [2025-09-15T19:21:07.218068] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:07.250122] [DEBUG] [LOCAL ] MFA: Loaded 33621 existing records from primary storage. [2025-09-15T19:21:07.250250] [INFO ] [MAIN ] MFA: Loaded 33621 existing records. [2025-09-15T19:21:07.451950] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:07.452376] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-15T19:21:07.452479] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-15T19:21:07.453359] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-15T19:21:07.453417] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-15T19:21:07.676145] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-15T19:21:07.788029] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:21:07.876243] [INFO ] [REMOTE ] MFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:07.904053] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:21:07.906460] [INFO ] [REMOTE ] MEGI: Full fetch complete (21983 records). [2025-09-15T19:21:07.906547] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-15T19:21:08.275022] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-15T19:21:08.275114] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-15T19:21:08.275717] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-15T19:21:08.275762] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-15T19:21:08.276431] [DEBUG] [LOCAL ] MEGI: Trimmed 21983 records to 14795 (keeping 150 days of data) [2025-09-15T19:21:08.368693] [DEBUG] [LOCAL ] MEGI: Primary data saved (14795 records). [2025-09-15T19:21:08.368854] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-15T19:21:08.368961] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MEGI took 25.1s. Estimated remaining: 1h 50m 13s. Rate: 9.4 symbols/min [2025-09-15T19:21:08.466730] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-15T19:21:08.540280] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:08.544956] [DEBUG] [LOCAL ] MFAN: Loaded 3076 existing records from primary storage. [2025-09-15T19:21:08.545042] [INFO ] [MAIN ] MFAN: Loaded 3076 existing records. [2025-09-15T19:21:08.723051] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:08.723499] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-15T19:21:08.723560] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-15T19:21:08.729607] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:21:08.729658] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-15T19:21:08.731898] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-15T19:21:08.763532] [INFO ] [REMOTE ] MED: Full fetch complete (24462 records). [2025-09-15T19:21:08.800833] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-15T19:21:09.261034] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-15T19:21:09.409957] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:09.494985] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-15T19:21:09.495074] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-15T19:21:09.495657] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-15T19:21:09.495702] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-15T19:21:09.496472] [DEBUG] [LOCAL ] MED: Trimmed 24462 records to 15589 (keeping 150 days of data) [2025-09-15T19:21:09.594444] [DEBUG] [LOCAL ] MED: Primary data saved (15589 records). [2025-09-15T19:21:09.594609] [INFO ] [MAIN ] MED: Full history saved. [2025-09-15T19:21:09.594745] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MED took 44.2s. Estimated remaining: 1h 50m 3s. Rate: 9.4 symbols/min [2025-09-15T19:21:09.774815] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:09.779328] [DEBUG] [LOCAL ] MFAO: Loaded 2960 existing records from primary storage. [2025-09-15T19:21:09.779409] [INFO ] [MAIN ] MFAO: Loaded 2960 existing records. [2025-09-15T19:21:09.958666] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:09.958918] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-15T19:21:09.958967] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-15T19:21:09.959191] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-15T19:21:09.959239] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-15T19:21:10.062092] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-15T19:21:10.325928] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:10.857949] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-15T19:21:11.021121] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-15T19:21:11.657938] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-15T19:21:11.902130] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:21:11.996041] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T19:21:12.457873] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-15T19:21:12.565543] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-15T19:21:12.769713] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T19:21:13.126111] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:21:13.257875] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-15T19:21:14.057869] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-15T19:21:14.857856] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-15T19:21:14.931475] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T19:21:15.426824] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T19:21:15.429486] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T19:21:15.657878] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-15T19:21:16.036817] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T19:21:16.457873] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-15T19:21:16.913009] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:21:17.257873] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-15T19:21:17.907458] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T19:21:18.057866] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-15T19:21:18.857873] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-15T19:21:19.657892] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-15T19:21:19.707224] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:21:20.065794] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T19:21:20.071664] [INFO ] [REMOTE ] MET: Full fetch complete (57955 records). [2025-09-15T19:21:20.071807] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-15T19:21:20.179128] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T19:21:20.460429] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-15T19:21:20.460782] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-15T19:21:20.461720] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-15T19:21:20.462677] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-15T19:21:20.462731] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-15T19:21:20.464006] [DEBUG] [LOCAL ] MET: Trimmed 57955 records to 39323 (keeping 150 days of data) [2025-09-15T19:21:20.716442] [DEBUG] [LOCAL ] MET: Primary data saved (39323 records). [2025-09-15T19:21:20.716587] [INFO ] [MAIN ] MET: Full history saved. [2025-09-15T19:21:20.717340] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MET took 25.7s. Estimated remaining: 1h 49m 60s. Rate: 9.4 symbols/min [2025-09-15T19:21:20.884628] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:20.923062] [DEBUG] [LOCAL ] MFC: Loaded 38397 existing records from primary storage. [2025-09-15T19:21:20.923232] [INFO ] [MAIN ] MFC: Loaded 38397 existing records. [2025-09-15T19:21:21.120564] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:21.120980] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-15T19:21:21.121036] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-15T19:21:21.122358] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-15T19:21:21.122617] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-15T19:21:21.269963] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-15T19:21:21.496350] [INFO ] [REMOTE ] MFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:21.818152] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:21:21.834455] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:21:22.057878] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-15T19:21:22.857893] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-15T19:21:23.287625] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T19:21:23.453710] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:21:23.657922] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-15T19:21:24.457897] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-15T19:21:25.180036] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:21:25.257862] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-15T19:21:26.057888] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-15T19:21:26.104486] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:21:26.524870] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T19:21:26.857872] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-15T19:21:27.013768] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:21:27.381432] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:21:27.657882] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-15T19:21:28.245472] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:21:28.457914] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-15T19:21:28.809626] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-15T19:21:29.257893] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-15T19:21:30.057883] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-15T19:21:30.670841] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:21:30.671888] [INFO ] [REMOTE ] MFAN: Full fetch complete (4537 records). [2025-09-15T19:21:30.671957] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-15T19:21:30.867933] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-15T19:21:31.031165] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-15T19:21:31.031341] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-15T19:21:31.031513] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-15T19:21:31.031565] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-15T19:21:31.032090] [DEBUG] [LOCAL ] MFAN: Trimmed 4537 records to 3011 (keeping 150 days of data) [2025-09-15T19:21:31.051434] [DEBUG] [LOCAL ] MFAN: Primary data saved (3011 records). [2025-09-15T19:21:31.051592] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-15T19:21:31.051713] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFAN took 22.7s. Estimated remaining: 1h 49m 57s. Rate: 9.4 symbols/min [2025-09-15T19:21:31.210168] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T19:21:31.277196] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:31.312842] [DEBUG] [LOCAL ] MFG: Loaded 37293 existing records from primary storage. [2025-09-15T19:21:31.313013] [INFO ] [MAIN ] MFG: Loaded 37293 existing records. [2025-09-15T19:21:31.498578] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:31.498920] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-15T19:21:31.499015] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-15T19:21:31.499866] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-15T19:21:31.499930] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-15T19:21:31.663391] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-15T19:21:31.878061] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:32.311470] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:21:32.457830] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-15T19:21:33.032702] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:21:33.257939] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-15T19:21:33.918760] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:21:33.919842] [INFO ] [REMOTE ] MFAO: Full fetch complete (4186 records). [2025-09-15T19:21:33.919929] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-15T19:21:34.075310] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-15T19:21:34.160909] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:21:34.226045] [INFO ] [REMOTE ] MFA: Full fetch complete (48952 records). [2025-09-15T19:21:34.232074] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-15T19:21:34.424198] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-15T19:21:34.424352] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-15T19:21:34.425136] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-15T19:21:34.440742] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-15T19:21:34.485874] [DEBUG] [LOCAL ] MFAO: Trimmed 4186 records to 2818 (keeping 150 days of data) [2025-09-15T19:21:34.665317] [DEBUG] [LOCAL ] MFAO: Primary data saved (2818 records). [2025-09-15T19:21:34.695278] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-15T19:21:34.706593] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFAO took 25.1s. Estimated remaining: 1h 49m 48s. Rate: 9.4 symbols/min [2025-09-15T19:21:34.846779] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-15T19:21:34.849407] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-15T19:21:34.851138] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-15T19:21:34.856660] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-15T19:21:34.861913] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-15T19:21:34.922666] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:34.923308] [DEBUG] [LOCAL ] MFA: Trimmed 48952 records to 32905 (keeping 150 days of data) [2025-09-15T19:21:35.030997] [DEBUG] [LOCAL ] MFM: Loaded 10158 existing records from primary storage. [2025-09-15T19:21:35.035149] [INFO ] [MAIN ] MFM: Loaded 10158 existing records. [2025-09-15T19:21:35.234896] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:35.235189] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-15T19:21:35.235240] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-15T19:21:35.267270] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-15T19:21:35.273470] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-15T19:21:35.662605] [INFO ] [REMOTE ] MFM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:35.665095] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-15T19:21:35.672941] [DEBUG] [LOCAL ] MFA: Primary data saved (32905 records). [2025-09-15T19:21:35.673077] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-15T19:21:35.673167] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFA took 28.6s. Estimated remaining: 1h 49m 38s. Rate: 9.4 symbols/min [2025-09-15T19:21:35.846857] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:35.847074] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-15T19:21:35.847189] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-15T19:21:35.847353] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-15T19:21:35.847402] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-15T19:21:35.847514] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-15T19:21:35.847559] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-15T19:21:36.005840] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:21:36.247010] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:36.459763] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-15T19:21:36.464545] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:21:36.484132] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:21:37.257872] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-15T19:21:37.748382] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:21:38.057943] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-15T19:21:38.826685] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:21:38.857827] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-15T19:21:39.360668] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:21:39.366331] [INFO ] [REMOTE ] MFC: Full fetch complete (55967 records). [2025-09-15T19:21:39.366451] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-15T19:21:39.659778] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-15T19:21:39.751993] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-15T19:21:39.752082] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-15T19:21:39.753030] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-15T19:21:39.753076] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-15T19:21:39.754429] [DEBUG] [LOCAL ] MFC: Trimmed 55967 records to 37624 (keeping 150 days of data) [2025-09-15T19:21:39.986290] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-15T19:21:40.025312] [DEBUG] [LOCAL ] MFC: Primary data saved (37624 records). [2025-09-15T19:21:40.025476] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-15T19:21:40.026138] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFC took 19.3s. Estimated remaining: 1h 49m 30s. Rate: 9.4 symbols/min [2025-09-15T19:21:40.212312] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:40.220749] [DEBUG] [LOCAL ] MFSG: Loaded 3948 existing records from primary storage. [2025-09-15T19:21:40.220890] [INFO ] [MAIN ] MFSG: Loaded 3948 existing records. [2025-09-15T19:21:40.431934] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:40.432231] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-15T19:21:40.432347] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-15T19:21:40.432603] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-15T19:21:40.432700] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-15T19:21:40.469125] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-15T19:21:40.882628] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T19:21:40.922190] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-15T19:21:41.071180] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:41.257938] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-15T19:21:41.676883] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:21:42.057934] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-15T19:21:42.826521] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:21:42.857877] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-15T19:21:43.657880] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-15T19:21:44.457858] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-15T19:21:44.599715] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:21:44.756804] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T19:21:44.822594] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T19:21:45.257871] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-15T19:21:45.622325] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T19:21:46.057892] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-15T19:21:46.857896] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-15T19:21:47.439515] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:21:47.467794] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:21:47.657905] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-15T19:21:48.457922] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-15T19:21:48.485521] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:21:48.839301] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T19:21:49.257895] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-15T19:21:49.525808] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-15T19:21:50.057911] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-15T19:21:50.857900] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-15T19:21:51.177066] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T19:21:51.657904] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-15T19:21:51.704200] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:21:52.136582] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T19:21:52.457876] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-15T19:21:53.257912] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-15T19:21:53.913627] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:21:53.996251] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:21:54.057841] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-15T19:21:54.857896] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-15T19:21:55.110717] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-15T19:21:55.389905] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:21:55.399044] [INFO ] [REMOTE ] MFG: Full fetch complete (52780 records). [2025-09-15T19:21:55.399325] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-15T19:21:55.663099] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-15T19:21:55.809130] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-15T19:21:55.809288] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-15T19:21:55.810247] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-15T19:21:55.810296] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-15T19:21:55.813071] [DEBUG] [LOCAL ] MFG: Trimmed 52780 records to 36559 (keeping 150 days of data) [2025-09-15T19:21:56.034051] [DEBUG] [LOCAL ] MFG: Primary data saved (36559 records). [2025-09-15T19:21:56.034232] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-15T19:21:56.034360] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFG took 25.0s. Estimated remaining: 1h 49m 31s. Rate: 9.4 symbols/min [2025-09-15T19:21:56.206609] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:56.217119] [DEBUG] [LOCAL ] MFSI: Loaded 8941 existing records from primary storage. [2025-09-15T19:21:56.217233] [INFO ] [MAIN ] MFSI: Loaded 8941 existing records. [2025-09-15T19:21:56.413240] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:56.413571] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-15T19:21:56.413623] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-15T19:21:56.414048] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-15T19:21:56.414097] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-15T19:21:56.462955] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-15T19:21:56.693716] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T19:21:56.809886] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:57.085598] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T19:21:57.258070] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-15T19:21:57.774903] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T19:21:58.057879] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-15T19:21:58.600272] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T19:21:58.857906] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-15T19:21:59.456445] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:21:59.457398] [INFO ] [REMOTE ] MFSB: Full fetch complete (1100 records). [2025-09-15T19:21:59.457470] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-15T19:21:59.635390] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 132 unique days, need 150 days [2025-09-15T19:21:59.635564] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:21:59.635631] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:21:59.635699] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-15T19:21:59.635763] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-15T19:21:59.635839] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-15T19:21:59.635895] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-15T19:21:59.635978] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFSB took 24.0s. Estimated remaining: 1h 49m 22s. Rate: 9.4 symbols/min [2025-09-15T19:21:59.665818] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-15T19:21:59.813405] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:59.817547] [DEBUG] [LOCAL ] MFSV: Loaded 1655 existing records from primary storage. [2025-09-15T19:21:59.817691] [INFO ] [MAIN ] MFSV: Loaded 1655 existing records. [2025-09-15T19:21:59.996835] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:59.997110] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-15T19:21:59.997156] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-15T19:21:59.997355] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-15T19:21:59.997400] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-15T19:22:00.365913] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:00.428896] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:22:00.430269] [INFO ] [REMOTE ] MFSG: Full fetch complete (4893 records). [2025-09-15T19:22:00.430345] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-15T19:22:00.462964] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-15T19:22:00.797401] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-15T19:22:00.797505] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-15T19:22:00.797676] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-15T19:22:00.797726] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-15T19:22:00.798126] [DEBUG] [LOCAL ] MFSG: Trimmed 4893 records to 3906 (keeping 150 days of data) [2025-09-15T19:22:00.822219] [DEBUG] [LOCAL ] MFSG: Primary data saved (3906 records). [2025-09-15T19:22:00.822303] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-15T19:22:00.822392] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSG took 20.8s. Estimated remaining: 1h 49m 12s. Rate: 9.4 symbols/min [2025-09-15T19:22:00.998825] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:01.013440] [DEBUG] [LOCAL ] MG: Loaded 11650 existing records from primary storage. [2025-09-15T19:22:01.013577] [INFO ] [MAIN ] MG: Loaded 11650 existing records. [2025-09-15T19:22:01.191538] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:01.191833] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-15T19:22:01.191894] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-15T19:22:01.192241] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-15T19:22:01.192285] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-15T19:22:01.266166] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-15T19:22:01.486213] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:22:01.565884] [INFO ] [REMOTE ] MG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:01.673161] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T19:22:02.057905] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-15T19:22:02.423211] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T19:22:02.857864] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-15T19:22:03.316812] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T19:22:03.657873] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-15T19:22:04.062920] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T19:22:04.457901] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-15T19:22:04.762328] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T19:22:05.257861] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-15T19:22:06.057888] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-15T19:22:06.153707] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:22:06.155776] [INFO ] [REMOTE ] MFM: Full fetch complete (15242 records). [2025-09-15T19:22:06.155848] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-15T19:22:06.556767] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-15T19:22:06.556885] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-15T19:22:06.557275] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-15T19:22:06.557328] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-15T19:22:06.557972] [DEBUG] [LOCAL ] MFM: Trimmed 15242 records to 9588 (keeping 150 days of data) [2025-09-15T19:22:06.588257] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:06.625073] [DEBUG] [LOCAL ] MFM: Primary data saved (9588 records). [2025-09-15T19:22:06.625232] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-15T19:22:06.625363] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MFM took 31.9s. Estimated remaining: 1h 49m 5s. Rate: 9.4 symbols/min [2025-09-15T19:22:06.802475] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:06.846980] [DEBUG] [LOCAL ] MGA: Loaded 37796 existing records from primary storage. [2025-09-15T19:22:06.847130] [INFO ] [MAIN ] MGA: Loaded 37796 existing records. [2025-09-15T19:22:06.867752] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-15T19:22:07.033793] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:07.034138] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-15T19:22:07.034213] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-15T19:22:07.035354] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-15T19:22:07.035416] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-15T19:22:07.367090] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T19:22:07.400515] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:07.657871] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-15T19:22:08.456868] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:22:08.459860] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-15T19:22:09.257881] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-15T19:22:09.508596] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:22:09.845783] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:22:10.057871] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-15T19:22:10.738194] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:22:10.857869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-15T19:22:11.657866] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-15T19:22:11.905381] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T19:22:12.457878] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-15T19:22:12.845601] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:22:12.886720] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:22:13.257875] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-15T19:22:13.987982] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T19:22:14.057868] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-15T19:22:14.857869] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-15T19:22:15.058988] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:22:15.657875] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-15T19:22:15.687276] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:22:16.457875] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-15T19:22:16.632434] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T19:22:17.257865] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-15T19:22:18.032533] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:22:18.053779] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:22:18.057808] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-15T19:22:18.857874] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-15T19:22:18.970422] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:22:18.986893] [DEBUG] [REMOTE ] MGA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-15T19:22:18.987367] [WARN ] [REMOTE ] MGA: No data returned for month 2025-04 [2025-09-15T19:22:19.657887] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-15T19:22:20.458052] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-15T19:22:20.560755] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:22:20.562658] [INFO ] [REMOTE ] MG: Full fetch complete (18035 records). [2025-09-15T19:22:20.562728] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-15T19:22:20.956836] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-15T19:22:20.956916] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-15T19:22:20.957375] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-15T19:22:20.957427] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-15T19:22:20.958105] [DEBUG] [LOCAL ] MG: Trimmed 18035 records to 11429 (keeping 150 days of data) [2025-09-15T19:22:21.032845] [DEBUG] [LOCAL ] MG: Primary data saved (11429 records). [2025-09-15T19:22:21.032991] [INFO ] [MAIN ] MG: Full history saved. [2025-09-15T19:22:21.033101] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MG took 20.2s. Estimated remaining: 1h 49m 5s. Rate: 9.4 symbols/min [2025-09-15T19:22:21.213837] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:21.224124] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:22:21.234112] [DEBUG] [LOCAL ] MGF: Loaded 3212 existing records from primary storage. [2025-09-15T19:22:21.234285] [INFO ] [MAIN ] MGF: Loaded 3212 existing records. [2025-09-15T19:22:21.264560] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-15T19:22:21.422543] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:21.422819] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-15T19:22:21.422885] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-15T19:22:21.423152] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-15T19:22:21.423199] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-15T19:22:21.809405] [INFO ] [REMOTE ] MGF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:22.057937] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-15T19:22:22.486319] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:22:22.869836] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-15T19:22:22.877476] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T19:22:23.645457] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:22:23.657813] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-15T19:22:24.292042] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T19:22:24.294226] [INFO ] [REMOTE ] MFSI: Full fetch complete (10875 records). [2025-09-15T19:22:24.294298] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-15T19:22:24.469248] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-15T19:22:24.655972] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-15T19:22:24.656050] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-15T19:22:24.656334] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-15T19:22:24.656373] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-15T19:22:24.656888] [DEBUG] [LOCAL ] MFSI: Trimmed 10875 records to 8872 (keeping 150 days of data) [2025-09-15T19:22:24.713497] [DEBUG] [LOCAL ] MFSI: Primary data saved (8872 records). [2025-09-15T19:22:24.713636] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-15T19:22:24.713739] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MFSI took 28.7s. Estimated remaining: 1h 48m 57s. Rate: 9.4 symbols/min [2025-09-15T19:22:24.888821] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:24.930310] [DEBUG] [LOCAL ] MGM: Loaded 40354 existing records from primary storage. [2025-09-15T19:22:24.930457] [INFO ] [MAIN ] MGM: Loaded 40354 existing records. [2025-09-15T19:22:25.109944] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:25.110241] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-15T19:22:25.110292] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-15T19:22:25.111325] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-15T19:22:25.111387] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-15T19:22:25.264621] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-15T19:22:25.479892] [INFO ] [REMOTE ] MGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:25.862836] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:22:25.863937] [INFO ] [REMOTE ] MFSV: Full fetch complete (2369 records). [2025-09-15T19:22:25.864009] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-15T19:22:26.065065] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-15T19:22:26.231833] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-15T19:22:26.232026] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-15T19:22:26.232143] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-15T19:22:26.232195] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-15T19:22:26.232575] [DEBUG] [LOCAL ] MFSV: Trimmed 2369 records to 1681 (keeping 150 days of data) [2025-09-15T19:22:26.269733] [DEBUG] [LOCAL ] MFSV: Primary data saved (1681 records). [2025-09-15T19:22:26.270104] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-15T19:22:26.270460] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MFSV took 26.6s. Estimated remaining: 1h 48m 46s. Rate: 9.4 symbols/min [2025-09-15T19:22:26.271368] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T19:22:26.453976] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:26.462473] [DEBUG] [LOCAL ] MGR: Loaded 4180 existing records from primary storage. [2025-09-15T19:22:26.462610] [INFO ] [MAIN ] MGR: Loaded 4180 existing records. [2025-09-15T19:22:26.639388] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:26.639668] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-15T19:22:26.639717] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-15T19:22:26.639964] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-15T19:22:26.640008] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-15T19:22:26.757470] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T19:22:26.862956] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-15T19:22:27.005139] [INFO ] [REMOTE ] MGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:27.657879] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-15T19:22:28.458752] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-15T19:22:28.468134] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:22:28.879199] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:22:29.065798] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:22:29.257882] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-15T19:22:30.057883] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-15T19:22:30.857886] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-15T19:22:31.057028] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:22:31.258403] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T19:22:31.588450] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:22:31.657907] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-15T19:22:32.457880] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-15T19:22:32.992406] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:33.257918] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-15T19:22:33.600835] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T19:22:33.708253] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T19:22:34.057935] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-15T19:22:34.684403] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:22:34.857920] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-15T19:22:35.657904] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-15T19:22:36.457889] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-15T19:22:36.589255] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:22:36.595622] [INFO ] [REMOTE ] MGA: Full fetch complete (47161 records). [2025-09-15T19:22:36.595866] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-15T19:22:36.798899] [WARN ] [VALIDATOR ] MGA: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T19:22:36.799607] [FATAL] [MAIN ] MGA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:22:36.799699] [WARN ] [MAIN ] MGA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:22:36.799775] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-15T19:22:36.799843] [DEBUG] [LOCAL ] MGA: No primary data file found to delete. [2025-09-15T19:22:36.799883] [INFO ] [LOCAL ] MGA: Starting deletion of derivative data. [2025-09-15T19:22:36.800242] [DEBUG] [LOCAL ] MGA: Deleted derivative data file. [2025-09-15T19:22:36.801612] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGA took 30.2s. Estimated remaining: 1h 48m 43s. Rate: 9.4 symbols/min [2025-09-15T19:22:36.983054] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:36.990855] [DEBUG] [LOCAL ] MGRB: Loaded 3220 existing records from primary storage. [2025-09-15T19:22:36.990980] [INFO ] [MAIN ] MGRB: Loaded 3220 existing records. [2025-09-15T19:22:37.177706] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:37.183942] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-15T19:22:37.183858] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:22:37.184046] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-15T19:22:37.186965] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-15T19:22:37.187069] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-15T19:22:37.263236] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-15T19:22:37.575109] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:37.599907] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T19:22:37.990497] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:22:37.992018] [INFO ] [REMOTE ] MGF: Full fetch complete (4461 records). [2025-09-15T19:22:37.992097] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-15T19:22:38.064030] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-15T19:22:38.364746] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-15T19:22:38.364827] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-15T19:22:38.364980] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-15T19:22:38.365021] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-15T19:22:38.365409] [DEBUG] [LOCAL ] MGF: Trimmed 4461 records to 3170 (keeping 150 days of data) [2025-09-15T19:22:38.384571] [DEBUG] [LOCAL ] MGF: Primary data saved (3170 records). [2025-09-15T19:22:38.384732] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-15T19:22:38.384831] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGF took 17.4s. Estimated remaining: 1h 48m 33s. Rate: 9.4 symbols/min [2025-09-15T19:22:38.554705] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:38.558101] [DEBUG] [LOCAL ] MGRD: Loaded 1695 existing records from primary storage. [2025-09-15T19:22:38.558192] [INFO ] [MAIN ] MGRD: Loaded 1695 existing records. [2025-09-15T19:22:38.748921] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:38.749160] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-15T19:22:38.749205] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-15T19:22:38.749405] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-15T19:22:38.749450] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-15T19:22:38.863002] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-15T19:22:39.109463] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:39.403731] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T19:22:39.657915] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-15T19:22:39.819049] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T19:22:40.080358] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:22:40.457885] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-15T19:22:41.257913] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-15T19:22:41.790315] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:22:42.057880] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-15T19:22:42.352099] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T19:22:42.426313] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T19:22:42.857870] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-15T19:22:43.398506] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T19:22:43.657888] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-15T19:22:44.457905] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-15T19:22:44.861533] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:22:45.257889] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-15T19:22:45.346142] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:22:45.849513] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:22:46.057881] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-15T19:22:46.673083] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:22:46.857888] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-15T19:22:47.409615] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:22:47.657886] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-15T19:22:48.081453] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:22:48.457902] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-15T19:22:48.995077] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T19:22:49.257860] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-15T19:22:49.695845] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T19:22:50.057881] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-15T19:22:50.467430] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:22:50.857904] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-15T19:22:51.345742] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T19:22:51.657890] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-15T19:22:52.222748] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:22:52.457889] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-15T19:22:52.890729] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T19:22:53.257895] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-15T19:22:53.707849] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:22:54.057879] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-15T19:22:54.522547] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T19:22:54.857886] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-15T19:22:55.402937] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:22:55.403845] [INFO ] [REMOTE ] MGRB: Full fetch complete (4551 records). [2025-09-15T19:22:55.403915] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-15T19:22:55.663079] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-15T19:22:55.768668] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-15T19:22:55.768756] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-15T19:22:55.768940] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-15T19:22:55.768982] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-15T19:22:55.769350] [DEBUG] [LOCAL ] MGRB: Trimmed 4551 records to 3036 (keeping 150 days of data) [2025-09-15T19:22:55.788284] [DEBUG] [LOCAL ] MGRB: Primary data saved (3036 records). [2025-09-15T19:22:55.788351] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-15T19:22:55.788425] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MGRB took 19.0s. Estimated remaining: 1h 48m 35s. Rate: 9.4 symbols/min [2025-09-15T19:22:55.955832] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:55.963294] [DEBUG] [LOCAL ] MGRE: Loaded 4935 existing records from primary storage. [2025-09-15T19:22:55.963430] [INFO ] [MAIN ] MGRE: Loaded 4935 existing records. [2025-09-15T19:22:56.148403] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:56.148834] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-15T19:22:56.148888] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-15T19:22:56.149320] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-15T19:22:56.149371] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-15T19:22:56.401555] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:22:56.462971] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-15T19:22:56.522250] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:56.882379] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T19:22:57.257898] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-15T19:22:57.787305] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:58.057936] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-15T19:22:58.857880] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-15T19:22:59.657914] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-15T19:23:00.457969] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-15T19:23:00.999231] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T19:23:01.000376] [INFO ] [REMOTE ] MGR: Full fetch complete (6008 records). [2025-09-15T19:23:01.000448] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-15T19:23:01.431635] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-15T19:23:01.431743] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-15T19:23:01.431991] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-15T19:23:01.432031] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-15T19:23:01.432464] [DEBUG] [LOCAL ] MGR: Trimmed 6008 records to 4099 (keeping 150 days of data) [2025-09-15T19:23:01.458708] [DEBUG] [LOCAL ] MGR: Primary data saved (4099 records). [2025-09-15T19:23:01.458836] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-15T19:23:01.458954] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGR took 35.2s. Estimated remaining: 1h 48m 28s. Rate: 9.4 symbols/min [2025-09-15T19:23:01.630515] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:01.672098] [DEBUG] [LOCAL ] MGY: Loaded 39371 existing records from primary storage. [2025-09-15T19:23:01.672272] [INFO ] [MAIN ] MGY: Loaded 39371 existing records. [2025-09-15T19:23:01.851901] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:01.852150] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-15T19:23:01.852196] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-15T19:23:01.853156] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-15T19:23:01.853209] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-15T19:23:02.226944] [INFO ] [REMOTE ] MGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:02.227606] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-15T19:23:03.878438] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (4.22 seconds). [2025-09-15T19:23:03.880286] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-15T19:23:04.148214] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (5.29 seconds). [2025-09-15T19:23:04.149049] [INFO ] [REMOTE ] MGRD: Full fetch complete (2511 records). [2025-09-15T19:23:04.149117] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-15T19:23:04.518463] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-15T19:23:04.518854] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-15T19:23:04.519008] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-15T19:23:04.518785] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T19:23:04.520924] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-15T19:23:04.521506] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-15T19:23:04.522110] [DEBUG] [LOCAL ] MGRD: Trimmed 2511 records to 1640 (keeping 150 days of data) [2025-09-15T19:23:04.534476] [DEBUG] [LOCAL ] MGRD: Primary data saved (1640 records). [2025-09-15T19:23:04.534537] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-15T19:23:04.534619] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGRD took 26.1s. Estimated remaining: 1h 48m 20s. Rate: 9.4 symbols/min [2025-09-15T19:23:04.706862] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:04.707076] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-15T19:23:04.707118] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-15T19:23:04.707277] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-15T19:23:04.707320] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-15T19:23:04.707363] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-15T19:23:04.707397] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-15T19:23:05.077577] [INFO ] [REMOTE ] MH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:05.078033] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-15T19:23:05.102494] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (7.04 seconds). [2025-09-15T19:23:05.109324] [INFO ] [REMOTE ] MGM: Full fetch complete (58281 records). [2025-09-15T19:23:05.109503] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-15T19:23:05.334615] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:05.354790] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-15T19:23:05.360758] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-15T19:23:05.424967] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T19:23:05.437327] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-15T19:23:05.528187] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-15T19:23:05.528343] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-15T19:23:05.529440] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-15T19:23:05.529512] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-15T19:23:05.541747] [DEBUG] [LOCAL ] MGM: Trimmed 58281 records to 39574 (keeping 150 days of data) [2025-09-15T19:23:05.561061] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (3.33 seconds). [2025-09-15T19:23:05.661212] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:05.664445] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-15T19:23:05.819728] [DEBUG] [LOCAL ] MGM: Primary data saved (39574 records). [2025-09-15T19:23:05.819896] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-15T19:23:05.821453] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MGM took 41.1s. Estimated remaining: 1h 48m 9s. Rate: 9.4 symbols/min [2025-09-15T19:23:05.982376] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:23:06.008122] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:06.019426] [DEBUG] [LOCAL ] MHD: Loaded 8816 existing records from primary storage. [2025-09-15T19:23:06.019549] [INFO ] [MAIN ] MHD: Loaded 8816 existing records. [2025-09-15T19:23:06.063413] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-15T19:23:06.197327] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:06.197550] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-15T19:23:06.197604] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-15T19:23:06.198099] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-15T19:23:06.198148] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-15T19:23:06.548880] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:06.579114] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:23:06.857883] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-15T19:23:07.515272] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:23:07.657889] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-15T19:23:07.873814] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:07.874137] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-15T19:23:08.457880] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-15T19:23:09.257866] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-15T19:23:09.732040] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:23:09.752883] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:23:09.754315] [INFO ] [REMOTE ] MGRE: Full fetch complete (7090 records). [2025-09-15T19:23:09.754394] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-15T19:23:10.072242] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-15T19:23:10.120759] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-15T19:23:10.120843] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-15T19:23:10.121058] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-15T19:23:10.121102] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-15T19:23:10.121544] [DEBUG] [LOCAL ] MGRE: Trimmed 7090 records to 4814 (keeping 150 days of data) [2025-09-15T19:23:10.152227] [DEBUG] [LOCAL ] MGRE: Primary data saved (4814 records). [2025-09-15T19:23:10.152389] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-15T19:23:10.152512] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MGRE took 14.4s. Estimated remaining: 1h 48m 1s. Rate: 9.4 symbols/min [2025-09-15T19:23:10.327798] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:10.337924] [DEBUG] [LOCAL ] MHF: Loaded 6860 existing records from primary storage. [2025-09-15T19:23:10.338071] [INFO ] [MAIN ] MHF: Loaded 6860 existing records. [2025-09-15T19:23:10.517250] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:10.517615] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-15T19:23:10.517685] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-15T19:23:10.518061] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-15T19:23:10.518121] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-15T19:23:10.863061] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-15T19:23:10.891901] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:11.103140] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:11.103514] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-15T19:23:11.657891] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-15T19:23:11.936366] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T19:23:12.214996] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:23:12.457928] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-15T19:23:13.257880] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-15T19:23:13.345264] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T19:23:14.057932] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-15T19:23:14.677286] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:23:14.713537] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:23:14.857833] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-15T19:23:15.657921] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-15T19:23:15.838147] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:15.838450] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-15T19:23:16.238154] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:23:16.457895] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-15T19:23:17.257906] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-15T19:23:17.325667] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:23:17.834049] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:23:18.057933] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-15T19:23:18.857892] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-15T19:23:19.346197] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:23:19.657914] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-15T19:23:20.136866] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:23:20.457915] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-15T19:23:20.545112] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:23:20.549075] [INFO ] [REMOTE ] MH: Full fetch complete (10504 records). [2025-09-15T19:23:20.549149] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-15T19:23:20.733279] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-15T19:23:20.733595] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:23:20.733666] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:23:20.733732] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-15T19:23:20.733801] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-15T19:23:20.733847] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-15T19:23:20.733889] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-15T19:23:20.733963] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MH took 16.2s. Estimated remaining: 1h 47m 58s. Rate: 9.4 symbols/min [2025-09-15T19:23:20.912061] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:20.945320] [DEBUG] [LOCAL ] MHK: Loaded 31851 existing records from primary storage. [2025-09-15T19:23:20.945466] [INFO ] [MAIN ] MHK: Loaded 31851 existing records. [2025-09-15T19:23:21.121243] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:21.121497] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-15T19:23:21.121543] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-15T19:23:21.122253] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-15T19:23:21.122301] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-15T19:23:21.265742] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-15T19:23:21.488684] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T19:23:21.492987] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:22.057874] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-15T19:23:22.502276] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:23:22.648011] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T19:23:22.857870] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-15T19:23:23.366318] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T19:23:23.657893] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-15T19:23:24.457883] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-15T19:23:25.134980] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:23:25.257891] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-15T19:23:25.285317] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:23:25.291351] [INFO ] [REMOTE ] MGY: Full fetch complete (56982 records). [2025-09-15T19:23:25.291468] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-15T19:23:25.679700] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-15T19:23:25.679817] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-15T19:23:25.681034] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-15T19:23:25.681089] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-15T19:23:25.682775] [DEBUG] [LOCAL ] MGY: Trimmed 56982 records to 38628 (keeping 150 days of data) [2025-09-15T19:23:25.924524] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:23:25.957443] [DEBUG] [LOCAL ] MGY: Primary data saved (38628 records). [2025-09-15T19:23:25.957712] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-15T19:23:25.957854] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MGY took 24.5s. Estimated remaining: 1h 47m 51s. Rate: 9.4 symbols/min [2025-09-15T19:23:26.063539] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-15T19:23:26.143111] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:26.143384] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-15T19:23:26.143426] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-15T19:23:26.143609] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-15T19:23:26.143679] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-15T19:23:26.143727] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-15T19:23:26.143764] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-15T19:23:26.578155] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:26.765373] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T19:23:26.857946] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-15T19:23:27.333636] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T19:23:27.657923] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-15T19:23:28.255265] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:23:28.457882] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-15T19:23:28.762730] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-15T19:23:29.257886] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-15T19:23:29.501750] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-15T19:23:30.057871] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-15T19:23:30.461307] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:23:30.857874] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-15T19:23:31.588497] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T19:23:31.657890] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-15T19:23:32.342433] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:23:32.457879] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-15T19:23:33.258232] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-15T19:23:33.259441] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:23:33.262992] [INFO ] [REMOTE ] MHF: Full fetch complete (9333 records). [2025-09-15T19:23:33.263152] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-15T19:23:33.616989] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-15T19:23:33.617079] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-15T19:23:33.617301] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-15T19:23:33.617339] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-15T19:23:33.617780] [DEBUG] [LOCAL ] MHF: Trimmed 9333 records to 6816 (keeping 150 days of data) [2025-09-15T19:23:33.657904] [DEBUG] [LOCAL ] MHF: Primary data saved (6816 records). [2025-09-15T19:23:33.658020] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-15T19:23:33.658110] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MHF took 23.5s. Estimated remaining: 1h 47m 46s. Rate: 9.4 symbols/min [2025-09-15T19:23:33.829698] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:33.837102] [DEBUG] [LOCAL ] MHN: Loaded 5568 existing records from primary storage. [2025-09-15T19:23:33.837228] [INFO ] [MAIN ] MHN: Loaded 5568 existing records. [2025-09-15T19:23:34.014012] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:34.014340] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-15T19:23:34.014402] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-15T19:23:34.014834] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-15T19:23:34.014906] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-15T19:23:34.069588] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-15T19:23:34.313900] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:23:34.371762] [INFO ] [REMOTE ] MHD: Full fetch complete (13251 records). [2025-09-15T19:23:34.375830] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:34.376165] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-15T19:23:34.629946] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:23:34.751318] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-15T19:23:34.751408] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-15T19:23:34.751742] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-15T19:23:34.751786] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-15T19:23:34.752293] [DEBUG] [LOCAL ] MHD: Trimmed 13251 records to 8707 (keeping 150 days of data) [2025-09-15T19:23:34.806408] [DEBUG] [LOCAL ] MHD: Primary data saved (8707 records). [2025-09-15T19:23:34.806526] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-15T19:23:34.806608] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHD took 29.0s. Estimated remaining: 1h 47m 35s. Rate: 9.4 symbols/min [2025-09-15T19:23:34.863022] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-15T19:23:34.981430] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:35.000614] [DEBUG] [LOCAL ] MHO: Loaded 17950 existing records from primary storage. [2025-09-15T19:23:35.000761] [INFO ] [MAIN ] MHO: Loaded 17950 existing records. [2025-09-15T19:23:35.177967] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:35.178212] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-15T19:23:35.178258] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-15T19:23:35.178774] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-15T19:23:35.178837] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-15T19:23:35.280305] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:23:35.549118] [INFO ] [REMOTE ] MHO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:35.657901] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-15T19:23:36.234782] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:23:36.457910] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-15T19:23:37.257906] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-15T19:23:37.591343] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T19:23:37.923097] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T19:23:38.057851] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-15T19:23:38.857865] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-15T19:23:39.046940] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:23:39.079719] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T19:23:39.657919] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-15T19:23:39.961393] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-15T19:23:40.457916] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-15T19:23:41.257924] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-15T19:23:41.619354] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T19:23:41.620242] [INFO ] [REMOTE ] MHLA: Full fetch complete (1152 records). [2025-09-15T19:23:41.621382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T19:23:41.621450] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-15T19:23:41.812637] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 133 unique days, need 150 days [2025-09-15T19:23:41.812881] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:23:41.812931] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:23:41.812975] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-15T19:23:41.813033] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-15T19:23:41.813077] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-15T19:23:41.813120] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-15T19:23:41.813177] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHLA took 15.9s. Estimated remaining: 1h 47m 30s. Rate: 9.4 symbols/min [2025-09-15T19:23:41.979857] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:41.980012] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-15T19:23:41.980057] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-15T19:23:41.980175] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-15T19:23:41.980215] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-15T19:23:41.980256] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-15T19:23:41.980289] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-15T19:23:42.063026] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-15T19:23:42.340556] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:42.844552] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T19:23:42.857828] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-15T19:23:43.573901] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T19:23:43.657892] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-15T19:23:44.457900] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-15T19:23:45.004681] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:23:45.255956] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T19:23:45.259272] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-15T19:23:46.057890] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-15T19:23:46.248885] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:46.249189] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-15T19:23:46.301573] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:23:46.857863] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-15T19:23:47.657879] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-15T19:23:47.988963] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:23:48.107369] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:23:48.457924] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-15T19:23:49.257951] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-15T19:23:49.440377] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:49.440722] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-15T19:23:49.637850] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:23:50.057888] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-15T19:23:50.236071] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:50.236443] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-15T19:23:50.857868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-15T19:23:51.067137] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:51.067496] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-15T19:23:51.657881] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-15T19:23:52.457876] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-15T19:23:52.888791] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:23:52.944505] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T19:23:53.257916] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-15T19:23:53.460802] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:53.461200] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-15T19:23:54.057896] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-15T19:23:54.857872] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-15T19:23:55.658522] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-15T19:23:55.664800] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:23:55.897965] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:23:56.429821] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T19:23:56.431381] [INFO ] [REMOTE ] MHN: Full fetch complete (8329 records). [2025-09-15T19:23:56.431451] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-15T19:23:56.463092] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-15T19:23:56.763957] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:56.787660] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-15T19:23:56.794293] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-15T19:23:56.794854] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-15T19:23:56.795089] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-15T19:23:56.795139] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-15T19:23:56.795582] [DEBUG] [LOCAL ] MHN: Trimmed 8329 records to 5513 (keeping 150 days of data) [2025-09-15T19:23:56.829679] [DEBUG] [LOCAL ] MHN: Primary data saved (5513 records). [2025-09-15T19:23:56.829758] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-15T19:23:56.829836] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MHN took 23.2s. Estimated remaining: 1h 47m 30s. Rate: 9.4 symbols/min [2025-09-15T19:23:57.011348] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:57.026425] [DEBUG] [LOCAL ] MIN: Loaded 10736 existing records from primary storage. [2025-09-15T19:23:57.026541] [INFO ] [MAIN ] MIN: Loaded 10736 existing records. [2025-09-15T19:23:57.199521] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:57.199766] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-15T19:23:57.199813] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-15T19:23:57.200296] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-15T19:23:57.200344] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-15T19:23:57.263023] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-15T19:23:57.548445] [INFO ] [REMOTE ] MIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:58.057905] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-15T19:23:58.114718] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:23:58.662454] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T19:23:58.857878] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-15T19:23:59.657868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-15T19:24:00.114286] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:24:00.457876] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-15T19:24:00.604572] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:24:01.257834] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-15T19:24:01.677975] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:24:01.901759] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T19:24:02.057880] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-15T19:24:02.857887] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-15T19:24:03.096581] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:24:03.657922] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-15T19:24:04.457874] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-15T19:24:04.967231] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-15T19:24:04.972692] [INFO ] [REMOTE ] MIAX: Full fetch complete (6886 records). [2025-09-15T19:24:04.972863] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-15T19:24:05.162244] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 22 unique days, need 150 days [2025-09-15T19:24:05.162539] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:24:05.162669] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:24:05.162843] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-15T19:24:05.162935] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-15T19:24:05.163018] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-15T19:24:05.163495] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-15T19:24:05.163657] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MIAX took 23.4s. Estimated remaining: 1h 47m 25s. Rate: 9.4 symbols/min [2025-09-15T19:24:05.172390] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T19:24:05.191609] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:24:05.257814] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-15T19:24:06.057831] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-15T19:24:06.368079] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:24:06.370998] [INFO ] [REMOTE ] MHO: Full fetch complete (27018 records). [2025-09-15T19:24:06.371085] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-15T19:24:06.744996] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-15T19:24:06.745087] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-15T19:24:06.745966] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-15T19:24:06.746025] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-15T19:24:06.746795] [DEBUG] [LOCAL ] MHO: Trimmed 27018 records to 17637 (keeping 150 days of data) [2025-09-15T19:24:06.861208] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-15T19:24:06.866526] [DEBUG] [LOCAL ] MHO: Primary data saved (17637 records). [2025-09-15T19:24:06.866669] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-15T19:24:06.866782] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MHO took 32.1s. Estimated remaining: 1h 47m 15s. Rate: 9.4 symbols/min [2025-09-15T19:24:07.208938] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T19:24:07.216778] [INFO ] [REMOTE ] MHK: Full fetch complete (46242 records). [2025-09-15T19:24:07.216889] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-15T19:24:07.518527] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:24:07.610864] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-15T19:24:07.610942] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-15T19:24:07.611714] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-15T19:24:07.611759] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-15T19:24:07.612938] [DEBUG] [LOCAL ] MHK: Trimmed 46242 records to 31379 (keeping 150 days of data) [2025-09-15T19:24:07.671344] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-15T19:24:07.816918] [DEBUG] [LOCAL ] MHK: Primary data saved (31379 records). [2025-09-15T19:24:07.817094] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-15T19:24:07.817197] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MHK took 47.1s. Estimated remaining: 1h 47m 5s. Rate: 9.4 symbols/min [2025-09-15T19:24:08.798464] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:24:08.803834] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-15T19:24:09.696298] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:24:09.700770] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-15T19:24:10.435675] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:24:10.437388] [INFO ] [REMOTE ] MIN: Full fetch complete (13891 records). [2025-09-15T19:24:10.437457] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-15T19:24:10.802538] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-15T19:24:10.802658] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-15T19:24:10.803015] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-15T19:24:10.803078] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-15T19:24:10.803699] [DEBUG] [LOCAL ] MIN: Trimmed 13891 records to 10623 (keeping 150 days of data) [2025-09-15T19:24:10.871056] [DEBUG] [LOCAL ] MIN: Primary data saved (10623 records). [2025-09-15T19:24:10.871197] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-15T19:24:10.871283] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIN took 14.0s. Estimated remaining: 1h 46m 56s. Rate: 9.4 symbols/min [2025-09-15T19:24:11.597970] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.578351] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.563221] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.618048] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.619534] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-15T19:24:11.620445] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-15T19:24:11.621074] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-15T19:24:11.621156] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-15T19:24:11.621227] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-15T19:24:11.621283] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-15T19:24:11.734235] [DEBUG] [LOCAL ] MITP: Loaded 1677 existing records from primary storage. [2025-09-15T19:24:11.772138] [DEBUG] [LOCAL ] MITT: Loaded 16045 existing records from primary storage. [2025-09-15T19:24:11.754023] [INFO ] [MAIN ] MITP: Loaded 1677 existing records. [2025-09-15T19:24:11.777691] [INFO ] [MAIN ] MITT: Loaded 16045 existing records. [2025-09-15T19:24:12.077151] [DEBUG] [LOCAL ] MIR: Loaded 38381 existing records from primary storage. [2025-09-15T19:24:12.101830] [INFO ] [MAIN ] MIR: Loaded 38381 existing records. [2025-09-15T19:24:12.305960] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.333254] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.383324] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-15T19:24:12.466087] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-15T19:24:12.482752] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-15T19:24:12.482677] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.606574] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.623709] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-15T19:24:12.698322] [INFO ] [REMOTE ] MITN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:12.720158] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-15T19:24:12.760666] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-15T19:24:12.767985] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.782390] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-15T19:24:12.782613] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.788261] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-15T19:24:12.848783] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-15T19:24:12.937249] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-15T19:24:13.209482] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T19:24:13.261307] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-15T19:24:13.488434] [INFO ] [REMOTE ] MITP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.512035] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-15T19:24:13.783134] [INFO ] [REMOTE ] MIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.790808] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.791396] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-15T19:24:13.791201] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-15T19:24:13.945419] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:24:14.057908] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-15T19:24:14.084159] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:24:14.481486] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:24:14.564225] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:24:14.857870] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-15T19:24:15.048448] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:24:15.657914] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-15T19:24:15.693748] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T19:24:16.180795] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T19:24:16.457881] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-15T19:24:17.257872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-15T19:24:18.001955] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:24:18.057822] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-15T19:24:18.269476] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T19:24:18.364248] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T19:24:18.857866] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-15T19:24:19.157244] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-15T19:24:19.657858] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-15T19:24:19.980776] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T19:24:20.457872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-15T19:24:20.932222] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:24:20.933005] [INFO ] [REMOTE ] MITN: Full fetch complete (1940 records). [2025-09-15T19:24:20.933073] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-15T19:24:21.120581] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:24:21.120936] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:24:21.120998] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:24:21.121061] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-15T19:24:21.121147] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-15T19:24:21.121188] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-15T19:24:21.121229] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-15T19:24:21.121293] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MITN took 10.2s. Estimated remaining: 1h 46m 52s. Rate: 9.4 symbols/min [2025-09-15T19:24:21.266450] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-15T19:24:21.291372] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:21.301608] [DEBUG] [LOCAL ] MIY: Loaded 4348 existing records from primary storage. [2025-09-15T19:24:21.301748] [INFO ] [MAIN ] MIY: Loaded 4348 existing records. [2025-09-15T19:24:21.481059] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:21.481334] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-15T19:24:21.481382] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-15T19:24:21.481636] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-15T19:24:21.481713] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-15T19:24:21.843247] [INFO ] [REMOTE ] MIY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:22.057853] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-15T19:24:22.400199] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:24:22.637529] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:24:22.857872] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-15T19:24:23.657901] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-15T19:24:24.209949] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:24:24.457842] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-15T19:24:24.761041] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:24:25.033359] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:24:25.257878] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-15T19:24:25.673329] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T19:24:26.057875] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-15T19:24:26.683850] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:24:26.857852] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-15T19:24:27.657908] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-15T19:24:28.205793] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:24:28.467964] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-15T19:24:28.474808] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:24:28.995578] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T19:24:29.257901] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-15T19:24:30.057912] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-15T19:24:30.689683] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:24:30.857844] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-15T19:24:31.173888] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:24:31.182688] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T19:24:31.657887] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-15T19:24:32.457876] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-15T19:24:32.865793] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:24:32.994252] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T19:24:33.257931] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-15T19:24:34.057893] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-15T19:24:34.565392] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:24:34.857885] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-15T19:24:35.057358] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T19:24:35.657892] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-15T19:24:36.015237] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T19:24:36.180164] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:24:36.187398] [INFO ] [REMOTE ] MIR: Full fetch complete (55107 records). [2025-09-15T19:24:36.187551] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-15T19:24:36.468072] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-15T19:24:36.647436] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-15T19:24:36.647549] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-15T19:24:36.648542] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-15T19:24:36.648613] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-15T19:24:36.650068] [DEBUG] [LOCAL ] MIR: Trimmed 55107 records to 37755 (keeping 150 days of data) [2025-09-15T19:24:36.886194] [DEBUG] [LOCAL ] MIR: Primary data saved (37755 records). [2025-09-15T19:24:36.886358] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-15T19:24:36.886459] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MIR took 26.0s. Estimated remaining: 1h 46m 53s. Rate: 9.4 symbols/min [2025-09-15T19:24:37.056094] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:37.092789] [DEBUG] [LOCAL ] MKC: Loaded 39477 existing records from primary storage. [2025-09-15T19:24:37.092943] [INFO ] [MAIN ] MKC: Loaded 39477 existing records. [2025-09-15T19:24:37.267269] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-15T19:24:37.273658] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:37.273903] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-15T19:24:37.273974] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-15T19:24:37.275045] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-15T19:24:37.275103] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-15T19:24:37.611590] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:24:37.678167] [INFO ] [REMOTE ] MKC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:38.036682] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:24:38.057869] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-15T19:24:38.592285] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:24:38.857941] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-15T19:24:39.534219] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:24:39.657931] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-15T19:24:40.457925] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-15T19:24:40.849569] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T19:24:40.850321] [INFO ] [REMOTE ] MITP: Full fetch complete (2546 records). [2025-09-15T19:24:40.850389] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-15T19:24:41.201375] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-15T19:24:41.201457] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-15T19:24:41.201579] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-15T19:24:41.201618] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-15T19:24:41.201977] [DEBUG] [LOCAL ] MITP: Trimmed 2546 records to 1616 (keeping 150 days of data) [2025-09-15T19:24:41.213059] [DEBUG] [LOCAL ] MITP: Primary data saved (1616 records). [2025-09-15T19:24:41.213197] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-15T19:24:41.213287] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MITP took 30.3s. Estimated remaining: 1h 46m 45s. Rate: 9.4 symbols/min [2025-09-15T19:24:41.269041] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-15T19:24:41.396084] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:41.427294] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T19:24:41.460111] [DEBUG] [LOCAL ] MKL: Loaded 25665 existing records from primary storage. [2025-09-15T19:24:41.460256] [INFO ] [MAIN ] MKL: Loaded 25665 existing records. [2025-09-15T19:24:41.634946] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:41.635184] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-15T19:24:41.635230] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-15T19:24:41.636028] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-15T19:24:41.636080] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-15T19:24:41.917013] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:24:41.944376] [INFO ] [REMOTE ] MIY: Full fetch complete (6356 records). [2025-09-15T19:24:41.979954] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-15T19:24:42.002222] [INFO ] [REMOTE ] MKL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:42.065875] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-15T19:24:42.369954] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-15T19:24:42.370043] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-15T19:24:42.370239] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-15T19:24:42.370281] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-15T19:24:42.370830] [DEBUG] [LOCAL ] MIY: Trimmed 6356 records to 4318 (keeping 150 days of data) [2025-09-15T19:24:42.400116] [DEBUG] [LOCAL ] MIY: Primary data saved (4318 records). [2025-09-15T19:24:42.400266] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-15T19:24:42.400354] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MIY took 21.3s. Estimated remaining: 1h 46m 35s. Rate: 9.4 symbols/min [2025-09-15T19:24:42.569615] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:42.612367] [DEBUG] [LOCAL ] MLI: Loaded 32624 existing records from primary storage. [2025-09-15T19:24:42.612508] [INFO ] [MAIN ] MLI: Loaded 32624 existing records. [2025-09-15T19:24:42.791321] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:42.791683] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-15T19:24:42.791925] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-15T19:24:42.792856] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-15T19:24:42.792921] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-15T19:24:42.862971] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-15T19:24:43.148570] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:43.601177] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:24:43.657874] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-15T19:24:43.856524] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:24:43.859157] [INFO ] [REMOTE ] MITT: Full fetch complete (25006 records). [2025-09-15T19:24:43.859267] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-15T19:24:44.231439] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-15T19:24:44.231545] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-15T19:24:44.232146] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-15T19:24:44.232195] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-15T19:24:44.233165] [DEBUG] [LOCAL ] MITT: Trimmed 25006 records to 15605 (keeping 150 days of data) [2025-09-15T19:24:44.327748] [DEBUG] [LOCAL ] MITT: Primary data saved (15605 records). [2025-09-15T19:24:44.327912] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-15T19:24:44.328033] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MITT took 33.5s. Estimated remaining: 1h 46m 25s. Rate: 9.4 symbols/min [2025-09-15T19:24:44.472091] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-15T19:24:44.504617] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:44.526230] [DEBUG] [LOCAL ] MLM: Loaded 21830 existing records from primary storage. [2025-09-15T19:24:44.526401] [INFO ] [MAIN ] MLM: Loaded 21830 existing records. [2025-09-15T19:24:44.705406] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:44.705689] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-15T19:24:44.705736] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-15T19:24:44.706336] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-15T19:24:44.706387] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-15T19:24:45.065935] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:45.113472] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:24:45.257885] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-15T19:24:45.951124] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T19:24:46.057906] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-15T19:24:46.431744] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:24:46.857955] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-15T19:24:47.285377] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:24:47.657935] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-15T19:24:48.408493] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:24:48.457821] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-15T19:24:49.275385] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-15T19:24:49.295615] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T19:24:50.025604] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:24:50.057818] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-15T19:24:50.557576] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:24:50.857942] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-15T19:24:51.581186] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:24:51.657860] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-15T19:24:52.279179] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:24:52.457878] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-15T19:24:52.750095] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T19:24:53.257883] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-15T19:24:53.923381] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:24:54.057864] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-15T19:24:54.394480] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:24:54.857878] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-15T19:24:55.403389] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:24:55.657897] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-15T19:24:56.457911] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-15T19:24:56.640623] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T19:24:56.958809] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:24:57.257875] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-15T19:24:57.372437] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T19:24:58.057936] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-15T19:24:58.719988] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:24:58.857883] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-15T19:24:59.222049] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:24:59.657873] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-15T19:25:00.467457] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-15T19:25:00.492239] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:25:00.886040] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:25:01.257907] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-15T19:25:02.048043] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T19:25:02.057815] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-15T19:25:02.346031] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:25:02.857863] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-15T19:25:03.483333] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:25:03.488416] [INFO ] [REMOTE ] MLI: Full fetch complete (47777 records). [2025-09-15T19:25:03.488518] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-15T19:25:03.675619] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-15T19:25:03.878831] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-15T19:25:03.879051] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-15T19:25:03.880323] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-15T19:25:03.880423] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-15T19:25:03.882326] [DEBUG] [LOCAL ] MLI: Trimmed 47777 records to 31883 (keeping 150 days of data) [2025-09-15T19:25:04.015563] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T19:25:04.141837] [DEBUG] [LOCAL ] MLI: Primary data saved (31883 records). [2025-09-15T19:25:04.142065] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-15T19:25:04.142228] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLI took 21.7s. Estimated remaining: 1h 46m 29s. Rate: 9.4 symbols/min [2025-09-15T19:25:04.328514] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:04.350827] [DEBUG] [LOCAL ] MLNK: Loaded 19044 existing records from primary storage. [2025-09-15T19:25:04.351020] [INFO ] [MAIN ] MLNK: Loaded 19044 existing records. [2025-09-15T19:25:04.460552] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-15T19:25:04.567802] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:04.568588] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-15T19:25:04.568692] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-15T19:25:04.569479] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-15T19:25:04.569551] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-15T19:25:04.958636] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:05.257973] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-15T19:25:05.586279] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T19:25:05.609731] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T19:25:05.614671] [INFO ] [REMOTE ] MLM: Full fetch complete (35361 records). [2025-09-15T19:25:05.614837] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-15T19:25:06.007674] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-15T19:25:06.007823] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-15T19:25:06.008630] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-15T19:25:06.008971] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-15T19:25:06.027492] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:25:06.032368] [DEBUG] [LOCAL ] MLM: Trimmed 35361 records to 21374 (keeping 150 days of data) [2025-09-15T19:25:06.091383] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-15T19:25:06.172977] [DEBUG] [LOCAL ] MLM: Primary data saved (21374 records). [2025-09-15T19:25:06.173114] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-15T19:25:06.173242] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLM took 21.8s. Estimated remaining: 1h 46m 19s. Rate: 9.4 symbols/min [2025-09-15T19:25:06.344984] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:06.349061] [DEBUG] [LOCAL ] MLP: Loaded 2297 existing records from primary storage. [2025-09-15T19:25:06.349143] [INFO ] [MAIN ] MLP: Loaded 2297 existing records. [2025-09-15T19:25:06.526168] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:06.526448] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-15T19:25:06.526497] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-15T19:25:06.526735] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-15T19:25:06.526782] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-15T19:25:06.879776] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-15T19:25:06.885004] [INFO ] [REMOTE ] MLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:07.190309] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:25:07.657915] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-15T19:25:08.035512] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T19:25:08.039274] [INFO ] [REMOTE ] MKL: Full fetch complete (37674 records). [2025-09-15T19:25:08.039369] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-15T19:25:08.415703] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-15T19:25:08.415904] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-15T19:25:08.416718] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-15T19:25:08.416769] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-15T19:25:08.417699] [DEBUG] [LOCAL ] MKL: Trimmed 37674 records to 25028 (keeping 150 days of data) [2025-09-15T19:25:08.475084] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-15T19:25:08.581292] [DEBUG] [LOCAL ] MKL: Primary data saved (25028 records). [2025-09-15T19:25:08.581415] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-15T19:25:08.581500] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MKL took 27.4s. Estimated remaining: 1h 46m 10s. Rate: 9.4 symbols/min [2025-09-15T19:25:08.753259] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:08.769251] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T19:25:08.780892] [DEBUG] [LOCAL ] MLR: Loaded 8560 existing records from primary storage. [2025-09-15T19:25:08.780993] [INFO ] [MAIN ] MLR: Loaded 8560 existing records. [2025-09-15T19:25:08.938460] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T19:25:08.958632] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:08.958861] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-15T19:25:08.958905] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-15T19:25:08.959390] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-15T19:25:08.959439] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-15T19:25:09.262943] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-15T19:25:09.312853] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:10.057879] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-15T19:25:10.124377] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:25:10.857871] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-15T19:25:11.443586] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T19:25:11.653488] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:25:11.661299] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-15T19:25:12.457933] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-15T19:25:13.092678] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:25:13.101345] [INFO ] [REMOTE ] MKC: Full fetch complete (57004 records). [2025-09-15T19:25:13.101461] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-15T19:25:13.267539] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-15T19:25:13.502062] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-15T19:25:13.510531] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-15T19:25:13.512283] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-15T19:25:13.513175] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-15T19:25:13.512995] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T19:25:13.520005] [DEBUG] [LOCAL ] MKC: Trimmed 57004 records to 38721 (keeping 150 days of data) [2025-09-15T19:25:13.778063] [DEBUG] [LOCAL ] MKC: Primary data saved (38721 records). [2025-09-15T19:25:13.778285] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-15T19:25:13.778414] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MKC took 36.9s. Estimated remaining: 1h 46m 3s. Rate: 9.4 symbols/min [2025-09-15T19:25:13.963103] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:13.996740] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:25:14.014425] [DEBUG] [LOCAL ] MMC: Loaded 38946 existing records from primary storage. [2025-09-15T19:25:14.014591] [INFO ] [MAIN ] MMC: Loaded 38946 existing records. [2025-09-15T19:25:14.066831] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-15T19:25:14.196495] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:14.196778] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-15T19:25:14.196831] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-15T19:25:14.197890] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-15T19:25:14.197944] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-15T19:25:14.487460] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:25:14.565803] [INFO ] [REMOTE ] MMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:14.857920] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-15T19:25:15.397719] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T19:25:15.657896] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-15T19:25:16.457845] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-15T19:25:16.902397] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:25:17.257898] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-15T19:25:17.381578] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T19:25:17.821910] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:25:18.057860] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-15T19:25:18.499516] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:25:18.857893] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-15T19:25:19.314022] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T19:25:19.657872] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-15T19:25:20.457924] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-15T19:25:20.918790] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:25:20.922461] [INFO ] [REMOTE ] MLNK: Full fetch complete (27087 records). [2025-09-15T19:25:20.922568] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-15T19:25:21.263190] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-15T19:25:21.296151] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-15T19:25:21.303378] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-15T19:25:21.304320] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-15T19:25:21.305866] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-15T19:25:21.307163] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:25:21.311148] [DEBUG] [LOCAL ] MLNK: Trimmed 27087 records to 18738 (keeping 150 days of data) [2025-09-15T19:25:21.426584] [DEBUG] [LOCAL ] MLNK: Primary data saved (18738 records). [2025-09-15T19:25:21.426768] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-15T19:25:21.426889] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MLNK took 17.3s. Estimated remaining: 1h 45m 57s. Rate: 9.4 symbols/min [2025-09-15T19:25:21.593697] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:21.603001] [DEBUG] [LOCAL ] MMD: Loaded 7956 existing records from primary storage. [2025-09-15T19:25:21.603109] [INFO ] [MAIN ] MMD: Loaded 7956 existing records. [2025-09-15T19:25:21.707621] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:25:21.791603] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:21.791917] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-15T19:25:21.791965] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-15T19:25:21.792344] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-15T19:25:21.792391] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-15T19:25:22.063164] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-15T19:25:22.159740] [INFO ] [REMOTE ] MMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:22.621171] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:25:22.857874] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-15T19:25:23.657933] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-15T19:25:23.722981] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T19:25:24.405067] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T19:25:24.457941] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-15T19:25:25.257939] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-15T19:25:25.289111] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:25:26.057922] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-15T19:25:26.645020] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:25:26.709960] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:25:26.711050] [INFO ] [REMOTE ] MLP: Full fetch complete (3224 records). [2025-09-15T19:25:26.711119] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-15T19:25:26.866744] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-15T19:25:27.091528] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-15T19:25:27.091669] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-15T19:25:27.091864] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-15T19:25:27.091938] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-15T19:25:27.092747] [DEBUG] [LOCAL ] MLP: Trimmed 3224 records to 2255 (keeping 150 days of data) [2025-09-15T19:25:27.114154] [DEBUG] [LOCAL ] MLP: Primary data saved (2255 records). [2025-09-15T19:25:27.114372] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-15T19:25:27.114505] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MLP took 20.9s. Estimated remaining: 1h 45m 50s. Rate: 9.4 symbols/min [2025-09-15T19:25:27.294045] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:27.305888] [DEBUG] [LOCAL ] MMI: Loaded 11093 existing records from primary storage. [2025-09-15T19:25:27.306028] [INFO ] [MAIN ] MMI: Loaded 11093 existing records. [2025-09-15T19:25:27.481482] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:27.481779] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-15T19:25:27.481827] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-15T19:25:27.482254] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-15T19:25:27.482300] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-15T19:25:27.668111] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-15T19:25:27.838758] [INFO ] [REMOTE ] MMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:28.457900] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-15T19:25:28.593032] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T19:25:28.655335] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:25:29.230821] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:25:29.257848] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-15T19:25:29.974238] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T19:25:30.057938] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-15T19:25:30.857944] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-15T19:25:31.051420] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:25:31.657942] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-15T19:25:32.474873] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-15T19:25:32.503210] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:25:32.547963] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T19:25:33.174899] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T19:25:33.257896] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-15T19:25:33.889515] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:25:34.057915] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-15T19:25:34.857899] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-15T19:25:35.532658] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:25:35.657187] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:25:35.659372] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-15T19:25:35.660804] [INFO ] [REMOTE ] MLR: Full fetch complete (14415 records). [2025-09-15T19:25:35.660899] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-15T19:25:36.037175] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-15T19:25:36.037260] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-15T19:25:36.037664] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-15T19:25:36.037725] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-15T19:25:36.038294] [DEBUG] [LOCAL ] MLR: Trimmed 14415 records to 8409 (keeping 150 days of data) [2025-09-15T19:25:36.093135] [DEBUG] [LOCAL ] MLR: Primary data saved (8409 records). [2025-09-15T19:25:36.093287] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-15T19:25:36.093386] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MLR took 27.5s. Estimated remaining: 1h 45m 46s. Rate: 9.4 symbols/min [2025-09-15T19:25:36.277269] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:36.277514] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-15T19:25:36.277557] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-15T19:25:36.277710] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-15T19:25:36.277754] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-15T19:25:36.277799] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-15T19:25:36.277834] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-15T19:25:36.462083] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-15T19:25:36.651057] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:36.710380] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:25:37.257908] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-15T19:25:37.525586] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-15T19:25:38.057858] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-15T19:25:38.170006] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T19:25:38.778550] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:25:38.857891] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-15T19:25:39.657912] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-15T19:25:40.266876] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:25:40.457909] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-15T19:25:40.669507] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T19:25:41.087993] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:25:41.257885] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-15T19:25:42.057857] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-15T19:25:42.705459] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:25:42.707243] [INFO ] [REMOTE ] MMD: Full fetch complete (12312 records). [2025-09-15T19:25:42.707321] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-15T19:25:42.863092] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-15T19:25:43.112012] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-15T19:25:43.112182] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-15T19:25:43.112687] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-15T19:25:43.112752] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-15T19:25:43.113585] [DEBUG] [LOCAL ] MMD: Trimmed 12312 records to 7760 (keeping 150 days of data) [2025-09-15T19:25:43.227116] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T19:25:43.249145] [DEBUG] [LOCAL ] MMD: Primary data saved (7760 records). [2025-09-15T19:25:43.249748] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-15T19:25:43.249847] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMD took 21.8s. Estimated remaining: 1h 45m 40s. Rate: 9.4 symbols/min [2025-09-15T19:25:43.418940] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:43.460309] [DEBUG] [LOCAL ] MMM: Loaded 40041 existing records from primary storage. [2025-09-15T19:25:43.460455] [INFO ] [MAIN ] MMM: Loaded 40041 existing records. [2025-09-15T19:25:43.638623] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:43.638927] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-15T19:25:43.638973] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-15T19:25:43.639957] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-15T19:25:43.640015] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-15T19:25:43.663033] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-15T19:25:43.997896] [INFO ] [REMOTE ] MMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:44.004260] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:25:44.457934] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-15T19:25:45.246511] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:25:45.252409] [INFO ] [REMOTE ] MMC: Full fetch complete (56269 records). [2025-09-15T19:25:45.252562] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-15T19:25:45.264423] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-15T19:25:45.650678] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-15T19:25:45.650765] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-15T19:25:45.651610] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-15T19:25:45.651671] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-15T19:25:45.652849] [DEBUG] [LOCAL ] MMC: Trimmed 56269 records to 38185 (keeping 150 days of data) [2025-09-15T19:25:45.767815] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T19:25:45.912567] [DEBUG] [LOCAL ] MMC: Primary data saved (38185 records). [2025-09-15T19:25:45.912755] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-15T19:25:45.912891] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMC took 32.1s. Estimated remaining: 1h 45m 31s. Rate: 9.4 symbols/min [2025-09-15T19:25:46.061726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-15T19:25:46.087133] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:46.118549] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T19:25:46.149014] [DEBUG] [LOCAL ] MMS: Loaded 24667 existing records from primary storage. [2025-09-15T19:25:46.149154] [INFO ] [MAIN ] MMS: Loaded 24667 existing records. [2025-09-15T19:25:46.325822] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:46.326088] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-15T19:25:46.326171] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-15T19:25:46.326898] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-15T19:25:46.326949] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-15T19:25:46.698158] [INFO ] [REMOTE ] MMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:46.709467] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T19:25:46.857850] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-15T19:25:47.657905] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-15T19:25:48.039507] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:25:48.057921] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:25:48.457886] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-15T19:25:49.257940] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-15T19:25:49.664752] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T19:25:49.801053] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T19:25:50.057883] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-15T19:25:50.857902] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-15T19:25:51.584829] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:25:51.657872] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-15T19:25:51.742600] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:25:52.457914] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-15T19:25:52.762775] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:25:53.257907] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-15T19:25:53.337759] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T19:25:53.339748] [INFO ] [REMOTE ] MMI: Full fetch complete (16825 records). [2025-09-15T19:25:53.339828] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-15T19:25:53.710381] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-15T19:25:53.710461] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-15T19:25:53.710882] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-15T19:25:53.710927] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-15T19:25:53.711505] [DEBUG] [LOCAL ] MMI: Trimmed 16825 records to 10782 (keeping 150 days of data) [2025-09-15T19:25:53.781222] [DEBUG] [LOCAL ] MMI: Primary data saved (10782 records). [2025-09-15T19:25:53.781374] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-15T19:25:53.781461] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMI took 26.7s. Estimated remaining: 1h 45m 26s. Rate: 9.4 symbols/min [2025-09-15T19:25:53.955348] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:53.965697] [DEBUG] [LOCAL ] MMT: Loaded 7827 existing records from primary storage. [2025-09-15T19:25:53.965795] [INFO ] [MAIN ] MMT: Loaded 7827 existing records. [2025-09-15T19:25:54.063060] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-15T19:25:54.142046] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:54.142282] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-15T19:25:54.142352] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-15T19:25:54.142752] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-15T19:25:54.142847] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-15T19:25:54.507462] [INFO ] [REMOTE ] MMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:54.857832] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-15T19:25:55.064749] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:25:55.142494] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T19:25:55.622451] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:25:55.657877] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-15T19:25:56.457933] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-15T19:25:56.829368] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T19:25:57.038202] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:25:57.257890] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-15T19:25:58.057901] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-15T19:25:58.333001] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T19:25:58.856826] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T19:25:58.864373] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-15T19:25:59.279191] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T19:25:59.657891] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-15T19:26:00.457860] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-15T19:26:00.599759] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:26:00.915529] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T19:26:00.916294] [INFO ] [REMOTE ] MMKT: Full fetch complete (1529 records). [2025-09-15T19:26:00.916362] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-15T19:26:01.095806] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T19:26:01.096025] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:26:01.096092] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:26:01.096136] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-15T19:26:01.096205] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-15T19:26:01.096242] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-15T19:26:01.096282] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-15T19:26:01.096354] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMKT took 25.0s. Estimated remaining: 1h 45m 20s. Rate: 9.4 symbols/min [2025-09-15T19:26:01.274121] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-15T19:26:01.313962] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:01.331955] [DEBUG] [LOCAL ] MMU: Loaded 12504 existing records from primary storage. [2025-09-15T19:26:01.332145] [INFO ] [MAIN ] MMU: Loaded 12504 existing records. [2025-09-15T19:26:01.527999] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:01.528287] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-15T19:26:01.528336] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-15T19:26:01.528779] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-15T19:26:01.528826] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-15T19:26:01.933488] [INFO ] [REMOTE ] MMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:02.057913] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-15T19:26:02.857924] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-15T19:26:03.083777] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:26:03.657918] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-15T19:26:04.457946] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-15T19:26:05.481506] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T19:26:05.485867] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-15T19:26:06.553190] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:26:06.558250] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-15T19:26:07.419973] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:26:07.423415] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-15T19:26:08.287778] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:26:08.293500] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-15T19:26:09.256754] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:26:09.260396] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-15T19:26:16.560769] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (12.90 seconds). [2025-09-15T19:26:16.563873] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-15T19:26:17.190560] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (7.93 seconds). [2025-09-15T19:26:17.195734] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-15T19:26:17.325602] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:26:17.328695] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-15T19:26:17.643599] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (16.37 seconds). [2025-09-15T19:26:17.655326] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-15T19:26:17.926790] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:26:17.929380] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-15T19:26:18.062551] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:26:18.065026] [INFO ] [REMOTE ] MMU: Full fetch complete (18734 records). [2025-09-15T19:26:18.065106] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-15T19:26:18.444746] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-15T19:26:18.444840] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-15T19:26:18.445237] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-15T19:26:18.445277] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-15T19:26:18.445877] [DEBUG] [LOCAL ] MMU: Trimmed 18734 records to 12090 (keeping 150 days of data) [2025-09-15T19:26:18.535330] [DEBUG] [LOCAL ] MMU: Primary data saved (12090 records). [2025-09-15T19:26:18.535703] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-15T19:26:18.535903] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMU took 17.4s. Estimated remaining: 1h 45m 22s. Rate: 9.4 symbols/min [2025-09-15T19:26:18.727850] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:18.748241] [DEBUG] [LOCAL ] MNR: Loaded 18817 existing records from primary storage. [2025-09-15T19:26:18.748413] [INFO ] [MAIN ] MNR: Loaded 18817 existing records. [2025-09-15T19:26:18.925481] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:18.935764] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-15T19:26:18.936381] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-15T19:26:18.936758] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:26:18.940511] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-15T19:26:18.940692] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-15T19:26:18.941377] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-15T19:26:19.300213] [INFO ] [REMOTE ] MNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:19.300692] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-15T19:26:19.639234] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T19:26:19.650712] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-15T19:26:19.834690] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:26:19.837611] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-15T19:26:20.268316] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:26:20.275271] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-15T19:26:20.568824] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:26:20.570115] [INFO ] [REMOTE ] MMT: Full fetch complete (12396 records). [2025-09-15T19:26:20.570186] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-15T19:26:20.924694] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-15T19:26:20.924780] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-15T19:26:20.925071] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-15T19:26:20.925110] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-15T19:26:20.925554] [DEBUG] [LOCAL ] MMT: Trimmed 12396 records to 7640 (keeping 150 days of data) [2025-09-15T19:26:20.975308] [DEBUG] [LOCAL ] MMT: Primary data saved (7640 records). [2025-09-15T19:26:20.975436] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-15T19:26:20.975529] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMT took 27.2s. Estimated remaining: 1h 45m 13s. Rate: 9.4 symbols/min [2025-09-15T19:26:21.142628] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:21.183457] [DEBUG] [LOCAL ] MNSO: Loaded 32461 existing records from primary storage. [2025-09-15T19:26:21.183600] [INFO ] [MAIN ] MNSO: Loaded 32461 existing records. [2025-09-15T19:26:21.362954] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:21.363557] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-15T19:26:21.363781] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-15T19:26:21.364782] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-15T19:26:21.364889] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-15T19:26:21.440879] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:26:21.491291] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-15T19:26:21.767093] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T19:26:21.786496] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:21.798509] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-15T19:26:21.800297] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-15T19:26:22.604568] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T19:26:22.609698] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-15T19:26:23.341495] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:26:23.350373] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-15T19:26:23.478812] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:26:23.502441] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (20.64 seconds). [2025-09-15T19:26:23.511561] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-15T19:26:23.512542] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-15T19:26:23.540884] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:26:23.550837] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-15T19:26:24.809956] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:26:24.815144] [INFO ] [REMOTE ] MMS: Full fetch complete (37752 records). [2025-09-15T19:26:24.815339] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-15T19:26:25.199364] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:26:25.271987] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-15T19:26:25.416453] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-15T19:26:25.416594] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-15T19:26:25.418358] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-15T19:26:25.418445] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-15T19:26:25.420314] [DEBUG] [LOCAL ] MMS: Trimmed 37752 records to 24361 (keeping 150 days of data) [2025-09-15T19:26:25.595712] [DEBUG] [LOCAL ] MMS: Primary data saved (24361 records). [2025-09-15T19:26:25.595981] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-15T19:26:25.596082] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MMS took 39.7s. Estimated remaining: 1h 45m 5s. Rate: 9.4 symbols/min [2025-09-15T19:26:25.779229] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:25.779507] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-15T19:26:25.779739] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-15T19:26:25.789894] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-15T19:26:25.805922] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-15T19:26:25.806137] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-15T19:26:25.806200] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-15T19:26:25.875787] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-15T19:26:25.927103] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-15T19:26:26.180183] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:26.180524] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-15T19:26:26.198751] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-15T19:26:26.205038] [INFO ] [REMOTE ] MMM: Full fetch complete (57929 records). [2025-09-15T19:26:26.205197] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-15T19:26:26.499865] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:26.500473] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-15T19:26:26.511280] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-15T19:26:26.593625] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-15T19:26:26.593735] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-15T19:26:26.594765] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-15T19:26:26.594826] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-15T19:26:26.596168] [DEBUG] [LOCAL ] MMM: Trimmed 57929 records to 39261 (keeping 150 days of data) [2025-09-15T19:26:26.853055] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:26.853183] [DEBUG] [LOCAL ] MMM: Primary data saved (39261 records). [2025-09-15T19:26:26.853436] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-15T19:26:26.856358] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMM took 43.6s. Estimated remaining: 1h 44m 55s. Rate: 9.4 symbols/min [2025-09-15T19:26:26.856488] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-15T19:26:26.920220] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-15T19:26:27.032373] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:27.052529] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:26:27.102306] [DEBUG] [LOCAL ] MO: Loaded 40494 existing records from primary storage. [2025-09-15T19:26:27.102508] [INFO ] [MAIN ] MO: Loaded 40494 existing records. [2025-09-15T19:26:27.179596] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:27.207056] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-15T19:26:27.286252] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:27.286493] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-15T19:26:27.286546] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-15T19:26:27.287623] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-15T19:26:27.287715] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-15T19:26:27.646059] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:27.657834] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-15T19:26:27.790335] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T19:26:28.457879] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-15T19:26:29.205524] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:26:29.257815] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-15T19:26:30.057895] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-15T19:26:30.203487] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T19:26:30.857889] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-15T19:26:31.068468] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T19:26:31.099112] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T19:26:31.325162] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:26:31.657882] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-15T19:26:32.457902] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-15T19:26:32.650442] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:26:32.653270] [INFO ] [REMOTE ] MNR: Full fetch complete (28024 records). [2025-09-15T19:26:32.653344] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-15T19:26:33.017977] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-15T19:26:33.018066] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-15T19:26:33.018661] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-15T19:26:33.018704] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-15T19:26:33.019534] [DEBUG] [LOCAL ] MNR: Trimmed 28024 records to 18562 (keeping 150 days of data) [2025-09-15T19:26:33.136942] [DEBUG] [LOCAL ] MNR: Primary data saved (18562 records). [2025-09-15T19:26:33.137085] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-15T19:26:33.137168] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNR took 14.6s. Estimated remaining: 1h 44m 48s. Rate: 9.4 symbols/min [2025-09-15T19:26:33.263087] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-15T19:26:33.316588] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:33.353717] [DEBUG] [LOCAL ] MOD: Loaded 33695 existing records from primary storage. [2025-09-15T19:26:33.354337] [INFO ] [MAIN ] MOD: Loaded 33695 existing records. [2025-09-15T19:26:33.539282] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:33.539551] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-15T19:26:33.539602] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-15T19:26:33.540389] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-15T19:26:33.540438] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-15T19:26:33.914113] [INFO ] [REMOTE ] MOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:33.937332] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:26:34.057884] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-15T19:26:34.447878] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:26:34.857904] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-15T19:26:35.657911] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-15T19:26:35.769606] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:26:36.457910] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-15T19:26:36.909672] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T19:26:36.952240] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T19:26:37.257892] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-15T19:26:37.957212] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:26:38.057918] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-15T19:26:38.532483] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:26:38.857869] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-15T19:26:39.579410] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:26:39.657825] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-15T19:26:40.225176] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T19:26:40.457875] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-15T19:26:41.043807] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:26:41.048802] [INFO ] [REMOTE ] MNSO: Full fetch complete (48527 records). [2025-09-15T19:26:41.048974] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-15T19:26:41.267889] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-15T19:26:41.441504] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-15T19:26:41.441587] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-15T19:26:41.442373] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-15T19:26:41.442419] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-15T19:26:41.443415] [DEBUG] [LOCAL ] MNSO: Trimmed 48527 records to 31713 (keeping 150 days of data) [2025-09-15T19:26:41.646141] [DEBUG] [LOCAL ] MNSO: Primary data saved (31713 records). [2025-09-15T19:26:41.646295] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-15T19:26:41.646907] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MNSO took 20.7s. Estimated remaining: 1h 44m 44s. Rate: 9.4 symbols/min [2025-09-15T19:26:41.826435] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:41.840503] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:26:41.845808] [INFO ] [REMOTE ] MNTN: Full fetch complete (22988 records). [2025-09-15T19:26:41.845950] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-15T19:26:42.043506] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 79 unique days, need 150 days [2025-09-15T19:26:42.058286] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-15T19:26:42.058156] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:26:42.058551] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:26:42.059598] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-15T19:26:42.060874] [DEBUG] [LOCAL ] MODG: Loaded 38900 existing records from primary storage. [2025-09-15T19:26:42.061025] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-15T19:26:42.061214] [INFO ] [MAIN ] MODG: Loaded 38900 existing records. [2025-09-15T19:26:42.061281] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-15T19:26:42.118617] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-15T19:26:42.164486] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MNTN took 16.6s. Estimated remaining: 1h 44m 33s. Rate: 9.4 symbols/min [2025-09-15T19:26:42.396442] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:42.421277] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:42.421455] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-15T19:26:42.421784] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-15T19:26:42.422599] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-15T19:26:42.422705] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-15T19:26:42.731898] [DEBUG] [LOCAL ] MOH: Loaded 32109 existing records from primary storage. [2025-09-15T19:26:42.742573] [INFO ] [MAIN ] MOH: Loaded 32109 existing records. [2025-09-15T19:26:42.872767] [INFO ] [REMOTE ] MODG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:42.895821] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-15T19:26:43.011016] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:43.011426] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-15T19:26:43.011511] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-15T19:26:43.061519] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-15T19:26:43.079214] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-15T19:26:43.155072] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:26:43.467480] [INFO ] [REMOTE ] MOH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:43.657879] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-15T19:26:44.119721] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T19:26:44.457961] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-15T19:26:44.665287] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T19:26:45.135490] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:26:45.257958] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-15T19:26:45.917914] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:26:46.057873] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-15T19:26:46.692803] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:26:46.857937] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-15T19:26:47.244519] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:26:47.657874] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-15T19:26:48.266884] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T19:26:48.457939] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-15T19:26:49.257938] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-15T19:26:49.737660] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:26:49.855496] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-15T19:26:50.057940] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-15T19:26:50.857895] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-15T19:26:51.008177] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T19:26:51.180709] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:26:51.185573] [INFO ] [REMOTE ] MOD: Full fetch complete (50372 records). [2025-09-15T19:26:51.185690] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-15T19:26:51.576835] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-15T19:26:51.576923] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-15T19:26:51.577766] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-15T19:26:51.577811] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-15T19:26:51.578910] [DEBUG] [LOCAL ] MOD: Trimmed 50372 records to 32979 (keeping 150 days of data) [2025-09-15T19:26:51.671192] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-15T19:26:51.787844] [DEBUG] [LOCAL ] MOD: Primary data saved (32979 records). [2025-09-15T19:26:51.787992] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-15T19:26:51.788085] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MOD took 18.7s. Estimated remaining: 1h 44m 29s. Rate: 9.4 symbols/min [2025-09-15T19:26:51.959533] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:51.997659] [DEBUG] [LOCAL ] MOS: Loaded 40283 existing records from primary storage. [2025-09-15T19:26:51.997809] [INFO ] [MAIN ] MOS: Loaded 40283 existing records. [2025-09-15T19:26:52.173931] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:52.174227] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-15T19:26:52.174273] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-15T19:26:52.175312] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-15T19:26:52.175363] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-15T19:26:52.462978] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-15T19:26:52.524414] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:52.705749] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T19:26:52.956843] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T19:26:53.257937] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-15T19:26:53.804684] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:26:54.057950] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-15T19:26:54.865970] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-15T19:26:54.869024] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T19:26:55.664482] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-15T19:26:55.669888] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:26:56.033230] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:26:56.457873] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-15T19:26:57.257925] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-15T19:26:57.509406] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:26:57.517472] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-15T19:26:57.517692] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-15T19:26:57.926118] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-15T19:26:57.926251] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-15T19:26:57.927133] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-15T19:26:57.927181] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-15T19:26:57.928452] [DEBUG] [LOCAL ] MO: Trimmed 58433 records to 39714 (keeping 150 days of data) [2025-09-15T19:26:58.057886] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-15T19:26:58.193194] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:26:58.226923] [DEBUG] [LOCAL ] MO: Primary data saved (39714 records). [2025-09-15T19:26:58.227078] [INFO ] [MAIN ] MO: Full history saved. [2025-09-15T19:26:58.228273] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MO took 31.4s. Estimated remaining: 1h 44m 23s. Rate: 9.4 symbols/min [2025-09-15T19:26:58.398404] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:58.416426] [DEBUG] [LOCAL ] MOV: Loaded 15954 existing records from primary storage. [2025-09-15T19:26:58.416564] [INFO ] [MAIN ] MOV: Loaded 15954 existing records. [2025-09-15T19:26:58.593229] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:58.593448] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-15T19:26:58.593494] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-15T19:26:58.594018] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-15T19:26:58.594069] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-15T19:26:58.866275] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-15T19:26:58.956557] [INFO ] [REMOTE ] MOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:59.082356] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T19:26:59.156999] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:26:59.657931] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-15T19:27:00.438971] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T19:27:00.460800] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-15T19:27:00.462689] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:27:01.257873] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-15T19:27:02.057885] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-15T19:27:02.857886] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-15T19:27:03.762320] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-15T19:27:03.773394] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-15T19:27:04.362452] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-09-15T19:27:04.457875] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-15T19:27:05.031769] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-15T19:27:05.257888] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-15T19:27:05.288042] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T19:27:05.515659] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (3.46 seconds). [2025-09-15T19:27:05.972444] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T19:27:06.057848] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-15T19:27:06.244055] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:27:06.857876] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-15T19:27:07.569987] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T19:27:07.657884] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-15T19:27:07.853881] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:27:08.457872] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-15T19:27:09.252405] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T19:27:09.263207] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-15T19:27:09.715809] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:27:09.721584] [INFO ] [REMOTE ] MODG: Full fetch complete (56156 records). [2025-09-15T19:27:09.721740] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-15T19:27:10.063040] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-15T19:27:10.103885] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-15T19:27:10.104015] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-15T19:27:10.108678] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-15T19:27:10.109000] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-15T19:27:10.116682] [DEBUG] [LOCAL ] MODG: Trimmed 56156 records to 38153 (keeping 150 days of data) [2025-09-15T19:27:10.125608] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:27:10.352050] [DEBUG] [LOCAL ] MODG: Primary data saved (38153 records). [2025-09-15T19:27:10.352200] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-15T19:27:10.352821] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MODG took 28.7s. Estimated remaining: 1h 44m 20s. Rate: 9.4 symbols/min [2025-09-15T19:27:10.521770] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:10.564435] [DEBUG] [LOCAL ] MP: Loaded 40484 existing records from primary storage. [2025-09-15T19:27:10.564617] [INFO ] [MAIN ] MP: Loaded 40484 existing records. [2025-09-15T19:27:10.740006] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:10.740293] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-15T19:27:10.740339] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-15T19:27:10.741260] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-15T19:27:10.741313] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-15T19:27:10.863065] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-15T19:27:11.100943] [INFO ] [REMOTE ] MP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:11.657880] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-15T19:27:11.906318] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T19:27:12.457839] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-15T19:27:12.540960] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T19:27:12.546255] [INFO ] [REMOTE ] MOH: Full fetch complete (45402 records). [2025-09-15T19:27:12.546346] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-15T19:27:12.928994] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-15T19:27:12.929114] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-15T19:27:12.930473] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-15T19:27:12.930522] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-15T19:27:12.931925] [DEBUG] [LOCAL ] MOH: Trimmed 45402 records to 31518 (keeping 150 days of data) [2025-09-15T19:27:13.134271] [DEBUG] [LOCAL ] MOH: Primary data saved (31518 records). [2025-09-15T19:27:13.134546] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-15T19:27:13.134706] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOH took 31.0s. Estimated remaining: 1h 44m 12s. Rate: 9.4 symbols/min [2025-09-15T19:27:13.260276] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-15T19:27:13.311588] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:13.342850] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T19:27:13.357630] [DEBUG] [LOCAL ] MPA: Loaded 4029 existing records from primary storage. [2025-09-15T19:27:13.357754] [INFO ] [MAIN ] MPA: Loaded 4029 existing records. [2025-09-15T19:27:13.533493] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:13.533753] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-15T19:27:13.533801] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-15T19:27:13.534029] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-15T19:27:13.534076] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-15T19:27:13.879789] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:14.057864] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-15T19:27:14.723768] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:27:14.857822] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-15T19:27:15.092567] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:27:15.095393] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-15T19:27:15.657924] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-15T19:27:16.322260] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:27:16.457923] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-15T19:27:16.937740] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T19:27:17.200441] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:27:17.209533] [INFO ] [REMOTE ] MOS: Full fetch complete (58190 records). [2025-09-15T19:27:17.209774] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-15T19:27:17.262964] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-15T19:27:17.813044] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-15T19:27:17.813201] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-15T19:27:17.814847] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-15T19:27:17.814996] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-15T19:27:17.816976] [DEBUG] [LOCAL ] MOS: Trimmed 58190 records to 39505 (keeping 150 days of data) [2025-09-15T19:27:18.085867] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-15T19:27:18.160234] [DEBUG] [LOCAL ] MOS: Primary data saved (39505 records). [2025-09-15T19:27:18.160409] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-15T19:27:18.161251] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MOS took 26.4s. Estimated remaining: 1h 44m 4s. Rate: 9.4 symbols/min [2025-09-15T19:27:18.375922] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:18.421443] [DEBUG] [LOCAL ] MPC: Loaded 39139 existing records from primary storage. [2025-09-15T19:27:18.421599] [INFO ] [MAIN ] MPC: Loaded 39139 existing records. [2025-09-15T19:27:18.607217] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:18.607487] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-15T19:27:18.607534] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-15T19:27:18.608327] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-15T19:27:18.608379] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-15T19:27:18.864782] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-15T19:27:18.970289] [INFO ] [REMOTE ] MPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:18.981246] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:27:18.985934] [INFO ] [REMOTE ] MOV: Full fetch complete (24068 records). [2025-09-15T19:27:18.986227] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-15T19:27:19.411007] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-15T19:27:19.411335] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-15T19:27:19.411673] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-15T19:27:19.428239] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-15T19:27:19.429062] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-15T19:27:19.430291] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:27:19.434810] [DEBUG] [LOCAL ] MOV: Trimmed 24068 records to 15399 (keeping 150 days of data) [2025-09-15T19:27:19.535474] [DEBUG] [LOCAL ] MOV: Primary data saved (15399 records). [2025-09-15T19:27:19.535654] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-15T19:27:19.535791] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MOV took 21.3s. Estimated remaining: 1h 43m 54s. Rate: 9.4 symbols/min [2025-09-15T19:27:19.663063] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-15T19:27:19.717143] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:19.761212] [DEBUG] [LOCAL ] MPLX: Loaded 37896 existing records from primary storage. [2025-09-15T19:27:19.761365] [INFO ] [MAIN ] MPLX: Loaded 37896 existing records. [2025-09-15T19:27:19.936974] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:19.937243] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-15T19:27:19.937290] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-15T19:27:19.938154] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-15T19:27:19.938205] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-15T19:27:20.281886] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:27:20.306701] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:20.457873] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-15T19:27:21.257934] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-15T19:27:21.841655] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:27:22.057915] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-15T19:27:22.664572] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:27:22.687424] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:27:22.857929] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-15T19:27:23.657922] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-15T19:27:24.457928] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-15T19:27:24.642400] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T19:27:25.257900] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-15T19:27:25.397929] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:27:25.747304] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T19:27:26.057896] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-15T19:27:26.566204] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T19:27:26.857934] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-15T19:27:27.385144] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:27:27.657880] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-15T19:27:27.737476] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:27:28.457909] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-15T19:27:29.234420] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:27:29.257811] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-15T19:27:30.057873] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-15T19:27:30.603809] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:27:30.605316] [INFO ] [REMOTE ] MPA: Full fetch complete (5663 records). [2025-09-15T19:27:30.607499] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T19:27:30.618197] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-15T19:27:30.828162] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T19:27:30.862912] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-15T19:27:31.039182] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-15T19:27:31.039261] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-15T19:27:31.039419] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-15T19:27:31.039457] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-15T19:27:31.039859] [DEBUG] [LOCAL ] MPA: Trimmed 5663 records to 3946 (keeping 150 days of data) [2025-09-15T19:27:31.064473] [DEBUG] [LOCAL ] MPA: Primary data saved (3946 records). [2025-09-15T19:27:31.064550] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-15T19:27:31.064626] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MPA took 17.9s. Estimated remaining: 1h 43m 52s. Rate: 9.4 symbols/min [2025-09-15T19:27:31.232448] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:31.237696] [DEBUG] [LOCAL ] MPV: Loaded 3390 existing records from primary storage. [2025-09-15T19:27:31.237788] [INFO ] [MAIN ] MPV: Loaded 3390 existing records. [2025-09-15T19:27:31.422098] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:31.422407] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-15T19:27:31.422459] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-15T19:27:31.422734] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-15T19:27:31.422784] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-15T19:27:31.667966] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-15T19:27:31.781129] [INFO ] [REMOTE ] MPV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:32.457856] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-15T19:27:32.522281] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:27:33.257943] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-15T19:27:33.782539] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T19:27:33.977138] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:27:34.057862] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-15T19:27:34.857992] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-15T19:27:35.070355] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T19:27:35.300359] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T19:27:35.657864] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-15T19:27:35.710757] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:27:36.221860] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T19:27:36.457861] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-15T19:27:37.257905] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-15T19:27:37.771005] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:27:38.057865] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-15T19:27:38.208799] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T19:27:38.857906] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-15T19:27:39.603733] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:27:39.657887] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-15T19:27:40.257055] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:27:40.457938] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-15T19:27:40.714911] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T19:27:40.720591] [INFO ] [REMOTE ] MPLX: Full fetch complete (55407 records). [2025-09-15T19:27:40.720728] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-15T19:27:41.107681] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-15T19:27:41.107857] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-15T19:27:41.108882] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-15T19:27:41.108954] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-15T19:27:41.116377] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:27:41.119456] [DEBUG] [LOCAL ] MPLX: Trimmed 55407 records to 37164 (keeping 150 days of data) [2025-09-15T19:27:41.290371] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-15T19:27:41.352733] [DEBUG] [LOCAL ] MPLX: Primary data saved (37164 records). [2025-09-15T19:27:41.352862] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-15T19:27:41.353906] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPLX took 21.8s. Estimated remaining: 1h 43m 48s. Rate: 9.4 symbols/min [2025-09-15T19:27:41.521892] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:41.562071] [DEBUG] [LOCAL ] MPW: Loaded 40288 existing records from primary storage. [2025-09-15T19:27:41.562214] [INFO ] [MAIN ] MPW: Loaded 40288 existing records. [2025-09-15T19:27:41.748743] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:41.749062] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-15T19:27:41.749124] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-15T19:27:41.749956] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-15T19:27:41.750024] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-15T19:27:42.062952] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-15T19:27:42.143926] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:42.529988] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T19:27:42.857887] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-15T19:27:43.067184] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:27:43.657909] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-15T19:27:44.131971] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T19:27:44.457877] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-15T19:27:44.557264] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:27:45.257875] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-15T19:27:46.057899] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-15T19:27:46.453448] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T19:27:46.843846] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:27:46.857825] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-15T19:27:47.411511] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:27:47.417322] [INFO ] [REMOTE ] MPC: Full fetch complete (56784 records). [2025-09-15T19:27:47.417432] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-15T19:27:47.663708] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-15T19:27:47.817153] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-15T19:27:47.817256] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-15T19:27:47.818177] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-15T19:27:47.818235] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-15T19:27:47.819532] [DEBUG] [LOCAL ] MPC: Trimmed 56784 records to 38350 (keeping 150 days of data) [2025-09-15T19:27:48.073704] [DEBUG] [LOCAL ] MPC: Primary data saved (38350 records). [2025-09-15T19:27:48.073881] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-15T19:27:48.074870] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MPC took 29.9s. Estimated remaining: 1h 43m 42s. Rate: 9.4 symbols/min [2025-09-15T19:27:48.247290] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:48.251966] [DEBUG] [LOCAL ] MPX: Loaded 2890 existing records from primary storage. [2025-09-15T19:27:48.252049] [INFO ] [MAIN ] MPX: Loaded 2890 existing records. [2025-09-15T19:27:48.434139] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:48.434549] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-15T19:27:48.434608] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-15T19:27:48.434914] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-15T19:27:48.434966] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-15T19:27:48.469045] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-15T19:27:48.803143] [INFO ] [REMOTE ] MPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:48.841559] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T19:27:48.939696] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:27:48.941598] [INFO ] [REMOTE ] MPV: Full fetch complete (5855 records). [2025-09-15T19:27:48.941712] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-15T19:27:49.270528] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-15T19:27:49.310484] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-15T19:27:49.310566] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-15T19:27:49.310755] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-15T19:27:49.310800] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-15T19:27:49.311234] [DEBUG] [LOCAL ] MPV: Trimmed 5855 records to 3301 (keeping 150 days of data) [2025-09-15T19:27:49.334472] [DEBUG] [LOCAL ] MPV: Primary data saved (3301 records). [2025-09-15T19:27:49.334625] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-15T19:27:49.334758] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPV took 18.3s. Estimated remaining: 1h 43m 32s. Rate: 9.4 symbols/min [2025-09-15T19:27:49.503227] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:49.510523] [DEBUG] [LOCAL ] MQT: Loaded 5655 existing records from primary storage. [2025-09-15T19:27:49.510612] [INFO ] [MAIN ] MQT: Loaded 5655 existing records. [2025-09-15T19:27:49.684798] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:49.685054] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-15T19:27:49.685101] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-15T19:27:49.685376] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-15T19:27:49.685422] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-15T19:27:50.034954] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:27:50.056909] [INFO ] [REMOTE ] MQT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:50.059203] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-15T19:27:50.151322] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-15T19:27:50.531619] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:27:50.857902] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-15T19:27:51.484282] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T19:27:51.657890] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-15T19:27:52.132862] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:27:52.457866] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-15T19:27:53.185198] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:27:53.257837] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-15T19:27:54.057885] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-15T19:27:54.857886] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-15T19:27:55.441604] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T19:27:55.545685] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:27:55.573523] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T19:27:55.580519] [INFO ] [REMOTE ] MP: Full fetch complete (58249 records). [2025-09-15T19:27:55.580656] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-15T19:27:55.663071] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-15T19:27:55.969884] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-15T19:27:55.970040] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-15T19:27:55.971314] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-15T19:27:55.971365] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-15T19:27:55.973180] [DEBUG] [LOCAL ] MP: Trimmed 58249 records to 39704 (keeping 150 days of data) [2025-09-15T19:27:56.243201] [DEBUG] [LOCAL ] MP: Primary data saved (39704 records). [2025-09-15T19:27:56.243445] [INFO ] [MAIN ] MP: Full history saved. [2025-09-15T19:27:56.244091] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MP took 45.9s. Estimated remaining: 1h 43m 26s. Rate: 9.4 symbols/min [2025-09-15T19:27:56.355366] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T19:27:56.431568] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:56.451889] [DEBUG] [LOCAL ] MQY: Loaded 11827 existing records from primary storage. [2025-09-15T19:27:56.452086] [INFO ] [MAIN ] MQY: Loaded 11827 existing records. [2025-09-15T19:27:56.463243] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-15T19:27:56.636215] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:56.636520] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-15T19:27:56.636568] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-15T19:27:56.637022] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-15T19:27:56.637071] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-15T19:27:56.929494] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T19:27:57.007496] [INFO ] [REMOTE ] MQY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:57.257893] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-15T19:27:58.057932] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-15T19:27:58.276910] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T19:27:58.857870] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-15T19:27:59.039618] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:27:59.040580] [INFO ] [REMOTE ] MPX: Full fetch complete (4838 records). [2025-09-15T19:27:59.040674] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-15T19:27:59.391360] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-15T19:27:59.391441] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-15T19:27:59.391591] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-15T19:27:59.391628] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-15T19:27:59.392009] [DEBUG] [LOCAL ] MPX: Trimmed 4838 records to 2844 (keeping 150 days of data) [2025-09-15T19:27:59.409300] [DEBUG] [LOCAL ] MPX: Primary data saved (2844 records). [2025-09-15T19:27:59.409359] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-15T19:27:59.409445] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MPX took 11.3s. Estimated remaining: 1h 43m 17s. Rate: 9.4 symbols/min [2025-09-15T19:27:59.586154] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:59.616354] [DEBUG] [LOCAL ] MRC: Loaded 27384 existing records from primary storage. [2025-09-15T19:27:59.616499] [INFO ] [MAIN ] MRC: Loaded 27384 existing records. [2025-09-15T19:27:59.660504] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-15T19:27:59.729613] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:27:59.811230] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:59.811501] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-15T19:27:59.811562] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-15T19:27:59.812158] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-15T19:27:59.812222] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-15T19:28:00.174084] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:00.457910] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-15T19:28:00.779465] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T19:28:01.257898] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-15T19:28:01.794304] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:28:02.057874] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-15T19:28:02.857891] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-15T19:28:02.916694] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:28:03.469887] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:28:03.657876] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-15T19:28:03.828382] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T19:28:04.457882] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-15T19:28:04.964235] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:28:05.166844] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T19:28:05.257905] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-15T19:28:05.709680] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:28:06.057896] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-15T19:28:06.752135] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:28:06.857877] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-15T19:28:07.440292] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:28:07.657903] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-15T19:28:08.457874] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-15T19:28:09.202430] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:28:09.257882] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-15T19:28:09.415161] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:28:10.057873] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-15T19:28:10.575120] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:28:10.771188] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T19:28:10.857868] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-15T19:28:11.447842] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:28:11.449664] [INFO ] [REMOTE ] MQT: Full fetch complete (9431 records). [2025-09-15T19:28:11.449764] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-15T19:28:11.662941] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-15T19:28:11.809225] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-15T19:28:11.809365] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-15T19:28:11.809603] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-15T19:28:11.809671] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-15T19:28:11.810150] [DEBUG] [LOCAL ] MQT: Trimmed 9431 records to 5280 (keeping 150 days of data) [2025-09-15T19:28:11.842868] [DEBUG] [LOCAL ] MQT: Primary data saved (5280 records). [2025-09-15T19:28:11.842978] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-15T19:28:11.843061] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MQT took 22.5s. Estimated remaining: 1h 43m 15s. Rate: 9.4 symbols/min [2025-09-15T19:28:12.011001] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:12.053570] [DEBUG] [LOCAL ] MRK: Loaded 40530 existing records from primary storage. [2025-09-15T19:28:12.053729] [INFO ] [MAIN ] MRK: Loaded 40530 existing records. [2025-09-15T19:28:12.229344] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:12.229630] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-15T19:28:12.229698] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-15T19:28:12.230735] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-15T19:28:12.230786] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-15T19:28:12.468258] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-15T19:28:12.580117] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:28:12.603624] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:13.257873] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-15T19:28:14.013228] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T19:28:14.057823] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-15T19:28:14.857868] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-15T19:28:15.158146] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T19:28:15.275229] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:28:15.657927] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-15T19:28:16.457935] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-15T19:28:16.765138] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T19:28:16.802608] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:28:17.186355] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T19:28:17.257882] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-15T19:28:18.057921] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-15T19:28:18.857885] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-15T19:28:19.145221] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T19:28:19.150996] [INFO ] [REMOTE ] MPW: Full fetch complete (58153 records). [2025-09-15T19:28:19.151102] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-15T19:28:19.533207] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-15T19:28:19.533297] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-15T19:28:19.534245] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-15T19:28:19.534295] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-15T19:28:19.535545] [DEBUG] [LOCAL ] MPW: Trimmed 58153 records to 39513 (keeping 150 days of data) [2025-09-15T19:28:19.659600] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-15T19:28:19.783959] [DEBUG] [LOCAL ] MPW: Primary data saved (39513 records). [2025-09-15T19:28:19.784155] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-15T19:28:19.785882] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MPW took 38.4s. Estimated remaining: 1h 43m 10s. Rate: 9.4 symbols/min [2025-09-15T19:28:19.898989] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T19:28:20.457890] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-15T19:28:20.762208] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-15T19:28:21.257867] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-15T19:28:21.628710] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T19:28:21.632295] [INFO ] [REMOTE ] MRC: Full fetch complete (41114 records). [2025-09-15T19:28:21.632385] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-15T19:28:22.017241] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-15T19:28:22.017335] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-15T19:28:22.018056] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-15T19:28:22.018102] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-15T19:28:22.018965] [DEBUG] [LOCAL ] MRC: Trimmed 41114 records to 26794 (keeping 150 days of data) [2025-09-15T19:28:22.178020] [DEBUG] [LOCAL ] MRC: Primary data saved (26794 records). [2025-09-15T19:28:22.178161] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-15T19:28:22.178245] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MRC took 22.8s. Estimated remaining: 1h 43m 1s. Rate: 9.4 symbols/min [2025-09-15T19:28:22.323504] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T19:28:22.326294] [INFO ] [REMOTE ] MQY: Full fetch complete (18403 records). [2025-09-15T19:28:22.326368] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-15T19:28:22.691758] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-15T19:28:22.691902] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-15T19:28:22.692375] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-15T19:28:22.692431] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-15T19:28:22.693283] [DEBUG] [LOCAL ] MQY: Trimmed 18403 records to 11648 (keeping 150 days of data) [2025-09-15T19:28:22.765266] [DEBUG] [LOCAL ] MQY: Primary data saved (11648 records). [2025-09-15T19:28:22.765416] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-15T19:28:22.765501] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MQY took 26.5s. Estimated remaining: 1h 42m 50s. Rate: 9.4 symbols/min [2025-09-15T19:28:23.383075] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T19:28:23.394398] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-15T19:28:25.065017] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:28:25.076461] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-15T19:28:27.082709] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T19:28:27.093613] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-15T19:28:29.088510] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T19:28:29.100789] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-15T19:28:31.125805] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T19:28:31.140168] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-15T19:28:33.001277] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T19:28:33.008241] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-15T19:28:33.008408] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-15T19:28:33.389197] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-15T19:28:33.389277] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-15T19:28:33.390195] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-15T19:28:33.390243] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-15T19:28:33.391419] [DEBUG] [LOCAL ] MRK: Trimmed 58469 records to 39751 (keeping 150 days of data) [2025-09-15T19:28:33.644130] [DEBUG] [LOCAL ] MRK: Primary data saved (39751 records). [2025-09-15T19:28:33.644290] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-15T19:28:33.644375] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 21.8s. Estimated remaining: 1h 42m 47s. Rate: 9.4 symbols/min [2025-09-15T19:28:34.242853] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.243678] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.340227] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.375233] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.396973] [DEBUG] [LOCAL ] MSB: Loaded 6124 existing records from primary storage. [2025-09-15T19:28:34.397227] [INFO ] [MAIN ] MSB: Loaded 6124 existing records. [2025-09-15T19:28:34.510758] [DEBUG] [LOCAL ] MRP: Loaded 34842 existing records from primary storage. [2025-09-15T19:28:34.531270] [INFO ] [MAIN ] MRP: Loaded 34842 existing records. [2025-09-15T19:28:34.527755] [DEBUG] [LOCAL ] MSA: Loaded 14092 existing records from primary storage. [2025-09-15T19:28:34.541755] [INFO ] [MAIN ] MSA: Loaded 14092 existing records. [2025-09-15T19:28:34.619110] [DEBUG] [LOCAL ] MS: Loaded 40437 existing records from primary storage. [2025-09-15T19:28:34.708021] [INFO ] [MAIN ] MS: Loaded 40437 existing records. [2025-09-15T19:28:34.775844] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:34.868442] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-15T19:28:34.938824] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-15T19:28:35.037240] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-15T19:28:35.088299] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.159693] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-15T19:28:35.159818] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.164547] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.164830] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.185086] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.175659] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-15T19:28:35.205713] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.235088] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-15T19:28:35.205757] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-15T19:28:35.229936] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-15T19:28:35.240416] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-15T19:28:35.251487] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-15T19:28:35.251597] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-15T19:28:35.268269] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-15T19:28:35.268210] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-15T19:28:36.406402] [INFO ] [REMOTE ] MSB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.475214] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-15T19:28:36.603972] [INFO ] [REMOTE ] MRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.675501] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-15T19:28:36.718598] [INFO ] [REMOTE ] MS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.738981] [INFO ] [REMOTE ] MSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.739882] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-15T19:28:36.739555] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-15T19:28:37.247173] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:28:37.250217] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-15T19:28:37.665003] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T19:28:37.668699] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-15T19:28:37.839123] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:28:37.841607] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-15T19:28:38.138762] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:28:38.147873] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-15T19:28:38.348241] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:28:38.367668] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-15T19:28:38.385432] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:28:38.396532] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-15T19:28:38.410334] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:28:38.414448] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-15T19:28:38.966438] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:28:38.969308] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-15T19:28:39.377913] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:28:39.380309] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-15T19:28:39.461073] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:28:39.471526] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-15T19:28:39.580315] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:28:39.585977] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-15T19:28:39.844093] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T19:28:39.855633] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-15T19:28:39.954965] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:28:39.957805] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-15T19:28:40.217128] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:28:40.223807] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-15T19:28:40.548090] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:28:40.551747] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-15T19:28:40.858785] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:28:41.025006] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:28:41.026274] [INFO ] [REMOTE ] MSB: Full fetch complete (9194 records). [2025-09-15T19:28:41.026344] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-15T19:28:41.268911] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-15T19:28:41.412869] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:28:41.413066] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-15T19:28:41.417396] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-15T19:28:41.418319] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-15T19:28:41.418382] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-15T19:28:41.419118] [DEBUG] [LOCAL ] MSB: Trimmed 9194 records to 5948 (keeping 150 days of data) [2025-09-15T19:28:41.456393] [DEBUG] [LOCAL ] MSB: Primary data saved (5948 records). [2025-09-15T19:28:41.456591] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-15T19:28:41.456761] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSB took 7.8s. Estimated remaining: 1h 42m 42s. Rate: 9.4 symbols/min [2025-09-15T19:28:41.643002] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:41.655467] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-15T19:28:41.655524] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-15T19:28:41.656177] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-15T19:28:41.657139] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T19:28:41.657264] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-15T19:28:41.667771] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-15T19:28:41.668101] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-15T19:28:42.027103] [INFO ] [REMOTE ] MSC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:42.057816] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-15T19:28:42.538425] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:28:42.606628] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T19:28:42.857921] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-15T19:28:43.197321] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T19:28:43.657956] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-15T19:28:44.457926] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-15T19:28:45.127475] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:28:45.257870] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-15T19:28:45.440762] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T19:28:46.057900] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-15T19:28:46.790620] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:28:46.857842] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-15T19:28:46.932098] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T19:28:47.657888] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-15T19:28:48.418150] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:28:48.457892] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-15T19:28:48.728745] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-15T19:28:48.979608] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:28:49.257945] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-15T19:28:50.057924] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-15T19:28:50.220084] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:28:50.222545] [INFO ] [REMOTE ] MSA: Full fetch complete (20247 records). [2025-09-15T19:28:50.222618] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-15T19:28:50.401188] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T19:28:50.590966] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-15T19:28:50.591072] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-15T19:28:50.591563] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-15T19:28:50.591631] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-15T19:28:50.592544] [DEBUG] [LOCAL ] MSA: Trimmed 20247 records to 13825 (keeping 150 days of data) [2025-09-15T19:28:50.680176] [DEBUG] [LOCAL ] MSA: Primary data saved (13825 records). [2025-09-15T19:28:50.680337] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-15T19:28:50.680431] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSA took 17.0s. Estimated remaining: 1h 42m 37s. Rate: 9.4 symbols/min [2025-09-15T19:28:50.850013] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:50.857930] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-15T19:28:50.878690] [DEBUG] [LOCAL ] MSCI: Loaded 25461 existing records from primary storage. [2025-09-15T19:28:50.878848] [INFO ] [MAIN ] MSCI: Loaded 25461 existing records. [2025-09-15T19:28:51.059288] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:51.059690] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-15T19:28:51.059767] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-15T19:28:51.060481] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-15T19:28:51.060530] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-15T19:28:51.410137] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:51.657859] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-15T19:28:52.462991] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-15T19:28:52.486489] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:28:52.634036] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T19:28:53.257931] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-15T19:28:54.057982] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-15T19:28:54.104468] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:28:54.110630] [INFO ] [REMOTE ] MRP: Full fetch complete (51803 records). [2025-09-15T19:28:54.110881] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-15T19:28:54.384626] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T19:28:54.506861] [DEBUG] [VALIDATOR ] MRP: All expected trading days are present. [2025-09-15T19:28:54.506954] [DEBUG] [VALIDATOR ] MRP: Primary data validation passed. [2025-09-15T19:28:54.508142] [INFO ] [MAIN ] MRP: Fetched primary data is valid. [2025-09-15T19:28:54.508192] [DEBUG] [LOCAL ] MRP: Saving primary data. [2025-09-15T19:28:54.509393] [DEBUG] [LOCAL ] MRP: Trimmed 51803 records to 34180 (keeping 150 days of data) [2025-09-15T19:28:54.726671] [DEBUG] [LOCAL ] MRP: Primary data saved (34180 records). [2025-09-15T19:28:54.726831] [INFO ] [MAIN ] MRP: Full history saved. [2025-09-15T19:28:54.726954] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MRP took 21.1s. Estimated remaining: 1h 42m 29s. Rate: 9.4 symbols/min [2025-09-15T19:28:54.867500] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-15T19:28:54.899490] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:54.913243] [DEBUG] [LOCAL ] MSD: Loaded 12044 existing records from primary storage. [2025-09-15T19:28:54.913384] [INFO ] [MAIN ] MSD: Loaded 12044 existing records. [2025-09-15T19:28:55.095692] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:55.096123] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-15T19:28:55.096256] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-15T19:28:55.096747] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-15T19:28:55.096804] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-15T19:28:55.257470] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T19:28:55.515693] [INFO ] [REMOTE ] MSD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:55.657824] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-15T19:28:56.381902] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:28:56.457871] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-15T19:28:56.533580] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:28:57.257924] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-15T19:28:57.796064] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:28:58.057922] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-15T19:28:58.163789] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T19:28:58.857894] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-15T19:28:59.578991] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:28:59.657883] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-15T19:28:59.830550] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T19:29:00.457880] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-15T19:29:00.744306] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T19:29:01.141532] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T19:29:01.257875] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-15T19:29:01.846722] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:29:02.057872] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-15T19:29:02.857865] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-15T19:29:03.657841] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-15T19:29:03.725693] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:29:03.731574] [INFO ] [REMOTE ] MS: Full fetch complete (58374 records). [2025-09-15T19:29:03.731727] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-15T19:29:04.106827] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:29:04.126044] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-15T19:29:04.126149] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-15T19:29:04.127154] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-15T19:29:04.127219] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-15T19:29:04.128697] [DEBUG] [LOCAL ] MS: Trimmed 58374 records to 39657 (keeping 150 days of data) [2025-09-15T19:29:04.252397] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:29:04.422557] [DEBUG] [LOCAL ] MS: Primary data saved (39657 records). [2025-09-15T19:29:04.422742] [INFO ] [MAIN ] MS: Full history saved. [2025-09-15T19:29:04.422857] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MS took 30.8s. Estimated remaining: 1h 42m 25s. Rate: 9.4 symbols/min [2025-09-15T19:29:04.463420] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-15T19:29:04.596891] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:04.623835] [DEBUG] [LOCAL ] MSDL: Loaded 27502 existing records from primary storage. [2025-09-15T19:29:04.623972] [INFO ] [MAIN ] MSDL: Loaded 27502 existing records. [2025-09-15T19:29:04.797525] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:04.797863] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-15T19:29:04.797912] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-15T19:29:04.798575] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-15T19:29:04.798624] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-15T19:29:05.152173] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:05.257931] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-15T19:29:05.516101] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:29:06.057870] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-15T19:29:06.314626] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T19:29:06.857881] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-15T19:29:06.949315] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:29:07.657832] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-15T19:29:07.922094] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-15T19:29:08.142021] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:29:08.457916] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-15T19:29:09.257963] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-15T19:29:09.808306] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:29:09.809361] [INFO ] [REMOTE ] MSC: Full fetch complete (1880 records). [2025-09-15T19:29:09.809429] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-15T19:29:09.996616] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T19:29:09.996900] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:29:09.996984] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:29:09.997103] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-15T19:29:09.997196] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-15T19:29:09.997261] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-15T19:29:09.997320] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-15T19:29:09.997390] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSC took 28.5s. Estimated remaining: 1h 42m 18s. Rate: 9.4 symbols/min [2025-09-15T19:29:10.058710] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-15T19:29:10.218802] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:10.223990] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T19:29:10.250221] [DEBUG] [LOCAL ] MSGE: Loaded 19384 existing records from primary storage. [2025-09-15T19:29:10.250386] [INFO ] [MAIN ] MSGE: Loaded 19384 existing records. [2025-09-15T19:29:10.425104] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:10.425371] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-15T19:29:10.425421] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-15T19:29:10.425945] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-15T19:29:10.425997] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-15T19:29:10.775800] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:10.857822] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-15T19:29:11.040420] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:29:11.043050] [INFO ] [REMOTE ] MSD: Full fetch complete (16731 records). [2025-09-15T19:29:11.043136] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-15T19:29:11.422625] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-15T19:29:11.422736] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-15T19:29:11.423109] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-15T19:29:11.423159] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-15T19:29:11.423848] [DEBUG] [LOCAL ] MSD: Trimmed 16731 records to 11977 (keeping 150 days of data) [2025-09-15T19:29:11.491771] [DEBUG] [LOCAL ] MSD: Primary data saved (11977 records). [2025-09-15T19:29:11.491901] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-15T19:29:11.491987] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSD took 16.8s. Estimated remaining: 1h 42m 9s. Rate: 9.4 symbols/min [2025-09-15T19:29:11.667863] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:11.664699] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-15T19:29:11.682017] [DEBUG] [LOCAL ] MSGS: Loaded 12313 existing records from primary storage. [2025-09-15T19:29:11.682138] [INFO ] [MAIN ] MSGS: Loaded 12313 existing records. [2025-09-15T19:29:11.866972] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:11.867208] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-15T19:29:11.867255] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-15T19:29:11.867700] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-15T19:29:11.867751] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-15T19:29:12.242543] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:12.265150] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T19:29:12.457873] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-15T19:29:13.001444] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:29:13.257856] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-15T19:29:13.279836] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:29:14.057866] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-15T19:29:14.420674] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:29:14.857932] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-15T19:29:15.373534] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:29:15.378256] [INFO ] [REMOTE ] MSCI: Full fetch complete (37965 records). [2025-09-15T19:29:15.378344] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-15T19:29:15.663032] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-15T19:29:15.773547] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-15T19:29:15.773637] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-15T19:29:15.774467] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-15T19:29:15.774526] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-15T19:29:15.775466] [DEBUG] [LOCAL ] MSCI: Trimmed 37965 records to 25068 (keeping 150 days of data) [2025-09-15T19:29:15.943816] [DEBUG] [LOCAL ] MSCI: Primary data saved (25068 records). [2025-09-15T19:29:15.943997] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-15T19:29:15.944219] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSCI took 25.3s. Estimated remaining: 1h 42m 1s. Rate: 9.4 symbols/min [2025-09-15T19:29:16.078815] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:29:16.156988] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:16.189062] [DEBUG] [LOCAL ] MSI: Loaded 30154 existing records from primary storage. [2025-09-15T19:29:16.189230] [INFO ] [MAIN ] MSI: Loaded 30154 existing records. [2025-09-15T19:29:16.363506] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:16.363849] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-15T19:29:16.363901] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-15T19:29:16.364798] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-15T19:29:16.364853] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-15T19:29:16.463467] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-15T19:29:16.723946] [INFO ] [REMOTE ] MSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:16.747091] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T19:29:17.201575] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T19:29:17.257842] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-15T19:29:18.057884] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-15T19:29:18.213262] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T19:29:18.857843] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-15T19:29:18.939382] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:29:19.443364] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:29:19.657893] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-15T19:29:20.457889] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-15T19:29:20.816393] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T19:29:21.008187] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:29:21.257941] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-15T19:29:22.057890] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-15T19:29:22.450617] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:29:22.857951] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-15T19:29:23.589170] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:29:23.668231] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-15T19:29:23.681380] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:29:24.457912] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-15T19:29:25.173937] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:29:25.257860] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-15T19:29:25.399896] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:29:26.057890] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-15T19:29:26.574915] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T19:29:26.857888] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-15T19:29:27.062211] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:29:27.065765] [INFO ] [REMOTE ] MSGE: Full fetch complete (29282 records). [2025-09-15T19:29:27.065852] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-15T19:29:27.464565] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-15T19:29:27.464871] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-15T19:29:27.466122] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-15T19:29:27.466190] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-15T19:29:27.467296] [DEBUG] [LOCAL ] MSGE: Trimmed 29282 records to 19047 (keeping 150 days of data) [2025-09-15T19:29:27.598814] [DEBUG] [LOCAL ] MSGE: Primary data saved (19047 records). [2025-09-15T19:29:27.599127] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-15T19:29:27.599287] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSGE took 17.6s. Estimated remaining: 1h 41m 58s. Rate: 9.4 symbols/min [2025-09-15T19:29:27.668231] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-15T19:29:27.789769] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:27.804058] [DEBUG] [LOCAL ] MSIF: Loaded 10482 existing records from primary storage. [2025-09-15T19:29:27.804427] [INFO ] [MAIN ] MSIF: Loaded 10482 existing records. [2025-09-15T19:29:27.995977] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:27.996320] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-15T19:29:27.996372] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-15T19:29:27.996864] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-15T19:29:27.996922] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-15T19:29:28.401468] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:28.436682] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:29:28.457825] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-15T19:29:28.708244] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T19:29:29.257925] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-15T19:29:29.523146] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:29:30.059114] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-15T19:29:30.060923] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:29:30.857853] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-15T19:29:31.331736] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:29:31.657889] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-15T19:29:31.938112] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:29:32.457882] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-15T19:29:32.548724] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:29:33.257932] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-15T19:29:33.978601] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:29:34.057870] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-15T19:29:34.593942] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:29:34.857883] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-15T19:29:35.037908] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:29:35.042220] [INFO ] [REMOTE ] MSI: Full fetch complete (44511 records). [2025-09-15T19:29:35.042331] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-15T19:29:35.419123] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-15T19:29:35.419244] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-15T19:29:35.420142] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-15T19:29:35.420200] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-15T19:29:35.422614] [DEBUG] [LOCAL ] MSI: Trimmed 44511 records to 29648 (keeping 150 days of data) [2025-09-15T19:29:35.622120] [DEBUG] [LOCAL ] MSI: Primary data saved (29648 records). [2025-09-15T19:29:35.622246] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-15T19:29:35.622402] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSI took 19.7s. Estimated remaining: 1h 41m 53s. Rate: 9.4 symbols/min [2025-09-15T19:29:35.664915] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-15T19:29:35.792920] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:35.819337] [DEBUG] [LOCAL ] MSM: Loaded 25777 existing records from primary storage. [2025-09-15T19:29:35.819479] [INFO ] [MAIN ] MSM: Loaded 25777 existing records. [2025-09-15T19:29:35.993864] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:35.994106] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-15T19:29:35.994152] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-15T19:29:35.994979] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-15T19:29:35.995031] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-15T19:29:36.347907] [INFO ] [REMOTE ] MSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:36.459036] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-15T19:29:36.460780] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:29:36.465626] [INFO ] [REMOTE ] MSDL: Full fetch complete (41567 records). [2025-09-15T19:29:36.465738] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-15T19:29:36.806264] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:29:36.874541] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-15T19:29:36.874625] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-15T19:29:36.875467] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-15T19:29:36.875512] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-15T19:29:36.876400] [DEBUG] [LOCAL ] MSDL: Trimmed 41567 records to 27074 (keeping 150 days of data) [2025-09-15T19:29:37.052272] [DEBUG] [LOCAL ] MSDL: Primary data saved (27074 records). [2025-09-15T19:29:37.052416] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-15T19:29:37.052525] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSDL took 32.6s. Estimated remaining: 1h 41m 43s. Rate: 9.4 symbols/min [2025-09-15T19:29:37.233277] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:37.234140] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:29:37.260942] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-15T19:29:37.277806] [DEBUG] [LOCAL ] MT: Loaded 37882 existing records from primary storage. [2025-09-15T19:29:37.277942] [INFO ] [MAIN ] MT: Loaded 37882 existing records. [2025-09-15T19:29:37.455715] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:37.456007] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-15T19:29:37.456067] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-15T19:29:37.457102] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-15T19:29:37.457159] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-15T19:29:37.804373] [INFO ] [REMOTE ] MT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:38.057858] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-15T19:29:38.572163] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:29:38.857882] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-15T19:29:39.596509] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:29:39.657832] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-15T19:29:40.130437] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:29:40.457935] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-15T19:29:41.016202] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:29:41.257897] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-15T19:29:41.771943] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:29:41.803904] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:29:42.057928] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-15T19:29:42.857839] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-15T19:29:43.109790] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:29:43.112445] [INFO ] [REMOTE ] MSGS: Full fetch complete (17715 records). [2025-09-15T19:29:43.112515] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-15T19:29:43.490948] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-15T19:29:43.491060] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-15T19:29:43.491499] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-15T19:29:43.491552] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-15T19:29:43.492333] [DEBUG] [LOCAL ] MSGS: Trimmed 17715 records to 12220 (keeping 150 days of data) [2025-09-15T19:29:43.572823] [DEBUG] [LOCAL ] MSGS: Primary data saved (12220 records). [2025-09-15T19:29:43.572961] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-15T19:29:43.573066] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSGS took 32.1s. Estimated remaining: 1h 41m 37s. Rate: 9.4 symbols/min [2025-09-15T19:29:43.663077] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-15T19:29:43.755707] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:43.784830] [DEBUG] [LOCAL ] MTAL: Loaded 27726 existing records from primary storage. [2025-09-15T19:29:43.784967] [INFO ] [MAIN ] MTAL: Loaded 27726 existing records. [2025-09-15T19:29:43.964305] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:43.964603] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-15T19:29:43.964687] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-15T19:29:43.965315] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-15T19:29:43.965363] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-15T19:29:44.337561] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:44.358975] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T19:29:44.418779] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:29:44.457835] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-15T19:29:45.257884] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-15T19:29:45.700553] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:29:46.057869] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-15T19:29:46.229793] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:29:46.741050] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T19:29:46.857879] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-15T19:29:47.657906] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-15T19:29:48.183315] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:29:48.457889] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-15T19:29:48.610636] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T19:29:49.246188] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:29:49.257806] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-15T19:29:50.057839] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-15T19:29:50.191079] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T19:29:50.857849] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-15T19:29:51.267052] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:29:51.657928] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-15T19:29:52.395401] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T19:29:52.457850] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-15T19:29:53.107864] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:29:53.257861] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-15T19:29:53.916079] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:29:54.005084] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T19:29:54.057838] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-15T19:29:54.857928] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-15T19:29:55.114709] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:29:55.118830] [INFO ] [REMOTE ] MSM: Full fetch complete (38155 records). [2025-09-15T19:29:55.118920] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-15T19:29:55.492750] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-15T19:29:55.492830] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-15T19:29:55.493498] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-15T19:29:55.493538] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-15T19:29:55.494427] [DEBUG] [LOCAL ] MSM: Trimmed 38155 records to 25248 (keeping 150 days of data) [2025-09-15T19:29:55.652171] [DEBUG] [LOCAL ] MSM: Primary data saved (25248 records). [2025-09-15T19:29:55.652305] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-15T19:29:55.652390] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSM took 20.0s. Estimated remaining: 1h 41m 35s. Rate: 9.4 symbols/min [2025-09-15T19:29:55.663014] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-15T19:29:55.825148] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:55.862674] [DEBUG] [LOCAL ] MTB: Loaded 35024 existing records from primary storage. [2025-09-15T19:29:55.862823] [INFO ] [MAIN ] MTB: Loaded 35024 existing records. [2025-09-15T19:29:56.042533] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:56.042957] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-15T19:29:56.043094] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-15T19:29:56.044122] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-15T19:29:56.044261] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-15T19:29:56.174573] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T19:29:56.430296] [INFO ] [REMOTE ] MTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:56.457818] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-15T19:29:57.128736] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T19:29:57.135204] [INFO ] [REMOTE ] MT: Full fetch complete (55428 records). [2025-09-15T19:29:57.135409] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-15T19:29:57.263143] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-15T19:29:57.533660] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-15T19:29:57.533803] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-15T19:29:57.535780] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-15T19:29:57.535840] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-15T19:29:57.537574] [DEBUG] [LOCAL ] MT: Trimmed 55428 records to 37095 (keeping 150 days of data) [2025-09-15T19:29:57.789910] [DEBUG] [LOCAL ] MT: Primary data saved (37095 records). [2025-09-15T19:29:57.790075] [INFO ] [MAIN ] MT: Full history saved. [2025-09-15T19:29:57.790929] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MT took 20.7s. Estimated remaining: 1h 41m 25s. Rate: 9.4 symbols/min [2025-09-15T19:29:57.957915] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:57.972062] [DEBUG] [LOCAL ] MTD: Loaded 11405 existing records from primary storage. [2025-09-15T19:29:57.972221] [INFO ] [MAIN ] MTD: Loaded 11405 existing records. [2025-09-15T19:29:58.062779] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-15T19:29:58.155832] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:58.156236] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-15T19:29:58.156371] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-15T19:29:58.156868] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-15T19:29:58.157015] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-15T19:29:58.428922] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T19:29:58.481167] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:29:58.486564] [INFO ] [REMOTE ] MSIF: Full fetch complete (14315 records). [2025-09-15T19:29:58.502208] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-15T19:29:58.651274] [INFO ] [REMOTE ] MTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:58.863028] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-15T19:29:58.936189] [DEBUG] [VALIDATOR ] MSIF: All expected trading days are present. [2025-09-15T19:29:58.936265] [DEBUG] [VALIDATOR ] MSIF: Primary data validation passed. [2025-09-15T19:29:58.936586] [INFO ] [MAIN ] MSIF: Fetched primary data is valid. [2025-09-15T19:29:58.936624] [DEBUG] [LOCAL ] MSIF: Saving primary data. [2025-09-15T19:29:58.937465] [DEBUG] [LOCAL ] MSIF: Trimmed 14315 records to 10557 (keeping 150 days of data) [2025-09-15T19:29:59.005813] [DEBUG] [LOCAL ] MSIF: Primary data saved (10557 records). [2025-09-15T19:29:59.006005] [INFO ] [MAIN ] MSIF: Full history saved. [2025-09-15T19:29:59.006113] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MSIF took 31.4s. Estimated remaining: 1h 41m 16s. Rate: 9.4 symbols/min [2025-09-15T19:29:59.177502] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:59.199676] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:29:59.242237] [DEBUG] [LOCAL ] MTDR: Loaded 38772 existing records from primary storage. [2025-09-15T19:29:59.242441] [INFO ] [MAIN ] MTDR: Loaded 38772 existing records. [2025-09-15T19:29:59.418383] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:59.418683] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-15T19:29:59.418735] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-15T19:29:59.419678] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-15T19:29:59.419749] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-15T19:29:59.664763] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-15T19:29:59.720245] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:29:59.798855] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:00.457944] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-15T19:30:00.857348] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:30:01.257957] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-15T19:30:01.517995] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:30:02.057918] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-15T19:30:02.114202] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T19:30:02.857914] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-15T19:30:03.657889] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-15T19:30:04.350260] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-15T19:30:04.457909] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-15T19:30:04.548830] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:30:05.257887] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-15T19:30:06.057876] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-15T19:30:06.266306] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-15T19:30:06.655446] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T19:30:06.857876] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-15T19:30:06.988988] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:30:07.095990] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T19:30:07.657874] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-15T19:30:08.333087] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:30:08.457877] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-15T19:30:08.968554] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:30:09.257893] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-15T19:30:09.852321] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:30:10.057897] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-15T19:30:10.857882] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-15T19:30:10.992814] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T19:30:11.301608] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:30:11.657866] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-15T19:30:12.117988] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:30:12.457872] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-15T19:30:13.041067] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:30:13.257894] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-15T19:30:13.856989] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T19:30:13.861670] [INFO ] [REMOTE ] MTAL: Full fetch complete (38017 records). [2025-09-15T19:30:13.861769] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-15T19:30:14.067832] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-15T19:30:14.235779] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-15T19:30:14.235881] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-15T19:30:14.236712] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-15T19:30:14.236760] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-15T19:30:14.237833] [DEBUG] [LOCAL ] MTAL: Trimmed 38017 records to 27153 (keeping 150 days of data) [2025-09-15T19:30:14.401831] [DEBUG] [LOCAL ] MTAL: Primary data saved (27153 records). [2025-09-15T19:30:14.402022] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-15T19:30:14.402119] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MTAL took 30.8s. Estimated remaining: 1h 41m 15s. Rate: 9.4 symbols/min [2025-09-15T19:30:14.590323] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:14.627958] [DEBUG] [LOCAL ] MTG: Loaded 38305 existing records from primary storage. [2025-09-15T19:30:14.628213] [INFO ] [MAIN ] MTG: Loaded 38305 existing records. [2025-09-15T19:30:14.834934] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:14.835929] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-15T19:30:14.836437] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-15T19:30:14.839722] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T19:30:14.849512] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-15T19:30:14.850044] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-15T19:30:14.861765] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-15T19:30:14.930554] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:30:15.215474] [INFO ] [REMOTE ] MTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:15.657898] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-15T19:30:16.005853] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:30:16.457943] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-15T19:30:17.257958] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-15T19:30:17.482172] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T19:30:17.607525] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:30:18.057876] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-15T19:30:18.857987] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-15T19:30:19.096816] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:30:19.102026] [INFO ] [REMOTE ] MTB: Full fetch complete (51241 records). [2025-09-15T19:30:19.102151] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-15T19:30:19.504500] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-15T19:30:19.512344] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-15T19:30:19.514220] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:30:19.513842] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-15T19:30:19.517531] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-15T19:30:19.518865] [DEBUG] [LOCAL ] MTB: Trimmed 51241 records to 34251 (keeping 150 days of data) [2025-09-15T19:30:19.695095] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-15T19:30:19.751731] [DEBUG] [LOCAL ] MTB: Primary data saved (34251 records). [2025-09-15T19:30:19.751902] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-15T19:30:19.752556] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTB took 24.1s. Estimated remaining: 1h 41m 8s. Rate: 9.4 symbols/min [2025-09-15T19:30:19.932182] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:19.967261] [DEBUG] [LOCAL ] MTH: Loaded 32732 existing records from primary storage. [2025-09-15T19:30:19.967426] [INFO ] [MAIN ] MTH: Loaded 32732 existing records. [2025-09-15T19:30:20.156178] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:20.157304] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-15T19:30:20.157370] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-15T19:30:20.158509] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-15T19:30:20.158576] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-15T19:30:20.467889] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-15T19:30:20.528952] [INFO ] [REMOTE ] MTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:20.561655] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T19:30:20.596245] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:30:20.598004] [INFO ] [REMOTE ] MTD: Full fetch complete (16731 records). [2025-09-15T19:30:20.598091] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-15T19:30:20.961129] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-15T19:30:20.961211] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-15T19:30:20.961573] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-15T19:30:20.961611] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-15T19:30:20.962155] [DEBUG] [LOCAL ] MTD: Trimmed 16731 records to 11010 (keeping 150 days of data) [2025-09-15T19:30:21.031404] [DEBUG] [LOCAL ] MTD: Primary data saved (11010 records). [2025-09-15T19:30:21.031533] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-15T19:30:21.031617] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTD took 23.2s. Estimated remaining: 1h 40m 58s. Rate: 9.4 symbols/min [2025-09-15T19:30:21.205539] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:21.240214] [DEBUG] [LOCAL ] MTN: Loaded 29044 existing records from primary storage. [2025-09-15T19:30:21.240378] [INFO ] [MAIN ] MTN: Loaded 29044 existing records. [2025-09-15T19:30:21.263099] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-15T19:30:21.422202] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:21.422483] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-15T19:30:21.422544] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-15T19:30:21.423301] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-15T19:30:21.423365] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-15T19:30:21.772143] [INFO ] [REMOTE ] MTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:21.868331] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:30:22.057925] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-15T19:30:22.776528] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T19:30:22.782278] [INFO ] [REMOTE ] MTDR: Full fetch complete (55914 records). [2025-09-15T19:30:22.782419] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-15T19:30:22.862953] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-15T19:30:23.188486] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-15T19:30:23.188589] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-15T19:30:23.189669] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-15T19:30:23.189728] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-15T19:30:23.191068] [DEBUG] [LOCAL ] MTDR: Trimmed 55914 records to 37997 (keeping 150 days of data) [2025-09-15T19:30:23.440818] [DEBUG] [LOCAL ] MTDR: Primary data saved (37997 records). [2025-09-15T19:30:23.441006] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-15T19:30:23.441110] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTDR took 24.4s. Estimated remaining: 1h 40m 49s. Rate: 9.4 symbols/min [2025-09-15T19:30:23.597305] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:30:23.654712] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:23.658393] [DEBUG] [LOCAL ] MTR: Loaded 1606 existing records from primary storage. [2025-09-15T19:30:23.658237] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-15T19:30:23.658536] [INFO ] [MAIN ] MTR: Loaded 1606 existing records. [2025-09-15T19:30:23.843853] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:23.844115] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-15T19:30:23.844207] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-15T19:30:23.844409] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-15T19:30:23.844457] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-15T19:30:24.208368] [INFO ] [REMOTE ] MTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:24.437717] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:30:24.457821] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-15T19:30:25.248201] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:30:25.257830] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-15T19:30:26.057848] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-15T19:30:26.172146] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T19:30:26.663875] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T19:30:26.857902] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-15T19:30:27.273349] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:30:27.329909] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T19:30:27.657875] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-15T19:30:27.979314] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T19:30:28.457888] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-15T19:30:28.870377] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:30:29.257879] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-15T19:30:30.057935] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-15T19:30:30.661510] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T19:30:30.857879] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-15T19:30:31.657949] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-15T19:30:31.796890] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:30:32.017266] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T19:30:32.418874] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:30:32.457856] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-15T19:30:33.257899] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-15T19:30:34.007895] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T19:30:34.057816] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-15T19:30:34.620872] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:30:34.857866] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-15T19:30:35.381391] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:30:35.657880] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-15T19:30:36.072212] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T19:30:36.457882] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-15T19:30:37.135522] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:30:37.257875] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-15T19:30:37.756906] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:30:38.057906] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-15T19:30:38.611827] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T19:30:38.857917] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-15T19:30:39.372937] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:30:39.657893] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-15T19:30:39.926433] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:30:40.142682] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T19:30:40.457934] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-15T19:30:40.907208] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:30:41.257914] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-15T19:30:42.057942] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-15T19:30:42.573470] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:30:42.578378] [INFO ] [REMOTE ] MTN: Full fetch complete (42302 records). [2025-09-15T19:30:42.578520] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-15T19:30:42.866450] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-15T19:30:42.965566] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-15T19:30:42.965689] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-15T19:30:42.966456] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-15T19:30:42.966501] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-15T19:30:42.967662] [DEBUG] [LOCAL ] MTN: Trimmed 42302 records to 28572 (keeping 150 days of data) [2025-09-15T19:30:43.157503] [DEBUG] [LOCAL ] MTN: Primary data saved (28572 records). [2025-09-15T19:30:43.157683] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-15T19:30:43.157798] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTN took 22.1s. Estimated remaining: 1h 40m 52s. Rate: 9.4 symbols/min [2025-09-15T19:30:43.331057] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:43.348339] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:30:43.354605] [INFO ] [REMOTE ] MTH: Full fetch complete (47970 records). [2025-09-15T19:30:43.354755] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-15T19:30:43.495440] [DEBUG] [LOCAL ] MTRN: Loaded 13788 existing records from primary storage. [2025-09-15T19:30:43.501461] [INFO ] [MAIN ] MTRN: Loaded 13788 existing records. [2025-09-15T19:30:43.673733] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-15T19:30:43.879837] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:43.917394] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-15T19:30:43.933453] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-15T19:30:43.943763] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-15T19:30:43.943863] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-15T19:30:44.159403] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:30:44.215563] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-15T19:30:44.228835] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-15T19:30:44.230782] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-15T19:30:44.247337] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-15T19:30:44.364999] [DEBUG] [LOCAL ] MTH: Trimmed 47970 records to 32137 (keeping 150 days of data) [2025-09-15T19:30:44.470084] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-15T19:30:44.510313] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:44.689827] [DEBUG] [LOCAL ] MTH: Primary data saved (32137 records). [2025-09-15T19:30:44.690407] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-15T19:30:44.692438] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTH took 24.9s. Estimated remaining: 1h 40m 42s. Rate: 9.4 symbols/min [2025-09-15T19:30:44.691738] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T19:30:44.875235] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:44.900818] [DEBUG] [LOCAL ] MTUS: Loaded 21091 existing records from primary storage. [2025-09-15T19:30:44.900945] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T19:30:44.901850] [INFO ] [REMOTE ] MTR: Full fetch complete (1926 records). [2025-09-15T19:30:44.901937] [INFO ] [MAIN ] MTUS: Loaded 21091 existing records. [2025-09-15T19:30:44.902026] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-15T19:30:45.272629] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-15T19:30:45.290914] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:45.376072] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-15T19:30:45.379564] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-15T19:30:45.385687] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-15T19:30:45.396039] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-15T19:30:45.544335] [DEBUG] [VALIDATOR ] MTR: All expected trading days are present. [2025-09-15T19:30:45.563182] [DEBUG] [VALIDATOR ] MTR: Primary data validation passed. [2025-09-15T19:30:45.565779] [INFO ] [MAIN ] MTR: Fetched primary data is valid. [2025-09-15T19:30:45.566125] [DEBUG] [LOCAL ] MTR: Saving primary data. [2025-09-15T19:30:45.582328] [DEBUG] [LOCAL ] MTR: Trimmed 1926 records to 1586 (keeping 150 days of data) [2025-09-15T19:30:45.652259] [DEBUG] [LOCAL ] MTR: Primary data saved (1586 records). [2025-09-15T19:30:45.719109] [INFO ] [MAIN ] MTR: Full history saved. [2025-09-15T19:30:45.746057] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTR took 22.3s. Estimated remaining: 1h 40m 33s. Rate: 9.4 symbols/min [2025-09-15T19:30:45.936136] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:46.006408] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:46.026405] [DEBUG] [LOCAL ] MTW: Loaded 20093 existing records from primary storage. [2025-09-15T19:30:46.026568] [INFO ] [MAIN ] MTW: Loaded 20093 existing records. [2025-09-15T19:30:46.062928] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-15T19:30:46.216889] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:46.217333] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-15T19:30:46.217390] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-15T19:30:46.218115] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-15T19:30:46.218177] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-15T19:30:46.599519] [INFO ] [REMOTE ] MTW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:46.681728] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:30:46.794091] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:30:46.857886] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-15T19:30:47.657978] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-15T19:30:47.961417] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T19:30:48.237858] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:30:48.457911] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-15T19:30:49.257896] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-15T19:30:49.284217] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T19:30:50.057893] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-15T19:30:50.300746] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:30:50.857924] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-15T19:30:51.156083] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:30:51.657881] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-15T19:30:52.049201] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:30:52.054879] [INFO ] [REMOTE ] MTG: Full fetch complete (55864 records). [2025-09-15T19:30:52.055000] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-15T19:30:52.432523] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-15T19:30:52.432608] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-15T19:30:52.433497] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-15T19:30:52.433544] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-15T19:30:52.434763] [DEBUG] [LOCAL ] MTG: Trimmed 55864 records to 37536 (keeping 150 days of data) [2025-09-15T19:30:52.492414] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-15T19:30:52.701576] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T19:30:52.725325] [DEBUG] [LOCAL ] MTG: Primary data saved (37536 records). [2025-09-15T19:30:52.725706] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-15T19:30:52.727219] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTG took 38.3s. Estimated remaining: 1h 40m 27s. Rate: 9.4 symbols/min [2025-09-15T19:30:52.897683] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:52.915920] [DEBUG] [LOCAL ] MTX: Loaded 17744 existing records from primary storage. [2025-09-15T19:30:52.916054] [INFO ] [MAIN ] MTX: Loaded 17744 existing records. [2025-09-15T19:30:53.091511] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:53.091829] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-15T19:30:53.091878] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-15T19:30:53.092459] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-15T19:30:53.092509] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-15T19:30:53.263939] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-15T19:30:53.451303] [INFO ] [REMOTE ] MTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:53.631133] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:30:54.057835] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-15T19:30:54.402657] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:30:54.857838] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-15T19:30:54.917997] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:30:55.657884] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-15T19:30:55.771808] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T19:30:56.457858] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-15T19:30:56.831887] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T19:30:57.079939] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:30:57.257872] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-15T19:30:58.057905] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-15T19:30:58.125441] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:30:58.127440] [INFO ] [REMOTE ] MTRN: Full fetch complete (18849 records). [2025-09-15T19:30:58.127552] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-15T19:30:58.488030] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-15T19:30:58.488110] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-15T19:30:58.488507] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-15T19:30:58.488547] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-15T19:30:58.489145] [DEBUG] [LOCAL ] MTRN: Trimmed 18849 records to 13585 (keeping 150 days of data) [2025-09-15T19:30:58.581689] [DEBUG] [LOCAL ] MTRN: Primary data saved (13585 records). [2025-09-15T19:30:58.581917] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-15T19:30:58.582068] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTRN took 15.4s. Estimated remaining: 1h 40m 20s. Rate: 9.4 symbols/min [2025-09-15T19:30:58.759009] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:58.794023] [DEBUG] [LOCAL ] MTZ: Loaded 32078 existing records from primary storage. [2025-09-15T19:30:58.794228] [INFO ] [MAIN ] MTZ: Loaded 32078 existing records. [2025-09-15T19:30:58.862963] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-15T19:30:58.978093] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:58.978340] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-15T19:30:58.978387] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-15T19:30:58.979192] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-15T19:30:58.979253] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-15T19:30:59.343274] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:59.360164] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:30:59.657897] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-15T19:30:59.674963] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T19:31:00.457947] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-15T19:31:00.864830] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:31:01.257921] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-15T19:31:01.869816] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:31:02.057894] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-15T19:31:02.409692] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:31:02.857846] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-15T19:31:03.009523] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:31:03.657936] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-15T19:31:03.954109] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:31:04.457899] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-15T19:31:05.256944] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T19:31:05.266262] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-15T19:31:05.302472] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:31:06.057870] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-15T19:31:06.277299] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T19:31:06.857875] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-15T19:31:07.281694] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T19:31:07.657874] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-15T19:31:07.905119] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:31:08.457910] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-15T19:31:09.050610] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:31:09.257901] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-15T19:31:09.507434] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:31:10.057881] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-15T19:31:10.313181] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:31:10.857868] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-15T19:31:11.068600] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T19:31:11.071373] [INFO ] [REMOTE ] MTX: Full fetch complete (24968 records). [2025-09-15T19:31:11.071451] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-15T19:31:11.447879] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-15T19:31:11.447977] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-15T19:31:11.448565] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-15T19:31:11.448606] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-15T19:31:11.449373] [DEBUG] [LOCAL ] MTX: Trimmed 24968 records to 17395 (keeping 150 days of data) [2025-09-15T19:31:11.570512] [DEBUG] [LOCAL ] MTX: Primary data saved (17395 records). [2025-09-15T19:31:11.570677] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-15T19:31:11.570807] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTX took 18.8s. Estimated remaining: 1h 40m 18s. Rate: 9.4 symbols/min [2025-09-15T19:31:11.662925] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-15T19:31:11.744766] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:11.755186] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:31:11.762477] [INFO ] [REMOTE ] MTUS: Full fetch complete (31823 records). [2025-09-15T19:31:11.762656] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-15T19:31:11.834924] [DEBUG] [LOCAL ] MUA: Loaded 8490 existing records from primary storage. [2025-09-15T19:31:11.852063] [INFO ] [MAIN ] MUA: Loaded 8490 existing records. [2025-09-15T19:31:12.245533] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:12.248710] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-15T19:31:12.248814] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-15T19:31:12.265300] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-15T19:31:12.306710] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-15T19:31:12.438241] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-15T19:31:12.449178] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-15T19:31:12.459581] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-15T19:31:12.460506] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-15T19:31:12.465742] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-15T19:31:12.542554] [DEBUG] [LOCAL ] MTUS: Trimmed 31823 records to 20687 (keeping 150 days of data) [2025-09-15T19:31:12.791403] [INFO ] [REMOTE ] MUA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:12.827409] [DEBUG] [LOCAL ] MTUS: Primary data saved (20687 records). [2025-09-15T19:31:12.827534] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-15T19:31:12.827668] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MTUS took 28.1s. Estimated remaining: 1h 40m 8s. Rate: 9.4 symbols/min [2025-09-15T19:31:12.996775] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:13.012799] [DEBUG] [LOCAL ] MUC: Loaded 14665 existing records from primary storage. [2025-09-15T19:31:13.012970] [INFO ] [MAIN ] MUC: Loaded 14665 existing records. [2025-09-15T19:31:13.192865] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:13.193190] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-15T19:31:13.193467] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-15T19:31:13.193992] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-15T19:31:13.194102] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-15T19:31:13.262971] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-15T19:31:13.574966] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:13.577004] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T19:31:13.679867] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:31:13.780991] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T19:31:14.057870] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-15T19:31:14.857934] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-15T19:31:15.354515] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T19:31:15.657870] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-15T19:31:15.786956] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:31:16.457870] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-15T19:31:16.684837] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:31:17.257878] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-15T19:31:17.824743] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:31:17.875381] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:31:18.057857] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-15T19:31:18.857948] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-15T19:31:19.030296] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:31:19.657887] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-15T19:31:19.874514] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:31:19.877506] [INFO ] [REMOTE ] MTW: Full fetch complete (29429 records). [2025-09-15T19:31:19.877607] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-15T19:31:20.245758] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-15T19:31:20.245894] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-15T19:31:20.246573] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-15T19:31:20.247199] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-15T19:31:20.248252] [DEBUG] [LOCAL ] MTW: Trimmed 29429 records to 19697 (keeping 150 days of data) [2025-09-15T19:31:20.368309] [DEBUG] [LOCAL ] MTW: Primary data saved (19697 records). [2025-09-15T19:31:20.368462] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-15T19:31:20.368562] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MTW took 34.6s. Estimated remaining: 1h 40m 3s. Rate: 9.4 symbols/min [2025-09-15T19:31:20.458324] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-15T19:31:20.540498] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:20.554099] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:31:20.566003] [DEBUG] [LOCAL ] MUE: Loaded 9473 existing records from primary storage. [2025-09-15T19:31:20.566104] [INFO ] [MAIN ] MUE: Loaded 9473 existing records. [2025-09-15T19:31:20.745852] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:20.746149] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-15T19:31:20.746204] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-15T19:31:20.746581] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-15T19:31:20.746629] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-15T19:31:21.098625] [INFO ] [REMOTE ] MUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:21.257879] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-15T19:31:22.057860] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-15T19:31:22.206065] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:31:22.282322] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T19:31:22.479341] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:31:22.857953] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-15T19:31:23.657904] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-15T19:31:24.457981] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-15T19:31:24.534971] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:31:24.565462] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:31:25.037816] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:31:25.257879] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-15T19:31:26.057893] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-15T19:31:26.101561] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:31:26.857878] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-15T19:31:26.969783] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:31:27.657924] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-15T19:31:28.075714] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:31:28.080931] [INFO ] [REMOTE ] MTZ: Full fetch complete (47569 records). [2025-09-15T19:31:28.081023] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-15T19:31:28.329258] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:31:28.469891] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-15T19:31:28.487443] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-15T19:31:28.487534] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-15T19:31:28.488444] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-15T19:31:28.488506] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-15T19:31:28.489900] [DEBUG] [LOCAL ] MTZ: Trimmed 47569 records to 31459 (keeping 150 days of data) [2025-09-15T19:31:28.694684] [DEBUG] [LOCAL ] MTZ: Primary data saved (31459 records). [2025-09-15T19:31:28.694834] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-15T19:31:28.694945] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MTZ took 30.1s. Estimated remaining: 1h 39m 57s. Rate: 9.4 symbols/min [2025-09-15T19:31:28.867219] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:28.910211] [DEBUG] [LOCAL ] MUFG: Loaded 39562 existing records from primary storage. [2025-09-15T19:31:28.910402] [INFO ] [MAIN ] MUFG: Loaded 39562 existing records. [2025-09-15T19:31:29.087696] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:29.088048] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-15T19:31:29.088096] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-15T19:31:29.089041] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-15T19:31:29.089093] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-15T19:31:29.271139] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:31:29.270455] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-15T19:31:29.456844] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:30.057884] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-15T19:31:30.108082] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:31:30.697669] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T19:31:30.857888] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-15T19:31:31.657904] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-15T19:31:31.722121] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:31:32.457927] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-15T19:31:32.634295] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T19:31:33.257886] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-15T19:31:33.972372] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T19:31:34.020260] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T19:31:34.057858] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-15T19:31:34.857922] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-15T19:31:35.657838] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-15T19:31:35.698008] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:31:35.723965] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:31:35.725798] [INFO ] [REMOTE ] MUA: Full fetch complete (13602 records). [2025-09-15T19:31:35.725872] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-15T19:31:36.080412] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-15T19:31:36.080488] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-15T19:31:36.080799] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-15T19:31:36.080840] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-15T19:31:36.081335] [DEBUG] [LOCAL ] MUA: Trimmed 13602 records to 8367 (keeping 150 days of data) [2025-09-15T19:31:36.134471] [DEBUG] [LOCAL ] MUA: Primary data saved (8367 records). [2025-09-15T19:31:36.134595] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-15T19:31:36.134707] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MUA took 24.6s. Estimated remaining: 1h 39m 52s. Rate: 9.4 symbols/min [2025-09-15T19:31:36.305478] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:36.316568] [DEBUG] [LOCAL ] MUJ: Loaded 10212 existing records from primary storage. [2025-09-15T19:31:36.316692] [INFO ] [MAIN ] MUJ: Loaded 10212 existing records. [2025-09-15T19:31:36.463983] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-15T19:31:36.491856] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:36.492010] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-15T19:31:36.492054] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-15T19:31:36.492487] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-15T19:31:36.492535] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-15T19:31:36.825231] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T19:31:36.866357] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:37.257866] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-15T19:31:37.334244] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:31:37.872242] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:31:38.057885] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-15T19:31:38.861778] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-15T19:31:38.862791] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:31:39.657874] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-15T19:31:39.740284] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:31:40.457892] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-15T19:31:40.644632] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:31:40.647499] [INFO ] [REMOTE ] MUC: Full fetch complete (21393 records). [2025-09-15T19:31:40.647580] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-15T19:31:41.011469] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-15T19:31:41.011560] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-15T19:31:41.012077] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-15T19:31:41.012122] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-15T19:31:41.012744] [DEBUG] [LOCAL ] MUC: Trimmed 21393 records to 14348 (keeping 150 days of data) [2025-09-15T19:31:41.098980] [DEBUG] [LOCAL ] MUC: Primary data saved (14348 records). [2025-09-15T19:31:41.099112] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-15T19:31:41.099203] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUC took 28.3s. Estimated remaining: 1h 39m 45s. Rate: 9.4 symbols/min [2025-09-15T19:31:41.268357] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:41.265336] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-15T19:31:41.310111] [DEBUG] [LOCAL ] MUR: Loaded 39754 existing records from primary storage. [2025-09-15T19:31:41.310247] [INFO ] [MAIN ] MUR: Loaded 39754 existing records. [2025-09-15T19:31:41.492559] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:41.492866] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-15T19:31:41.492914] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-15T19:31:41.493941] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-15T19:31:41.493995] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-15T19:31:41.868403] [INFO ] [REMOTE ] MUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:42.064518] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-15T19:31:42.088359] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:31:42.158616] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:31:42.160592] [INFO ] [REMOTE ] MUE: Full fetch complete (12507 records). [2025-09-15T19:31:42.160687] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-15T19:31:42.517608] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-15T19:31:42.517704] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-15T19:31:42.518003] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-15T19:31:42.518048] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-15T19:31:42.518532] [DEBUG] [LOCAL ] MUE: Trimmed 12507 records to 9308 (keeping 150 days of data) [2025-09-15T19:31:42.575717] [DEBUG] [LOCAL ] MUE: Primary data saved (9308 records). [2025-09-15T19:31:42.575886] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-15T19:31:42.575977] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUE took 22.2s. Estimated remaining: 1h 39m 35s. Rate: 9.4 symbols/min [2025-09-15T19:31:42.756266] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:42.767505] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:31:42.787211] [DEBUG] [LOCAL ] MUSA: Loaded 18803 existing records from primary storage. [2025-09-15T19:31:42.787341] [INFO ] [MAIN ] MUSA: Loaded 18803 existing records. [2025-09-15T19:31:42.863049] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-15T19:31:42.998794] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:42.999041] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-15T19:31:42.999086] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-15T19:31:42.999631] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-15T19:31:42.999711] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-15T19:31:43.351676] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:43.657881] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-15T19:31:44.457839] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-15T19:31:44.704705] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:31:44.855898] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T19:31:45.232395] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:31:45.257823] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-15T19:31:45.977372] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:31:46.057907] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-15T19:31:46.857876] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-15T19:31:47.226343] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:31:47.657863] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-15T19:31:48.408734] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:31:48.457855] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-15T19:31:48.598492] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T19:31:49.257880] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-15T19:31:49.926423] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:31:50.057871] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-15T19:31:50.857885] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-15T19:31:50.945059] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T19:31:50.999232] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T19:31:51.657919] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-15T19:31:52.251697] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:31:52.457910] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-15T19:31:53.114071] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:31:53.257869] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-15T19:31:54.057829] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-15T19:31:54.178914] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T19:31:54.523022] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T19:31:54.857874] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-15T19:31:55.503547] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:31:55.516403] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:31:55.657866] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-15T19:31:56.457921] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-15T19:31:57.163374] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:31:57.166117] [INFO ] [REMOTE ] MUJ: Full fetch complete (13883 records). [2025-09-15T19:31:57.166217] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-15T19:31:57.268183] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-15T19:31:57.551304] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-15T19:31:57.551473] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-15T19:31:57.552082] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-15T19:31:57.552172] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-15T19:31:57.552827] [DEBUG] [LOCAL ] MUJ: Trimmed 13883 records to 10188 (keeping 150 days of data) [2025-09-15T19:31:57.650592] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T19:31:57.668070] [DEBUG] [LOCAL ] MUJ: Primary data saved (10188 records). [2025-09-15T19:31:57.668345] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-15T19:31:57.668451] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUJ took 21.5s. Estimated remaining: 1h 39m 34s. Rate: 9.4 symbols/min [2025-09-15T19:31:57.839840] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:57.840068] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-15T19:31:57.840109] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-15T19:31:57.840231] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-15T19:31:57.840272] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-15T19:31:57.840316] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-15T19:31:57.840351] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-15T19:31:58.063009] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-15T19:31:58.196206] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:58.214597] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:31:58.857906] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-15T19:31:59.113033] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:31:59.113378] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-15T19:31:59.657868] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-15T19:31:59.793548] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:31:59.799231] [INFO ] [REMOTE ] MUFG: Full fetch complete (57152 records). [2025-09-15T19:31:59.799330] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-15T19:32:00.180193] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-15T19:32:00.180286] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-15T19:32:00.181256] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-15T19:32:00.181347] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-15T19:32:00.182695] [DEBUG] [LOCAL ] MUFG: Trimmed 57152 records to 38767 (keeping 150 days of data) [2025-09-15T19:32:00.424069] [DEBUG] [LOCAL ] MUFG: Primary data saved (38767 records). [2025-09-15T19:32:00.424282] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-15T19:32:00.424414] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUFG took 31.7s. Estimated remaining: 1h 39m 26s. Rate: 9.4 symbols/min [2025-09-15T19:32:00.464847] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-15T19:32:00.616865] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:00.648487] [DEBUG] [LOCAL ] MUX: Loaded 31410 existing records from primary storage. [2025-09-15T19:32:00.648661] [INFO ] [MAIN ] MUX: Loaded 31410 existing records. [2025-09-15T19:32:00.841144] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:00.841960] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-15T19:32:00.842496] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:32:00.842603] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-15T19:32:00.848946] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-15T19:32:00.849005] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-15T19:32:00.958485] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T19:32:01.216321] [INFO ] [REMOTE ] MUX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:01.257835] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-15T19:32:01.505681] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-15T19:32:02.057872] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-15T19:32:02.857880] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-15T19:32:03.657888] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-15T19:32:03.785423] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T19:32:03.976253] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T19:32:04.008416] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T19:32:04.457872] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-15T19:32:05.257875] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-15T19:32:06.072274] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-15T19:32:06.107498] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:32:06.225967] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T19:32:06.229236] [INFO ] [REMOTE ] MUSA: Full fetch complete (27511 records). [2025-09-15T19:32:06.229354] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-15T19:32:06.607863] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-15T19:32:06.607963] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-15T19:32:06.608604] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-15T19:32:06.608681] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-15T19:32:06.609465] [DEBUG] [LOCAL ] MUSA: Trimmed 27511 records to 18513 (keeping 150 days of data) [2025-09-15T19:32:06.729329] [DEBUG] [LOCAL ] MUSA: Primary data saved (18513 records). [2025-09-15T19:32:06.729498] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-15T19:32:06.729620] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUSA took 24.2s. Estimated remaining: 1h 39m 19s. Rate: 9.4 symbols/min [2025-09-15T19:32:06.869056] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-15T19:32:06.901430] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:06.911872] [DEBUG] [LOCAL ] MVF: Loaded 9100 existing records from primary storage. [2025-09-15T19:32:06.912007] [INFO ] [MAIN ] MVF: Loaded 9100 existing records. [2025-09-15T19:32:07.091458] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:07.091764] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-15T19:32:07.091818] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-15T19:32:07.092218] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-15T19:32:07.092267] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-15T19:32:07.138374] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-15T19:32:07.449090] [INFO ] [REMOTE ] MVF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:07.513332] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:32:07.657871] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-15T19:32:07.871183] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-15T19:32:08.457861] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-15T19:32:08.668940] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-15T19:32:09.257869] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-15T19:32:09.848087] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T19:32:10.057885] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-15T19:32:10.530524] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:32:10.530869] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-15T19:32:10.530962] [INFO ] [REMOTE ] MUSE: Full fetch complete (95 records). [2025-09-15T19:32:10.531025] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-15T19:32:10.531626] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T19:32:10.531720] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:32:10.531757] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:32:10.531794] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-15T19:32:10.531853] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-15T19:32:10.531888] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-15T19:32:10.531973] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-15T19:32:10.532044] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MUSE took 12.9s. Estimated remaining: 1h 39m 11s. Rate: 9.4 symbols/min [2025-09-15T19:32:10.703457] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:10.711884] [DEBUG] [LOCAL ] MVO: Loaded 6506 existing records from primary storage. [2025-09-15T19:32:10.712024] [INFO ] [MAIN ] MVO: Loaded 6506 existing records. [2025-09-15T19:32:10.868707] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-15T19:32:10.895252] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:10.895844] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-15T19:32:10.895898] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-15T19:32:10.896368] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-15T19:32:10.896437] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-15T19:32:11.260467] [INFO ] [REMOTE ] MVO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:11.657877] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-15T19:32:11.852885] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:32:12.457855] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-15T19:32:13.029325] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:32:13.035382] [INFO ] [REMOTE ] MUR: Full fetch complete (57587 records). [2025-09-15T19:32:13.035521] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-15T19:32:13.260300] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-15T19:32:13.255103] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:32:13.490635] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-15T19:32:13.490737] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-15T19:32:13.491609] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-15T19:32:13.491670] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-15T19:32:13.492856] [DEBUG] [LOCAL ] MUR: Trimmed 57587 records to 38975 (keeping 150 days of data) [2025-09-15T19:32:13.741324] [DEBUG] [LOCAL ] MUR: Primary data saved (38975 records). [2025-09-15T19:32:13.741481] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-15T19:32:13.742389] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MUR took 32.6s. Estimated remaining: 1h 39m 3s. Rate: 9.4 symbols/min [2025-09-15T19:32:13.917877] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:13.928483] [DEBUG] [LOCAL ] MVT: Loaded 7495 existing records from primary storage. [2025-09-15T19:32:13.928623] [INFO ] [MAIN ] MVT: Loaded 7495 existing records. [2025-09-15T19:32:14.068717] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-15T19:32:14.106716] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:14.106950] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-15T19:32:14.106996] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-15T19:32:14.107314] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-15T19:32:14.107360] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-15T19:32:14.292116] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:32:14.479399] [INFO ] [REMOTE ] MVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:14.857896] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-15T19:32:15.453457] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T19:32:15.610611] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:32:15.657895] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-15T19:32:16.219112] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:32:16.457928] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-15T19:32:17.113320] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:32:17.257882] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-15T19:32:18.024131] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:32:18.057914] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-15T19:32:18.857897] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-15T19:32:19.212517] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:32:19.425872] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T19:32:19.657865] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-15T19:32:20.457886] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-15T19:32:21.070542] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:32:21.257908] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-15T19:32:21.291552] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T19:32:22.057914] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-15T19:32:22.374666] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:32:22.853926] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:32:22.857802] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-15T19:32:23.330748] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:32:23.657900] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-15T19:32:24.450207] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:32:24.457823] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-15T19:32:25.099056] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T19:32:25.257876] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-15T19:32:26.057917] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-15T19:32:26.805175] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:32:26.867661] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-15T19:32:26.870450] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:32:27.657926] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-15T19:32:27.718361] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:32:28.457880] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-15T19:32:29.211739] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:32:29.213903] [INFO ] [REMOTE ] MVF: Full fetch complete (13703 records). [2025-09-15T19:32:29.213989] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-15T19:32:29.263007] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-15T19:32:29.419466] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:32:29.641373] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-15T19:32:29.641472] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-15T19:32:29.641866] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-15T19:32:29.641911] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-15T19:32:29.642455] [DEBUG] [LOCAL ] MVF: Trimmed 13703 records to 8769 (keeping 150 days of data) [2025-09-15T19:32:29.697954] [DEBUG] [LOCAL ] MVF: Primary data saved (8769 records). [2025-09-15T19:32:29.698109] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-15T19:32:29.698213] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVF took 23.0s. Estimated remaining: 1h 39m 3s. Rate: 9.4 symbols/min [2025-09-15T19:32:29.887588] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:29.930406] [DEBUG] [LOCAL ] MWA: Loaded 34538 existing records from primary storage. [2025-09-15T19:32:29.930603] [INFO ] [MAIN ] MWA: Loaded 34538 existing records. [2025-09-15T19:32:30.063071] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-15T19:32:30.117007] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:30.117252] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-15T19:32:30.117301] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-15T19:32:30.118146] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-15T19:32:30.118210] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-15T19:32:30.231080] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:32:30.489430] [INFO ] [REMOTE ] MWA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:30.857873] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-15T19:32:30.877573] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T19:32:31.657903] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-15T19:32:32.334573] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:32:32.346113] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T19:32:32.348747] [INFO ] [REMOTE ] MUX: Full fetch complete (45654 records). [2025-09-15T19:32:32.349125] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-15T19:32:32.462940] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-15T19:32:32.736732] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-15T19:32:32.736815] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-15T19:32:32.737583] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-15T19:32:32.737632] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-15T19:32:32.738680] [DEBUG] [LOCAL ] MUX: Trimmed 45654 records to 30886 (keeping 150 days of data) [2025-09-15T19:32:32.923900] [DEBUG] [LOCAL ] MUX: Primary data saved (30886 records). [2025-09-15T19:32:32.924036] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-15T19:32:32.924130] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MUX took 32.5s. Estimated remaining: 1h 38m 54s. Rate: 9.4 symbols/min [2025-09-15T19:32:33.090053] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:32:33.257870] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-15T19:32:34.057905] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-15T19:32:34.683095] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T19:32:34.727808] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T19:32:34.729544] [INFO ] [REMOTE ] MVT: Full fetch complete (10464 records). [2025-09-15T19:32:34.729618] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-15T19:32:34.869224] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-15T19:32:35.093786] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-15T19:32:35.093869] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-15T19:32:35.094207] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-15T19:32:35.094265] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-15T19:32:35.094841] [DEBUG] [LOCAL ] MVT: Trimmed 10464 records to 7340 (keeping 150 days of data) [2025-09-15T19:32:35.141443] [DEBUG] [LOCAL ] MVT: Primary data saved (7340 records). [2025-09-15T19:32:35.141587] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-15T19:32:35.141706] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MVT took 21.4s. Estimated remaining: 1h 38m 45s. Rate: 9.4 symbols/min [2025-09-15T19:32:35.657900] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-15T19:32:35.678829] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T19:32:36.457908] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-15T19:32:37.166114] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:32:37.167480] [INFO ] [REMOTE ] MVO: Full fetch complete (10058 records). [2025-09-15T19:32:37.167551] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-15T19:32:37.525571] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-15T19:32:37.525699] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-15T19:32:37.526187] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-15T19:32:37.526242] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-15T19:32:37.526812] [DEBUG] [LOCAL ] MVO: Trimmed 10058 records to 6388 (keeping 150 days of data) [2025-09-15T19:32:37.596976] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T19:32:37.610866] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-15T19:32:37.613456] [DEBUG] [LOCAL ] MVO: Primary data saved (6388 records). [2025-09-15T19:32:37.613598] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-15T19:32:37.614986] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MVO took 27.1s. Estimated remaining: 1h 38m 36s. Rate: 9.4 symbols/min [2025-09-15T19:32:39.133988] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:32:39.144830] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-15T19:32:40.759910] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:32:40.774907] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-15T19:32:42.215146] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:32:42.226059] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-15T19:32:43.708376] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T19:32:43.718504] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-15T19:32:45.131005] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T19:32:45.142703] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-15T19:32:46.311563] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T19:32:46.316594] [INFO ] [REMOTE ] MWA: Full fetch complete (51539 records). [2025-09-15T19:32:46.316766] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-15T19:32:46.690568] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-15T19:32:46.690660] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-15T19:32:46.691408] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-15T19:32:46.691448] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-15T19:32:46.692407] [DEBUG] [LOCAL ] MWA: Trimmed 51539 records to 33785 (keeping 150 days of data) [2025-09-15T19:32:46.905927] [DEBUG] [LOCAL ] MWA: Primary data saved (33785 records). [2025-09-15T19:32:46.906108] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-15T19:32:46.906202] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MWA took 17.2s. Estimated remaining: 1h 38m 32s. Rate: 9.4 symbols/min [2025-09-15T19:32:47.485494] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.537009] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.576441] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.630919] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.636416] [DEBUG] [LOCAL ] MXF: Loaded 4251 existing records from primary storage. [2025-09-15T19:32:47.636677] [INFO ] [MAIN ] MXF: Loaded 4251 existing records. [2025-09-15T19:32:47.636604] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-15T19:32:47.642182] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-15T19:32:47.666280] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-15T19:32:47.699457] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-15T19:32:47.717501] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-15T19:32:47.733309] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-15T19:32:47.708438] [DEBUG] [LOCAL ] MYD: Loaded 9439 existing records from primary storage. [2025-09-15T19:32:47.759378] [INFO ] [MAIN ] MYD: Loaded 9439 existing records. [2025-09-15T19:32:48.001744] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:47.978108] [DEBUG] [LOCAL ] MX: Loaded 16829 existing records from primary storage. [2025-09-15T19:32:48.036530] [INFO ] [MAIN ] MX: Loaded 16829 existing records. [2025-09-15T19:32:48.047014] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.098784] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-15T19:32:48.182873] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-15T19:32:48.276584] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-15T19:32:48.458573] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:48.526061] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.613774] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-15T19:32:48.661636] [INFO ] [REMOTE ] MXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:48.665432] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-15T19:32:48.665677] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-15T19:32:48.665068] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:48.666754] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-15T19:32:48.666895] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.682862] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-15T19:32:48.822135] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-15T19:32:48.868917] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-15T19:32:49.246133] [INFO ] [REMOTE ] MXF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.263146] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T19:32:49.279500] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-15T19:32:49.291166] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-15T19:32:49.557747] [INFO ] [REMOTE ] MYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.576862] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-15T19:32:49.669223] [INFO ] [REMOTE ] MX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.669577] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-15T19:32:49.678700] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T19:32:49.679744] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-15T19:32:50.035846] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:32:50.038108] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-15T19:32:50.090569] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:32:50.091630] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-15T19:32:50.348232] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:32:50.351722] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-15T19:32:50.426462] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T19:32:50.427465] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-15T19:32:50.521578] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:32:50.526156] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-15T19:32:50.752447] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T19:32:50.758635] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T19:32:50.857900] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-15T19:32:51.014234] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:32:51.257517] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T19:32:51.367103] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:32:51.657876] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-15T19:32:52.417780] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:32:52.457921] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-15T19:32:52.844834] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T19:32:53.257882] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-15T19:32:53.700543] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:32:54.057882] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-15T19:32:54.857896] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-15T19:32:55.027979] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T19:32:55.657845] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-15T19:32:55.673502] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T19:32:56.416986] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:32:56.457879] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-15T19:32:57.052709] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:32:57.257887] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-15T19:32:57.829811] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:32:58.057906] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-15T19:32:58.468496] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T19:32:58.857883] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-15T19:32:59.357798] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:32:59.358719] [INFO ] [REMOTE ] MXF: Full fetch complete (6984 records). [2025-09-15T19:32:59.358800] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-15T19:32:59.662999] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-15T19:32:59.713069] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-15T19:32:59.713142] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-15T19:32:59.713321] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-15T19:32:59.713361] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-15T19:32:59.713784] [DEBUG] [LOCAL ] MXF: Trimmed 6984 records to 4055 (keeping 150 days of data) [2025-09-15T19:32:59.739276] [DEBUG] [LOCAL ] MXF: Primary data saved (4055 records). [2025-09-15T19:32:59.739367] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-15T19:32:59.739446] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MXF took 12.8s. Estimated remaining: 1h 38m 30s. Rate: 9.4 symbols/min [2025-09-15T19:32:59.911898] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:59.929869] [DEBUG] [LOCAL ] MYE: Loaded 17877 existing records from primary storage. [2025-09-15T19:32:59.929988] [INFO ] [MAIN ] MYE: Loaded 17877 existing records. [2025-09-15T19:33:00.112135] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:00.112386] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-15T19:33:00.112435] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-15T19:33:00.112951] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-15T19:33:00.113012] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-15T19:33:00.279772] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:33:00.284235] [INFO ] [REMOTE ] MXE: Full fetch complete (1789 records). [2025-09-15T19:33:00.298879] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-15T19:33:00.460722] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-15T19:33:00.671117] [INFO ] [REMOTE ] MYE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:00.675249] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T19:33:00.675841] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:33:00.675895] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:33:00.675934] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-15T19:33:00.676003] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-15T19:33:00.676042] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-15T19:33:00.676080] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-15T19:33:00.676152] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MXE took 13.8s. Estimated remaining: 1h 38m 20s. Rate: 9.4 symbols/min [2025-09-15T19:33:00.840610] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:00.855468] [DEBUG] [LOCAL ] MYI: Loaded 13687 existing records from primary storage. [2025-09-15T19:33:00.855574] [INFO ] [MAIN ] MYI: Loaded 13687 existing records. [2025-09-15T19:33:01.036933] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:01.037215] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-15T19:33:01.037269] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-15T19:33:01.037998] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-15T19:33:01.038051] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-15T19:33:01.263091] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-15T19:33:01.402729] [INFO ] [REMOTE ] MYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:01.634085] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:33:02.057897] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-15T19:33:02.857913] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-15T19:33:03.190196] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T19:33:03.657929] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-15T19:33:04.457876] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-15T19:33:04.632849] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-15T19:33:04.992296] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T19:33:05.257883] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-15T19:33:05.777441] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T19:33:05.855676] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (3.00 seconds). [2025-09-15T19:33:05.921014] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T19:33:06.057869] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-15T19:33:06.857883] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-15T19:33:07.180453] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T19:33:07.657892] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-15T19:33:07.819911] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T19:33:08.075370] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T19:33:08.457883] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-15T19:33:09.237485] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T19:33:09.239311] [INFO ] [REMOTE ] MYD: Full fetch complete (15009 records). [2025-09-15T19:33:09.239378] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-15T19:33:09.263052] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-15T19:33:09.629604] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-15T19:33:09.629739] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-15T19:33:09.630680] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-15T19:33:09.630745] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-15T19:33:09.631494] [DEBUG] [LOCAL ] MYD: Trimmed 15009 records to 9151 (keeping 150 days of data) [2025-09-15T19:33:09.696034] [DEBUG] [LOCAL ] MYD: Primary data saved (9151 records). [2025-09-15T19:33:09.696250] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-15T19:33:09.696407] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MYD took 22.8s. Estimated remaining: 1h 38m 15s. Rate: 9.4 symbols/min [2025-09-15T19:33:09.872229] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:09.882327] [DEBUG] [LOCAL ] MYN: Loaded 7456 existing records from primary storage. [2025-09-15T19:33:09.882486] [INFO ] [MAIN ] MYN: Loaded 7456 existing records. [2025-09-15T19:33:10.063388] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-15T19:33:10.067553] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:10.069380] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-15T19:33:10.069434] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-15T19:33:10.069798] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-15T19:33:10.069850] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-15T19:33:10.440533] [INFO ] [REMOTE ] MYN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:10.454766] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T19:33:10.857915] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-15T19:33:10.999016] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:33:11.611230] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T19:33:11.657912] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-15T19:33:12.457925] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-15T19:33:12.822068] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:33:13.257967] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-15T19:33:13.730970] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T19:33:14.058023] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-15T19:33:14.706284] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:33:14.857960] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-15T19:33:15.601382] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:33:15.657838] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-15T19:33:16.457904] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-15T19:33:16.742282] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T19:33:16.745225] [INFO ] [REMOTE ] MX: Full fetch complete (24730 records). [2025-09-15T19:33:16.745307] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-15T19:33:16.857729] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:33:17.129325] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-15T19:33:17.129405] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-15T19:33:17.129956] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-15T19:33:17.129999] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-15T19:33:17.130682] [DEBUG] [LOCAL ] MX: Trimmed 24730 records to 16505 (keeping 150 days of data) [2025-09-15T19:33:17.222383] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:33:17.241341] [DEBUG] [LOCAL ] MX: Primary data saved (16505 records). [2025-09-15T19:33:17.241479] [INFO ] [MAIN ] MX: Full history saved. [2025-09-15T19:33:17.241684] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MX took 30.3s. Estimated remaining: 1h 38m 9s. Rate: 9.4 symbols/min [2025-09-15T19:33:17.263112] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-15T19:33:17.422977] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:17.453754] [DEBUG] [LOCAL ] NABL: Loaded 29693 existing records from primary storage. [2025-09-15T19:33:17.453946] [INFO ] [MAIN ] NABL: Loaded 29693 existing records. [2025-09-15T19:33:17.629170] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:17.629441] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-15T19:33:17.629498] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-15T19:33:17.630138] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-15T19:33:17.630186] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-15T19:33:17.983875] [INFO ] [REMOTE ] NABL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:18.057875] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-15T19:33:18.270612] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T19:33:18.857883] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-15T19:33:19.018450] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T19:33:19.657903] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-15T19:33:19.778724] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:33:20.305307] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T19:33:20.457914] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-15T19:33:21.206449] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:33:21.257817] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-15T19:33:22.021273] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T19:33:22.057819] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-15T19:33:22.857871] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-15T19:33:22.919609] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:33:23.657908] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-15T19:33:24.390294] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:33:24.444034] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:33:24.457808] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-15T19:33:25.257882] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-15T19:33:25.786303] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:33:26.057889] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-15T19:33:26.141343] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:33:26.857919] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-15T19:33:27.481148] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:33:27.603052] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:33:27.605817] [INFO ] [REMOTE ] MYE: Full fetch complete (27617 records). [2025-09-15T19:33:27.605893] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-15T19:33:27.664611] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-15T19:33:27.986471] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-15T19:33:27.986551] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-15T19:33:27.987141] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-15T19:33:27.987184] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-15T19:33:27.987873] [DEBUG] [LOCAL ] MYE: Trimmed 27617 records to 17475 (keeping 150 days of data) [2025-09-15T19:33:28.106746] [DEBUG] [LOCAL ] MYE: Primary data saved (17475 records). [2025-09-15T19:33:28.106999] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-15T19:33:28.107150] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. MYE took 28.4s. Estimated remaining: 1h 38m 6s. Rate: 9.4 symbols/min [2025-09-15T19:33:28.277756] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:28.298589] [DEBUG] [LOCAL ] NAC: Loaded 17941 existing records from primary storage. [2025-09-15T19:33:28.298740] [INFO ] [MAIN ] NAC: Loaded 17941 existing records. [2025-09-15T19:33:28.457912] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-15T19:33:28.478770] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:28.478951] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-15T19:33:28.478996] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-15T19:33:28.479467] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-15T19:33:28.479514] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-15T19:33:28.786587] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:33:28.833872] [INFO ] [REMOTE ] MYI: Full fetch complete (21318 records). [2025-09-15T19:33:28.851380] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-15T19:33:28.855132] [INFO ] [REMOTE ] NAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:29.214329] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-15T19:33:29.214411] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-15T19:33:29.214864] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-15T19:33:29.214905] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-15T19:33:29.215516] [DEBUG] [LOCAL ] MYI: Trimmed 21318 records to 13412 (keeping 150 days of data) [2025-09-15T19:33:29.263072] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-15T19:33:29.311827] [DEBUG] [LOCAL ] MYI: Primary data saved (13412 records). [2025-09-15T19:33:29.311989] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-15T19:33:29.312081] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. MYI took 28.6s. Estimated remaining: 1h 37m 56s. Rate: 9.4 symbols/min [2025-09-15T19:33:29.483717] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:29.512491] [DEBUG] [LOCAL ] NAD: Loaded 25561 existing records from primary storage. [2025-09-15T19:33:29.512629] [INFO ] [MAIN ] NAD: Loaded 25561 existing records. [2025-09-15T19:33:29.700299] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:29.700716] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-15T19:33:29.700836] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-15T19:33:29.708876] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-15T19:33:29.722084] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-15T19:33:29.722893] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:33:30.059551] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-15T19:33:30.101280] [INFO ] [REMOTE ] NAD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:30.110473] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:33:30.857881] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-15T19:33:31.259015] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T19:33:31.451044] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:33:31.454001] [INFO ] [REMOTE ] MYN: Full fetch complete (10999 records). [2025-09-15T19:33:31.454087] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-15T19:33:31.663100] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-15T19:33:31.824145] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-15T19:33:31.824263] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-15T19:33:31.824583] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-15T19:33:31.824624] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-15T19:33:31.825204] [DEBUG] [LOCAL ] MYN: Trimmed 10999 records to 7468 (keeping 150 days of data) [2025-09-15T19:33:31.871486] [DEBUG] [LOCAL ] MYN: Primary data saved (7468 records). [2025-09-15T19:33:31.871681] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-15T19:33:31.871780] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. MYN took 22.2s. Estimated remaining: 1h 37m 47s. Rate: 9.4 symbols/min [2025-09-15T19:33:32.039812] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:32.048021] [DEBUG] [LOCAL ] NAN: Loaded 6288 existing records from primary storage. [2025-09-15T19:33:32.048112] [INFO ] [MAIN ] NAN: Loaded 6288 existing records. [2025-09-15T19:33:32.226994] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:32.227407] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-15T19:33:32.227457] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-15T19:33:32.227909] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-15T19:33:32.227962] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-15T19:33:32.468626] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-15T19:33:32.599598] [INFO ] [REMOTE ] NAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:32.612224] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:33:33.257885] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-15T19:33:33.925334] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:33:34.037083] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T19:33:34.057812] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-15T19:33:34.833823] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:33:34.857824] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-15T19:33:35.573402] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:33:35.657952] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-15T19:33:36.457913] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-15T19:33:36.972195] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:33:37.196250] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:33:37.257914] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-15T19:33:38.057845] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-15T19:33:38.522505] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T19:33:38.857922] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-15T19:33:39.037845] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:33:39.042286] [INFO ] [REMOTE ] NABL: Full fetch complete (43894 records). [2025-09-15T19:33:39.042369] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-15T19:33:39.452129] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-15T19:33:39.452215] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-15T19:33:39.453232] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-15T19:33:39.453300] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-15T19:33:39.454381] [DEBUG] [LOCAL ] NABL: Trimmed 43894 records to 29090 (keeping 150 days of data) [2025-09-15T19:33:39.632683] [DEBUG] [LOCAL ] NABL: Primary data saved (29090 records). [2025-09-15T19:33:39.632856] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-15T19:33:39.632993] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NABL took 22.4s. Estimated remaining: 1h 37m 42s. Rate: 9.4 symbols/min [2025-09-15T19:33:39.663046] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-15T19:33:39.813846] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:39.853622] [DEBUG] [LOCAL ] NAT: Loaded 36541 existing records from primary storage. [2025-09-15T19:33:39.853785] [INFO ] [MAIN ] NAT: Loaded 36541 existing records. [2025-09-15T19:33:40.078762] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:40.080041] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T19:33:40.085293] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-15T19:33:40.085527] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-15T19:33:40.086536] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-15T19:33:40.086593] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-15T19:33:40.444081] [INFO ] [REMOTE ] NAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:40.457886] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-15T19:33:40.749996] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:33:41.257925] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-15T19:33:41.707073] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T19:33:41.920805] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T19:33:42.057876] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-15T19:33:42.459957] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-15T19:33:42.857878] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-15T19:33:43.657874] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-15T19:33:44.211429] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:33:44.379184] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:33:44.457860] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-15T19:33:45.257891] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-15T19:33:46.057890] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-15T19:33:46.471219] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T19:33:46.528233] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:33:46.760476] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T19:33:46.857911] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-15T19:33:47.657900] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-15T19:33:47.684636] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:33:47.686479] [INFO ] [REMOTE ] NAN: Full fetch complete (9942 records). [2025-09-15T19:33:47.686548] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-15T19:33:48.067932] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-15T19:33:48.068063] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-15T19:33:48.068424] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-15T19:33:48.068471] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-15T19:33:48.069531] [DEBUG] [LOCAL ] NAN: Trimmed 9942 records to 6267 (keeping 150 days of data) [2025-09-15T19:33:48.112474] [DEBUG] [LOCAL ] NAN: Primary data saved (6267 records). [2025-09-15T19:33:48.112734] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-15T19:33:48.112857] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NAN took 16.2s. Estimated remaining: 1h 37m 37s. Rate: 9.4 symbols/min [2025-09-15T19:33:48.290122] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:48.313286] [DEBUG] [LOCAL ] NATL: Loaded 24453 existing records from primary storage. [2025-09-15T19:33:48.313425] [INFO ] [MAIN ] NATL: Loaded 24453 existing records. [2025-09-15T19:33:48.462952] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-15T19:33:48.490831] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:48.491067] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-15T19:33:48.491113] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-15T19:33:48.491740] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-15T19:33:48.491789] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-15T19:33:48.842441] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:33:48.861597] [INFO ] [REMOTE ] NATL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:49.257876] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-15T19:33:50.058005] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-15T19:33:50.057936] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T19:33:50.209911] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T19:33:50.857841] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-15T19:33:51.020164] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T19:33:51.649059] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T19:33:51.652622] [INFO ] [REMOTE ] NAC: Full fetch complete (26611 records). [2025-09-15T19:33:51.652772] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-15T19:33:51.664297] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-15T19:33:52.027505] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-15T19:33:52.027585] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-15T19:33:52.028144] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-15T19:33:52.028188] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-15T19:33:52.028896] [DEBUG] [LOCAL ] NAC: Trimmed 26611 records to 17588 (keeping 150 days of data) [2025-09-15T19:33:52.138405] [DEBUG] [LOCAL ] NAC: Primary data saved (17588 records). [2025-09-15T19:33:52.138564] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-15T19:33:52.138676] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NAC took 24.0s. Estimated remaining: 1h 37m 29s. Rate: 9.4 symbols/min [2025-09-15T19:33:52.308947] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:33:52.312680] [DEBUG] [LOCAL ] NAZ: Loaded 1977 existing records from primary storage. [2025-09-15T19:33:52.312777] [INFO ] [MAIN ] NAZ: Loaded 1977 existing records. [2025-09-15T19:33:52.463052] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-15T19:33:52.490401] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:33:52.490753] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-15T19:33:52.490801] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-15T19:33:52.490975] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-15T19:33:52.491081] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-15T19:33:52.842422] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:33:53.145324] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:33:53.257841] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-15T19:33:53.945620] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:33:54.057852] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-15T19:33:54.106774] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:33:54.857876] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-15T19:33:55.561067] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T19:33:55.657846] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-15T19:33:56.042502] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:33:56.457879] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-15T19:33:57.055682] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:33:57.068513] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:33:57.257891] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-15T19:33:58.057847] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-15T19:33:58.441171] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:33:58.598542] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T19:33:58.857894] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-15T19:33:59.657902] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-15T19:34:00.099591] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T19:34:00.369442] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T19:34:00.457850] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-15T19:34:01.257904] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-15T19:34:01.776720] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T19:34:01.807574] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:34:02.057870] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-15T19:34:02.497448] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:34:02.857871] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-15T19:34:03.657882] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-15T19:34:04.148384] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T19:34:04.457897] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-15T19:34:04.599719] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T19:34:05.257883] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-15T19:34:05.808574] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:34:05.890211] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T19:34:06.057894] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-15T19:34:06.857925] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-15T19:34:07.104771] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:34:07.111362] [INFO ] [REMOTE ] NATL: Full fetch complete (34905 records). [2025-09-15T19:34:07.111606] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-15T19:34:07.538394] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-15T19:34:07.538538] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-15T19:34:07.539388] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-15T19:34:07.539438] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-15T19:34:07.540487] [DEBUG] [LOCAL ] NATL: Trimmed 34905 records to 24035 (keeping 150 days of data) [2025-09-15T19:34:07.663737] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-15T19:34:07.697485] [DEBUG] [LOCAL ] NATL: Primary data saved (24035 records). [2025-09-15T19:34:07.697626] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-15T19:34:07.697757] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NATL took 19.6s. Estimated remaining: 1h 37m 29s. Rate: 9.4 symbols/min [2025-09-15T19:34:07.869157] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:07.877063] [DEBUG] [LOCAL ] NBB: Loaded 6533 existing records from primary storage. [2025-09-15T19:34:07.877160] [INFO ] [MAIN ] NBB: Loaded 6533 existing records. [2025-09-15T19:34:08.065880] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:08.066787] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-15T19:34:08.066837] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-15T19:34:08.067135] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-15T19:34:08.067209] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-15T19:34:08.249627] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:34:08.458665] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-15T19:34:08.458590] [INFO ] [REMOTE ] NBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:08.487298] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T19:34:09.257869] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-15T19:34:09.575958] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:34:10.057863] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-15T19:34:10.806343] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T19:34:10.811907] [INFO ] [REMOTE ] NAT: Full fetch complete (53609 records). [2025-09-15T19:34:10.812003] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-15T19:34:10.867616] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-15T19:34:11.136537] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T19:34:11.151253] [INFO ] [REMOTE ] NAD: Full fetch complete (36745 records). [2025-09-15T19:34:11.180434] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-15T19:34:11.297605] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-15T19:34:11.308701] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-15T19:34:11.330490] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-15T19:34:11.330563] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-15T19:34:11.406547] [DEBUG] [LOCAL ] NAT: Trimmed 53609 records to 35875 (keeping 150 days of data) [2025-09-15T19:34:11.661675] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-15T19:34:11.718583] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-15T19:34:11.719610] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-15T19:34:11.721122] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-15T19:34:11.721591] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-15T19:34:11.780850] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T19:34:11.741296] [DEBUG] [LOCAL ] NAD: Trimmed 36745 records to 24848 (keeping 150 days of data) [2025-09-15T19:34:11.953403] [DEBUG] [LOCAL ] NAT: Primary data saved (35875 records). [2025-09-15T19:34:11.958246] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-15T19:34:11.967834] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NAT took 32.3s. Estimated remaining: 1h 37m 21s. Rate: 9.4 symbols/min [2025-09-15T19:34:12.080036] [DEBUG] [LOCAL ] NAD: Primary data saved (24848 records). [2025-09-15T19:34:12.100427] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-15T19:34:12.103978] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NAD took 42.8s. Estimated remaining: 1h 37m 11s. Rate: 9.4 symbols/min [2025-09-15T19:34:12.269240] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:12.309916] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:34:12.363020] [INFO ] [REMOTE ] NAZ: Full fetch complete (3028 records). [2025-09-15T19:34:12.371986] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-15T19:34:12.371839] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:12.436252] [DEBUG] [LOCAL ] NBHC: Loaded 16605 existing records from primary storage. [2025-09-15T19:34:12.462059] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-15T19:34:12.456834] [INFO ] [MAIN ] NBHC: Loaded 16605 existing records. [2025-09-15T19:34:12.680497] [DEBUG] [LOCAL ] NBR: Loaded 26348 existing records from primary storage. [2025-09-15T19:34:12.697527] [INFO ] [MAIN ] NBR: Loaded 26348 existing records. [2025-09-15T19:34:12.991320] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:13.054591] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-15T19:34:13.136360] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:13.160469] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-15T19:34:13.160638] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-15T19:34:13.160809] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-15T19:34:13.160967] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-15T19:34:13.160929] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-15T19:34:13.161141] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-15T19:34:13.161249] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-15T19:34:13.161783] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-15T19:34:13.161996] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-15T19:34:13.161746] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-15T19:34:13.161945] [DEBUG] [LOCAL ] NAZ: Trimmed 3028 records to 1952 (keeping 150 days of data) [2025-09-15T19:34:13.193732] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-15T19:34:13.438335] [DEBUG] [LOCAL ] NAZ: Primary data saved (1952 records). [2025-09-15T19:34:13.534434] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-15T19:34:13.614216] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T19:34:13.733578] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-15T19:34:13.670185] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NAZ took 21.5s. Estimated remaining: 1h 37m 1s. Rate: 9.4 symbols/min [2025-09-15T19:34:13.972367] [INFO ] [REMOTE ] NBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:14.037118] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:14.062969] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-15T19:34:14.112411] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:14.131125] [DEBUG] [LOCAL ] NBXG: Loaded 16249 existing records from primary storage. [2025-09-15T19:34:14.131273] [INFO ] [MAIN ] NBXG: Loaded 16249 existing records. [2025-09-15T19:34:14.314036] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:14.314854] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-15T19:34:14.314907] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-15T19:34:14.315561] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-15T19:34:14.315607] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-15T19:34:14.604738] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T19:34:14.685541] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:14.857869] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-15T19:34:15.657839] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-15T19:34:15.679843] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:34:15.692956] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T19:34:16.457837] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-15T19:34:16.825567] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T19:34:17.257909] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-15T19:34:17.538020] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T19:34:17.726722] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T19:34:18.057904] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-15T19:34:18.857898] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-15T19:34:19.271133] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:34:19.398294] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T19:34:19.657874] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-15T19:34:20.223838] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:34:20.457916] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-15T19:34:21.154048] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T19:34:21.257851] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-15T19:34:22.057906] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-15T19:34:22.407335] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:34:22.857872] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-15T19:34:23.173888] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T19:34:23.523510] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T19:34:23.525688] [INFO ] [REMOTE ] NBB: Full fetch complete (9614 records). [2025-09-15T19:34:23.525794] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-15T19:34:23.663028] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-15T19:34:23.902430] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-15T19:34:23.902523] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-15T19:34:23.902850] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-15T19:34:23.902898] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-15T19:34:23.903429] [DEBUG] [LOCAL ] NBB: Trimmed 9614 records to 6403 (keeping 150 days of data) [2025-09-15T19:34:23.944873] [DEBUG] [LOCAL ] NBB: Primary data saved (6403 records). [2025-09-15T19:34:23.945049] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-15T19:34:23.945217] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NBB took 16.2s. Estimated remaining: 1h 36m 57s. Rate: 9.4 symbols/min [2025-09-15T19:34:24.119020] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:24.122053] [DEBUG] [LOCAL ] NC: Loaded 1225 existing records from primary storage. [2025-09-15T19:34:24.122135] [INFO ] [MAIN ] NC: Loaded 1225 existing records. [2025-09-15T19:34:24.316967] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:24.317250] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-15T19:34:24.317312] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-15T19:34:24.317548] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-15T19:34:24.317600] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-15T19:34:24.463146] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-15T19:34:24.684993] [INFO ] [REMOTE ] NC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:24.702825] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:34:25.257870] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-15T19:34:25.387963] [DEBUG] [REMOTE ] NBHC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-15T19:34:25.388275] [WARN ] [REMOTE ] NBHC: No data returned for month 2025-06 [2025-09-15T19:34:25.764409] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:34:26.057896] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-15T19:34:26.857868] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-15T19:34:26.978219] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:34:27.657889] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-15T19:34:28.350737] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:34:28.352909] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:34:28.457859] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-15T19:34:29.257945] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-15T19:34:29.820614] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:34:30.057841] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-15T19:34:30.098600] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:34:30.863083] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-15T19:34:30.865160] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:34:31.322620] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T19:34:31.657875] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-15T19:34:32.316613] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T19:34:32.457888] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-15T19:34:33.257949] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-15T19:34:33.433560] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T19:34:33.730282] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:34:34.057866] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-15T19:34:34.442294] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T19:34:34.857910] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-15T19:34:35.657866] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-15T19:34:36.172213] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T19:34:36.457879] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-15T19:34:36.487435] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:34:36.490284] [INFO ] [REMOTE ] NBHC: Full fetch complete (21472 records). [2025-09-15T19:34:36.490399] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-15T19:34:36.676819] [WARN ] [VALIDATOR ] NBHC: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-15T19:34:36.677189] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:34:36.677239] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:34:36.677284] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-15T19:34:36.677366] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-09-15T19:34:36.677404] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-09-15T19:34:36.677764] [DEBUG] [LOCAL ] NBHC: Deleted derivative data file. [2025-09-15T19:34:36.677859] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NBHC took 24.7s. Estimated remaining: 1h 36m 55s. Rate: 9.4 symbols/min [2025-09-15T19:34:36.852137] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:36.861368] [DEBUG] [LOCAL ] NCA: Loaded 7389 existing records from primary storage. [2025-09-15T19:34:36.861501] [INFO ] [MAIN ] NCA: Loaded 7389 existing records. [2025-09-15T19:34:36.973342] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:34:37.052594] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:37.052901] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-15T19:34:37.052951] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-15T19:34:37.053252] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-15T19:34:37.053315] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-15T19:34:37.263033] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-15T19:34:37.420993] [INFO ] [REMOTE ] NCA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:38.057887] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-15T19:34:38.431677] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T19:34:38.812694] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T19:34:38.857878] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-15T19:34:39.497252] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T19:34:39.657859] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-15T19:34:40.223075] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:34:40.457878] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-15T19:34:41.212915] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:34:41.257895] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-15T19:34:42.057885] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-15T19:34:42.442225] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T19:34:42.495237] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:34:42.857869] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-15T19:34:43.657872] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-15T19:34:44.028569] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T19:34:44.351234] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T19:34:44.457882] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-15T19:34:44.919097] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T19:34:44.919969] [INFO ] [REMOTE ] NC: Full fetch complete (2056 records). [2025-09-15T19:34:44.920043] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-15T19:34:45.264954] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-15T19:34:45.275020] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-15T19:34:45.275102] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-15T19:34:45.275212] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-15T19:34:45.275265] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-15T19:34:45.275689] [DEBUG] [LOCAL ] NC: Trimmed 2056 records to 1162 (keeping 150 days of data) [2025-09-15T19:34:45.284213] [DEBUG] [LOCAL ] NC: Primary data saved (1162 records). [2025-09-15T19:34:45.284278] [INFO ] [MAIN ] NC: Full history saved. [2025-09-15T19:34:45.284347] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NC took 21.3s. Estimated remaining: 1h 36m 50s. Rate: 9.4 symbols/min [2025-09-15T19:34:45.452873] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:45.468417] [DEBUG] [LOCAL ] NCDL: Loaded 15159 existing records from primary storage. [2025-09-15T19:34:45.468547] [INFO ] [MAIN ] NCDL: Loaded 15159 existing records. [2025-09-15T19:34:45.641757] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:45.642008] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-15T19:34:45.642076] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-15T19:34:45.642754] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-15T19:34:45.642828] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-15T19:34:45.999234] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:46.057863] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-15T19:34:46.269119] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:34:46.271925] [INFO ] [REMOTE ] NBXG: Full fetch complete (25006 records). [2025-09-15T19:34:46.272025] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-15T19:34:46.647684] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-15T19:34:46.647809] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-15T19:34:46.655679] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-15T19:34:46.655933] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:34:46.658563] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-15T19:34:46.659833] [DEBUG] [LOCAL ] NBXG: Trimmed 25006 records to 15978 (keeping 150 days of data) [2025-09-15T19:34:46.760478] [DEBUG] [LOCAL ] NBXG: Primary data saved (15978 records). [2025-09-15T19:34:46.760620] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-15T19:34:46.760736] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NBXG took 33.0s. Estimated remaining: 1h 36m 41s. Rate: 9.4 symbols/min [2025-09-15T19:34:46.860430] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-15T19:34:46.931405] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:46.973170] [DEBUG] [LOCAL ] NCLH: Loaded 40493 existing records from primary storage. [2025-09-15T19:34:46.973318] [INFO ] [MAIN ] NCLH: Loaded 40493 existing records. [2025-09-15T19:34:47.155618] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:47.155976] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-15T19:34:47.156025] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-15T19:34:47.156972] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-15T19:34:47.157048] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-15T19:34:47.525182] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:47.657860] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-15T19:34:47.992096] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T19:34:48.457880] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-15T19:34:48.948848] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:34:48.953520] [INFO ] [REMOTE ] NBR: Full fetch complete (38140 records). [2025-09-15T19:34:48.953671] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-15T19:34:49.260051] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-15T19:34:49.344878] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-15T19:34:49.344994] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-15T19:34:49.345834] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-15T19:34:49.345893] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-15T19:34:49.361555] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:34:49.367792] [DEBUG] [LOCAL ] NBR: Trimmed 38140 records to 25999 (keeping 150 days of data) [2025-09-15T19:34:49.526394] [DEBUG] [LOCAL ] NBR: Primary data saved (25999 records). [2025-09-15T19:34:49.526529] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-15T19:34:49.526613] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NBR took 37.4s. Estimated remaining: 1h 36m 32s. Rate: 9.4 symbols/min [2025-09-15T19:34:49.707799] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:49.718347] [DEBUG] [LOCAL ] NCV: Loaded 9633 existing records from primary storage. [2025-09-15T19:34:49.718457] [INFO ] [MAIN ] NCV: Loaded 9633 existing records. [2025-09-15T19:34:49.900962] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:49.901462] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-15T19:34:49.901509] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-15T19:34:49.902232] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-15T19:34:49.902306] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-15T19:34:50.067613] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-15T19:34:50.274116] [INFO ] [REMOTE ] NCV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:50.857807] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-15T19:34:51.057842] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T19:34:51.192803] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:34:51.657845] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-15T19:34:51.733368] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:34:52.256882] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:34:52.457906] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-15T19:34:53.185725] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:34:53.257828] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-15T19:34:54.057899] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-15T19:34:54.564847] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T19:34:54.566260] [INFO ] [REMOTE ] NCA: Full fetch complete (10957 records). [2025-09-15T19:34:54.566328] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-15T19:34:54.863029] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-15T19:34:54.924705] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-15T19:34:54.924782] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-15T19:34:54.925062] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-15T19:34:54.925103] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-15T19:34:54.925582] [DEBUG] [LOCAL ] NCA: Trimmed 10957 records to 7083 (keeping 150 days of data) [2025-09-15T19:34:54.970879] [DEBUG] [LOCAL ] NCA: Primary data saved (7083 records). [2025-09-15T19:34:54.970984] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-15T19:34:54.971073] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NCA took 18.3s. Estimated remaining: 1h 36m 25s. Rate: 9.4 symbols/min [2025-09-15T19:34:55.138203] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:34:55.147697] [DEBUG] [LOCAL ] NCZ: Loaded 8192 existing records from primary storage. [2025-09-15T19:34:55.147801] [INFO ] [MAIN ] NCZ: Loaded 8192 existing records. [2025-09-15T19:34:55.325235] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:34:55.325516] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-15T19:34:55.325637] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-15T19:34:55.326176] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-15T19:34:55.326238] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-15T19:34:55.662196] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-15T19:34:55.725821] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-15T19:34:55.723150] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:34:55.752691] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T19:34:56.457880] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-15T19:34:56.636479] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T19:34:57.257938] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-15T19:34:57.557914] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:34:58.057825] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-15T19:34:58.228372] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:34:58.857867] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-15T19:34:59.547265] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T19:34:59.657956] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-15T19:34:59.826101] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T19:35:00.326189] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T19:35:00.457876] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-15T19:35:01.257882] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-15T19:35:01.388230] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:35:02.057872] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-15T19:35:02.431148] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T19:35:02.844685] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:35:02.857834] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-15T19:35:03.657881] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-15T19:35:03.867455] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:35:04.335630] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:35:04.457887] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-15T19:35:05.244835] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T19:35:05.257819] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-15T19:35:05.975400] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T19:35:06.057867] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-15T19:35:06.795471] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T19:35:06.857877] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-15T19:35:07.657882] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-15T19:35:07.752756] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T19:35:08.234441] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:35:08.457875] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-15T19:35:09.257885] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-15T19:35:09.299162] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T19:35:09.302671] [INFO ] [REMOTE ] NCDL: Full fetch complete (23939 records). [2025-09-15T19:35:09.302776] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-15T19:35:09.681715] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-15T19:35:09.681806] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-15T19:35:09.682315] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-15T19:35:09.682368] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-15T19:35:09.683527] [DEBUG] [LOCAL ] NCDL: Trimmed 23939 records to 14866 (keeping 150 days of data) [2025-09-15T19:35:09.778585] [DEBUG] [LOCAL ] NCDL: Primary data saved (14866 records). [2025-09-15T19:35:09.778746] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-15T19:35:09.778834] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NCDL took 24.5s. Estimated remaining: 1h 36m 24s. Rate: 9.4 symbols/min [2025-09-15T19:35:09.958036] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:09.971540] [DEBUG] [LOCAL ] NDMO: Loaded 12663 existing records from primary storage. [2025-09-15T19:35:09.971693] [INFO ] [MAIN ] NDMO: Loaded 12663 existing records. [2025-09-15T19:35:10.062974] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-15T19:35:10.149612] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:10.149854] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-15T19:35:10.149899] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-15T19:35:10.150255] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-15T19:35:10.150300] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-15T19:35:10.508192] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:10.792844] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:35:10.795954] [INFO ] [REMOTE ] NCV: Full fetch complete (14935 records). [2025-09-15T19:35:10.796034] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-15T19:35:10.863093] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-15T19:35:11.180824] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-15T19:35:11.180972] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-15T19:35:11.181449] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-15T19:35:11.181502] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-15T19:35:11.182580] [DEBUG] [LOCAL ] NCV: Trimmed 14935 records to 9518 (keeping 150 days of data) [2025-09-15T19:35:11.247568] [DEBUG] [LOCAL ] NCV: Primary data saved (9518 records). [2025-09-15T19:35:11.247998] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-15T19:35:11.248163] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCV took 21.7s. Estimated remaining: 1h 36m 14s. Rate: 9.4 symbols/min [2025-09-15T19:35:11.402462] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T19:35:11.474607] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:11.523591] [DEBUG] [LOCAL ] NE: Loaded 39328 existing records from primary storage. [2025-09-15T19:35:11.523778] [INFO ] [MAIN ] NE: Loaded 39328 existing records. [2025-09-15T19:35:11.658726] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-15T19:35:11.714363] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:35:11.719509] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:11.723052] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-15T19:35:11.723104] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-15T19:35:11.724086] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-15T19:35:11.724137] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-15T19:35:12.078223] [INFO ] [REMOTE ] NE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:12.457922] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-15T19:35:12.488369] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T19:35:13.257955] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-15T19:35:14.057899] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-15T19:35:14.133587] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T19:35:14.217340] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T19:35:14.706846] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:35:14.708602] [INFO ] [REMOTE ] NCZ: Full fetch complete (13263 records). [2025-09-15T19:35:14.708692] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-15T19:35:14.883079] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-15T19:35:15.075149] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-15T19:35:15.075232] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-15T19:35:15.075566] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-15T19:35:15.075605] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-15T19:35:15.076164] [DEBUG] [LOCAL ] NCZ: Trimmed 13263 records to 8108 (keeping 150 days of data) [2025-09-15T19:35:15.128116] [DEBUG] [LOCAL ] NCZ: Primary data saved (8108 records). [2025-09-15T19:35:15.128263] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-15T19:35:15.128363] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NCZ took 20.2s. Estimated remaining: 1h 36m 7s. Rate: 9.4 symbols/min [2025-09-15T19:35:15.304826] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:15.334341] [DEBUG] [LOCAL ] NEA: Loaded 26449 existing records from primary storage. [2025-09-15T19:35:15.334482] [INFO ] [MAIN ] NEA: Loaded 26449 existing records. [2025-09-15T19:35:15.508767] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:15.509063] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-15T19:35:15.509129] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-15T19:35:15.509759] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-15T19:35:15.509814] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-15T19:35:15.667793] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-15T19:35:15.868376] [INFO ] [REMOTE ] NEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:15.963464] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:35:16.457936] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-15T19:35:17.257931] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-15T19:35:17.353907] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T19:35:17.830262] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:35:18.026458] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:35:18.057839] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-15T19:35:18.857877] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-15T19:35:18.900938] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:35:19.657974] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-15T19:35:20.457918] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-15T19:35:20.546158] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:35:20.808859] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:35:21.257906] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-15T19:35:21.462127] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T19:35:22.057943] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-15T19:35:22.748268] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:35:22.857892] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-15T19:35:23.657939] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-15T19:35:23.990161] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:35:24.084583] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:35:24.457886] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-15T19:35:24.640198] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T19:35:25.257896] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-15T19:35:26.064123] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-15T19:35:26.070252] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:35:26.857884] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-15T19:35:27.022349] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:35:27.025169] [INFO ] [REMOTE ] NDMO: Full fetch complete (17423 records). [2025-09-15T19:35:27.025287] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-15T19:35:27.349517] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T19:35:27.439129] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-15T19:35:27.439205] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-15T19:35:27.439576] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-15T19:35:27.439626] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-15T19:35:27.440160] [DEBUG] [LOCAL ] NDMO: Trimmed 17423 records to 12480 (keeping 150 days of data) [2025-09-15T19:35:27.516806] [DEBUG] [LOCAL ] NDMO: Primary data saved (12480 records). [2025-09-15T19:35:27.516947] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-15T19:35:27.517041] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NDMO took 17.7s. Estimated remaining: 1h 36m 4s. Rate: 9.4 symbols/min [2025-09-15T19:35:27.662944] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-15T19:35:27.686934] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:27.729545] [DEBUG] [LOCAL ] NEE: Loaded 40447 existing records from primary storage. [2025-09-15T19:35:27.729706] [INFO ] [MAIN ] NEE: Loaded 40447 existing records. [2025-09-15T19:35:27.905223] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:27.905630] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-15T19:35:27.905726] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-15T19:35:27.906900] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-15T19:35:27.906964] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-15T19:35:28.255827] [INFO ] [REMOTE ] NEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:28.334401] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T19:35:28.457834] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-15T19:35:28.938549] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:35:29.257886] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-15T19:35:30.057905] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-15T19:35:30.161626] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:35:30.167501] [INFO ] [REMOTE ] NE: Full fetch complete (56966 records). [2025-09-15T19:35:30.167617] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-15T19:35:30.589112] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-15T19:35:30.589193] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-15T19:35:30.590094] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-15T19:35:30.590141] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-15T19:35:30.591552] [DEBUG] [LOCAL ] NE: Trimmed 56966 records to 38574 (keeping 150 days of data) [2025-09-15T19:35:30.843625] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T19:35:30.858014] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-15T19:35:30.885313] [DEBUG] [LOCAL ] NE: Primary data saved (38574 records). [2025-09-15T19:35:30.885440] [INFO ] [MAIN ] NE: Full history saved. [2025-09-15T19:35:30.885530] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NE took 19.6s. Estimated remaining: 1h 35m 56s. Rate: 9.4 symbols/min [2025-09-15T19:35:31.059973] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:31.099607] [DEBUG] [LOCAL ] NEM: Loaded 40448 existing records from primary storage. [2025-09-15T19:35:31.099819] [INFO ] [MAIN ] NEM: Loaded 40448 existing records. [2025-09-15T19:35:31.281689] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:31.281924] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-15T19:35:31.281971] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-15T19:35:31.283023] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-15T19:35:31.283080] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-15T19:35:31.648496] [INFO ] [REMOTE ] NEM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:31.668161] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-15T19:35:31.672937] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T19:35:32.388059] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:35:32.457884] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-15T19:35:33.257900] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-15T19:35:33.404231] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T19:35:33.410612] [INFO ] [REMOTE ] NCLH: Full fetch complete (58433 records). [2025-09-15T19:35:33.410840] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-15T19:35:33.805515] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-15T19:35:33.805612] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-15T19:35:33.806520] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-15T19:35:33.806568] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-15T19:35:33.809058] [DEBUG] [LOCAL ] NCLH: Trimmed 58433 records to 39713 (keeping 150 days of data) [2025-09-15T19:35:34.058001] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-15T19:35:34.064202] [DEBUG] [LOCAL ] NCLH: Primary data saved (39713 records). [2025-09-15T19:35:34.064376] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-15T19:35:34.066402] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NCLH took 47.3s. Estimated remaining: 1h 35m 47s. Rate: 9.4 symbols/min [2025-09-15T19:35:34.255666] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:34.304352] [DEBUG] [LOCAL ] NET: Loaded 39881 existing records from primary storage. [2025-09-15T19:35:34.304513] [INFO ] [MAIN ] NET: Loaded 39881 existing records. [2025-09-15T19:35:34.481858] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:34.482210] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-15T19:35:34.482310] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-15T19:35:34.483207] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-15T19:35:34.483263] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-15T19:35:34.844544] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-15T19:35:34.912501] [INFO ] [REMOTE ] NET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:34.906732] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-15T19:35:34.953952] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:35:34.998270] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:35:35.657897] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-15T19:35:36.459295] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-15T19:35:36.459215] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:35:37.257924] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-15T19:35:37.673872] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T19:35:38.057913] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-15T19:35:38.202936] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:35:38.857888] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-15T19:35:39.064272] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T19:35:39.301206] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T19:35:39.657931] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-15T19:35:40.457893] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-15T19:35:40.862431] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T19:35:41.257919] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-15T19:35:41.809355] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T19:35:42.057891] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-15T19:35:42.524145] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-15T19:35:42.857842] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-15T19:35:43.143322] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:35:43.657871] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-15T19:35:43.697904] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T19:35:43.801970] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T19:35:44.457878] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-15T19:35:45.257926] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-15T19:35:45.580929] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:35:45.791477] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-15T19:35:46.057862] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-15T19:35:46.857879] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-15T19:35:46.959710] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:35:46.965754] [INFO ] [REMOTE ] NEE: Full fetch complete (58387 records). [2025-09-15T19:35:46.965899] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-15T19:35:47.355139] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-15T19:35:47.355241] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-15T19:35:47.356164] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-15T19:35:47.356220] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-15T19:35:47.357562] [DEBUG] [LOCAL ] NEE: Trimmed 58387 records to 39667 (keeping 150 days of data) [2025-09-15T19:35:47.625632] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:35:47.632651] [INFO ] [REMOTE ] NEA: Full fetch complete (38424 records). [2025-09-15T19:35:47.633868] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-15T19:35:47.640625] [DEBUG] [LOCAL ] NEE: Primary data saved (39667 records). [2025-09-15T19:35:47.640927] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-15T19:35:47.641047] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NEE took 20.1s. Estimated remaining: 1h 35m 45s. Rate: 9.4 symbols/min [2025-09-15T19:35:47.663463] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-15T19:35:48.118614] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:48.256788] [DEBUG] [LOCAL ] NEU: Loaded 6817 existing records from primary storage. [2025-09-15T19:35:48.259162] [INFO ] [MAIN ] NEU: Loaded 6817 existing records. [2025-09-15T19:35:48.259278] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-15T19:35:48.320724] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-15T19:35:48.348462] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-15T19:35:48.371989] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-15T19:35:48.449765] [DEBUG] [LOCAL ] NEA: Trimmed 38424 records to 25889 (keeping 150 days of data) [2025-09-15T19:35:48.455877] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:48.456980] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-15T19:35:48.457612] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-15T19:35:48.458876] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-15T19:35:48.459176] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-15T19:35:49.000240] [INFO ] [REMOTE ] NEU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:49.001803] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-15T19:35:49.003802] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-15T19:35:49.071103] [DEBUG] [LOCAL ] NEA: Primary data saved (25889 records). [2025-09-15T19:35:49.071265] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-15T19:35:49.071382] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NEA took 33.9s. Estimated remaining: 1h 35m 36s. Rate: 9.4 symbols/min [2025-09-15T19:35:49.241692] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:49.245056] [DEBUG] [LOCAL ] NEUE: Loaded 1229 existing records from primary storage. [2025-09-15T19:35:49.245136] [INFO ] [MAIN ] NEUE: Loaded 1229 existing records. [2025-09-15T19:35:49.276076] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-15T19:35:49.428378] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:35:49.428676] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-15T19:35:49.428726] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-15T19:35:49.428956] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-15T19:35:49.429000] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-15T19:35:49.786659] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:35:49.818389] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T19:35:49.883590] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-15T19:35:50.057889] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-15T19:35:50.857841] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-15T19:35:51.359479] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T19:35:51.454925] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T19:35:51.657900] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-15T19:35:51.760313] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T19:35:52.128305] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T19:35:52.457922] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-15T19:35:53.031432] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T19:35:53.257895] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-15T19:35:53.658588] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:35:54.057885] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-15T19:35:54.681105] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:35:54.857878] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-15T19:35:55.657879] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-15T19:35:56.004355] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-15T19:35:56.457879] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-15T19:35:56.759522] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T19:35:56.808885] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T19:35:57.257868] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-15T19:35:58.057874] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-15T19:35:58.857836] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-15T19:35:58.996604] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T19:35:59.088831] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T19:35:59.094371] [INFO ] [REMOTE ] NET: Full fetch complete (57768 records). [2025-09-15T19:35:59.094479] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-15T19:35:59.478666] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-15T19:35:59.478761] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-15T19:35:59.479725] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-15T19:35:59.479782] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-15T19:35:59.481214] [DEBUG] [LOCAL ] NET: Trimmed 57768 records to 39108 (keeping 150 days of data) [2025-09-15T19:35:59.671330] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-15T19:35:59.752149] [DEBUG] [LOCAL ] NET: Primary data saved (39108 records). [2025-09-15T19:35:59.752405] [INFO ] [MAIN ] NET: Full history saved. [2025-09-15T19:35:59.753475] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NET took 25.7s. Estimated remaining: 1h 35m 32s. Rate: 9.4 symbols/min [2025-09-15T19:35:59.932617] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:35:59.938311] [DEBUG] [LOCAL ] NEXA: Loaded 2867 existing records from primary storage. [2025-09-15T19:35:59.938438] [INFO ] [MAIN ] NEXA: Loaded 2867 existing records. [2025-09-15T19:36:00.125033] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:00.125450] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-15T19:36:00.125500] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-15T19:36:00.125762] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-15T19:36:00.125810] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-15T19:36:00.466183] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-15T19:36:00.509624] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:00.531844] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:36:00.733567] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T19:36:00.799517] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T19:36:01.257900] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-15T19:36:02.057912] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-15T19:36:02.857918] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-15T19:36:03.424583] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:36:03.657913] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-15T19:36:03.957822] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-15T19:36:04.281364] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:36:04.446427] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-15T19:36:04.457818] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-15T19:36:05.257839] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-15T19:36:05.476275] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:36:05.477776] [INFO ] [REMOTE ] NEU: Full fetch complete (8614 records). [2025-09-15T19:36:05.477844] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-15T19:36:05.836023] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-15T19:36:05.836112] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-15T19:36:05.836424] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-15T19:36:05.836464] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-15T19:36:05.836968] [DEBUG] [LOCAL ] NEU: Trimmed 8614 records to 6787 (keeping 150 days of data) [2025-09-15T19:36:05.885544] [DEBUG] [LOCAL ] NEU: Primary data saved (6787 records). [2025-09-15T19:36:05.885712] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-15T19:36:05.885810] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NEU took 18.2s. Estimated remaining: 1h 35m 26s. Rate: 9.4 symbols/min [2025-09-15T19:36:06.063347] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-15T19:36:06.067748] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:06.096000] [DEBUG] [LOCAL ] NFG: Loaded 28591 existing records from primary storage. [2025-09-15T19:36:06.096132] [INFO ] [MAIN ] NFG: Loaded 28591 existing records. [2025-09-15T19:36:06.268815] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:06.269071] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-15T19:36:06.269117] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-15T19:36:06.270007] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-15T19:36:06.270059] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-15T19:36:06.612471] [INFO ] [REMOTE ] NFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:06.857867] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-15T19:36:06.908724] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T19:36:06.909301] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:36:06.917183] [INFO ] [REMOTE ] NEM: Full fetch complete (58388 records). [2025-09-15T19:36:06.917315] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-15T19:36:07.299455] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-15T19:36:07.299539] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-15T19:36:07.300409] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-15T19:36:07.300455] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-15T19:36:07.301628] [DEBUG] [LOCAL ] NEM: Trimmed 58388 records to 39668 (keeping 150 days of data) [2025-09-15T19:36:07.567998] [DEBUG] [LOCAL ] NEM: Primary data saved (39668 records). [2025-09-15T19:36:07.568175] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-15T19:36:07.569078] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NEM took 36.7s. Estimated remaining: 1h 35m 17s. Rate: 9.4 symbols/min [2025-09-15T19:36:07.667857] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-15T19:36:07.744337] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:07.761495] [DEBUG] [LOCAL ] NFJ: Loaded 14566 existing records from primary storage. [2025-09-15T19:36:07.761631] [INFO ] [MAIN ] NFJ: Loaded 14566 existing records. [2025-09-15T19:36:07.936016] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:07.936269] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-15T19:36:07.936315] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-15T19:36:07.936785] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-15T19:36:07.936841] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-15T19:36:08.154009] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T19:36:08.206180] [INFO ] [REMOTE ] NEUE: Full fetch complete (2408 records). [2025-09-15T19:36:08.223246] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-15T19:36:08.416083] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:08.459820] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-15T19:36:08.619770] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T19:36:08.707599] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-15T19:36:08.707692] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-15T19:36:08.707807] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-15T19:36:08.707852] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-15T19:36:08.708204] [DEBUG] [LOCAL ] NEUE: Trimmed 2408 records to 1185 (keeping 150 days of data) [2025-09-15T19:36:08.716047] [DEBUG] [LOCAL ] NEUE: Primary data saved (1185 records). [2025-09-15T19:36:08.716109] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-15T19:36:08.716176] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NEUE took 19.6s. Estimated remaining: 1h 35m 7s. Rate: 9.4 symbols/min [2025-09-15T19:36:08.888728] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:08.923296] [DEBUG] [LOCAL ] NGG: Loaded 35319 existing records from primary storage. [2025-09-15T19:36:08.923440] [INFO ] [MAIN ] NGG: Loaded 35319 existing records. [2025-09-15T19:36:09.108366] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:09.108684] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-15T19:36:09.108732] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-15T19:36:09.109738] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-15T19:36:09.109823] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-15T19:36:09.263458] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-15T19:36:09.497444] [INFO ] [REMOTE ] NGG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:09.802776] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:36:09.803433] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T19:36:10.057882] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-15T19:36:10.857880] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-15T19:36:11.341412] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T19:36:11.657874] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-15T19:36:11.891651] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T19:36:12.457911] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-15T19:36:12.891301] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:36:13.257936] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-15T19:36:13.642731] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T19:36:14.057923] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-15T19:36:14.857923] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-15T19:36:15.657927] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-15T19:36:16.102521] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-15T19:36:16.448101] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T19:36:16.457809] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-15T19:36:16.567963] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:36:17.053499] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-15T19:36:17.257877] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-15T19:36:17.651789] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T19:36:17.666146] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T19:36:18.057880] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-15T19:36:18.857900] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-15T19:36:19.269838] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T19:36:19.657889] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-15T19:36:20.305633] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T19:36:20.457895] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-15T19:36:20.844847] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:36:21.257896] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-15T19:36:21.308031] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:36:22.057895] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-15T19:36:22.857854] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-15T19:36:22.883831] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:36:22.917603] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:36:23.657920] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-15T19:36:23.707777] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:36:24.457934] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-15T19:36:25.047344] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T19:36:25.189991] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:36:25.257903] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-15T19:36:26.057920] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-15T19:36:26.476670] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:36:26.857920] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-15T19:36:27.470457] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T19:36:27.657911] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-15T19:36:28.063623] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T19:36:28.456862] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:36:28.461368] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-15T19:36:28.462723] [INFO ] [REMOTE ] NGG: Full fetch complete (50073 records). [2025-09-15T19:36:28.462799] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-15T19:36:28.838281] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-15T19:36:28.838361] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-15T19:36:28.839501] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-15T19:36:28.839546] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-15T19:36:28.840632] [DEBUG] [LOCAL ] NGG: Trimmed 50073 records to 34488 (keeping 150 days of data) [2025-09-15T19:36:29.052835] [DEBUG] [LOCAL ] NGG: Primary data saved (34488 records). [2025-09-15T19:36:29.052987] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-15T19:36:29.053895] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NGG took 20.3s. Estimated remaining: 1h 35m 9s. Rate: 9.4 symbols/min [2025-09-15T19:36:29.229345] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:29.252052] [DEBUG] [LOCAL ] NGL: Loaded 23004 existing records from primary storage. [2025-09-15T19:36:29.252193] [INFO ] [MAIN ] NGL: Loaded 23004 existing records. [2025-09-15T19:36:29.263278] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-15T19:36:29.430868] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:29.431104] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-15T19:36:29.431149] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-15T19:36:29.431611] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-15T19:36:29.431685] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-15T19:36:29.721169] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:36:29.804864] [INFO ] [REMOTE ] NGL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:29.808873] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:36:29.810439] [INFO ] [REMOTE ] NEXA: Full fetch complete (4290 records). [2025-09-15T19:36:29.810516] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-15T19:36:30.062985] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-15T19:36:30.172712] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-15T19:36:30.172800] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-15T19:36:30.172951] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-15T19:36:30.172990] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-15T19:36:30.173357] [DEBUG] [LOCAL ] NEXA: Trimmed 4290 records to 2952 (keeping 150 days of data) [2025-09-15T19:36:30.190947] [DEBUG] [LOCAL ] NEXA: Primary data saved (2952 records). [2025-09-15T19:36:30.191016] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-15T19:36:30.191092] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NEXA took 30.4s. Estimated remaining: 1h 34m 60s. Rate: 9.4 symbols/min [2025-09-15T19:36:30.367916] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:30.378250] [DEBUG] [LOCAL ] NGS: Loaded 8254 existing records from primary storage. [2025-09-15T19:36:30.378412] [INFO ] [MAIN ] NGS: Loaded 8254 existing records. [2025-09-15T19:36:30.555073] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:30.555318] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-15T19:36:30.555376] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-15T19:36:30.555733] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-15T19:36:30.555795] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-15T19:36:30.863033] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-15T19:36:30.922612] [INFO ] [REMOTE ] NGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:31.261341] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T19:36:31.657874] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-15T19:36:31.857797] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:36:32.457876] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-15T19:36:33.067724] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:36:33.071874] [INFO ] [REMOTE ] NFG: Full fetch complete (42542 records). [2025-09-15T19:36:33.071961] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-15T19:36:33.260811] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-15T19:36:33.350155] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:36:33.390807] [INFO ] [REMOTE ] NFJ: Full fetch complete (21964 records). [2025-09-15T19:36:33.414226] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-15T19:36:33.567824] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-15T19:36:33.567949] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-15T19:36:33.568949] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-15T19:36:33.574302] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-15T19:36:33.641962] [DEBUG] [LOCAL ] NFG: Trimmed 42542 records to 27895 (keeping 150 days of data) [2025-09-15T19:36:33.960801] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-15T19:36:33.965686] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-15T19:36:33.967016] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-15T19:36:33.968316] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-15T19:36:33.973764] [DEBUG] [LOCAL ] NFJ: Trimmed 21964 records to 14409 (keeping 150 days of data) [2025-09-15T19:36:34.076246] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-15T19:36:34.103962] [DEBUG] [LOCAL ] NFJ: Primary data saved (14409 records). [2025-09-15T19:36:34.112980] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-15T19:36:34.113118] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NFJ took 26.5s. Estimated remaining: 1h 34m 52s. Rate: 9.4 symbols/min [2025-09-15T19:36:34.186100] [DEBUG] [LOCAL ] NFG: Primary data saved (27895 records). [2025-09-15T19:36:34.186634] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-15T19:36:34.186771] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NFG took 28.3s. Estimated remaining: 1h 34m 42s. Rate: 9.4 symbols/min [2025-09-15T19:36:34.474291] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:34.493759] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:36:34.534053] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:36:34.533207] [DEBUG] [LOCAL ] NGVT: Loaded 18193 existing records from primary storage. [2025-09-15T19:36:34.539911] [INFO ] [MAIN ] NGVT: Loaded 18193 existing records. [2025-09-15T19:36:34.653143] [DEBUG] [LOCAL ] NGVC: Loaded 17464 existing records from primary storage. [2025-09-15T19:36:34.658917] [INFO ] [MAIN ] NGVC: Loaded 17464 existing records. [2025-09-15T19:36:34.831452] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:34.839309] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-15T19:36:34.849577] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-15T19:36:34.859837] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-15T19:36:34.899518] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-15T19:36:34.911679] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-15T19:36:34.910869] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:36:34.954128] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-15T19:36:34.979431] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-15T19:36:35.009904] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-15T19:36:35.012204] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-15T19:36:35.285267] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:36:35.593544] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:35.645555] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:36:35.657817] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-15T19:36:36.225636] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:36:36.457894] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-15T19:36:36.533120] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:36:37.257878] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-15T19:36:37.575523] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T19:36:38.057890] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-15T19:36:38.096776] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T19:36:38.857872] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-15T19:36:38.880194] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:36:39.568992] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T19:36:39.657876] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-15T19:36:40.457868] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-15T19:36:40.694801] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:36:41.092742] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:36:41.257883] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-15T19:36:42.057918] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-15T19:36:42.372524] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T19:36:42.857874] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-15T19:36:43.013620] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T19:36:43.532409] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:36:43.657832] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-15T19:36:44.407268] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:36:44.457823] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-15T19:36:44.953680] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T19:36:45.257869] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-15T19:36:46.057863] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-15T19:36:46.066853] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T19:36:46.068716] [INFO ] [REMOTE ] NGS: Full fetch complete (12636 records). [2025-09-15T19:36:46.068801] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-15T19:36:46.448750] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-15T19:36:46.448838] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-15T19:36:46.449168] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-15T19:36:46.449216] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-15T19:36:46.449721] [DEBUG] [LOCAL ] NGS: Trimmed 12636 records to 8037 (keeping 150 days of data) [2025-09-15T19:36:46.503929] [DEBUG] [LOCAL ] NGS: Primary data saved (8037 records). [2025-09-15T19:36:46.504124] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-15T19:36:46.504253] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGS took 16.3s. Estimated remaining: 1h 34m 39s. Rate: 9.4 symbols/min [2025-09-15T19:36:46.857887] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-15T19:36:47.172449] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:36:47.657915] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-15T19:36:47.790475] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:36:48.457844] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-15T19:36:48.521303] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:36:49.257890] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-15T19:36:49.654899] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T19:36:50.057883] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-15T19:36:50.485046] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:36:50.857878] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-15T19:36:51.141882] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:36:51.657857] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-15T19:36:51.768836] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T19:36:52.457928] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-15T19:36:52.508097] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:36:53.257909] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-15T19:36:53.732048] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T19:36:54.057906] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-15T19:36:54.439065] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T19:36:54.441989] [INFO ] [REMOTE ] NGVC: Full fetch complete (24181 records). [2025-09-15T19:36:54.442077] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-15T19:36:54.809191] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-15T19:36:54.809304] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-15T19:36:54.809944] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-15T19:36:54.809990] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-15T19:36:54.810855] [DEBUG] [LOCAL ] NGVC: Trimmed 24181 records to 17227 (keeping 150 days of data) [2025-09-15T19:36:54.865132] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-15T19:36:54.923492] [DEBUG] [LOCAL ] NGVC: Primary data saved (17227 records). [2025-09-15T19:36:54.923752] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-15T19:36:54.923905] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NGVC took 20.8s. Estimated remaining: 1h 34m 34s. Rate: 9.4 symbols/min [2025-09-15T19:36:54.936288] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:36:55.657935] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-15T19:36:56.232172] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:36:56.236207] [INFO ] [REMOTE ] NGL: Full fetch complete (32661 records). [2025-09-15T19:36:56.236285] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-15T19:36:56.611381] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-15T19:36:56.624028] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-15T19:36:56.625774] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:36:56.625321] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-15T19:36:56.630548] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-15T19:36:56.631236] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-15T19:36:56.632540] [DEBUG] [LOCAL ] NGL: Trimmed 32661 records to 22541 (keeping 150 days of data) [2025-09-15T19:36:56.760771] [DEBUG] [LOCAL ] NGL: Primary data saved (22541 records). [2025-09-15T19:36:56.760899] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-15T19:36:56.760993] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NGL took 27.7s. Estimated remaining: 1h 34m 25s. Rate: 9.4 symbols/min [2025-09-15T19:36:57.824138] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T19:36:57.830005] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-15T19:36:58.911743] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T19:36:58.914759] [INFO ] [REMOTE ] NGVT: Full fetch complete (26897 records). [2025-09-15T19:36:58.914867] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-15T19:36:59.288113] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-15T19:36:59.288192] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-15T19:36:59.288760] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-15T19:36:59.288802] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-15T19:36:59.289495] [DEBUG] [LOCAL ] NGVT: Trimmed 26897 records to 17832 (keeping 150 days of data) [2025-09-15T19:36:59.394923] [DEBUG] [LOCAL ] NGVT: Primary data saved (17832 records). [2025-09-15T19:36:59.395074] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-15T19:36:59.395160] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NGVT took 25.2s. Estimated remaining: 1h 34m 16s. Rate: 9.4 symbols/min [2025-09-15T19:37:00.011058] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:00.059863] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:00.084584] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:00.103774] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:00.119231] [DEBUG] [LOCAL ] NIE: Loaded 8228 existing records from primary storage. [2025-09-15T19:37:00.121078] [INFO ] [MAIN ] NIE: Loaded 8228 existing records. [2025-09-15T19:37:00.169356] [DEBUG] [LOCAL ] NIC: Loaded 6573 existing records from primary storage. [2025-09-15T19:37:00.196723] [DEBUG] [LOCAL ] NHI: Loaded 16738 existing records from primary storage. [2025-09-15T19:37:00.196593] [INFO ] [MAIN ] NIC: Loaded 6573 existing records. [2025-09-15T19:37:00.213375] [INFO ] [MAIN ] NHI: Loaded 16738 existing records. [2025-09-15T19:37:00.571047] [DEBUG] [LOCAL ] NI: Loaded 40187 existing records from primary storage. [2025-09-15T19:37:00.571176] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:00.647577] [INFO ] [MAIN ] NI: Loaded 40187 existing records. [2025-09-15T19:37:00.647437] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:00.670241] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-15T19:37:00.708100] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-15T19:37:00.702600] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:00.697390] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-15T19:37:00.742688] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-15T19:37:00.754662] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-15T19:37:00.754822] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-15T19:37:00.781289] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-15T19:37:00.781415] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-15T19:37:00.781389] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-15T19:37:00.833267] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-15T19:37:00.833359] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-15T19:37:00.833406] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-15T19:37:01.135921] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:01.340048] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-15T19:37:01.464845] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-15T19:37:01.516877] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-15T19:37:01.586065] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-15T19:37:01.916568] [INFO ] [REMOTE ] NIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:01.971223] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-15T19:37:02.025977] [INFO ] [REMOTE ] NIE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:02.059616] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-15T19:37:02.108304] [INFO ] [REMOTE ] NHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:02.127286] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-15T19:37:02.337698] [INFO ] [REMOTE ] NI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:02.337972] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-15T19:37:02.663693] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:37:02.665779] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-15T19:37:02.872180] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T19:37:02.874456] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-15T19:37:03.076208] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:37:03.080498] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-15T19:37:03.481235] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:37:03.580445] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T19:37:03.657877] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-15T19:37:04.129030] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:37:04.399156] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T19:37:04.457819] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-15T19:37:04.546243] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T19:37:05.257866] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-15T19:37:05.900894] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T19:37:06.059478] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-15T19:37:06.068584] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:37:06.675550] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:37:06.857905] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-15T19:37:07.618721] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T19:37:07.657881] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-15T19:37:08.457885] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-15T19:37:08.586731] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T19:37:09.147414] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:37:09.257872] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-15T19:37:09.915678] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:37:10.057876] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-15T19:37:10.857868] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-15T19:37:10.870975] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T19:37:11.559259] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T19:37:11.657836] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-15T19:37:12.457925] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-15T19:37:12.527406] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T19:37:13.243217] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T19:37:13.257822] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-15T19:37:13.997131] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:37:13.998388] [INFO ] [REMOTE ] NIC: Full fetch complete (9625 records). [2025-09-15T19:37:13.998457] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-15T19:37:14.063548] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-15T19:37:14.364841] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-15T19:37:14.364954] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-15T19:37:14.365242] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-15T19:37:14.365299] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-15T19:37:14.365891] [DEBUG] [LOCAL ] NIC: Trimmed 9625 records to 6420 (keeping 150 days of data) [2025-09-15T19:37:14.409605] [DEBUG] [LOCAL ] NIC: Primary data saved (6420 records). [2025-09-15T19:37:14.409776] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-15T19:37:14.409884] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIC took 15.0s. Estimated remaining: 1h 34m 15s. Rate: 9.4 symbols/min [2025-09-15T19:37:14.579937] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:14.584808] [DEBUG] [LOCAL ] NIM: Loaded 2843 existing records from primary storage. [2025-09-15T19:37:14.584904] [INFO ] [MAIN ] NIM: Loaded 2843 existing records. [2025-09-15T19:37:14.758168] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:14.758437] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-15T19:37:14.758482] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-15T19:37:14.758713] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-15T19:37:14.758760] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-15T19:37:14.863971] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-15T19:37:15.114589] [INFO ] [REMOTE ] NIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:15.657876] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-15T19:37:15.800371] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:37:15.948903] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:37:16.263783] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:37:16.265560] [INFO ] [REMOTE ] NIE: Full fetch complete (12453 records). [2025-09-15T19:37:16.265637] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-15T19:37:16.464935] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-15T19:37:16.634088] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-15T19:37:16.634192] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-15T19:37:16.634534] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-15T19:37:16.634574] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-15T19:37:16.635133] [DEBUG] [LOCAL ] NIE: Trimmed 12453 records to 8108 (keeping 150 days of data) [2025-09-15T19:37:16.686875] [DEBUG] [LOCAL ] NIE: Primary data saved (8108 records). [2025-09-15T19:37:16.687008] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-15T19:37:16.687122] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NIE took 17.3s. Estimated remaining: 1h 34m 6s. Rate: 9.4 symbols/min [2025-09-15T19:37:16.855362] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:16.876563] [DEBUG] [LOCAL ] NINE: Loaded 22068 existing records from primary storage. [2025-09-15T19:37:16.876767] [INFO ] [MAIN ] NINE: Loaded 22068 existing records. [2025-09-15T19:37:17.060581] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:17.060922] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-15T19:37:17.060977] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-15T19:37:17.070949] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:37:17.073033] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-15T19:37:17.073108] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-15T19:37:17.263126] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-15T19:37:17.428874] [INFO ] [REMOTE ] NINE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:18.057926] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-15T19:37:18.857909] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-15T19:37:19.242287] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-15T19:37:19.293517] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:37:19.657881] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-15T19:37:19.777864] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:37:20.457876] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-15T19:37:20.686869] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T19:37:21.121491] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:37:21.257877] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-15T19:37:22.057831] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-15T19:37:22.474563] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T19:37:22.606955] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T19:37:22.857864] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-15T19:37:23.657890] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-15T19:37:24.443506] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T19:37:24.457825] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-15T19:37:24.750321] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T19:37:25.257875] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-15T19:37:25.807916] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:37:26.057885] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-15T19:37:26.249917] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T19:37:26.857882] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-15T19:37:27.122286] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T19:37:27.414004] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T19:37:27.657933] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-15T19:37:28.457854] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-15T19:37:28.483054] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T19:37:29.257888] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-15T19:37:30.025065] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T19:37:30.027526] [INFO ] [REMOTE ] NHI: Full fetch complete (24052 records). [2025-09-15T19:37:30.027618] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-15T19:37:30.063057] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-15T19:37:30.396583] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-15T19:37:30.396766] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-15T19:37:30.397281] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-15T19:37:30.397333] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-15T19:37:30.398152] [DEBUG] [LOCAL ] NHI: Trimmed 24052 records to 16297 (keeping 150 days of data) [2025-09-15T19:37:30.507839] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T19:37:30.544098] [DEBUG] [LOCAL ] NHI: Primary data saved (16297 records). [2025-09-15T19:37:30.544240] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-15T19:37:30.544349] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NHI took 31.1s. Estimated remaining: 1h 34m 4s. Rate: 9.4 symbols/min [2025-09-15T19:37:30.645352] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T19:37:30.721601] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:30.770718] [DEBUG] [LOCAL ] NIO: Loaded 40542 existing records from primary storage. [2025-09-15T19:37:30.770877] [INFO ] [MAIN ] NIO: Loaded 40542 existing records. [2025-09-15T19:37:30.863124] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-15T19:37:30.947534] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:30.947816] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-15T19:37:30.947875] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-15T19:37:30.948808] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-15T19:37:30.948859] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-15T19:37:31.295392] [INFO ] [REMOTE ] NIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:31.657913] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-15T19:37:32.034862] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T19:37:32.241313] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:37:32.247063] [INFO ] [REMOTE ] NI: Full fetch complete (58086 records). [2025-09-15T19:37:32.247169] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-15T19:37:32.463066] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-15T19:37:32.652559] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-15T19:37:32.652710] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-15T19:37:32.654467] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-15T19:37:32.654545] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-15T19:37:32.656656] [DEBUG] [LOCAL ] NI: Trimmed 58086 records to 39409 (keeping 150 days of data) [2025-09-15T19:37:32.948059] [DEBUG] [LOCAL ] NI: Primary data saved (39409 records). [2025-09-15T19:37:32.948295] [INFO ] [MAIN ] NI: Full history saved. [2025-09-15T19:37:32.948443] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NI took 33.5s. Estimated remaining: 1h 33m 55s. Rate: 9.4 symbols/min [2025-09-15T19:37:33.124990] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:33.125282] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-15T19:37:33.125326] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-15T19:37:33.125468] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-15T19:37:33.125571] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-15T19:37:33.125618] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-15T19:37:33.125675] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-15T19:37:33.263119] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-15T19:37:33.501809] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:33.838500] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T19:37:33.839973] [INFO ] [REMOTE ] NIM: Full fetch complete (4693 records). [2025-09-15T19:37:33.840076] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-15T19:37:34.067028] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-15T19:37:34.226986] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-15T19:37:34.227095] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-15T19:37:34.227335] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-15T19:37:34.227409] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-15T19:37:34.227863] [DEBUG] [LOCAL ] NIM: Trimmed 4693 records to 2724 (keeping 150 days of data) [2025-09-15T19:37:34.246497] [DEBUG] [LOCAL ] NIM: Primary data saved (2724 records). [2025-09-15T19:37:34.246656] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-15T19:37:34.246782] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NIM took 19.8s. Estimated remaining: 1h 33m 46s. Rate: 9.4 symbols/min [2025-09-15T19:37:34.332806] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:37:34.357894] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-15T19:37:34.431177] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:34.462261] [DEBUG] [LOCAL ] NJR: Loaded 28259 existing records from primary storage. [2025-09-15T19:37:34.462449] [INFO ] [MAIN ] NJR: Loaded 28259 existing records. [2025-09-15T19:37:34.653378] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:34.653665] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-15T19:37:34.653712] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-15T19:37:34.654522] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-15T19:37:34.654573] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-15T19:37:34.860890] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-15T19:37:35.008120] [INFO ] [REMOTE ] NJR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:35.036896] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-15T19:37:35.127194] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:37:35.127514] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-15T19:37:35.657883] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-15T19:37:35.851571] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:37:35.851918] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-15T19:37:36.457910] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-15T19:37:37.257891] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-15T19:37:38.057943] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-15T19:37:38.695998] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-15T19:37:38.757847] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T19:37:38.857874] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-15T19:37:39.005829] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:37:39.657841] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-15T19:37:39.818966] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:37:40.457891] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-15T19:37:41.257883] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-15T19:37:41.519279] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T19:37:41.898989] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T19:37:42.057874] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-15T19:37:42.503762] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T19:37:42.857948] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-15T19:37:43.657891] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-15T19:37:43.771710] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T19:37:43.774665] [INFO ] [REMOTE ] NINE: Full fetch complete (31680 records). [2025-09-15T19:37:43.774790] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-15T19:37:44.155927] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-15T19:37:44.156055] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-15T19:37:44.156900] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-15T19:37:44.157003] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-15T19:37:44.158140] [DEBUG] [LOCAL ] NINE: Trimmed 31680 records to 21617 (keeping 150 days of data) [2025-09-15T19:37:44.285569] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-15T19:37:44.342901] [DEBUG] [LOCAL ] NINE: Primary data saved (21617 records). [2025-09-15T19:37:44.343097] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-15T19:37:44.343220] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NINE took 27.7s. Estimated remaining: 1h 33m 42s. Rate: 9.4 symbols/min [2025-09-15T19:37:44.463095] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-15T19:37:44.529031] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:44.529321] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-15T19:37:44.529360] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-15T19:37:44.529494] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-15T19:37:44.529535] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-15T19:37:44.529577] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-15T19:37:44.529611] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-15T19:37:44.767274] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:37:44.795815] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-15T19:37:44.919676] [INFO ] [REMOTE ] NKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:37:44.960494] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:37:45.257893] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-15T19:37:46.057887] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-15T19:37:46.857940] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-15T19:37:47.037229] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:37:47.037542] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-15T19:37:47.349782] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:37:47.594373] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-15T19:37:47.657832] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-15T19:37:48.457878] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-15T19:37:48.773310] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:37:49.257883] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-15T19:37:50.057855] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-15T19:37:50.857929] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-15T19:37:51.026741] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-15T19:37:51.242269] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:37:51.657870] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-15T19:37:51.727723] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-15T19:37:51.747412] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T19:37:52.457868] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-15T19:37:53.257887] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-15T19:37:53.934548] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T19:37:54.057836] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-15T19:37:54.202862] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-15T19:37:54.857887] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-15T19:37:55.417538] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T19:37:55.555636] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-15T19:37:55.657910] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-15T19:37:56.457906] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-15T19:37:57.257883] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-15T19:37:57.350914] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-15T19:37:57.357593] [INFO ] [REMOTE ] NIO: Full fetch complete (58482 records). [2025-09-15T19:37:57.357791] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-15T19:37:57.776846] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-15T19:37:57.776966] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-15T19:37:57.778388] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-15T19:37:57.778454] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-15T19:37:57.780386] [DEBUG] [LOCAL ] NIO: Trimmed 58482 records to 39762 (keeping 150 days of data) [2025-09-15T19:37:58.041779] [DEBUG] [LOCAL ] NIO: Primary data saved (39762 records). [2025-09-15T19:37:58.041997] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-15T19:37:58.043220] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NIO took 27.5s. Estimated remaining: 1h 33m 40s. Rate: 9.4 symbols/min [2025-09-15T19:37:58.220036] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:58.236739] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T19:37:58.245838] [INFO ] [REMOTE ] NIQ: Full fetch complete (12987 records). [2025-09-15T19:37:58.245970] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-15T19:37:58.333197] [DEBUG] [LOCAL ] NKX: Loaded 10334 existing records from primary storage. [2025-09-15T19:37:58.350598] [INFO ] [MAIN ] NKX: Loaded 10334 existing records. [2025-09-15T19:37:58.574439] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 38 unique days, need 150 days [2025-09-15T19:37:58.580822] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:37:58.725860] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:37:58.726414] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-15T19:37:58.657208] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:37:58.727079] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-15T19:37:58.727233] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-15T19:37:58.733478] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-15T19:37:58.733318] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-15T19:37:58.733812] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-15T19:37:58.746898] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-15T19:37:58.760386] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-15T19:37:58.765563] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-15T19:37:58.761536] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-15T19:37:58.781359] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NIQ took 25.8s. Estimated remaining: 1h 33m 30s. Rate: 9.4 symbols/min [2025-09-15T19:37:58.790900] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T19:37:58.841358] [INFO ] [REMOTE ] NJR: Full fetch complete (40845 records). [2025-09-15T19:37:58.889708] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-15T19:37:59.519087] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:37:59.645902] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-15T19:37:59.686001] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-15T19:37:59.769638] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-15T19:37:59.806334] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-15T19:37:59.849239] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-15T19:37:59.929848] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-15T19:37:59.979406] [INFO ] [REMOTE ] NKX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:00.055770] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-15T19:38:00.180320] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-15T19:38:00.180567] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-15T19:38:00.181500] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-15T19:38:00.181887] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-15T19:38:00.242754] [DEBUG] [LOCAL ] NJR: Trimmed 40845 records to 27763 (keeping 150 days of data) [2025-09-15T19:38:00.567984] [INFO ] [REMOTE ] NL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:00.570525] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-15T19:38:00.622479] [DEBUG] [LOCAL ] NJR: Primary data saved (27763 records). [2025-09-15T19:38:00.622630] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-15T19:38:00.622755] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NJR took 26.4s. Estimated remaining: 1h 33m 21s. Rate: 9.4 symbols/min [2025-09-15T19:38:00.794299] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:00.804329] [DEBUG] [LOCAL ] NLOP: Loaded 8503 existing records from primary storage. [2025-09-15T19:38:00.804464] [INFO ] [MAIN ] NLOP: Loaded 8503 existing records. [2025-09-15T19:38:00.980358] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:00.980637] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-15T19:38:00.980708] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-15T19:38:00.981160] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-15T19:38:00.981210] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-15T19:38:01.103344] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T19:38:01.136476] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-15T19:38:01.225563] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:38:01.284619] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-15T19:38:01.368119] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:01.463587] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-15T19:38:01.811669] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:38:02.057972] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-15T19:38:02.059987] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T19:38:02.665100] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:38:02.857891] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-15T19:38:03.664169] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-15T19:38:03.667165] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:38:04.194249] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T19:38:04.457888] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-15T19:38:05.084137] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:38:05.257900] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-15T19:38:05.880284] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T19:38:06.057860] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-15T19:38:06.683400] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:38:06.857879] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-15T19:38:07.589768] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:38:07.657866] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-15T19:38:08.416346] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:38:08.457872] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-15T19:38:09.257874] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-15T19:38:09.364978] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T19:38:09.782028] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T19:38:09.783052] [INFO ] [REMOTE ] NL: Full fetch complete (5208 records). [2025-09-15T19:38:09.783121] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-15T19:38:09.957596] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:38:09.957798] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:38:09.957848] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:38:09.957886] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-15T19:38:09.957947] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-15T19:38:09.957982] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-15T19:38:09.958021] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-15T19:38:09.958075] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NL took 11.1s. Estimated remaining: 1h 33m 16s. Rate: 9.4 symbols/min [2025-09-15T19:38:10.063021] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-15T19:38:10.129619] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:10.169154] [DEBUG] [LOCAL ] NLY: Loaded 40330 existing records from primary storage. [2025-09-15T19:38:10.169291] [INFO ] [MAIN ] NLY: Loaded 40330 existing records. [2025-09-15T19:38:10.357418] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:10.357813] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-15T19:38:10.357869] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-15T19:38:10.359179] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-15T19:38:10.359425] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-15T19:38:10.725354] [INFO ] [REMOTE ] NLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:10.857875] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-15T19:38:10.881296] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:38:11.628709] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:38:11.657817] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-15T19:38:12.457889] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-15T19:38:12.491746] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:38:13.257919] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-15T19:38:14.057929] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-15T19:38:14.219946] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T19:38:14.399392] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T19:38:14.731668] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:38:14.857894] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-15T19:38:15.657885] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-15T19:38:15.742418] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:38:16.457900] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-15T19:38:17.164529] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T19:38:17.257847] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-15T19:38:17.450596] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T19:38:18.057876] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-15T19:38:18.816193] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:38:18.818227] [INFO ] [REMOTE ] NLOP: Full fetch complete (12917 records). [2025-09-15T19:38:18.818310] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-15T19:38:18.862979] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-15T19:38:19.179126] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-15T19:38:19.179269] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-15T19:38:19.179634] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-15T19:38:19.179707] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-15T19:38:19.180509] [DEBUG] [LOCAL ] NLOP: Trimmed 12917 records to 8370 (keeping 150 days of data) [2025-09-15T19:38:19.233205] [DEBUG] [LOCAL ] NLOP: Primary data saved (8370 records). [2025-09-15T19:38:19.233415] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-15T19:38:19.233542] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NLOP took 18.6s. Estimated remaining: 1h 33m 12s. Rate: 9.4 symbols/min [2025-09-15T19:38:19.439026] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-15T19:38:19.441320] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:19.463509] [DEBUG] [LOCAL ] NMAI: Loaded 9356 existing records from primary storage. [2025-09-15T19:38:19.463630] [INFO ] [MAIN ] NMAI: Loaded 9356 existing records. [2025-09-15T19:38:19.639066] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:19.639332] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-15T19:38:19.639382] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-15T19:38:19.639770] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-15T19:38:19.639825] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-15T19:38:19.663001] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-15T19:38:20.000279] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:20.457960] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-15T19:38:20.658773] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:38:21.035169] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-15T19:38:21.257870] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-15T19:38:21.311770] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:38:21.999569] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:38:22.001716] [INFO ] [REMOTE ] NKX: Full fetch complete (14669 records). [2025-09-15T19:38:22.001792] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-15T19:38:22.062984] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-15T19:38:22.369570] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-15T19:38:22.369672] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-15T19:38:22.370033] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-15T19:38:22.370072] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-15T19:38:22.370593] [DEBUG] [LOCAL ] NKX: Trimmed 14669 records to 10202 (keeping 150 days of data) [2025-09-15T19:38:22.438109] [DEBUG] [LOCAL ] NKX: Primary data saved (10202 records). [2025-09-15T19:38:22.438282] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-15T19:38:22.438397] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NKX took 24.4s. Estimated remaining: 1h 33m 4s. Rate: 9.4 symbols/min [2025-09-15T19:38:22.605506] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:22.605714] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-15T19:38:22.605751] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-15T19:38:22.605903] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-15T19:38:22.605941] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-15T19:38:22.605981] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-15T19:38:22.606014] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-15T19:38:22.863101] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-15T19:38:22.960245] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:23.642886] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:38:23.657811] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-15T19:38:24.198955] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T19:38:24.300778] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T19:38:24.457933] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-15T19:38:25.050063] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:38:25.257921] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-15T19:38:25.901826] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T19:38:26.057925] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-15T19:38:26.243519] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:38:26.243932] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-15T19:38:26.857876] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-15T19:38:27.657865] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-15T19:38:28.067188] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T19:38:28.457844] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-15T19:38:28.636401] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:38:29.257888] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-15T19:38:30.057926] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-15T19:38:30.748583] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:38:30.794572] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T19:38:30.857876] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-15T19:38:31.657910] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-15T19:38:32.093817] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-15T19:38:32.099552] [INFO ] [REMOTE ] NKE: Full fetch complete (57717 records). [2025-09-15T19:38:32.099726] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-15T19:38:32.295765] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T19:38:32.296603] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:38:32.296685] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:38:32.296734] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-15T19:38:32.296836] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-15T19:38:32.296879] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-15T19:38:32.296923] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-15T19:38:32.297017] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NKE took 48.0s. Estimated remaining: 1h 32m 59s. Rate: 9.4 symbols/min [2025-09-15T19:38:32.463327] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-15T19:38:32.481124] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:38:32.507019] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:32.521706] [DEBUG] [LOCAL ] NMCO: Loaded 12649 existing records from primary storage. [2025-09-15T19:38:32.521827] [INFO ] [MAIN ] NMCO: Loaded 12649 existing records. [2025-09-15T19:38:32.730484] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T19:38:32.736392] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:32.746191] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-15T19:38:32.746280] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-15T19:38:32.747080] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-15T19:38:32.747140] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-15T19:38:33.121867] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:33.257872] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-15T19:38:34.057933] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-15T19:38:34.301173] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T19:38:34.321209] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:38:34.857895] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-15T19:38:35.657919] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-15T19:38:35.913627] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T19:38:36.331242] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T19:38:36.369509] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T19:38:36.457885] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-15T19:38:37.257868] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-15T19:38:38.057908] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-15T19:38:38.350151] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T19:38:38.373674] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T19:38:38.767090] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T19:38:38.857868] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-15T19:38:39.657898] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-15T19:38:40.180544] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:38:40.223771] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T19:38:40.457911] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-15T19:38:41.167247] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:38:41.257911] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-15T19:38:42.057869] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-15T19:38:42.204241] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:38:42.857915] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-15T19:38:43.514617] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T19:38:43.520458] [INFO ] [REMOTE ] NLY: Full fetch complete (58251 records). [2025-09-15T19:38:43.520574] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-15T19:38:43.662978] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-15T19:38:43.909813] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-15T19:38:43.909913] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-15T19:38:43.910927] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-15T19:38:43.910998] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-15T19:38:43.912409] [DEBUG] [LOCAL ] NLY: Trimmed 58251 records to 39550 (keeping 150 days of data) [2025-09-15T19:38:44.165969] [DEBUG] [LOCAL ] NLY: Primary data saved (39550 records). [2025-09-15T19:38:44.166136] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-15T19:38:44.167100] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NLY took 34.2s. Estimated remaining: 1h 32m 56s. Rate: 9.4 symbols/min [2025-09-15T19:38:44.386437] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:44.391071] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:38:44.409925] [DEBUG] [LOCAL ] NMG: Loaded 5919 existing records from primary storage. [2025-09-15T19:38:44.410070] [INFO ] [MAIN ] NMG: Loaded 5919 existing records. [2025-09-15T19:38:44.467509] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-15T19:38:44.601071] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:44.601376] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-15T19:38:44.601555] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-15T19:38:44.607063] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-15T19:38:44.611828] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-15T19:38:44.659060] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:38:44.995125] [INFO ] [REMOTE ] NMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:45.257888] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-15T19:38:45.390463] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T19:38:45.392512] [INFO ] [REMOTE ] NMAI: Full fetch complete (14371 records). [2025-09-15T19:38:45.392582] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-15T19:38:45.755704] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-15T19:38:45.755786] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-15T19:38:45.756103] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-15T19:38:45.756143] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-15T19:38:45.756628] [DEBUG] [LOCAL ] NMAI: Trimmed 14371 records to 9248 (keeping 150 days of data) [2025-09-15T19:38:45.814121] [DEBUG] [LOCAL ] NMAI: Primary data saved (9248 records). [2025-09-15T19:38:45.814271] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-15T19:38:45.814356] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NMAI took 26.6s. Estimated remaining: 1h 32m 47s. Rate: 9.4 symbols/min [2025-09-15T19:38:45.983975] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:45.993065] [DEBUG] [LOCAL ] NMI: Loaded 3384 existing records from primary storage. [2025-09-15T19:38:45.993208] [INFO ] [MAIN ] NMI: Loaded 3384 existing records. [2025-09-15T19:38:46.062328] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-15T19:38:46.123060] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:38:46.157609] [INFO ] [REMOTE ] NMCO: Full fetch complete (17444 records). [2025-09-15T19:38:46.164351] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-15T19:38:46.217049] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:46.276761] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-15T19:38:46.287258] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-15T19:38:46.313954] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-15T19:38:46.336988] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-15T19:38:46.831311] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-15T19:38:46.831616] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-15T19:38:46.842433] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-15T19:38:46.852699] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-15T19:38:46.881133] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-15T19:38:46.908373] [INFO ] [REMOTE ] NMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:46.909693] [DEBUG] [LOCAL ] NMCO: Trimmed 17444 records to 12266 (keeping 150 days of data) [2025-09-15T19:38:46.988508] [DEBUG] [LOCAL ] NMCO: Primary data saved (12266 records). [2025-09-15T19:38:46.988661] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-15T19:38:46.988755] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMCO took 14.7s. Estimated remaining: 1h 32m 38s. Rate: 9.4 symbols/min [2025-09-15T19:38:47.164054] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:47.174518] [DEBUG] [LOCAL ] NMM: Loaded 10048 existing records from primary storage. [2025-09-15T19:38:47.174635] [INFO ] [MAIN ] NMM: Loaded 10048 existing records. [2025-09-15T19:38:47.347040] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:47.347289] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-15T19:38:47.347336] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-15T19:38:47.347699] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-15T19:38:47.347753] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-15T19:38:47.662965] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-15T19:38:47.697348] [INFO ] [REMOTE ] NMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:47.704274] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:38:47.863295] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T19:38:47.868179] [INFO ] [REMOTE ] NMAX: Full fetch complete (38208 records). [2025-09-15T19:38:47.868277] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-15T19:38:48.058109] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 116 unique days, need 150 days [2025-09-15T19:38:48.058605] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:38:48.058673] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:38:48.058715] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-15T19:38:48.058824] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-15T19:38:48.058872] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-15T19:38:48.058914] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-15T19:38:48.058998] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NMAX took 25.6s. Estimated remaining: 1h 32m 28s. Rate: 9.4 symbols/min [2025-09-15T19:38:48.236458] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T19:38:48.240049] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:48.267463] [DEBUG] [LOCAL ] NMR: Loaded 25901 existing records from primary storage. [2025-09-15T19:38:48.267607] [INFO ] [MAIN ] NMR: Loaded 25901 existing records. [2025-09-15T19:38:48.440038] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:48.440300] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-15T19:38:48.440348] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-15T19:38:48.441073] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-15T19:38:48.441128] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-15T19:38:48.463038] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-15T19:38:48.796109] [INFO ] [REMOTE ] NMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:49.019164] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T19:38:49.257872] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-15T19:38:49.655188] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:38:50.057932] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-15T19:38:50.675853] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:38:50.857887] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-15T19:38:51.311239] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:38:51.657891] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-15T19:38:52.457957] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-15T19:38:52.480581] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:38:53.257871] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-15T19:38:53.261570] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:38:54.057873] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-15T19:38:54.566606] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T19:38:54.622418] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:38:54.857881] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-15T19:38:55.327533] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T19:38:55.657923] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-15T19:38:56.149357] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T19:38:56.457885] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-15T19:38:57.050765] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:38:57.257877] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-15T19:38:57.831126] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:38:57.832351] [INFO ] [REMOTE ] NMI: Full fetch complete (4439 records). [2025-09-15T19:38:57.832441] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-15T19:38:58.063154] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-15T19:38:58.213477] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-15T19:38:58.213570] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-15T19:38:58.213778] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-15T19:38:58.213857] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-15T19:38:58.214326] [DEBUG] [LOCAL ] NMI: Trimmed 4439 records to 3338 (keeping 150 days of data) [2025-09-15T19:38:58.235359] [DEBUG] [LOCAL ] NMI: Primary data saved (3338 records). [2025-09-15T19:38:58.235476] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-15T19:38:58.235565] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMI took 12.4s. Estimated remaining: 1h 32m 24s. Rate: 9.4 symbols/min [2025-09-15T19:38:58.404588] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:38:58.408468] [DEBUG] [LOCAL ] NMS: Loaded 2290 existing records from primary storage. [2025-09-15T19:38:58.408544] [INFO ] [MAIN ] NMS: Loaded 2290 existing records. [2025-09-15T19:38:58.584893] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:38:58.585185] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-15T19:38:58.585234] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-15T19:38:58.585407] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-15T19:38:58.585450] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-15T19:38:58.724604] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:38:58.862954] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-15T19:38:58.964713] [INFO ] [REMOTE ] NMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:38:59.619597] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:38:59.657873] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-15T19:39:00.052079] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T19:39:00.457881] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-15T19:39:01.257894] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-15T19:39:01.452430] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:39:02.058074] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-15T19:39:02.857873] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-15T19:39:03.522821] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T19:39:03.657874] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-15T19:39:04.306835] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T19:39:04.457869] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-15T19:39:04.582111] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T19:39:04.935000] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T19:39:05.257839] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-15T19:39:05.618116] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-15T19:39:05.669264] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T19:39:06.057871] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-15T19:39:06.624408] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T19:39:06.857900] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-15T19:39:07.542379] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:39:07.657860] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-15T19:39:08.352060] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T19:39:08.353328] [INFO ] [REMOTE ] NMG: Full fetch complete (8013 records). [2025-09-15T19:39:08.353433] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-15T19:39:08.462947] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-15T19:39:08.748998] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-15T19:39:08.749075] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-15T19:39:08.749269] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-15T19:39:08.749307] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-15T19:39:08.749739] [DEBUG] [LOCAL ] NMG: Trimmed 8013 records to 5659 (keeping 150 days of data) [2025-09-15T19:39:08.783123] [DEBUG] [LOCAL ] NMG: Primary data saved (5659 records). [2025-09-15T19:39:08.783260] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-15T19:39:08.783348] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMG took 24.6s. Estimated remaining: 1h 32m 20s. Rate: 9.4 symbols/min [2025-09-15T19:39:08.954254] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:08.958116] [DEBUG] [LOCAL ] NMT: Loaded 2165 existing records from primary storage. [2025-09-15T19:39:08.958198] [INFO ] [MAIN ] NMT: Loaded 2165 existing records. [2025-09-15T19:39:09.060484] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:39:09.138890] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:09.139175] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-15T19:39:09.139220] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-15T19:39:09.139460] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-15T19:39:09.139505] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-15T19:39:09.263030] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-15T19:39:09.501599] [INFO ] [REMOTE ] NMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:10.057994] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-15T19:39:10.287969] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T19:39:10.467192] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T19:39:10.857922] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-15T19:39:11.657874] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-15T19:39:11.753012] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T19:39:11.984082] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T19:39:12.457952] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-15T19:39:13.222676] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:39:13.223746] [INFO ] [REMOTE ] NMS: Full fetch complete (3151 records). [2025-09-15T19:39:13.223821] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-15T19:39:13.263003] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-15T19:39:13.599190] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-15T19:39:13.599277] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-15T19:39:13.599397] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-15T19:39:13.599465] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-15T19:39:13.599888] [DEBUG] [LOCAL ] NMS: Trimmed 3151 records to 2278 (keeping 150 days of data) [2025-09-15T19:39:13.614827] [DEBUG] [LOCAL ] NMS: Primary data saved (2278 records). [2025-09-15T19:39:13.614893] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-15T19:39:13.614988] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NMS took 15.4s. Estimated remaining: 1h 32m 13s. Rate: 9.4 symbols/min [2025-09-15T19:39:13.791449] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:13.809500] [DEBUG] [LOCAL ] NMZ: Loaded 15769 existing records from primary storage. [2025-09-15T19:39:13.809637] [INFO ] [MAIN ] NMZ: Loaded 15769 existing records. [2025-09-15T19:39:13.991326] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:13.991617] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-15T19:39:13.991688] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-15T19:39:13.992197] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-15T19:39:13.992254] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-15T19:39:14.063533] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-15T19:39:14.364412] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:14.857910] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-15T19:39:15.351607] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T19:39:15.526670] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T19:39:15.657865] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-15T19:39:15.690461] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T19:39:16.457922] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-15T19:39:16.501605] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T19:39:16.801573] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-15T19:39:17.257889] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-15T19:39:18.057905] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-15T19:39:18.567722] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T19:39:18.857874] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-15T19:39:18.884095] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:39:18.886255] [INFO ] [REMOTE ] NMM: Full fetch complete (15895 records). [2025-09-15T19:39:18.886327] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-15T19:39:19.249829] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-15T19:39:19.249918] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-15T19:39:19.250355] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-15T19:39:19.250406] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-15T19:39:19.251012] [DEBUG] [LOCAL ] NMM: Trimmed 15895 records to 9879 (keeping 150 days of data) [2025-09-15T19:39:19.315984] [DEBUG] [LOCAL ] NMM: Primary data saved (9879 records). [2025-09-15T19:39:19.316138] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-15T19:39:19.316427] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NMM took 32.3s. Estimated remaining: 1h 32m 6s. Rate: 9.4 symbols/min [2025-09-15T19:39:19.494220] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:19.504867] [DEBUG] [LOCAL ] NNI: Loaded 7915 existing records from primary storage. [2025-09-15T19:39:19.505004] [INFO ] [MAIN ] NNI: Loaded 7915 existing records. [2025-09-15T19:39:19.665867] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-15T19:39:19.688053] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:19.689272] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-15T19:39:19.689342] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-15T19:39:19.689822] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-15T19:39:19.689898] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-15T19:39:20.071741] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T19:39:20.078484] [INFO ] [REMOTE ] NNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:20.100473] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T19:39:20.457874] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-15T19:39:21.264320] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-15T19:39:21.267668] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:39:22.057875] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-15T19:39:22.711132] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:39:22.769355] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:39:22.857888] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-15T19:39:23.657906] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-15T19:39:23.985570] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:39:24.457841] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-15T19:39:24.748069] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T19:39:25.098247] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T19:39:25.257821] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-15T19:39:26.057873] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-15T19:39:26.610873] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T19:39:26.857932] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-15T19:39:27.164590] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:39:27.450702] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:39:27.657891] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-15T19:39:27.790987] [DEBUG] [REMOTE ] NNI: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-15T19:39:27.791319] [WARN ] [REMOTE ] NNI: No data returned for month 2025-04 [2025-09-15T19:39:28.457885] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-15T19:39:29.257862] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-15T19:39:29.278821] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:39:30.048343] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T19:39:30.057807] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-15T19:39:30.857885] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-15T19:39:31.098192] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:39:31.101213] [INFO ] [REMOTE ] NMZ: Full fetch complete (23309 records). [2025-09-15T19:39:31.101321] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-15T19:39:31.378985] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T19:39:31.476748] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-15T19:39:31.476840] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-15T19:39:31.477464] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-15T19:39:31.477516] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-15T19:39:31.478310] [DEBUG] [LOCAL ] NMZ: Trimmed 23309 records to 15373 (keeping 150 days of data) [2025-09-15T19:39:31.576948] [DEBUG] [LOCAL ] NMZ: Primary data saved (15373 records). [2025-09-15T19:39:31.577087] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-15T19:39:31.577221] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NMZ took 18.0s. Estimated remaining: 1h 32m 3s. Rate: 9.4 symbols/min [2025-09-15T19:39:31.663029] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-15T19:39:31.753399] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:31.795187] [DEBUG] [LOCAL ] NNN: Loaded 36174 existing records from primary storage. [2025-09-15T19:39:31.795322] [INFO ] [MAIN ] NNN: Loaded 36174 existing records. [2025-09-15T19:39:31.975911] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:31.976163] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-15T19:39:31.976209] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-15T19:39:31.977153] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-15T19:39:31.977203] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-15T19:39:32.331634] [INFO ] [REMOTE ] NNN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:32.371742] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:39:32.457912] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-15T19:39:33.257902] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-15T19:39:33.943415] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T19:39:34.057865] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-15T19:39:34.584009] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:39:34.588007] [INFO ] [REMOTE ] NMR: Full fetch complete (38017 records). [2025-09-15T19:39:34.588099] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-15T19:39:34.866501] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-15T19:39:34.964228] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-15T19:39:34.964312] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-15T19:39:34.965152] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-15T19:39:34.965200] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-15T19:39:34.966632] [DEBUG] [LOCAL ] NMR: Trimmed 38017 records to 25248 (keeping 150 days of data) [2025-09-15T19:39:35.125926] [DEBUG] [LOCAL ] NMR: Primary data saved (25248 records). [2025-09-15T19:39:35.126064] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-15T19:39:35.126168] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NMR took 47.1s. Estimated remaining: 1h 31m 55s. Rate: 9.4 symbols/min [2025-09-15T19:39:35.294897] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:35.301969] [DEBUG] [LOCAL ] NNY: Loaded 4138 existing records from primary storage. [2025-09-15T19:39:35.302099] [INFO ] [MAIN ] NNY: Loaded 4138 existing records. [2025-09-15T19:39:35.463270] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:39:35.491611] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:35.492085] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-15T19:39:35.492226] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-15T19:39:35.492555] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-15T19:39:35.492629] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-15T19:39:35.659823] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-15T19:39:35.887761] [INFO ] [REMOTE ] NNY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:35.889809] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T19:39:36.244579] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:39:36.457878] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-15T19:39:37.115178] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:39:37.257896] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-15T19:39:37.717707] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T19:39:37.718671] [INFO ] [REMOTE ] NMT: Full fetch complete (3015 records). [2025-09-15T19:39:37.718738] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-15T19:39:38.062238] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-15T19:39:38.066891] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-15T19:39:38.067873] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-15T19:39:38.067992] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-15T19:39:38.068031] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-15T19:39:38.068386] [DEBUG] [LOCAL ] NMT: Trimmed 3015 records to 2149 (keeping 150 days of data) [2025-09-15T19:39:38.083670] [DEBUG] [LOCAL ] NMT: Primary data saved (2149 records). [2025-09-15T19:39:38.083756] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-15T19:39:38.083840] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NMT took 29.3s. Estimated remaining: 1h 31m 47s. Rate: 9.4 symbols/min [2025-09-15T19:39:38.252841] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:38.267440] [DEBUG] [LOCAL ] NOA: Loaded 11606 existing records from primary storage. [2025-09-15T19:39:38.267549] [INFO ] [MAIN ] NOA: Loaded 11606 existing records. [2025-09-15T19:39:38.449535] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:38.449793] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-15T19:39:38.449849] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-15T19:39:38.450287] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-15T19:39:38.450333] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-15T19:39:38.736081] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T19:39:38.816675] [INFO ] [REMOTE ] NOA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:38.857832] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-15T19:39:39.549925] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:39:39.657827] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-15T19:39:40.457894] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-15T19:39:40.645908] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:39:41.213482] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T19:39:41.257909] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-15T19:39:42.057902] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-15T19:39:42.076483] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T19:39:42.663947] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:39:42.857878] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-15T19:39:43.657893] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-15T19:39:43.846672] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:39:44.200608] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T19:39:44.457900] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-15T19:39:45.215186] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T19:39:45.257833] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-15T19:39:45.970149] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:39:45.972142] [INFO ] [REMOTE ] NNI: Full fetch complete (9043 records). [2025-09-15T19:39:45.972215] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-15T19:39:46.063111] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-15T19:39:46.161572] [WARN ] [VALIDATOR ] NNI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T19:39:46.161859] [FATAL] [MAIN ] NNI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:39:46.161931] [WARN ] [MAIN ] NNI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:39:46.161976] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-15T19:39:46.162040] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-09-15T19:39:46.162078] [INFO ] [LOCAL ] NNI: Starting deletion of derivative data. [2025-09-15T19:39:46.162433] [DEBUG] [LOCAL ] NNI: Deleted derivative data file. [2025-09-15T19:39:46.162549] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NNI took 26.8s. Estimated remaining: 1h 31m 41s. Rate: 9.4 symbols/min [2025-09-15T19:39:46.336512] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:39:46.353531] [DEBUG] [LOCAL ] NOAH: Loaded 14703 existing records from primary storage. [2025-09-15T19:39:46.353688] [INFO ] [MAIN ] NOAH: Loaded 14703 existing records. [2025-09-15T19:39:46.544666] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:39:46.544966] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-15T19:39:46.545016] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-15T19:39:46.545547] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-15T19:39:46.545608] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-15T19:39:46.817150] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T19:39:46.869543] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-15T19:39:46.907064] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:39:47.454029] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T19:39:47.657888] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-15T19:39:48.457898] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-15T19:39:48.538496] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:39:49.257885] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-15T19:39:50.028412] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:39:50.050057] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T19:39:50.057808] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-15T19:39:50.857872] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-15T19:39:51.341935] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T19:39:51.510699] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:39:51.657901] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-15T19:39:52.463465] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-15T19:39:52.465225] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T19:39:53.257891] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-15T19:39:54.057908] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-15T19:39:54.110572] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:39:54.303601] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:39:54.857911] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-15T19:39:54.887927] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:39:55.350894] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:39:55.657906] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-15T19:39:56.457856] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-15T19:39:56.745516] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:39:57.257876] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-15T19:39:57.839424] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:39:57.867994] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:39:58.057897] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-15T19:39:58.857888] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-15T19:39:59.419209] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T19:39:59.657881] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-15T19:39:59.765535] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:40:00.457859] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-15T19:40:00.672877] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T19:40:00.675177] [INFO ] [REMOTE ] NOA: Full fetch complete (17653 records). [2025-09-15T19:40:00.675261] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-15T19:40:01.066965] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-15T19:40:01.067052] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-15T19:40:01.067482] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-15T19:40:01.067538] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-15T19:40:01.068412] [DEBUG] [LOCAL ] NOA: Trimmed 17653 records to 11300 (keeping 150 days of data) [2025-09-15T19:40:01.150193] [DEBUG] [LOCAL ] NOA: Primary data saved (11300 records). [2025-09-15T19:40:01.150349] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-15T19:40:01.150476] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NOA took 23.1s. Estimated remaining: 1h 31m 40s. Rate: 9.4 symbols/min [2025-09-15T19:40:01.259297] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-15T19:40:01.331552] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:01.369137] [DEBUG] [LOCAL ] NOC: Loaded 31770 existing records from primary storage. [2025-09-15T19:40:01.369288] [INFO ] [MAIN ] NOC: Loaded 31770 existing records. [2025-09-15T19:40:01.566436] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:01.566709] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-15T19:40:01.566760] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-15T19:40:01.567609] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-15T19:40:01.567688] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-15T19:40:01.953894] [INFO ] [REMOTE ] NOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:02.057907] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-15T19:40:02.319178] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T19:40:02.857872] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-15T19:40:02.961471] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:40:02.965035] [INFO ] [REMOTE ] NOAH: Full fetch complete (21454 records). [2025-09-15T19:40:02.965189] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-15T19:40:03.338514] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-15T19:40:03.338622] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-15T19:40:03.339228] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-15T19:40:03.339299] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-15T19:40:03.340629] [DEBUG] [LOCAL ] NOAH: Trimmed 21454 records to 14278 (keeping 150 days of data) [2025-09-15T19:40:03.455043] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:40:03.468608] [DEBUG] [LOCAL ] NOAH: Primary data saved (14278 records). [2025-09-15T19:40:03.468728] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-15T19:40:03.468816] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NOAH took 17.3s. Estimated remaining: 1h 31m 31s. Rate: 9.4 symbols/min [2025-09-15T19:40:03.574383] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T19:40:03.596986] [INFO ] [REMOTE ] NNY: Full fetch complete (6166 records). [2025-09-15T19:40:03.628089] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-15T19:40:03.648566] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:03.662907] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-15T19:40:03.997323] [DEBUG] [LOCAL ] NOG: Loaded 38382 existing records from primary storage. [2025-09-15T19:40:04.003155] [INFO ] [MAIN ] NOG: Loaded 38382 existing records. [2025-09-15T19:40:04.205855] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-15T19:40:04.237356] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-15T19:40:04.252973] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-15T19:40:04.258372] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-15T19:40:04.258535] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:04.259474] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-15T19:40:04.259790] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-15T19:40:04.259914] [DEBUG] [LOCAL ] NNY: Trimmed 6166 records to 4225 (keeping 150 days of data) [2025-09-15T19:40:04.272593] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-15T19:40:04.272746] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-15T19:40:04.456032] [DEBUG] [LOCAL ] NNY: Primary data saved (4225 records). [2025-09-15T19:40:04.471862] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-15T19:40:04.472721] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-15T19:40:04.480348] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NNY took 29.4s. Estimated remaining: 1h 31m 22s. Rate: 9.4 symbols/min [2025-09-15T19:40:04.872849] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:04.876559] [INFO ] [REMOTE ] NOG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:04.917910] [DEBUG] [LOCAL ] NOK: Loaded 40362 existing records from primary storage. [2025-09-15T19:40:04.918054] [INFO ] [MAIN ] NOK: Loaded 40362 existing records. [2025-09-15T19:40:05.096764] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:05.097047] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-15T19:40:05.097107] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-15T19:40:05.098011] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-15T19:40:05.098071] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-15T19:40:05.264812] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-15T19:40:05.496667] [INFO ] [REMOTE ] NOK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:05.533946] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T19:40:06.045735] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:40:06.055184] [INFO ] [REMOTE ] NNN: Full fetch complete (52823 records). [2025-09-15T19:40:06.055413] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-15T19:40:06.063276] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-15T19:40:06.579825] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-15T19:40:06.579951] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-15T19:40:06.581441] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-15T19:40:06.581546] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-15T19:40:06.583042] [DEBUG] [LOCAL ] NNN: Trimmed 52823 records to 35485 (keeping 150 days of data) [2025-09-15T19:40:06.837278] [DEBUG] [LOCAL ] NNN: Primary data saved (35485 records). [2025-09-15T19:40:06.837441] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-15T19:40:06.837537] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NNN took 35.3s. Estimated remaining: 1h 31m 13s. Rate: 9.4 symbols/min [2025-09-15T19:40:06.872163] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-15T19:40:07.044566] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:07.044861] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-15T19:40:07.044939] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-15T19:40:07.069591] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-15T19:40:07.072440] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-15T19:40:07.072708] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-15T19:40:07.073135] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-15T19:40:07.106776] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:40:07.440603] [INFO ] [REMOTE ] NOM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:07.490799] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T19:40:07.657864] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-15T19:40:08.457849] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-15T19:40:08.692112] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T19:40:09.257881] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-15T19:40:09.362825] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T19:40:09.581072] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-15T19:40:09.931024] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:40:10.057857] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-15T19:40:10.857876] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-15T19:40:11.231034] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T19:40:11.657860] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-15T19:40:11.760230] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:40:12.457857] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-15T19:40:12.966727] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T19:40:13.257875] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-15T19:40:14.014754] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:40:14.057829] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-15T19:40:14.857897] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-15T19:40:15.215559] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:40:15.307601] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T19:40:15.657872] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-15T19:40:16.405184] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:40:16.457863] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-15T19:40:17.257889] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-15T19:40:17.641237] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T19:40:17.709044] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T19:40:18.057876] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-15T19:40:18.394600] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T19:40:18.857928] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-15T19:40:19.051251] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T19:40:19.657904] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-15T19:40:19.971574] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T19:40:20.356355] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T19:40:20.360348] [INFO ] [REMOTE ] NOC: Full fetch complete (47156 records). [2025-09-15T19:40:20.360441] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-15T19:40:20.460192] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-15T19:40:20.734427] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-15T19:40:20.734511] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-15T19:40:20.735315] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-15T19:40:20.735357] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-15T19:40:20.736371] [DEBUG] [LOCAL ] NOC: Trimmed 47156 records to 31028 (keeping 150 days of data) [2025-09-15T19:40:20.921288] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:40:20.941522] [DEBUG] [LOCAL ] NOC: Primary data saved (31028 records). [2025-09-15T19:40:20.941654] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-15T19:40:20.943056] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOC took 19.8s. Estimated remaining: 1h 31m 11s. Rate: 9.4 symbols/min [2025-09-15T19:40:21.111400] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:21.146310] [DEBUG] [LOCAL ] NOMD: Loaded 31505 existing records from primary storage. [2025-09-15T19:40:21.146458] [INFO ] [MAIN ] NOMD: Loaded 31505 existing records. [2025-09-15T19:40:21.262991] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-15T19:40:21.323870] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:21.324105] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-15T19:40:21.324201] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-15T19:40:21.325093] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-15T19:40:21.325156] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-15T19:40:21.679800] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:22.057872] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-15T19:40:22.857829] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-15T19:40:23.212348] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T19:40:23.408338] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T19:40:23.485280] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T19:40:23.657860] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-15T19:40:24.457928] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-15T19:40:24.986555] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T19:40:25.257917] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-15T19:40:25.923284] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T19:40:25.928726] [INFO ] [REMOTE ] NOG: Full fetch complete (55650 records). [2025-09-15T19:40:25.928837] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-15T19:40:26.070728] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-15T19:40:26.312065] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-15T19:40:26.312152] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-15T19:40:26.313141] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-15T19:40:26.313187] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-15T19:40:26.314330] [DEBUG] [LOCAL ] NOG: Trimmed 55650 records to 37625 (keeping 150 days of data) [2025-09-15T19:40:26.549981] [DEBUG] [LOCAL ] NOG: Primary data saved (37625 records). [2025-09-15T19:40:26.550192] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-15T19:40:26.550290] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NOG took 23.1s. Estimated remaining: 1h 31m 4s. Rate: 9.4 symbols/min [2025-09-15T19:40:26.746969] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:40:26.750126] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:26.790089] [DEBUG] [LOCAL ] NOTE: Loaded 33164 existing records from primary storage. [2025-09-15T19:40:26.790337] [INFO ] [MAIN ] NOTE: Loaded 33164 existing records. [2025-09-15T19:40:26.862978] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-15T19:40:26.979193] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:26.979469] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-15T19:40:26.979517] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-15T19:40:26.980328] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-15T19:40:26.980395] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-15T19:40:27.342828] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:27.657827] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-15T19:40:28.118726] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T19:40:28.165316] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T19:40:28.457801] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-15T19:40:28.486306] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T19:40:28.915483] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T19:40:28.916371] [INFO ] [REMOTE ] NOM: Full fetch complete (1251 records). [2025-09-15T19:40:28.916439] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-15T19:40:29.095761] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T19:40:29.095960] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:40:29.096008] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:40:29.096051] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-15T19:40:29.096128] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-15T19:40:29.096166] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-15T19:40:29.096215] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-15T19:40:29.096274] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NOM took 22.3s. Estimated remaining: 1h 30m 56s. Rate: 9.4 symbols/min [2025-09-15T19:40:29.267823] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-15T19:40:29.271892] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:29.313725] [DEBUG] [LOCAL ] NOV: Loaded 39981 existing records from primary storage. [2025-09-15T19:40:29.313907] [INFO ] [MAIN ] NOV: Loaded 39981 existing records. [2025-09-15T19:40:29.488544] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:29.488815] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-15T19:40:29.488861] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-15T19:40:29.489764] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-15T19:40:29.489815] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-15T19:40:29.839458] [INFO ] [REMOTE ] NOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:30.057859] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-15T19:40:30.728144] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:40:30.857886] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-15T19:40:31.657873] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-15T19:40:32.213841] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:40:32.261599] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T19:40:32.457891] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-15T19:40:33.163212] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:40:33.257829] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-15T19:40:34.057862] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-15T19:40:34.143902] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:40:34.857854] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-15T19:40:34.897354] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T19:40:35.415556] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:40:35.657907] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-15T19:40:36.387776] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T19:40:36.457855] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-15T19:40:37.202224] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:40:37.257861] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-15T19:40:38.011923] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T19:40:38.057839] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-15T19:40:38.857884] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-15T19:40:38.924436] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:40:39.250138] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T19:40:39.657921] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-15T19:40:40.268780] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:40:40.457921] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-15T19:40:40.867305] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:40:41.257932] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-15T19:40:41.740835] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:40:42.057876] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-15T19:40:42.292539] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:40:42.297930] [INFO ] [REMOTE ] NOMD: Full fetch complete (44647 records). [2025-09-15T19:40:42.298104] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-15T19:40:42.687692] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-15T19:40:42.687800] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-15T19:40:42.688623] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-15T19:40:42.688687] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-15T19:40:42.689936] [DEBUG] [LOCAL ] NOMD: Trimmed 44647 records to 30839 (keeping 150 days of data) [2025-09-15T19:40:42.867509] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-15T19:40:42.888283] [DEBUG] [LOCAL ] NOMD: Primary data saved (30839 records). [2025-09-15T19:40:42.888439] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-15T19:40:42.889020] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NOMD took 21.9s. Estimated remaining: 1h 30m 54s. Rate: 9.4 symbols/min [2025-09-15T19:40:43.058334] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:43.097014] [DEBUG] [LOCAL ] NOW: Loaded 36186 existing records from primary storage. [2025-09-15T19:40:43.097221] [INFO ] [MAIN ] NOW: Loaded 36186 existing records. [2025-09-15T19:40:43.273921] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:43.274201] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-15T19:40:43.274250] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-15T19:40:43.275044] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-15T19:40:43.275095] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-15T19:40:43.632289] [INFO ] [REMOTE ] NOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:43.657920] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-15T19:40:43.764491] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T19:40:44.395460] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:40:44.457895] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-15T19:40:45.122819] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:40:45.257843] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-15T19:40:46.009282] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:40:46.057887] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-15T19:40:46.750860] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:40:46.857861] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-15T19:40:47.657991] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-15T19:40:47.954304] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T19:40:47.960611] [INFO ] [REMOTE ] NOK: Full fetch complete (58297 records). [2025-09-15T19:40:47.960788] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-15T19:40:48.344009] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-15T19:40:48.344107] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-15T19:40:48.345052] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-15T19:40:48.345113] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-15T19:40:48.346523] [DEBUG] [LOCAL ] NOK: Trimmed 58297 records to 39582 (keeping 150 days of data) [2025-09-15T19:40:48.458762] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-15T19:40:48.592672] [DEBUG] [LOCAL ] NOK: Primary data saved (39582 records). [2025-09-15T19:40:48.592839] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-15T19:40:48.593759] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NOK took 44.1s. Estimated remaining: 1h 30m 47s. Rate: 9.4 symbols/min [2025-09-15T19:40:48.772051] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:48.772378] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-15T19:40:48.772567] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-15T19:40:48.772789] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-15T19:40:48.772986] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-15T19:40:48.773065] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-15T19:40:48.773175] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-15T19:40:48.909201] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T19:40:49.178596] [INFO ] [REMOTE ] NPB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:49.257830] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-15T19:40:49.384710] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T19:40:49.685275] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:40:49.836442] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:40:50.057863] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-15T19:40:50.827201] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:40:50.857819] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-15T19:40:51.530755] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T19:40:51.657928] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-15T19:40:52.448543] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:40:52.457811] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-15T19:40:53.220826] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T19:40:53.257864] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-15T19:40:54.057866] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-15T19:40:54.194129] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T19:40:54.857875] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-15T19:40:55.389697] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:40:55.393321] [INFO ] [REMOTE ] NOTE: Full fetch complete (48355 records). [2025-09-15T19:40:55.393454] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-15T19:40:55.662968] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-15T19:40:55.777364] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-15T19:40:55.777504] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-15T19:40:55.778343] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-15T19:40:55.778487] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-15T19:40:55.790891] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T19:40:55.791007] [DEBUG] [LOCAL ] NOTE: Trimmed 48355 records to 32429 (keeping 150 days of data) [2025-09-15T19:40:55.985667] [DEBUG] [LOCAL ] NOTE: Primary data saved (32429 records). [2025-09-15T19:40:55.985804] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-15T19:40:55.985886] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOTE took 29.4s. Estimated remaining: 1h 30m 41s. Rate: 9.4 symbols/min [2025-09-15T19:40:56.157295] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:56.170961] [DEBUG] [LOCAL ] NPCT: Loaded 12879 existing records from primary storage. [2025-09-15T19:40:56.171071] [INFO ] [MAIN ] NPCT: Loaded 12879 existing records. [2025-09-15T19:40:56.343991] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:56.344270] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-15T19:40:56.344322] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-15T19:40:56.344752] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-15T19:40:56.344800] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-15T19:40:56.462931] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-15T19:40:56.692180] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:57.187873] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T19:40:57.193834] [INFO ] [REMOTE ] NOV: Full fetch complete (57852 records). [2025-09-15T19:40:57.193939] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-15T19:40:57.262960] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-15T19:40:57.519472] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:40:57.592476] [INFO ] [REMOTE ] NPB: Full fetch complete (15302 records). [2025-09-15T19:40:57.595329] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-15T19:40:57.595394] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-15T19:40:57.596545] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-15T19:40:57.596611] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-15T19:40:57.595470] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-15T19:40:57.698032] [DEBUG] [LOCAL ] NOV: Trimmed 57852 records to 39200 (keeping 150 days of data) [2025-09-15T19:40:57.845354] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T19:40:57.873954] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:40:57.874346] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:40:57.875104] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-15T19:40:57.875184] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-15T19:40:57.875934] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-15T19:40:57.876690] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-15T19:40:57.877044] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NPB took 9.3s. Estimated remaining: 1h 30m 32s. Rate: 9.4 symbols/min [2025-09-15T19:40:58.058503] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-15T19:40:58.058193] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:40:58.073611] [DEBUG] [LOCAL ] NPFD: Loaded 7027 existing records from primary storage. [2025-09-15T19:40:58.075262] [INFO ] [MAIN ] NPFD: Loaded 7027 existing records. [2025-09-15T19:40:58.296440] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:40:58.297981] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-15T19:40:58.298363] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-15T19:40:58.314666] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-15T19:40:58.315159] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T19:40:58.315366] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-15T19:40:58.862975] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-15T19:40:58.946014] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:40:58.976659] [DEBUG] [LOCAL ] NOV: Primary data saved (39200 records). [2025-09-15T19:40:58.976866] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-15T19:40:58.979608] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NOV took 29.9s. Estimated remaining: 1h 30m 23s. Rate: 9.4 symbols/min [2025-09-15T19:40:59.657911] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-15T19:40:59.725021] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T19:41:00.328837] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-15T19:41:00.359734] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T19:41:00.457886] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-15T19:41:01.079803] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T19:41:01.257907] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-15T19:41:01.961876] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:41:02.057831] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-15T19:41:02.821390] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T19:41:02.857874] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-15T19:41:03.657891] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-15T19:41:04.212962] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:41:04.457959] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-15T19:41:04.610998] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T19:41:05.076663] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:41:05.257866] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-15T19:41:06.057880] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-15T19:41:06.203376] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:41:06.857884] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-15T19:41:07.657854] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-15T19:41:07.800798] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T19:41:07.926355] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T19:41:08.088632] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T19:41:08.457868] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-15T19:41:09.181010] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T19:41:09.257889] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-15T19:41:10.023833] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T19:41:10.057859] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-15T19:41:10.768824] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:41:10.770446] [INFO ] [REMOTE ] NPFD: Full fetch complete (10731 records). [2025-09-15T19:41:10.770514] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-15T19:41:10.863079] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-15T19:41:11.184184] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-15T19:41:11.184304] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-15T19:41:11.184741] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-15T19:41:11.184788] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-15T19:41:11.185337] [DEBUG] [LOCAL ] NPFD: Trimmed 10731 records to 6724 (keeping 150 days of data) [2025-09-15T19:41:11.231260] [DEBUG] [LOCAL ] NPFD: Primary data saved (6724 records). [2025-09-15T19:41:11.231460] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-15T19:41:11.231592] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NPFD took 13.4s. Estimated remaining: 1h 30m 20s. Rate: 9.4 symbols/min [2025-09-15T19:41:11.657876] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-15T19:41:11.727893] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:41:12.457886] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-15T19:41:13.413825] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:41:13.416178] [INFO ] [REMOTE ] NPCT: Full fetch complete (18338 records). [2025-09-15T19:41:13.416293] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-15T19:41:13.790734] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-15T19:41:13.790894] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-15T19:41:13.791348] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-15T19:41:13.791444] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-15T19:41:13.792424] [DEBUG] [LOCAL ] NPCT: Trimmed 18338 records to 12728 (keeping 150 days of data) [2025-09-15T19:41:13.883078] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-15T19:41:13.897136] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-15T19:41:13.916160] [DEBUG] [LOCAL ] NPCT: Primary data saved (12728 records). [2025-09-15T19:41:13.916275] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-15T19:41:13.916358] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPCT took 17.9s. Estimated remaining: 1h 30m 11s. Rate: 9.4 symbols/min [2025-09-15T19:41:15.799736] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T19:41:15.805515] [INFO ] [REMOTE ] NOW: Full fetch complete (53477 records). [2025-09-15T19:41:15.805738] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-15T19:41:16.207452] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-15T19:41:16.207563] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-15T19:41:16.208500] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-15T19:41:16.208575] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-15T19:41:16.209980] [DEBUG] [LOCAL ] NOW: Trimmed 53477 records to 35412 (keeping 150 days of data) [2025-09-15T19:41:16.435010] [DEBUG] [LOCAL ] NOW: Primary data saved (35412 records). [2025-09-15T19:41:16.435160] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-15T19:41:16.435765] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NOW took 33.5s. Estimated remaining: 1h 30m 3s. Rate: 9.4 symbols/min [2025-09-15T19:41:17.107109] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:17.149706] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:17.227070] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:17.248946] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-15T19:41:17.251937] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:17.252235] [DEBUG] [LOCAL ] NPV: No existing data file found in primary storage. [2025-09-15T19:41:17.252325] [WARN ] [MAIN ] NPV: No existing data found, performing full refresh instead. [2025-09-15T19:41:17.252731] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-15T19:41:17.252921] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-15T19:41:17.253161] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-15T19:41:17.253236] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-09-15T19:41:17.253761] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-15T19:41:17.253692] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-15T19:41:17.287763] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-15T19:41:17.339076] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-15T19:41:17.369141] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-15T19:41:17.351389] [DEBUG] [LOCAL ] NPK: Loaded 6405 existing records from primary storage. [2025-09-15T19:41:17.369063] [DEBUG] [LOCAL ] NPO: Loaded 9549 existing records from primary storage. [2025-09-15T19:41:17.369318] [INFO ] [MAIN ] NPK: Loaded 6405 existing records. [2025-09-15T19:41:17.412977] [INFO ] [MAIN ] NPO: Loaded 9549 existing records. [2025-09-15T19:41:18.068486] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:18.136785] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:18.163811] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-15T19:41:18.211093] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-15T19:41:18.238997] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-15T19:41:18.261638] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-15T19:41:18.265080] [INFO ] [REMOTE ] NPV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:18.238939] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-15T19:41:18.307586] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-15T19:41:18.307194] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-15T19:41:18.355799] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-15T19:41:18.395319] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-15T19:41:18.588020] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:18.593931] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-15T19:41:19.105187] [INFO ] [REMOTE ] NPK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:19.132737] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-15T19:41:19.132436] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:41:19.152843] [INFO ] [REMOTE ] NPO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:19.155840] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-15T19:41:19.154758] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-15T19:41:19.683830] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T19:41:19.685616] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-15T19:41:19.756986] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T19:41:19.759955] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-15T19:41:19.805034] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T19:41:19.806659] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-15T19:41:20.022966] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T19:41:20.122617] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T19:41:20.248434] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T19:41:20.257052] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:41:20.457898] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-15T19:41:21.257887] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-15T19:41:21.532385] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:41:21.716207] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T19:41:22.057866] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-15T19:41:22.673123] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:41:22.857904] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-15T19:41:23.438846] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:41:23.657874] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-15T19:41:24.457873] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-15T19:41:24.514343] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:41:25.257894] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-15T19:41:25.853105] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T19:41:26.047248] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:41:26.057818] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-15T19:41:26.857882] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-15T19:41:27.428173] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T19:41:27.468087] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T19:41:27.657880] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-15T19:41:28.457884] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-15T19:41:28.482491] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:41:29.222451] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T19:41:29.257866] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-15T19:41:30.057855] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-15T19:41:30.109835] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:41:30.857936] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-15T19:41:31.658065] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-15T19:41:31.663142] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T19:41:31.681274] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:41:32.205421] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:41:32.457914] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-15T19:41:33.257896] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-15T19:41:33.842822] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:41:33.919009] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:41:33.920170] [INFO ] [REMOTE ] NPK: Full fetch complete (8709 records). [2025-09-15T19:41:33.920238] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-15T19:41:34.063383] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-15T19:41:34.286817] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-15T19:41:34.286904] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-15T19:41:34.287147] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-15T19:41:34.287194] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-15T19:41:34.287707] [DEBUG] [LOCAL ] NPK: Trimmed 8709 records to 6354 (keeping 150 days of data) [2025-09-15T19:41:34.328660] [DEBUG] [LOCAL ] NPK: Primary data saved (6354 records). [2025-09-15T19:41:34.328823] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-15T19:41:34.328916] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NPK took 17.9s. Estimated remaining: 1h 30m 3s. Rate: 9.4 symbols/min [2025-09-15T19:41:34.500187] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:34.533250] [DEBUG] [LOCAL ] NPWR: Loaded 32423 existing records from primary storage. [2025-09-15T19:41:34.533454] [INFO ] [MAIN ] NPWR: Loaded 32423 existing records. [2025-09-15T19:41:34.711376] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:34.711690] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-15T19:41:34.711740] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-15T19:41:34.712515] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-15T19:41:34.712579] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-15T19:41:34.822069] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T19:41:34.866539] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-15T19:41:35.075245] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:35.608932] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:41:35.657857] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-15T19:41:36.326682] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T19:41:36.328026] [INFO ] [REMOTE ] NPV: Full fetch complete (5290 records). [2025-09-15T19:41:36.328095] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-15T19:41:36.467500] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-15T19:41:36.694628] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-15T19:41:36.694757] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-15T19:41:36.694988] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-15T19:41:36.695032] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-15T19:41:36.695586] [DEBUG] [LOCAL ] NPV: Trimmed 5290 records to 3779 (keeping 150 days of data) [2025-09-15T19:41:36.725060] [DEBUG] [LOCAL ] NPV: Primary data saved (3779 records). [2025-09-15T19:41:36.725273] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-15T19:41:36.725385] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NPV took 20.3s. Estimated remaining: 1h 29m 54s. Rate: 9.4 symbols/min [2025-09-15T19:41:36.903131] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:36.914680] [DEBUG] [LOCAL ] NQP: Loaded 6844 existing records from primary storage. [2025-09-15T19:41:36.914869] [INFO ] [MAIN ] NQP: Loaded 6844 existing records. [2025-09-15T19:41:37.097839] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:37.098215] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-15T19:41:37.098264] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-15T19:41:37.098711] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-15T19:41:37.098778] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-15T19:41:37.262392] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-15T19:41:37.475018] [INFO ] [REMOTE ] NQP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:37.585345] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T19:41:38.057857] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-15T19:41:38.758929] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:41:38.857853] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-15T19:41:39.581975] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:41:39.657906] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-15T19:41:39.689934] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:41:39.691588] [INFO ] [REMOTE ] NPO: Full fetch complete (14072 records). [2025-09-15T19:41:39.691683] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-15T19:41:40.047529] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-15T19:41:40.047612] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-15T19:41:40.047966] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-15T19:41:40.048018] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-15T19:41:40.048531] [DEBUG] [LOCAL ] NPO: Trimmed 14072 records to 9291 (keeping 150 days of data) [2025-09-15T19:41:40.110849] [DEBUG] [LOCAL ] NPO: Primary data saved (9291 records). [2025-09-15T19:41:40.110996] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-15T19:41:40.111080] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NPO took 23.7s. Estimated remaining: 1h 29m 46s. Rate: 9.4 symbols/min [2025-09-15T19:41:40.288836] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:40.312895] [DEBUG] [LOCAL ] NRDY: Loaded 24286 existing records from primary storage. [2025-09-15T19:41:40.313058] [INFO ] [MAIN ] NRDY: Loaded 24286 existing records. [2025-09-15T19:41:40.465017] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-15T19:41:40.509446] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:40.509853] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-15T19:41:40.509908] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-15T19:41:40.510806] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-15T19:41:40.510863] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-15T19:41:40.905976] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:41.059943] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:41:41.257921] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-15T19:41:41.806194] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:41:41.969848] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:41:42.057911] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-15T19:41:42.857892] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-15T19:41:43.439594] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:41:43.561605] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T19:41:43.657939] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-15T19:41:44.457866] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-15T19:41:44.467871] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:41:45.257878] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-15T19:41:45.715524] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:41:45.719984] [INFO ] [REMOTE ] NPKI: Full fetch complete (43655 records). [2025-09-15T19:41:45.720076] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-15T19:41:46.062838] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-15T19:41:46.095086] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-09-15T19:41:46.095158] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-09-15T19:41:46.095961] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-09-15T19:41:46.096008] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-09-15T19:41:46.097268] [DEBUG] [LOCAL ] NPKI: Trimmed 43655 records to 30274 (keeping 150 days of data) [2025-09-15T19:41:46.284714] [DEBUG] [LOCAL ] NPKI: Primary data saved (30274 records). [2025-09-15T19:41:46.284850] [INFO ] [MAIN ] NPKI: Full history saved. [2025-09-15T19:41:46.284953] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NPKI took 29.8s. Estimated remaining: 1h 29m 40s. Rate: 9.4 symbols/min [2025-09-15T19:41:46.456243] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:46.464301] [DEBUG] [LOCAL ] NREF: Loaded 5581 existing records from primary storage. [2025-09-15T19:41:46.464402] [INFO ] [MAIN ] NREF: Loaded 5581 existing records. [2025-09-15T19:41:46.638204] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:46.638464] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-15T19:41:46.638509] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-15T19:41:46.638772] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-15T19:41:46.638819] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-15T19:41:46.874307] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-15T19:41:46.987119] [INFO ] [REMOTE ] NREF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:47.542857] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T19:41:47.560458] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:41:47.657895] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-15T19:41:48.295932] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T19:41:48.457901] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-15T19:41:49.250031] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T19:41:49.257808] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-15T19:41:49.817447] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T19:41:50.057845] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-15T19:41:50.092276] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (4.83 seconds). [2025-09-15T19:41:50.857881] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-15T19:41:51.290002] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:41:51.295513] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T19:41:51.657948] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-15T19:41:52.457896] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-15T19:41:52.934166] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T19:41:53.220582] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T19:41:53.257823] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-15T19:41:54.012072] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:41:54.057811] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-15T19:41:54.783737] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:41:54.857869] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-15T19:41:55.340160] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T19:41:55.341713] [INFO ] [REMOTE ] NQP: Full fetch complete (9832 records). [2025-09-15T19:41:55.341781] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-15T19:41:55.664195] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-15T19:41:55.704548] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-15T19:41:55.704622] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-15T19:41:55.704904] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-15T19:41:55.704963] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-15T19:41:55.705416] [DEBUG] [LOCAL ] NQP: Trimmed 9832 records to 6678 (keeping 150 days of data) [2025-09-15T19:41:55.748506] [DEBUG] [LOCAL ] NQP: Primary data saved (6678 records). [2025-09-15T19:41:55.748625] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-15T19:41:55.748751] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NQP took 19.0s. Estimated remaining: 1h 29m 35s. Rate: 9.4 symbols/min [2025-09-15T19:41:55.920158] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:41:55.968848] [DEBUG] [LOCAL ] NRG: Loaded 39817 existing records from primary storage. [2025-09-15T19:41:55.968990] [INFO ] [MAIN ] NRG: Loaded 39817 existing records. [2025-09-15T19:41:56.147910] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:41:56.148187] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-15T19:41:56.148244] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-15T19:41:56.149062] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-15T19:41:56.149121] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-15T19:41:56.458343] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-15T19:41:56.511219] [INFO ] [REMOTE ] NRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:41:56.518711] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:41:57.257941] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-15T19:41:57.827851] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T19:41:57.864789] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:41:58.057863] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-15T19:41:58.857902] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-15T19:41:59.137966] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T19:41:59.482627] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:41:59.657872] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-15T19:42:00.297932] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T19:42:00.299419] [INFO ] [REMOTE ] NREF: Full fetch complete (8218 records). [2025-09-15T19:42:00.299487] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-15T19:42:00.458963] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-15T19:42:00.657857] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-15T19:42:00.657939] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-15T19:42:00.658136] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-15T19:42:00.658194] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-15T19:42:00.658806] [DEBUG] [LOCAL ] NREF: Trimmed 8218 records to 5557 (keeping 150 days of data) [2025-09-15T19:42:00.695789] [DEBUG] [LOCAL ] NREF: Primary data saved (5557 records). [2025-09-15T19:42:00.695890] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-15T19:42:00.695976] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NREF took 14.4s. Estimated remaining: 1h 29m 28s. Rate: 9.4 symbols/min [2025-09-15T19:42:00.864081] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:00.901783] [DEBUG] [LOCAL ] NRGV: Loaded 31505 existing records from primary storage. [2025-09-15T19:42:00.901953] [INFO ] [MAIN ] NRGV: Loaded 31505 existing records. [2025-09-15T19:42:01.078032] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:01.078298] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-15T19:42:01.078352] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-15T19:42:01.079541] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-15T19:42:01.079594] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-15T19:42:01.264214] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-15T19:42:01.426529] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:02.057904] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-15T19:42:02.857892] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-15T19:42:02.973540] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T19:42:03.657870] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-15T19:42:04.054535] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-15T19:42:04.126356] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T19:42:04.457869] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-15T19:42:04.794724] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-15T19:42:05.257887] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-15T19:42:05.833206] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T19:42:05.888758] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T19:42:06.057833] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-15T19:42:06.428451] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:42:06.857876] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-15T19:42:07.657882] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-15T19:42:07.828354] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T19:42:07.908377] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:42:08.457868] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-15T19:42:09.030250] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:42:09.257884] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-15T19:42:09.476427] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:42:09.479984] [INFO ] [REMOTE ] NRDY: Full fetch complete (37030 records). [2025-09-15T19:42:09.480071] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-15T19:42:09.843022] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-15T19:42:09.843108] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-15T19:42:09.843823] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-15T19:42:09.843868] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-15T19:42:09.844814] [DEBUG] [LOCAL ] NRDY: Trimmed 37030 records to 23866 (keeping 150 days of data) [2025-09-15T19:42:09.991226] [DEBUG] [LOCAL ] NRDY: Primary data saved (23866 records). [2025-09-15T19:42:09.991361] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-15T19:42:09.991482] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NRDY took 29.9s. Estimated remaining: 1h 29m 23s. Rate: 9.4 symbols/min [2025-09-15T19:42:10.064771] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-15T19:42:10.165180] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:10.180705] [DEBUG] [LOCAL ] NRK: Loaded 15230 existing records from primary storage. [2025-09-15T19:42:10.180844] [INFO ] [MAIN ] NRK: Loaded 15230 existing records. [2025-09-15T19:42:10.354443] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:10.354725] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-15T19:42:10.354777] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-15T19:42:10.355287] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-15T19:42:10.355338] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-15T19:42:10.703390] [INFO ] [REMOTE ] NRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:10.857869] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-15T19:42:11.213921] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-15T19:42:11.651153] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:42:11.659927] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-15T19:42:11.675011] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:42:12.457866] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-15T19:42:13.073437] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:42:13.078775] [INFO ] [REMOTE ] NPWR: Full fetch complete (45831 records). [2025-09-15T19:42:13.078957] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-15T19:42:13.262623] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-15T19:42:13.479587] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-15T19:42:13.479768] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-15T19:42:13.481136] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-15T19:42:13.481234] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-15T19:42:13.483090] [DEBUG] [LOCAL ] NPWR: Trimmed 45831 records to 31832 (keeping 150 days of data) [2025-09-15T19:42:13.703852] [DEBUG] [LOCAL ] NPWR: Primary data saved (31832 records). [2025-09-15T19:42:13.704075] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-15T19:42:13.704223] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NPWR took 39.4s. Estimated remaining: 1h 29m 16s. Rate: 9.4 symbols/min [2025-09-15T19:42:13.893891] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:13.899484] [DEBUG] [LOCAL ] NRP: Loaded 2786 existing records from primary storage. [2025-09-15T19:42:13.899561] [INFO ] [MAIN ] NRP: Loaded 2786 existing records. [2025-09-15T19:42:14.071825] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-15T19:42:14.076183] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:14.076561] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-15T19:42:14.077502] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-15T19:42:14.077811] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-15T19:42:14.077859] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-15T19:42:14.428138] [INFO ] [REMOTE ] NRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:14.581145] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-15T19:42:14.857884] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-15T19:42:14.901217] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:42:15.463017] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:42:15.657851] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-15T19:42:16.457942] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-15T19:42:16.613785] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-15T19:42:17.069200] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:42:17.209604] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:42:17.257856] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-15T19:42:18.057893] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-15T19:42:18.723946] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T19:42:18.857912] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-15T19:42:19.657894] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-15T19:42:19.727834] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T19:42:20.042091] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T19:42:20.457905] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-15T19:42:21.254293] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:42:21.259005] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-15T19:42:21.260324] [INFO ] [REMOTE ] NRGV: Full fetch complete (45542 records). [2025-09-15T19:42:21.260409] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-15T19:42:21.492514] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T19:42:21.662999] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-15T19:42:21.663087] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-15T19:42:21.663962] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-15T19:42:21.664010] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-15T19:42:21.665177] [DEBUG] [LOCAL ] NRGV: Trimmed 45542 records to 30946 (keeping 150 days of data) [2025-09-15T19:42:21.852611] [DEBUG] [LOCAL ] NRGV: Primary data saved (30946 records). [2025-09-15T19:42:21.852784] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-15T19:42:21.852879] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRGV took 21.2s. Estimated remaining: 1h 29m 10s. Rate: 9.4 symbols/min [2025-09-15T19:42:22.082456] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-15T19:42:22.085066] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:22.094277] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T19:42:22.101266] [DEBUG] [LOCAL ] NRT: Loaded 3685 existing records from primary storage. [2025-09-15T19:42:22.101392] [INFO ] [MAIN ] NRT: Loaded 3685 existing records. [2025-09-15T19:42:22.282430] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:22.282777] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-15T19:42:22.282837] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-15T19:42:22.283175] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-15T19:42:22.283236] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-15T19:42:22.641170] [INFO ] [REMOTE ] NRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:22.857932] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-15T19:42:23.469789] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:42:23.657922] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-15T19:42:23.958658] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T19:42:24.457893] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-15T19:42:24.706419] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:42:25.257899] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-15T19:42:25.264779] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:42:26.057879] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-15T19:42:26.402496] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T19:42:26.857896] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-15T19:42:27.307199] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:42:27.390879] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T19:42:27.657908] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-15T19:42:28.134466] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T19:42:28.457938] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-15T19:42:29.257924] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-15T19:42:30.057859] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-15T19:42:30.095300] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:42:30.101755] [INFO ] [REMOTE ] NRG: Full fetch complete (57608 records). [2025-09-15T19:42:30.101949] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-15T19:42:30.274308] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:42:30.384675] [INFO ] [REMOTE ] NRK: Full fetch complete (20440 records). [2025-09-15T19:42:30.397626] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-15T19:42:30.571124] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T19:42:30.661721] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-09-15T19:42:30.677179] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-09-15T19:42:30.709586] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-09-15T19:42:30.737400] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-09-15T19:42:30.839326] [DEBUG] [LOCAL ] NRG: Trimmed 57608 records to 39072 (keeping 150 days of data) [2025-09-15T19:42:30.860316] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-15T19:42:30.927404] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-15T19:42:30.927507] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-15T19:42:30.928078] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-15T19:42:30.928123] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-15T19:42:30.928883] [DEBUG] [LOCAL ] NRK: Trimmed 20440 records to 14847 (keeping 150 days of data) [2025-09-15T19:42:31.135093] [DEBUG] [LOCAL ] NRK: Primary data saved (14847 records). [2025-09-15T19:42:31.136030] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-15T19:42:31.136710] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRK took 21.1s. Estimated remaining: 1h 29m 5s. Rate: 9.4 symbols/min [2025-09-15T19:42:31.318932] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:31.326412] [DEBUG] [LOCAL ] NRUC: Loaded 2274 existing records from primary storage. [2025-09-15T19:42:31.327187] [INFO ] [MAIN ] NRUC: Loaded 2274 existing records. [2025-09-15T19:42:31.513831] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:31.516314] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-15T19:42:31.516439] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-15T19:42:31.524857] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-15T19:42:31.526420] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-15T19:42:31.533011] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:42:31.703875] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-15T19:42:32.022890] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:32.030563] [DEBUG] [LOCAL ] NRG: Primary data saved (39072 records). [2025-09-15T19:42:32.030741] [INFO ] [MAIN ] NRG: Full history saved. [2025-09-15T19:42:32.031768] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRG took 36.3s. Estimated remaining: 1h 28m 56s. Rate: 9.4 symbols/min [2025-09-15T19:42:32.220765] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:32.227769] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T19:42:32.262955] [DEBUG] [LOCAL ] NSA: Loaded 33958 existing records from primary storage. [2025-09-15T19:42:32.263129] [INFO ] [MAIN ] NSA: Loaded 33958 existing records. [2025-09-15T19:42:32.437354] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:32.437625] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-15T19:42:32.437696] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-15T19:42:32.438640] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-15T19:42:32.438722] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-15T19:42:32.467916] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-15T19:42:32.793808] [INFO ] [REMOTE ] NSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:33.158582] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:42:33.257917] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-15T19:42:33.854138] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:42:34.057879] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-15T19:42:34.586423] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T19:42:34.587394] [INFO ] [REMOTE ] NRP: Full fetch complete (4591 records). [2025-09-15T19:42:34.587463] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-15T19:42:34.862986] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-15T19:42:34.955635] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-15T19:42:34.955736] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-15T19:42:34.955905] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-15T19:42:34.955945] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-15T19:42:34.956333] [DEBUG] [LOCAL ] NRP: Trimmed 4591 records to 2777 (keeping 150 days of data) [2025-09-15T19:42:34.975890] [DEBUG] [LOCAL ] NRP: Primary data saved (2777 records). [2025-09-15T19:42:34.976008] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-15T19:42:34.976130] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NRP took 21.3s. Estimated remaining: 1h 28m 48s. Rate: 9.4 symbols/min [2025-09-15T19:42:35.142828] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:35.184423] [DEBUG] [LOCAL ] NSC: Loaded 36869 existing records from primary storage. [2025-09-15T19:42:35.184564] [INFO ] [MAIN ] NSC: Loaded 36869 existing records. [2025-09-15T19:42:35.358837] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:35.359131] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-15T19:42:35.359176] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-15T19:42:35.360355] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-15T19:42:35.360429] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-15T19:42:35.502407] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T19:42:35.663019] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-15T19:42:35.747923] [INFO ] [REMOTE ] NSC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:36.271940] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:42:36.457872] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-15T19:42:37.257880] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-15T19:42:37.690072] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T19:42:37.759325] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T19:42:38.057948] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-15T19:42:38.628080] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:42:38.857871] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-15T19:42:39.440603] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:42:39.657869] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-15T19:42:40.206052] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:42:40.457915] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-15T19:42:41.257896] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-15T19:42:41.812388] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:42:41.814690] [INFO ] [REMOTE ] NRT: Full fetch complete (5418 records). [2025-09-15T19:42:41.814816] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-15T19:42:42.063160] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-15T19:42:42.206697] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-15T19:42:42.206828] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-15T19:42:42.207075] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-15T19:42:42.207212] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-15T19:42:42.217325] [DEBUG] [LOCAL ] NRT: Trimmed 5418 records to 3659 (keeping 150 days of data) [2025-09-15T19:42:42.255605] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:42:42.270713] [DEBUG] [LOCAL ] NRT: Primary data saved (3659 records). [2025-09-15T19:42:42.271052] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-15T19:42:42.271573] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NRT took 20.4s. Estimated remaining: 1h 28m 42s. Rate: 9.4 symbols/min [2025-09-15T19:42:42.458214] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:42.481064] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:42:42.495262] [DEBUG] [LOCAL ] NSP: Loaded 26649 existing records from primary storage. [2025-09-15T19:42:42.495561] [INFO ] [MAIN ] NSP: Loaded 26649 existing records. [2025-09-15T19:42:42.719018] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:42.719476] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-15T19:42:42.719542] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-15T19:42:42.720424] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-15T19:42:42.720486] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-15T19:42:42.863117] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-15T19:42:43.130453] [INFO ] [REMOTE ] NSP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:43.657894] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-15T19:42:44.418327] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T19:42:44.457968] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-15T19:42:44.906068] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:42:45.257956] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-15T19:42:45.382023] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T19:42:46.057899] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-15T19:42:46.857839] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-15T19:42:46.937915] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T19:42:47.657909] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-15T19:42:47.771868] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:42:47.800574] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:42:48.457918] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-15T19:42:48.999224] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T19:42:49.000190] [INFO ] [REMOTE ] NRUC: Full fetch complete (3715 records). [2025-09-15T19:42:49.000272] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-15T19:42:49.263022] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-15T19:42:49.365102] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-15T19:42:49.365184] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-15T19:42:49.365363] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-15T19:42:49.365406] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-15T19:42:49.365800] [DEBUG] [LOCAL ] NRUC: Trimmed 3715 records to 2214 (keeping 150 days of data) [2025-09-15T19:42:49.381035] [DEBUG] [LOCAL ] NRUC: Primary data saved (2214 records). [2025-09-15T19:42:49.381103] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-15T19:42:49.381194] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NRUC took 18.2s. Estimated remaining: 1h 28m 36s. Rate: 9.4 symbols/min [2025-09-15T19:42:49.553727] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:42:49.595857] [DEBUG] [LOCAL ] NTB: Loaded 14874 existing records from primary storage. [2025-09-15T19:42:49.596665] [INFO ] [MAIN ] NTB: Loaded 14874 existing records. [2025-09-15T19:42:49.629547] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T19:42:49.786751] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:42:49.787067] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-15T19:42:49.787115] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-15T19:42:49.787630] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-15T19:42:49.787704] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-15T19:42:50.064597] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-15T19:42:50.146518] [INFO ] [REMOTE ] NTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:42:50.743087] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:42:50.857923] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-15T19:42:51.437692] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:42:51.657908] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-15T19:42:52.457948] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-15T19:42:52.604737] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:42:52.797866] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T19:42:53.257908] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-15T19:42:53.473964] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T19:42:54.057877] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-15T19:42:54.857893] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-15T19:42:54.946055] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:42:55.000096] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:42:55.657924] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-15T19:42:55.920152] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:42:56.457913] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-15T19:42:56.494273] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:42:57.257872] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-15T19:42:57.690099] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:42:57.999035] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:42:58.057903] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-15T19:42:58.857932] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-15T19:42:58.872316] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T19:42:59.657865] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-15T19:43:00.234989] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:43:00.457916] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-15T19:43:00.497724] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:43:01.257869] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-15T19:43:01.771607] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T19:43:02.057925] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-15T19:43:02.857893] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-15T19:43:03.086080] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T19:43:03.668668] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-15T19:43:03.673960] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T19:43:03.876261] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:43:04.457870] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-15T19:43:04.817866] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:43:05.169375] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:43:05.171761] [INFO ] [REMOTE ] NTB: Full fetch complete (22926 records). [2025-09-15T19:43:05.171832] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-15T19:43:05.262996] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-15T19:43:05.537733] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-15T19:43:05.537821] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-15T19:43:05.538305] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-15T19:43:05.538346] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-15T19:43:05.538954] [DEBUG] [LOCAL ] NTB: Trimmed 22926 records to 14614 (keeping 150 days of data) [2025-09-15T19:43:05.628737] [DEBUG] [LOCAL ] NTB: Primary data saved (14614 records). [2025-09-15T19:43:05.628874] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-15T19:43:05.628982] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NTB took 16.2s. Estimated remaining: 1h 28m 35s. Rate: 9.4 symbols/min [2025-09-15T19:43:05.797151] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:05.797341] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-15T19:43:05.797381] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-15T19:43:05.797500] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-15T19:43:05.797540] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-15T19:43:05.797580] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-15T19:43:05.797621] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-15T19:43:06.066032] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-15T19:43:06.150147] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:06.736363] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T19:43:06.857855] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-15T19:43:07.385589] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:43:07.657888] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-15T19:43:08.457886] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-15T19:43:08.533118] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T19:43:08.538575] [INFO ] [REMOTE ] NSC: Full fetch complete (53509 records). [2025-09-15T19:43:08.538708] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-15T19:43:08.942854] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-09-15T19:43:08.942954] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-09-15T19:43:08.944015] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-15T19:43:08.944100] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-09-15T19:43:08.945714] [DEBUG] [LOCAL ] NSC: Trimmed 53509 records to 36140 (keeping 150 days of data) [2025-09-15T19:43:09.069599] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:43:09.078249] [INFO ] [REMOTE ] NSA: Full fetch complete (47937 records). [2025-09-15T19:43:09.079660] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-15T19:43:09.168455] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:43:09.257849] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-15T19:43:09.500603] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-15T19:43:09.500979] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-15T19:43:09.502587] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-15T19:43:09.502918] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-15T19:43:09.507072] [DEBUG] [LOCAL ] NSA: Trimmed 47937 records to 33417 (keeping 150 days of data) [2025-09-15T19:43:09.787322] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:43:09.838356] [DEBUG] [LOCAL ] NSC: Primary data saved (36140 records). [2025-09-15T19:43:09.839564] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-15T19:43:09.841525] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NSC took 34.9s. Estimated remaining: 1h 28m 27s. Rate: 9.4 symbols/min [2025-09-15T19:43:10.033499] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:10.040375] [DEBUG] [LOCAL ] NSA: Primary data saved (33417 records). [2025-09-15T19:43:10.040546] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-15T19:43:10.041284] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NSA took 38.0s. Estimated remaining: 1h 28m 18s. Rate: 9.4 symbols/min [2025-09-15T19:43:10.062923] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-15T19:43:10.229724] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:10.252781] [DEBUG] [LOCAL ] NTR: Loaded 39519 existing records from primary storage. [2025-09-15T19:43:10.252987] [INFO ] [MAIN ] NTR: Loaded 39519 existing records. [2025-09-15T19:43:10.442744] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:10.452451] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-15T19:43:10.452952] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-15T19:43:10.452911] [DEBUG] [LOCAL ] NTST: Loaded 32619 existing records from primary storage. [2025-09-15T19:43:10.453073] [INFO ] [MAIN ] NTST: Loaded 32619 existing records. [2025-09-15T19:43:10.484526] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-15T19:43:10.516311] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-15T19:43:10.766357] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:10.845866] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-15T19:43:10.868573] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-15T19:43:10.868679] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-15T19:43:10.905269] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-15T19:43:10.906056] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-15T19:43:11.109142] [INFO ] [REMOTE ] NTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:11.371739] [INFO ] [REMOTE ] NTST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:11.421396] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T19:43:11.422330] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T19:43:11.427572] [INFO ] [REMOTE ] NSP: Full fetch complete (37994 records). [2025-09-15T19:43:11.427695] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-15T19:43:11.665446] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-15T19:43:11.800258] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-15T19:43:11.800444] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-15T19:43:11.801214] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-15T19:43:11.801261] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-15T19:43:11.802382] [DEBUG] [LOCAL ] NSP: Trimmed 37994 records to 26270 (keeping 150 days of data) [2025-09-15T19:43:11.966700] [DEBUG] [LOCAL ] NSP: Primary data saved (26270 records). [2025-09-15T19:43:11.966825] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-15T19:43:11.966922] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NSP took 29.7s. Estimated remaining: 1h 28m 9s. Rate: 9.4 symbols/min [2025-09-15T19:43:12.132934] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:12.171540] [DEBUG] [LOCAL ] NU: Loaded 40486 existing records from primary storage. [2025-09-15T19:43:12.171700] [INFO ] [MAIN ] NU: Loaded 40486 existing records. [2025-09-15T19:43:12.345183] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:12.345458] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-15T19:43:12.345504] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-15T19:43:12.346449] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-15T19:43:12.346501] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-15T19:43:12.462914] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-15T19:43:12.720295] [INFO ] [REMOTE ] NU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:13.044007] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:43:13.257856] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-15T19:43:14.057891] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-15T19:43:14.211802] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T19:43:14.288423] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T19:43:14.828209] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:43:14.857843] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-15T19:43:15.657911] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-15T19:43:16.457882] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-15T19:43:16.998666] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T19:43:17.036913] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T19:43:17.117210] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T19:43:17.257830] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-15T19:43:18.057872] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-15T19:43:18.857881] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-15T19:43:19.327189] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T19:43:19.365481] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-15T19:43:19.657891] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-15T19:43:20.226496] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:43:20.284600] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:43:20.457885] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-15T19:43:21.257897] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-15T19:43:21.717145] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:43:22.057877] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-15T19:43:22.857855] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-15T19:43:22.953705] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:43:23.377246] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:43:23.657949] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-15T19:43:24.210308] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T19:43:24.457875] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-15T19:43:24.887915] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T19:43:25.257888] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-15T19:43:25.945070] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:43:26.057912] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-15T19:43:26.857913] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-15T19:43:27.285243] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T19:43:27.361402] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:43:27.362216] [INFO ] [REMOTE ] NTEST: Full fetch complete (1668 records). [2025-09-15T19:43:27.362285] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-15T19:43:27.544459] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 133 unique days, need 150 days [2025-09-15T19:43:27.544716] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:43:27.544789] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:43:27.544853] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-15T19:43:27.544931] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-15T19:43:27.544994] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-15T19:43:27.545068] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-15T19:43:27.545150] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NTEST took 21.9s. Estimated remaining: 1h 28m 8s. Rate: 9.4 symbols/min [2025-09-15T19:43:27.668225] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-15T19:43:27.734551] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:27.734868] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-15T19:43:27.735029] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-15T19:43:27.735369] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-15T19:43:27.735465] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-15T19:43:27.735550] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-15T19:43:27.735608] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-15T19:43:28.167196] [INFO ] [REMOTE ] NUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:28.169805] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T19:43:28.457872] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-15T19:43:29.257849] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-15T19:43:29.535919] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T19:43:30.057840] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-15T19:43:30.119631] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T19:43:30.857946] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-15T19:43:30.965988] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:43:31.657978] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-15T19:43:32.457925] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-15T19:43:32.642172] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:43:32.747354] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-15T19:43:32.828844] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T19:43:33.257877] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-15T19:43:34.057901] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-15T19:43:34.371248] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T19:43:34.857871] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-15T19:43:35.176037] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T19:43:35.642214] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:43:35.648033] [INFO ] [REMOTE ] NTR: Full fetch complete (57266 records). [2025-09-15T19:43:35.648146] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-15T19:43:35.662980] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-15T19:43:36.037330] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-15T19:43:36.037447] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-15T19:43:36.038528] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-15T19:43:36.038631] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-15T19:43:36.053527] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:43:36.052853] [DEBUG] [LOCAL ] NTR: Trimmed 57266 records to 38745 (keeping 150 days of data) [2025-09-15T19:43:36.059234] [INFO ] [REMOTE ] NTST: Full fetch complete (46507 records). [2025-09-15T19:43:36.059347] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-15T19:43:36.458244] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-15T19:43:36.565918] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-15T19:43:36.567202] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-15T19:43:36.568769] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-15T19:43:36.569776] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-15T19:43:36.575769] [DEBUG] [LOCAL ] NTST: Trimmed 46507 records to 31978 (keeping 150 days of data) [2025-09-15T19:43:36.887819] [DEBUG] [LOCAL ] NTR: Primary data saved (38745 records). [2025-09-15T19:43:36.890719] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-15T19:43:36.894762] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NTR took 27.1s. Estimated remaining: 1h 28m 3s. Rate: 9.4 symbols/min [2025-09-15T19:43:36.963600] [DEBUG] [LOCAL ] NTST: Primary data saved (31978 records). [2025-09-15T19:43:36.975144] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-15T19:43:36.991723] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NTST took 27.0s. Estimated remaining: 1h 27m 53s. Rate: 9.4 symbols/min [2025-09-15T19:43:37.193357] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:37.248095] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:37.274285] [DEBUG] [LOCAL ] NUV: Loaded 16682 existing records from primary storage. [2025-09-15T19:43:37.274473] [INFO ] [MAIN ] NUV: Loaded 16682 existing records. [2025-09-15T19:43:37.383189] [DEBUG] [LOCAL ] NUS: Loaded 27086 existing records from primary storage. [2025-09-15T19:43:37.393990] [INFO ] [MAIN ] NUS: Loaded 27086 existing records. [2025-09-15T19:43:37.538271] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:37.565398] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-15T19:43:37.565564] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-15T19:43:37.571155] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-15T19:43:37.581512] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-15T19:43:37.730170] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:37.747977] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-15T19:43:37.753610] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-15T19:43:37.774232] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-15T19:43:37.797631] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-15T19:43:38.250704] [INFO ] [REMOTE ] NUV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:38.257591] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-15T19:43:38.400548] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-15T19:43:38.404521] [INFO ] [REMOTE ] NUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:38.415288] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-15T19:43:38.458382] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-15T19:43:38.464733] [INFO ] [REMOTE ] NU: Full fetch complete (58426 records). [2025-09-15T19:43:38.464838] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-15T19:43:38.843494] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-15T19:43:38.843580] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-15T19:43:38.844604] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-15T19:43:38.844712] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-15T19:43:38.846262] [DEBUG] [LOCAL ] NU: Trimmed 58426 records to 39706 (keeping 150 days of data) [2025-09-15T19:43:38.903022] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-15T19:43:39.099896] [DEBUG] [LOCAL ] NU: Primary data saved (39706 records). [2025-09-15T19:43:39.100035] [INFO ] [MAIN ] NU: Full history saved. [2025-09-15T19:43:39.101324] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NU took 27.1s. Estimated remaining: 1h 27m 44s. Rate: 9.4 symbols/min [2025-09-15T19:43:39.284220] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:39.323445] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T19:43:39.341341] [DEBUG] [LOCAL ] NUVB: Loaded 38758 existing records from primary storage. [2025-09-15T19:43:39.341474] [INFO ] [MAIN ] NUVB: Loaded 38758 existing records. [2025-09-15T19:43:39.515539] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:39.515814] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-15T19:43:39.515860] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-15T19:43:39.516770] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-15T19:43:39.516822] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-15T19:43:39.665072] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-15T19:43:39.882164] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:39.907842] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T19:43:40.457874] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-15T19:43:40.636141] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T19:43:40.669943] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T19:43:41.257875] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-15T19:43:41.870449] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:43:42.057905] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-15T19:43:42.762882] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T19:43:42.857825] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-15T19:43:43.220101] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T19:43:43.657890] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-15T19:43:44.290350] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:43:44.457905] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-15T19:43:44.860099] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:43:45.257873] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-15T19:43:45.718704] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T19:43:46.057940] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-15T19:43:46.857928] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-15T19:43:46.967827] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:43:47.007093] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T19:43:47.657965] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-15T19:43:48.457923] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-15T19:43:48.638660] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:43:49.237710] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:43:49.262964] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-15T19:43:49.278237] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:43:50.057883] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-15T19:43:50.560351] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:43:50.857874] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-15T19:43:51.657874] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-15T19:43:52.013478] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-15T19:43:52.457973] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-15T19:43:52.718973] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T19:43:52.793566] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:43:53.257836] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-15T19:43:53.406939] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:43:54.057898] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-15T19:43:54.857888] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-15T19:43:55.134667] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T19:43:55.290917] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:43:55.657851] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-15T19:43:55.976012] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:43:56.457874] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-15T19:43:57.257943] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-15T19:43:57.429009] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T19:43:57.987921] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:43:58.057942] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-15T19:43:58.323772] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:43:58.326972] [INFO ] [REMOTE ] NUV: Full fetch complete (24899 records). [2025-09-15T19:43:58.327071] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-15T19:43:58.736700] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-15T19:43:58.736816] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-15T19:43:58.737659] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-15T19:43:58.737706] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-15T19:43:58.738483] [DEBUG] [LOCAL ] NUV: Trimmed 24899 records to 16294 (keeping 150 days of data) [2025-09-15T19:43:58.849571] [DEBUG] [LOCAL ] NUV: Primary data saved (16294 records). [2025-09-15T19:43:58.849798] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-15T19:43:58.849975] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NUV took 21.8s. Estimated remaining: 1h 27m 45s. Rate: 9.4 symbols/min [2025-09-15T19:43:58.863000] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-15T19:43:59.036810] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:43:59.045992] [DEBUG] [LOCAL ] NUW: Loaded 5128 existing records from primary storage. [2025-09-15T19:43:59.046194] [INFO ] [MAIN ] NUW: Loaded 5128 existing records. [2025-09-15T19:43:59.228764] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:43:59.229124] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-15T19:43:59.229188] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-15T19:43:59.229485] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-15T19:43:59.229534] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-15T19:43:59.594589] [INFO ] [REMOTE ] NUW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:43:59.657893] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-15T19:43:59.720240] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T19:43:59.728411] [INFO ] [REMOTE ] NUVB: Full fetch complete (54951 records). [2025-09-15T19:43:59.728563] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-15T19:44:00.123658] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-15T19:44:00.123824] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-15T19:44:00.125318] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-15T19:44:00.125520] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-15T19:44:00.140026] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:44:00.144828] [DEBUG] [LOCAL ] NUVB: Trimmed 54951 records to 38079 (keeping 150 days of data) [2025-09-15T19:44:00.144984] [INFO ] [REMOTE ] NUS: Full fetch complete (40395 records). [2025-09-15T19:44:00.145336] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-15T19:44:00.463256] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-15T19:44:00.713478] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-15T19:44:00.714014] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-15T19:44:00.716488] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-15T19:44:00.717185] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-15T19:44:00.728596] [DEBUG] [LOCAL ] NUS: Trimmed 40395 records to 26383 (keeping 150 days of data) [2025-09-15T19:44:00.946629] [DEBUG] [LOCAL ] NUVB: Primary data saved (38079 records). [2025-09-15T19:44:00.947780] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-15T19:44:00.948997] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUVB took 21.8s. Estimated remaining: 1h 27m 36s. Rate: 9.4 symbols/min [2025-09-15T19:44:01.126298] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:01.183046] [DEBUG] [LOCAL ] NVG: Loaded 20268 existing records from primary storage. [2025-09-15T19:44:01.183871] [INFO ] [MAIN ] NVG: Loaded 20268 existing records. [2025-09-15T19:44:01.330210] [DEBUG] [LOCAL ] NUS: Primary data saved (26383 records). [2025-09-15T19:44:01.375986] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-15T19:44:01.399524] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NUS took 24.5s. Estimated remaining: 1h 27m 27s. Rate: 9.4 symbols/min [2025-09-15T19:44:01.399181] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:01.400151] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-15T19:44:01.446035] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-15T19:44:01.493851] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-15T19:44:01.504417] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-15T19:44:01.550526] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:44:01.584269] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-15T19:44:01.742738] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:01.746164] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-15T19:44:01.810721] [INFO ] [REMOTE ] NUE: Full fetch complete (55967 records). [2025-09-15T19:44:01.834765] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-15T19:44:01.996622] [DEBUG] [LOCAL ] NVGS: Loaded 23625 existing records from primary storage. [2025-09-15T19:44:02.011855] [INFO ] [MAIN ] NVGS: Loaded 23625 existing records. [2025-09-15T19:44:02.349924] [INFO ] [REMOTE ] NVG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:02.411870] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-15T19:44:02.418094] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:02.457221] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-15T19:44:02.456975] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:44:02.456077] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:44:02.457321] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-15T19:44:02.461071] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:44:02.461282] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:44:02.461334] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-15T19:44:02.461382] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-15T19:44:02.461440] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-15T19:44:02.461494] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-15T19:44:02.461562] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NUE took 34.9s. Estimated remaining: 1h 27m 18s. Rate: 9.4 symbols/min [2025-09-15T19:44:02.472866] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-15T19:44:02.493338] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-15T19:44:02.802707] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:02.867781] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-15T19:44:03.021558] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:03.037804] [DEBUG] [LOCAL ] NVO: Loaded 40524 existing records from primary storage. [2025-09-15T19:44:03.037939] [INFO ] [MAIN ] NVO: Loaded 40524 existing records. [2025-09-15T19:44:03.229665] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:03.229955] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-15T19:44:03.230002] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-15T19:44:03.231041] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-15T19:44:03.231093] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-15T19:44:03.588371] [INFO ] [REMOTE ] NVO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:03.604202] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:44:03.657820] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-15T19:44:03.679905] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:44:04.457896] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-15T19:44:05.065425] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T19:44:05.257892] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-15T19:44:05.743738] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T19:44:05.797409] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-15T19:44:06.057880] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-15T19:44:06.857864] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-15T19:44:07.200039] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T19:44:07.478729] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T19:44:07.657865] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-15T19:44:08.157564] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T19:44:08.457874] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-15T19:44:09.257889] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-15T19:44:10.057892] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-15T19:44:10.611336] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:44:10.725816] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-15T19:44:10.751209] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:44:10.857841] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-15T19:44:11.657887] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-15T19:44:12.114418] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:44:12.457870] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-15T19:44:12.540687] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T19:44:13.257886] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-15T19:44:13.492034] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T19:44:14.057858] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-15T19:44:14.857884] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-15T19:44:15.330350] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T19:44:15.452351] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:44:15.455236] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T19:44:15.453924] [INFO ] [REMOTE ] NUW: Full fetch complete (8154 records). [2025-09-15T19:44:15.465610] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-15T19:44:15.663060] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-15T19:44:15.847428] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-15T19:44:15.847560] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-15T19:44:15.847912] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-15T19:44:15.847986] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-15T19:44:15.848849] [DEBUG] [LOCAL ] NUW: Trimmed 8154 records to 5084 (keeping 150 days of data) [2025-09-15T19:44:15.884973] [DEBUG] [LOCAL ] NUW: Primary data saved (5084 records). [2025-09-15T19:44:15.885171] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-15T19:44:15.885285] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NUW took 17.0s. Estimated remaining: 1h 27m 15s. Rate: 9.4 symbols/min [2025-09-15T19:44:16.081537] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:16.096706] [DEBUG] [LOCAL ] NVR: Loaded 13330 existing records from primary storage. [2025-09-15T19:44:16.096861] [INFO ] [MAIN ] NVR: Loaded 13330 existing records. [2025-09-15T19:44:16.272938] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:16.273185] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-15T19:44:16.273232] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-15T19:44:16.273789] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-15T19:44:16.273846] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-15T19:44:16.468417] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-15T19:44:16.627611] [INFO ] [REMOTE ] NVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:16.669512] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T19:44:17.257916] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-15T19:44:18.057937] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-15T19:44:18.191209] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T19:44:18.857886] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-15T19:44:19.009890] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-15T19:44:19.323687] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:44:19.634835] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T19:44:19.657818] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-15T19:44:20.457838] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-15T19:44:20.662367] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T19:44:21.257857] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-15T19:44:21.696689] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:44:22.057851] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-15T19:44:22.248205] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:44:22.857894] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-15T19:44:23.337711] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:44:23.341546] [INFO ] [REMOTE ] NVG: Full fetch complete (29512 records). [2025-09-15T19:44:23.341627] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-15T19:44:23.662971] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-15T19:44:23.718144] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-15T19:44:23.718225] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-15T19:44:23.718846] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-15T19:44:23.718913] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-15T19:44:23.719970] [DEBUG] [LOCAL ] NVG: Trimmed 29512 records to 19940 (keeping 150 days of data) [2025-09-15T19:44:23.854046] [DEBUG] [LOCAL ] NVG: Primary data saved (19940 records). [2025-09-15T19:44:23.854227] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-15T19:44:23.854318] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVG took 22.9s. Estimated remaining: 1h 27m 10s. Rate: 9.4 symbols/min [2025-09-15T19:44:24.040797] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:24.071425] [DEBUG] [LOCAL ] NVRI: Loaded 28503 existing records from primary storage. [2025-09-15T19:44:24.071561] [INFO ] [MAIN ] NVRI: Loaded 28503 existing records. [2025-09-15T19:44:24.252032] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:24.252304] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-15T19:44:24.252353] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-15T19:44:24.252990] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-15T19:44:24.253043] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-15T19:44:24.466977] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-15T19:44:24.617712] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:24.630051] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T19:44:25.248932] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-15T19:44:25.259230] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-15T19:44:25.614941] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:44:26.057904] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-15T19:44:26.356377] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:44:26.857884] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-15T19:44:27.657925] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-15T19:44:28.019876] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:44:28.307161] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-15T19:44:28.457834] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-15T19:44:28.484764] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T19:44:29.257867] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-15T19:44:29.365233] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:44:30.057899] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-15T19:44:30.857867] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-15T19:44:31.097224] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:44:31.100261] [INFO ] [REMOTE ] NVGS: Full fetch complete (33538 records). [2025-09-15T19:44:31.100338] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-15T19:44:31.524089] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-15T19:44:31.524209] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-15T19:44:31.525131] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-15T19:44:31.525180] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-15T19:44:31.526177] [DEBUG] [LOCAL ] NVGS: Trimmed 33538 records to 23312 (keeping 150 days of data) [2025-09-15T19:44:31.654130] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:44:31.658837] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-15T19:44:31.659427] [INFO ] [REMOTE ] NVR: Full fetch complete (21527 records). [2025-09-15T19:44:31.661485] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-15T19:44:31.935686] [DEBUG] [LOCAL ] NVGS: Primary data saved (23312 records). [2025-09-15T19:44:31.947860] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-15T19:44:31.972837] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVGS took 30.6s. Estimated remaining: 1h 27m 4s. Rate: 9.4 symbols/min [2025-09-15T19:44:32.265307] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-15T19:44:32.269496] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-15T19:44:32.270291] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-15T19:44:32.270773] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-15T19:44:32.349865] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:32.350408] [DEBUG] [LOCAL ] NVR: Trimmed 21527 records to 12975 (keeping 150 days of data) [2025-09-15T19:44:32.420379] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-09-15T19:44:32.467067] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-15T19:44:32.484379] [DEBUG] [LOCAL ] NVR: Primary data saved (12975 records). [2025-09-15T19:44:32.484580] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-15T19:44:32.484684] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVR took 16.6s. Estimated remaining: 1h 26m 55s. Rate: 9.4 symbols/min [2025-09-15T19:44:32.678713] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:32.680274] [DEBUG] [LOCAL ] NVS: Loaded 38688 existing records from primary storage. [2025-09-15T19:44:32.680773] [INFO ] [MAIN ] NVS: Loaded 38688 existing records. [2025-09-15T19:44:32.879559] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:32.888044] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-15T19:44:32.899287] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-15T19:44:32.902777] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-15T19:44:32.903053] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-15T19:44:32.939677] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:44:32.964860] [DEBUG] [LOCAL ] NVST: Loaded 38634 existing records from primary storage. [2025-09-15T19:44:33.009930] [INFO ] [MAIN ] NVST: Loaded 38634 existing records. [2025-09-15T19:44:33.347078] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:33.278838] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-15T19:44:33.384181] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-15T19:44:33.421575] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-15T19:44:33.498883] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-15T19:44:33.501182] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-15T19:44:33.535512] [INFO ] [REMOTE ] NVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:33.585860] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:44:33.641059] [INFO ] [REMOTE ] NVO: Full fetch complete (58464 records). [2025-09-15T19:44:33.641685] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-15T19:44:34.062378] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-15T19:44:34.123610] [INFO ] [REMOTE ] NVST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:34.341764] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-15T19:44:34.341897] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-15T19:44:34.343525] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-15T19:44:34.343593] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-15T19:44:34.345720] [DEBUG] [LOCAL ] NVO: Trimmed 58464 records to 39744 (keeping 150 days of data) [2025-09-15T19:44:34.636589] [DEBUG] [LOCAL ] NVO: Primary data saved (39744 records). [2025-09-15T19:44:34.636902] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-15T19:44:34.637013] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVO took 32.2s. Estimated remaining: 1h 26m 46s. Rate: 9.4 symbols/min [2025-09-15T19:44:34.820118] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:34.855466] [DEBUG] [LOCAL ] NVT: Loaded 38635 existing records from primary storage. [2025-09-15T19:44:34.855619] [INFO ] [MAIN ] NVT: Loaded 38635 existing records. [2025-09-15T19:44:34.877617] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-15T19:44:35.035733] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:35.036057] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-15T19:44:35.036171] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-15T19:44:35.037145] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-15T19:44:35.037200] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-15T19:44:35.223080] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T19:44:35.436421] [INFO ] [REMOTE ] NVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:35.657884] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-15T19:44:35.906275] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:44:36.269859] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:44:36.457904] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-15T19:44:37.257902] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-15T19:44:37.419244] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T19:44:37.710773] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T19:44:38.057885] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-15T19:44:38.714856] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T19:44:38.857917] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-15T19:44:39.657911] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-15T19:44:39.742366] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:44:40.139097] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:44:40.457871] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-15T19:44:41.034622] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:44:41.257868] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-15T19:44:42.035383] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:44:42.057810] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-15T19:44:42.810216] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:44:42.857885] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-15T19:44:43.657914] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-15T19:44:43.902135] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T19:44:43.981748] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:44:44.457918] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-15T19:44:45.269713] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-15T19:44:45.272576] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:44:45.992912] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:44:46.057896] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-15T19:44:46.293916] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T19:44:46.857941] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-15T19:44:47.454352] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:44:47.657895] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-15T19:44:48.457919] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-15T19:44:48.642353] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T19:44:49.257907] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-15T19:44:49.391944] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T19:44:49.985494] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:44:50.057923] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-15T19:44:50.496427] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:44:50.857966] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-15T19:44:51.366985] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:44:51.372596] [INFO ] [REMOTE ] NVST: Full fetch complete (56047 records). [2025-09-15T19:44:51.372759] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-15T19:44:51.667353] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-15T19:44:51.767491] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-15T19:44:51.767572] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-15T19:44:51.768462] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-15T19:44:51.768507] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-15T19:44:51.769626] [DEBUG] [LOCAL ] NVST: Trimmed 56047 records to 37889 (keeping 150 days of data) [2025-09-15T19:44:51.998188] [DEBUG] [LOCAL ] NVST: Primary data saved (37889 records). [2025-09-15T19:44:51.998331] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-15T19:44:51.998953] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NVST took 19.5s. Estimated remaining: 1h 26m 46s. Rate: 9.4 symbols/min [2025-09-15T19:44:52.169504] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:52.208995] [DEBUG] [LOCAL ] NWG: Loaded 38809 existing records from primary storage. [2025-09-15T19:44:52.209143] [INFO ] [MAIN ] NWG: Loaded 38809 existing records. [2025-09-15T19:44:52.384146] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:52.384417] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-15T19:44:52.384464] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-15T19:44:52.385340] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-15T19:44:52.385391] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-15T19:44:52.463019] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-15T19:44:52.749739] [INFO ] [REMOTE ] NWG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:52.782129] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-15T19:44:53.257991] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-15T19:44:53.299665] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:44:53.845268] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:44:53.852405] [INFO ] [REMOTE ] NVRI: Full fetch complete (42104 records). [2025-09-15T19:44:53.852570] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-15T19:44:54.064723] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-15T19:44:54.259536] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-15T19:44:54.259706] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-15T19:44:54.261092] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-15T19:44:54.261166] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-15T19:44:54.262759] [DEBUG] [LOCAL ] NVRI: Trimmed 42104 records to 28047 (keeping 150 days of data) [2025-09-15T19:44:54.436920] [DEBUG] [LOCAL ] NVRI: Primary data saved (28047 records). [2025-09-15T19:44:54.437124] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-15T19:44:54.437238] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NVRI took 30.6s. Estimated remaining: 1h 26m 37s. Rate: 9.4 symbols/min [2025-09-15T19:44:54.620027] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:44:54.652879] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:44:54.677603] [DEBUG] [LOCAL ] NWN: Loaded 20525 existing records from primary storage. [2025-09-15T19:44:54.677767] [INFO ] [MAIN ] NWN: Loaded 20525 existing records. [2025-09-15T19:44:54.855436] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:44:54.855754] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-15T19:44:54.855812] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-15T19:44:54.856418] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-15T19:44:54.856467] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-15T19:44:54.867909] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-15T19:44:55.237800] [INFO ] [REMOTE ] NWN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:44:55.657939] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-15T19:44:55.854969] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T19:44:56.386115] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:44:56.457871] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-15T19:44:56.712226] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T19:44:57.257895] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-15T19:44:58.063149] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-15T19:44:58.068570] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:44:58.122948] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:44:58.857889] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-15T19:44:59.657889] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-15T19:44:59.929088] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T19:45:00.152890] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:45:00.457871] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-15T19:45:01.257905] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-15T19:45:01.488874] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T19:45:01.810764] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T19:45:02.057918] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-15T19:45:02.857999] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-15T19:45:03.432037] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:45:03.657898] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-15T19:45:04.457929] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-15T19:45:04.573924] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-15T19:45:05.257878] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-15T19:45:05.851972] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T19:45:06.002386] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-09-15T19:45:06.057897] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-15T19:45:06.327041] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-15T19:45:06.333214] [INFO ] [REMOTE ] NVS: Full fetch complete (56328 records). [2025-09-15T19:45:06.333455] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-15T19:45:06.766324] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T19:45:06.790938] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-15T19:45:06.791220] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-15T19:45:06.792218] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-15T19:45:06.792275] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-15T19:45:06.793967] [DEBUG] [LOCAL ] NVS: Trimmed 56328 records to 37898 (keeping 150 days of data) [2025-09-15T19:45:06.859946] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-15T19:45:07.038680] [DEBUG] [LOCAL ] NVS: Primary data saved (37898 records). [2025-09-15T19:45:07.038892] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-15T19:45:07.039777] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NVS took 35.1s. Estimated remaining: 1h 26m 34s. Rate: 9.4 symbols/min [2025-09-15T19:45:07.211211] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:07.235910] [DEBUG] [LOCAL ] NX: Loaded 24369 existing records from primary storage. [2025-09-15T19:45:07.236049] [INFO ] [MAIN ] NX: Loaded 24369 existing records. [2025-09-15T19:45:07.422688] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:07.422933] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-15T19:45:07.422979] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-15T19:45:07.423585] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-15T19:45:07.423635] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-15T19:45:07.682425] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-15T19:45:07.801224] [INFO ] [REMOTE ] NX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:07.859938] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T19:45:08.425920] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:45:08.431601] [INFO ] [REMOTE ] NVT: Full fetch complete (56177 records). [2025-09-15T19:45:08.431729] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-15T19:45:08.463149] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-15T19:45:08.822115] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-15T19:45:08.822199] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-15T19:45:08.823076] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-15T19:45:08.823123] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-15T19:45:08.824319] [DEBUG] [LOCAL ] NVT: Trimmed 56177 records to 37884 (keeping 150 days of data) [2025-09-15T19:45:08.940631] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:45:09.093991] [DEBUG] [LOCAL ] NVT: Primary data saved (37884 records). [2025-09-15T19:45:09.094149] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-15T19:45:09.094297] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NVT took 34.5s. Estimated remaining: 1h 26m 25s. Rate: 9.4 symbols/min [2025-09-15T19:45:09.274324] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-15T19:45:09.276627] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:09.282116] [DEBUG] [LOCAL ] NXC: Loaded 3040 existing records from primary storage. [2025-09-15T19:45:09.282201] [INFO ] [MAIN ] NXC: Loaded 3040 existing records. [2025-09-15T19:45:09.494070] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:09.494350] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-15T19:45:09.494402] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-15T19:45:09.494671] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-15T19:45:09.494726] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-15T19:45:09.871984] [INFO ] [REMOTE ] NXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:09.891018] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T19:45:10.057876] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-15T19:45:10.260112] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:45:10.263068] [INFO ] [REMOTE ] NWN: Full fetch complete (28835 records). [2025-09-15T19:45:10.263184] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-15T19:45:10.640923] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-15T19:45:10.641023] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-15T19:45:10.641614] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-15T19:45:10.641671] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-15T19:45:10.642434] [DEBUG] [LOCAL ] NWN: Trimmed 28835 records to 20122 (keeping 150 days of data) [2025-09-15T19:45:10.767263] [DEBUG] [LOCAL ] NWN: Primary data saved (20122 records). [2025-09-15T19:45:10.767392] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-15T19:45:10.767494] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NWN took 16.3s. Estimated remaining: 1h 26m 17s. Rate: 9.4 symbols/min [2025-09-15T19:45:10.864430] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-15T19:45:10.944920] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:10.945156] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-15T19:45:10.945195] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-15T19:45:10.945329] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-15T19:45:10.945371] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-15T19:45:10.945412] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-15T19:45:10.945446] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-15T19:45:11.308303] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:11.484069] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:45:11.657868] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-15T19:45:12.459503] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-15T19:45:12.462311] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T19:45:13.025562] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:45:13.038206] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:45:13.257867] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-15T19:45:14.057881] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-15T19:45:14.651978] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:45:14.859149] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-15T19:45:14.861045] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:45:15.657918] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-15T19:45:16.395523] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:45:16.395956] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-15T19:45:16.457926] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-15T19:45:17.023247] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:45:17.200397] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-15T19:45:17.257902] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-15T19:45:17.475565] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:45:17.475930] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-15T19:45:18.057899] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-15T19:45:18.247935] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:45:18.248262] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-15T19:45:18.857884] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-15T19:45:19.657924] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-15T19:45:20.457911] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-15T19:45:20.488837] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:45:20.494491] [INFO ] [REMOTE ] NWG: Full fetch complete (56004 records). [2025-09-15T19:45:20.494630] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-15T19:45:20.908932] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-15T19:45:20.913025] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-15T19:45:20.914366] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-15T19:45:20.914985] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-15T19:45:20.915162] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:45:20.924680] [DEBUG] [LOCAL ] NWG: Trimmed 56004 records to 38033 (keeping 150 days of data) [2025-09-15T19:45:20.937953] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:45:21.191446] [DEBUG] [LOCAL ] NWG: Primary data saved (38033 records). [2025-09-15T19:45:21.191617] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-15T19:45:21.192150] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NWG took 29.2s. Estimated remaining: 1h 26m 12s. Rate: 9.4 symbols/min [2025-09-15T19:45:21.257944] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-15T19:45:21.791394] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:45:22.057929] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-15T19:45:22.857939] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-15T19:45:23.051542] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:45:23.051927] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-15T19:45:23.318156] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:45:23.657905] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-15T19:45:24.181408] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:45:24.457919] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-15T19:45:25.257901] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-15T19:45:25.618925] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T19:45:25.624286] [INFO ] [REMOTE ] NX: Full fetch complete (36214 records). [2025-09-15T19:45:25.624397] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-15T19:45:25.793576] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T19:45:26.007744] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-15T19:45:26.007829] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-15T19:45:26.008537] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-15T19:45:26.008578] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-15T19:45:26.009462] [DEBUG] [LOCAL ] NX: Trimmed 36214 records to 24040 (keeping 150 days of data) [2025-09-15T19:45:26.060694] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-15T19:45:26.160630] [DEBUG] [LOCAL ] NX: Primary data saved (24040 records). [2025-09-15T19:45:26.160823] [INFO ] [MAIN ] NX: Full history saved. [2025-09-15T19:45:26.160943] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NX took 19.1s. Estimated remaining: 1h 26m 5s. Rate: 9.4 symbols/min [2025-09-15T19:45:26.365491] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:45:26.365859] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-15T19:45:26.857893] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-15T19:45:27.657895] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-15T19:45:29.056185] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T19:45:29.057409] [INFO ] [REMOTE ] NXC: Full fetch complete (4456 records). [2025-09-15T19:45:29.057480] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-15T19:45:29.355044] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-15T19:45:29.381106] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-15T19:45:29.440879] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-15T19:45:29.440959] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-15T19:45:29.441102] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-15T19:45:29.441141] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-15T19:45:29.441518] [DEBUG] [LOCAL ] NXC: Trimmed 4456 records to 2940 (keeping 150 days of data) [2025-09-15T19:45:29.460952] [DEBUG] [LOCAL ] NXC: Primary data saved (2940 records). [2025-09-15T19:45:29.461051] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-15T19:45:29.461128] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NXC took 20.4s. Estimated remaining: 1h 25m 57s. Rate: 9.4 symbols/min [2025-09-15T19:45:31.051694] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T19:45:31.062136] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-15T19:45:32.624706] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T19:45:32.630023] [INFO ] [REMOTE ] NXDR: Full fetch complete (14465 records). [2025-09-15T19:45:32.630107] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-15T19:45:32.807081] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 40 unique days, need 150 days [2025-09-15T19:45:32.807392] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:45:32.808013] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:45:32.808067] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-15T19:45:32.808125] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-15T19:45:32.808166] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-15T19:45:32.808216] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-15T19:45:32.808275] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXDR took 22.0s. Estimated remaining: 1h 25m 49s. Rate: 9.4 symbols/min [2025-09-15T19:45:33.353632] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:33.491784] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:33.493922] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:33.549807] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:33.564013] [DEBUG] [LOCAL ] NXDT: Loaded 11045 existing records from primary storage. [2025-09-15T19:45:33.564318] [INFO ] [MAIN ] NXDT: Loaded 11045 existing records. [2025-09-15T19:45:33.607116] [DEBUG] [LOCAL ] NXG: Loaded 7526 existing records from primary storage. [2025-09-15T19:45:33.634891] [INFO ] [MAIN ] NXG: Loaded 7526 existing records. [2025-09-15T19:45:33.682980] [DEBUG] [LOCAL ] NXJ: Loaded 11754 existing records from primary storage. [2025-09-15T19:45:33.713147] [INFO ] [MAIN ] NXJ: Loaded 11754 existing records. [2025-09-15T19:45:33.968454] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:33.995953] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-15T19:45:33.985435] [DEBUG] [LOCAL ] NXE: Loaded 39838 existing records from primary storage. [2025-09-15T19:45:34.002419] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-15T19:45:34.058347] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-15T19:45:34.026103] [INFO ] [MAIN ] NXE: Loaded 39838 existing records. [2025-09-15T19:45:34.097343] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-15T19:45:34.126586] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:34.307352] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:34.334280] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-15T19:45:34.312967] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-15T19:45:34.342957] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-15T19:45:34.348262] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-15T19:45:34.385214] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-15T19:45:34.395808] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-15T19:45:34.470767] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-15T19:45:34.444741] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-15T19:45:34.470673] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:34.538239] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-15T19:45:34.559703] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-15T19:45:34.670427] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-15T19:45:34.732888] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-15T19:45:35.281162] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:35.397684] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-15T19:45:35.715876] [INFO ] [REMOTE ] NXG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:35.787896] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-15T19:45:35.787248] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:35.806031] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-15T19:45:35.871467] [INFO ] [REMOTE ] NXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:35.871836] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-15T19:45:36.469139] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T19:45:36.471552] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-15T19:45:36.595373] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T19:45:36.601571] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-15T19:45:36.660808] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:45:36.665436] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-15T19:45:36.962187] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T19:45:36.965685] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-15T19:45:37.354137] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:45:37.360571] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-15T19:45:37.368429] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T19:45:37.371365] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-15T19:45:37.535666] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T19:45:37.633618] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T19:45:38.057890] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-15T19:45:38.363703] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:45:38.447119] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:45:38.857901] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-15T19:45:39.662972] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-15T19:45:39.688459] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T19:45:39.778406] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T19:45:40.379983] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T19:45:40.457916] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-15T19:45:41.257942] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-15T19:45:41.866936] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T19:45:42.057847] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-15T19:45:42.169738] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T19:45:42.770714] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T19:45:42.857931] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-15T19:45:43.549485] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:45:43.657917] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-15T19:45:44.434473] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:45:44.457887] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-15T19:45:45.122904] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:45:45.257918] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-15T19:45:46.057881] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-15T19:45:46.857951] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-15T19:45:47.088876] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T19:45:47.110259] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:45:47.488398] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:45:47.657855] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-15T19:45:48.432020] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T19:45:48.457843] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-15T19:45:49.257895] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-15T19:45:49.281238] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:45:49.283357] [INFO ] [REMOTE ] NXJ: Full fetch complete (15531 records). [2025-09-15T19:45:49.283433] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-15T19:45:49.653728] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-15T19:45:49.653834] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-15T19:45:49.654229] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-15T19:45:49.654280] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-15T19:45:49.654850] [DEBUG] [LOCAL ] NXJ: Trimmed 15531 records to 11607 (keeping 150 days of data) [2025-09-15T19:45:49.730117] [DEBUG] [LOCAL ] NXJ: Primary data saved (11607 records). [2025-09-15T19:45:49.730286] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-15T19:45:49.730387] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXJ took 16.9s. Estimated remaining: 1h 25m 48s. Rate: 9.4 symbols/min [2025-09-15T19:45:49.904349] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:49.908548] [DEBUG] [LOCAL ] NXN: Loaded 1753 existing records from primary storage. [2025-09-15T19:45:49.908677] [INFO ] [MAIN ] NXN: Loaded 1753 existing records. [2025-09-15T19:45:50.064244] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-15T19:45:50.092162] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:50.093146] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-15T19:45:50.093208] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-15T19:45:50.093362] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-15T19:45:50.093410] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-15T19:45:50.453913] [INFO ] [REMOTE ] NXN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:50.809081] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:45:50.857851] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-15T19:45:50.985025] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:45:51.323731] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T19:45:51.657916] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-15T19:45:52.344915] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T19:45:52.346816] [INFO ] [REMOTE ] NXG: Full fetch complete (11198 records). [2025-09-15T19:45:52.346889] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-15T19:45:52.463041] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-15T19:45:52.709681] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-15T19:45:52.709764] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-15T19:45:52.710047] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-15T19:45:52.710089] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-15T19:45:52.710535] [DEBUG] [LOCAL ] NXG: Trimmed 11198 records to 7370 (keeping 150 days of data) [2025-09-15T19:45:52.757182] [DEBUG] [LOCAL ] NXG: Primary data saved (7370 records). [2025-09-15T19:45:52.757288] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-15T19:45:52.757370] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXG took 19.9s. Estimated remaining: 1h 25m 40s. Rate: 9.4 symbols/min [2025-09-15T19:45:52.925340] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:52.935700] [DEBUG] [LOCAL ] NXP: Loaded 9211 existing records from primary storage. [2025-09-15T19:45:52.935824] [INFO ] [MAIN ] NXP: Loaded 9211 existing records. [2025-09-15T19:45:53.119390] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:53.119692] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-15T19:45:53.119743] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-15T19:45:53.120064] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-15T19:45:53.120112] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-15T19:45:53.262996] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-15T19:45:53.480451] [INFO ] [REMOTE ] NXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:53.791562] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:45:54.057889] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-15T19:45:54.386472] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T19:45:54.679815] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:45:54.857903] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-15T19:45:55.657903] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-15T19:45:55.743953] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:45:55.746031] [INFO ] [REMOTE ] NXDT: Full fetch complete (18348 records). [2025-09-15T19:45:55.746102] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-15T19:45:56.103924] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-15T19:45:56.104000] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-15T19:45:56.104469] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-15T19:45:56.104511] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-15T19:45:56.105080] [DEBUG] [LOCAL ] NXDT: Trimmed 18348 records to 10717 (keeping 150 days of data) [2025-09-15T19:45:56.172653] [DEBUG] [LOCAL ] NXDT: Primary data saved (10717 records). [2025-09-15T19:45:56.172802] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-15T19:45:56.172902] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXDT took 23.4s. Estimated remaining: 1h 25m 32s. Rate: 9.4 symbols/min [2025-09-15T19:45:56.347922] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:45:56.364371] [DEBUG] [LOCAL ] NXRT: Loaded 13774 existing records from primary storage. [2025-09-15T19:45:56.364517] [INFO ] [MAIN ] NXRT: Loaded 13774 existing records. [2025-09-15T19:45:56.463706] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-15T19:45:56.543174] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:45:56.543429] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-15T19:45:56.543477] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-15T19:45:56.543980] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-15T19:45:56.544029] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-15T19:45:56.890816] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:45:57.238419] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:45:57.257864] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-15T19:45:57.500966] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T19:45:58.029459] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:45:58.057903] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-15T19:45:58.857858] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-15T19:45:58.868967] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:45:59.278401] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T19:45:59.657888] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-15T19:46:00.443776] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:46:00.457855] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-15T19:46:01.257875] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-15T19:46:01.704101] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:46:02.057910] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-15T19:46:02.124736] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:46:02.130858] [INFO ] [REMOTE ] NXE: Full fetch complete (57595 records). [2025-09-15T19:46:02.131000] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-15T19:46:02.566379] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-15T19:46:02.566474] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-15T19:46:02.567386] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-15T19:46:02.567437] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-15T19:46:02.568896] [DEBUG] [LOCAL ] NXE: Trimmed 57595 records to 39107 (keeping 150 days of data) [2025-09-15T19:46:02.786747] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T19:46:02.815307] [DEBUG] [LOCAL ] NXE: Primary data saved (39107 records). [2025-09-15T19:46:02.815452] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-15T19:46:02.815538] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXE took 30.0s. Estimated remaining: 1h 25m 26s. Rate: 9.4 symbols/min [2025-09-15T19:46:02.867824] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-15T19:46:02.989787] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:02.989975] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-15T19:46:02.990015] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-15T19:46:02.990159] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-15T19:46:02.990200] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-15T19:46:02.990240] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-15T19:46:02.990274] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-15T19:46:03.337921] [INFO ] [REMOTE ] NYC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:03.437853] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T19:46:03.657885] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-15T19:46:04.416100] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T19:46:04.457915] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-15T19:46:05.121115] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:46:05.257889] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-15T19:46:06.057908] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-15T19:46:06.152694] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:46:06.154785] [INFO ] [REMOTE ] NXP: Full fetch complete (12895 records). [2025-09-15T19:46:06.154898] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-15T19:46:06.514165] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-15T19:46:06.514277] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-15T19:46:06.514636] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-15T19:46:06.514693] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-15T19:46:06.515165] [DEBUG] [LOCAL ] NXP: Trimmed 12895 records to 9046 (keeping 150 days of data) [2025-09-15T19:46:06.560801] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T19:46:06.577605] [DEBUG] [LOCAL ] NXP: Primary data saved (9046 records). [2025-09-15T19:46:06.577752] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-15T19:46:06.577855] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NXP took 13.8s. Estimated remaining: 1h 25m 18s. Rate: 9.4 symbols/min [2025-09-15T19:46:06.744450] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:06.782205] [DEBUG] [LOCAL ] NYT: Loaded 37498 existing records from primary storage. [2025-09-15T19:46:06.782353] [INFO ] [MAIN ] NYT: Loaded 37498 existing records. [2025-09-15T19:46:06.863114] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-15T19:46:06.958972] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:06.959229] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-15T19:46:06.959282] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-15T19:46:06.960115] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-15T19:46:06.960165] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-15T19:46:07.311822] [INFO ] [REMOTE ] NYT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:07.625197] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:46:07.657817] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-15T19:46:08.457903] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-15T19:46:08.706719] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:46:09.257874] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-15T19:46:09.775950] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:46:10.057894] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-15T19:46:10.251912] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T19:46:10.337167] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-15T19:46:10.857866] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-15T19:46:11.336229] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T19:46:11.657888] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-15T19:46:11.955929] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T19:46:12.457874] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-15T19:46:12.946882] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:46:13.257870] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-15T19:46:14.057906] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-15T19:46:14.559482] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:46:14.560694] [INFO ] [REMOTE ] NXN: Full fetch complete (2563 records). [2025-09-15T19:46:14.560802] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-15T19:46:14.863017] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-15T19:46:14.954639] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-15T19:46:14.954807] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-15T19:46:14.954917] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-15T19:46:14.954978] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-15T19:46:14.955534] [DEBUG] [LOCAL ] NXN: Trimmed 2563 records to 1734 (keeping 150 days of data) [2025-09-15T19:46:14.970033] [DEBUG] [LOCAL ] NXN: Primary data saved (1734 records). [2025-09-15T19:46:14.970221] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-15T19:46:14.970361] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NXN took 25.2s. Estimated remaining: 1h 25m 13s. Rate: 9.4 symbols/min [2025-09-15T19:46:15.092306] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T19:46:15.183175] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:15.208543] [DEBUG] [LOCAL ] NZF: Loaded 21505 existing records from primary storage. [2025-09-15T19:46:15.208701] [INFO ] [MAIN ] NZF: Loaded 21505 existing records. [2025-09-15T19:46:15.385300] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:15.385706] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-15T19:46:15.385768] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-15T19:46:15.386509] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-15T19:46:15.386560] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-15T19:46:15.661080] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-15T19:46:15.739480] [INFO ] [REMOTE ] NZF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:15.941797] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:46:16.457912] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-15T19:46:17.227106] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:46:17.258117] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-15T19:46:17.289586] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T19:46:18.057870] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-15T19:46:18.242627] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T19:46:18.857861] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-15T19:46:19.190206] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T19:46:19.476711] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:46:19.657873] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-15T19:46:20.352211] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:46:20.457893] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-15T19:46:20.792180] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T19:46:21.257866] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-15T19:46:22.057883] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-15T19:46:22.857870] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-15T19:46:23.097321] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-15T19:46:23.129363] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T19:46:23.194854] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:46:23.657936] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-15T19:46:24.457876] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-15T19:46:24.985773] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T19:46:24.986580] [INFO ] [REMOTE ] NYC: Full fetch complete (1351 records). [2025-09-15T19:46:24.986680] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-15T19:46:25.169185] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T19:46:25.169411] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:46:25.169472] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:46:25.169626] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-15T19:46:25.169721] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-15T19:46:25.169837] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-15T19:46:25.169958] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-15T19:46:25.170120] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NYC took 22.4s. Estimated remaining: 1h 25m 9s. Rate: 9.4 symbols/min [2025-09-15T19:46:25.263180] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-15T19:46:25.403687] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:25.408481] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T19:46:25.408759] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-15T19:46:25.419388] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-15T19:46:25.419713] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-15T19:46:25.419781] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-15T19:46:25.419881] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-15T19:46:25.420619] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-15T19:46:25.788010] [INFO ] [REMOTE ] O: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:26.057886] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-15T19:46:26.173192] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T19:46:26.857936] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-15T19:46:27.657878] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-15T19:46:28.408727] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:46:28.458128] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-15T19:46:28.463336] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-15T19:46:28.517961] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:46:29.257878] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-15T19:46:29.592457] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:46:30.057888] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-15T19:46:30.481539] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:46:30.857872] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-15T19:46:31.657911] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-15T19:46:32.299544] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:46:32.467626] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-15T19:46:32.495558] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-15T19:46:32.513827] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T19:46:32.516217] [INFO ] [REMOTE ] NXRT: Full fetch complete (20161 records). [2025-09-15T19:46:32.516291] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-15T19:46:32.891441] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-15T19:46:32.891520] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-15T19:46:32.891949] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-15T19:46:32.891993] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-15T19:46:32.892566] [DEBUG] [LOCAL ] NXRT: Trimmed 20161 records to 13545 (keeping 150 days of data) [2025-09-15T19:46:32.977241] [DEBUG] [LOCAL ] NXRT: Primary data saved (13545 records). [2025-09-15T19:46:32.977382] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-15T19:46:32.977468] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. NXRT took 36.8s. Estimated remaining: 1h 25m 3s. Rate: 9.4 symbols/min [2025-09-15T19:46:33.145187] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:33.187031] [DEBUG] [LOCAL ] OBDC: Loaded 38542 existing records from primary storage. [2025-09-15T19:46:33.187199] [INFO ] [MAIN ] OBDC: Loaded 38542 existing records. [2025-09-15T19:46:33.263036] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-15T19:46:33.365679] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:33.365908] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-15T19:46:33.365954] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-15T19:46:33.366892] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-15T19:46:33.366942] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-15T19:46:33.721657] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:33.804634] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T19:46:34.057910] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-15T19:46:34.857894] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-15T19:46:35.394261] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:46:35.657848] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-15T19:46:35.715678] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-15T19:46:36.267006] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:46:36.276277] [INFO ] [REMOTE ] NYT: Full fetch complete (54671 records). [2025-09-15T19:46:36.276514] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-15T19:46:36.463131] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-15T19:46:36.712106] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:46:36.892957] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-15T19:46:36.893096] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-15T19:46:36.894974] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-15T19:46:36.895087] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-15T19:46:36.896861] [DEBUG] [LOCAL ] NYT: Trimmed 54671 records to 36763 (keeping 150 days of data) [2025-09-15T19:46:37.156176] [DEBUG] [LOCAL ] NYT: Primary data saved (36763 records). [2025-09-15T19:46:37.156343] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-15T19:46:37.156686] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. NYT took 30.6s. Estimated remaining: 1h 24m 56s. Rate: 9.4 symbols/min [2025-09-15T19:46:37.262577] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-15T19:46:37.340623] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:37.354953] [DEBUG] [LOCAL ] OBK: Loaded 11930 existing records from primary storage. [2025-09-15T19:46:37.355105] [INFO ] [MAIN ] OBK: Loaded 11930 existing records. [2025-09-15T19:46:37.531071] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:37.531340] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-15T19:46:37.531387] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-15T19:46:37.531880] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-15T19:46:37.531933] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-15T19:46:37.883145] [INFO ] [REMOTE ] OBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:38.001860] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T19:46:38.057825] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-15T19:46:38.568791] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:46:38.572731] [INFO ] [REMOTE ] NZF: Full fetch complete (31833 records). [2025-09-15T19:46:38.572858] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-15T19:46:38.862976] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-15T19:46:38.956850] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-15T19:46:38.956937] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-15T19:46:38.957570] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-15T19:46:38.957610] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-15T19:46:38.958539] [DEBUG] [LOCAL ] NZF: Trimmed 31833 records to 21113 (keeping 150 days of data) [2025-09-15T19:46:39.100597] [DEBUG] [LOCAL ] NZF: Primary data saved (21113 records). [2025-09-15T19:46:39.100744] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-15T19:46:39.100838] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. NZF took 24.1s. Estimated remaining: 1h 24m 47s. Rate: 9.4 symbols/min [2025-09-15T19:46:39.271418] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:39.314298] [DEBUG] [LOCAL ] OC: Loaded 33188 existing records from primary storage. [2025-09-15T19:46:39.314688] [INFO ] [MAIN ] OC: Loaded 33188 existing records. [2025-09-15T19:46:39.491457] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:39.491710] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-15T19:46:39.491758] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-15T19:46:39.492688] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-15T19:46:39.492743] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-15T19:46:39.658954] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-15T19:46:39.843997] [INFO ] [REMOTE ] OC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:39.984997] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:46:40.029238] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T19:46:40.457866] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-15T19:46:41.257921] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-15T19:46:42.004847] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-15T19:46:42.068320] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-15T19:46:42.093399] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:46:42.706499] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T19:46:42.857892] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-15T19:46:43.657907] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-15T19:46:44.156064] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:46:44.399864] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-15T19:46:44.457864] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-15T19:46:45.007255] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:46:45.257942] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-15T19:46:46.057933] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-15T19:46:46.153076] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:46:46.857854] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-15T19:46:46.942207] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T19:46:47.500738] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T19:46:47.657894] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-15T19:46:47.730380] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T19:46:48.457899] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-15T19:46:49.257894] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-15T19:46:49.322386] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T19:46:50.057881] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-15T19:46:50.148200] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:46:50.857876] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-15T19:46:51.036594] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T19:46:51.552175] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-15T19:46:51.657887] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-15T19:46:52.145394] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:46:52.457903] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-15T19:46:53.183293] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T19:46:53.257929] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-15T19:46:54.057899] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-15T19:46:54.091199] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-15T19:46:54.096681] [INFO ] [REMOTE ] O: Full fetch complete (58076 records). [2025-09-15T19:46:54.096796] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-15T19:46:54.289879] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:46:54.290533] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:46:54.290599] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:46:54.290664] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-15T19:46:54.290733] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-15T19:46:54.290771] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-15T19:46:54.290890] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-15T19:46:54.290972] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. O took 29.1s. Estimated remaining: 1h 24m 45s. Rate: 9.4 symbols/min [2025-09-15T19:46:54.462415] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:54.469547] [DEBUG] [LOCAL ] OCFT: Loaded 5798 existing records from primary storage. [2025-09-15T19:46:54.469684] [INFO ] [MAIN ] OCFT: Loaded 5798 existing records. [2025-09-15T19:46:54.652000] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:54.652237] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-15T19:46:54.652286] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-15T19:46:54.652523] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-15T19:46:54.652570] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-15T19:46:54.859837] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-15T19:46:55.050911] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:55.052417] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:46:55.057976] [INFO ] [REMOTE ] OBDC: Full fetch complete (56193 records). [2025-09-15T19:46:55.058068] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-15T19:46:55.445333] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-15T19:46:55.445423] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-15T19:46:55.446317] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-15T19:46:55.446364] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-15T19:46:55.447719] [DEBUG] [LOCAL ] OBDC: Trimmed 56193 records to 37788 (keeping 150 days of data) [2025-09-15T19:46:55.664038] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-15T19:46:55.707272] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T19:46:55.714572] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:46:55.756457] [DEBUG] [LOCAL ] OBDC: Primary data saved (37788 records). [2025-09-15T19:46:55.756657] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-15T19:46:55.757322] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. OBDC took 22.8s. Estimated remaining: 1h 24m 36s. Rate: 9.4 symbols/min [2025-09-15T19:46:55.932396] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:46:55.942145] [DEBUG] [LOCAL ] ODC: Loaded 6453 existing records from primary storage. [2025-09-15T19:46:55.942302] [INFO ] [MAIN ] ODC: Loaded 6453 existing records. [2025-09-15T19:46:56.116212] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:46:56.116508] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-15T19:46:56.116558] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-15T19:46:56.116849] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-15T19:46:56.116898] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-15T19:46:56.466796] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-15T19:46:56.471280] [INFO ] [REMOTE ] ODC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:46:56.576830] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T19:46:57.257877] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-15T19:46:58.062972] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-15T19:46:58.075761] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:46:58.172033] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:46:58.817587] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:46:58.857849] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-15T19:46:59.557925] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:46:59.657901] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-15T19:47:00.457870] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-15T19:47:01.091504] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T19:47:01.257920] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-15T19:47:01.334133] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:47:02.057894] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-15T19:47:02.083085] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:47:02.857865] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-15T19:47:03.558727] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:47:03.657888] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-15T19:47:03.685298] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:47:03.691061] [INFO ] [REMOTE ] OC: Full fetch complete (48864 records). [2025-09-15T19:47:03.691201] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-15T19:47:04.084145] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-15T19:47:04.084248] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-15T19:47:04.085201] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-15T19:47:04.085245] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-15T19:47:04.086303] [DEBUG] [LOCAL ] OC: Trimmed 48864 records to 32462 (keeping 150 days of data) [2025-09-15T19:47:04.312598] [DEBUG] [LOCAL ] OC: Primary data saved (32462 records). [2025-09-15T19:47:04.313002] [INFO ] [MAIN ] OC: Full history saved. [2025-09-15T19:47:04.313097] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. OC took 25.2s. Estimated remaining: 1h 24m 31s. Rate: 9.4 symbols/min [2025-09-15T19:47:04.458376] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-15T19:47:04.481972] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:04.489430] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:47:04.491948] [INFO ] [REMOTE ] OBK: Full fetch complete (17538 records). [2025-09-15T19:47:04.492023] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-15T19:47:04.677162] [DEBUG] [LOCAL ] ODV: Loaded 20014 existing records from primary storage. [2025-09-15T19:47:04.728730] [INFO ] [MAIN ] ODV: Loaded 20014 existing records. [2025-09-15T19:47:05.047758] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-15T19:47:05.051076] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-15T19:47:05.051033] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:05.051517] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-15T19:47:05.051570] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-15T19:47:05.052098] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-15T19:47:05.052439] [DEBUG] [LOCAL ] OBK: Trimmed 17538 records to 11716 (keeping 150 days of data) [2025-09-15T19:47:05.052361] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-15T19:47:05.053241] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-15T19:47:05.053293] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-15T19:47:05.226759] [DEBUG] [LOCAL ] OBK: Primary data saved (11716 records). [2025-09-15T19:47:05.232476] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-15T19:47:05.238928] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. OBK took 28.1s. Estimated remaining: 1h 24m 22s. Rate: 9.4 symbols/min [2025-09-15T19:47:05.260022] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-15T19:47:05.364765] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T19:47:05.680459] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:05.685057] [INFO ] [REMOTE ] ODV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:05.712716] [DEBUG] [LOCAL ] OEC: Loaded 27729 existing records from primary storage. [2025-09-15T19:47:05.712881] [INFO ] [MAIN ] OEC: Loaded 27729 existing records. [2025-09-15T19:47:05.890397] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:05.890633] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-15T19:47:05.890698] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-15T19:47:05.891723] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-15T19:47:05.891773] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-15T19:47:06.067967] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-15T19:47:06.252158] [INFO ] [REMOTE ] OEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:06.258141] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T19:47:06.691065] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:47:06.857864] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-15T19:47:07.508162] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T19:47:07.657863] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-15T19:47:08.457871] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-15T19:47:08.624233] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T19:47:08.968456] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T19:47:08.969574] [INFO ] [REMOTE ] OCFT: Full fetch complete (10364 records). [2025-09-15T19:47:08.969674] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-15T19:47:09.263001] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-15T19:47:09.336194] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-15T19:47:09.336280] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-15T19:47:09.336611] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-15T19:47:09.336696] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-15T19:47:09.337238] [DEBUG] [LOCAL ] OCFT: Trimmed 10364 records to 5759 (keeping 150 days of data) [2025-09-15T19:47:09.372563] [DEBUG] [LOCAL ] OCFT: Primary data saved (5759 records). [2025-09-15T19:47:09.372781] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-15T19:47:09.372879] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. OCFT took 15.1s. Estimated remaining: 1h 24m 14s. Rate: 9.4 symbols/min [2025-09-15T19:47:09.547114] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:09.563437] [DEBUG] [LOCAL ] OFG: Loaded 15623 existing records from primary storage. [2025-09-15T19:47:09.563624] [INFO ] [MAIN ] OFG: Loaded 15623 existing records. [2025-09-15T19:47:09.756787] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:09.757458] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-15T19:47:09.757518] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-15T19:47:09.758212] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-15T19:47:09.758265] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-15T19:47:10.062956] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-15T19:47:10.134681] [INFO ] [REMOTE ] OFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:10.140970] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:47:10.857873] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-15T19:47:11.389793] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T19:47:11.657843] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-15T19:47:11.806010] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T19:47:12.371634] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T19:47:12.457856] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-15T19:47:13.229731] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T19:47:13.257832] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-15T19:47:14.033616] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T19:47:14.057821] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-15T19:47:14.788440] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:47:14.857828] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-15T19:47:15.657870] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-15T19:47:15.681764] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:47:15.683310] [INFO ] [REMOTE ] ODC: Full fetch complete (8805 records). [2025-09-15T19:47:15.683385] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-15T19:47:16.041281] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-15T19:47:16.041363] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-15T19:47:16.041599] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-15T19:47:16.041656] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-15T19:47:16.042099] [DEBUG] [LOCAL ] ODC: Trimmed 8805 records to 6421 (keeping 150 days of data) [2025-09-15T19:47:16.085800] [DEBUG] [LOCAL ] ODC: Primary data saved (6421 records). [2025-09-15T19:47:16.085971] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-15T19:47:16.086066] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. ODC took 20.3s. Estimated remaining: 1h 24m 8s. Rate: 9.4 symbols/min [2025-09-15T19:47:16.256897] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:16.291181] [DEBUG] [LOCAL ] OGE: Loaded 34641 existing records from primary storage. [2025-09-15T19:47:16.291344] [INFO ] [MAIN ] OGE: Loaded 34641 existing records. [2025-09-15T19:47:16.463697] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-15T19:47:16.469166] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:16.469416] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-15T19:47:16.469501] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-15T19:47:16.470274] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-15T19:47:16.470327] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-15T19:47:16.823040] [INFO ] [REMOTE ] OGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:17.112064] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T19:47:17.130905] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T19:47:17.257880] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-15T19:47:18.057882] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-15T19:47:18.530942] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T19:47:18.857912] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-15T19:47:19.476625] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T19:47:19.534858] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T19:47:19.657892] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-15T19:47:20.457911] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-15T19:47:20.799524] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T19:47:21.257945] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-15T19:47:21.825019] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:47:22.057865] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-15T19:47:22.080891] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:47:22.857790] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-15T19:47:23.324608] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:47:23.657867] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-15T19:47:24.275623] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:47:24.457948] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-15T19:47:24.992765] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:47:25.257954] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-15T19:47:25.807071] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:47:26.057972] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-15T19:47:26.354292] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:47:26.857891] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-15T19:47:27.657885] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-15T19:47:27.719680] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T19:47:28.311139] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:47:28.457957] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-15T19:47:28.790988] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T19:47:29.257907] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-15T19:47:29.673908] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:47:30.057904] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-15T19:47:30.266435] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T19:47:30.857914] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-15T19:47:30.923934] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:47:31.657952] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-15T19:47:31.757241] [DEBUG] [REMOTE ] OEC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-15T19:47:31.757576] [WARN ] [REMOTE ] OEC: No data returned for month 2025-09 [2025-09-15T19:47:31.757718] [INFO ] [REMOTE ] OEC: Full fetch complete (38144 records). [2025-09-15T19:47:31.757805] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-15T19:47:31.758777] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T19:47:31.758875] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:47:31.758941] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:47:31.759006] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-15T19:47:31.759088] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-09-15T19:47:31.759134] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-09-15T19:47:31.759471] [DEBUG] [LOCAL ] OEC: Deleted derivative data file. [2025-09-15T19:47:31.759573] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. OEC took 26.5s. Estimated remaining: 1h 24m 7s. Rate: 9.4 symbols/min [2025-09-15T19:47:31.936600] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:31.975730] [DEBUG] [LOCAL ] OGN: Loaded 39992 existing records from primary storage. [2025-09-15T19:47:31.975886] [INFO ] [MAIN ] OGN: Loaded 39992 existing records. [2025-09-15T19:47:32.157232] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:32.157526] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-15T19:47:32.157580] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-15T19:47:32.158522] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-15T19:47:32.158572] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-15T19:47:32.462451] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-15T19:47:32.519981] [INFO ] [REMOTE ] OGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:32.549318] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:47:33.257875] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-15T19:47:33.711839] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:47:33.716891] [INFO ] [REMOTE ] ODV: Full fetch complete (25506 records). [2025-09-15T19:47:33.717049] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-15T19:47:34.059134] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-15T19:47:34.105189] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-15T19:47:34.105284] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-15T19:47:34.105921] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-15T19:47:34.105971] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-15T19:47:34.106857] [DEBUG] [LOCAL ] ODV: Trimmed 25506 records to 19786 (keeping 150 days of data) [2025-09-15T19:47:34.229466] [DEBUG] [LOCAL ] ODV: Primary data saved (19786 records). [2025-09-15T19:47:34.229634] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-15T19:47:34.229771] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. ODV took 29.9s. Estimated remaining: 1h 23m 58s. Rate: 9.4 symbols/min [2025-09-15T19:47:34.409403] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:34.435780] [DEBUG] [LOCAL ] OGS: Loaded 26261 existing records from primary storage. [2025-09-15T19:47:34.435964] [INFO ] [MAIN ] OGS: Loaded 26261 existing records. [2025-09-15T19:47:34.623999] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:34.624591] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-15T19:47:34.624683] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-15T19:47:34.625356] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-15T19:47:34.625410] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-15T19:47:34.858949] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-15T19:47:35.003375] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T19:47:35.035084] [INFO ] [REMOTE ] OGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:35.315617] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:47:35.658004] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-15T19:47:35.959917] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T19:47:36.457917] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-15T19:47:37.240279] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:47:37.257846] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-15T19:47:37.687827] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:47:38.057868] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-15T19:47:38.863021] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-15T19:47:38.885676] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:47:39.544078] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T19:47:39.546701] [INFO ] [REMOTE ] OFG: Full fetch complete (25121 records). [2025-09-15T19:47:39.546843] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-15T19:47:39.672708] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-15T19:47:39.682979] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T19:47:39.993788] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-15T19:47:39.993875] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-15T19:47:39.994463] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-15T19:47:39.994522] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-15T19:47:39.995155] [DEBUG] [LOCAL ] OFG: Trimmed 25121 records to 15190 (keeping 150 days of data) [2025-09-15T19:47:40.089294] [DEBUG] [LOCAL ] OFG: Primary data saved (15190 records). [2025-09-15T19:47:40.089445] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-15T19:47:40.089529] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OFG took 30.7s. Estimated remaining: 1h 23m 52s. Rate: 9.4 symbols/min [2025-09-15T19:47:40.259500] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:40.306578] [DEBUG] [LOCAL ] OHI: Loaded 39212 existing records from primary storage. [2025-09-15T19:47:40.306842] [INFO ] [MAIN ] OHI: Loaded 39212 existing records. [2025-09-15T19:47:40.465082] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-15T19:47:40.489872] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:40.490279] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-15T19:47:40.490396] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-15T19:47:40.491342] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-15T19:47:40.491399] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-15T19:47:40.859364] [INFO ] [REMOTE ] OHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:41.257901] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-15T19:47:41.648413] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-15T19:47:41.715307] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T19:47:42.057934] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-15T19:47:42.453944] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:47:42.459789] [INFO ] [REMOTE ] OGE: Full fetch complete (50687 records). [2025-09-15T19:47:42.459985] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-15T19:47:42.866962] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-15T19:47:42.887905] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-15T19:47:42.888037] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-15T19:47:42.888955] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-15T19:47:42.889005] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-15T19:47:42.890269] [DEBUG] [LOCAL ] OGE: Trimmed 50687 records to 34067 (keeping 150 days of data) [2025-09-15T19:47:43.103583] [DEBUG] [LOCAL ] OGE: Primary data saved (34067 records). [2025-09-15T19:47:43.103755] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-15T19:47:43.104258] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OGE took 27.0s. Estimated remaining: 1h 23m 44s. Rate: 9.4 symbols/min [2025-09-15T19:47:43.275399] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:43.313789] [DEBUG] [LOCAL ] OI: Loaded 35376 existing records from primary storage. [2025-09-15T19:47:43.313949] [INFO ] [MAIN ] OI: Loaded 35376 existing records. [2025-09-15T19:47:43.497736] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:43.498187] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-15T19:47:43.498254] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-15T19:47:43.499251] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-15T19:47:43.499309] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-15T19:47:43.668900] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-15T19:47:43.720110] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:47:43.931234] [INFO ] [REMOTE ] OI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:44.165303] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T19:47:44.457882] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-15T19:47:45.257866] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-15T19:47:45.299489] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:47:45.944392] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T19:47:46.057963] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-15T19:47:46.756087] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:47:46.857880] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-15T19:47:47.523321] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:47:47.657938] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-15T19:47:48.457944] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-15T19:47:48.774757] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T19:47:48.855456] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T19:47:49.257905] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-15T19:47:50.057932] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-15T19:47:50.238666] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:47:50.857932] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-15T19:47:50.952931] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:47:51.600269] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:47:51.657869] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-15T19:47:52.457891] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-15T19:47:52.512151] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T19:47:52.521017] [INFO ] [REMOTE ] OGN: Full fetch complete (57760 records). [2025-09-15T19:47:52.521216] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-15T19:47:52.898272] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-15T19:47:52.898357] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-15T19:47:52.899290] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-15T19:47:52.899337] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-15T19:47:52.900532] [DEBUG] [LOCAL ] OGN: Trimmed 57760 records to 39217 (keeping 150 days of data) [2025-09-15T19:47:53.171765] [DEBUG] [LOCAL ] OGN: Primary data saved (39217 records). [2025-09-15T19:47:53.171983] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-15T19:47:53.172094] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OGN took 21.4s. Estimated remaining: 1h 23m 39s. Rate: 9.4 symbols/min [2025-09-15T19:47:53.269050] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-15T19:47:53.369414] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:47:53.381210] [DEBUG] [LOCAL ] OIA: Loaded 9906 existing records from primary storage. [2025-09-15T19:47:53.381345] [INFO ] [MAIN ] OIA: Loaded 9906 existing records. [2025-09-15T19:47:53.602321] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:47:53.602940] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-15T19:47:53.603000] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-15T19:47:53.603450] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-15T19:47:53.603524] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-15T19:47:53.760619] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T19:47:54.046763] [INFO ] [REMOTE ] OIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:47:54.058708] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-15T19:47:54.073824] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:47:54.587380] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:47:54.857909] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-15T19:47:55.657960] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-15T19:47:55.738608] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T19:47:55.764211] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T19:47:56.457879] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-15T19:47:57.200250] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T19:47:57.257907] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-15T19:47:57.971092] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T19:47:58.057867] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-15T19:47:58.857879] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-15T19:47:58.952812] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:47:59.158502] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:47:59.657936] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-15T19:48:00.321426] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:48:00.457877] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-15T19:48:00.862364] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T19:48:01.240371] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:48:01.257836] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-15T19:48:02.057875] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-15T19:48:02.857886] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-15T19:48:03.011436] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T19:48:03.657869] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-15T19:48:04.457934] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-15T19:48:05.365486] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:48:05.373216] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-15T19:48:05.508411] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (3.45 seconds). [2025-09-15T19:48:05.518463] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T19:48:05.565412] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-15T19:48:05.571380] [INFO ] [REMOTE ] OHI: Full fetch complete (56688 records). [2025-09-15T19:48:05.571482] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-15T19:48:06.006168] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-15T19:48:06.006280] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-15T19:48:06.007326] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-15T19:48:06.007397] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-15T19:48:06.008910] [DEBUG] [LOCAL ] OHI: Trimmed 56688 records to 38444 (keeping 150 days of data) [2025-09-15T19:48:06.067280] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-15T19:48:06.276450] [DEBUG] [LOCAL ] OHI: Primary data saved (38444 records). [2025-09-15T19:48:06.276608] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-15T19:48:06.277947] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OHI took 26.2s. Estimated remaining: 1h 23m 36s. Rate: 9.4 symbols/min [2025-09-15T19:48:06.477735] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:06.492351] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:48:06.496544] [INFO ] [REMOTE ] OGS: Full fetch complete (37037 records). [2025-09-15T19:48:06.496665] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-15T19:48:06.696353] [DEBUG] [LOCAL ] OII: Loaded 31748 existing records from primary storage. [2025-09-15T19:48:06.709277] [INFO ] [MAIN ] OII: Loaded 31748 existing records. [2025-09-15T19:48:06.868057] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-15T19:48:07.099280] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:07.099677] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-15T19:48:07.099747] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-15T19:48:07.107340] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-15T19:48:07.109368] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-15T19:48:07.109464] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-15T19:48:07.143735] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-15T19:48:07.170246] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-15T19:48:07.179141] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-15T19:48:07.242568] [DEBUG] [LOCAL ] OGS: Trimmed 37037 records to 25749 (keeping 150 days of data) [2025-09-15T19:48:07.604672] [INFO ] [REMOTE ] OII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:07.641337] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:48:07.647295] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:48:07.653464] [INFO ] [REMOTE ] OI: Full fetch complete (51367 records). [2025-09-15T19:48:07.654142] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-15T19:48:07.658190] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-15T19:48:07.797176] [DEBUG] [LOCAL ] OGS: Primary data saved (25749 records). [2025-09-15T19:48:07.797375] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-15T19:48:07.797540] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OGS took 33.6s. Estimated remaining: 1h 23m 27s. Rate: 9.4 symbols/min [2025-09-15T19:48:08.167720] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:08.265447] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-15T19:48:08.265609] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-15T19:48:08.266921] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-15T19:48:08.275179] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-15T19:48:08.278459] [DEBUG] [LOCAL ] OI: Trimmed 51367 records to 34667 (keeping 150 days of data) [2025-09-15T19:48:08.289623] [DEBUG] [LOCAL ] OIS: Loaded 30281 existing records from primary storage. [2025-09-15T19:48:08.289809] [INFO ] [MAIN ] OIS: Loaded 30281 existing records. [2025-09-15T19:48:08.465313] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-15T19:48:08.589995] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:08.592868] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-15T19:48:08.592918] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-15T19:48:08.629913] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-15T19:48:08.630058] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-15T19:48:08.970103] [DEBUG] [LOCAL ] OI: Primary data saved (34667 records). [2025-09-15T19:48:08.980747] [INFO ] [MAIN ] OI: Full history saved. [2025-09-15T19:48:08.981473] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OI took 25.9s. Estimated remaining: 1h 23m 18s. Rate: 9.4 symbols/min [2025-09-15T19:48:09.108521] [INFO ] [REMOTE ] OIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:09.230832] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:09.260677] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-15T19:48:09.303075] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:48:09.319733] [DEBUG] [LOCAL ] OKE: Loaded 40329 existing records from primary storage. [2025-09-15T19:48:09.320101] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T19:48:09.320355] [INFO ] [MAIN ] OKE: Loaded 40329 existing records. [2025-09-15T19:48:09.498938] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:09.499202] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-15T19:48:09.499249] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-15T19:48:09.500331] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-15T19:48:09.500384] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-15T19:48:09.855452] [INFO ] [REMOTE ] OKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:10.057875] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-15T19:48:10.629707] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:48:10.857891] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-15T19:48:11.589135] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:48:11.657865] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-15T19:48:11.679839] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:48:12.457924] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-15T19:48:13.177352] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:48:13.257910] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-15T19:48:14.057936] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-15T19:48:14.429091] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T19:48:14.857877] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-15T19:48:15.211576] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T19:48:15.213699] [INFO ] [REMOTE ] OIA: Full fetch complete (15034 records). [2025-09-15T19:48:15.213791] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-15T19:48:15.612479] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-15T19:48:15.612611] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-15T19:48:15.613173] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-15T19:48:15.613226] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-15T19:48:15.614288] [DEBUG] [LOCAL ] OIA: Trimmed 15034 records to 9824 (keeping 150 days of data) [2025-09-15T19:48:15.660608] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-15T19:48:15.678289] [DEBUG] [LOCAL ] OIA: Primary data saved (9824 records). [2025-09-15T19:48:15.678417] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-15T19:48:15.678527] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OIA took 22.5s. Estimated remaining: 1h 23m 12s. Rate: 9.4 symbols/min [2025-09-15T19:48:15.869905] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:15.914340] [DEBUG] [LOCAL ] OKLO: Loaded 40559 existing records from primary storage. [2025-09-15T19:48:15.914535] [INFO ] [MAIN ] OKLO: Loaded 40559 existing records. [2025-09-15T19:48:16.097837] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:16.098143] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-15T19:48:16.098206] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-15T19:48:16.099079] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-15T19:48:16.099134] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-15T19:48:16.465797] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:16.466387] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-15T19:48:16.501117] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-15T19:48:16.543617] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:48:17.107551] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:48:17.257857] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-15T19:48:18.057922] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-15T19:48:18.708021] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T19:48:18.810212] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-15T19:48:18.857836] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-15T19:48:19.073072] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T19:48:19.657878] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-15T19:48:20.457921] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-15T19:48:21.091132] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:48:21.257844] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-15T19:48:21.539820] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-15T19:48:21.584944] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T19:48:22.057884] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-15T19:48:22.751133] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:48:22.857826] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-15T19:48:23.377085] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:48:23.657922] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-15T19:48:24.402635] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:48:24.457868] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-15T19:48:25.257939] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-15T19:48:26.057892] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-15T19:48:26.315837] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-15T19:48:26.770456] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-15T19:48:26.775884] [INFO ] [REMOTE ] OII: Full fetch complete (47053 records). [2025-09-15T19:48:26.776078] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-15T19:48:26.863101] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-15T19:48:27.195962] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-15T19:48:27.196066] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-15T19:48:27.196927] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-15T19:48:27.196986] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-15T19:48:27.198172] [DEBUG] [LOCAL ] OII: Trimmed 47053 records to 31144 (keeping 150 days of data) [2025-09-15T19:48:27.397738] [DEBUG] [LOCAL ] OII: Primary data saved (31144 records). [2025-09-15T19:48:27.397923] [INFO ] [MAIN ] OII: Full history saved. [2025-09-15T19:48:27.398029] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OII took 21.1s. Estimated remaining: 1h 23m 8s. Rate: 9.4 symbols/min [2025-09-15T19:48:27.583014] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:27.583299] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-09-15T19:48:27.583341] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-09-15T19:48:27.583484] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-15T19:48:27.583526] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-15T19:48:27.583577] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-09-15T19:48:27.583620] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-15T19:48:27.969484] [INFO ] [REMOTE ] OLN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:27.970012] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-15T19:48:28.006074] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T19:48:28.457950] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-15T19:48:28.702242] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T19:48:29.071906] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (3.81 seconds). [2025-09-15T19:48:29.257860] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-15T19:48:29.649094] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T19:48:29.691026] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T19:48:29.694935] [INFO ] [REMOTE ] OIS: Full fetch complete (44443 records). [2025-09-15T19:48:29.695061] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-15T19:48:30.066208] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-15T19:48:30.070500] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-15T19:48:30.070665] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-15T19:48:30.072598] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-15T19:48:30.072781] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-15T19:48:30.074222] [DEBUG] [LOCAL ] OIS: Trimmed 44443 records to 29521 (keeping 150 days of data) [2025-09-15T19:48:30.258110] [DEBUG] [LOCAL ] OIS: Primary data saved (29521 records). [2025-09-15T19:48:30.258265] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-15T19:48:30.258363] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OIS took 22.5s. Estimated remaining: 1h 23m 0s. Rate: 9.4 symbols/min [2025-09-15T19:48:30.427575] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:30.436129] [DEBUG] [LOCAL ] OLP: Loaded 6945 existing records from primary storage. [2025-09-15T19:48:30.436249] [INFO ] [MAIN ] OLP: Loaded 6945 existing records. [2025-09-15T19:48:30.610289] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:30.610587] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-15T19:48:30.610637] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-15T19:48:30.611069] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-15T19:48:30.611117] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-15T19:48:30.862873] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-15T19:48:30.971219] [INFO ] [REMOTE ] OLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:31.067992] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T19:48:31.657928] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-15T19:48:32.296157] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T19:48:32.367246] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T19:48:32.457886] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-15T19:48:32.511461] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T19:48:33.257905] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-15T19:48:33.853605] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:48:34.057935] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-15T19:48:34.857889] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-15T19:48:34.980450] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T19:48:35.657903] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-15T19:48:35.779809] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T19:48:35.811537] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:48:36.457870] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-15T19:48:37.210371] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:48:37.257886] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-15T19:48:37.312586] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:48:38.057889] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-15T19:48:38.789841] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T19:48:38.857857] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-15T19:48:39.261617] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-15T19:48:39.267673] [INFO ] [REMOTE ] OKE: Full fetch complete (58215 records). [2025-09-15T19:48:39.267821] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-15T19:48:39.663037] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-15T19:48:39.714562] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-15T19:48:39.714694] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-15T19:48:39.716256] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-15T19:48:39.716309] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-15T19:48:39.718072] [DEBUG] [LOCAL ] OKE: Trimmed 58215 records to 39550 (keeping 150 days of data) [2025-09-15T19:48:39.993093] [DEBUG] [LOCAL ] OKE: Primary data saved (39550 records). [2025-09-15T19:48:39.993361] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-15T19:48:39.994620] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OKE took 31.0s. Estimated remaining: 1h 22m 56s. Rate: 9.4 symbols/min [2025-09-15T19:48:40.175269] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:40.225316] [DEBUG] [LOCAL ] OMC: Loaded 40064 existing records from primary storage. [2025-09-15T19:48:40.225532] [INFO ] [MAIN ] OMC: Loaded 40064 existing records. [2025-09-15T19:48:40.426458] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:40.426843] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-15T19:48:40.426912] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-15T19:48:40.428112] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-15T19:48:40.428183] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-15T19:48:40.463035] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-15T19:48:40.771037] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:48:40.844560] [INFO ] [REMOTE ] OMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:41.238922] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:48:41.257861] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-15T19:48:41.918849] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T19:48:42.072286] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-15T19:48:42.122967] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-15T19:48:42.857880] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-15T19:48:43.494003] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T19:48:43.611010] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T19:48:43.657841] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-15T19:48:44.449404] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T19:48:44.451196] [INFO ] [REMOTE ] OLP: Full fetch complete (10294 records). [2025-09-15T19:48:44.451291] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-15T19:48:44.463271] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-15T19:48:44.822699] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-15T19:48:44.822779] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-15T19:48:44.823019] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-15T19:48:44.823058] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-15T19:48:44.823485] [DEBUG] [LOCAL ] OLP: Trimmed 10294 records to 6858 (keeping 150 days of data) [2025-09-15T19:48:44.864501] [DEBUG] [LOCAL ] OLP: Primary data saved (6858 records). [2025-09-15T19:48:44.864598] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-15T19:48:44.864719] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OLP took 14.6s. Estimated remaining: 1h 22m 48s. Rate: 9.4 symbols/min [2025-09-15T19:48:45.035506] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:45.073034] [DEBUG] [LOCAL ] OMF: Loaded 34325 existing records from primary storage. [2025-09-15T19:48:45.073175] [INFO ] [MAIN ] OMF: Loaded 34325 existing records. [2025-09-15T19:48:45.251696] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:45.251979] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-15T19:48:45.252029] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-15T19:48:45.252861] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-15T19:48:45.252916] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-15T19:48:45.264231] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-15T19:48:45.633298] [INFO ] [REMOTE ] OMF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:46.057947] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-15T19:48:46.243227] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T19:48:46.857847] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-15T19:48:46.897596] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:48:47.494587] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:48:47.657891] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-15T19:48:48.457917] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-15T19:48:48.621056] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:48:49.257879] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-15T19:48:49.348374] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:48:50.057895] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-15T19:48:50.763793] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T19:48:50.857833] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-15T19:48:50.903337] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T19:48:51.364831] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:48:51.657889] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-15T19:48:52.381968] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:48:52.457927] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-15T19:48:53.257852] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-15T19:48:53.387240] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T19:48:54.057957] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-15T19:48:54.858034] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-15T19:48:55.083267] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-15T19:48:55.240427] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-15T19:48:55.246939] [INFO ] [REMOTE ] OLN: Full fetch complete (56076 records). [2025-09-15T19:48:55.247110] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-15T19:48:55.654920] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-15T19:48:55.655049] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-15T19:48:55.656500] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-15T19:48:55.656614] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-15T19:48:55.657984] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-15T19:48:55.660245] [DEBUG] [LOCAL ] OLN: Trimmed 56076 records to 38332 (keeping 150 days of data) [2025-09-15T19:48:55.796596] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T19:48:55.968610] [DEBUG] [LOCAL ] OLN: Primary data saved (38332 records). [2025-09-15T19:48:55.968862] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-15T19:48:55.968987] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OLN took 28.6s. Estimated remaining: 1h 22m 44s. Rate: 9.4 symbols/min [2025-09-15T19:48:56.146694] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:56.181611] [DEBUG] [LOCAL ] OMI: Loaded 34185 existing records from primary storage. [2025-09-15T19:48:56.181883] [INFO ] [MAIN ] OMI: Loaded 34185 existing records. [2025-09-15T19:48:56.373669] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:56.374314] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-15T19:48:56.374373] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-15T19:48:56.375293] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-15T19:48:56.375354] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-15T19:48:56.466890] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-15T19:48:56.718484] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T19:48:56.793196] [INFO ] [REMOTE ] OMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:48:57.257868] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-15T19:48:58.057914] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-15T19:48:58.257595] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-15T19:48:58.264602] [INFO ] [REMOTE ] OKLO: Full fetch complete (58499 records). [2025-09-15T19:48:58.265005] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-15T19:48:58.424405] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T19:48:58.731528] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-15T19:48:58.731671] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-15T19:48:58.732924] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-15T19:48:58.732998] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-15T19:48:58.762344] [DEBUG] [LOCAL ] OKLO: Trimmed 58499 records to 39779 (keeping 150 days of data) [2025-09-15T19:48:58.764237] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T19:48:58.873014] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-15T19:48:59.057111] [DEBUG] [LOCAL ] OKLO: Primary data saved (39779 records). [2025-09-15T19:48:59.057496] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-15T19:48:59.057686] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. OKLO took 43.4s. Estimated remaining: 1h 22m 36s. Rate: 9.4 symbols/min [2025-09-15T19:48:59.242862] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:48:59.276838] [DEBUG] [LOCAL ] ONIT: Loaded 5818 existing records from primary storage. [2025-09-15T19:48:59.277861] [INFO ] [MAIN ] ONIT: Loaded 5818 existing records. [2025-09-15T19:48:59.312436] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T19:48:59.478522] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:48:59.478929] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-15T19:48:59.478983] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-15T19:48:59.479357] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-15T19:48:59.479410] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-15T19:48:59.667751] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-15T19:48:59.877205] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:00.457937] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-15T19:49:00.618223] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T19:49:01.257913] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-15T19:49:01.575890] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T19:49:02.057930] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-15T19:49:02.083700] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:49:02.089961] [INFO ] [REMOTE ] OMC: Full fetch complete (57932 records). [2025-09-15T19:49:02.090124] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-15T19:49:02.474070] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-15T19:49:02.478632] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-15T19:49:02.480328] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-15T19:49:02.480391] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-15T19:49:02.482561] [DEBUG] [LOCAL ] OMC: Trimmed 57932 records to 39281 (keeping 150 days of data) [2025-09-15T19:49:02.752683] [DEBUG] [LOCAL ] OMC: Primary data saved (39281 records). [2025-09-15T19:49:02.753131] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-15T19:49:02.766814] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. OMC took 22.8s. Estimated remaining: 1h 22m 29s. Rate: 9.4 symbols/min [2025-09-15T19:49:02.859082] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-15T19:49:02.886485] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:49:02.982956] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:03.011656] [DEBUG] [LOCAL ] ONL: Loaded 22844 existing records from primary storage. [2025-09-15T19:49:03.011866] [INFO ] [MAIN ] ONL: Loaded 22844 existing records. [2025-09-15T19:49:03.192879] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:03.193238] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-15T19:49:03.193291] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-15T19:49:03.194144] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-15T19:49:03.194217] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-15T19:49:03.592486] [INFO ] [REMOTE ] ONL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:03.600579] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T19:49:03.629940] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:49:03.657829] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-15T19:49:04.457884] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-15T19:49:05.175163] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T19:49:05.204115] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:49:05.257821] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-15T19:49:06.032632] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T19:49:06.057878] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-15T19:49:06.710046] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T19:49:06.857903] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-15T19:49:07.591330] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T19:49:07.657856] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-15T19:49:08.458864] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-15T19:49:08.461536] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:49:09.257896] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-15T19:49:10.001511] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:49:10.006369] [INFO ] [REMOTE ] OMF: Full fetch complete (50228 records). [2025-09-15T19:49:10.006470] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-15T19:49:10.066213] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-15T19:49:10.424261] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-15T19:49:10.424461] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-15T19:49:10.425664] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-15T19:49:10.425789] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-15T19:49:10.427285] [DEBUG] [LOCAL ] OMF: Trimmed 50228 records to 33661 (keeping 150 days of data) [2025-09-15T19:49:10.553182] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:49:10.676989] [DEBUG] [LOCAL ] OMF: Primary data saved (33661 records). [2025-09-15T19:49:10.677147] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-15T19:49:10.677249] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. OMF took 25.8s. Estimated remaining: 1h 22m 23s. Rate: 9.4 symbols/min [2025-09-15T19:49:10.845283] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:49:10.863465] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-15T19:49:10.863402] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:10.867204] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-09-15T19:49:10.867261] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-09-15T19:49:10.867385] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-15T19:49:10.867425] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-15T19:49:10.867468] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-09-15T19:49:10.867502] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-15T19:49:11.222509] [INFO ] [REMOTE ] ONON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:11.657845] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-15T19:49:11.821363] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T19:49:12.223738] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:49:12.225265] [INFO ] [REMOTE ] ONIT: Full fetch complete (8545 records). [2025-09-15T19:49:12.225342] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-15T19:49:12.468046] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-15T19:49:12.604978] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-15T19:49:12.605079] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-15T19:49:12.605324] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-15T19:49:12.605365] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-15T19:49:12.605831] [DEBUG] [LOCAL ] ONIT: Trimmed 8545 records to 5740 (keeping 150 days of data) [2025-09-15T19:49:12.640109] [DEBUG] [LOCAL ] ONIT: Primary data saved (5740 records). [2025-09-15T19:49:12.640223] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-15T19:49:12.640328] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. ONIT took 13.6s. Estimated remaining: 1h 22m 15s. Rate: 9.4 symbols/min [2025-09-15T19:49:12.823986] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:12.824213] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-09-15T19:49:12.824255] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-09-15T19:49:12.824373] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-15T19:49:12.824411] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-15T19:49:12.824450] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-09-15T19:49:12.824490] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-15T19:49:13.183288] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:13.257836] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-15T19:49:13.761088] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T19:49:13.976808] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T19:49:14.057872] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-15T19:49:14.857847] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-15T19:49:15.150897] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:49:15.657890] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-15T19:49:16.465614] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-15T19:49:16.468012] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:49:17.257933] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-15T19:49:17.574243] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T19:49:17.636926] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:49:18.057870] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-15T19:49:18.818827] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T19:49:18.857885] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-15T19:49:19.083843] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T19:49:19.657906] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-15T19:49:20.239319] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:49:20.245013] [INFO ] [REMOTE ] OMI: Full fetch complete (50076 records). [2025-09-15T19:49:20.245163] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-15T19:49:20.464833] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-15T19:49:20.623778] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-15T19:49:20.623868] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-15T19:49:20.624833] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-15T19:49:20.624883] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-15T19:49:20.626098] [DEBUG] [LOCAL ] OMI: Trimmed 50076 records to 33471 (keeping 150 days of data) [2025-09-15T19:49:20.831742] [DEBUG] [LOCAL ] OMI: Primary data saved (33471 records). [2025-09-15T19:49:20.831917] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-15T19:49:20.832029] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. OMI took 24.9s. Estimated remaining: 1h 22m 9s. Rate: 9.4 symbols/min [2025-09-15T19:49:21.000276] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:21.035500] [DEBUG] [LOCAL ] ONTO: Loaded 35192 existing records from primary storage. [2025-09-15T19:49:21.035684] [INFO ] [MAIN ] ONTO: Loaded 35192 existing records. [2025-09-15T19:49:21.210816] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:21.211035] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-15T19:49:21.211080] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-15T19:49:21.211860] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-15T19:49:21.211911] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-15T19:49:21.274935] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-15T19:49:21.572096] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:21.617213] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:49:21.745670] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:49:22.057865] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-15T19:49:22.498404] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T19:49:22.857873] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-15T19:49:23.657898] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-15T19:49:24.087775] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T19:49:24.118566] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:49:24.457896] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-15T19:49:25.063918] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:49:25.257930] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-15T19:49:25.960038] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:49:26.057931] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-15T19:49:26.117799] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:49:26.857932] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-15T19:49:27.488897] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:49:27.616367] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T19:49:27.657910] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-15T19:49:28.457905] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-15T19:49:28.806365] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:49:29.257916] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-15T19:49:29.526774] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:49:29.530051] [INFO ] [REMOTE ] ONL: Full fetch complete (34044 records). [2025-09-15T19:49:29.530178] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-15T19:49:29.921711] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-15T19:49:29.921831] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-15T19:49:29.922923] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-15T19:49:29.922976] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-15T19:49:29.924060] [DEBUG] [LOCAL ] ONL: Trimmed 34044 records to 22091 (keeping 150 days of data) [2025-09-15T19:49:30.062432] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-15T19:49:30.076705] [DEBUG] [LOCAL ] ONL: Primary data saved (22091 records). [2025-09-15T19:49:30.076903] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-15T19:49:30.077019] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. ONL took 27.3s. Estimated remaining: 1h 22m 4s. Rate: 9.4 symbols/min [2025-09-15T19:49:30.264315] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:30.281252] [DEBUG] [LOCAL ] OOMA: Loaded 13939 existing records from primary storage. [2025-09-15T19:49:30.281446] [INFO ] [MAIN ] OOMA: Loaded 13939 existing records. [2025-09-15T19:49:30.466542] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:30.466864] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-15T19:49:30.466915] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-15T19:49:30.467346] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-15T19:49:30.467398] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-15T19:49:30.832796] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:30.857824] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-15T19:49:30.892096] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:49:31.189676] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:49:31.657983] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-15T19:49:31.816845] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T19:49:32.457952] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-15T19:49:33.257902] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-15T19:49:33.396976] [DEBUG] [REMOTE ] OOMA: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-15T19:49:33.397312] [WARN ] [REMOTE ] OOMA: No data returned for month 2025-03 [2025-09-15T19:49:33.489753] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:49:33.493022] [INFO ] [REMOTE ] ONTF: Full fetch complete (24577 records). [2025-09-15T19:49:33.493152] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-15T19:49:33.942354] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T19:49:33.958200] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-15T19:49:33.959084] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-15T19:49:33.960192] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-15T19:49:33.960442] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-15T19:49:33.962264] [DEBUG] [LOCAL ] ONTF: Trimmed 24577 records to 17112 (keeping 150 days of data) [2025-09-15T19:49:34.062020] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-15T19:49:34.071971] [DEBUG] [LOCAL ] ONTF: Primary data saved (17112 records). [2025-09-15T19:49:34.072350] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-15T19:49:34.072456] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. ONTF took 21.4s. Estimated remaining: 1h 21m 57s. Rate: 9.4 symbols/min [2025-09-15T19:49:34.857927] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-15T19:49:35.073411] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T19:49:35.657939] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-15T19:49:36.457999] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-15T19:49:36.493795] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:49:36.514913] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:49:37.257888] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-15T19:49:38.057903] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-15T19:49:38.306242] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T19:49:38.331467] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:49:38.857922] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-15T19:49:39.328181] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:49:39.538468] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T19:49:39.657928] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-15T19:49:40.457992] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-15T19:49:40.549281] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:49:41.257901] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-15T19:49:42.057900] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-15T19:49:42.139095] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T19:49:42.167994] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T19:49:42.170705] [INFO ] [REMOTE ] OOMA: Full fetch complete (17360 records). [2025-09-15T19:49:42.170777] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-15T19:49:42.352335] [WARN ] [VALIDATOR ] OOMA: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T19:49:42.352714] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:49:42.352764] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:49:42.352818] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-15T19:49:42.352876] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-09-15T19:49:42.352923] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-09-15T19:49:42.353283] [DEBUG] [LOCAL ] OOMA: Deleted derivative data file. [2025-09-15T19:49:42.353385] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. OOMA took 12.3s. Estimated remaining: 1h 21m 51s. Rate: 9.4 symbols/min [2025-09-15T19:49:42.857887] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-15T19:49:44.088527] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T19:49:44.100083] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-15T19:49:44.320240] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:49:44.457899] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-15T19:49:45.879765] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:49:45.891231] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-15T19:49:46.079921] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T19:49:46.085279] [INFO ] [REMOTE ] ONTO: Full fetch complete (50423 records). [2025-09-15T19:49:46.085433] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-15T19:49:46.466666] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-15T19:49:46.466778] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-15T19:49:46.467601] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-15T19:49:46.467668] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-15T19:49:46.468740] [DEBUG] [LOCAL ] ONTO: Trimmed 50423 records to 34701 (keeping 150 days of data) [2025-09-15T19:49:46.682234] [DEBUG] [LOCAL ] ONTO: Primary data saved (34701 records). [2025-09-15T19:49:46.682381] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-15T19:49:46.683164] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. ONTO took 25.9s. Estimated remaining: 1h 21m 44s. Rate: 9.4 symbols/min [2025-09-15T19:49:47.769551] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T19:49:47.775492] [INFO ] [REMOTE ] ONON: Full fetch complete (58293 records). [2025-09-15T19:49:47.775597] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-15T19:49:48.153890] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-15T19:49:48.153970] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-15T19:49:48.154910] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-15T19:49:48.154967] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-15T19:49:48.156358] [DEBUG] [LOCAL ] ONON: Trimmed 58293 records to 39581 (keeping 150 days of data) [2025-09-15T19:49:48.402565] [DEBUG] [LOCAL ] ONON: Primary data saved (39581 records). [2025-09-15T19:49:48.402764] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-15T19:49:48.402870] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. ONON took 37.7s. Estimated remaining: 1h 21m 35s. Rate: 9.4 symbols/min [2025-09-15T19:49:49.064097] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:49.139174] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:49.135402] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:49.142901] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-15T19:49:49.142729] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:49:49.144215] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-15T19:49:49.145258] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-15T19:49:49.145307] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-15T19:49:49.145672] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-15T19:49:49.145744] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-15T19:49:49.250841] [DEBUG] [LOCAL ] OPP: Loaded 8746 existing records from primary storage. [2025-09-15T19:49:49.256829] [INFO ] [MAIN ] OPP: Loaded 8746 existing records. [2025-09-15T19:49:49.348025] [DEBUG] [LOCAL ] OPAD: Loaded 16216 existing records from primary storage. [2025-09-15T19:49:49.399982] [INFO ] [MAIN ] OPAD: Loaded 16216 existing records. [2025-09-15T19:49:49.479094] [DEBUG] [LOCAL ] OPFI: Loaded 34815 existing records from primary storage. [2025-09-15T19:49:49.510142] [INFO ] [MAIN ] OPFI: Loaded 34815 existing records. [2025-09-15T19:49:49.929138] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:50.097734] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-15T19:49:50.110090] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-15T19:49:50.104380] [INFO ] [REMOTE ] OPY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:50.109982] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:50.130846] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-15T19:49:50.133216] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-15T19:49:50.133322] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-15T19:49:50.133062] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:49:50.133528] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-15T19:49:50.133585] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-15T19:49:50.130150] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-15T19:49:50.133996] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-15T19:49:50.139794] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-15T19:49:50.140088] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-15T19:49:50.146048] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-15T19:49:50.156217] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-15T19:49:51.107198] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T19:49:51.119170] [INFO ] [REMOTE ] OPP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:51.136474] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-15T19:49:51.152392] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-15T19:49:51.239008] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:51.276428] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-15T19:49:51.298639] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:49:51.299217] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-15T19:49:51.715698] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:49:51.717614] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-15T19:49:51.749023] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T19:49:51.750965] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-15T19:49:52.002971] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:49:52.005722] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-15T19:49:52.332218] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:49:52.457953] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-15T19:49:52.515817] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:49:52.545448] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T19:49:52.958505] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T19:49:53.014448] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T19:49:53.257845] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-15T19:49:54.057880] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-15T19:49:54.099343] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:49:54.415618] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T19:49:54.857885] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-15T19:49:55.657902] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-15T19:49:56.389834] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:49:56.457893] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-15T19:49:56.469892] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:49:57.257879] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-15T19:49:58.057921] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-15T19:49:58.074546] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T19:49:58.150122] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:49:58.488578] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T19:49:58.857876] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-15T19:49:59.600500] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T19:49:59.657828] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-15T19:50:00.457897] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-15T19:50:01.257887] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-15T19:50:01.416550] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T19:50:01.450306] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T19:50:02.057893] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-15T19:50:02.492537] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:50:02.710023] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T19:50:02.857874] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-15T19:50:03.560275] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:50:03.657874] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-15T19:50:04.396396] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:50:04.457895] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-15T19:50:05.240929] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T19:50:05.242766] [INFO ] [REMOTE ] OPP: Full fetch complete (12835 records). [2025-09-15T19:50:05.242835] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-15T19:50:05.264005] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-15T19:50:05.614378] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-15T19:50:05.614490] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-15T19:50:05.614819] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-15T19:50:05.614871] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-15T19:50:05.616018] [DEBUG] [LOCAL ] OPP: Trimmed 12835 records to 8670 (keeping 150 days of data) [2025-09-15T19:50:05.670520] [DEBUG] [LOCAL ] OPP: Primary data saved (8670 records). [2025-09-15T19:50:05.670659] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-15T19:50:05.670780] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPP took 17.3s. Estimated remaining: 1h 21m 34s. Rate: 9.4 symbols/min [2025-09-15T19:50:05.846245] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:05.891322] [DEBUG] [LOCAL ] OR: Loaded 34207 existing records from primary storage. [2025-09-15T19:50:05.891463] [INFO ] [MAIN ] OR: Loaded 34207 existing records. [2025-09-15T19:50:06.065615] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-15T19:50:06.070633] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:06.071520] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-15T19:50:06.071578] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-15T19:50:06.072438] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-15T19:50:06.072488] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-15T19:50:06.237187] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T19:50:06.451978] [INFO ] [REMOTE ] OR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:06.857895] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-15T19:50:07.657891] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-15T19:50:07.843446] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:50:08.255857] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T19:50:08.286825] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T19:50:08.288671] [INFO ] [REMOTE ] OPY: Full fetch complete (8230 records). [2025-09-15T19:50:08.288744] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-15T19:50:08.463188] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-15T19:50:08.471664] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:50:08.473628] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:50:08.473792] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:50:08.473941] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-15T19:50:08.474036] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-15T19:50:08.474090] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-15T19:50:08.474615] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-15T19:50:08.475053] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. OPY took 20.1s. Estimated remaining: 1h 21m 26s. Rate: 9.4 symbols/min [2025-09-15T19:50:08.654527] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:08.683332] [DEBUG] [LOCAL ] ORA: Loaded 24057 existing records from primary storage. [2025-09-15T19:50:08.683668] [INFO ] [MAIN ] ORA: Loaded 24057 existing records. [2025-09-15T19:50:08.866081] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:08.866430] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-15T19:50:08.866480] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-15T19:50:08.867570] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-15T19:50:08.867626] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-15T19:50:09.230995] [INFO ] [REMOTE ] ORA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:09.257954] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-15T19:50:10.057943] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-15T19:50:10.288003] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T19:50:10.293828] [INFO ] [REMOTE ] OPAD: Full fetch complete (18552 records). [2025-09-15T19:50:10.293965] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-15T19:50:10.662065] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-15T19:50:10.662160] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-15T19:50:10.662590] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-15T19:50:10.662900] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-15T19:50:10.664106] [DEBUG] [LOCAL ] OPAD: Trimmed 18552 records to 16476 (keeping 150 days of data) [2025-09-15T19:50:10.767917] [DEBUG] [LOCAL ] OPAD: Primary data saved (16476 records). [2025-09-15T19:50:10.768348] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-15T19:50:10.768448] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. OPAD took 22.4s. Estimated remaining: 1h 21m 18s. Rate: 9.4 symbols/min [2025-09-15T19:50:10.861590] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-15T19:50:10.894210] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:50:10.980358] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:11.016746] [DEBUG] [LOCAL ] ORC: Loaded 39449 existing records from primary storage. [2025-09-15T19:50:11.016906] [INFO ] [MAIN ] ORC: Loaded 39449 existing records. [2025-09-15T19:50:11.193472] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:11.193772] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-15T19:50:11.193820] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-15T19:50:11.194738] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-15T19:50:11.194790] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-15T19:50:11.549199] [INFO ] [REMOTE ] ORC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:11.579926] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:50:11.657833] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-15T19:50:12.301446] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:50:12.457975] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-15T19:50:13.198176] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:50:13.257876] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-15T19:50:13.575895] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T19:50:14.057954] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-15T19:50:14.857929] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-15T19:50:15.094549] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T19:50:15.657922] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-15T19:50:15.736592] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T19:50:16.413788] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T19:50:16.457813] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-15T19:50:17.257881] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-15T19:50:17.482691] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T19:50:17.949476] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T19:50:17.954931] [INFO ] [REMOTE ] OPFI: Full fetch complete (51331 records). [2025-09-15T19:50:17.955054] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-15T19:50:18.063982] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-15T19:50:18.356353] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-15T19:50:18.356440] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-15T19:50:18.357381] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-15T19:50:18.357431] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-15T19:50:18.358572] [DEBUG] [LOCAL ] OPFI: Trimmed 51331 records to 34322 (keeping 150 days of data) [2025-09-15T19:50:18.594590] [DEBUG] [LOCAL ] OPFI: Primary data saved (34322 records). [2025-09-15T19:50:18.594845] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-15T19:50:18.594963] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. OPFI took 30.2s. Estimated remaining: 1h 21m 12s. Rate: 9.4 symbols/min [2025-09-15T19:50:18.597063] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:50:18.783612] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:18.783866] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-15T19:50:18.783909] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-15T19:50:18.784031] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-15T19:50:18.784072] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-15T19:50:18.784114] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-15T19:50:18.784148] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-15T19:50:18.863025] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-15T19:50:19.160026] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:19.657872] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-15T19:50:19.772348] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T19:50:20.457887] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-15T19:50:20.797239] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T19:50:20.858366] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:50:21.257879] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-15T19:50:21.836602] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:50:22.057884] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-15T19:50:22.857886] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-15T19:50:23.015279] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T19:50:23.615938] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T19:50:23.657891] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-15T19:50:24.074784] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:50:24.457888] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-15T19:50:25.169181] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T19:50:25.257836] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-15T19:50:25.730441] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:50:26.057918] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-15T19:50:26.670430] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T19:50:26.857888] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-15T19:50:27.657916] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-15T19:50:28.149204] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-15T19:50:28.305575] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T19:50:28.313363] [INFO ] [REMOTE ] OR: Full fetch complete (49771 records). [2025-09-15T19:50:28.313600] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-15T19:50:28.463010] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-15T19:50:28.841181] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-15T19:50:28.841309] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-15T19:50:28.842672] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-15T19:50:28.842740] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-15T19:50:28.844508] [DEBUG] [LOCAL ] OR: Trimmed 49771 records to 33580 (keeping 150 days of data) [2025-09-15T19:50:29.204458] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:50:29.222188] [DEBUG] [LOCAL ] OR: Primary data saved (33580 records). [2025-09-15T19:50:29.222576] [INFO ] [MAIN ] OR: Full history saved. [2025-09-15T19:50:29.224091] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. OR took 23.6s. Estimated remaining: 1h 21m 8s. Rate: 9.4 symbols/min [2025-09-15T19:50:29.265496] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-15T19:50:29.459793] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:29.460061] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-15T19:50:29.460104] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-15T19:50:29.460236] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-15T19:50:29.460280] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-15T19:50:29.460358] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-15T19:50:29.460403] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-15T19:50:29.874142] [INFO ] [REMOTE ] ORI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:30.057887] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-15T19:50:30.463832] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:50:30.467399] [INFO ] [REMOTE ] ORA: Full fetch complete (35695 records). [2025-09-15T19:50:30.467481] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-15T19:50:30.841137] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-15T19:50:30.841298] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-15T19:50:30.842033] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-15T19:50:30.842086] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-15T19:50:30.872863] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-15T19:50:30.878317] [DEBUG] [LOCAL ] ORA: Trimmed 35695 records to 23615 (keeping 150 days of data) [2025-09-15T19:50:30.883730] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-15T19:50:31.045962] [DEBUG] [LOCAL ] ORA: Primary data saved (23615 records). [2025-09-15T19:50:31.046104] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-15T19:50:31.046189] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORA took 22.6s. Estimated remaining: 1h 20m 59s. Rate: 9.4 symbols/min [2025-09-15T19:50:31.215418] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:31.241310] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:50:31.265455] [DEBUG] [LOCAL ] ORN: Loaded 23351 existing records from primary storage. [2025-09-15T19:50:31.265583] [INFO ] [MAIN ] ORN: Loaded 23351 existing records. [2025-09-15T19:50:31.439591] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:31.439868] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-15T19:50:31.439914] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-15T19:50:31.440533] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-15T19:50:31.440580] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-15T19:50:31.667440] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-15T19:50:31.792327] [INFO ] [REMOTE ] ORN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:32.457879] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-15T19:50:32.895136] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T19:50:33.259896] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-15T19:50:33.262785] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T19:50:33.614804] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:50:34.057916] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-15T19:50:34.857910] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-15T19:50:35.547983] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-15T19:50:35.611734] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T19:50:35.657828] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-15T19:50:36.457895] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-15T19:50:36.730811] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T19:50:36.736824] [INFO ] [REMOTE ] ORC: Full fetch complete (56806 records). [2025-09-15T19:50:36.736977] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-15T19:50:37.125862] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-15T19:50:37.125941] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-15T19:50:37.126826] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-15T19:50:37.126869] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-15T19:50:37.127992] [DEBUG] [LOCAL ] ORC: Trimmed 56806 records to 38686 (keeping 150 days of data) [2025-09-15T19:50:37.299524] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-15T19:50:37.366804] [DEBUG] [LOCAL ] ORC: Primary data saved (38686 records). [2025-09-15T19:50:37.366926] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-15T19:50:37.367007] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORC took 26.6s. Estimated remaining: 1h 20m 53s. Rate: 9.4 symbols/min [2025-09-15T19:50:37.611885] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T19:50:37.613290] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:37.662618] [DEBUG] [LOCAL ] OSCR: Loaded 40515 existing records from primary storage. [2025-09-15T19:50:37.662794] [INFO ] [MAIN ] OSCR: Loaded 40515 existing records. [2025-09-15T19:50:37.846052] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:37.846355] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-15T19:50:37.846403] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-15T19:50:37.847355] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-15T19:50:37.847408] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-15T19:50:38.063028] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-15T19:50:38.211128] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:38.560235] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:50:38.857916] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-15T19:50:39.205294] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-15T19:50:39.407627] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T19:50:39.657884] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-15T19:50:40.457991] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-15T19:50:40.517896] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T19:50:41.257889] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-15T19:50:41.945756] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-15T19:50:42.057884] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-15T19:50:42.381925] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T19:50:42.857952] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-15T19:50:43.168869] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-15T19:50:43.658860] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T19:50:43.657878] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-15T19:50:43.896164] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:50:44.457905] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-15T19:50:44.778626] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:50:45.257997] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-15T19:50:45.483614] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T19:50:46.057957] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-15T19:50:46.857911] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-15T19:50:46.957671] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:50:46.963229] [INFO ] [REMOTE ] ORI: Full fetch complete (52923 records). [2025-09-15T19:50:46.963359] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-15T19:50:47.163657] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:50:47.164480] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:50:47.164577] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:50:47.164797] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-15T19:50:47.164985] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-15T19:50:47.165064] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-15T19:50:47.165119] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-15T19:50:47.165270] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. ORI took 17.9s. Estimated remaining: 1h 20m 48s. Rate: 9.4 symbols/min [2025-09-15T19:50:47.363596] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:47.365372] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:50:47.365514] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-15T19:50:47.372445] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-15T19:50:47.373105] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-15T19:50:47.373157] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-15T19:50:47.373203] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-15T19:50:47.373237] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-15T19:50:47.659901] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-15T19:50:47.736671] [INFO ] [REMOTE ] OSK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:48.457859] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-15T19:50:49.257938] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-15T19:50:49.301056] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-15T19:50:49.389413] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T19:50:50.054745] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:50:50.062455] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-15T19:50:50.150675] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:50:50.857875] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-15T19:50:51.657883] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-15T19:50:52.315860] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:50:52.427434] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-15T19:50:52.457820] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-15T19:50:53.257856] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-15T19:50:53.786053] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-15T19:50:54.057878] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-15T19:50:54.662677] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-15T19:50:54.788057] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:50:54.857854] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-15T19:50:55.657877] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-15T19:50:56.115871] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:50:56.119169] [INFO ] [REMOTE ] ORN: Full fetch complete (34319 records). [2025-09-15T19:50:56.119263] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-15T19:50:56.458915] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-15T19:50:56.490726] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-15T19:50:56.490826] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-15T19:50:56.491618] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-15T19:50:56.491844] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-15T19:50:56.493074] [DEBUG] [LOCAL ] ORN: Trimmed 34319 records to 22954 (keeping 150 days of data) [2025-09-15T19:50:56.616296] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-15T19:50:56.672131] [DEBUG] [LOCAL ] ORN: Primary data saved (22954 records). [2025-09-15T19:50:56.672271] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-15T19:50:56.672366] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. ORN took 25.6s. Estimated remaining: 1h 20m 43s. Rate: 9.4 symbols/min [2025-09-15T19:50:56.841694] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:56.841889] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-15T19:50:56.841926] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-15T19:50:56.842054] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-15T19:50:56.842094] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-15T19:50:56.842135] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-15T19:50:56.842170] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-15T19:50:57.187210] [INFO ] [REMOTE ] OTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:57.257829] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-15T19:50:57.466847] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:50:57.467138] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-15T19:50:57.825280] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T19:50:57.956531] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-15T19:50:57.961877] [INFO ] [REMOTE ] ORCL: Full fetch complete (58103 records). [2025-09-15T19:50:57.961975] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-15T19:50:58.061501] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-15T19:50:58.154105] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:50:58.154904] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:50:58.154979] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:50:58.155040] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-15T19:50:58.155126] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-15T19:50:58.155196] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-15T19:50:58.155257] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-15T19:50:58.155322] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. ORCL took 39.6s. Estimated remaining: 1h 20m 34s. Rate: 9.4 symbols/min [2025-09-15T19:50:58.323379] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:50:58.361102] [DEBUG] [LOCAL ] OTIS: Loaded 39660 existing records from primary storage. [2025-09-15T19:50:58.361243] [INFO ] [MAIN ] OTIS: Loaded 39660 existing records. [2025-09-15T19:50:58.546702] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:50:58.546943] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-15T19:50:58.547020] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-15T19:50:58.547980] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-15T19:50:58.548032] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-15T19:50:58.863019] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-15T19:50:58.899610] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:50:59.131310] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:50:59.131664] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-15T19:50:59.657905] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-15T19:51:00.359393] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-15T19:51:00.457907] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-15T19:51:01.046124] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:51:01.257884] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-15T19:51:01.620477] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:51:01.620822] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-15T19:51:02.057870] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-15T19:51:02.857900] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-15T19:51:03.657862] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-15T19:51:03.908747] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (3.45 seconds). [2025-09-15T19:51:03.920836] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:51:03.921134] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-15T19:51:04.457863] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-15T19:51:05.257890] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-15T19:51:05.773986] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T19:51:05.982149] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:51:06.044544] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (3.19 seconds). [2025-09-15T19:51:06.057811] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-15T19:51:06.857874] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-15T19:51:07.631842] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:51:07.657841] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-15T19:51:07.927606] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (3.47 seconds). [2025-09-15T19:51:07.933593] [INFO ] [REMOTE ] OSCR: Full fetch complete (58359 records). [2025-09-15T19:51:07.933779] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-15T19:51:08.331415] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-15T19:51:08.331555] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-15T19:51:08.332663] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-15T19:51:08.332767] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-15T19:51:08.334286] [DEBUG] [LOCAL ] OSCR: Trimmed 58359 records to 39762 (keeping 150 days of data) [2025-09-15T19:51:08.448745] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-15T19:51:08.458142] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-15T19:51:08.598152] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:51:08.636539] [DEBUG] [LOCAL ] OSCR: Primary data saved (39762 records). [2025-09-15T19:51:08.636713] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-15T19:51:08.636822] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OSCR took 31.3s. Estimated remaining: 1h 20m 30s. Rate: 9.4 symbols/min [2025-09-15T19:51:08.838098] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:08.874811] [DEBUG] [LOCAL ] OUT: Loaded 36209 existing records from primary storage. [2025-09-15T19:51:08.874990] [INFO ] [MAIN ] OUT: Loaded 36209 existing records. [2025-09-15T19:51:09.049031] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:09.049309] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-15T19:51:09.049355] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-15T19:51:09.050412] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-15T19:51:09.050463] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-15T19:51:09.265331] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-15T19:51:09.398889] [INFO ] [REMOTE ] OUT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:10.057901] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-15T19:51:10.257283] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:51:10.291272] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:51:10.294085] [INFO ] [REMOTE ] OTF: Full fetch complete (6230 records). [2025-09-15T19:51:10.294155] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-15T19:51:10.472184] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 65 unique days, need 150 days [2025-09-15T19:51:10.472423] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:51:10.472474] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:51:10.472517] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-15T19:51:10.472614] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-15T19:51:10.472675] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-15T19:51:10.472721] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-15T19:51:10.472783] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OTF took 13.8s. Estimated remaining: 1h 20m 21s. Rate: 9.4 symbols/min [2025-09-15T19:51:10.640085] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:10.680372] [DEBUG] [LOCAL ] OVV: Loaded 40277 existing records from primary storage. [2025-09-15T19:51:10.680541] [INFO ] [MAIN ] OVV: Loaded 40277 existing records. [2025-09-15T19:51:10.860033] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-15T19:51:10.863446] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:10.864343] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-15T19:51:10.864395] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-15T19:51:10.865210] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-15T19:51:10.865275] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-15T19:51:11.224923] [INFO ] [REMOTE ] OVV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:11.545321] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T19:51:11.657855] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-15T19:51:12.201791] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T19:51:12.206515] [INFO ] [REMOTE ] OSK: Full fetch complete (45844 records). [2025-09-15T19:51:12.206666] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-15T19:51:12.398941] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:51:12.399526] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:51:12.399580] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:51:12.399626] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-15T19:51:12.399722] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-15T19:51:12.399779] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-15T19:51:12.399822] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-15T19:51:12.399885] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OSK took 25.2s. Estimated remaining: 1h 20m 13s. Rate: 9.4 symbols/min [2025-09-15T19:51:12.462979] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-15T19:51:12.577789] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:12.632616] [DEBUG] [LOCAL ] OWL: Loaded 40303 existing records from primary storage. [2025-09-15T19:51:12.632841] [INFO ] [MAIN ] OWL: Loaded 40303 existing records. [2025-09-15T19:51:12.820199] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:12.820463] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-15T19:51:12.820516] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-15T19:51:12.821471] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-15T19:51:12.821522] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-15T19:51:13.175744] [INFO ] [REMOTE ] OWL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:13.203123] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:51:13.257816] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-15T19:51:14.057944] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-15T19:51:14.752830] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-15T19:51:14.857832] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-15T19:51:15.657946] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-15T19:51:16.029278] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-15T19:51:16.457933] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-15T19:51:16.639201] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-15T19:51:17.091988] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T19:51:17.257841] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-15T19:51:17.529203] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T19:51:18.023745] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T19:51:18.057812] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-15T19:51:18.857914] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-15T19:51:19.155720] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:51:19.663040] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-15T19:51:19.676602] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T19:51:20.166873] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:51:20.457865] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-15T19:51:21.132977] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:51:21.257822] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-15T19:51:21.916048] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T19:51:22.057877] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-15T19:51:22.722896] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:51:22.857842] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-15T19:51:23.657857] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-15T19:51:23.887415] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T19:51:24.342273] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T19:51:24.457873] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-15T19:51:25.257860] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-15T19:51:25.339104] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T19:51:25.717776] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:51:26.057927] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-15T19:51:26.857894] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-15T19:51:27.657881] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-15T19:51:28.043523] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-15T19:51:28.089219] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T19:51:28.457882] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-15T19:51:29.079859] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-15T19:51:29.257904] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-15T19:51:29.325742] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:51:29.331776] [INFO ] [REMOTE ] OTIS: Full fetch complete (57316 records). [2025-09-15T19:51:29.331908] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-15T19:51:29.722719] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-15T19:51:29.722817] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-15T19:51:29.723757] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-15T19:51:29.723814] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-15T19:51:29.725234] [DEBUG] [LOCAL ] OTIS: Trimmed 57316 records to 38917 (keeping 150 days of data) [2025-09-15T19:51:29.982089] [DEBUG] [LOCAL ] OTIS: Primary data saved (38917 records). [2025-09-15T19:51:29.982291] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-15T19:51:29.982943] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OTIS took 31.8s. Estimated remaining: 1h 20m 12s. Rate: 9.4 symbols/min [2025-09-15T19:51:30.062995] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-15T19:51:30.157293] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:30.168568] [DEBUG] [LOCAL ] OWLT: Loaded 6949 existing records from primary storage. [2025-09-15T19:51:30.168725] [INFO ] [MAIN ] OWLT: Loaded 6949 existing records. [2025-09-15T19:51:30.400752] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:30.401302] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-15T19:51:30.411864] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-15T19:51:30.426042] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-15T19:51:30.428974] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-15T19:51:30.476003] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-15T19:51:30.811893] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:30.868852] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-15T19:51:30.875435] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T19:51:31.590337] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T19:51:31.597497] [INFO ] [REMOTE ] OUT: Full fetch complete (52314 records). [2025-09-15T19:51:31.597704] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-15T19:51:31.663039] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-15T19:51:31.712869] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:51:32.005372] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-15T19:51:32.005477] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-15T19:51:32.006521] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-15T19:51:32.006607] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-15T19:51:32.008013] [DEBUG] [LOCAL ] OUT: Trimmed 52314 records to 35495 (keeping 150 days of data) [2025-09-15T19:51:32.243478] [DEBUG] [LOCAL ] OUT: Primary data saved (35495 records). [2025-09-15T19:51:32.243670] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-15T19:51:32.243779] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OUT took 23.6s. Estimated remaining: 1h 20m 4s. Rate: 9.4 symbols/min [2025-09-15T19:51:32.418782] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:32.444062] [DEBUG] [LOCAL ] OXM: Loaded 24739 existing records from primary storage. [2025-09-15T19:51:32.444322] [INFO ] [MAIN ] OXM: Loaded 24739 existing records. [2025-09-15T19:51:32.464445] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-15T19:51:32.625163] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:32.625420] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-15T19:51:32.625469] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-15T19:51:32.626246] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-15T19:51:32.626299] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-15T19:51:32.999150] [INFO ] [REMOTE ] OXM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:33.229553] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:51:33.257825] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-15T19:51:33.313104] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:51:33.829572] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:51:34.057866] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-15T19:51:34.562638] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T19:51:34.857877] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-15T19:51:35.657845] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-15T19:51:36.049146] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:51:36.457876] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-15T19:51:37.129445] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:51:37.257874] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-15T19:51:37.366238] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:51:37.372570] [INFO ] [REMOTE ] OVV: Full fetch complete (58153 records). [2025-09-15T19:51:37.372780] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-15T19:51:37.757077] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-15T19:51:37.757165] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-15T19:51:37.758088] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-15T19:51:37.758141] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-15T19:51:37.759656] [DEBUG] [LOCAL ] OVV: Trimmed 58153 records to 39498 (keeping 150 days of data) [2025-09-15T19:51:38.025472] [DEBUG] [LOCAL ] OVV: Primary data saved (39498 records). [2025-09-15T19:51:38.025677] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-15T19:51:38.026734] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OVV took 27.6s. Estimated remaining: 1h 19m 57s. Rate: 9.4 symbols/min [2025-09-15T19:51:38.060401] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-15T19:51:38.201195] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:38.201418] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-15T19:51:38.201456] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-15T19:51:38.201587] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-15T19:51:38.201625] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-15T19:51:38.201686] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-15T19:51:38.201723] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-15T19:51:38.561861] [INFO ] [REMOTE ] OXY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:38.587511] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T19:51:38.857911] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-15T19:51:39.657938] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-15T19:51:39.991453] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:51:40.458007] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-15T19:51:41.163946] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T19:51:41.260573] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-15T19:51:41.269080] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-15T19:51:41.869130] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T19:51:42.057936] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-15T19:51:42.216529] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T19:51:42.653255] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:51:42.857916] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-15T19:51:43.657932] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-15T19:51:44.457917] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-15T19:51:44.529733] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:51:44.537998] [INFO ] [REMOTE ] OWL: Full fetch complete (58224 records). [2025-09-15T19:51:44.538261] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-15T19:51:44.942023] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-15T19:51:44.942151] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-15T19:51:44.943488] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-15T19:51:44.943538] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-15T19:51:44.945190] [DEBUG] [LOCAL ] OWL: Trimmed 58224 records to 39522 (keeping 150 days of data) [2025-09-15T19:51:45.228571] [DEBUG] [LOCAL ] OWL: Primary data saved (39522 records). [2025-09-15T19:51:45.228770] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-15T19:51:45.229520] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. OWL took 32.8s. Estimated remaining: 1h 19m 51s. Rate: 9.4 symbols/min [2025-09-15T19:51:45.263159] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-15T19:51:45.417977] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:45.463796] [DEBUG] [LOCAL ] PAAS: Loaded 40365 existing records from primary storage. [2025-09-15T19:51:45.463963] [INFO ] [MAIN ] PAAS: Loaded 40365 existing records. [2025-09-15T19:51:45.646180] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:45.646465] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-15T19:51:45.646519] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-15T19:51:45.647581] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-15T19:51:45.647634] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-15T19:51:46.036751] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:46.047195] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:51:46.063297] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-15T19:51:46.103199] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-15T19:51:46.119893] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:51:46.857868] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-15T19:51:47.657884] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-15T19:51:47.971515] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T19:51:48.020383] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-15T19:51:48.457873] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-15T19:51:48.500154] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T19:51:48.501697] [INFO ] [REMOTE ] OWLT: Full fetch complete (9145 records). [2025-09-15T19:51:48.501764] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-15T19:51:48.856532] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-15T19:51:48.856622] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-15T19:51:48.857014] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-15T19:51:48.857113] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-15T19:51:48.857609] [DEBUG] [LOCAL ] OWLT: Trimmed 9145 records to 6955 (keeping 150 days of data) [2025-09-15T19:51:48.899093] [DEBUG] [LOCAL ] OWLT: Primary data saved (6955 records). [2025-09-15T19:51:48.899233] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-15T19:51:48.899332] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. OWLT took 18.9s. Estimated remaining: 1h 19m 43s. Rate: 9.4 symbols/min [2025-09-15T19:51:49.068436] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:49.078896] [DEBUG] [LOCAL ] PAC: Loaded 8602 existing records from primary storage. [2025-09-15T19:51:49.079008] [INFO ] [MAIN ] PAC: Loaded 8602 existing records. [2025-09-15T19:51:49.257594] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:49.257826] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-15T19:51:49.258080] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-15T19:51:49.258247] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-15T19:51:49.259491] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-15T19:51:49.259547] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-15T19:51:49.611187] [INFO ] [REMOTE ] PAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:49.671946] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:51:50.057888] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-15T19:51:50.857891] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-15T19:51:51.074019] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:51:51.078314] [INFO ] [REMOTE ] OXM: Full fetch complete (35722 records). [2025-09-15T19:51:51.078401] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-15T19:51:51.455868] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-15T19:51:51.455951] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-15T19:51:51.456766] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-15T19:51:51.456813] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-15T19:51:51.457595] [DEBUG] [LOCAL ] OXM: Trimmed 35722 records to 24204 (keeping 150 days of data) [2025-09-15T19:51:51.570428] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:51:51.623298] [DEBUG] [LOCAL ] OXM: Primary data saved (24204 records). [2025-09-15T19:51:51.623448] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-15T19:51:51.623571] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. OXM took 19.4s. Estimated remaining: 1h 19m 35s. Rate: 9.4 symbols/min [2025-09-15T19:51:51.665986] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-15T19:51:51.797991] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:51:51.821497] [DEBUG] [LOCAL ] PACK: Loaded 23281 existing records from primary storage. [2025-09-15T19:51:51.821692] [INFO ] [MAIN ] PACK: Loaded 23281 existing records. [2025-09-15T19:51:52.006684] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:51:52.007033] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-15T19:51:52.007140] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-15T19:51:52.007842] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-15T19:51:52.007904] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-15T19:51:52.402554] [INFO ] [REMOTE ] PACK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:51:52.404700] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (3.15 seconds). [2025-09-15T19:51:52.427209] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:51:52.457820] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-15T19:51:53.257931] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-15T19:51:53.633737] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:51:54.057871] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-15T19:51:54.857891] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-15T19:51:55.661263] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-15T19:51:55.682980] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-15T19:51:56.206262] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-15T19:51:56.238912] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T19:51:56.457883] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-15T19:51:56.723920] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:51:57.257859] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-15T19:51:58.057881] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-15T19:51:58.124852] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T19:51:58.654685] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-15T19:51:58.857869] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-15T19:51:59.662986] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-15T19:51:59.678132] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T19:52:00.457866] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-15T19:52:00.625786] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T19:52:01.257853] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-15T19:52:01.333032] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T19:52:01.614143] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T19:52:02.057872] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-15T19:52:02.104031] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T19:52:02.857883] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-15T19:52:03.657932] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-15T19:52:04.222969] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:52:04.339106] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:52:04.457858] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-15T19:52:04.494327] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:52:05.144963] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T19:52:05.146473] [INFO ] [REMOTE ] PAC: Full fetch complete (12792 records). [2025-09-15T19:52:05.146548] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-15T19:52:05.262943] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-15T19:52:05.517131] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-15T19:52:05.517210] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-15T19:52:05.517490] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-15T19:52:05.517568] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-15T19:52:05.518085] [DEBUG] [LOCAL ] PAC: Trimmed 12792 records to 8394 (keeping 150 days of data) [2025-09-15T19:52:05.572263] [DEBUG] [LOCAL ] PAC: Primary data saved (8394 records). [2025-09-15T19:52:05.572379] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-15T19:52:05.572471] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. PAC took 16.7s. Estimated remaining: 1h 19m 32s. Rate: 9.4 symbols/min [2025-09-15T19:52:05.739552] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:05.765501] [DEBUG] [LOCAL ] PACS: Loaded 25091 existing records from primary storage. [2025-09-15T19:52:05.765675] [INFO ] [MAIN ] PACS: Loaded 25091 existing records. [2025-09-15T19:52:05.940504] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:05.940760] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-15T19:52:05.940806] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-15T19:52:05.941339] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-15T19:52:05.941386] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-15T19:52:06.063022] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-15T19:52:06.296781] [INFO ] [REMOTE ] PACS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:06.434717] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:52:06.857883] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-15T19:52:07.657921] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-15T19:52:08.050763] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:52:08.115751] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-15T19:52:08.121337] [INFO ] [REMOTE ] OXY: Full fetch complete (58086 records). [2025-09-15T19:52:08.121492] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-15T19:52:08.315599] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:52:08.316579] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:52:08.316709] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:52:08.316791] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-15T19:52:08.316885] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-15T19:52:08.316938] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-15T19:52:08.316982] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-15T19:52:08.317059] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. OXY took 30.3s. Estimated remaining: 1h 19m 24s. Rate: 9.4 symbols/min [2025-09-15T19:52:08.462985] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-15T19:52:08.496086] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:08.513848] [DEBUG] [LOCAL ] PAG: Loaded 15705 existing records from primary storage. [2025-09-15T19:52:08.513986] [INFO ] [MAIN ] PAG: Loaded 15705 existing records. [2025-09-15T19:52:08.694058] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:08.694351] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-15T19:52:08.694399] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-15T19:52:08.694912] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-15T19:52:08.694996] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-15T19:52:09.051416] [INFO ] [REMOTE ] PAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:09.254345] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T19:52:09.264135] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-15T19:52:09.536530] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:52:10.057850] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-15T19:52:10.104687] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:52:10.857874] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-15T19:52:11.657927] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-15T19:52:12.055448] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T19:52:12.179720] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T19:52:12.457857] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-15T19:52:12.935102] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:52:13.257948] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-15T19:52:13.686121] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:52:14.057881] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-15T19:52:14.333728] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T19:52:14.857905] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-15T19:52:15.127833] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:52:15.131777] [INFO ] [REMOTE ] PACK: Full fetch complete (34485 records). [2025-09-15T19:52:15.131868] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-15T19:52:15.508001] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-15T19:52:15.508081] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-15T19:52:15.508776] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-15T19:52:15.508855] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-15T19:52:15.509636] [DEBUG] [LOCAL ] PACK: Trimmed 34485 records to 22763 (keeping 150 days of data) [2025-09-15T19:52:15.636541] [DEBUG] [LOCAL ] PACK: Primary data saved (22763 records). [2025-09-15T19:52:15.636692] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-15T19:52:15.636780] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. PACK took 24.0s. Estimated remaining: 1h 19m 18s. Rate: 9.4 symbols/min [2025-09-15T19:52:15.668363] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-15T19:52:15.835115] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:15.875597] [DEBUG] [LOCAL ] PAGS: Loaded 39690 existing records from primary storage. [2025-09-15T19:52:15.875774] [INFO ] [MAIN ] PAGS: Loaded 39690 existing records. [2025-09-15T19:52:16.060758] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:16.061129] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-15T19:52:16.061211] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-15T19:52:16.062257] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-15T19:52:16.078448] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-15T19:52:16.155206] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:52:16.456549] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:16.457837] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-15T19:52:16.801887] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:52:17.257928] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-15T19:52:18.057902] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-15T19:52:18.083049] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:52:18.147517] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T19:52:18.857887] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-15T19:52:19.657908] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-15T19:52:19.812477] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T19:52:20.419549] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:52:20.457849] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-15T19:52:20.898878] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:52:21.257872] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-15T19:52:21.912380] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:52:22.057867] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-15T19:52:22.249540] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T19:52:22.857915] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-15T19:52:23.410665] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T19:52:23.657882] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-15T19:52:23.851886] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T19:52:24.457887] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-15T19:52:24.663412] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:52:25.257874] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-15T19:52:26.057868] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-15T19:52:26.306873] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:52:26.522289] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T19:52:26.528150] [INFO ] [REMOTE ] PAAS: Full fetch complete (58249 records). [2025-09-15T19:52:26.528256] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-15T19:52:26.862942] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-15T19:52:26.913501] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-15T19:52:26.913581] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-15T19:52:26.914501] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-15T19:52:26.914550] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-15T19:52:26.915785] [DEBUG] [LOCAL ] PAAS: Trimmed 58249 records to 39585 (keeping 150 days of data) [2025-09-15T19:52:27.193690] [DEBUG] [LOCAL ] PAAS: Primary data saved (39585 records). [2025-09-15T19:52:27.193881] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-15T19:52:27.195548] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PAAS took 42.0s. Estimated remaining: 1h 19m 14s. Rate: 9.4 symbols/min [2025-09-15T19:52:27.374847] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:27.378909] [DEBUG] [LOCAL ] PAI: Loaded 1976 existing records from primary storage. [2025-09-15T19:52:27.379051] [INFO ] [MAIN ] PAI: Loaded 1976 existing records. [2025-09-15T19:52:27.557266] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:27.557570] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-15T19:52:27.557617] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-15T19:52:27.557869] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-15T19:52:27.557916] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-15T19:52:27.659823] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-15T19:52:27.916319] [INFO ] [REMOTE ] PAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:27.985618] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T19:52:28.310183] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:52:28.401410] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:52:28.403767] [INFO ] [REMOTE ] PAG: Full fetch complete (24193 records). [2025-09-15T19:52:28.403850] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-15T19:52:28.463123] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-15T19:52:28.791978] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-15T19:52:28.792089] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-15T19:52:28.793304] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-15T19:52:28.793598] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-15T19:52:28.795009] [DEBUG] [LOCAL ] PAG: Trimmed 24193 records to 15392 (keeping 150 days of data) [2025-09-15T19:52:28.902867] [DEBUG] [LOCAL ] PAG: Primary data saved (15392 records). [2025-09-15T19:52:28.903052] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-15T19:52:28.903203] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PAG took 20.6s. Estimated remaining: 1h 19m 6s. Rate: 9.4 symbols/min [2025-09-15T19:52:29.074884] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:29.075122] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-15T19:52:29.075163] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-15T19:52:29.075294] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-15T19:52:29.075334] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-15T19:52:29.075376] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-15T19:52:29.075410] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-15T19:52:29.267079] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-15T19:52:29.441265] [INFO ] [REMOTE ] PAII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:30.057879] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-15T19:52:30.171751] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T19:52:30.282480] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:30.282828] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-15T19:52:30.417996] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T19:52:30.857892] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-15T19:52:31.048327] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:31.048786] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-15T19:52:31.657881] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-15T19:52:32.457944] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-15T19:52:32.685867] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:32.686273] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-15T19:52:33.165127] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T19:52:33.257888] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-15T19:52:34.057946] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-15T19:52:34.194367] [DEBUG] [REMOTE ] PACS: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-15T19:52:34.194802] [WARN ] [REMOTE ] PACS: No data returned for month 2025-09 [2025-09-15T19:52:34.194933] [INFO ] [REMOTE ] PACS: Full fetch complete (33874 records). [2025-09-15T19:52:34.195029] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-15T19:52:34.196160] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T19:52:34.196284] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:52:34.196360] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:52:34.196445] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-15T19:52:34.196532] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-09-15T19:52:34.196589] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-09-15T19:52:34.197029] [DEBUG] [LOCAL ] PACS: Deleted derivative data file. [2025-09-15T19:52:34.197155] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PACS took 28.6s. Estimated remaining: 1h 18m 59s. Rate: 9.4 symbols/min [2025-09-15T19:52:34.427954] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:34.453547] [DEBUG] [LOCAL ] PAM: Loaded 20366 existing records from primary storage. [2025-09-15T19:52:34.453751] [INFO ] [MAIN ] PAM: Loaded 20366 existing records. [2025-09-15T19:52:34.660117] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:34.660685] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-15T19:52:34.660774] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-15T19:52:34.668312] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-15T19:52:34.679206] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-15T19:52:34.680016] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T19:52:34.748547] [INFO ] [REMOTE ] PAGS: Full fetch complete (57234 records). [2025-09-15T19:52:34.804012] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-15T19:52:34.858901] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-15T19:52:35.165399] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:35.289363] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-15T19:52:35.376020] [INFO ] [REMOTE ] PAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:35.486945] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-15T19:52:35.487063] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-15T19:52:35.488021] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-15T19:52:35.488070] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-15T19:52:35.489356] [DEBUG] [LOCAL ] PAGS: Trimmed 57234 records to 38961 (keeping 150 days of data) [2025-09-15T19:52:35.661844] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-15T19:52:35.728803] [DEBUG] [LOCAL ] PAGS: Primary data saved (38961 records). [2025-09-15T19:52:35.728964] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-15T19:52:35.729053] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAGS took 20.1s. Estimated remaining: 1h 18m 51s. Rate: 9.4 symbols/min [2025-09-15T19:52:35.895612] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:35.917497] [DEBUG] [LOCAL ] PAR: Loaded 24234 existing records from primary storage. [2025-09-15T19:52:35.917617] [INFO ] [MAIN ] PAR: Loaded 24234 existing records. [2025-09-15T19:52:36.089802] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:36.090007] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-15T19:52:36.090052] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-15T19:52:36.090583] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-15T19:52:36.090629] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-15T19:52:36.463287] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-15T19:52:36.468753] [INFO ] [REMOTE ] PAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:36.687434] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:36.687812] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-15T19:52:37.035697] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:52:37.257857] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-15T19:52:37.437464] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:37.437802] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-15T19:52:38.057930] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-15T19:52:38.238878] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:52:38.239223] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-15T19:52:38.857915] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-15T19:52:39.291662] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:52:39.657934] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-15T19:52:40.062858] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:52:40.457922] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-15T19:52:40.910548] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:52:41.257929] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-15T19:52:42.057880] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-15T19:52:42.293617] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:52:42.499041] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T19:52:42.857927] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-15T19:52:43.267286] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:52:43.657902] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-15T19:52:44.457888] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-15T19:52:44.652534] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:52:44.907790] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:52:45.257893] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-15T19:52:45.710557] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T19:52:46.057878] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-15T19:52:46.416805] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T19:52:46.417442] [INFO ] [REMOTE ] PAII: Full fetch complete (26 records). [2025-09-15T19:52:46.417520] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-15T19:52:46.592115] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 4 unique days, need 150 days [2025-09-15T19:52:46.592334] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:52:46.592407] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:52:46.592474] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-15T19:52:46.592552] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-15T19:52:46.592592] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-15T19:52:46.592661] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-15T19:52:46.592741] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAII took 17.7s. Estimated remaining: 1h 18m 46s. Rate: 9.4 symbols/min [2025-09-15T19:52:46.771196] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:46.814973] [DEBUG] [LOCAL ] PARR: Loaded 36297 existing records from primary storage. [2025-09-15T19:52:46.815125] [INFO ] [MAIN ] PARR: Loaded 36297 existing records. [2025-09-15T19:52:46.862973] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-15T19:52:47.013134] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:47.013379] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-15T19:52:47.013425] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-15T19:52:47.014202] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-15T19:52:47.014253] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-15T19:52:47.383717] [INFO ] [REMOTE ] PARR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:47.657912] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-15T19:52:48.125771] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T19:52:48.267724] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:52:48.269061] [INFO ] [REMOTE ] PAI: Full fetch complete (2972 records). [2025-09-15T19:52:48.269130] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-15T19:52:48.463365] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-15T19:52:48.626525] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-15T19:52:48.626615] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-15T19:52:48.626737] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-15T19:52:48.626801] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-15T19:52:48.627191] [DEBUG] [LOCAL ] PAI: Trimmed 2972 records to 1985 (keeping 150 days of data) [2025-09-15T19:52:48.639790] [DEBUG] [LOCAL ] PAI: Primary data saved (1985 records). [2025-09-15T19:52:48.639881] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-15T19:52:48.639975] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PAI took 21.4s. Estimated remaining: 1h 18m 38s. Rate: 9.4 symbols/min [2025-09-15T19:52:48.813954] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:48.866006] [DEBUG] [LOCAL ] PATH: Loaded 40422 existing records from primary storage. [2025-09-15T19:52:48.866195] [INFO ] [MAIN ] PATH: Loaded 40422 existing records. [2025-09-15T19:52:49.044966] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:49.045218] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-15T19:52:49.045265] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-15T19:52:49.046098] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-15T19:52:49.046167] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-15T19:52:49.266433] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-15T19:52:49.405243] [INFO ] [REMOTE ] PATH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:50.030205] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T19:52:50.057827] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-15T19:52:50.095412] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:52:50.857880] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-15T19:52:51.422092] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:52:51.657871] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-15T19:52:51.801856] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T19:52:52.457884] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-15T19:52:52.973828] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T19:52:53.257871] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-15T19:52:53.589894] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:52:54.057968] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-15T19:52:54.857914] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-15T19:52:55.229496] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T19:52:55.233754] [INFO ] [REMOTE ] PAM: Full fetch complete (30158 records). [2025-09-15T19:52:55.233835] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-15T19:52:55.641393] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-15T19:52:55.641539] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-15T19:52:55.642308] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-15T19:52:55.642373] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-15T19:52:55.666084] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-15T19:52:55.670226] [DEBUG] [LOCAL ] PAM: Trimmed 30158 records to 20034 (keeping 150 days of data) [2025-09-15T19:52:55.671923] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-15T19:52:55.806514] [DEBUG] [LOCAL ] PAM: Primary data saved (20034 records). [2025-09-15T19:52:55.806635] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-15T19:52:55.806770] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PAM took 21.6s. Estimated remaining: 1h 18m 32s. Rate: 9.4 symbols/min [2025-09-15T19:52:55.979306] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:52:55.996236] [DEBUG] [LOCAL ] PAXS: Loaded 15963 existing records from primary storage. [2025-09-15T19:52:55.996370] [INFO ] [MAIN ] PAXS: Loaded 15963 existing records. [2025-09-15T19:52:56.177984] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:52:56.178334] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-15T19:52:56.178408] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-15T19:52:56.178999] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-15T19:52:56.179082] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-15T19:52:56.461074] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-15T19:52:56.451880] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:52:56.589449] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:52:56.644828] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T19:52:57.257866] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-15T19:52:58.057891] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-15T19:52:58.503156] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T19:52:58.862979] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-15T19:52:58.884015] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-15T19:52:59.410463] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:52:59.657880] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-15T19:53:00.422585] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T19:53:00.457837] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-15T19:53:00.977746] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T19:53:01.257881] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-15T19:53:01.988342] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:53:02.057856] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-15T19:53:02.263189] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:53:02.748598] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T19:53:02.857865] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-15T19:53:03.657890] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-15T19:53:04.315499] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T19:53:04.320957] [INFO ] [REMOTE ] PARR: Full fetch complete (52599 records). [2025-09-15T19:53:04.321058] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-15T19:53:04.462095] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-15T19:53:04.706236] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-15T19:53:04.706319] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-15T19:53:04.707248] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-15T19:53:04.707304] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-15T19:53:04.708478] [DEBUG] [LOCAL ] PARR: Trimmed 52599 records to 35558 (keeping 150 days of data) [2025-09-15T19:53:04.922737] [DEBUG] [LOCAL ] PARR: Primary data saved (35558 records). [2025-09-15T19:53:04.922951] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-15T19:53:04.923748] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PARR took 18.3s. Estimated remaining: 1h 18m 27s. Rate: 9.4 symbols/min [2025-09-15T19:53:05.097455] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:05.133505] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:53:05.163235] [DEBUG] [LOCAL ] PAY: Loaded 28848 existing records from primary storage. [2025-09-15T19:53:05.163404] [INFO ] [MAIN ] PAY: Loaded 28848 existing records. [2025-09-15T19:53:05.261759] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-15T19:53:05.339942] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:05.340212] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-15T19:53:05.340263] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-15T19:53:05.340936] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-15T19:53:05.340990] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-15T19:53:05.745471] [INFO ] [REMOTE ] PAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:06.057893] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-15T19:53:06.212804] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T19:53:06.704571] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T19:53:06.857863] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-15T19:53:06.901606] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:53:07.657899] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-15T19:53:07.862984] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T19:53:08.434747] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:53:08.457821] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-15T19:53:09.257848] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-15T19:53:09.526977] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:53:10.057901] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-15T19:53:10.257213] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T19:53:10.857841] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-15T19:53:10.892510] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:53:11.657906] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-15T19:53:12.261887] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T19:53:12.457868] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-15T19:53:13.043357] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T19:53:13.257864] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-15T19:53:13.402715] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:53:14.057931] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-15T19:53:14.585177] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:53:14.857874] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-15T19:53:15.657878] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-15T19:53:16.319201] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-15T19:53:16.342872] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:53:16.347508] [INFO ] [REMOTE ] PAR: Full fetch complete (35232 records). [2025-09-15T19:53:16.347618] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-15T19:53:16.462962] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-15T19:53:16.720939] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-15T19:53:16.721028] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-15T19:53:16.721748] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-15T19:53:16.721790] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-15T19:53:16.722535] [DEBUG] [LOCAL ] PAR: Trimmed 35232 records to 23807 (keeping 150 days of data) [2025-09-15T19:53:16.871302] [DEBUG] [LOCAL ] PAR: Primary data saved (23807 records). [2025-09-15T19:53:16.871457] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-15T19:53:16.871568] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PAR took 41.1s. Estimated remaining: 1h 18m 23s. Rate: 9.4 symbols/min [2025-09-15T19:53:17.060138] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:17.093721] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:53:17.123124] [DEBUG] [LOCAL ] PAYC: Loaded 26500 existing records from primary storage. [2025-09-15T19:53:17.123267] [INFO ] [MAIN ] PAYC: Loaded 26500 existing records. [2025-09-15T19:53:17.270949] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-15T19:53:17.311307] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:17.311603] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-15T19:53:17.311682] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-15T19:53:17.312454] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-15T19:53:17.312521] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-15T19:53:17.693256] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:18.057908] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-15T19:53:18.657002] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-15T19:53:18.692266] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T19:53:18.857863] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-15T19:53:18.873664] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:53:18.876194] [INFO ] [REMOTE ] PAXS: Full fetch complete (22414 records). [2025-09-15T19:53:18.876275] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-15T19:53:19.245411] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-15T19:53:19.245509] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-15T19:53:19.246198] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-15T19:53:19.246243] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-15T19:53:19.246958] [DEBUG] [LOCAL ] PAXS: Trimmed 22414 records to 15712 (keeping 150 days of data) [2025-09-15T19:53:19.346194] [DEBUG] [LOCAL ] PAXS: Primary data saved (15712 records). [2025-09-15T19:53:19.346343] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-15T19:53:19.346462] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PAXS took 23.5s. Estimated remaining: 1h 18m 15s. Rate: 9.4 symbols/min [2025-09-15T19:53:19.514002] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:19.545270] [DEBUG] [LOCAL ] PB: Loaded 31174 existing records from primary storage. [2025-09-15T19:53:19.545444] [INFO ] [MAIN ] PB: Loaded 31174 existing records. [2025-09-15T19:53:19.662961] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-15T19:53:19.727594] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:19.727890] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-15T19:53:19.727936] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-15T19:53:19.728517] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-15T19:53:19.728572] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-15T19:53:20.102166] [INFO ] [REMOTE ] PB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:20.457982] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-15T19:53:20.901021] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:53:21.192615] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-15T19:53:21.257917] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-15T19:53:21.684986] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T19:53:22.057939] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-15T19:53:22.857962] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-15T19:53:23.115110] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T19:53:23.184603] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T19:53:23.657866] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-15T19:53:23.803310] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:53:24.457921] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-15T19:53:24.805539] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:53:25.257934] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-15T19:53:25.743210] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:53:26.057933] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-15T19:53:26.785781] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:53:26.857950] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-15T19:53:27.279789] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T19:53:27.657873] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-15T19:53:28.457889] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-15T19:53:28.823325] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T19:53:28.829350] [INFO ] [REMOTE ] PATH: Full fetch complete (58358 records). [2025-09-15T19:53:28.829476] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-15T19:53:29.224733] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-15T19:53:29.224847] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-15T19:53:29.225955] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-15T19:53:29.226061] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-15T19:53:29.227825] [DEBUG] [LOCAL ] PATH: Trimmed 58358 records to 39645 (keeping 150 days of data) [2025-09-15T19:53:29.296044] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-15T19:53:29.348227] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:53:29.518272] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:53:29.529605] [INFO ] [REMOTE ] PAY: Full fetch complete (40775 records). [2025-09-15T19:53:29.530367] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-15T19:53:29.633396] [DEBUG] [LOCAL ] PATH: Primary data saved (39645 records). [2025-09-15T19:53:29.646751] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-15T19:53:29.657704] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PATH took 41.0s. Estimated remaining: 1h 18m 10s. Rate: 9.4 symbols/min [2025-09-15T19:53:30.005629] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:30.064500] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-15T19:53:30.217939] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-15T19:53:30.218038] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-15T19:53:30.219010] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-15T19:53:30.219065] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-15T19:53:30.221082] [DEBUG] [LOCAL ] PAY: Trimmed 40775 records to 28375 (keeping 150 days of data) [2025-09-15T19:53:30.351391] [DEBUG] [LOCAL ] PBA: Loaded 36908 existing records from primary storage. [2025-09-15T19:53:30.352330] [INFO ] [MAIN ] PBA: Loaded 36908 existing records. [2025-09-15T19:53:30.573119] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:30.585270] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-15T19:53:30.585336] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-15T19:53:30.589739] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-15T19:53:30.593788] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-15T19:53:30.787436] [DEBUG] [LOCAL ] PAY: Primary data saved (28375 records). [2025-09-15T19:53:30.806228] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-15T19:53:30.816960] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PAY took 25.9s. Estimated remaining: 1h 18m 1s. Rate: 9.4 symbols/min [2025-09-15T19:53:31.104315] [INFO ] [REMOTE ] PBA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:31.121006] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-15T19:53:31.179775] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:31.206011] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:53:31.259379] [DEBUG] [LOCAL ] PBF: Loaded 40016 existing records from primary storage. [2025-09-15T19:53:31.259656] [INFO ] [MAIN ] PBF: Loaded 40016 existing records. [2025-09-15T19:53:31.459050] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:31.459703] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-15T19:53:31.459805] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-15T19:53:31.460824] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-15T19:53:31.460890] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-15T19:53:31.667581] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-15T19:53:31.772380] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T19:53:31.907116] [INFO ] [REMOTE ] PBF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:32.457922] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-15T19:53:32.841494] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T19:53:32.968716] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:53:33.257891] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-15T19:53:33.912969] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:53:34.057885] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-15T19:53:34.496614] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:53:34.857909] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-15T19:53:35.609138] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:53:35.657902] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-15T19:53:36.415849] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:53:36.457839] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-15T19:53:37.000443] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:53:37.257923] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-15T19:53:37.997210] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:53:38.057944] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-15T19:53:38.617522] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:53:38.857968] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-15T19:53:39.352585] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T19:53:39.657935] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-15T19:53:40.010282] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T19:53:40.015800] [INFO ] [REMOTE ] PB: Full fetch complete (44304 records). [2025-09-15T19:53:40.015886] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-15T19:53:40.399344] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-15T19:53:40.399442] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-15T19:53:40.400237] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-15T19:53:40.400280] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-15T19:53:40.401201] [DEBUG] [LOCAL ] PB: Trimmed 44304 records to 30715 (keeping 150 days of data) [2025-09-15T19:53:40.464222] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-15T19:53:40.612310] [DEBUG] [LOCAL ] PB: Primary data saved (30715 records). [2025-09-15T19:53:40.612520] [INFO ] [MAIN ] PB: Full history saved. [2025-09-15T19:53:40.613165] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PB took 21.3s. Estimated remaining: 1h 17m 57s. Rate: 9.4 symbols/min [2025-09-15T19:53:40.791863] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:40.820006] [DEBUG] [LOCAL ] PBH: Loaded 23964 existing records from primary storage. [2025-09-15T19:53:40.820151] [INFO ] [MAIN ] PBH: Loaded 23964 existing records. [2025-09-15T19:53:40.996971] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:40.997472] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-15T19:53:40.997573] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-15T19:53:40.998179] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-15T19:53:40.998336] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-15T19:53:41.263888] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-15T19:53:41.365192] [INFO ] [REMOTE ] PBH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:41.392948] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T19:53:41.608256] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:53:42.057918] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-15T19:53:42.850696] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:53:42.860483] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-15T19:53:43.136461] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T19:53:43.657937] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-15T19:53:44.003401] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T19:53:44.457886] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-15T19:53:45.259350] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-15T19:53:45.264354] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:53:45.580399] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:53:46.057879] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-15T19:53:46.678605] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T19:53:46.683154] [INFO ] [REMOTE ] PAYC: Full fetch complete (39868 records). [2025-09-15T19:53:46.683356] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-15T19:53:46.868854] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-15T19:53:47.084724] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-15T19:53:47.084843] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-15T19:53:47.086118] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-15T19:53:47.086185] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-15T19:53:47.087510] [DEBUG] [LOCAL ] PAYC: Trimmed 39868 records to 26059 (keeping 150 days of data) [2025-09-15T19:53:47.274019] [DEBUG] [LOCAL ] PAYC: Primary data saved (26059 records). [2025-09-15T19:53:47.274314] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-15T19:53:47.274474] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PAYC took 30.4s. Estimated remaining: 1h 17m 50s. Rate: 9.4 symbols/min [2025-09-15T19:53:47.462263] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:53:47.525730] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T19:53:47.556248] [DEBUG] [LOCAL ] PBI: Loaded 37490 existing records from primary storage. [2025-09-15T19:53:47.556471] [INFO ] [MAIN ] PBI: Loaded 37490 existing records. [2025-09-15T19:53:47.663923] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-15T19:53:47.753469] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:53:47.753756] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-15T19:53:47.753811] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-15T19:53:47.754999] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-15T19:53:47.755056] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-15T19:53:48.112791] [INFO ] [REMOTE ] PBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:53:48.130772] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:53:48.457886] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-15T19:53:49.257889] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-15T19:53:49.469626] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:53:49.915046] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:53:50.057958] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-15T19:53:50.184867] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T19:53:50.857921] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-15T19:53:51.657898] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-15T19:53:51.812473] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T19:53:52.457930] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-15T19:53:52.562208] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:53:52.568127] [INFO ] [REMOTE ] PBF: Full fetch complete (57700 records). [2025-09-15T19:53:52.568233] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-15T19:53:52.949026] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-15T19:53:52.949149] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-15T19:53:52.950165] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-15T19:53:52.950367] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-15T19:53:52.951869] [DEBUG] [LOCAL ] PBF: Trimmed 57700 records to 39234 (keeping 150 days of data) [2025-09-15T19:53:53.078459] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:53:53.237131] [DEBUG] [LOCAL ] PBF: Primary data saved (39234 records). [2025-09-15T19:53:53.237294] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-15T19:53:53.237393] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBF took 22.4s. Estimated remaining: 1h 17m 44s. Rate: 9.4 symbols/min [2025-09-15T19:53:53.257890] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-15T19:53:54.057873] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-15T19:53:54.126439] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T19:53:54.438738] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:53:54.857896] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-15T19:53:55.657923] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-15T19:53:55.706613] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:53:56.209596] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T19:53:56.457871] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-15T19:53:57.173893] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T19:53:57.257924] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-15T19:53:58.065034] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-15T19:53:58.066061] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T19:53:58.072376] [INFO ] [REMOTE ] PBA: Full fetch complete (53555 records). [2025-09-15T19:53:58.072471] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-15T19:53:58.453383] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-15T19:53:58.453491] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-15T19:53:58.454481] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-15T19:53:58.454550] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-15T19:53:58.456000] [DEBUG] [LOCAL ] PBA: Trimmed 53555 records to 36207 (keeping 150 days of data) [2025-09-15T19:53:58.594138] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:53:58.727241] [DEBUG] [LOCAL ] PBA: Primary data saved (36207 records). [2025-09-15T19:53:58.727408] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-15T19:53:58.727509] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBA took 29.1s. Estimated remaining: 1h 17m 37s. Rate: 9.4 symbols/min [2025-09-15T19:53:58.857948] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-15T19:53:59.670615] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:53:59.680158] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-15T19:54:00.130396] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T19:54:00.134701] [INFO ] [REMOTE ] PBH: Full fetch complete (33576 records). [2025-09-15T19:54:00.134784] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-15T19:54:00.505041] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-15T19:54:00.505145] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-15T19:54:00.506350] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-15T19:54:00.506397] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-15T19:54:00.507504] [DEBUG] [LOCAL ] PBH: Trimmed 33576 records to 23652 (keeping 150 days of data) [2025-09-15T19:54:00.660968] [DEBUG] [LOCAL ] PBH: Primary data saved (23652 records). [2025-09-15T19:54:00.661160] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-15T19:54:00.661278] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PBH took 20.0s. Estimated remaining: 1h 17m 29s. Rate: 9.4 symbols/min [2025-09-15T19:54:01.509888] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T19:54:01.521337] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-15T19:54:03.655055] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-15T19:54:03.666738] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-15T19:54:06.071010] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-15T19:54:06.077059] [INFO ] [REMOTE ] PBI: Full fetch complete (54783 records). [2025-09-15T19:54:06.077181] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-15T19:54:06.482563] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-15T19:54:06.482690] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-15T19:54:06.483679] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-15T19:54:06.483730] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-15T19:54:06.485249] [DEBUG] [LOCAL ] PBI: Trimmed 54783 records to 36793 (keeping 150 days of data) [2025-09-15T19:54:06.715221] [DEBUG] [LOCAL ] PBI: Primary data saved (36793 records). [2025-09-15T19:54:06.715380] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-15T19:54:06.715469] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PBI took 19.4s. Estimated remaining: 1h 17m 22s. Rate: 9.4 symbols/min [2025-09-15T19:54:07.272291] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:07.427739] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:07.449519] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:07.455157] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:07.471899] [DEBUG] [LOCAL ] PCF: Loaded 6661 existing records from primary storage. [2025-09-15T19:54:07.472092] [INFO ] [MAIN ] PCF: Loaded 6661 existing records. [2025-09-15T19:54:07.555803] [DEBUG] [LOCAL ] PBT: Loaded 13455 existing records from primary storage. [2025-09-15T19:54:07.576408] [INFO ] [MAIN ] PBT: Loaded 13455 existing records. [2025-09-15T19:54:07.815695] [DEBUG] [LOCAL ] PCG: Loaded 40459 existing records from primary storage. [2025-09-15T19:54:07.821730] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:07.827902] [INFO ] [MAIN ] PCG: Loaded 40459 existing records. [2025-09-15T19:54:07.827788] [DEBUG] [LOCAL ] PBR: Loaded 40462 existing records from primary storage. [2025-09-15T19:54:07.854909] [INFO ] [MAIN ] PBR: Loaded 40462 existing records. [2025-09-15T19:54:07.854695] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-15T19:54:07.920725] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-15T19:54:08.022898] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:08.038491] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-15T19:54:08.125822] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-15T19:54:08.147548] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-15T19:54:08.152542] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-15T19:54:08.174242] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-15T19:54:08.238268] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-15T19:54:08.385685] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:08.385364] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:08.455085] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-15T19:54:08.455525] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-15T19:54:08.469662] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-15T19:54:08.455448] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-15T19:54:08.507218] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-15T19:54:08.518178] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-15T19:54:08.529566] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-15T19:54:08.538237] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-15T19:54:09.465225] [INFO ] [REMOTE ] PCF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:09.518216] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-15T19:54:09.650270] [INFO ] [REMOTE ] PBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:09.670200] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-15T19:54:09.820613] [INFO ] [REMOTE ] PBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:09.837982] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-15T19:54:09.841598] [INFO ] [REMOTE ] PCG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:09.841876] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-15T19:54:10.333230] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:54:10.336404] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-15T19:54:10.370055] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T19:54:10.373407] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-15T19:54:10.799668] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T19:54:10.802292] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-15T19:54:11.381891] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:54:11.385999] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-15T19:54:11.639246] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T19:54:11.650092] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-15T19:54:11.680071] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:54:11.691310] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-15T19:54:11.700461] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T19:54:11.704004] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-15T19:54:12.301174] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:54:12.303478] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-15T19:54:12.391247] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T19:54:12.394788] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-15T19:54:12.829613] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:54:12.833021] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-15T19:54:13.076027] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T19:54:13.257901] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-15T19:54:13.557971] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T19:54:13.600795] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:54:13.670738] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-15T19:54:14.057846] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-15T19:54:14.217760] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T19:54:14.857892] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-15T19:54:15.633114] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:54:15.657812] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-15T19:54:15.890886] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T19:54:16.404984] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:54:16.407027] [INFO ] [REMOTE ] PCF: Full fetch complete (10068 records). [2025-09-15T19:54:16.407098] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-15T19:54:16.462970] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-15T19:54:16.776487] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-15T19:54:16.776570] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-15T19:54:16.776853] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-15T19:54:16.776895] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-15T19:54:16.777338] [DEBUG] [LOCAL ] PCF: Trimmed 10068 records to 6537 (keeping 150 days of data) [2025-09-15T19:54:16.815605] [DEBUG] [LOCAL ] PCF: Primary data saved (6537 records). [2025-09-15T19:54:16.815738] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-15T19:54:16.815827] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCF took 10.1s. Estimated remaining: 1h 17m 17s. Rate: 9.4 symbols/min [2025-09-15T19:54:16.985658] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:16.991917] [DEBUG] [LOCAL ] PCM: Loaded 4859 existing records from primary storage. [2025-09-15T19:54:16.992009] [INFO ] [MAIN ] PCM: Loaded 4859 existing records. [2025-09-15T19:54:17.189094] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:17.189607] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-15T19:54:17.189729] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-15T19:54:17.190149] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-15T19:54:17.190198] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-15T19:54:17.263172] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-15T19:54:17.583457] [INFO ] [REMOTE ] PCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:18.057878] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-15T19:54:18.706029] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T19:54:18.779723] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T19:54:18.857886] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-15T19:54:19.048512] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T19:54:19.657933] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-15T19:54:20.457946] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-15T19:54:20.713854] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:54:21.257969] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-15T19:54:21.807068] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-15T19:54:22.057896] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-15T19:54:22.347267] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:54:22.857888] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-15T19:54:22.985392] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-15T19:54:23.270749] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:54:23.657917] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-15T19:54:23.900917] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T19:54:24.457859] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-15T19:54:24.573931] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T19:54:25.257872] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-15T19:54:26.057843] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-15T19:54:26.302121] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T19:54:26.634478] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:54:26.857891] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-15T19:54:26.964964] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T19:54:27.614013] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T19:54:27.657915] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-15T19:54:28.457921] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-15T19:54:29.257911] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-15T19:54:29.565061] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T19:54:30.023861] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T19:54:30.026553] [INFO ] [REMOTE ] PBT: Full fetch complete (18909 records). [2025-09-15T19:54:30.026629] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-15T19:54:30.062966] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-15T19:54:30.405440] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-15T19:54:30.405722] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-15T19:54:30.406175] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-15T19:54:30.406261] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-15T19:54:30.407065] [DEBUG] [LOCAL ] PBT: Trimmed 18909 records to 13303 (keeping 150 days of data) [2025-09-15T19:54:30.517737] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-15T19:54:30.530534] [DEBUG] [LOCAL ] PBT: Primary data saved (13303 records). [2025-09-15T19:54:30.531088] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-15T19:54:30.531202] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PBT took 23.8s. Estimated remaining: 1h 17m 14s. Rate: 9.4 symbols/min [2025-09-15T19:54:30.701221] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:30.719686] [DEBUG] [LOCAL ] PCN: Loaded 18310 existing records from primary storage. [2025-09-15T19:54:30.719805] [INFO ] [MAIN ] PCN: Loaded 18310 existing records. [2025-09-15T19:54:30.867990] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-15T19:54:30.895898] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:30.897236] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-15T19:54:30.897289] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-15T19:54:30.897838] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-15T19:54:30.897891] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-15T19:54:31.250173] [INFO ] [REMOTE ] PCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:31.611812] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:54:31.657902] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-15T19:54:31.989802] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T19:54:31.995891] [INFO ] [REMOTE ] PBR: Full fetch complete (58397 records). [2025-09-15T19:54:31.996005] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-15T19:54:32.380183] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-15T19:54:32.380386] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-15T19:54:32.381449] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-15T19:54:32.381513] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-15T19:54:32.382773] [DEBUG] [LOCAL ] PBR: Trimmed 58397 records to 39681 (keeping 150 days of data) [2025-09-15T19:54:32.475681] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-15T19:54:32.635166] [DEBUG] [LOCAL ] PBR: Primary data saved (39681 records). [2025-09-15T19:54:32.635327] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-15T19:54:32.635430] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PBR took 25.9s. Estimated remaining: 1h 17m 6s. Rate: 9.4 symbols/min [2025-09-15T19:54:32.823859] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T19:54:32.826363] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:32.867072] [DEBUG] [LOCAL ] PCOR: Loaded 35891 existing records from primary storage. [2025-09-15T19:54:32.867234] [INFO ] [MAIN ] PCOR: Loaded 35891 existing records. [2025-09-15T19:54:33.047383] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:33.047821] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-15T19:54:33.047886] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-15T19:54:33.050000] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-15T19:54:33.050101] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-15T19:54:33.266956] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-15T19:54:33.407495] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:34.057891] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-15T19:54:34.264154] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:54:34.270030] [INFO ] [REMOTE ] PCG: Full fetch complete (58398 records). [2025-09-15T19:54:34.270121] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-15T19:54:34.647377] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-09-15T19:54:34.647558] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-09-15T19:54:34.648482] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-09-15T19:54:34.648539] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-09-15T19:54:34.661411] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T19:54:34.660982] [DEBUG] [LOCAL ] PCG: Trimmed 58398 records to 39679 (keeping 150 days of data) [2025-09-15T19:54:34.880584] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-15T19:54:34.915519] [DEBUG] [LOCAL ] PCG: Primary data saved (39679 records). [2025-09-15T19:54:34.915681] [INFO ] [MAIN ] PCG: Full history saved. [2025-09-15T19:54:34.915777] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PCG took 28.2s. Estimated remaining: 1h 16m 58s. Rate: 9.4 symbols/min [2025-09-15T19:54:35.088315] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:35.099532] [DEBUG] [LOCAL ] PCQ: Loaded 8802 existing records from primary storage. [2025-09-15T19:54:35.099751] [INFO ] [MAIN ] PCQ: Loaded 8802 existing records. [2025-09-15T19:54:35.283346] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:35.283615] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-15T19:54:35.283683] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-15T19:54:35.284082] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-15T19:54:35.284132] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-15T19:54:35.636418] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:35.658279] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-15T19:54:35.663473] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:54:36.235530] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:54:36.353722] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T19:54:36.457874] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-15T19:54:37.216237] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:54:37.257912] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-15T19:54:38.057872] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-15T19:54:38.193450] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T19:54:38.857923] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-15T19:54:39.393867] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T19:54:39.415213] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:54:39.657885] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-15T19:54:40.457891] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-15T19:54:41.257886] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-15T19:54:41.311602] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:54:41.343753] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T19:54:41.857521] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T19:54:42.057901] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-15T19:54:42.857882] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-15T19:54:43.129433] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:54:43.657916] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-15T19:54:44.110622] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T19:54:44.135589] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:54:44.457905] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-15T19:54:45.257869] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-15T19:54:45.680827] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:54:46.057893] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-15T19:54:46.349467] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:54:46.857864] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-15T19:54:46.995303] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:54:47.511926] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:54:47.513722] [INFO ] [REMOTE ] PCM: Full fetch complete (7359 records). [2025-09-15T19:54:47.513791] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-15T19:54:47.663095] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-15T19:54:47.871600] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-15T19:54:47.871704] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-15T19:54:47.871892] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-15T19:54:47.871932] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-15T19:54:47.872336] [DEBUG] [LOCAL ] PCM: Trimmed 7359 records to 4893 (keeping 150 days of data) [2025-09-15T19:54:47.901329] [DEBUG] [LOCAL ] PCM: Primary data saved (4893 records). [2025-09-15T19:54:47.901408] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-15T19:54:47.901502] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PCM took 31.1s. Estimated remaining: 1h 16m 54s. Rate: 9.4 symbols/min [2025-09-15T19:54:48.073453] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:48.109207] [DEBUG] [LOCAL ] PD: Loaded 35887 existing records from primary storage. [2025-09-15T19:54:48.109380] [INFO ] [MAIN ] PD: Loaded 35887 existing records. [2025-09-15T19:54:48.284075] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:48.284322] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-15T19:54:48.284373] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-15T19:54:48.285080] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-15T19:54:48.285135] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-15T19:54:48.464107] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-15T19:54:48.638625] [INFO ] [REMOTE ] PD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:48.810715] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:54:49.257922] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-15T19:54:49.567707] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T19:54:49.569821] [INFO ] [REMOTE ] PCQ: Full fetch complete (12939 records). [2025-09-15T19:54:49.569893] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-15T19:54:49.929211] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-15T19:54:49.929296] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-15T19:54:49.929575] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-15T19:54:49.929614] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-15T19:54:49.930088] [DEBUG] [LOCAL ] PCQ: Trimmed 12939 records to 8603 (keeping 150 days of data) [2025-09-15T19:54:49.982311] [DEBUG] [LOCAL ] PCQ: Primary data saved (8603 records). [2025-09-15T19:54:49.982434] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-15T19:54:49.982529] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PCQ took 15.1s. Estimated remaining: 1h 16m 46s. Rate: 9.4 symbols/min [2025-09-15T19:54:50.063075] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-15T19:54:50.151318] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:50.151468] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-15T19:54:50.151507] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-15T19:54:50.151622] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-15T19:54:50.151679] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-15T19:54:50.151747] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-15T19:54:50.151782] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-15T19:54:50.501289] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:50.653150] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:54:50.857885] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-15T19:54:51.208080] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-15T19:54:51.549298] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T19:54:51.657915] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-15T19:54:52.457943] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-15T19:54:53.090554] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T19:54:53.257860] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-15T19:54:53.868337] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:54:54.057878] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-15T19:54:54.462609] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:54:54.798674] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:54:54.803978] [INFO ] [REMOTE ] PCOR: Full fetch complete (52663 records). [2025-09-15T19:54:54.804109] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-15T19:54:54.863089] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-15T19:54:55.189787] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-15T19:54:55.189876] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-15T19:54:55.190820] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-15T19:54:55.190877] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-15T19:54:55.192137] [DEBUG] [LOCAL ] PCOR: Trimmed 52663 records to 35210 (keeping 150 days of data) [2025-09-15T19:54:55.324488] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T19:54:55.422529] [DEBUG] [LOCAL ] PCOR: Primary data saved (35210 records). [2025-09-15T19:54:55.422692] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-15T19:54:55.422787] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PCOR took 22.8s. Estimated remaining: 1h 16m 39s. Rate: 9.4 symbols/min [2025-09-15T19:54:55.591356] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:54:55.629789] [DEBUG] [LOCAL ] PDI: Loaded 37523 existing records from primary storage. [2025-09-15T19:54:55.629956] [INFO ] [MAIN ] PDI: Loaded 37523 existing records. [2025-09-15T19:54:55.662941] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-15T19:54:55.807045] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:54:55.807313] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-15T19:54:55.807361] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-15T19:54:55.808203] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-15T19:54:55.808254] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-15T19:54:56.164514] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T19:54:56.168081] [INFO ] [REMOTE ] PDI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:54:56.457899] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-15T19:54:57.257894] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-15T19:54:57.974080] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:54:58.057957] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-15T19:54:58.350618] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:54:58.857895] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-15T19:54:59.657868] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-15T19:54:59.762300] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:54:59.948911] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-15T19:55:00.219596] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:55:00.457877] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-15T19:55:01.257874] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-15T19:55:01.552216] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-15T19:55:02.024636] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T19:55:02.057885] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-15T19:55:02.393687] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T19:55:02.857883] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-15T19:55:03.657884] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-15T19:55:04.078404] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T19:55:04.079120] [INFO ] [REMOTE ] PDCC: Full fetch complete (1150 records). [2025-09-15T19:55:04.079188] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-15T19:55:04.257098] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T19:55:04.257323] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:55:04.257370] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:55:04.257479] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-15T19:55:04.257542] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-15T19:55:04.257587] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-15T19:55:04.257658] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-15T19:55:04.257722] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PDCC took 14.3s. Estimated remaining: 1h 16m 34s. Rate: 9.4 symbols/min [2025-09-15T19:55:04.430445] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:04.459164] [DEBUG] [LOCAL ] PDM: Loaded 29797 existing records from primary storage. [2025-09-15T19:55:04.458575] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-15T19:55:04.459300] [INFO ] [MAIN ] PDM: Loaded 29797 existing records. [2025-09-15T19:55:04.648271] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:04.648721] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-15T19:55:04.648799] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-15T19:55:04.649430] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-15T19:55:04.649479] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-15T19:55:04.986355] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-15T19:55:05.055101] [INFO ] [REMOTE ] PDM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:05.257875] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-15T19:55:05.773206] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:55:05.777093] [INFO ] [REMOTE ] PCN: Full fetch complete (25950 records). [2025-09-15T19:55:05.777189] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-15T19:55:06.069710] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-15T19:55:06.192743] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-15T19:55:06.192831] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-15T19:55:06.193498] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-15T19:55:06.193544] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-15T19:55:06.195092] [DEBUG] [LOCAL ] PCN: Trimmed 25950 records to 18060 (keeping 150 days of data) [2025-09-15T19:55:06.310130] [DEBUG] [LOCAL ] PCN: Primary data saved (18060 records). [2025-09-15T19:55:06.310293] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-15T19:55:06.310384] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PCN took 35.8s. Estimated remaining: 1h 16m 26s. Rate: 9.4 symbols/min [2025-09-15T19:55:06.490054] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:06.512920] [DEBUG] [LOCAL ] PDO: Loaded 23018 existing records from primary storage. [2025-09-15T19:55:06.513091] [INFO ] [MAIN ] PDO: Loaded 23018 existing records. [2025-09-15T19:55:06.693580] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:06.693876] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-15T19:55:06.693930] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-15T19:55:06.694687] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-15T19:55:06.694744] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-15T19:55:06.865016] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-15T19:55:07.052134] [INFO ] [REMOTE ] PDO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:07.098287] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T19:55:07.162280] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:55:07.657865] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-15T19:55:08.457950] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-15T19:55:08.688740] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T19:55:08.881858] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:55:09.257924] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-15T19:55:09.917143] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:55:10.057862] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-15T19:55:10.606197] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:55:10.857930] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-15T19:55:11.537242] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:55:11.657888] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-15T19:55:11.876350] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T19:55:12.457879] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-15T19:55:13.160410] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T19:55:13.257908] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-15T19:55:13.659497] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:55:14.057880] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-15T19:55:14.857894] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-15T19:55:15.050461] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T19:55:15.657885] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-15T19:55:15.699263] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:55:15.705202] [INFO ] [REMOTE ] PD: Full fetch complete (51391 records). [2025-09-15T19:55:15.705355] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-15T19:55:16.095152] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-15T19:55:16.095340] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-15T19:55:16.096255] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-15T19:55:16.096323] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-15T19:55:16.098057] [DEBUG] [LOCAL ] PD: Trimmed 51391 records to 35268 (keeping 150 days of data) [2025-09-15T19:55:16.178520] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T19:55:16.342368] [DEBUG] [LOCAL ] PD: Primary data saved (35268 records). [2025-09-15T19:55:16.342536] [INFO ] [MAIN ] PD: Full history saved. [2025-09-15T19:55:16.343142] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PD took 28.4s. Estimated remaining: 1h 16m 21s. Rate: 9.4 symbols/min [2025-09-15T19:55:16.462985] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-15T19:55:16.521170] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:16.536492] [DEBUG] [LOCAL ] PDS: Loaded 12577 existing records from primary storage. [2025-09-15T19:55:16.536657] [INFO ] [MAIN ] PDS: Loaded 12577 existing records. [2025-09-15T19:55:16.720329] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:16.720614] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-15T19:55:16.720709] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-15T19:55:16.721084] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-15T19:55:16.721128] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-15T19:55:17.096961] [INFO ] [REMOTE ] PDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:17.120318] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:55:17.257866] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-15T19:55:18.057911] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-15T19:55:18.402707] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T19:55:18.725538] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T19:55:18.857855] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-15T19:55:19.508928] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:55:19.657943] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-15T19:55:20.057382] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:55:20.457913] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-15T19:55:20.645879] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:55:21.257887] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-15T19:55:22.057906] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-15T19:55:22.273365] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T19:55:22.306004] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T19:55:22.312063] [INFO ] [REMOTE ] PDI: Full fetch complete (54717 records). [2025-09-15T19:55:22.312236] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-15T19:55:22.705377] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-15T19:55:22.705474] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-15T19:55:22.706343] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-15T19:55:22.706387] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-15T19:55:22.709037] [DEBUG] [LOCAL ] PDI: Trimmed 54717 records to 36823 (keeping 150 days of data) [2025-09-15T19:55:22.882122] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-15T19:55:22.946204] [DEBUG] [LOCAL ] PDI: Primary data saved (36823 records). [2025-09-15T19:55:22.946325] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-15T19:55:22.946442] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDI took 27.5s. Estimated remaining: 1h 16m 15s. Rate: 9.4 symbols/min [2025-09-15T19:55:23.121809] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:23.138390] [DEBUG] [LOCAL ] PDT: Loaded 13012 existing records from primary storage. [2025-09-15T19:55:23.138531] [INFO ] [MAIN ] PDT: Loaded 13012 existing records. [2025-09-15T19:55:23.319248] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:23.319769] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-15T19:55:23.319933] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-15T19:55:23.320674] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-15T19:55:23.320746] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-15T19:55:23.440373] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T19:55:23.663005] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-15T19:55:23.720306] [INFO ] [REMOTE ] PDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:24.078592] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T19:55:24.457892] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-15T19:55:24.788109] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:55:25.257854] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-15T19:55:25.735746] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:55:25.740071] [INFO ] [REMOTE ] PDM: Full fetch complete (43368 records). [2025-09-15T19:55:25.740191] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-15T19:55:26.067132] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-15T19:55:26.116704] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-15T19:55:26.116783] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-15T19:55:26.117671] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-15T19:55:26.117724] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-15T19:55:26.119222] [DEBUG] [LOCAL ] PDM: Trimmed 43368 records to 29063 (keeping 150 days of data) [2025-09-15T19:55:26.299137] [DEBUG] [LOCAL ] PDM: Primary data saved (29063 records). [2025-09-15T19:55:26.299286] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-15T19:55:26.299401] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDM took 22.0s. Estimated remaining: 1h 16m 7s. Rate: 9.4 symbols/min [2025-09-15T19:55:26.468505] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:26.468695] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-09-15T19:55:26.468736] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-09-15T19:55:26.468885] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-15T19:55:26.468934] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-15T19:55:26.468976] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-09-15T19:55:26.469009] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-15T19:55:26.829636] [INFO ] [REMOTE ] PDX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:26.848507] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:55:26.857811] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-15T19:55:26.899893] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T19:55:27.657900] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-15T19:55:27.749998] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:55:28.457877] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-15T19:55:28.862293] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T19:55:29.214225] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:55:29.257894] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-15T19:55:30.032886] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T19:55:30.057845] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-15T19:55:30.857908] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-15T19:55:31.131626] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:55:31.658131] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-15T19:55:32.060144] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:55:32.072546] [INFO ] [REMOTE ] PDO: Full fetch complete (34714 records). [2025-09-15T19:55:32.072847] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-15T19:55:32.463154] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-15T19:55:32.629340] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-15T19:55:32.629552] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-15T19:55:32.631236] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-15T19:55:32.631359] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-15T19:55:32.648025] [DEBUG] [LOCAL ] PDO: Trimmed 34714 records to 22514 (keeping 150 days of data) [2025-09-15T19:55:32.650216] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:55:32.878501] [DEBUG] [LOCAL ] PDO: Primary data saved (22514 records). [2025-09-15T19:55:32.878841] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-15T19:55:32.878998] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PDO took 26.6s. Estimated remaining: 1h 16m 1s. Rate: 9.4 symbols/min [2025-09-15T19:55:33.105290] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:33.151573] [DEBUG] [LOCAL ] PEB: Loaded 38074 existing records from primary storage. [2025-09-15T19:55:33.151781] [INFO ] [MAIN ] PEB: Loaded 38074 existing records. [2025-09-15T19:55:33.263018] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-15T19:55:33.334588] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:33.334854] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-15T19:55:33.334914] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-15T19:55:33.335940] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-15T19:55:33.335997] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-15T19:55:33.536423] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T19:55:33.726299] [INFO ] [REMOTE ] PEB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:34.057918] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-15T19:55:34.187432] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:55:34.692891] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T19:55:34.857860] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-15T19:55:35.552633] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:55:35.657885] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-15T19:55:36.457898] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-15T19:55:36.760322] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T19:55:37.257890] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-15T19:55:37.409472] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:55:38.057917] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-15T19:55:38.233776] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T19:55:38.641907] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T19:55:38.857891] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-15T19:55:39.638700] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T19:55:39.657820] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-15T19:55:40.457878] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-15T19:55:40.493073] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:55:41.257892] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-15T19:55:41.325896] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:55:41.328151] [INFO ] [REMOTE ] PDT: Full fetch complete (19249 records). [2025-09-15T19:55:41.328246] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-15T19:55:41.688930] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-15T19:55:41.689019] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-15T19:55:41.689421] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-15T19:55:41.689460] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-15T19:55:41.690061] [DEBUG] [LOCAL ] PDT: Trimmed 19249 records to 12890 (keeping 150 days of data) [2025-09-15T19:55:41.774660] [DEBUG] [LOCAL ] PDT: Primary data saved (12890 records). [2025-09-15T19:55:41.774798] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-15T19:55:41.774891] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PDT took 18.8s. Estimated remaining: 1h 15m 56s. Rate: 9.4 symbols/min [2025-09-15T19:55:41.945565] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:41.991921] [DEBUG] [LOCAL ] PEG: Loaded 40001 existing records from primary storage. [2025-09-15T19:55:41.992120] [INFO ] [MAIN ] PEG: Loaded 40001 existing records. [2025-09-15T19:55:42.063157] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-15T19:55:42.183753] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T19:55:42.187219] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:42.189320] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-15T19:55:42.189788] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-15T19:55:42.190064] [INFO ] [REMOTE ] PDX: Full fetch complete (16230 records). [2025-09-15T19:55:42.190172] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-15T19:55:42.221611] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-15T19:55:42.221759] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-15T19:55:42.861333] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-15T19:55:42.958818] [INFO ] [REMOTE ] PEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:42.959561] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-15T19:55:42.959700] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-15T19:55:42.960214] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-15T19:55:42.960274] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-15T19:55:42.961073] [DEBUG] [LOCAL ] PDX: Trimmed 16230 records to 10423 (keeping 150 days of data) [2025-09-15T19:55:42.973334] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T19:55:43.044605] [DEBUG] [LOCAL ] PDX: Primary data saved (10423 records). [2025-09-15T19:55:43.044766] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-15T19:55:43.044846] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PDX took 16.7s. Estimated remaining: 1h 15m 47s. Rate: 9.4 symbols/min [2025-09-15T19:55:43.216260] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:43.238443] [DEBUG] [LOCAL ] PEN: Loaded 22890 existing records from primary storage. [2025-09-15T19:55:43.238604] [INFO ] [MAIN ] PEN: Loaded 22890 existing records. [2025-09-15T19:55:43.420816] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:43.421134] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-15T19:55:43.421184] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-15T19:55:43.421807] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-15T19:55:43.421860] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-15T19:55:43.663064] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-15T19:55:43.776787] [INFO ] [REMOTE ] PEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:44.263768] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:55:44.421882] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T19:55:44.457840] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-15T19:55:45.189700] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:55:45.191725] [INFO ] [REMOTE ] PDS: Full fetch complete (20425 records). [2025-09-15T19:55:45.191822] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-15T19:55:45.263127] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-15T19:55:45.563297] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-15T19:55:45.563380] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-15T19:55:45.563846] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-15T19:55:45.563889] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-15T19:55:45.564592] [DEBUG] [LOCAL ] PDS: Trimmed 20425 records to 12126 (keeping 150 days of data) [2025-09-15T19:55:45.642799] [DEBUG] [LOCAL ] PDS: Primary data saved (12126 records). [2025-09-15T19:55:45.642949] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-15T19:55:45.643052] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PDS took 29.3s. Estimated remaining: 1h 15m 39s. Rate: 9.4 symbols/min [2025-09-15T19:55:45.813917] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:55:45.823253] [DEBUG] [LOCAL ] PEO: Loaded 8194 existing records from primary storage. [2025-09-15T19:55:45.823359] [INFO ] [MAIN ] PEO: Loaded 8194 existing records. [2025-09-15T19:55:46.003827] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:55:46.004075] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-15T19:55:46.004122] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-15T19:55:46.004570] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-15T19:55:46.004621] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-15T19:55:46.067982] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-15T19:55:46.399768] [INFO ] [REMOTE ] PEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:55:46.849546] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:55:46.861320] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-15T19:55:47.539371] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T19:55:47.552503] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:55:47.657896] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-15T19:55:48.457886] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-15T19:55:49.019120] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:55:49.257874] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-15T19:55:49.888090] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T19:55:50.011980] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:55:50.057885] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-15T19:55:50.857873] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-15T19:55:51.658188] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-15T19:55:51.664730] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:55:51.788636] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T19:55:52.457869] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-15T19:55:53.139176] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:55:53.257840] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-15T19:55:54.057889] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-15T19:55:54.387387] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:55:54.595430] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T19:55:54.857924] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-15T19:55:55.657918] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-15T19:55:55.849242] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T19:55:56.039199] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:55:56.193021] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T19:55:56.457887] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-15T19:55:57.257874] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-15T19:55:57.876845] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:55:58.057902] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-15T19:55:58.105521] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:55:58.857877] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-15T19:55:59.657879] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-15T19:55:59.828657] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T19:56:00.220755] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:56:00.435013] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:56:00.457835] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-15T19:56:01.257929] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-15T19:56:02.057875] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-15T19:56:02.166230] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T19:56:02.502471] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T19:56:02.857880] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-15T19:56:03.528618] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:56:03.657878] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-15T19:56:04.332327] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T19:56:04.457835] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-15T19:56:04.593837] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T19:56:05.257870] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-15T19:56:05.753630] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:56:05.757099] [INFO ] [REMOTE ] PEN: Full fetch complete (33990 records). [2025-09-15T19:56:05.757192] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-15T19:56:06.062931] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-15T19:56:06.134079] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-15T19:56:06.134221] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-15T19:56:06.135005] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-15T19:56:06.135062] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-15T19:56:06.136220] [DEBUG] [LOCAL ] PEN: Trimmed 33990 records to 22345 (keeping 150 days of data) [2025-09-15T19:56:06.275891] [DEBUG] [LOCAL ] PEN: Primary data saved (22345 records). [2025-09-15T19:56:06.276037] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-15T19:56:06.276122] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEN took 23.2s. Estimated remaining: 1h 15m 39s. Rate: 9.4 symbols/min [2025-09-15T19:56:06.453701] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:06.465912] [DEBUG] [LOCAL ] PERF: Loaded 11386 existing records from primary storage. [2025-09-15T19:56:06.466026] [INFO ] [MAIN ] PERF: Loaded 11386 existing records. [2025-09-15T19:56:06.643741] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:06.644008] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-15T19:56:06.644054] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-15T19:56:06.644494] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-15T19:56:06.644549] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-15T19:56:06.860813] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-15T19:56:06.910038] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T19:56:06.937496] [INFO ] [REMOTE ] PEO: Full fetch complete (11775 records). [2025-09-15T19:56:06.988297] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-15T19:56:07.019129] [INFO ] [REMOTE ] PERF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:07.285091] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T19:56:07.436341] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-15T19:56:07.436453] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-15T19:56:07.436833] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-15T19:56:07.436890] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-15T19:56:07.437695] [DEBUG] [LOCAL ] PEO: Trimmed 11775 records to 7977 (keeping 150 days of data) [2025-09-15T19:56:07.493313] [DEBUG] [LOCAL ] PEO: Primary data saved (7977 records). [2025-09-15T19:56:07.493472] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-15T19:56:07.493572] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEO took 21.9s. Estimated remaining: 1h 15m 30s. Rate: 9.4 symbols/min [2025-09-15T19:56:07.664574] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-15T19:56:07.667980] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:07.668901] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-15T19:56:07.668949] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-15T19:56:07.669102] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-15T19:56:07.669167] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-15T19:56:07.669224] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-15T19:56:07.669269] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-15T19:56:08.029753] [INFO ] [REMOTE ] PEW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:08.464667] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-15T19:56:08.486777] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T19:56:08.706687] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:56:08.706997] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-15T19:56:09.257839] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-15T19:56:09.303150] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T19:56:09.515058] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:56:09.515357] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-15T19:56:10.057921] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-15T19:56:10.857977] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-15T19:56:11.082181] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:56:11.082663] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-15T19:56:11.556010] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T19:56:11.562743] [INFO ] [REMOTE ] PEG: Full fetch complete (57739 records). [2025-09-15T19:56:11.562975] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-15T19:56:11.663126] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-15T19:56:11.973657] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-09-15T19:56:11.973746] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-09-15T19:56:11.974776] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-09-15T19:56:11.974825] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-09-15T19:56:11.976103] [DEBUG] [LOCAL ] PEG: Trimmed 57739 records to 39246 (keeping 150 days of data) [2025-09-15T19:56:12.231888] [DEBUG] [LOCAL ] PEG: Primary data saved (39246 records). [2025-09-15T19:56:12.232046] [INFO ] [MAIN ] PEG: Full history saved. [2025-09-15T19:56:12.232130] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PEG took 30.5s. Estimated remaining: 1h 15m 23s. Rate: 9.4 symbols/min [2025-09-15T19:56:12.408387] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:12.414000] [DEBUG] [LOCAL ] PFD: Loaded 3832 existing records from primary storage. [2025-09-15T19:56:12.414112] [INFO ] [MAIN ] PFD: Loaded 3832 existing records. [2025-09-15T19:56:12.480102] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-15T19:56:12.588416] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T19:56:12.612547] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:12.612778] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-15T19:56:12.612828] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-15T19:56:12.613080] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-15T19:56:12.613151] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-15T19:56:12.728489] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:56:12.763013] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-15T19:56:12.992306] [INFO ] [REMOTE ] PFD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:13.257869] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-15T19:56:13.885399] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T19:56:14.057873] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-15T19:56:14.857888] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-15T19:56:14.972044] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T19:56:15.065817] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:56:15.066171] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-15T19:56:15.657897] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-15T19:56:16.294637] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T19:56:16.457913] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-15T19:56:17.257955] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-15T19:56:18.040855] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:56:18.057440] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:56:18.062609] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-15T19:56:18.064270] [INFO ] [REMOTE ] PEB: Full fetch complete (55028 records). [2025-09-15T19:56:18.064353] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-15T19:56:18.457668] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-15T19:56:18.457756] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-15T19:56:18.458795] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-15T19:56:18.458841] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-15T19:56:18.460176] [DEBUG] [LOCAL ] PEB: Trimmed 55028 records to 37283 (keeping 150 days of data) [2025-09-15T19:56:18.700538] [DEBUG] [LOCAL ] PEB: Primary data saved (37283 records). [2025-09-15T19:56:18.700788] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-15T19:56:18.701721] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PEB took 45.8s. Estimated remaining: 1h 15m 17s. Rate: 9.4 symbols/min [2025-09-15T19:56:18.812173] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:56:18.862945] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-15T19:56:18.885878] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:18.926065] [DEBUG] [LOCAL ] PFE: Loaded 40553 existing records from primary storage. [2025-09-15T19:56:18.926216] [INFO ] [MAIN ] PFE: Loaded 40553 existing records. [2025-09-15T19:56:19.102501] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:19.102779] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-15T19:56:19.102829] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-15T19:56:19.103818] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-15T19:56:19.103870] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-15T19:56:19.472202] [INFO ] [REMOTE ] PFE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:19.657887] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-15T19:56:20.457889] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-15T19:56:20.541191] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T19:56:20.725518] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:56:20.977270] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T19:56:21.257886] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-15T19:56:22.057935] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-15T19:56:22.874906] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-15T19:56:22.878948] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T19:56:23.029166] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:56:23.657883] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-15T19:56:24.230556] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T19:56:24.457876] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-15T19:56:25.257983] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-15T19:56:25.276604] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:56:25.388124] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T19:56:26.057934] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-15T19:56:26.689179] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:56:26.693676] [INFO ] [REMOTE ] PEW: Full fetch complete (13863 records). [2025-09-15T19:56:26.693771] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-15T19:56:26.864724] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-15T19:56:26.901586] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 43 unique days, need 150 days [2025-09-15T19:56:26.903692] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:56:26.903778] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:56:26.903875] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-15T19:56:26.903962] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-15T19:56:26.904003] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-15T19:56:26.904058] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-15T19:56:26.904138] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PEW took 19.4s. Estimated remaining: 1h 15m 11s. Rate: 9.4 symbols/min [2025-09-15T19:56:27.003546] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T19:56:27.037956] [INFO ] [REMOTE ] PERF: Full fetch complete (16095 records). [2025-09-15T19:56:27.069913] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-15T19:56:27.157367] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:27.483581] [DEBUG] [LOCAL ] PFGC: Loaded 35492 existing records from primary storage. [2025-09-15T19:56:27.497675] [INFO ] [MAIN ] PFGC: Loaded 35492 existing records. [2025-09-15T19:56:27.568991] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-15T19:56:27.591836] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-15T19:56:27.603455] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-15T19:56:27.608631] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-15T19:56:27.650877] [DEBUG] [LOCAL ] PERF: Trimmed 16095 records to 11331 (keeping 150 days of data) [2025-09-15T19:56:27.679275] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-15T19:56:27.710970] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:27.711981] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-15T19:56:27.712029] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-15T19:56:27.739510] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-15T19:56:27.745802] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-15T19:56:28.146261] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:28.153403] [DEBUG] [LOCAL ] PERF: Primary data saved (11331 records). [2025-09-15T19:56:28.153493] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-15T19:56:28.153585] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PERF took 21.9s. Estimated remaining: 1h 15m 3s. Rate: 9.4 symbols/min [2025-09-15T19:56:28.329881] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:28.333981] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:56:28.343213] [DEBUG] [LOCAL ] PFH: Loaded 5261 existing records from primary storage. [2025-09-15T19:56:28.343323] [INFO ] [MAIN ] PFH: Loaded 5261 existing records. [2025-09-15T19:56:28.462950] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-15T19:56:28.544092] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:28.544340] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-15T19:56:28.544389] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-15T19:56:28.544821] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-15T19:56:28.544872] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-15T19:56:28.916029] [INFO ] [REMOTE ] PFH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:29.200680] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-15T19:56:29.257839] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-15T19:56:29.714335] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T19:56:30.057910] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-15T19:56:30.539922] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:56:30.857873] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-15T19:56:31.380368] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T19:56:31.657918] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-15T19:56:32.016394] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-15T19:56:32.103435] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T19:56:32.457935] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-15T19:56:32.930380] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:56:33.257915] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-15T19:56:33.830811] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:56:34.057912] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-15T19:56:34.857889] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-15T19:56:35.462890] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:56:35.464238] [INFO ] [REMOTE ] PFD: Full fetch complete (5520 records). [2025-09-15T19:56:35.464334] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-15T19:56:35.668215] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-15T19:56:35.832332] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-15T19:56:35.832416] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-15T19:56:35.832622] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-15T19:56:35.832682] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-15T19:56:35.833100] [DEBUG] [LOCAL ] PFD: Trimmed 5520 records to 3798 (keeping 150 days of data) [2025-09-15T19:56:35.859192] [DEBUG] [LOCAL ] PFD: Primary data saved (3798 records). [2025-09-15T19:56:35.859333] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-15T19:56:35.859446] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PFD took 23.6s. Estimated remaining: 1h 14m 57s. Rate: 9.4 symbols/min [2025-09-15T19:56:36.040360] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:36.051434] [DEBUG] [LOCAL ] PFL: Loaded 9928 existing records from primary storage. [2025-09-15T19:56:36.051564] [INFO ] [MAIN ] PFL: Loaded 9928 existing records. [2025-09-15T19:56:36.232380] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:36.232627] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-15T19:56:36.232697] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-15T19:56:36.233063] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-15T19:56:36.233117] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-15T19:56:36.460677] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-15T19:56:36.596215] [INFO ] [REMOTE ] PFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:36.750136] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-09-15T19:56:37.125349] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:56:37.253349] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:56:37.257805] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-15T19:56:37.888848] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:56:38.057886] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-15T19:56:38.857877] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-15T19:56:39.629419] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:56:39.657881] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-15T19:56:40.190203] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T19:56:40.457871] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-15T19:56:41.257872] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-15T19:56:41.431679] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-15T19:56:41.871447] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:56:41.973566] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T19:56:42.057920] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-15T19:56:42.557028] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:56:42.558187] [INFO ] [REMOTE ] PFH: Full fetch complete (7648 records). [2025-09-15T19:56:42.558260] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-15T19:56:42.862930] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-15T19:56:42.920371] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-15T19:56:42.920467] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-15T19:56:42.920719] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-15T19:56:42.920768] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-15T19:56:42.921209] [DEBUG] [LOCAL ] PFH: Trimmed 7648 records to 5083 (keeping 150 days of data) [2025-09-15T19:56:42.953162] [DEBUG] [LOCAL ] PFH: Primary data saved (5083 records). [2025-09-15T19:56:42.953277] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-15T19:56:42.953376] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFH took 14.8s. Estimated remaining: 1h 14m 51s. Rate: 9.4 symbols/min [2025-09-15T19:56:43.124574] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:43.157210] [DEBUG] [LOCAL ] PFLT: Loaded 31971 existing records from primary storage. [2025-09-15T19:56:43.157415] [INFO ] [MAIN ] PFLT: Loaded 31971 existing records. [2025-09-15T19:56:43.345712] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:43.345995] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-15T19:56:43.346058] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-15T19:56:43.346783] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-15T19:56:43.346834] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-15T19:56:43.662985] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-15T19:56:43.699500] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:44.453572] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T19:56:44.457812] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-15T19:56:45.257873] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-15T19:56:45.328053] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:56:45.585732] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-15T19:56:46.057904] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-15T19:56:46.572557] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T19:56:46.724756] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T19:56:46.857875] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-15T19:56:47.657905] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-15T19:56:48.429037] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T19:56:48.457851] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-15T19:56:49.257867] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-15T19:56:50.030747] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-15T19:56:50.050426] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:56:50.063307] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-15T19:56:50.082463] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:56:50.567143] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T19:56:50.857889] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-15T19:56:51.657877] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-15T19:56:52.338402] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T19:56:52.457910] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-15T19:56:53.110109] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-15T19:56:53.118301] [INFO ] [REMOTE ] PFE: Full fetch complete (58493 records). [2025-09-15T19:56:53.118458] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-15T19:56:53.263024] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-15T19:56:53.551526] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-09-15T19:56:53.551634] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-09-15T19:56:53.553162] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-09-15T19:56:53.553224] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-09-15T19:56:53.554721] [DEBUG] [LOCAL ] PFE: Trimmed 58493 records to 39773 (keeping 150 days of data) [2025-09-15T19:56:53.832079] [DEBUG] [LOCAL ] PFE: Primary data saved (39773 records). [2025-09-15T19:56:53.832247] [INFO ] [MAIN ] PFE: Full history saved. [2025-09-15T19:56:53.832352] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFE took 35.1s. Estimated remaining: 1h 14m 46s. Rate: 9.4 symbols/min [2025-09-15T19:56:54.008821] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:54.027012] [DEBUG] [LOCAL ] PFN: Loaded 15751 existing records from primary storage. [2025-09-15T19:56:54.027155] [INFO ] [MAIN ] PFN: Loaded 15751 existing records. [2025-09-15T19:56:54.058668] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-15T19:56:54.206252] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T19:56:54.253366] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:54.253660] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-15T19:56:54.253715] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-15T19:56:54.254279] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-15T19:56:54.254334] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-15T19:56:54.656275] [INFO ] [REMOTE ] PFN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:54.788739] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:56:54.857833] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-15T19:56:55.056584] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:56:55.657872] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-15T19:56:56.437016] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T19:56:56.457817] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-15T19:56:56.976802] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:56:57.257872] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-15T19:56:57.903911] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T19:56:57.909471] [INFO ] [REMOTE ] PFGC: Full fetch complete (51090 records). [2025-09-15T19:56:57.909662] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-15T19:56:58.063024] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-15T19:56:58.306121] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-15T19:56:58.306336] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-15T19:56:58.307585] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-15T19:56:58.307682] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-15T19:56:58.309385] [DEBUG] [LOCAL ] PFGC: Trimmed 51090 records to 34948 (keeping 150 days of data) [2025-09-15T19:56:58.524103] [DEBUG] [LOCAL ] PFGC: Primary data saved (34948 records). [2025-09-15T19:56:58.524303] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-15T19:56:58.524889] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFGC took 31.6s. Estimated remaining: 1h 14m 39s. Rate: 9.4 symbols/min [2025-09-15T19:56:58.694472] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:56:58.702420] [DEBUG] [LOCAL ] PFO: Loaded 4456 existing records from primary storage. [2025-09-15T19:56:58.702558] [INFO ] [MAIN ] PFO: Loaded 4456 existing records. [2025-09-15T19:56:58.884952] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:56:58.882013] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-15T19:56:58.886346] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-15T19:56:58.886456] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-15T19:56:58.886901] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-15T19:56:58.886965] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-15T19:56:59.071374] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T19:56:59.290326] [INFO ] [REMOTE ] PFO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:56:59.292157] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T19:56:59.657875] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-15T19:56:59.823865] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T19:56:59.826368] [INFO ] [REMOTE ] PFL: Full fetch complete (15170 records). [2025-09-15T19:56:59.826450] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-15T19:57:00.183070] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-15T19:57:00.183147] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-15T19:57:00.183478] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-15T19:57:00.183518] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-15T19:57:00.184035] [DEBUG] [LOCAL ] PFL: Trimmed 15170 records to 9701 (keeping 150 days of data) [2025-09-15T19:57:00.249360] [DEBUG] [LOCAL ] PFL: Primary data saved (9701 records). [2025-09-15T19:57:00.249604] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-15T19:57:00.249759] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFL took 24.4s. Estimated remaining: 1h 14m 31s. Rate: 9.4 symbols/min [2025-09-15T19:57:00.429772] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:00.456782] [DEBUG] [LOCAL ] PFS: Loaded 26037 existing records from primary storage. [2025-09-15T19:57:00.456934] [INFO ] [MAIN ] PFS: Loaded 26037 existing records. [2025-09-15T19:57:00.468194] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-15T19:57:00.643602] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:00.643913] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-15T19:57:00.643965] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-15T19:57:00.644789] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-15T19:57:00.644843] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-15T19:57:00.993948] [INFO ] [REMOTE ] PFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:01.199129] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T19:57:01.257831] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-15T19:57:01.684132] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:57:02.057877] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-15T19:57:02.611157] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T19:57:02.857877] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-15T19:57:02.957669] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T19:57:03.657871] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-15T19:57:04.401752] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:57:04.406867] [INFO ] [REMOTE ] PFLT: Full fetch complete (47704 records). [2025-09-15T19:57:04.407047] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-15T19:57:04.470451] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-15T19:57:04.727501] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:57:04.824402] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-15T19:57:04.824482] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-15T19:57:04.825410] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-15T19:57:04.825466] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-15T19:57:04.826481] [DEBUG] [LOCAL ] PFLT: Trimmed 47704 records to 31333 (keeping 150 days of data) [2025-09-15T19:57:05.029260] [DEBUG] [LOCAL ] PFLT: Primary data saved (31333 records). [2025-09-15T19:57:05.029411] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-15T19:57:05.029512] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFLT took 22.1s. Estimated remaining: 1h 14m 24s. Rate: 9.4 symbols/min [2025-09-15T19:57:05.204795] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:05.225897] [DEBUG] [LOCAL ] PFSI: Loaded 21119 existing records from primary storage. [2025-09-15T19:57:05.226048] [INFO ] [MAIN ] PFSI: Loaded 21119 existing records. [2025-09-15T19:57:05.263003] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-15T19:57:05.416529] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:05.416834] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-15T19:57:05.416883] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-15T19:57:05.417534] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-15T19:57:05.417597] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-15T19:57:05.780974] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:06.057909] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-15T19:57:06.606976] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:57:06.806903] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-15T19:57:06.857891] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-15T19:57:07.657899] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-15T19:57:07.810053] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T19:57:08.448330] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:57:08.457822] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-15T19:57:08.601012] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:57:09.257876] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-15T19:57:10.057898] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-15T19:57:10.566440] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T19:57:10.857845] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-15T19:57:10.908633] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:57:10.956624] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:57:11.657879] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-15T19:57:11.673695] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:57:12.304073] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T19:57:12.457876] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-15T19:57:13.077409] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:57:13.257890] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-15T19:57:14.057913] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-15T19:57:14.137314] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T19:57:14.141260] [INFO ] [REMOTE ] PFN: Full fetch complete (23284 records). [2025-09-15T19:57:14.141415] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-15T19:57:14.502488] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-15T19:57:14.502571] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-15T19:57:14.503069] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-15T19:57:14.503111] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-15T19:57:14.503726] [DEBUG] [LOCAL ] PFN: Trimmed 23284 records to 15476 (keeping 150 days of data) [2025-09-15T19:57:14.601049] [DEBUG] [LOCAL ] PFN: Primary data saved (15476 records). [2025-09-15T19:57:14.601233] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-15T19:57:14.601335] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PFN took 20.8s. Estimated remaining: 1h 14m 19s. Rate: 9.4 symbols/min [2025-09-15T19:57:14.769609] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:14.816464] [DEBUG] [LOCAL ] PG: Loaded 40493 existing records from primary storage. [2025-09-15T19:57:14.816605] [INFO ] [MAIN ] PG: Loaded 40493 existing records. [2025-09-15T19:57:14.863059] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-15T19:57:14.995879] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:14.996107] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-15T19:57:14.996162] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-15T19:57:14.997125] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-15T19:57:14.997184] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-15T19:57:15.359028] [INFO ] [REMOTE ] PG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:15.561617] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:57:15.657840] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-15T19:57:16.138261] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T19:57:16.457874] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-15T19:57:16.641091] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T19:57:17.257892] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-15T19:57:17.632966] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:57:18.057961] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-15T19:57:18.656397] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:57:18.863018] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-15T19:57:18.874825] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:57:19.657886] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-15T19:57:20.049513] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:57:20.457875] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-15T19:57:21.257852] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-15T19:57:21.715695] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T19:57:21.716585] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T19:57:21.859200] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:57:22.057887] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-15T19:57:22.857873] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-15T19:57:23.166737] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T19:57:23.391966] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:57:23.657916] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-15T19:57:24.457884] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-15T19:57:24.598322] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T19:57:25.257875] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-15T19:57:26.039295] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T19:57:26.040881] [INFO ] [REMOTE ] PFO: Full fetch complete (5949 records). [2025-09-15T19:57:26.040950] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-15T19:57:26.063048] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-15T19:57:26.397440] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-15T19:57:26.397542] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-15T19:57:26.397772] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-15T19:57:26.397818] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-15T19:57:26.398406] [DEBUG] [LOCAL ] PFO: Trimmed 5949 records to 4455 (keeping 150 days of data) [2025-09-15T19:57:26.426449] [DEBUG] [LOCAL ] PFO: Primary data saved (4455 records). [2025-09-15T19:57:26.426559] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-15T19:57:26.426696] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PFO took 27.9s. Estimated remaining: 1h 14m 15s. Rate: 9.4 symbols/min [2025-09-15T19:57:26.603447] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:26.611527] [DEBUG] [LOCAL ] PGP: Loaded 4011 existing records from primary storage. [2025-09-15T19:57:26.627493] [INFO ] [MAIN ] PGP: Loaded 4011 existing records. [2025-09-15T19:57:26.747171] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-15T19:57:26.846706] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:26.847004] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-15T19:57:26.847056] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-15T19:57:26.847385] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-15T19:57:26.847441] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-15T19:57:26.863032] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-15T19:57:27.219593] [INFO ] [REMOTE ] PGP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:27.241923] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:57:27.657890] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-15T19:57:28.049963] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T19:57:28.457836] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-15T19:57:28.680478] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T19:57:28.921844] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T19:57:29.257870] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-15T19:57:30.057862] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-15T19:57:30.321575] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:57:30.857922] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-15T19:57:31.657917] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-15T19:57:32.199887] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-15T19:57:32.204063] [INFO ] [REMOTE ] PFS: Full fetch complete (38629 records). [2025-09-15T19:57:32.204159] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-15T19:57:32.463295] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-15T19:57:32.573894] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-15T19:57:32.573971] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-15T19:57:32.574752] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-15T19:57:32.574799] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-15T19:57:32.575728] [DEBUG] [LOCAL ] PFS: Trimmed 38629 records to 25329 (keeping 150 days of data) [2025-09-15T19:57:32.683591] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:57:32.750314] [DEBUG] [LOCAL ] PFS: Primary data saved (25329 records). [2025-09-15T19:57:32.750453] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-15T19:57:32.750556] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PFS took 32.5s. Estimated remaining: 1h 14m 8s. Rate: 9.4 symbols/min [2025-09-15T19:57:32.922724] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:32.965607] [DEBUG] [LOCAL ] PGR: Loaded 39822 existing records from primary storage. [2025-09-15T19:57:32.965808] [INFO ] [MAIN ] PGR: Loaded 39822 existing records. [2025-09-15T19:57:33.140405] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:33.140707] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-15T19:57:33.140784] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-15T19:57:33.141750] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-15T19:57:33.141813] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-15T19:57:33.263027] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-15T19:57:33.491918] [INFO ] [REMOTE ] PGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:33.875624] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T19:57:33.961491] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:57:34.057884] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-15T19:57:34.268554] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (3.41 seconds). [2025-09-15T19:57:34.666860] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:57:34.857921] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-15T19:57:35.342795] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T19:57:35.657927] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-15T19:57:36.457955] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-15T19:57:36.868576] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T19:57:36.872957] [INFO ] [REMOTE ] PFSI: Full fetch complete (30976 records). [2025-09-15T19:57:36.873087] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-15T19:57:37.261487] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-15T19:57:37.262584] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-15T19:57:37.262672] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-15T19:57:37.263354] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-15T19:57:37.263511] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-15T19:57:37.264393] [DEBUG] [LOCAL ] PFSI: Trimmed 30976 records to 20742 (keeping 150 days of data) [2025-09-15T19:57:37.403060] [DEBUG] [LOCAL ] PFSI: Primary data saved (20742 records). [2025-09-15T19:57:37.403186] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-15T19:57:37.403286] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PFSI took 32.4s. Estimated remaining: 1h 14m 1s. Rate: 9.4 symbols/min [2025-09-15T19:57:37.572700] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:37.607663] [DEBUG] [LOCAL ] PGRE: Loaded 35261 existing records from primary storage. [2025-09-15T19:57:37.607807] [INFO ] [MAIN ] PGRE: Loaded 35261 existing records. [2025-09-15T19:57:37.790659] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:37.791058] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-15T19:57:37.791180] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-15T19:57:37.791862] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-15T19:57:37.791958] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-15T19:57:38.032281] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T19:57:38.064414] [INFO ] [REMOTE ] PGP: Full fetch complete (5940 records). [2025-09-15T19:57:38.064328] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-15T19:57:38.081125] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-15T19:57:38.225447] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:38.343894] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T19:57:38.550178] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-15T19:57:38.550261] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-15T19:57:38.550424] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-15T19:57:38.550481] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-15T19:57:38.550883] [DEBUG] [LOCAL ] PGP: Trimmed 5940 records to 3996 (keeping 150 days of data) [2025-09-15T19:57:38.575158] [DEBUG] [LOCAL ] PGP: Primary data saved (3996 records). [2025-09-15T19:57:38.575255] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-15T19:57:38.575334] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PGP took 12.1s. Estimated remaining: 1h 13m 53s. Rate: 9.4 symbols/min [2025-09-15T19:57:38.743021] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:38.748385] [DEBUG] [LOCAL ] PGZ: Loaded 4131 existing records from primary storage. [2025-09-15T19:57:38.748492] [INFO ] [MAIN ] PGZ: Loaded 4131 existing records. [2025-09-15T19:57:38.862938] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-15T19:57:38.928668] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:38.928881] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-15T19:57:38.928948] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-15T19:57:38.929232] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-15T19:57:38.929279] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-15T19:57:39.284949] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:39.657953] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-15T19:57:40.457940] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-15T19:57:40.494807] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-15T19:57:40.564829] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T19:57:40.800485] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-15T19:57:40.849579] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:57:41.257858] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-15T19:57:41.809402] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:57:42.057875] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-15T19:57:42.857936] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-15T19:57:43.657935] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-15T19:57:44.067834] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T19:57:44.270480] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:57:44.308768] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T19:57:44.457896] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-15T19:57:44.938614] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T19:57:45.257873] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-15T19:57:46.057893] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-15T19:57:46.857885] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-15T19:57:47.211527] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T19:57:47.313954] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:57:47.475536] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T19:57:47.657847] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-15T19:57:48.330243] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:57:48.457889] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-15T19:57:49.059140] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T19:57:49.257863] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-15T19:57:50.057901] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-15T19:57:50.857938] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-15T19:57:51.256957] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T19:57:51.613183] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:57:51.611602] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:57:51.626058] [INFO ] [REMOTE ] PGZ: Full fetch complete (5888 records). [2025-09-15T19:57:51.626728] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-15T19:57:51.663039] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-15T19:57:51.996734] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-15T19:57:51.996818] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-15T19:57:51.997023] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-15T19:57:51.997061] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-15T19:57:51.997442] [DEBUG] [LOCAL ] PGZ: Trimmed 5888 records to 4127 (keeping 150 days of data) [2025-09-15T19:57:52.022526] [DEBUG] [LOCAL ] PGZ: Primary data saved (4127 records). [2025-09-15T19:57:52.022597] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-15T19:57:52.022686] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PGZ took 13.4s. Estimated remaining: 1h 13m 49s. Rate: 9.4 symbols/min [2025-09-15T19:57:52.193907] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:52.224862] [DEBUG] [LOCAL ] PH: Loaded 28162 existing records from primary storage. [2025-09-15T19:57:52.225009] [INFO ] [MAIN ] PH: Loaded 28162 existing records. [2025-09-15T19:57:52.399747] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:52.400004] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-15T19:57:52.400052] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-15T19:57:52.400705] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-15T19:57:52.400756] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-15T19:57:52.463058] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-15T19:57:52.756162] [INFO ] [REMOTE ] PH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:53.257893] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-15T19:57:53.796439] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:57:53.875089] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-15T19:57:54.057871] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-15T19:57:54.419265] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:57:54.857897] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-15T19:57:55.657900] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-15T19:57:55.904660] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T19:57:55.910466] [INFO ] [REMOTE ] PG: Full fetch complete (58431 records). [2025-09-15T19:57:55.910570] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-15T19:57:56.289330] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-09-15T19:57:56.289410] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-09-15T19:57:56.290318] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-09-15T19:57:56.290363] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-09-15T19:57:56.292033] [DEBUG] [LOCAL ] PG: Trimmed 58431 records to 39714 (keeping 150 days of data) [2025-09-15T19:57:56.489240] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-15T19:57:56.563084] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T19:57:56.599254] [DEBUG] [LOCAL ] PG: Primary data saved (39714 records). [2025-09-15T19:57:56.599393] [INFO ] [MAIN ] PG: Full history saved. [2025-09-15T19:57:56.601237] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PG took 42.0s. Estimated remaining: 1h 13m 42s. Rate: 9.4 symbols/min [2025-09-15T19:57:56.769125] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:57:56.778045] [DEBUG] [LOCAL ] PHD: Loaded 6860 existing records from primary storage. [2025-09-15T19:57:56.778171] [INFO ] [MAIN ] PHD: Loaded 6860 existing records. [2025-09-15T19:57:56.951102] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:57:56.951338] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-15T19:57:56.951382] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-15T19:57:56.951694] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-15T19:57:56.951743] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-15T19:57:57.262914] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-15T19:57:57.341066] [INFO ] [REMOTE ] PHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:57:57.671405] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T19:57:57.885339] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:57:58.057859] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-15T19:57:58.857944] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-15T19:57:59.027090] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:57:59.657866] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-15T19:57:59.943815] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T19:58:00.250331] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T19:58:00.457870] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-15T19:58:01.030874] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T19:58:01.068543] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:58:01.257879] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-15T19:58:02.057907] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-15T19:58:02.829702] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:58:02.834883] [INFO ] [REMOTE ] PGRE: Full fetch complete (48745 records). [2025-09-15T19:58:02.835008] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-15T19:58:02.866395] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-15T19:58:03.222214] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-15T19:58:03.222297] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-15T19:58:03.223129] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-15T19:58:03.223175] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-15T19:58:03.224244] [DEBUG] [LOCAL ] PGRE: Trimmed 48745 records to 34520 (keeping 150 days of data) [2025-09-15T19:58:03.443732] [DEBUG] [LOCAL ] PGRE: Primary data saved (34520 records). [2025-09-15T19:58:03.443976] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-15T19:58:03.444098] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PGRE took 26.0s. Estimated remaining: 1h 13m 36s. Rate: 9.4 symbols/min [2025-09-15T19:58:03.622082] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:03.658427] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-15T19:58:03.660623] [DEBUG] [LOCAL ] PHG: Loaded 34714 existing records from primary storage. [2025-09-15T19:58:03.661064] [INFO ] [MAIN ] PHG: Loaded 34714 existing records. [2025-09-15T19:58:03.784337] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T19:58:03.879139] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:03.881961] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T19:58:03.887820] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-15T19:58:03.888345] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-15T19:58:03.889004] [INFO ] [REMOTE ] PGR: Full fetch complete (57642 records). [2025-09-15T19:58:03.889160] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-15T19:58:03.889561] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-15T19:58:03.889682] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-15T19:58:04.463293] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-15T19:58:04.691956] [INFO ] [REMOTE ] PHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:04.730594] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-09-15T19:58:04.730732] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-09-15T19:58:04.731908] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-09-15T19:58:04.731986] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-09-15T19:58:04.733586] [DEBUG] [LOCAL ] PGR: Trimmed 57642 records to 39044 (keeping 150 days of data) [2025-09-15T19:58:04.996863] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T19:58:05.015990] [DEBUG] [LOCAL ] PGR: Primary data saved (39044 records). [2025-09-15T19:58:05.016160] [INFO ] [MAIN ] PGR: Full history saved. [2025-09-15T19:58:05.017772] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PGR took 32.3s. Estimated remaining: 1h 13m 28s. Rate: 9.4 symbols/min [2025-09-15T19:58:05.257861] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-15T19:58:05.298301] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:58:06.057873] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-15T19:58:06.482438] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:58:06.760744] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T19:58:06.857916] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-15T19:58:07.657937] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-15T19:58:08.457892] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-15T19:58:08.484223] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:58:08.836737] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T19:58:09.182455] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:58:09.257898] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-15T19:58:09.865837] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:58:10.057999] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-15T19:58:10.796864] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:58:10.857936] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-15T19:58:11.594328] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:58:11.596379] [INFO ] [REMOTE ] PHD: Full fetch complete (10187 records). [2025-09-15T19:58:11.596489] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-15T19:58:11.664914] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-15T19:58:11.987480] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-15T19:58:11.987618] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-15T19:58:11.988074] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-15T19:58:11.988119] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-15T19:58:11.988693] [DEBUG] [LOCAL ] PHD: Trimmed 10187 records to 6800 (keeping 150 days of data) [2025-09-15T19:58:12.032432] [DEBUG] [LOCAL ] PHD: Primary data saved (6800 records). [2025-09-15T19:58:12.032721] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-15T19:58:12.032845] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PHD took 15.4s. Estimated remaining: 1h 13m 22s. Rate: 9.4 symbols/min [2025-09-15T19:58:12.457970] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-15T19:58:13.148966] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:58:13.257849] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-15T19:58:13.999456] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:58:14.057852] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-15T19:58:14.699616] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:58:14.857853] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-15T19:58:15.149858] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T19:58:15.154144] [INFO ] [REMOTE ] PH: Full fetch complete (42984 records). [2025-09-15T19:58:15.154280] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-15T19:58:15.533192] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-15T19:58:15.533299] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-15T19:58:15.534091] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-15T19:58:15.534136] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-15T19:58:15.535117] [DEBUG] [LOCAL ] PH: Trimmed 42984 records to 27509 (keeping 150 days of data) [2025-09-15T19:58:15.717730] [DEBUG] [LOCAL ] PH: Primary data saved (27509 records). [2025-09-15T19:58:15.717873] [INFO ] [MAIN ] PH: Full history saved. [2025-09-15T19:58:15.717969] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PH took 23.7s. Estimated remaining: 1h 13m 14s. Rate: 9.4 symbols/min [2025-09-15T19:58:16.143909] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T19:58:16.154146] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-15T19:58:17.903208] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:58:17.913746] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-15T19:58:19.480675] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:58:19.491133] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-15T19:58:21.203109] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:58:21.207949] [INFO ] [REMOTE ] PHG: Full fetch complete (50207 records). [2025-09-15T19:58:21.208039] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-15T19:58:21.588144] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-15T19:58:21.588273] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-15T19:58:21.589115] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-15T19:58:21.589158] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-15T19:58:21.590188] [DEBUG] [LOCAL ] PHG: Trimmed 50207 records to 33960 (keeping 150 days of data) [2025-09-15T19:58:21.803798] [DEBUG] [LOCAL ] PHG: Primary data saved (33960 records). [2025-09-15T19:58:21.803968] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-15T19:58:21.804083] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHG took 18.4s. Estimated remaining: 1h 13m 8s. Rate: 9.4 symbols/min [2025-09-15T19:58:22.316521] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:22.446126] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:22.505303] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:22.533543] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:22.556503] [DEBUG] [LOCAL ] PHI: Loaded 10886 existing records from primary storage. [2025-09-15T19:58:22.557669] [INFO ] [MAIN ] PHI: Loaded 10886 existing records. [2025-09-15T19:58:22.587283] [DEBUG] [LOCAL ] PHK: Loaded 19411 existing records from primary storage. [2025-09-15T19:58:22.599035] [INFO ] [MAIN ] PHK: Loaded 19411 existing records. [2025-09-15T19:58:22.807082] [DEBUG] [LOCAL ] PHIN: Loaded 23699 existing records from primary storage. [2025-09-15T19:58:22.844428] [INFO ] [MAIN ] PHIN: Loaded 23699 existing records. [2025-09-15T19:58:22.872330] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:23.029317] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-15T19:58:23.035075] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-15T19:58:23.024060] [DEBUG] [LOCAL ] PHM: Loaded 38859 existing records from primary storage. [2025-09-15T19:58:23.041408] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-15T19:58:23.046945] [INFO ] [MAIN ] PHM: Loaded 38859 existing records. [2025-09-15T19:58:23.065725] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-15T19:58:23.116855] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:23.174658] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-15T19:58:23.213971] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-15T19:58:23.268221] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-15T19:58:23.323833] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:23.351526] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-15T19:58:23.430268] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-15T19:58:23.509835] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-15T19:58:23.616249] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:23.670123] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-15T19:58:23.655115] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-15T19:58:23.670319] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-15T19:58:23.697250] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-15T19:58:23.804806] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-15T19:58:23.820630] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-15T19:58:24.292234] [INFO ] [REMOTE ] PHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:24.502255] [INFO ] [REMOTE ] PHK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:24.537855] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-15T19:58:24.537453] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-15T19:58:24.884293] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:24.887923] [INFO ] [REMOTE ] PHM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:24.888260] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-15T19:58:24.888453] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-15T19:58:25.370005] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T19:58:25.373043] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-15T19:58:25.847320] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:58:25.853361] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-15T19:58:26.231697] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:58:26.239073] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-15T19:58:26.252310] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T19:58:26.257112] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-15T19:58:26.345607] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:58:26.355567] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-15T19:58:26.600255] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:58:26.606273] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-15T19:58:27.036220] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T19:58:27.040263] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-15T19:58:27.523889] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:58:27.532707] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-15T19:58:27.888526] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:58:27.899404] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-15T19:58:27.944922] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:58:27.965904] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:58:28.457842] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-15T19:58:28.934330] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:58:29.207893] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T19:58:29.257847] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-15T19:58:29.628145] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T19:58:29.746440] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T19:58:30.057914] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-15T19:58:30.857903] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-15T19:58:31.657867] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-15T19:58:31.754817] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T19:58:32.062206] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:58:32.457842] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-15T19:58:32.620595] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T19:58:33.257877] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-15T19:58:34.042301] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T19:58:34.057826] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-15T19:58:34.082688] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:58:34.857954] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-15T19:58:35.657855] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-15T19:58:35.903535] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T19:58:36.127176] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:58:36.457915] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-15T19:58:36.802123] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:58:37.257864] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-15T19:58:37.426579] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T19:58:37.429535] [INFO ] [REMOTE ] PHI: Full fetch complete (15756 records). [2025-09-15T19:58:37.429629] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-15T19:58:37.800132] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-15T19:58:37.800227] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-15T19:58:37.800634] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-15T19:58:37.800703] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-15T19:58:37.801283] [DEBUG] [LOCAL ] PHI: Trimmed 15756 records to 10763 (keeping 150 days of data) [2025-09-15T19:58:37.869069] [DEBUG] [LOCAL ] PHI: Primary data saved (10763 records). [2025-09-15T19:58:37.869217] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-15T19:58:37.869318] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PHI took 16.1s. Estimated remaining: 1h 13m 5s. Rate: 9.4 symbols/min [2025-09-15T19:58:38.045773] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:38.061262] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-15T19:58:38.074864] [DEBUG] [LOCAL ] PHR: Loaded 27578 existing records from primary storage. [2025-09-15T19:58:38.075009] [INFO ] [MAIN ] PHR: Loaded 27578 existing records. [2025-09-15T19:58:38.250007] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:38.250246] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-15T19:58:38.250292] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-15T19:58:38.250930] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-15T19:58:38.250981] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-15T19:58:38.618172] [INFO ] [REMOTE ] PHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:38.645361] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:58:38.857897] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-15T19:58:39.662962] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-15T19:58:39.679521] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T19:58:39.873208] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:58:40.457916] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-15T19:58:40.774634] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T19:58:41.257890] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-15T19:58:41.341022] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:58:42.057936] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-15T19:58:42.857876] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-15T19:58:42.897867] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:58:42.904035] [INFO ] [REMOTE ] PHM: Full fetch complete (56287 records). [2025-09-15T19:58:42.904160] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-15T19:58:43.239217] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T19:58:43.330582] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-09-15T19:58:43.330729] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-09-15T19:58:43.332168] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-09-15T19:58:43.332225] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-09-15T19:58:43.334043] [DEBUG] [LOCAL ] PHM: Trimmed 56287 records to 38096 (keeping 150 days of data) [2025-09-15T19:58:43.605376] [DEBUG] [LOCAL ] PHM: Primary data saved (38096 records). [2025-09-15T19:58:43.605622] [INFO ] [MAIN ] PHM: Full history saved. [2025-09-15T19:58:43.605842] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHM took 21.8s. Estimated remaining: 1h 12m 59s. Rate: 9.4 symbols/min [2025-09-15T19:58:43.664093] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-15T19:58:43.797875] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:43.811450] [DEBUG] [LOCAL ] PHT: Loaded 12120 existing records from primary storage. [2025-09-15T19:58:43.811579] [INFO ] [MAIN ] PHT: Loaded 12120 existing records. [2025-09-15T19:58:43.994202] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:43.994549] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-15T19:58:43.994598] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-15T19:58:43.995136] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-15T19:58:43.995190] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-15T19:58:44.235329] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:58:44.299769] [INFO ] [REMOTE ] PHIN: Full fetch complete (36761 records). [2025-09-15T19:58:44.305168] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-15T19:58:44.458921] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-15T19:58:44.537353] [INFO ] [REMOTE ] PHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:44.769847] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:58:44.814325] [INFO ] [REMOTE ] PHK: Full fetch complete (29121 records). [2025-09-15T19:58:44.832516] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-15T19:58:44.876784] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-15T19:58:44.908409] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-15T19:58:44.920677] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-15T19:58:44.925852] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-15T19:58:44.973845] [DEBUG] [LOCAL ] PHIN: Trimmed 36761 records to 23192 (keeping 150 days of data) [2025-09-15T19:58:45.261084] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-15T19:58:45.338742] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-15T19:58:45.339141] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-15T19:58:45.340305] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-15T19:58:45.341408] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-15T19:58:45.347305] [DEBUG] [LOCAL ] PHK: Trimmed 29121 records to 19047 (keeping 150 days of data) [2025-09-15T19:58:45.484882] [DEBUG] [LOCAL ] PHK: Primary data saved (19047 records). [2025-09-15T19:58:45.486039] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-15T19:58:45.486162] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PHK took 23.7s. Estimated remaining: 1h 12m 50s. Rate: 9.4 symbols/min [2025-09-15T19:58:45.613998] [DEBUG] [LOCAL ] PHIN: Primary data saved (23192 records). [2025-09-15T19:58:45.668541] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:45.644327] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-15T19:58:45.669035] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PHIN took 23.9s. Estimated remaining: 1h 12m 42s. Rate: 9.4 symbols/min [2025-09-15T19:58:45.842475] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:45.856782] [DEBUG] [LOCAL ] PIM: Loaded 3668 existing records from primary storage. [2025-09-15T19:58:45.856923] [INFO ] [MAIN ] PIM: Loaded 3668 existing records. [2025-09-15T19:58:45.992750] [DEBUG] [LOCAL ] PII: Loaded 37006 existing records from primary storage. [2025-09-15T19:58:45.995191] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T19:58:46.002756] [INFO ] [MAIN ] PII: Loaded 37006 existing records. [2025-09-15T19:58:46.089287] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-15T19:58:46.167271] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:46.185601] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T19:58:46.191275] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-15T19:58:46.191401] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-15T19:58:46.233587] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-15T19:58:46.243949] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-15T19:58:46.387249] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:46.411007] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-15T19:58:46.413248] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-15T19:58:46.419117] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-15T19:58:46.429408] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-15T19:58:46.860411] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-15T19:58:46.931715] [INFO ] [REMOTE ] PIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:47.091603] [INFO ] [REMOTE ] PII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:47.142083] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T19:58:47.607003] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T19:58:47.657881] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-15T19:58:48.457898] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-15T19:58:48.989344] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T19:58:49.160703] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:58:49.257876] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-15T19:58:50.057900] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-15T19:58:50.282514] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T19:58:50.481911] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:58:50.857947] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-15T19:58:51.657879] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-15T19:58:51.958050] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T19:58:52.450994] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:58:52.457809] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-15T19:58:53.257901] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-15T19:58:53.377744] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:58:54.057875] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-15T19:58:54.446313] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T19:58:54.857878] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-15T19:58:55.574995] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T19:58:55.657833] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-15T19:58:56.109013] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:58:56.114510] [INFO ] [REMOTE ] PHR: Full fetch complete (39624 records). [2025-09-15T19:58:56.114629] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-15T19:58:56.474685] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-15T19:58:56.489758] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-15T19:58:56.489842] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-15T19:58:56.490594] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-15T19:58:56.490756] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-15T19:58:56.491634] [DEBUG] [LOCAL ] PHR: Trimmed 39624 records to 27259 (keeping 150 days of data) [2025-09-15T19:58:56.668532] [DEBUG] [LOCAL ] PHR: Primary data saved (27259 records). [2025-09-15T19:58:56.668691] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-15T19:58:56.668796] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PHR took 18.8s. Estimated remaining: 1h 12m 37s. Rate: 9.4 symbols/min [2025-09-15T19:58:56.846372] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:58:56.858578] [DEBUG] [LOCAL ] PINE: Loaded 10663 existing records from primary storage. [2025-09-15T19:58:56.858719] [INFO ] [MAIN ] PINE: Loaded 10663 existing records. [2025-09-15T19:58:57.037980] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:58:57.038339] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-15T19:58:57.038414] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-15T19:58:57.038924] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-15T19:58:57.038986] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-15T19:58:57.188374] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:58:57.262964] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-15T19:58:57.466436] [INFO ] [REMOTE ] PINE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:58:57.487692] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:58:57.887095] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T19:58:58.057883] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-15T19:58:58.857876] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-15T19:58:58.949243] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:58:59.657881] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-15T19:59:00.181318] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T19:59:00.457865] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-15T19:59:00.488038] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:59:01.257849] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-15T19:59:01.490038] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:59:01.492289] [INFO ] [REMOTE ] PHT: Full fetch complete (16022 records). [2025-09-15T19:59:01.492383] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-15T19:59:01.635398] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T19:59:01.879522] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-15T19:59:01.879620] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-15T19:59:01.880036] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-15T19:59:01.880085] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-15T19:59:01.880690] [DEBUG] [LOCAL ] PHT: Trimmed 16022 records to 11962 (keeping 150 days of data) [2025-09-15T19:59:01.951173] [DEBUG] [LOCAL ] PHT: Primary data saved (11962 records). [2025-09-15T19:59:01.951316] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-15T19:59:01.951410] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PHT took 18.3s. Estimated remaining: 1h 12m 30s. Rate: 9.4 symbols/min [2025-09-15T19:59:02.062528] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-15T19:59:02.133810] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:02.170989] [DEBUG] [LOCAL ] PINS: Loaded 40433 existing records from primary storage. [2025-09-15T19:59:02.171132] [INFO ] [MAIN ] PINS: Loaded 40433 existing records. [2025-09-15T19:59:02.358734] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:02.359119] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-15T19:59:02.359169] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-15T19:59:02.360310] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-15T19:59:02.360371] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-15T19:59:02.756165] [INFO ] [REMOTE ] PINS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:02.857927] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-15T19:59:03.657852] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-15T19:59:03.774115] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T19:59:03.975029] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T19:59:04.376242] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T19:59:04.457898] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-15T19:59:05.257872] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-15T19:59:05.412370] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:59:06.057913] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-15T19:59:06.470160] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T19:59:06.744071] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T19:59:06.857886] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-15T19:59:07.446350] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:59:07.657868] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-15T19:59:08.273422] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:59:08.275273] [INFO ] [REMOTE ] PIM: Full fetch complete (5009 records). [2025-09-15T19:59:08.275342] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-15T19:59:08.462963] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-15T19:59:08.645361] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-15T19:59:08.645443] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-15T19:59:08.645582] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-15T19:59:08.645620] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-15T19:59:08.646039] [DEBUG] [LOCAL ] PIM: Trimmed 5009 records to 3724 (keeping 150 days of data) [2025-09-15T19:59:08.668460] [DEBUG] [LOCAL ] PIM: Primary data saved (3724 records). [2025-09-15T19:59:08.668540] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-15T19:59:08.668671] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PIM took 23.0s. Estimated remaining: 1h 12m 24s. Rate: 9.4 symbols/min [2025-09-15T19:59:08.841126] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:08.853297] [DEBUG] [LOCAL ] PIPR: Loaded 10990 existing records from primary storage. [2025-09-15T19:59:08.853425] [INFO ] [MAIN ] PIPR: Loaded 10990 existing records. [2025-09-15T19:59:09.030422] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:09.030689] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-15T19:59:09.030737] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-15T19:59:09.031191] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-15T19:59:09.031244] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-15T19:59:09.263679] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-15T19:59:09.399296] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:10.057902] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-15T19:59:10.305456] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T19:59:10.528150] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T19:59:10.738233] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T19:59:10.857894] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-15T19:59:11.657930] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-15T19:59:11.884104] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T19:59:12.442055] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T19:59:12.457891] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-15T19:59:13.257906] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-15T19:59:13.935608] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T19:59:14.057856] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-15T19:59:14.256743] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T19:59:14.857883] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-15T19:59:14.924570] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T19:59:15.657891] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-15T19:59:16.439696] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:59:16.457821] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-15T19:59:17.257922] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-15T19:59:17.299726] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T19:59:18.057929] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-15T19:59:18.185361] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T19:59:18.368905] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:59:18.857882] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-15T19:59:19.498088] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T19:59:19.513537] [INFO ] [REMOTE ] PII: Full fetch complete (53835 records). [2025-09-15T19:59:19.513979] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-15T19:59:19.515003] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:59:19.666028] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-15T19:59:19.910535] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-15T19:59:19.910634] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-15T19:59:19.911590] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-15T19:59:19.911659] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-15T19:59:19.912973] [DEBUG] [LOCAL ] PII: Trimmed 53835 records to 36232 (keeping 150 days of data) [2025-09-15T19:59:20.151353] [DEBUG] [LOCAL ] PII: Primary data saved (36232 records). [2025-09-15T19:59:20.151554] [INFO ] [MAIN ] PII: Full history saved. [2025-09-15T19:59:20.151706] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PII took 34.7s. Estimated remaining: 1h 12m 20s. Rate: 9.4 symbols/min [2025-09-15T19:59:20.326047] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:20.345129] [DEBUG] [LOCAL ] PJT: Loaded 16167 existing records from primary storage. [2025-09-15T19:59:20.345266] [INFO ] [MAIN ] PJT: Loaded 16167 existing records. [2025-09-15T19:59:20.458537] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-15T19:59:20.453105] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T19:59:20.478142] [INFO ] [REMOTE ] PINE: Full fetch complete (15491 records). [2025-09-15T19:59:20.496614] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-15T19:59:20.579494] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:20.636812] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-15T19:59:20.639241] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-15T19:59:20.645014] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-15T19:59:20.655284] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-15T19:59:21.202546] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-15T19:59:21.207770] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-15T19:59:21.213384] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-15T19:59:21.223706] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-15T19:59:21.263540] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-15T19:59:21.282689] [INFO ] [REMOTE ] PJT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:21.284368] [DEBUG] [LOCAL ] PINE: Trimmed 15491 records to 10370 (keeping 150 days of data) [2025-09-15T19:59:21.347963] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T19:59:21.371846] [DEBUG] [LOCAL ] PINE: Primary data saved (10370 records). [2025-09-15T19:59:21.372003] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-15T19:59:21.372136] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PINE took 24.7s. Estimated remaining: 1h 12m 11s. Rate: 9.4 symbols/min [2025-09-15T19:59:21.554119] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:21.598257] [DEBUG] [LOCAL ] PK: Loaded 39726 existing records from primary storage. [2025-09-15T19:59:21.598408] [INFO ] [MAIN ] PK: Loaded 39726 existing records. [2025-09-15T19:59:21.782373] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:21.782678] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-15T19:59:21.782730] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-15T19:59:21.783507] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-15T19:59:21.783559] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-15T19:59:22.063914] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-15T19:59:22.148290] [INFO ] [REMOTE ] PK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:22.857940] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-15T19:59:23.184503] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T19:59:23.210556] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:59:23.567411] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:59:23.657889] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-15T19:59:24.457907] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-15T19:59:24.945465] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T19:59:25.257959] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-15T19:59:25.895751] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:59:26.057893] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-15T19:59:26.857908] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-15T19:59:27.164628] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T19:59:27.596634] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T19:59:27.657855] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-15T19:59:27.892875] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:59:28.457909] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-15T19:59:29.128984] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:59:29.257932] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-15T19:59:29.444478] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T19:59:29.808300] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:59:30.057883] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-15T19:59:30.857884] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-15T19:59:30.999231] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:59:31.657883] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-15T19:59:32.457932] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-15T19:59:32.642031] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T19:59:33.022840] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T19:59:33.118199] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:59:33.121029] [INFO ] [REMOTE ] PIPR: Full fetch complete (16356 records). [2025-09-15T19:59:33.121358] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-15T19:59:33.268202] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-15T19:59:33.550475] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-15T19:59:33.550586] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-15T19:59:33.551059] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-15T19:59:33.551107] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-15T19:59:33.551710] [DEBUG] [LOCAL ] PIPR: Trimmed 16356 records to 10817 (keeping 150 days of data) [2025-09-15T19:59:33.627929] [DEBUG] [LOCAL ] PIPR: Primary data saved (10817 records). [2025-09-15T19:59:33.628089] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-15T19:59:33.628199] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PIPR took 25.0s. Estimated remaining: 1h 12m 7s. Rate: 9.4 symbols/min [2025-09-15T19:59:33.802414] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:33.814689] [DEBUG] [LOCAL ] PKE: Loaded 9995 existing records from primary storage. [2025-09-15T19:59:33.814816] [INFO ] [MAIN ] PKE: Loaded 9995 existing records. [2025-09-15T19:59:33.989991] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:33.990241] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-15T19:59:33.990286] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-15T19:59:33.990637] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-15T19:59:33.990712] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-15T19:59:34.066272] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-15T19:59:34.360018] [INFO ] [REMOTE ] PKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:34.857908] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-15T19:59:35.241507] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T19:59:35.249994] [INFO ] [REMOTE ] PINS: Full fetch complete (58373 records). [2025-09-15T19:59:35.250211] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-15T19:59:35.663284] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-15T19:59:35.714312] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-15T19:59:35.714467] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-15T19:59:35.715836] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-15T19:59:35.715926] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-15T19:59:35.717748] [DEBUG] [LOCAL ] PINS: Trimmed 58373 records to 39653 (keeping 150 days of data) [2025-09-15T19:59:35.853193] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T19:59:35.916418] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T19:59:36.058297] [DEBUG] [LOCAL ] PINS: Primary data saved (39653 records). [2025-09-15T19:59:36.058466] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-15T19:59:36.058570] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PINS took 34.1s. Estimated remaining: 1h 11m 59s. Rate: 9.4 symbols/min [2025-09-15T19:59:36.232167] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:36.269155] [DEBUG] [LOCAL ] PKG: Loaded 29138 existing records from primary storage. [2025-09-15T19:59:36.269352] [INFO ] [MAIN ] PKG: Loaded 29138 existing records. [2025-09-15T19:59:36.451151] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:36.451497] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-15T19:59:36.451603] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-15T19:59:36.457579] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-15T19:59:36.459344] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-15T19:59:36.459065] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-15T19:59:36.465414] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:59:36.819667] [INFO ] [REMOTE ] PKG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:37.257878] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-15T19:59:37.433563] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T19:59:37.810155] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:59:38.057877] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-15T19:59:38.778445] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:59:38.857910] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-15T19:59:39.452860] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:59:39.657898] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-15T19:59:40.457886] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-15T19:59:41.257846] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-15T19:59:41.300306] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T19:59:41.302613] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:59:42.057880] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-15T19:59:42.769252] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T19:59:42.857878] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-15T19:59:43.400930] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:59:43.657895] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-15T19:59:44.183494] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T19:59:44.457906] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-15T19:59:44.731610] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T19:59:45.257920] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-15T19:59:45.810996] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:59:46.057894] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-15T19:59:46.790231] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T19:59:46.796065] [INFO ] [REMOTE ] PK: Full fetch complete (57469 records). [2025-09-15T19:59:46.796205] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-15T19:59:46.863147] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-15T19:59:47.196292] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-15T19:59:47.196399] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-15T19:59:47.197301] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-15T19:59:47.197357] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-15T19:59:47.198525] [DEBUG] [LOCAL ] PK: Trimmed 57469 records to 38953 (keeping 150 days of data) [2025-09-15T19:59:47.438441] [DEBUG] [LOCAL ] PK: Primary data saved (38953 records). [2025-09-15T19:59:47.438630] [INFO ] [MAIN ] PK: Full history saved. [2025-09-15T19:59:47.440461] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PK took 26.1s. Estimated remaining: 1h 11m 55s. Rate: 9.4 symbols/min [2025-09-15T19:59:47.649308] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:47.652450] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:59:47.662049] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-15T19:59:47.678259] [DEBUG] [LOCAL ] PKST: Loaded 13160 existing records from primary storage. [2025-09-15T19:59:47.678393] [INFO ] [MAIN ] PKST: Loaded 13160 existing records. [2025-09-15T19:59:47.859715] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:47.860217] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-15T19:59:47.860397] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-15T19:59:47.866956] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-15T19:59:47.875419] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-15T19:59:47.946247] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:59:48.256000] [INFO ] [REMOTE ] PKST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:48.347848] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T19:59:48.457857] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-15T19:59:49.257880] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-15T19:59:49.458720] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T19:59:50.057884] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-15T19:59:50.080361] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T19:59:50.756026] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:59:50.758287] [INFO ] [REMOTE ] PJT: Full fetch complete (25005 records). [2025-09-15T19:59:50.758408] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-15T19:59:50.864921] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-15T19:59:51.142669] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-15T19:59:51.142758] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-15T19:59:51.143348] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-15T19:59:51.143396] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-15T19:59:51.144164] [DEBUG] [LOCAL ] PJT: Trimmed 25005 records to 15826 (keeping 150 days of data) [2025-09-15T19:59:51.250418] [DEBUG] [LOCAL ] PJT: Primary data saved (15826 records). [2025-09-15T19:59:51.250570] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-15T19:59:51.250674] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PJT took 31.1s. Estimated remaining: 1h 11m 48s. Rate: 9.4 symbols/min [2025-09-15T19:59:51.420318] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:51.441329] [DEBUG] [LOCAL ] PKX: Loaded 17013 existing records from primary storage. [2025-09-15T19:59:51.441542] [INFO ] [MAIN ] PKX: Loaded 17013 existing records. [2025-09-15T19:59:51.625781] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:51.626097] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-15T19:59:51.626149] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-15T19:59:51.626975] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-15T19:59:51.627220] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-15T19:59:51.663059] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-15T19:59:51.988202] [INFO ] [REMOTE ] PKX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:52.064498] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T19:59:52.457884] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-15T19:59:52.652998] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T19:59:53.257846] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-15T19:59:53.336981] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:59:54.057893] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-15T19:59:54.182375] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T19:59:54.184441] [INFO ] [REMOTE ] PKE: Full fetch complete (13123 records). [2025-09-15T19:59:54.184509] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-15T19:59:54.581221] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-15T19:59:54.581308] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-15T19:59:54.581636] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-15T19:59:54.581698] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-15T19:59:54.582346] [DEBUG] [LOCAL ] PKE: Trimmed 13123 records to 9940 (keeping 150 days of data) [2025-09-15T19:59:54.650847] [DEBUG] [LOCAL ] PKE: Primary data saved (9940 records). [2025-09-15T19:59:54.650989] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-15T19:59:54.651091] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PKE took 21.0s. Estimated remaining: 1h 11m 40s. Rate: 9.4 symbols/min [2025-09-15T19:59:54.825310] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:59:54.865829] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-15T19:59:54.869410] [DEBUG] [LOCAL ] PL: Loaded 39968 existing records from primary storage. [2025-09-15T19:59:54.869562] [INFO ] [MAIN ] PL: Loaded 39968 existing records. [2025-09-15T19:59:55.051741] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:59:55.052007] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-15T19:59:55.052054] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-15T19:59:55.053010] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-15T19:59:55.053063] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-15T19:59:55.416255] [INFO ] [REMOTE ] PL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:59:55.555248] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:59:55.657872] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-15T19:59:56.289822] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:59:56.457946] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-15T19:59:57.257940] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-15T19:59:57.488502] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T19:59:57.516003] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:59:58.057878] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-15T19:59:58.269771] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T19:59:58.857879] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-15T19:59:59.658360] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-15T19:59:59.869870] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T19:59:59.968227] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T20:00:00.457853] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-15T20:00:00.764265] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T20:00:01.257897] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-15T20:00:01.509401] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T20:00:02.057884] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-15T20:00:02.238681] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T20:00:02.857913] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-15T20:00:03.657883] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-15T20:00:04.457940] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-15T20:00:04.800339] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-15T20:00:04.868867] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T20:00:05.257884] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-15T20:00:06.057986] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-15T20:00:06.869092] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-15T20:00:06.877563] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-15T20:00:08.058412] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (3.60 seconds). [2025-09-15T20:00:08.064777] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-15T20:00:09.075510] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (3.82 seconds). [2025-09-15T20:00:09.088500] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-09-15T20:00:09.103486] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-15T20:00:09.118542] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T20:00:09.164014] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-15T20:00:09.168830] [INFO ] [REMOTE ] PKG: Full fetch complete (43174 records). [2025-09-15T20:00:09.168937] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-15T20:00:09.264725] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-15T20:00:09.573313] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-15T20:00:09.573406] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-15T20:00:09.574274] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-15T20:00:09.574337] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-15T20:00:09.575350] [DEBUG] [LOCAL ] PKG: Trimmed 43174 records to 28597 (keeping 150 days of data) [2025-09-15T20:00:09.768900] [DEBUG] [LOCAL ] PKG: Primary data saved (28597 records). [2025-09-15T20:00:09.769063] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-15T20:00:09.769176] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PKG took 33.7s. Estimated remaining: 1h 11m 37s. Rate: 9.4 symbols/min [2025-09-15T20:00:09.952012] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:09.993431] [DEBUG] [LOCAL ] PLD: Loaded 40247 existing records from primary storage. [2025-09-15T20:00:09.993621] [INFO ] [MAIN ] PLD: Loaded 40247 existing records. [2025-09-15T20:00:10.065759] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-15T20:00:10.191936] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:10.192216] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-15T20:00:10.192267] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-15T20:00:10.193445] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-15T20:00:10.193499] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-15T20:00:10.548907] [INFO ] [REMOTE ] PLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:10.558000] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T20:00:10.561234] [INFO ] [REMOTE ] PKX: Full fetch complete (28146 records). [2025-09-15T20:00:10.561317] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-15T20:00:10.862931] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-15T20:00:10.943134] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-15T20:00:10.943213] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-15T20:00:10.943862] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-15T20:00:10.943908] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-15T20:00:10.944605] [DEBUG] [LOCAL ] PKX: Trimmed 28146 records to 16442 (keeping 150 days of data) [2025-09-15T20:00:11.042712] [DEBUG] [LOCAL ] PKX: Primary data saved (16442 records). [2025-09-15T20:00:11.042844] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-15T20:00:11.042927] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PKX took 19.8s. Estimated remaining: 1h 11m 29s. Rate: 9.4 symbols/min [2025-09-15T20:00:11.223750] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:11.224721] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T20:00:11.224882] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-09-15T20:00:11.227575] [INFO ] [REMOTE ] PKST: Full fetch complete (21650 records). [2025-09-15T20:00:11.227409] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-09-15T20:00:11.227743] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-15T20:00:11.227949] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-15T20:00:11.228132] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-15T20:00:11.248900] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-15T20:00:11.276731] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-15T20:00:11.931741] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-15T20:00:11.946341] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-15T20:00:11.969333] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-15T20:00:11.971216] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-15T20:00:11.991975] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-15T20:00:12.056502] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-15T20:00:12.059894] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:12.061262] [DEBUG] [LOCAL ] PKST: Trimmed 21650 records to 12836 (keeping 150 days of data) [2025-09-15T20:00:12.143131] [DEBUG] [LOCAL ] PKST: Primary data saved (12836 records). [2025-09-15T20:00:12.143277] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-15T20:00:12.143382] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PKST took 24.7s. Estimated remaining: 1h 11m 20s. Rate: 9.4 symbols/min [2025-09-15T20:00:12.315737] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:12.331632] [DEBUG] [LOCAL ] PLOW: Loaded 15707 existing records from primary storage. [2025-09-15T20:00:12.331820] [INFO ] [MAIN ] PLOW: Loaded 15707 existing records. [2025-09-15T20:00:12.463020] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-15T20:00:12.516502] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:12.516784] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-15T20:00:12.516835] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-15T20:00:12.517359] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-15T20:00:12.517411] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-15T20:00:12.884588] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:12.916619] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T20:00:13.257869] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-15T20:00:13.903255] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T20:00:14.057937] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-15T20:00:14.194948] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T20:00:14.270407] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-15T20:00:14.857920] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-15T20:00:15.657894] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-15T20:00:15.798735] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T20:00:16.457967] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-15T20:00:16.835039] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T20:00:17.048170] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:00:17.257943] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-15T20:00:17.401864] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T20:00:18.057906] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-15T20:00:18.858028] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-15T20:00:19.301777] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-15T20:00:19.657873] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-15T20:00:20.457912] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-15T20:00:20.512619] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-15T20:00:20.730124] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T20:00:21.257935] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-15T20:00:21.354721] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T20:00:22.057925] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-15T20:00:22.295569] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T20:00:22.301530] [INFO ] [REMOTE ] PL: Full fetch complete (57762 records). [2025-09-15T20:00:22.301698] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-15T20:00:22.683530] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-15T20:00:22.683608] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-15T20:00:22.684663] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-15T20:00:22.684711] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-15T20:00:22.685934] [DEBUG] [LOCAL ] PL: Trimmed 57762 records to 39249 (keeping 150 days of data) [2025-09-15T20:00:22.817249] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T20:00:22.872029] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-15T20:00:22.952102] [DEBUG] [LOCAL ] PL: Primary data saved (39249 records). [2025-09-15T20:00:22.952482] [INFO ] [MAIN ] PL: Full history saved. [2025-09-15T20:00:22.954138] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PL took 28.3s. Estimated remaining: 1h 11m 16s. Rate: 9.4 symbols/min [2025-09-15T20:00:23.064428] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:00:23.193252] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:23.222807] [DEBUG] [LOCAL ] PLYM: Loaded 24636 existing records from primary storage. [2025-09-15T20:00:23.223028] [INFO ] [MAIN ] PLYM: Loaded 24636 existing records. [2025-09-15T20:00:23.412119] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:23.412433] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-15T20:00:23.412484] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-15T20:00:23.413255] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-15T20:00:23.413307] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-15T20:00:23.665771] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-15T20:00:23.786895] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:24.457928] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-15T20:00:24.581140] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T20:00:25.257844] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-15T20:00:25.333458] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:00:25.476026] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T20:00:26.057857] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-15T20:00:26.187265] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:00:26.857921] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-15T20:00:26.958826] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T20:00:27.657969] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-15T20:00:28.284683] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:00:28.457902] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-15T20:00:28.660166] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T20:00:29.257881] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-15T20:00:29.675860] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:00:30.057884] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-15T20:00:30.857930] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-15T20:00:31.149354] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:00:31.532132] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:00:31.545963] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:00:31.548199] [INFO ] [REMOTE ] PLOW: Full fetch complete (22326 records). [2025-09-15T20:00:31.548304] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-15T20:00:31.662960] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-15T20:00:31.930900] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-15T20:00:31.931010] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-15T20:00:31.931522] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-15T20:00:31.931566] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-15T20:00:31.932383] [DEBUG] [LOCAL ] PLOW: Trimmed 22326 records to 15202 (keeping 150 days of data) [2025-09-15T20:00:32.034994] [DEBUG] [LOCAL ] PLOW: Primary data saved (15202 records). [2025-09-15T20:00:32.035235] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-15T20:00:32.035333] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PLOW took 19.9s. Estimated remaining: 1h 11m 10s. Rate: 9.4 symbols/min [2025-09-15T20:00:32.210903] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:32.255197] [DEBUG] [LOCAL ] PM: Loaded 40417 existing records from primary storage. [2025-09-15T20:00:32.255375] [INFO ] [MAIN ] PM: Loaded 40417 existing records. [2025-09-15T20:00:32.444997] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:32.445271] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-15T20:00:32.445316] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-15T20:00:32.446228] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-15T20:00:32.446286] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-15T20:00:32.467097] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-15T20:00:32.829141] [INFO ] [REMOTE ] PM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:33.063025] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T20:00:33.257873] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-15T20:00:34.049886] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:00:34.059260] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-15T20:00:34.857880] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-15T20:00:35.045531] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T20:00:35.075079] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T20:00:35.657929] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-15T20:00:36.158025] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:00:36.163133] [INFO ] [REMOTE ] PLNT: Full fetch complete (53014 records). [2025-09-15T20:00:36.163246] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-15T20:00:36.462752] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-15T20:00:36.557620] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-15T20:00:36.557721] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-15T20:00:36.558591] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-15T20:00:36.558656] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-15T20:00:36.559814] [DEBUG] [LOCAL ] PLNT: Trimmed 53014 records to 35594 (keeping 150 days of data) [2025-09-15T20:00:36.779445] [DEBUG] [LOCAL ] PLNT: Primary data saved (35594 records). [2025-09-15T20:00:36.779599] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-15T20:00:36.779694] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PLNT took 25.7s. Estimated remaining: 1h 11m 3s. Rate: 9.4 symbols/min [2025-09-15T20:00:36.962591] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:36.985781] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:00:37.007481] [DEBUG] [LOCAL ] PML: Loaded 15514 existing records from primary storage. [2025-09-15T20:00:37.007757] [INFO ] [MAIN ] PML: Loaded 15514 existing records. [2025-09-15T20:00:37.214620] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:37.215561] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-15T20:00:37.215630] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-15T20:00:37.216558] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-15T20:00:37.216632] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-15T20:00:37.263132] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-15T20:00:37.576957] [INFO ] [REMOTE ] PML: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:38.057892] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-15T20:00:38.632416] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T20:00:38.642185] [INFO ] [REMOTE ] PLD: Full fetch complete (58120 records). [2025-09-15T20:00:38.642335] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-15T20:00:38.863101] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-15T20:00:38.941691] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T20:00:39.050480] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-15T20:00:39.050624] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-15T20:00:39.051819] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-15T20:00:39.051891] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-15T20:00:39.053222] [DEBUG] [LOCAL ] PLD: Trimmed 58120 records to 39466 (keeping 150 days of data) [2025-09-15T20:00:39.298284] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T20:00:39.339563] [DEBUG] [LOCAL ] PLD: Primary data saved (39466 records). [2025-09-15T20:00:39.339723] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-15T20:00:39.339832] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PLD took 29.6s. Estimated remaining: 1h 10m 55s. Rate: 9.4 symbols/min [2025-09-15T20:00:39.512392] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:39.520351] [DEBUG] [LOCAL ] PMM: Loaded 6973 existing records from primary storage. [2025-09-15T20:00:39.520454] [INFO ] [MAIN ] PMM: Loaded 6973 existing records. [2025-09-15T20:00:39.661859] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-15T20:00:39.694898] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:39.695827] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-15T20:00:39.695893] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-15T20:00:39.696274] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-15T20:00:39.696346] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-15T20:00:40.045200] [INFO ] [REMOTE ] PMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:40.457890] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-15T20:00:40.510305] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:00:41.151751] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T20:00:41.257874] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-15T20:00:41.453261] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-15T20:00:42.057886] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-15T20:00:42.857875] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-15T20:00:42.898575] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T20:00:42.903255] [INFO ] [REMOTE ] PLYM: Full fetch complete (35484 records). [2025-09-15T20:00:42.903345] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-15T20:00:43.285364] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-15T20:00:43.285458] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-15T20:00:43.286176] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-15T20:00:43.286219] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-15T20:00:43.287162] [DEBUG] [LOCAL ] PLYM: Trimmed 35484 records to 24381 (keeping 150 days of data) [2025-09-15T20:00:43.443158] [DEBUG] [LOCAL ] PLYM: Primary data saved (24381 records). [2025-09-15T20:00:43.443342] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-15T20:00:43.443467] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PLYM took 20.5s. Estimated remaining: 1h 10m 48s. Rate: 9.4 symbols/min [2025-09-15T20:00:43.619399] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:00:43.638668] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T20:00:43.647972] [DEBUG] [LOCAL ] PMO: Loaded 7053 existing records from primary storage. [2025-09-15T20:00:43.648340] [INFO ] [MAIN ] PMO: Loaded 7053 existing records. [2025-09-15T20:00:43.662933] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-15T20:00:43.831751] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:00:43.832025] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-15T20:00:43.832075] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-15T20:00:43.832426] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-15T20:00:43.832476] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-15T20:00:44.200928] [INFO ] [REMOTE ] PMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:00:44.263052] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T20:00:44.457895] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-15T20:00:44.720188] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T20:00:45.257900] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-15T20:00:46.057934] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-15T20:00:46.169962] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T20:00:46.486490] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T20:00:46.574244] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T20:00:46.857884] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-15T20:00:47.657886] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-15T20:00:47.804611] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T20:00:48.268634] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T20:00:48.457876] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-15T20:00:49.170555] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T20:00:49.257820] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-15T20:00:49.994543] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:00:50.057883] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-15T20:00:50.857878] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-15T20:00:51.028769] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T20:00:51.632829] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T20:00:51.657838] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-15T20:00:52.457867] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-15T20:00:52.579827] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T20:00:53.207479] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:00:53.257830] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-15T20:00:53.832715] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T20:00:54.057880] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-15T20:00:54.839044] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:00:54.857819] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-15T20:00:55.519875] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T20:00:55.657835] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-15T20:00:56.457871] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-15T20:00:57.210132] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:00:57.257873] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-15T20:00:57.465347] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T20:00:57.922747] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T20:00:58.057869] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-15T20:00:58.857876] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-15T20:00:59.657875] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-15T20:00:59.925937] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T20:00:59.987302] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T20:00:59.990924] [INFO ] [REMOTE ] PML: Full fetch complete (21458 records). [2025-09-15T20:00:59.991003] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-15T20:01:00.263174] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T20:01:00.372625] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-15T20:01:00.372740] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-15T20:01:00.373255] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-15T20:01:00.373306] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-15T20:01:00.373943] [DEBUG] [LOCAL ] PML: Trimmed 21458 records to 15390 (keeping 150 days of data) [2025-09-15T20:01:00.467515] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-15T20:01:00.467788] [DEBUG] [LOCAL ] PML: Primary data saved (15390 records). [2025-09-15T20:01:00.468735] [INFO ] [MAIN ] PML: Full history saved. [2025-09-15T20:01:00.468826] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PML took 23.7s. Estimated remaining: 1h 10m 46s. Rate: 9.4 symbols/min [2025-09-15T20:01:00.640423] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:00.681426] [DEBUG] [LOCAL ] PMT: Loaded 29928 existing records from primary storage. [2025-09-15T20:01:00.681599] [INFO ] [MAIN ] PMT: Loaded 29928 existing records. [2025-09-15T20:01:00.862459] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:00.862802] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-15T20:01:00.862852] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-15T20:01:00.863749] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-15T20:01:00.863803] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-15T20:01:01.229332] [INFO ] [REMOTE ] PMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:01.257826] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-15T20:01:02.057880] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-15T20:01:02.585854] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T20:01:02.590701] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:01:02.857906] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-15T20:01:03.218221] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-15T20:01:03.597728] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T20:01:03.599338] [INFO ] [REMOTE ] PMM: Full fetch complete (12293 records). [2025-09-15T20:01:03.599411] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-15T20:01:03.662983] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-15T20:01:03.981241] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-15T20:01:03.981350] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-15T20:01:03.981896] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-15T20:01:03.981945] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-15T20:01:03.982509] [DEBUG] [LOCAL ] PMM: Trimmed 12293 records to 6727 (keeping 150 days of data) [2025-09-15T20:01:04.026882] [DEBUG] [LOCAL ] PMM: Primary data saved (6727 records). [2025-09-15T20:01:04.027097] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-15T20:01:04.027211] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMM took 24.7s. Estimated remaining: 1h 10m 38s. Rate: 9.4 symbols/min [2025-09-15T20:01:04.207262] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:04.207577] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-15T20:01:04.207619] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-15T20:01:04.207782] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-15T20:01:04.207822] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-15T20:01:04.207864] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-15T20:01:04.207898] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-15T20:01:04.465486] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-15T20:01:04.592085] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:05.166553] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T20:01:05.167954] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:01:05.177166] [INFO ] [REMOTE ] PMO: Full fetch complete (11448 records). [2025-09-15T20:01:05.177552] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-15T20:01:05.263030] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-15T20:01:05.568821] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-15T20:01:05.568904] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-15T20:01:05.569166] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-15T20:01:05.569207] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-15T20:01:05.569745] [DEBUG] [LOCAL ] PMO: Trimmed 11448 records to 6801 (keeping 150 days of data) [2025-09-15T20:01:05.614447] [DEBUG] [LOCAL ] PMO: Primary data saved (6801 records). [2025-09-15T20:01:05.614604] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-15T20:01:05.614719] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PMO took 22.2s. Estimated remaining: 1h 10m 30s. Rate: 9.4 symbols/min [2025-09-15T20:01:05.788535] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:05.788776] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-15T20:01:05.788816] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-15T20:01:05.788966] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-15T20:01:05.789005] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-15T20:01:05.789045] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-15T20:01:05.789078] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-15T20:01:06.067862] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-15T20:01:06.152888] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:06.443913] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T20:01:06.780971] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T20:01:06.857856] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-15T20:01:07.657945] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-15T20:01:07.978683] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T20:01:08.348793] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T20:01:08.355747] [INFO ] [REMOTE ] PM: Full fetch complete (58343 records). [2025-09-15T20:01:08.355988] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-15T20:01:08.462984] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-15T20:01:08.778139] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-09-15T20:01:08.778261] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-09-15T20:01:08.779627] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-09-15T20:01:08.779713] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-09-15T20:01:08.781576] [DEBUG] [LOCAL ] PM: Trimmed 58343 records to 39637 (keeping 150 days of data) [2025-09-15T20:01:09.016423] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T20:01:09.061384] [DEBUG] [LOCAL ] PM: Primary data saved (39637 records). [2025-09-15T20:01:09.061625] [INFO ] [MAIN ] PM: Full history saved. [2025-09-15T20:01:09.062511] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PM took 37.0s. Estimated remaining: 1h 10m 23s. Rate: 9.4 symbols/min [2025-09-15T20:01:09.246163] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:09.246406] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-15T20:01:09.246453] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-15T20:01:09.246617] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-15T20:01:09.246685] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-15T20:01:09.246736] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-15T20:01:09.246790] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-15T20:01:09.266939] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-15T20:01:09.602220] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:09.903472] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T20:01:10.057914] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-15T20:01:10.591402] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T20:01:10.858146] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-15T20:01:11.061629] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:01:11.062065] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-15T20:01:11.657888] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-15T20:01:11.877759] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:01:11.878249] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-15T20:01:12.457890] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-15T20:01:13.034697] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T20:01:13.257897] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-15T20:01:13.574377] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T20:01:14.057895] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-15T20:01:14.645523] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T20:01:14.857912] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-15T20:01:15.657933] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-15T20:01:15.847135] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:01:15.847611] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-15T20:01:16.042395] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T20:01:16.457951] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-15T20:01:16.849581] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T20:01:17.257949] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-15T20:01:17.441904] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:01:17.442265] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-15T20:01:18.057901] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-15T20:01:18.692812] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T20:01:18.857890] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-15T20:01:19.518956] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T20:01:19.657902] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-15T20:01:20.067333] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T20:01:20.457923] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-15T20:01:21.017070] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:01:21.257991] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-15T20:01:22.057933] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-15T20:01:22.520908] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T20:01:22.552513] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T20:01:22.857967] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-15T20:01:23.437601] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T20:01:23.439042] [INFO ] [REMOTE ] PMTW: Full fetch complete (3566 records). [2025-09-15T20:01:23.439141] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-15T20:01:23.650877] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 65 unique days, need 150 days [2025-09-15T20:01:23.651180] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:01:23.651227] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:01:23.651270] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-15T20:01:23.651359] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-15T20:01:23.651401] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-15T20:01:23.651451] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-15T20:01:23.651539] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PMTW took 14.6s. Estimated remaining: 1h 10m 20s. Rate: 9.4 symbols/min [2025-09-15T20:01:23.663068] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-15T20:01:23.836330] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:23.892315] [DEBUG] [LOCAL ] PNC: Loaded 39287 existing records from primary storage. [2025-09-15T20:01:23.892534] [INFO ] [MAIN ] PNC: Loaded 39287 existing records. [2025-09-15T20:01:24.093089] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:24.093439] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-15T20:01:24.093489] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-15T20:01:24.094787] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-15T20:01:24.094848] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-15T20:01:24.472868] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-15T20:01:24.480784] [INFO ] [REMOTE ] PNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:24.801148] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T20:01:25.257918] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-15T20:01:25.350395] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T20:01:25.754400] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:01:25.755461] [INFO ] [REMOTE ] PMTU: Full fetch complete (850 records). [2025-09-15T20:01:25.755541] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-15T20:01:25.955008] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T20:01:25.955338] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:01:25.955400] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:01:25.955453] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-15T20:01:25.955525] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-15T20:01:25.955564] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-15T20:01:25.955623] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-15T20:01:25.955774] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PMTU took 21.9s. Estimated remaining: 1h 10m 12s. Rate: 9.4 symbols/min [2025-09-15T20:01:26.063081] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-15T20:01:26.150507] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:26.159582] [DEBUG] [LOCAL ] PNI: Loaded 4942 existing records from primary storage. [2025-09-15T20:01:26.159822] [INFO ] [MAIN ] PNI: Loaded 4942 existing records. [2025-09-15T20:01:26.343390] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:26.343812] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-15T20:01:26.343871] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-15T20:01:26.344313] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-15T20:01:26.344369] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-15T20:01:26.718833] [INFO ] [REMOTE ] PNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:26.857924] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-15T20:01:27.391412] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T20:01:27.657876] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-15T20:01:27.747210] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T20:01:28.352416] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T20:01:28.457929] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-15T20:01:29.257941] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-15T20:01:29.809208] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T20:01:29.826732] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T20:01:30.057919] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-15T20:01:30.627912] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T20:01:30.857914] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-15T20:01:31.657974] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-15T20:01:32.403785] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:01:32.457870] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-15T20:01:32.614391] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T20:01:33.132165] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:01:33.257905] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-15T20:01:34.057934] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-15T20:01:34.529442] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:01:34.533512] [INFO ] [REMOTE ] PMT: Full fetch complete (43663 records). [2025-09-15T20:01:34.533617] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-15T20:01:34.631371] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T20:01:34.642749] [INFO ] [REMOTE ] PMTV: Full fetch complete (6003 records). [2025-09-15T20:01:34.653331] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-15T20:01:34.860635] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-15T20:01:34.958580] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T20:01:35.002285] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:01:35.028334] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:01:35.031044] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-15T20:01:35.036699] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-15T20:01:35.052062] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-15T20:01:35.107319] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-15T20:01:35.121387] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PMTV took 29.5s. Estimated remaining: 1h 10m 6s. Rate: 9.4 symbols/min [2025-09-15T20:01:35.121509] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-15T20:01:35.121665] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-15T20:01:35.122576] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-15T20:01:35.164674] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-15T20:01:35.229374] [DEBUG] [LOCAL ] PMT: Trimmed 43663 records to 29148 (keeping 150 days of data) [2025-09-15T20:01:35.358298] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:35.433761] [DEBUG] [LOCAL ] PNNT: Loaded 24207 existing records from primary storage. [2025-09-15T20:01:35.434865] [INFO ] [MAIN ] PNNT: Loaded 24207 existing records. [2025-09-15T20:01:35.623882] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:35.625116] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-15T20:01:35.625639] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-15T20:01:35.627053] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-15T20:01:35.627824] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-15T20:01:35.659400] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-15T20:01:36.055621] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:36.065498] [DEBUG] [LOCAL ] PMT: Primary data saved (29148 records). [2025-09-15T20:01:36.065596] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-15T20:01:36.065703] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. PMT took 35.6s. Estimated remaining: 1h 9m 58s. Rate: 9.4 symbols/min [2025-09-15T20:01:36.234786] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:36.273157] [DEBUG] [LOCAL ] PNR: Loaded 35810 existing records from primary storage. [2025-09-15T20:01:36.277036] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T20:01:36.277145] [INFO ] [MAIN ] PNR: Loaded 35810 existing records. [2025-09-15T20:01:36.469992] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-15T20:01:36.477558] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:36.479380] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-15T20:01:36.479549] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-15T20:01:36.480528] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-09-15T20:01:36.480583] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-15T20:01:36.835132] [INFO ] [REMOTE ] PNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:36.866782] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:01:36.988404] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T20:01:37.257909] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-15T20:01:38.057960] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-15T20:01:38.188154] [DEBUG] [REMOTE ] PNR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T20:01:38.188590] [WARN ] [REMOTE ] PNR: No data returned for month 2025-02 [2025-09-15T20:01:38.857878] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-15T20:01:38.933011] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T20:01:39.657880] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-15T20:01:40.457937] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-15T20:01:40.534146] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T20:01:40.584463] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:01:40.903427] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T20:01:41.257876] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-15T20:01:42.057879] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-15T20:01:42.857883] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-15T20:01:43.101681] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T20:01:43.291740] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T20:01:43.371243] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T20:01:43.373125] [INFO ] [REMOTE ] PNI: Full fetch complete (7254 records). [2025-09-15T20:01:43.373217] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-15T20:01:43.662968] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-15T20:01:43.739416] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-15T20:01:43.739573] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-15T20:01:43.739792] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-15T20:01:43.739861] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-15T20:01:43.740536] [DEBUG] [LOCAL ] PNI: Trimmed 7254 records to 4886 (keeping 150 days of data) [2025-09-15T20:01:43.773726] [DEBUG] [LOCAL ] PNI: Primary data saved (4886 records). [2025-09-15T20:01:43.773908] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-15T20:01:43.774054] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. PNI took 17.8s. Estimated remaining: 1h 9m 52s. Rate: 9.4 symbols/min [2025-09-15T20:01:43.950505] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:43.989527] [DEBUG] [LOCAL ] PNW: Loaded 34616 existing records from primary storage. [2025-09-15T20:01:43.989686] [INFO ] [MAIN ] PNW: Loaded 34616 existing records. [2025-09-15T20:01:44.164615] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:44.164921] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-15T20:01:44.164997] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-15T20:01:44.165862] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-15T20:01:44.165920] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-15T20:01:44.463122] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-15T20:01:44.514085] [INFO ] [REMOTE ] PNW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:45.257916] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-15T20:01:45.324316] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T20:01:46.057853] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-15T20:01:46.141807] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T20:01:46.454635] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T20:01:46.857863] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-15T20:01:47.341694] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T20:01:47.657872] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-15T20:01:48.377838] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:01:48.457883] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-15T20:01:49.253050] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T20:01:49.263016] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-15T20:01:49.939623] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T20:01:50.057886] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-15T20:01:50.759213] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T20:01:50.857869] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-15T20:01:51.277490] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T20:01:51.657888] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-15T20:01:52.251963] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:01:52.457881] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-15T20:01:53.210737] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T20:01:53.216743] [INFO ] [REMOTE ] PNC: Full fetch complete (56931 records). [2025-09-15T20:01:53.216890] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-15T20:01:53.263117] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-15T20:01:53.615624] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-09-15T20:01:53.615787] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-09-15T20:01:53.617258] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-09-15T20:01:53.617339] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-09-15T20:01:53.619216] [DEBUG] [LOCAL ] PNC: Trimmed 56931 records to 38496 (keeping 150 days of data) [2025-09-15T20:01:53.894527] [DEBUG] [LOCAL ] PNC: Primary data saved (38496 records). [2025-09-15T20:01:53.894814] [INFO ] [MAIN ] PNC: Full history saved. [2025-09-15T20:01:53.896393] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. PNC took 30.2s. Estimated remaining: 1h 9m 47s. Rate: 9.4 symbols/min [2025-09-15T20:01:54.064757] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-15T20:01:54.099611] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:54.122633] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T20:01:54.130157] [INFO ] [REMOTE ] PNR: Full fetch complete (47590 records). [2025-09-15T20:01:54.130417] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-15T20:01:54.359266] [WARN ] [VALIDATOR ] PNR: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T20:01:54.361469] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:01:54.362328] [DEBUG] [LOCAL ] POR: Loaded 35115 existing records from primary storage. [2025-09-15T20:01:54.362442] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:01:54.362549] [INFO ] [MAIN ] POR: Loaded 35115 existing records. [2025-09-15T20:01:54.362714] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-15T20:01:54.417418] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-15T20:01:54.461398] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-15T20:01:54.465351] [DEBUG] [LOCAL ] PNR: Deleted derivative data file. [2025-09-15T20:01:54.486873] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. PNR took 18.4s. Estimated remaining: 1h 9m 38s. Rate: 9.4 symbols/min [2025-09-15T20:01:54.546022] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:54.631534] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-15T20:01:54.658009] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-15T20:01:54.674526] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-15T20:01:54.674451] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T20:01:54.684970] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-15T20:01:54.858560] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-15T20:01:54.891339] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:01:55.139905] [INFO ] [REMOTE ] POR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:55.149483] [DEBUG] [LOCAL ] POST: Loaded 29045 existing records from primary storage. [2025-09-15T20:01:55.149627] [INFO ] [MAIN ] POST: Loaded 29045 existing records. [2025-09-15T20:01:55.327759] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:01:55.328018] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-15T20:01:55.328064] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-15T20:01:55.328855] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-15T20:01:55.328909] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-15T20:01:55.659539] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-15T20:01:55.682337] [INFO ] [REMOTE ] POST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:01:55.740679] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:01:56.188169] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T20:01:56.457884] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-15T20:01:57.195147] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:01:57.257877] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-15T20:01:57.780157] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:01:58.057857] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-15T20:01:58.632545] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T20:01:58.857857] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-15T20:01:59.093418] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T20:01:59.657897] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-15T20:01:59.915020] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T20:02:00.457887] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-15T20:02:00.945620] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:02:00.949690] [INFO ] [REMOTE ] PNNT: Full fetch complete (35630 records). [2025-09-15T20:02:00.949789] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-15T20:02:01.262968] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-15T20:02:01.336954] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-15T20:02:01.337069] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-15T20:02:01.337961] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-15T20:02:01.338011] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-15T20:02:01.339047] [DEBUG] [LOCAL ] PNNT: Trimmed 35630 records to 23767 (keeping 150 days of data) [2025-09-15T20:02:01.489008] [DEBUG] [LOCAL ] PNNT: Primary data saved (23767 records). [2025-09-15T20:02:01.489177] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-15T20:02:01.489285] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PNNT took 26.4s. Estimated remaining: 1h 9m 32s. Rate: 9.4 symbols/min [2025-09-15T20:02:01.664636] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:01.707007] [DEBUG] [LOCAL ] PPG: Loaded 37868 existing records from primary storage. [2025-09-15T20:02:01.707195] [INFO ] [MAIN ] PPG: Loaded 37868 existing records. [2025-09-15T20:02:01.905687] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:01.906027] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-15T20:02:01.906090] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-15T20:02:01.907073] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-15T20:02:01.907143] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-15T20:02:02.068187] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-15T20:02:02.289742] [INFO ] [REMOTE ] PPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:02.321605] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T20:02:02.863897] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-15T20:02:02.880732] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:02:03.418675] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:02:03.657904] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-15T20:02:04.452588] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:02:04.467271] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-15T20:02:05.136232] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T20:02:05.257884] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-15T20:02:06.051265] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:02:06.059134] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-15T20:02:06.602614] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T20:02:06.857898] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-15T20:02:07.653063] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:02:07.662919] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-15T20:02:08.395993] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:02:08.457857] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-15T20:02:09.257920] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-15T20:02:09.442969] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T20:02:10.057889] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-15T20:02:10.301816] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T20:02:10.673404] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T20:02:10.857903] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-15T20:02:11.587618] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T20:02:11.657930] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-15T20:02:12.361016] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:02:12.366548] [INFO ] [REMOTE ] PNW: Full fetch complete (50008 records). [2025-09-15T20:02:12.366820] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-15T20:02:12.466422] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-15T20:02:12.778374] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-15T20:02:12.778472] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-15T20:02:12.779616] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-15T20:02:12.779697] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-15T20:02:12.781132] [DEBUG] [LOCAL ] PNW: Trimmed 50008 records to 33968 (keeping 150 days of data) [2025-09-15T20:02:13.023020] [DEBUG] [LOCAL ] PNW: Primary data saved (33968 records). [2025-09-15T20:02:13.023715] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-15T20:02:13.024586] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PNW took 29.3s. Estimated remaining: 1h 9m 28s. Rate: 9.4 symbols/min [2025-09-15T20:02:13.024451] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T20:02:13.208398] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:13.245415] [DEBUG] [LOCAL ] PPL: Loaded 40279 existing records from primary storage. [2025-09-15T20:02:13.245584] [INFO ] [MAIN ] PPL: Loaded 40279 existing records. [2025-09-15T20:02:13.265920] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-15T20:02:13.423489] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:13.423736] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-15T20:02:13.423807] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-15T20:02:13.424733] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-15T20:02:13.424791] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-15T20:02:13.783137] [INFO ] [REMOTE ] PPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:14.038846] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T20:02:14.057811] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-15T20:02:14.857843] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-15T20:02:14.998100] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T20:02:15.619272] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T20:02:15.624632] [INFO ] [REMOTE ] POR: Full fetch complete (51196 records). [2025-09-15T20:02:15.624778] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-15T20:02:15.667534] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-15T20:02:16.010465] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-15T20:02:16.010583] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-15T20:02:16.011451] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-15T20:02:16.011495] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-15T20:02:16.012676] [DEBUG] [LOCAL ] POR: Trimmed 51196 records to 34526 (keeping 150 days of data) [2025-09-15T20:02:16.222376] [DEBUG] [LOCAL ] POR: Primary data saved (34526 records). [2025-09-15T20:02:16.222531] [INFO ] [MAIN ] POR: Full history saved. [2025-09-15T20:02:16.222676] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. POR took 22.3s. Estimated remaining: 1h 9m 20s. Rate: 9.4 symbols/min [2025-09-15T20:02:16.394284] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:16.409935] [DEBUG] [LOCAL ] PPT: Loaded 15034 existing records from primary storage. [2025-09-15T20:02:16.410065] [INFO ] [MAIN ] PPT: Loaded 15034 existing records. [2025-09-15T20:02:16.478190] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-15T20:02:16.670229] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T20:02:16.675143] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:16.685218] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-15T20:02:16.685296] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-15T20:02:16.685837] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-15T20:02:16.685901] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-15T20:02:17.039091] [INFO ] [REMOTE ] PPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:17.092474] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T20:02:17.257876] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-15T20:02:17.824579] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T20:02:18.057874] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-15T20:02:18.774725] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:02:18.857886] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-15T20:02:19.075821] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T20:02:19.657889] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-15T20:02:20.395842] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T20:02:20.400737] [INFO ] [REMOTE ] POST: Full fetch complete (42278 records). [2025-09-15T20:02:20.400852] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-15T20:02:20.467228] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-15T20:02:20.781379] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-15T20:02:20.781495] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-15T20:02:20.782377] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-15T20:02:20.782529] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-15T20:02:20.796168] [DEBUG] [LOCAL ] POST: Trimmed 42278 records to 28650 (keeping 150 days of data) [2025-09-15T20:02:20.796768] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T20:02:20.980148] [DEBUG] [LOCAL ] POST: Primary data saved (28650 records). [2025-09-15T20:02:20.980293] [INFO ] [MAIN ] POST: Full history saved. [2025-09-15T20:02:20.980387] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. POST took 26.4s. Estimated remaining: 1h 9m 13s. Rate: 9.4 symbols/min [2025-09-15T20:02:21.257886] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-15T20:02:22.057966] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-15T20:02:22.092877] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:02:22.693822] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T20:02:22.857879] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-15T20:02:23.064299] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T20:02:23.657885] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-15T20:02:24.457910] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-15T20:02:24.522351] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T20:02:24.561629] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T20:02:25.257926] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-15T20:02:26.019113] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T20:02:26.057890] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-15T20:02:26.095938] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T20:02:26.857891] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-15T20:02:27.657909] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-15T20:02:27.868686] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:02:27.898494] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T20:02:28.457885] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-15T20:02:29.144464] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:02:29.257895] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-15T20:02:29.429059] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T20:02:30.057913] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-15T20:02:30.857896] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-15T20:02:30.911524] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:02:30.914221] [INFO ] [REMOTE ] PPT: Full fetch complete (21848 records). [2025-09-15T20:02:30.914314] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-15T20:02:31.310573] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-15T20:02:31.311634] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-15T20:02:31.317293] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-15T20:02:31.318059] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-15T20:02:31.318146] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-15T20:02:31.318441] [INFO ] [REMOTE ] PPG: Full fetch complete (55314 records). [2025-09-15T20:02:31.318850] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-15T20:02:31.352507] [DEBUG] [LOCAL ] PPT: Trimmed 21848 records to 14642 (keeping 150 days of data) [2025-09-15T20:02:31.574538] [DEBUG] [LOCAL ] PPT: Primary data saved (14642 records). [2025-09-15T20:02:31.595046] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-15T20:02:31.611458] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PPT took 15.4s. Estimated remaining: 1h 9m 9s. Rate: 9.4 symbols/min [2025-09-15T20:02:31.796548] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-15T20:02:31.796655] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-15T20:02:31.797631] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-15T20:02:31.797690] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-15T20:02:31.799125] [DEBUG] [LOCAL ] PPG: Trimmed 55314 records to 37105 (keeping 150 days of data) [2025-09-15T20:02:32.049778] [DEBUG] [LOCAL ] PPG: Primary data saved (37105 records). [2025-09-15T20:02:32.050056] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-15T20:02:32.051114] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PPG took 30.6s. Estimated remaining: 1h 9m 0s. Rate: 9.4 symbols/min [2025-09-15T20:02:32.562517] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T20:02:32.574453] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-15T20:02:34.391832] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T20:02:34.403537] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-15T20:02:35.890715] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:02:35.902131] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-15T20:02:37.581591] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T20:02:37.589803] [INFO ] [REMOTE ] PPL: Full fetch complete (58190 records). [2025-09-15T20:02:37.590075] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-15T20:02:37.995533] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-09-15T20:02:37.995657] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-09-15T20:02:37.996898] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-09-15T20:02:37.996960] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-09-15T20:02:37.998249] [DEBUG] [LOCAL ] PPL: Trimmed 58190 records to 39499 (keeping 150 days of data) [2025-09-15T20:02:38.263064] [DEBUG] [LOCAL ] PPL: Primary data saved (39499 records). [2025-09-15T20:02:38.263292] [INFO ] [MAIN ] PPL: Full history saved. [2025-09-15T20:02:38.263440] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PPL took 25.2s. Estimated remaining: 1h 8m 54s. Rate: 9.4 symbols/min [2025-09-15T20:02:38.890951] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:38.947843] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:38.985433] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:39.044374] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:39.051337] [DEBUG] [LOCAL ] PRCS: Loaded 2019 existing records from primary storage. [2025-09-15T20:02:39.051609] [INFO ] [MAIN ] PRCS: Loaded 2019 existing records. [2025-09-15T20:02:39.190337] [DEBUG] [LOCAL ] PRG: Loaded 22008 existing records from primary storage. [2025-09-15T20:02:39.196745] [INFO ] [MAIN ] PRG: Loaded 22008 existing records. [2025-09-15T20:02:39.354331] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:39.381045] [DEBUG] [LOCAL ] PRA: Loaded 26274 existing records from primary storage. [2025-09-15T20:02:39.407478] [INFO ] [MAIN ] PRA: Loaded 26274 existing records. [2025-09-15T20:02:39.435500] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-15T20:02:39.461355] [DEBUG] [LOCAL ] PR: Loaded 40354 existing records from primary storage. [2025-09-15T20:02:39.461571] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-15T20:02:39.492205] [INFO ] [MAIN ] PR: Loaded 40354 existing records. [2025-09-15T20:02:39.555362] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-09-15T20:02:39.576738] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-15T20:02:39.670942] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:39.722750] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-15T20:02:39.808510] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-15T20:02:39.896937] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-15T20:02:39.912417] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:39.912523] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-15T20:02:39.923042] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-15T20:02:40.072828] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-15T20:02:40.130722] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-15T20:02:40.184282] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:40.184107] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-15T20:02:40.238500] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-15T20:02:40.255046] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-15T20:02:40.326060] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-15T20:02:40.351789] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-15T20:02:41.052823] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:41.112806] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-15T20:02:41.323757] [INFO ] [REMOTE ] PRA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:41.337766] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-15T20:02:41.487405] [INFO ] [REMOTE ] PR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:41.524354] [INFO ] [REMOTE ] PRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:41.519477] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-15T20:02:41.525386] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-15T20:02:41.822564] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T20:02:41.824340] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-15T20:02:42.355549] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T20:02:42.356999] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-15T20:02:42.369930] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T20:02:42.374048] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-15T20:02:42.475269] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T20:02:42.482520] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-15T20:02:42.857943] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T20:02:42.867989] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-15T20:02:42.932568] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T20:02:42.934900] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-15T20:02:43.292685] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T20:02:43.299528] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-15T20:02:43.341294] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T20:02:43.343004] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-15T20:02:43.748986] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T20:02:43.750796] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-15T20:02:43.926915] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T20:02:44.122237] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-15T20:02:44.290373] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:02:44.399380] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T20:02:44.457882] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-15T20:02:45.257876] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-15T20:02:46.057944] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-15T20:02:46.287613] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T20:02:46.322381] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T20:02:46.857920] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-15T20:02:47.495174] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T20:02:47.657862] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-15T20:02:48.420700] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:02:48.457850] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-15T20:02:49.044849] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T20:02:49.257865] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-15T20:02:49.971771] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T20:02:50.057885] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-15T20:02:50.333756] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T20:02:50.857863] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-15T20:02:51.302008] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T20:02:51.606264] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:02:51.657891] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-15T20:02:52.457883] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-15T20:02:52.835329] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:02:52.836163] [INFO ] [REMOTE ] PRCS: Full fetch complete (3069 records). [2025-09-15T20:02:52.836231] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-15T20:02:53.186592] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-09-15T20:02:53.186692] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-09-15T20:02:53.186807] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-09-15T20:02:53.186853] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-09-15T20:02:53.187209] [DEBUG] [LOCAL ] PRCS: Trimmed 3069 records to 1987 (keeping 150 days of data) [2025-09-15T20:02:53.199328] [DEBUG] [LOCAL ] PRCS: Primary data saved (1987 records). [2025-09-15T20:02:53.199389] [INFO ] [MAIN ] PRCS: Full history saved. [2025-09-15T20:02:53.199473] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRCS took 14.9s. Estimated remaining: 1h 8m 50s. Rate: 9.4 symbols/min [2025-09-15T20:02:53.266982] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-15T20:02:53.377920] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:53.419629] [DEBUG] [LOCAL ] PRGO: Loaded 34678 existing records from primary storage. [2025-09-15T20:02:53.419790] [INFO ] [MAIN ] PRGO: Loaded 34678 existing records. [2025-09-15T20:02:53.597870] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:53.598349] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-15T20:02:53.598458] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-15T20:02:53.609335] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-15T20:02:53.625017] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-15T20:02:53.710427] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T20:02:53.989801] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:54.057855] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-15T20:02:54.584384] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T20:02:54.857887] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-15T20:02:55.657868] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-15T20:02:55.938447] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T20:02:55.947505] [INFO ] [REMOTE ] PR: Full fetch complete (58286 records). [2025-09-15T20:02:55.947709] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-15T20:02:56.358473] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:02:56.357142] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-15T20:02:56.358606] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-15T20:02:56.367103] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-15T20:02:56.367376] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-15T20:02:56.368716] [DEBUG] [LOCAL ] PR: Trimmed 58286 records to 39574 (keeping 150 days of data) [2025-09-15T20:02:56.463080] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-15T20:02:56.616520] [DEBUG] [LOCAL ] PR: Primary data saved (39574 records). [2025-09-15T20:02:56.616679] [INFO ] [MAIN ] PR: Full history saved. [2025-09-15T20:02:56.617214] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PR took 18.4s. Estimated remaining: 1h 8m 43s. Rate: 9.4 symbols/min [2025-09-15T20:02:56.795838] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:02:56.803419] [DEBUG] [LOCAL ] PRH: Loaded 3644 existing records from primary storage. [2025-09-15T20:02:56.803578] [INFO ] [MAIN ] PRH: Loaded 3644 existing records. [2025-09-15T20:02:56.987480] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:02:57.010899] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-15T20:02:57.010976] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-15T20:02:57.011597] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-15T20:02:57.011684] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-15T20:02:57.012526] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T20:02:57.266635] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-15T20:02:57.398613] [INFO ] [REMOTE ] PRH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:02:57.691561] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T20:02:58.057873] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-15T20:02:58.354817] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T20:02:58.476988] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T20:02:58.857911] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-15T20:02:59.431812] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T20:02:59.657891] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-15T20:03:00.359905] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T20:03:00.457900] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-15T20:03:01.257889] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-15T20:03:01.594058] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T20:03:02.057866] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-15T20:03:02.755945] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:03:02.759377] [INFO ] [REMOTE ] PRA: Full fetch complete (36451 records). [2025-09-15T20:03:02.759470] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-15T20:03:02.860377] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-15T20:03:03.133717] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-15T20:03:03.133801] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-15T20:03:03.134537] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-15T20:03:03.134580] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-15T20:03:03.135454] [DEBUG] [LOCAL ] PRA: Trimmed 36451 records to 25598 (keeping 150 days of data) [2025-09-15T20:03:03.292806] [DEBUG] [LOCAL ] PRA: Primary data saved (25598 records). [2025-09-15T20:03:03.292954] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-15T20:03:03.293062] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRA took 25.0s. Estimated remaining: 1h 8m 37s. Rate: 9.4 symbols/min [2025-09-15T20:03:03.461345] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:03.475947] [DEBUG] [LOCAL ] PRI: Loaded 13321 existing records from primary storage. [2025-09-15T20:03:03.476071] [INFO ] [MAIN ] PRI: Loaded 13321 existing records. [2025-09-15T20:03:03.668471] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-15T20:03:03.674480] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:03.675859] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-15T20:03:03.675918] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-15T20:03:03.676424] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-15T20:03:03.676484] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-15T20:03:04.042065] [INFO ] [REMOTE ] PRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:04.457939] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-15T20:03:04.881044] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-15T20:03:04.892715] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T20:03:04.903727] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-15T20:03:04.906714] [INFO ] [REMOTE ] PRG: Full fetch complete (34227 records). [2025-09-15T20:03:04.906812] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-15T20:03:05.263531] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-15T20:03:05.288845] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-15T20:03:05.288976] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-15T20:03:05.289856] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-15T20:03:05.289920] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-15T20:03:05.291071] [DEBUG] [LOCAL ] PRG: Trimmed 34227 records to 21553 (keeping 150 days of data) [2025-09-15T20:03:05.424377] [DEBUG] [LOCAL ] PRG: Primary data saved (21553 records). [2025-09-15T20:03:05.424511] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-15T20:03:05.424595] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PRG took 27.1s. Estimated remaining: 1h 8m 29s. Rate: 9.4 symbols/min [2025-09-15T20:03:05.604179] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:05.622820] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T20:03:05.660471] [DEBUG] [LOCAL ] PRIM: Loaded 33406 existing records from primary storage. [2025-09-15T20:03:05.660670] [INFO ] [MAIN ] PRIM: Loaded 33406 existing records. [2025-09-15T20:03:05.768667] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T20:03:05.847157] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:05.847408] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-15T20:03:05.847458] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-15T20:03:05.848396] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-15T20:03:05.848468] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-15T20:03:06.063326] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-15T20:03:06.233162] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:06.857901] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-15T20:03:07.657857] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-15T20:03:07.750497] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T20:03:08.457861] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-15T20:03:08.513878] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T20:03:08.640308] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:03:09.257887] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-15T20:03:09.821362] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:03:09.880394] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T20:03:10.057880] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-15T20:03:10.623595] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T20:03:10.857929] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-15T20:03:11.657890] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-15T20:03:12.156783] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:03:12.157750] [INFO ] [REMOTE ] PRH: Full fetch complete (5867 records). [2025-09-15T20:03:12.157822] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-15T20:03:12.461720] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-15T20:03:12.533161] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-15T20:03:12.533389] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-15T20:03:12.533796] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-15T20:03:12.533973] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-15T20:03:12.534813] [DEBUG] [LOCAL ] PRH: Trimmed 5867 records to 3510 (keeping 150 days of data) [2025-09-15T20:03:12.562391] [DEBUG] [LOCAL ] PRH: Primary data saved (3510 records). [2025-09-15T20:03:12.562741] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-15T20:03:12.562991] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRH took 15.9s. Estimated remaining: 1h 8m 23s. Rate: 9.4 symbols/min [2025-09-15T20:03:12.744871] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T20:03:12.807016] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:12.851228] [DEBUG] [LOCAL ] PRKS: Loaded 31624 existing records from primary storage. [2025-09-15T20:03:12.851472] [INFO ] [MAIN ] PRKS: Loaded 31624 existing records. [2025-09-15T20:03:13.035132] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:13.035516] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-15T20:03:13.035570] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-15T20:03:13.036484] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-15T20:03:13.036543] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-15T20:03:13.263133] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-15T20:03:13.403071] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:14.057921] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-15T20:03:14.857921] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-15T20:03:14.988371] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-15T20:03:15.607139] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T20:03:15.657929] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-15T20:03:15.881434] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T20:03:16.061341] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-15T20:03:16.457915] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-15T20:03:16.848527] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T20:03:17.137471] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T20:03:17.257929] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-15T20:03:18.057874] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-15T20:03:18.564574] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:03:18.857873] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-15T20:03:19.086858] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T20:03:19.657921] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-15T20:03:20.325250] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:03:20.457889] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-15T20:03:20.804076] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T20:03:21.257869] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-15T20:03:21.740664] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T20:03:22.057910] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-15T20:03:22.857964] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-15T20:03:22.894680] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:03:23.039402] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T20:03:23.657896] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-15T20:03:24.283987] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:03:24.457888] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-15T20:03:24.502238] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T20:03:25.257900] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-15T20:03:25.783470] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T20:03:26.057920] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-15T20:03:26.519665] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T20:03:26.525151] [INFO ] [REMOTE ] PRGO: Full fetch complete (51202 records). [2025-09-15T20:03:26.525299] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-15T20:03:26.867092] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-15T20:03:26.924332] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-15T20:03:26.924460] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-15T20:03:26.925671] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-15T20:03:26.925735] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-15T20:03:26.927151] [DEBUG] [LOCAL ] PRGO: Trimmed 51202 records to 34043 (keeping 150 days of data) [2025-09-15T20:03:27.057918] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T20:03:27.066113] [INFO ] [REMOTE ] PRI: Full fetch complete (19894 records). [2025-09-15T20:03:27.068788] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-15T20:03:27.474169] [DEBUG] [LOCAL ] PRGO: Primary data saved (34043 records). [2025-09-15T20:03:27.490964] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-15T20:03:27.496011] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PRGO took 34.3s. Estimated remaining: 1h 8m 19s. Rate: 9.4 symbols/min [2025-09-15T20:03:27.658507] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-15T20:03:27.715452] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-15T20:03:27.766942] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:27.767130] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-15T20:03:27.768689] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-15T20:03:27.769210] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-15T20:03:27.770945] [DEBUG] [LOCAL ] PRI: Trimmed 19894 records to 13062 (keeping 150 days of data) [2025-09-15T20:03:27.854220] [DEBUG] [LOCAL ] PRLB: Loaded 15442 existing records from primary storage. [2025-09-15T20:03:27.858831] [INFO ] [MAIN ] PRLB: Loaded 15442 existing records. [2025-09-15T20:03:28.055604] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:28.060049] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-15T20:03:28.059806] [DEBUG] [LOCAL ] PRI: Primary data saved (13062 records). [2025-09-15T20:03:28.060247] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-15T20:03:28.060361] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-15T20:03:28.060635] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRI took 24.8s. Estimated remaining: 1h 8m 11s. Rate: 9.4 symbols/min [2025-09-15T20:03:28.061040] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-15T20:03:28.066290] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-15T20:03:28.409300] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:28.623342] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:28.625560] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-15T20:03:28.665433] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T20:03:28.689175] [DEBUG] [LOCAL ] PRM: Loaded 33203 existing records from primary storage. [2025-09-15T20:03:28.689382] [INFO ] [MAIN ] PRM: Loaded 33203 existing records. [2025-09-15T20:03:28.884426] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:28.884739] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-15T20:03:28.884792] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-15T20:03:28.885611] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-15T20:03:28.885707] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-15T20:03:29.251571] [INFO ] [REMOTE ] PRM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:29.263138] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-15T20:03:29.279227] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T20:03:29.817074] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:03:30.057871] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-15T20:03:30.682455] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T20:03:30.857887] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-15T20:03:31.636918] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T20:03:31.641815] [INFO ] [REMOTE ] PRIM: Full fetch complete (48612 records). [2025-09-15T20:03:31.641928] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-15T20:03:31.662998] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-15T20:03:32.038189] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-15T20:03:32.038312] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-15T20:03:32.039176] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-15T20:03:32.039262] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-15T20:03:32.040703] [DEBUG] [LOCAL ] PRIM: Trimmed 48612 records to 32736 (keeping 150 days of data) [2025-09-15T20:03:32.176664] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:03:32.295983] [DEBUG] [LOCAL ] PRIM: Primary data saved (32736 records). [2025-09-15T20:03:32.296244] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-15T20:03:32.296347] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRIM took 26.9s. Estimated remaining: 1h 8m 4s. Rate: 9.4 symbols/min [2025-09-15T20:03:32.459461] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-15T20:03:32.480984] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:32.528302] [DEBUG] [LOCAL ] PRMB: Loaded 40051 existing records from primary storage. [2025-09-15T20:03:32.528474] [INFO ] [MAIN ] PRMB: Loaded 40051 existing records. [2025-09-15T20:03:32.707431] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:32.707908] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-15T20:03:32.707968] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-15T20:03:32.716475] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-15T20:03:32.721345] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-15T20:03:32.803104] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T20:03:33.079527] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:33.257903] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-15T20:03:33.764373] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T20:03:34.057879] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-15T20:03:34.857897] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-15T20:03:34.888390] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T20:03:34.946327] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T20:03:35.657892] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-15T20:03:36.158376] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T20:03:36.457874] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-15T20:03:37.257882] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-15T20:03:37.540157] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T20:03:37.570331] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T20:03:38.057890] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-15T20:03:38.414872] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T20:03:38.784520] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T20:03:38.857882] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-15T20:03:39.657871] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-15T20:03:40.301496] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:03:40.457889] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-15T20:03:40.946225] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:03:40.951850] [INFO ] [REMOTE ] PRKS: Full fetch complete (46675 records). [2025-09-15T20:03:40.951957] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-15T20:03:41.262972] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-15T20:03:41.344878] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-15T20:03:41.344962] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-15T20:03:41.345794] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-15T20:03:41.345838] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-15T20:03:41.346875] [DEBUG] [LOCAL ] PRKS: Trimmed 46675 records to 31146 (keeping 150 days of data) [2025-09-15T20:03:41.486129] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T20:03:41.570180] [DEBUG] [LOCAL ] PRKS: Primary data saved (31146 records). [2025-09-15T20:03:41.570354] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-15T20:03:41.571751] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRKS took 29.0s. Estimated remaining: 1h 7m 58s. Rate: 9.4 symbols/min [2025-09-15T20:03:41.750435] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:41.781477] [DEBUG] [LOCAL ] PRO: Loaded 28932 existing records from primary storage. [2025-09-15T20:03:41.781622] [INFO ] [MAIN ] PRO: Loaded 28932 existing records. [2025-09-15T20:03:41.964710] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:41.964996] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-15T20:03:41.965055] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-15T20:03:41.965769] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-15T20:03:41.965822] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-15T20:03:42.062953] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-15T20:03:42.342965] [INFO ] [REMOTE ] PRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:42.718583] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:03:42.857856] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-15T20:03:43.041951] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T20:03:43.657869] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-15T20:03:44.457945] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-15T20:03:44.873719] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T20:03:44.909715] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-15T20:03:45.257903] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-15T20:03:45.567607] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:03:46.057885] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-15T20:03:46.504600] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T20:03:46.857892] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-15T20:03:47.536197] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:03:47.657841] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-15T20:03:47.827568] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:03:47.829945] [INFO ] [REMOTE ] PRLB: Full fetch complete (23262 records). [2025-09-15T20:03:47.830018] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-15T20:03:48.192779] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-15T20:03:48.192863] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-15T20:03:48.193340] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-15T20:03:48.193380] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-15T20:03:48.193998] [DEBUG] [LOCAL ] PRLB: Trimmed 23262 records to 14741 (keeping 150 days of data) [2025-09-15T20:03:48.285874] [DEBUG] [LOCAL ] PRLB: Primary data saved (14741 records). [2025-09-15T20:03:48.286023] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-15T20:03:48.286110] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRLB took 20.8s. Estimated remaining: 1h 7m 52s. Rate: 9.4 symbols/min [2025-09-15T20:03:48.453291] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:48.457853] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-15T20:03:48.472694] [DEBUG] [LOCAL ] PRSU: Loaded 17935 existing records from primary storage. [2025-09-15T20:03:48.472816] [INFO ] [MAIN ] PRSU: Loaded 17935 existing records. [2025-09-15T20:03:48.651051] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:48.651320] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-15T20:03:48.651373] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-15T20:03:48.652063] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-09-15T20:03:48.652124] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-15T20:03:49.015565] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:49.264126] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-15T20:03:49.295339] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:03:49.839280] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:03:50.057904] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-15T20:03:50.326494] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T20:03:50.857889] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-15T20:03:51.395794] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T20:03:51.590268] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T20:03:51.657883] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-15T20:03:52.457904] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-15T20:03:52.765540] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T20:03:53.257877] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-15T20:03:54.057843] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-15T20:03:54.093080] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:03:54.407900] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T20:03:54.857919] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-15T20:03:55.245304] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T20:03:55.657907] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-15T20:03:55.715805] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T20:03:56.457888] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-15T20:03:57.229133] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:03:57.234836] [INFO ] [REMOTE ] PRM: Full fetch complete (48692 records). [2025-09-15T20:03:57.234954] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-15T20:03:57.266775] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-15T20:03:57.630488] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-15T20:03:57.630603] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-15T20:03:57.631496] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-15T20:03:57.631560] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-15T20:03:57.653141] [DEBUG] [LOCAL ] PRM: Trimmed 48692 records to 32641 (keeping 150 days of data) [2025-09-15T20:03:57.653034] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T20:03:57.877110] [DEBUG] [LOCAL ] PRM: Primary data saved (32641 records). [2025-09-15T20:03:57.877352] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-15T20:03:57.877485] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRM took 29.8s. Estimated remaining: 1h 7m 47s. Rate: 9.4 symbols/min [2025-09-15T20:03:58.052739] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:58.058898] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-15T20:03:58.058771] [DEBUG] [LOCAL ] PRT: Loaded 3655 existing records from primary storage. [2025-09-15T20:03:58.059289] [INFO ] [MAIN ] PRT: Loaded 3655 existing records. [2025-09-15T20:03:58.249830] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:58.250163] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-15T20:03:58.250211] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-15T20:03:58.250526] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-15T20:03:58.250576] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-15T20:03:58.636869] [INFO ] [REMOTE ] PRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:03:58.819749] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T20:03:58.825521] [INFO ] [REMOTE ] PRMB: Full fetch complete (57639 records). [2025-09-15T20:03:58.825627] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-15T20:03:58.867870] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-15T20:03:59.215668] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-15T20:03:59.215887] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-15T20:03:59.222828] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-15T20:03:59.231674] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-15T20:03:59.233475] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T20:03:59.240351] [DEBUG] [LOCAL ] PRMB: Trimmed 57639 records to 39285 (keeping 150 days of data) [2025-09-15T20:03:59.509868] [DEBUG] [LOCAL ] PRMB: Primary data saved (39285 records). [2025-09-15T20:03:59.510106] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-15T20:03:59.510224] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PRMB took 27.2s. Estimated remaining: 1h 7m 39s. Rate: 9.4 symbols/min [2025-09-15T20:03:59.663169] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-15T20:03:59.716241] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:03:59.726358] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T20:03:59.771892] [DEBUG] [LOCAL ] PRU: Loaded 38574 existing records from primary storage. [2025-09-15T20:03:59.772105] [INFO ] [MAIN ] PRU: Loaded 38574 existing records. [2025-09-15T20:03:59.965694] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:03:59.966008] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-15T20:03:59.966059] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-15T20:03:59.967293] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-15T20:03:59.967351] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-15T20:04:00.354234] [INFO ] [REMOTE ] PRU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:00.457894] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-15T20:04:01.128151] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T20:04:01.257973] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-15T20:04:01.921946] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:04:01.925098] [INFO ] [REMOTE ] PRSU: Full fetch complete (26836 records). [2025-09-15T20:04:01.925208] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-15T20:04:02.058217] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-15T20:04:02.070611] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T20:04:02.358825] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-09-15T20:04:02.358947] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-09-15T20:04:02.359917] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-09-15T20:04:02.359972] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-09-15T20:04:02.360835] [DEBUG] [LOCAL ] PRSU: Trimmed 26836 records to 17591 (keeping 150 days of data) [2025-09-15T20:04:02.478680] [DEBUG] [LOCAL ] PRSU: Primary data saved (17591 records). [2025-09-15T20:04:02.478869] [INFO ] [MAIN ] PRSU: Full history saved. [2025-09-15T20:04:02.478975] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRSU took 14.2s. Estimated remaining: 1h 7m 31s. Rate: 9.4 symbols/min [2025-09-15T20:04:02.652759] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:02.652969] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-15T20:04:02.653009] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-15T20:04:02.653146] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-15T20:04:02.653185] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-15T20:04:02.653225] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-15T20:04:02.653314] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-15T20:04:02.863195] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-15T20:04:03.013535] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:03.538143] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T20:04:03.657882] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-15T20:04:03.855871] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:04:03.979798] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-15T20:04:04.457932] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-15T20:04:05.257895] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-15T20:04:05.999529] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:04:06.057916] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-15T20:04:06.619683] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T20:04:06.647538] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T20:04:06.857879] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-15T20:04:07.657906] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-15T20:04:08.171168] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T20:04:08.342564] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T20:04:08.457900] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-15T20:04:08.784682] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-15T20:04:09.257930] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-15T20:04:10.057936] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-15T20:04:10.462371] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T20:04:10.521416] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T20:04:10.857880] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-15T20:04:11.657928] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-15T20:04:12.006848] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:04:12.011211] [INFO ] [REMOTE ] PRO: Full fetch complete (39580 records). [2025-09-15T20:04:12.011324] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-15T20:04:12.404283] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-15T20:04:12.404374] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-15T20:04:12.405139] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-15T20:04:12.405185] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-15T20:04:12.406136] [DEBUG] [LOCAL ] PRO: Trimmed 39580 records to 28610 (keeping 150 days of data) [2025-09-15T20:04:12.459232] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-15T20:04:12.578748] [DEBUG] [LOCAL ] PRO: Primary data saved (28610 records). [2025-09-15T20:04:12.578888] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-15T20:04:12.578992] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PRO took 31.0s. Estimated remaining: 1h 7m 26s. Rate: 9.4 symbols/min [2025-09-15T20:04:12.748292] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:12.781818] [DEBUG] [LOCAL ] PSA: Loaded 31590 existing records from primary storage. [2025-09-15T20:04:12.781983] [INFO ] [MAIN ] PSA: Loaded 31590 existing records. [2025-09-15T20:04:12.887731] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T20:04:12.967300] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:12.967592] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-15T20:04:12.967659] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-15T20:04:12.968480] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-15T20:04:12.968539] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-15T20:04:13.267074] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-15T20:04:13.354445] [INFO ] [REMOTE ] PSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:13.438789] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T20:04:13.924444] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T20:04:14.057910] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-15T20:04:14.857910] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-15T20:04:15.444614] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T20:04:15.657897] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-15T20:04:16.181522] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:04:16.457888] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-15T20:04:17.001048] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T20:04:17.194352] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:04:17.257917] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-15T20:04:18.057905] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-15T20:04:18.380892] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T20:04:18.805870] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:04:18.857842] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-15T20:04:19.657883] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-15T20:04:19.978345] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T20:04:19.979062] [INFO ] [REMOTE ] PRVS: Full fetch complete (875 records). [2025-09-15T20:04:19.979131] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-15T20:04:20.156905] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T20:04:20.157090] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:04:20.157152] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:04:20.157225] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-15T20:04:20.157300] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-15T20:04:20.157373] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-15T20:04:20.157447] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-15T20:04:20.157529] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PRVS took 17.7s. Estimated remaining: 1h 7m 20s. Rate: 9.4 symbols/min [2025-09-15T20:04:20.328176] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:20.335471] [DEBUG] [LOCAL ] PSBD: Loaded 5174 existing records from primary storage. [2025-09-15T20:04:20.335588] [INFO ] [MAIN ] PSBD: Loaded 5174 existing records. [2025-09-15T20:04:20.462155] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-15T20:04:20.513132] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:20.514703] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-15T20:04:20.514846] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-15T20:04:20.515333] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-15T20:04:20.515415] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-15T20:04:20.643843] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:04:20.928416] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:21.155391] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T20:04:21.257865] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-15T20:04:22.057975] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-15T20:04:22.546223] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T20:04:22.792218] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T20:04:22.857879] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-15T20:04:23.657933] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-15T20:04:24.458065] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-15T20:04:24.574086] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T20:04:24.772744] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-15T20:04:25.228284] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:04:25.257813] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-15T20:04:26.057892] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-15T20:04:26.809571] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T20:04:26.814337] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T20:04:26.814578] [INFO ] [REMOTE ] PRT: Full fetch complete (6078 records). [2025-09-15T20:04:26.822976] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-15T20:04:26.863113] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-15T20:04:27.225365] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-15T20:04:27.225534] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-15T20:04:27.225797] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-15T20:04:27.225846] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-15T20:04:27.226536] [DEBUG] [LOCAL ] PRT: Trimmed 6078 records to 3636 (keeping 150 days of data) [2025-09-15T20:04:27.250208] [DEBUG] [LOCAL ] PRT: Primary data saved (3636 records). [2025-09-15T20:04:27.250396] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-15T20:04:27.250537] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PRT took 29.4s. Estimated remaining: 1h 7m 14s. Rate: 9.4 symbols/min [2025-09-15T20:04:27.428440] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:27.436493] [DEBUG] [LOCAL ] PSF: Loaded 5000 existing records from primary storage. [2025-09-15T20:04:27.436635] [INFO ] [MAIN ] PSF: Loaded 5000 existing records. [2025-09-15T20:04:27.618167] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:27.618442] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-15T20:04:27.618490] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-15T20:04:27.618827] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-15T20:04:27.618896] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-15T20:04:27.663117] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-15T20:04:27.978795] [INFO ] [REMOTE ] PSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:28.423925] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:04:28.457813] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-15T20:04:28.944934] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T20:04:29.149012] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T20:04:29.257951] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-15T20:04:29.746959] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T20:04:30.057876] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-15T20:04:30.736026] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T20:04:30.857922] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-15T20:04:31.657896] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-15T20:04:32.183181] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T20:04:32.259524] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:04:32.264744] [INFO ] [REMOTE ] PSA: Full fetch complete (45192 records). [2025-09-15T20:04:32.264929] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-15T20:04:32.461584] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-15T20:04:32.674121] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-15T20:04:32.674263] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-15T20:04:32.675829] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-15T20:04:32.675895] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-15T20:04:32.677211] [DEBUG] [LOCAL ] PSA: Trimmed 45192 records to 30919 (keeping 150 days of data) [2025-09-15T20:04:32.927505] [DEBUG] [LOCAL ] PSA: Primary data saved (30919 records). [2025-09-15T20:04:32.927711] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-15T20:04:32.928409] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PSA took 20.3s. Estimated remaining: 1h 7m 8s. Rate: 9.4 symbols/min [2025-09-15T20:04:33.102248] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:33.132963] [DEBUG] [LOCAL ] PSFE: Loaded 22960 existing records from primary storage. [2025-09-15T20:04:33.133193] [INFO ] [MAIN ] PSFE: Loaded 22960 existing records. [2025-09-15T20:04:33.263142] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-15T20:04:33.317125] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:33.317514] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-15T20:04:33.317570] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-15T20:04:33.318336] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-15T20:04:33.318402] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-15T20:04:33.707346] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:33.854952] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T20:04:34.068156] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-15T20:04:34.091413] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T20:04:34.825307] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T20:04:34.857830] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-15T20:04:35.332688] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T20:04:35.657914] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-15T20:04:36.316273] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T20:04:36.457886] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-15T20:04:37.226051] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T20:04:37.257828] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-15T20:04:38.003344] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T20:04:38.004899] [INFO ] [REMOTE ] PSF: Full fetch complete (7185 records). [2025-09-15T20:04:38.004972] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-15T20:04:38.066245] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-15T20:04:38.362517] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-15T20:04:38.362596] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-15T20:04:38.362795] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-15T20:04:38.362838] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-15T20:04:38.363236] [DEBUG] [LOCAL ] PSF: Trimmed 7185 records to 4946 (keeping 150 days of data) [2025-09-15T20:04:38.394233] [DEBUG] [LOCAL ] PSF: Primary data saved (4946 records). [2025-09-15T20:04:38.394319] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-15T20:04:38.394409] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSF took 11.1s. Estimated remaining: 1h 7m 1s. Rate: 9.4 symbols/min [2025-09-15T20:04:38.571665] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:38.611197] [DEBUG] [LOCAL ] PSN: Loaded 34321 existing records from primary storage. [2025-09-15T20:04:38.611359] [INFO ] [MAIN ] PSN: Loaded 34321 existing records. [2025-09-15T20:04:38.815267] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:38.815575] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-15T20:04:38.815627] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-15T20:04:38.816507] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-15T20:04:38.816564] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-15T20:04:38.867720] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-15T20:04:39.194674] [INFO ] [REMOTE ] PSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:39.217023] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T20:04:39.370194] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T20:04:39.657890] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-15T20:04:40.349168] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T20:04:40.457896] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-15T20:04:41.257933] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-15T20:04:42.066415] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-15T20:04:42.072706] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:04:42.105463] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T20:04:42.857885] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-15T20:04:43.581165] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:04:43.582591] [INFO ] [REMOTE ] PSBD: Full fetch complete (7086 records). [2025-09-15T20:04:43.582709] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-15T20:04:43.662268] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-15T20:04:43.931374] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T20:04:43.966046] [INFO ] [REMOTE ] PRU: Full fetch complete (56085 records). [2025-09-15T20:04:43.966263] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-15T20:04:43.966525] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-15T20:04:43.966472] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-15T20:04:43.966851] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-15T20:04:43.966920] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-15T20:04:43.967612] [DEBUG] [LOCAL ] PSBD: Trimmed 7086 records to 5148 (keeping 150 days of data) [2025-09-15T20:04:44.170110] [DEBUG] [LOCAL ] PSBD: Primary data saved (5148 records). [2025-09-15T20:04:44.191060] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-15T20:04:44.203348] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PSBD took 24.0s. Estimated remaining: 1h 6m 54s. Rate: 9.4 symbols/min [2025-09-15T20:04:44.458919] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-15T20:04:44.598513] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-15T20:04:44.598429] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:44.598954] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-15T20:04:44.599941] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-15T20:04:44.600070] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-15T20:04:44.601404] [DEBUG] [LOCAL ] PRU: Trimmed 56085 records to 37815 (keeping 150 days of data) [2025-09-15T20:04:44.721950] [DEBUG] [LOCAL ] PSO: Loaded 27438 existing records from primary storage. [2025-09-15T20:04:44.722847] [INFO ] [MAIN ] PSO: Loaded 27438 existing records. [2025-09-15T20:04:44.922706] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:44.926553] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-15T20:04:44.926886] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-15T20:04:44.928872] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-15T20:04:44.929263] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-15T20:04:45.071602] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T20:04:45.259370] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-15T20:04:45.479260] [INFO ] [REMOTE ] PSO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:45.562036] [DEBUG] [LOCAL ] PRU: Primary data saved (37815 records). [2025-09-15T20:04:45.562229] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-15T20:04:45.562346] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PRU took 46.1s. Estimated remaining: 1h 6m 46s. Rate: 9.4 symbols/min [2025-09-15T20:04:45.729956] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:04:45.753307] [DEBUG] [LOCAL ] PSQH: Loaded 25231 existing records from primary storage. [2025-09-15T20:04:45.753442] [INFO ] [MAIN ] PSQH: Loaded 25231 existing records. [2025-09-15T20:04:45.926023] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:04:45.926347] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-15T20:04:45.926395] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-15T20:04:45.927030] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-15T20:04:45.927082] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-15T20:04:46.064689] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-15T20:04:46.285954] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:04:46.317114] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T20:04:46.434383] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T20:04:46.857837] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-15T20:04:46.956314] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T20:04:47.657880] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-15T20:04:48.047394] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:04:48.457882] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-15T20:04:49.128071] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:04:49.257866] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-15T20:04:49.749226] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:04:50.057863] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-15T20:04:50.599312] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T20:04:50.857879] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-15T20:04:51.496988] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:04:51.657866] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-15T20:04:52.154056] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:04:52.457883] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-15T20:04:53.131721] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:04:53.257879] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-15T20:04:54.057883] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-15T20:04:54.124914] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:04:54.626178] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T20:04:54.857891] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-15T20:04:55.471841] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T20:04:55.657851] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-15T20:04:56.279892] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:04:56.457871] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-15T20:04:57.241354] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T20:04:57.257847] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-15T20:04:57.884849] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T20:04:58.057891] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-15T20:04:58.772833] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:04:58.857848] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-15T20:04:59.335807] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T20:04:59.657887] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-15T20:05:00.169521] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:05:00.457883] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-15T20:05:00.717300] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:05:01.257931] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-15T20:05:01.812986] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T20:05:02.057945] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-15T20:05:02.461419] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T20:05:02.468339] [INFO ] [REMOTE ] PSFE: Full fetch complete (33907 records). [2025-09-15T20:05:02.468595] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-15T20:05:02.863107] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-15T20:05:03.016213] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-15T20:05:03.016354] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-15T20:05:03.018503] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-15T20:05:03.018622] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-15T20:05:03.020189] [DEBUG] [LOCAL ] PSFE: Trimmed 33907 records to 22615 (keeping 150 days of data) [2025-09-15T20:05:03.176510] [DEBUG] [LOCAL ] PSFE: Primary data saved (22615 records). [2025-09-15T20:05:03.176715] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-15T20:05:03.176892] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PSFE took 30.2s. Estimated remaining: 1h 6m 44s. Rate: 9.4 symbols/min [2025-09-15T20:05:03.359351] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:03.376186] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:05:03.384726] [INFO ] [REMOTE ] PSN: Full fetch complete (50819 records). [2025-09-15T20:05:03.384912] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-15T20:05:03.663016] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-15T20:05:03.672487] [DEBUG] [LOCAL ] PSTG: Loaded 39671 existing records from primary storage. [2025-09-15T20:05:03.690332] [INFO ] [MAIN ] PSTG: Loaded 39671 existing records. [2025-09-15T20:05:03.948164] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-15T20:05:03.957725] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-15T20:05:03.970499] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-15T20:05:03.973891] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-15T20:05:03.995047] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:03.996100] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-15T20:05:03.996658] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-15T20:05:03.997222] [DEBUG] [LOCAL ] PSN: Trimmed 50819 records to 33662 (keeping 150 days of data) [2025-09-15T20:05:03.997775] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-15T20:05:03.998463] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-15T20:05:04.309816] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T20:05:04.462156] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-15T20:05:04.490095] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:04.593384] [DEBUG] [LOCAL ] PSN: Primary data saved (33662 records). [2025-09-15T20:05:04.593543] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-15T20:05:04.593627] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PSN took 26.2s. Estimated remaining: 1h 6m 36s. Rate: 9.4 symbols/min [2025-09-15T20:05:04.760834] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:04.782741] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T20:05:04.800668] [DEBUG] [LOCAL ] PSTL: Loaded 15028 existing records from primary storage. [2025-09-15T20:05:04.800789] [INFO ] [MAIN ] PSTL: Loaded 15028 existing records. [2025-09-15T20:05:04.972911] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:04.973161] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-15T20:05:04.973206] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-15T20:05:04.973593] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-15T20:05:04.973639] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-15T20:05:05.263012] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-15T20:05:05.325348] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:05.692110] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T20:05:06.057897] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-15T20:05:06.857904] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-15T20:05:06.982855] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T20:05:07.174499] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T20:05:07.657932] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-15T20:05:07.816208] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T20:05:07.820770] [INFO ] [REMOTE ] PSO: Full fetch complete (40303 records). [2025-09-15T20:05:07.820879] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-15T20:05:08.197251] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-15T20:05:08.197371] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-15T20:05:08.198168] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-15T20:05:08.198216] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-15T20:05:08.199484] [DEBUG] [LOCAL ] PSO: Trimmed 40303 records to 26824 (keeping 150 days of data) [2025-09-15T20:05:08.327897] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T20:05:08.393621] [DEBUG] [LOCAL ] PSO: Primary data saved (26824 records). [2025-09-15T20:05:08.393795] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-15T20:05:08.393901] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSO took 24.2s. Estimated remaining: 1h 6m 28s. Rate: 9.4 symbols/min [2025-09-15T20:05:08.463017] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-15T20:05:08.566451] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:08.612782] [DEBUG] [LOCAL ] PSX: Loaded 40017 existing records from primary storage. [2025-09-15T20:05:08.612934] [INFO ] [MAIN ] PSX: Loaded 40017 existing records. [2025-09-15T20:05:08.795397] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:08.795706] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-15T20:05:08.795763] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-15T20:05:08.796797] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-15T20:05:08.796849] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-15T20:05:09.149724] [INFO ] [REMOTE ] PSX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:09.257856] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-15T20:05:10.057836] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-15T20:05:10.171858] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T20:05:10.583515] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:05:10.857862] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-15T20:05:11.183074] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T20:05:11.657874] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-15T20:05:12.341993] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T20:05:12.346453] [INFO ] [REMOTE ] PSQH: Full fetch complete (37912 records). [2025-09-15T20:05:12.346536] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-15T20:05:12.463057] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-15T20:05:12.721220] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-15T20:05:12.721329] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-15T20:05:12.722185] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-15T20:05:12.727357] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-15T20:05:12.736099] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T20:05:12.741428] [DEBUG] [LOCAL ] PSQH: Trimmed 37912 records to 24941 (keeping 150 days of data) [2025-09-15T20:05:12.892159] [DEBUG] [LOCAL ] PSQH: Primary data saved (24941 records). [2025-09-15T20:05:12.892296] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-15T20:05:12.892408] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PSQH took 27.3s. Estimated remaining: 1h 6m 21s. Rate: 9.4 symbols/min [2025-09-15T20:05:13.059436] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:13.071308] [DEBUG] [LOCAL ] PTA: Loaded 10651 existing records from primary storage. [2025-09-15T20:05:13.071420] [INFO ] [MAIN ] PTA: Loaded 10651 existing records. [2025-09-15T20:05:13.247191] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:13.247445] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-15T20:05:13.247491] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-15T20:05:13.247888] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-15T20:05:13.247938] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-15T20:05:13.262939] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-15T20:05:13.617246] [INFO ] [REMOTE ] PTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:14.065509] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-15T20:05:14.095337] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:05:14.857837] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-15T20:05:15.164788] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T20:05:15.188777] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T20:05:15.657873] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-15T20:05:16.421201] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T20:05:16.457815] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-15T20:05:17.257954] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-15T20:05:17.305353] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:05:17.916928] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T20:05:18.057884] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-15T20:05:18.368590] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T20:05:18.820571] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T20:05:18.857828] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-15T20:05:19.657866] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-15T20:05:19.729320] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T20:05:20.457871] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-15T20:05:21.257920] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-15T20:05:21.423152] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T20:05:21.465996] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T20:05:22.057882] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-15T20:05:22.854845] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T20:05:22.864760] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-15T20:05:22.950350] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T20:05:22.954288] [INFO ] [REMOTE ] PSTL: Full fetch complete (22557 records). [2025-09-15T20:05:22.954430] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-15T20:05:23.336825] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-15T20:05:23.336907] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-15T20:05:23.337373] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-15T20:05:23.337413] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-15T20:05:23.338506] [DEBUG] [LOCAL ] PSTL: Trimmed 22557 records to 14762 (keeping 150 days of data) [2025-09-15T20:05:23.430821] [DEBUG] [LOCAL ] PSTL: Primary data saved (14762 records). [2025-09-15T20:05:23.430973] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-15T20:05:23.431069] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PSTL took 18.8s. Estimated remaining: 1h 6m 16s. Rate: 9.4 symbols/min [2025-09-15T20:05:23.597685] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:23.629780] [DEBUG] [LOCAL ] PTY: Loaded 27619 existing records from primary storage. [2025-09-15T20:05:23.629929] [INFO ] [MAIN ] PTY: Loaded 27619 existing records. [2025-09-15T20:05:23.663082] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-15T20:05:23.805539] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:23.805801] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-15T20:05:23.805848] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-15T20:05:23.806624] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-15T20:05:23.806708] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-15T20:05:24.154493] [INFO ] [REMOTE ] PTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:24.457927] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-15T20:05:24.734085] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T20:05:24.757377] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T20:05:25.257880] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-15T20:05:26.012161] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:05:26.057882] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-15T20:05:26.120535] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T20:05:26.858478] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-15T20:05:26.862179] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T20:05:27.657886] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-15T20:05:28.234894] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T20:05:28.457887] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-15T20:05:29.233906] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:05:29.257840] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-15T20:05:29.276222] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T20:05:30.057899] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-15T20:05:30.772162] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T20:05:30.857829] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-15T20:05:30.978268] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T20:05:30.984174] [INFO ] [REMOTE ] PSX: Full fetch complete (57818 records). [2025-09-15T20:05:30.984310] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-15T20:05:31.378685] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-15T20:05:31.378782] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-15T20:05:31.379858] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-15T20:05:31.379913] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-15T20:05:31.381494] [DEBUG] [LOCAL ] PSX: Trimmed 57818 records to 39235 (keeping 150 days of data) [2025-09-15T20:05:31.643321] [DEBUG] [LOCAL ] PSX: Primary data saved (39235 records). [2025-09-15T20:05:31.643472] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-15T20:05:31.644570] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PSX took 23.3s. Estimated remaining: 1h 6m 11s. Rate: 9.4 symbols/min [2025-09-15T20:05:31.665811] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-15T20:05:31.821119] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:31.858477] [DEBUG] [LOCAL ] PUK: Loaded 32908 existing records from primary storage. [2025-09-15T20:05:31.858623] [INFO ] [MAIN ] PUK: Loaded 32908 existing records. [2025-09-15T20:05:32.035386] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:32.035660] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-15T20:05:32.035734] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-15T20:05:32.036676] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-15T20:05:32.036743] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-15T20:05:32.394937] [INFO ] [REMOTE ] PUK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:32.415425] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:05:32.457816] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-15T20:05:33.257846] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-15T20:05:33.335319] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T20:05:34.057883] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-15T20:05:34.225465] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T20:05:34.271313] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T20:05:34.857878] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-15T20:05:35.427216] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T20:05:35.657865] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-15T20:05:35.947879] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T20:05:36.457887] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-15T20:05:37.258527] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-15T20:05:37.264093] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:05:37.367300] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T20:05:37.370520] [INFO ] [REMOTE ] PTA: Full fetch complete (16021 records). [2025-09-15T20:05:37.370612] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-15T20:05:37.765933] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-15T20:05:37.766013] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-15T20:05:37.766377] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-15T20:05:37.766416] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-15T20:05:37.766963] [DEBUG] [LOCAL ] PTA: Trimmed 16021 records to 10513 (keeping 150 days of data) [2025-09-15T20:05:37.833563] [DEBUG] [LOCAL ] PTA: Primary data saved (10513 records). [2025-09-15T20:05:37.833746] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-15T20:05:37.833840] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PTA took 24.9s. Estimated remaining: 1h 6m 4s. Rate: 9.4 symbols/min [2025-09-15T20:05:38.003751] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:38.039527] [DEBUG] [LOCAL ] PUMP: Loaded 37018 existing records from primary storage. [2025-09-15T20:05:38.039738] [INFO ] [MAIN ] PUMP: Loaded 37018 existing records. [2025-09-15T20:05:38.070083] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-15T20:05:38.221842] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:38.222095] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-15T20:05:38.222142] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-15T20:05:38.222863] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-15T20:05:38.222914] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-15T20:05:38.571383] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:38.594695] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T20:05:38.857874] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-15T20:05:39.657939] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-15T20:05:39.822276] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T20:05:40.089273] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T20:05:40.457929] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-15T20:05:40.961135] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T20:05:41.257883] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-15T20:05:41.595833] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T20:05:42.057909] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-15T20:05:42.659993] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:05:42.857893] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-15T20:05:43.346276] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T20:05:43.657904] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-15T20:05:44.267929] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T20:05:44.272679] [INFO ] [REMOTE ] PTY: Full fetch complete (40448 records). [2025-09-15T20:05:44.272775] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-15T20:05:44.463115] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-15T20:05:44.681844] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-15T20:05:44.681956] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-15T20:05:44.683195] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-15T20:05:44.683248] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-15T20:05:44.684759] [DEBUG] [LOCAL ] PTY: Trimmed 40448 records to 27092 (keeping 150 days of data) [2025-09-15T20:05:44.857120] [DEBUG] [LOCAL ] PTY: Primary data saved (27092 records). [2025-09-15T20:05:44.857266] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-15T20:05:44.857355] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PTY took 21.4s. Estimated remaining: 1h 5m 58s. Rate: 9.4 symbols/min [2025-09-15T20:05:45.025789] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:45.061484] [DEBUG] [LOCAL ] PVH: Loaded 38089 existing records from primary storage. [2025-09-15T20:05:45.061635] [INFO ] [MAIN ] PVH: Loaded 38089 existing records. [2025-09-15T20:05:45.241193] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:45.241438] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-15T20:05:45.241488] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-15T20:05:45.242335] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-15T20:05:45.242389] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-15T20:05:45.263079] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-15T20:05:45.637915] [INFO ] [REMOTE ] PVH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:45.669866] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:05:46.057889] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-15T20:05:46.284050] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T20:05:46.296012] [INFO ] [REMOTE ] PSTG: Full fetch complete (57450 records). [2025-09-15T20:05:46.296313] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-15T20:05:46.696184] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-15T20:05:46.696273] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-15T20:05:46.697433] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-15T20:05:46.697491] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-15T20:05:46.698868] [DEBUG] [LOCAL ] PSTG: Trimmed 57450 records to 38902 (keeping 150 days of data) [2025-09-15T20:05:46.888324] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-15T20:05:46.952008] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T20:05:46.994803] [DEBUG] [LOCAL ] PSTG: Primary data saved (38902 records). [2025-09-15T20:05:46.994993] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-15T20:05:46.996632] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PSTG took 43.8s. Estimated remaining: 1h 5m 50s. Rate: 9.4 symbols/min [2025-09-15T20:05:47.175471] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:47.183099] [DEBUG] [LOCAL ] PVL: Loaded 3548 existing records from primary storage. [2025-09-15T20:05:47.183265] [INFO ] [MAIN ] PVL: Loaded 3548 existing records. [2025-09-15T20:05:47.374178] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:47.374726] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-15T20:05:47.374863] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-15T20:05:47.375174] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-15T20:05:47.375332] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-15T20:05:47.592971] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T20:05:47.669046] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-15T20:05:47.797922] [INFO ] [REMOTE ] PVL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:48.441173] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T20:05:48.457816] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-15T20:05:49.257874] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-15T20:05:49.302607] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T20:05:49.916217] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:05:50.057876] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-15T20:05:50.857889] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-15T20:05:51.026127] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T20:05:51.332340] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T20:05:51.657890] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-15T20:05:52.169370] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T20:05:52.457872] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-15T20:05:52.810971] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-15T20:05:53.075861] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T20:05:53.257871] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-15T20:05:54.057871] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-15T20:05:54.594158] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T20:05:54.869999] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-15T20:05:54.880560] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T20:05:55.506974] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T20:05:55.657962] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-15T20:05:56.457892] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-15T20:05:57.117122] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:05:57.122292] [INFO ] [REMOTE ] PUK: Full fetch complete (48750 records). [2025-09-15T20:05:57.122458] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-15T20:05:57.271458] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-15T20:05:57.507825] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-15T20:05:57.507969] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-15T20:05:57.508864] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-15T20:05:57.508911] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-15T20:05:57.510089] [DEBUG] [LOCAL ] PUK: Trimmed 48750 records to 32121 (keeping 150 days of data) [2025-09-15T20:05:57.728190] [DEBUG] [LOCAL ] PUK: Primary data saved (32121 records). [2025-09-15T20:05:57.728350] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-15T20:05:57.729161] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PUK took 26.1s. Estimated remaining: 1h 5m 45s. Rate: 9.4 symbols/min [2025-09-15T20:05:57.935273] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:05:57.942969] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T20:05:57.945145] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:05:57.995630] [DEBUG] [LOCAL ] PWR: Loaded 35178 existing records from primary storage. [2025-09-15T20:05:57.995849] [INFO ] [MAIN ] PWR: Loaded 35178 existing records. [2025-09-15T20:05:58.063075] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-15T20:05:58.177260] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:05:58.177551] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-15T20:05:58.177599] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-15T20:05:58.178629] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-15T20:05:58.178711] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-15T20:05:58.540182] [INFO ] [REMOTE ] PWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:05:58.857908] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-15T20:05:59.653417] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:05:59.661989] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-15T20:05:59.663877] [INFO ] [REMOTE ] PUMP: Full fetch complete (53760 records). [2025-09-15T20:05:59.664062] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-15T20:06:00.048056] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-15T20:06:00.048155] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-15T20:06:00.049047] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-15T20:06:00.049097] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-15T20:06:00.050399] [DEBUG] [LOCAL ] PUMP: Trimmed 53760 records to 36293 (keeping 150 days of data) [2025-09-15T20:06:00.264379] [DEBUG] [LOCAL ] PUMP: Primary data saved (36293 records). [2025-09-15T20:06:00.264732] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-15T20:06:00.264887] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PUMP took 22.4s. Estimated remaining: 1h 5m 38s. Rate: 9.4 symbols/min [2025-09-15T20:06:00.453680] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:00.467738] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-15T20:06:00.494440] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T20:06:00.524630] [DEBUG] [LOCAL ] PX: Loaded 26389 existing records from primary storage. [2025-09-15T20:06:00.524794] [INFO ] [MAIN ] PX: Loaded 26389 existing records. [2025-09-15T20:06:00.702477] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:00.702760] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-15T20:06:00.702833] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-15T20:06:00.703595] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-15T20:06:00.703675] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-15T20:06:01.051377] [INFO ] [REMOTE ] PX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:01.261998] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-15T20:06:01.267740] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T20:06:01.334968] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T20:06:02.057879] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-15T20:06:02.857923] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-15T20:06:03.657981] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-15T20:06:04.151605] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-15T20:06:04.457972] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-15T20:06:04.867508] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T20:06:05.257986] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-15T20:06:06.253856] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T20:06:06.299586] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-15T20:06:06.302813] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (4.24 seconds). [2025-09-15T20:06:06.322947] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:06:06.360383] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (3.50 seconds). [2025-09-15T20:06:06.857878] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-15T20:06:07.657877] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-15T20:06:08.186901] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T20:06:08.457904] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-15T20:06:08.997322] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T20:06:08.998509] [INFO ] [REMOTE ] PVL: Full fetch complete (5131 records). [2025-09-15T20:06:08.998614] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-15T20:06:09.260149] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-15T20:06:09.381711] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-15T20:06:09.414197] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-15T20:06:09.414429] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-15T20:06:09.415436] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-15T20:06:09.415925] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-15T20:06:09.416512] [DEBUG] [LOCAL ] PVL: Trimmed 5131 records to 3476 (keeping 150 days of data) [2025-09-15T20:06:09.438224] [DEBUG] [LOCAL ] PVL: Primary data saved (3476 records). [2025-09-15T20:06:09.438298] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-15T20:06:09.438404] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. PVL took 22.4s. Estimated remaining: 1h 5m 32s. Rate: 9.4 symbols/min [2025-09-15T20:06:09.617916] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:09.664496] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-15T20:06:09.715839] [DEBUG] [LOCAL ] QBTS: Loaded 40560 existing records from primary storage. [2025-09-15T20:06:09.716012] [INFO ] [MAIN ] QBTS: Loaded 40560 existing records. [2025-09-15T20:06:09.893524] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:09.893939] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-15T20:06:09.893988] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-15T20:06:09.894758] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-15T20:06:09.894810] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-15T20:06:10.071717] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-15T20:06:10.260526] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:10.728907] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:06:10.857871] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-15T20:06:11.484176] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T20:06:11.489863] [INFO ] [REMOTE ] PVH: Full fetch complete (54269 records). [2025-09-15T20:06:11.490007] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-15T20:06:11.662138] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-15T20:06:11.887726] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-15T20:06:11.887831] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-15T20:06:11.888830] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-15T20:06:11.888876] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-15T20:06:11.890112] [DEBUG] [LOCAL ] PVH: Trimmed 54269 records to 37355 (keeping 150 days of data) [2025-09-15T20:06:12.131035] [DEBUG] [LOCAL ] PVH: Primary data saved (37355 records). [2025-09-15T20:06:12.131196] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-15T20:06:12.132196] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. PVH took 27.3s. Estimated remaining: 1h 5m 25s. Rate: 9.4 symbols/min [2025-09-15T20:06:12.310966] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:12.334528] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:06:12.358211] [DEBUG] [LOCAL ] QD: Loaded 20705 existing records from primary storage. [2025-09-15T20:06:12.358362] [INFO ] [MAIN ] QD: Loaded 20705 existing records. [2025-09-15T20:06:12.463000] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-15T20:06:12.552669] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:12.552943] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-15T20:06:12.552995] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-15T20:06:12.553544] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-15T20:06:12.553596] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-15T20:06:12.904805] [INFO ] [REMOTE ] QD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:13.257933] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-15T20:06:14.057943] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-15T20:06:14.866829] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:06:14.873732] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-15T20:06:14.906368] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-15T20:06:15.428680] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-15T20:06:15.657884] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-15T20:06:15.777623] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T20:06:16.457911] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-15T20:06:16.644226] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-15T20:06:16.761526] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:06:17.257897] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-15T20:06:18.057930] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-15T20:06:18.261950] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T20:06:18.857911] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-15T20:06:18.883101] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T20:06:19.657869] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-15T20:06:19.691700] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T20:06:19.695242] [INFO ] [REMOTE ] PX: Full fetch complete (38421 records). [2025-09-15T20:06:19.695368] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-15T20:06:19.828295] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T20:06:20.114503] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-15T20:06:20.114600] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-15T20:06:20.115363] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-15T20:06:20.115407] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-15T20:06:20.116327] [DEBUG] [LOCAL ] PX: Trimmed 38421 records to 25752 (keeping 150 days of data) [2025-09-15T20:06:20.273717] [DEBUG] [LOCAL ] PX: Primary data saved (25752 records). [2025-09-15T20:06:20.273854] [INFO ] [MAIN ] PX: Full history saved. [2025-09-15T20:06:20.273940] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. PX took 20.0s. Estimated remaining: 1h 5m 19s. Rate: 9.4 symbols/min [2025-09-15T20:06:20.449956] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:20.457908] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-15T20:06:20.485997] [DEBUG] [LOCAL ] QGEN: Loaded 37071 existing records from primary storage. [2025-09-15T20:06:20.486193] [INFO ] [MAIN ] QGEN: Loaded 37071 existing records. [2025-09-15T20:06:20.664867] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:20.665180] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-15T20:06:20.665227] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-15T20:06:20.665941] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-15T20:06:20.665989] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-15T20:06:21.020408] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:21.036139] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:06:21.257913] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-15T20:06:22.036588] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T20:06:22.057844] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-15T20:06:22.667897] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T20:06:22.857863] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-15T20:06:23.220596] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T20:06:23.657884] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-15T20:06:23.864933] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T20:06:24.457917] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-15T20:06:25.062620] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:06:25.257871] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-15T20:06:26.057887] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-15T20:06:26.857878] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-15T20:06:27.072095] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T20:06:27.272663] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-15T20:06:27.519741] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:06:27.657880] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-15T20:06:27.897582] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T20:06:28.457881] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-15T20:06:29.257855] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-15T20:06:29.289482] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T20:06:29.669317] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T20:06:29.672551] [INFO ] [REMOTE ] QD: Full fetch complete (30386 records). [2025-09-15T20:06:29.672633] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-15T20:06:30.058939] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-15T20:06:30.060712] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-15T20:06:30.060875] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-15T20:06:30.062088] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-15T20:06:30.062306] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-15T20:06:30.063863] [DEBUG] [LOCAL ] QD: Trimmed 30386 records to 20314 (keeping 150 days of data) [2025-09-15T20:06:30.202803] [DEBUG] [LOCAL ] QD: Primary data saved (20314 records). [2025-09-15T20:06:30.203066] [INFO ] [MAIN ] QD: Full history saved. [2025-09-15T20:06:30.203230] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. QD took 18.1s. Estimated remaining: 1h 5m 14s. Rate: 9.4 symbols/min [2025-09-15T20:06:30.386621] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:30.429784] [DEBUG] [LOCAL ] QS: Loaded 40500 existing records from primary storage. [2025-09-15T20:06:30.430006] [INFO ] [MAIN ] QS: Loaded 40500 existing records. [2025-09-15T20:06:30.608837] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:30.609162] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-15T20:06:30.609246] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-15T20:06:30.610213] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-15T20:06:30.610269] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-15T20:06:30.863120] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-15T20:06:30.986880] [INFO ] [REMOTE ] QS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:31.017547] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T20:06:31.508530] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T20:06:31.657886] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-15T20:06:32.457907] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-15T20:06:33.238003] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-15T20:06:33.257831] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-15T20:06:33.383593] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T20:06:34.057894] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-15T20:06:34.256194] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:06:34.857902] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-15T20:06:35.658749] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-15T20:06:35.663479] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T20:06:35.669177] [INFO ] [REMOTE ] PWR: Full fetch complete (52177 records). [2025-09-15T20:06:35.669322] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-15T20:06:36.149333] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-15T20:06:36.149525] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-15T20:06:36.151076] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-15T20:06:36.151246] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-15T20:06:36.153558] [DEBUG] [LOCAL ] PWR: Trimmed 52177 records to 34461 (keeping 150 days of data) [2025-09-15T20:06:36.322232] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-15T20:06:36.382653] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:06:36.457906] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-15T20:06:36.517535] [DEBUG] [LOCAL ] PWR: Primary data saved (34461 records). [2025-09-15T20:06:36.517736] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-15T20:06:36.518669] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. PWR took 38.8s. Estimated remaining: 1h 5m 7s. Rate: 9.4 symbols/min [2025-09-15T20:06:36.692199] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:36.733320] [DEBUG] [LOCAL ] QSR: Loaded 39436 existing records from primary storage. [2025-09-15T20:06:36.733484] [INFO ] [MAIN ] QSR: Loaded 39436 existing records. [2025-09-15T20:06:36.917563] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:36.918025] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-15T20:06:36.918107] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-15T20:06:36.919479] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-15T20:06:36.919551] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-15T20:06:37.269126] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-15T20:06:37.310865] [INFO ] [REMOTE ] QSR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:38.012471] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-15T20:06:38.087838] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-15T20:06:38.102836] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T20:06:38.109297] [INFO ] [REMOTE ] QGEN: Full fetch complete (53377 records). [2025-09-15T20:06:38.109517] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-15T20:06:38.519886] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-15T20:06:38.519984] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-15T20:06:38.520862] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-15T20:06:38.520906] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-15T20:06:38.522313] [DEBUG] [LOCAL ] QGEN: Trimmed 53377 records to 36330 (keeping 150 days of data) [2025-09-15T20:06:38.751610] [DEBUG] [LOCAL ] QGEN: Primary data saved (36330 records). [2025-09-15T20:06:38.751782] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-15T20:06:38.751921] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QGEN took 18.5s. Estimated remaining: 1h 4m 60s. Rate: 9.4 symbols/min [2025-09-15T20:06:38.857890] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-15T20:06:39.894340] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-15T20:06:39.907895] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-15T20:06:40.090121] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T20:06:40.457907] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-15T20:06:40.533153] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T20:06:41.257911] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-15T20:06:42.281901] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T20:06:42.293509] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-15T20:06:42.366601] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-15T20:06:42.374072] [INFO ] [REMOTE ] QBTS: Full fetch complete (58423 records). [2025-09-15T20:06:42.374443] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-15T20:06:42.782720] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-15T20:06:42.782854] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-15T20:06:42.784678] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-15T20:06:42.784771] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-15T20:06:42.786749] [DEBUG] [LOCAL ] QBTS: Trimmed 58423 records to 39780 (keeping 150 days of data) [2025-09-15T20:06:43.103112] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T20:06:43.119251] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-15T20:06:43.154071] [DEBUG] [LOCAL ] QBTS: Primary data saved (39780 records). [2025-09-15T20:06:43.154348] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-15T20:06:43.155010] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QBTS took 33.7s. Estimated remaining: 1h 4m 53s. Rate: 9.4 symbols/min [2025-09-15T20:06:45.137780] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-15T20:06:45.153635] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-15T20:06:46.111269] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-15T20:06:46.122988] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-15T20:06:47.710286] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:06:47.722700] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-15T20:06:47.831704] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-15T20:06:47.844432] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-15T20:06:49.195949] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:06:49.206977] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-15T20:06:49.793663] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T20:06:49.805203] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-15T20:06:50.569728] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T20:06:50.581787] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-15T20:06:51.860846] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T20:06:51.866699] [INFO ] [REMOTE ] QS: Full fetch complete (58422 records). [2025-09-15T20:06:51.866810] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-15T20:06:52.275742] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-15T20:06:52.276023] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-15T20:06:52.277257] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-15T20:06:52.277326] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-15T20:06:52.314557] [DEBUG] [LOCAL ] QS: Trimmed 58422 records to 39729 (keeping 150 days of data) [2025-09-15T20:06:52.318706] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T20:06:52.415343] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-15T20:06:52.572059] [DEBUG] [LOCAL ] QS: Primary data saved (39729 records). [2025-09-15T20:06:52.572232] [INFO ] [MAIN ] QS: Full history saved. [2025-09-15T20:06:52.573000] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QS took 22.4s. Estimated remaining: 1h 4m 47s. Rate: 9.4 symbols/min [2025-09-15T20:06:53.942452] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:06:53.948622] [INFO ] [REMOTE ] QSR: Full fetch complete (57048 records). [2025-09-15T20:06:53.948833] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-15T20:06:54.350231] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-15T20:06:54.350396] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-15T20:06:54.351883] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-15T20:06:54.351964] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-15T20:06:54.353819] [DEBUG] [LOCAL ] QSR: Trimmed 57048 records to 38692 (keeping 150 days of data) [2025-09-15T20:06:54.618157] [DEBUG] [LOCAL ] QSR: Primary data saved (38692 records). [2025-09-15T20:06:54.618389] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-15T20:06:54.619150] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QSR took 18.1s. Estimated remaining: 1h 4m 39s. Rate: 9.4 symbols/min [2025-09-15T20:06:55.366797] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:55.376416] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:55.373057] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:55.397171] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:06:55.406918] [DEBUG] [LOCAL ] QVCD: Loaded 3433 existing records from primary storage. [2025-09-15T20:06:55.407187] [INFO ] [MAIN ] QVCD: Loaded 3433 existing records. [2025-09-15T20:06:55.541485] [DEBUG] [LOCAL ] QVCC: Loaded 6548 existing records from primary storage. [2025-09-15T20:06:55.556718] [DEBUG] [LOCAL ] QTWO: Loaded 28213 existing records from primary storage. [2025-09-15T20:06:55.556024] [INFO ] [MAIN ] QVCC: Loaded 6548 existing records. [2025-09-15T20:06:55.556150] [DEBUG] [LOCAL ] QUAD: Loaded 18029 existing records from primary storage. [2025-09-15T20:06:55.567517] [INFO ] [MAIN ] QTWO: Loaded 28213 existing records. [2025-09-15T20:06:55.567705] [INFO ] [MAIN ] QUAD: Loaded 18029 existing records. [2025-09-15T20:06:55.755006] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:56.007896] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-15T20:06:56.058037] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-15T20:06:56.084831] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-15T20:06:56.115808] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-15T20:06:56.250257] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:56.340529] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-15T20:06:56.382965] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-15T20:06:56.398120] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-15T20:06:56.398452] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-15T20:06:56.398346] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:56.446303] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:06:56.508842] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-15T20:06:56.514891] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-15T20:06:56.535800] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-15T20:06:56.546099] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-15T20:06:56.546204] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-15T20:06:56.546258] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-15T20:06:56.627717] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-15T20:06:56.681371] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-15T20:06:57.288705] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:57.347981] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-15T20:06:57.449022] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:57.517015] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-15T20:06:57.713496] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:57.732198] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-15T20:06:57.768215] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:06:57.768526] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-15T20:06:57.964145] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T20:06:57.965430] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-15T20:06:58.098523] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T20:06:58.099898] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-15T20:06:58.686354] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T20:06:58.688147] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-15T20:06:59.599113] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:06:59.602094] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-15T20:06:59.714456] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T20:06:59.719795] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-15T20:06:59.867860] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-15T20:06:59.876017] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-15T20:07:00.702213] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:07:00.703964] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-15T20:07:00.972687] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:07:00.975112] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-15T20:07:01.389293] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T20:07:01.391829] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-15T20:07:01.437735] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T20:07:01.443419] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-15T20:07:01.735062] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T20:07:01.744099] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-15T20:07:01.825093] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T20:07:01.912627] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T20:07:02.057954] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-15T20:07:02.592111] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T20:07:02.718908] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T20:07:02.857920] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-15T20:07:03.093777] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:07:03.287058] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T20:07:03.657897] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-15T20:07:04.183179] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T20:07:04.457879] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-15T20:07:05.171693] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T20:07:05.257907] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-15T20:07:06.057907] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-15T20:07:06.234231] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T20:07:06.678975] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T20:07:06.681350] [INFO ] [REMOTE ] QVCC: Full fetch complete (9358 records). [2025-09-15T20:07:06.681481] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-15T20:07:06.863099] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-15T20:07:07.182415] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-15T20:07:07.182511] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-15T20:07:07.182841] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-15T20:07:07.182898] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-15T20:07:07.183578] [DEBUG] [LOCAL ] QVCC: Trimmed 9358 records to 6457 (keeping 150 days of data) [2025-09-15T20:07:07.247048] [DEBUG] [LOCAL ] QVCC: Primary data saved (6457 records). [2025-09-15T20:07:07.247269] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-15T20:07:07.247439] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. QVCC took 12.6s. Estimated remaining: 1h 4m 35s. Rate: 9.4 symbols/min [2025-09-15T20:07:07.493951] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:07.557509] [DEBUG] [LOCAL ] QXO: Loaded 40263 existing records from primary storage. [2025-09-15T20:07:07.557745] [INFO ] [MAIN ] QXO: Loaded 40263 existing records. [2025-09-15T20:07:07.667599] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-15T20:07:07.824919] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:07.825267] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-15T20:07:07.825422] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-15T20:07:07.831803] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-15T20:07:07.844757] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-15T20:07:07.917296] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T20:07:08.256512] [INFO ] [REMOTE ] QXO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:08.262130] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T20:07:08.457895] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-15T20:07:09.257934] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-15T20:07:09.832102] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T20:07:09.946780] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T20:07:10.057879] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-15T20:07:10.857847] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-15T20:07:11.064854] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T20:07:11.657930] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-15T20:07:12.415489] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:07:12.457904] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-15T20:07:12.985304] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T20:07:12.986323] [INFO ] [REMOTE ] QVCD: Full fetch complete (4843 records). [2025-09-15T20:07:12.986391] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-15T20:07:13.263012] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-15T20:07:13.358727] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-15T20:07:13.358821] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-15T20:07:13.359004] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-15T20:07:13.359056] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-15T20:07:13.369814] [DEBUG] [LOCAL ] QVCD: Trimmed 4843 records to 3362 (keeping 150 days of data) [2025-09-15T20:07:13.399287] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T20:07:13.422621] [DEBUG] [LOCAL ] QVCD: Primary data saved (3362 records). [2025-09-15T20:07:13.422774] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-15T20:07:13.422871] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. QVCD took 18.8s. Estimated remaining: 1h 4m 29s. Rate: 9.4 symbols/min [2025-09-15T20:07:13.592266] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:13.616327] [DEBUG] [LOCAL ] R: Loaded 20906 existing records from primary storage. [2025-09-15T20:07:13.616488] [INFO ] [MAIN ] R: Loaded 20906 existing records. [2025-09-15T20:07:13.789491] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:13.789752] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-15T20:07:13.789799] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-15T20:07:13.790543] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-15T20:07:13.790592] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-15T20:07:14.064418] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-15T20:07:14.146063] [INFO ] [REMOTE ] R: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:14.660180] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T20:07:14.831403] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:07:14.834045] [INFO ] [REMOTE ] QUAD: Full fetch complete (26817 records). [2025-09-15T20:07:14.834177] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-15T20:07:14.865179] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-15T20:07:15.205535] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-15T20:07:15.205616] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-15T20:07:15.206193] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-15T20:07:15.206236] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-15T20:07:15.206977] [DEBUG] [LOCAL ] QUAD: Trimmed 26817 records to 17585 (keeping 150 days of data) [2025-09-15T20:07:15.314034] [DEBUG] [LOCAL ] QUAD: Primary data saved (17585 records). [2025-09-15T20:07:15.314192] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-15T20:07:15.314305] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. QUAD took 20.7s. Estimated remaining: 1h 4m 21s. Rate: 9.4 symbols/min [2025-09-15T20:07:15.485785] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:15.502102] [DEBUG] [LOCAL ] RA: Loaded 15948 existing records from primary storage. [2025-09-15T20:07:15.502218] [INFO ] [MAIN ] RA: Loaded 15948 existing records. [2025-09-15T20:07:15.659372] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-15T20:07:15.680009] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:15.680173] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-15T20:07:15.680216] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-15T20:07:15.680622] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-15T20:07:15.680694] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-15T20:07:16.035444] [INFO ] [REMOTE ] RA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:16.079634] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T20:07:16.457875] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-15T20:07:17.142119] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T20:07:17.257855] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-15T20:07:17.499814] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:07:18.057922] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-15T20:07:18.857954] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-15T20:07:18.953331] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:07:19.072508] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T20:07:19.657837] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-15T20:07:19.700890] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T20:07:20.457861] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-15T20:07:20.943207] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:07:21.257879] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-15T20:07:22.038256] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T20:07:22.057839] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-15T20:07:22.337883] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T20:07:22.857887] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-15T20:07:23.645494] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T20:07:23.659525] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-15T20:07:23.680933] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T20:07:24.457873] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-15T20:07:25.150671] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:07:25.257886] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-15T20:07:25.606028] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:07:25.610992] [INFO ] [REMOTE ] QTWO: Full fetch complete (42721 records). [2025-09-15T20:07:25.611080] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-15T20:07:26.009942] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-15T20:07:26.010025] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-15T20:07:26.010818] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-15T20:07:26.010860] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-15T20:07:26.011766] [DEBUG] [LOCAL ] QTWO: Trimmed 42721 records to 27793 (keeping 150 days of data) [2025-09-15T20:07:26.065360] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-15T20:07:26.181005] [DEBUG] [LOCAL ] QTWO: Primary data saved (27793 records). [2025-09-15T20:07:26.181148] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-15T20:07:26.181236] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. QTWO took 31.6s. Estimated remaining: 1h 4m 16s. Rate: 9.4 symbols/min [2025-09-15T20:07:26.350415] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:26.369272] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:07:26.394683] [DEBUG] [LOCAL ] RACE: Loaded 23019 existing records from primary storage. [2025-09-15T20:07:26.394864] [INFO ] [MAIN ] RACE: Loaded 23019 existing records. [2025-09-15T20:07:26.581272] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:26.581531] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-15T20:07:26.581593] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-15T20:07:26.582167] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-15T20:07:26.582222] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-15T20:07:26.863944] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-15T20:07:26.953406] [INFO ] [REMOTE ] RACE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:27.105878] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T20:07:27.657911] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-15T20:07:28.457920] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-15T20:07:28.872564] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T20:07:28.967415] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T20:07:29.257911] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-15T20:07:29.328449] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T20:07:30.057845] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-15T20:07:30.159348] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:07:30.857882] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-15T20:07:31.639144] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T20:07:31.657824] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-15T20:07:32.314163] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:07:32.457882] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-15T20:07:32.982288] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T20:07:33.257890] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-15T20:07:33.656925] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T20:07:34.057886] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-15T20:07:34.862944] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-15T20:07:34.875012] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:07:35.430222] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:07:35.436772] [INFO ] [REMOTE ] QXO: Full fetch complete (57464 records). [2025-09-15T20:07:35.437005] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-15T20:07:35.667968] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-15T20:07:35.834993] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-15T20:07:35.835103] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-15T20:07:35.836119] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-15T20:07:35.836223] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-15T20:07:35.842938] [DEBUG] [LOCAL ] QXO: Trimmed 57464 records to 39513 (keeping 150 days of data) [2025-09-15T20:07:35.854315] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:07:36.103513] [DEBUG] [LOCAL ] QXO: Primary data saved (39513 records). [2025-09-15T20:07:36.103705] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-15T20:07:36.104440] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. QXO took 28.9s. Estimated remaining: 1h 4m 11s. Rate: 9.4 symbols/min [2025-09-15T20:07:36.279792] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:36.307705] [DEBUG] [LOCAL ] RAMP: Loaded 27463 existing records from primary storage. [2025-09-15T20:07:36.307847] [INFO ] [MAIN ] RAMP: Loaded 27463 existing records. [2025-09-15T20:07:36.464278] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-15T20:07:36.485932] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:36.487268] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-15T20:07:36.487322] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-15T20:07:36.488058] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-15T20:07:36.488118] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-15T20:07:36.830549] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T20:07:36.849342] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:36.852042] [INFO ] [REMOTE ] RA: Full fetch complete (23865 records). [2025-09-15T20:07:36.852117] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-15T20:07:37.221378] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-15T20:07:37.221497] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-15T20:07:37.222090] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-15T20:07:37.222531] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-15T20:07:37.223260] [DEBUG] [LOCAL ] RA: Trimmed 23865 records to 15704 (keeping 150 days of data) [2025-09-15T20:07:37.266092] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-15T20:07:37.326729] [DEBUG] [LOCAL ] RA: Primary data saved (15704 records). [2025-09-15T20:07:37.326896] [INFO ] [MAIN ] RA: Full history saved. [2025-09-15T20:07:37.326984] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. RA took 22.0s. Estimated remaining: 1h 4m 3s. Rate: 9.4 symbols/min [2025-09-15T20:07:37.506720] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:37.543822] [DEBUG] [LOCAL ] RBA: Loaded 34408 existing records from primary storage. [2025-09-15T20:07:37.543993] [INFO ] [MAIN ] RBA: Loaded 34408 existing records. [2025-09-15T20:07:37.726148] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:37.733583] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:07:37.733326] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-15T20:07:37.733772] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-15T20:07:37.736821] [INFO ] [REMOTE ] R: Full fetch complete (32638 records). [2025-09-15T20:07:37.736892] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-15T20:07:37.768232] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-15T20:07:37.805051] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-15T20:07:38.079880] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-15T20:07:38.437776] [INFO ] [REMOTE ] RBA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:38.465384] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-15T20:07:38.465443] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-15T20:07:38.466089] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-15T20:07:38.466132] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-15T20:07:38.467138] [DEBUG] [LOCAL ] R: Trimmed 32638 records to 20178 (keeping 150 days of data) [2025-09-15T20:07:38.614243] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T20:07:38.627704] [DEBUG] [LOCAL ] R: Primary data saved (20178 records). [2025-09-15T20:07:38.627816] [INFO ] [MAIN ] R: Full history saved. [2025-09-15T20:07:38.627897] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. R took 25.2s. Estimated remaining: 1h 3m 55s. Rate: 9.4 symbols/min [2025-09-15T20:07:38.800939] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:38.813629] [DEBUG] [LOCAL ] RBC: Loaded 11038 existing records from primary storage. [2025-09-15T20:07:38.813783] [INFO ] [MAIN ] RBC: Loaded 11038 existing records. [2025-09-15T20:07:38.862957] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-15T20:07:38.999269] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:39.000164] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-15T20:07:39.000217] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-15T20:07:39.000836] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-15T20:07:39.000887] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-15T20:07:39.350129] [INFO ] [REMOTE ] RBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:39.575511] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T20:07:39.657879] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-15T20:07:40.295518] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T20:07:40.457884] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-15T20:07:40.618522] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T20:07:41.257865] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-15T20:07:42.065229] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-15T20:07:42.071130] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:07:42.114493] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T20:07:42.857892] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-15T20:07:43.215570] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T20:07:43.657871] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-15T20:07:44.102231] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T20:07:44.457880] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-15T20:07:45.154883] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:07:45.257865] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-15T20:07:45.901551] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:07:46.057863] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-15T20:07:46.363523] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T20:07:46.857880] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-15T20:07:47.564997] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:07:47.657870] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-15T20:07:48.324308] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:07:48.374314] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T20:07:48.457879] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-15T20:07:49.257892] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-15T20:07:49.864155] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T20:07:49.922597] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T20:07:50.057854] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-15T20:07:50.857872] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-15T20:07:51.402747] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:07:51.406808] [INFO ] [REMOTE ] RACE: Full fetch complete (36329 records). [2025-09-15T20:07:51.406907] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-15T20:07:51.663012] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-15T20:07:51.750550] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T20:07:51.823199] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-15T20:07:51.823317] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-15T20:07:51.824335] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-15T20:07:51.824398] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-15T20:07:51.825603] [DEBUG] [LOCAL ] RACE: Trimmed 36329 records to 22545 (keeping 150 days of data) [2025-09-15T20:07:51.972545] [DEBUG] [LOCAL ] RACE: Primary data saved (22545 records). [2025-09-15T20:07:51.972704] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-15T20:07:51.972817] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RACE took 25.8s. Estimated remaining: 1h 3m 51s. Rate: 9.4 symbols/min [2025-09-15T20:07:52.156068] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:52.194744] [DEBUG] [LOCAL ] RBLX: Loaded 40472 existing records from primary storage. [2025-09-15T20:07:52.194911] [INFO ] [MAIN ] RBLX: Loaded 40472 existing records. [2025-09-15T20:07:52.369395] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:52.369629] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-15T20:07:52.369694] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-15T20:07:52.370552] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-15T20:07:52.370602] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-15T20:07:52.466260] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-15T20:07:52.723772] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:53.084573] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:07:53.102077] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:07:53.257844] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-15T20:07:54.057883] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-15T20:07:54.213397] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T20:07:54.857887] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-15T20:07:55.377146] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:07:55.657932] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-15T20:07:55.850504] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T20:07:56.457892] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-15T20:07:57.257933] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-15T20:07:57.533629] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T20:07:58.002836] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-15T20:07:58.022425] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T20:07:58.025818] [INFO ] [REMOTE ] RBC: Full fetch complete (16036 records). [2025-09-15T20:07:58.025954] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-15T20:07:58.063764] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-15T20:07:58.449698] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-15T20:07:58.449844] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-15T20:07:58.450353] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-15T20:07:58.450401] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-15T20:07:58.451522] [DEBUG] [LOCAL ] RBC: Trimmed 16036 records to 10796 (keeping 150 days of data) [2025-09-15T20:07:58.526311] [DEBUG] [LOCAL ] RBC: Primary data saved (10796 records). [2025-09-15T20:07:58.526520] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-15T20:07:58.526657] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RBC took 19.9s. Estimated remaining: 1h 3m 44s. Rate: 9.4 symbols/min [2025-09-15T20:07:58.701893] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:07:58.708332] [DEBUG] [LOCAL ] RBOT: Loaded 3824 existing records from primary storage. [2025-09-15T20:07:58.708448] [INFO ] [MAIN ] RBOT: Loaded 3824 existing records. [2025-09-15T20:07:58.863165] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-15T20:07:58.905537] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:07:58.905920] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-15T20:07:58.905974] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-15T20:07:58.906359] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-15T20:07:58.906412] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-15T20:07:59.276376] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:07:59.504510] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:07:59.657942] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-15T20:08:00.079081] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T20:08:00.457959] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-15T20:08:00.602546] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T20:08:01.064542] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T20:08:01.257958] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-15T20:08:02.057918] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-15T20:08:02.726089] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T20:08:02.857953] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-15T20:08:03.657912] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-15T20:08:03.929085] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T20:08:04.011621] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:08:04.017128] [INFO ] [REMOTE ] RBA: Full fetch complete (50236 records). [2025-09-15T20:08:04.017255] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-15T20:08:04.147782] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T20:08:04.439716] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-15T20:08:04.439829] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-15T20:08:04.441194] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-15T20:08:04.441254] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-15T20:08:04.442809] [DEBUG] [LOCAL ] RBA: Trimmed 50236 records to 33785 (keeping 150 days of data) [2025-09-15T20:08:04.502773] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-15T20:08:04.674632] [DEBUG] [LOCAL ] RBA: Primary data saved (33785 records). [2025-09-15T20:08:04.674841] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-15T20:08:04.676460] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RBA took 27.3s. Estimated remaining: 1h 3m 38s. Rate: 9.4 symbols/min [2025-09-15T20:08:04.851265] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:04.892076] [DEBUG] [LOCAL ] RBRK: Loaded 39987 existing records from primary storage. [2025-09-15T20:08:04.892259] [INFO ] [MAIN ] RBRK: Loaded 39987 existing records. [2025-09-15T20:08:05.068788] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:05.072043] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-15T20:08:05.071977] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T20:08:05.073226] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-15T20:08:05.074246] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-15T20:08:05.074302] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-15T20:08:05.261545] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-15T20:08:05.455343] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:06.057909] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-15T20:08:06.857944] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-15T20:08:07.245285] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-15T20:08:07.393309] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:08:07.397513] [INFO ] [REMOTE ] RAMP: Full fetch complete (40932 records). [2025-09-15T20:08:07.397626] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-15T20:08:07.663113] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-15T20:08:07.778595] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-15T20:08:07.778708] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-15T20:08:07.779558] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-15T20:08:07.779603] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-15T20:08:07.780813] [DEBUG] [LOCAL ] RAMP: Trimmed 40932 records to 26853 (keeping 150 days of data) [2025-09-15T20:08:07.948185] [DEBUG] [LOCAL ] RAMP: Primary data saved (26853 records). [2025-09-15T20:08:07.948344] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-15T20:08:07.948456] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RAMP took 31.8s. Estimated remaining: 1h 3m 30s. Rate: 9.4 symbols/min [2025-09-15T20:08:08.117315] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:08.159815] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T20:08:08.162092] [DEBUG] [LOCAL ] RC: Loaded 36469 existing records from primary storage. [2025-09-15T20:08:08.162528] [INFO ] [MAIN ] RC: Loaded 36469 existing records. [2025-09-15T20:08:08.335783] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:08.336137] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-15T20:08:08.336202] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-15T20:08:08.337344] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-15T20:08:08.337406] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-15T20:08:08.460729] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-15T20:08:08.712426] [INFO ] [REMOTE ] RC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:08.737683] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T20:08:09.098304] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:08:09.257925] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-15T20:08:10.057989] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-15T20:08:10.741986] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:08:10.857985] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-15T20:08:11.657925] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-15T20:08:12.009335] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T20:08:12.393499] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:08:12.411477] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T20:08:12.457836] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-15T20:08:13.090242] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T20:08:13.092051] [INFO ] [REMOTE ] RBOT: Full fetch complete (5791 records). [2025-09-15T20:08:13.092143] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-15T20:08:13.261587] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-15T20:08:13.473442] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-15T20:08:13.473526] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-15T20:08:13.473706] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-15T20:08:13.473749] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-15T20:08:13.474142] [DEBUG] [LOCAL ] RBOT: Trimmed 5791 records to 3792 (keeping 150 days of data) [2025-09-15T20:08:13.496473] [DEBUG] [LOCAL ] RBOT: Primary data saved (3792 records). [2025-09-15T20:08:13.496571] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-15T20:08:13.496675] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RBOT took 15.0s. Estimated remaining: 1h 3m 24s. Rate: 9.4 symbols/min [2025-09-15T20:08:13.663682] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:13.663904] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-15T20:08:13.663944] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-15T20:08:13.664085] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-15T20:08:13.664124] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-15T20:08:13.664164] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-15T20:08:13.664219] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-15T20:08:14.014337] [INFO ] [REMOTE ] RCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:14.057863] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-15T20:08:14.694354] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T20:08:14.857927] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-15T20:08:15.433673] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T20:08:15.657923] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-15T20:08:15.785057] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-15T20:08:16.190614] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T20:08:16.457903] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-15T20:08:17.257899] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-15T20:08:18.057900] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-15T20:08:18.197064] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T20:08:18.485098] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T20:08:18.857902] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-15T20:08:19.665708] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-15T20:08:19.672165] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-15T20:08:20.097070] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T20:08:20.260457] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T20:08:20.457864] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-15T20:08:21.257897] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-15T20:08:22.057851] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-15T20:08:22.103004] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:08:22.322682] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-15T20:08:22.869287] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-15T20:08:22.875062] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:08:23.657886] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-15T20:08:23.996771] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T20:08:24.457867] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-15T20:08:24.462951] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:08:25.257888] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-15T20:08:26.066578] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-15T20:08:26.088779] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T20:08:26.551266] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T20:08:26.857890] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-15T20:08:27.657901] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-15T20:08:28.065608] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T20:08:28.066414] [INFO ] [REMOTE ] RCB: Full fetch complete (3016 records). [2025-09-15T20:08:28.066526] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-15T20:08:28.264443] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T20:08:28.264694] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:08:28.264754] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:08:28.264796] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-15T20:08:28.264854] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-15T20:08:28.264903] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-15T20:08:28.264957] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-15T20:08:28.265027] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RCB took 14.8s. Estimated remaining: 1h 3m 20s. Rate: 9.4 symbols/min [2025-09-15T20:08:28.444931] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:28.461268] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-15T20:08:28.464392] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-15T20:08:28.472871] [INFO ] [REMOTE ] RBLX: Full fetch complete (58403 records). [2025-09-15T20:08:28.472950] [DEBUG] [LOCAL ] RCD: Loaded 2632 existing records from primary storage. [2025-09-15T20:08:28.473101] [INFO ] [MAIN ] RCD: Loaded 2632 existing records. [2025-09-15T20:08:28.473146] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-15T20:08:28.828630] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:28.860952] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-15T20:08:28.930350] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-15T20:08:28.963020] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-09-15T20:08:28.973470] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-15T20:08:29.123417] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-15T20:08:29.130160] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-15T20:08:29.131205] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-15T20:08:29.131292] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-15T20:08:29.248584] [DEBUG] [LOCAL ] RBLX: Trimmed 58403 records to 39693 (keeping 150 days of data) [2025-09-15T20:08:29.520960] [INFO ] [REMOTE ] RCD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:29.522242] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-15T20:08:29.561934] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-15T20:08:29.716733] [DEBUG] [LOCAL ] RBLX: Primary data saved (39693 records). [2025-09-15T20:08:29.716891] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-15T20:08:29.716999] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RBLX took 37.7s. Estimated remaining: 1h 3m 12s. Rate: 9.4 symbols/min [2025-09-15T20:08:29.892565] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:29.892827] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-09-15T20:08:29.892885] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-09-15T20:08:29.893254] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-15T20:08:29.893305] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-15T20:08:29.893354] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-09-15T20:08:29.893453] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-15T20:08:29.998735] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T20:08:30.058008] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-15T20:08:30.219956] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T20:08:30.319378] [INFO ] [REMOTE ] RCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:30.857938] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-15T20:08:31.657883] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-15T20:08:31.869751] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T20:08:32.414855] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T20:08:32.420371] [INFO ] [REMOTE ] RC: Full fetch complete (53392 records). [2025-09-15T20:08:32.420479] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-15T20:08:32.465763] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-15T20:08:32.816192] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-15T20:08:32.816337] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-15T20:08:32.817263] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-15T20:08:32.817450] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-15T20:08:32.819083] [DEBUG] [LOCAL ] RC: Trimmed 53392 records to 35705 (keeping 150 days of data) [2025-09-15T20:08:32.942537] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T20:08:33.075812] [DEBUG] [LOCAL ] RC: Primary data saved (35705 records). [2025-09-15T20:08:33.075990] [INFO ] [MAIN ] RC: Full history saved. [2025-09-15T20:08:33.077069] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RC took 25.1s. Estimated remaining: 1h 3m 5s. Rate: 9.4 symbols/min [2025-09-15T20:08:33.248918] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:33.257850] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-15T20:08:33.294919] [DEBUG] [LOCAL ] RCL: Loaded 39084 existing records from primary storage. [2025-09-15T20:08:33.295075] [INFO ] [MAIN ] RCL: Loaded 39084 existing records. [2025-09-15T20:08:33.472512] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:33.472804] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-15T20:08:33.472850] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-15T20:08:33.473901] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-15T20:08:33.473964] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-15T20:08:33.832514] [INFO ] [REMOTE ] RCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:34.057849] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-15T20:08:34.326045] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T20:08:34.579295] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T20:08:34.745392] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T20:08:34.857860] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-15T20:08:35.402964] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T20:08:35.657929] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-15T20:08:36.457887] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-15T20:08:37.257865] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-15T20:08:37.426117] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T20:08:37.432124] [INFO ] [REMOTE ] RBRK: Full fetch complete (57558 records). [2025-09-15T20:08:37.432252] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-15T20:08:37.822188] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T20:08:37.822536] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-15T20:08:37.824151] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-15T20:08:37.825508] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-15T20:08:37.825561] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-15T20:08:37.827074] [DEBUG] [LOCAL ] RBRK: Trimmed 57558 records to 39250 (keeping 150 days of data) [2025-09-15T20:08:38.057904] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-15T20:08:38.086395] [DEBUG] [LOCAL ] RBRK: Primary data saved (39250 records). [2025-09-15T20:08:38.086563] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-15T20:08:38.087214] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RBRK took 33.4s. Estimated remaining: 1h 2m 58s. Rate: 9.4 symbols/min [2025-09-15T20:08:38.299015] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:38.310570] [DEBUG] [LOCAL ] RCS: Loaded 8525 existing records from primary storage. [2025-09-15T20:08:38.310730] [INFO ] [MAIN ] RCS: Loaded 8525 existing records. [2025-09-15T20:08:38.422764] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-15T20:08:38.503068] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:38.503910] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-15T20:08:38.504101] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-15T20:08:38.504587] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-15T20:08:38.504745] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-15T20:08:38.841010] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-15T20:08:38.859463] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-15T20:08:38.911023] [INFO ] [REMOTE ] RCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:39.657879] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-15T20:08:40.457859] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-15T20:08:40.519552] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T20:08:41.172681] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:08:41.192610] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:08:41.257867] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-15T20:08:42.057888] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-15T20:08:42.771308] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T20:08:42.857867] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-15T20:08:43.424804] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T20:08:43.657858] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-15T20:08:44.044565] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T20:08:44.457891] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-15T20:08:45.127040] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T20:08:45.257851] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-15T20:08:45.296172] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:08:45.799442] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T20:08:46.057886] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-15T20:08:46.751378] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T20:08:46.857863] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-15T20:08:47.657873] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-15T20:08:48.200718] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T20:08:48.232603] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:08:48.457892] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-15T20:08:49.257915] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-15T20:08:50.057837] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-15T20:08:50.164751] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T20:08:50.208942] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T20:08:50.214278] [INFO ] [REMOTE ] RCI: Full fetch complete (52949 records). [2025-09-15T20:08:50.214372] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-15T20:08:50.596464] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-15T20:08:50.596634] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-15T20:08:50.597539] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-15T20:08:50.597597] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-15T20:08:50.606424] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T20:08:50.609332] [DEBUG] [LOCAL ] RCI: Trimmed 52949 records to 35754 (keeping 150 days of data) [2025-09-15T20:08:50.838089] [DEBUG] [LOCAL ] RCI: Primary data saved (35754 records). [2025-09-15T20:08:50.838237] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-15T20:08:50.838338] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCI took 21.1s. Estimated remaining: 1h 2m 54s. Rate: 9.4 symbols/min [2025-09-15T20:08:50.867598] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-15T20:08:51.011496] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:51.042636] [DEBUG] [LOCAL ] RCUS: Loaded 32146 existing records from primary storage. [2025-09-15T20:08:51.042818] [INFO ] [MAIN ] RCUS: Loaded 32146 existing records. [2025-09-15T20:08:51.229275] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:51.229553] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-15T20:08:51.229613] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-15T20:08:51.230439] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-15T20:08:51.230494] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-15T20:08:51.342359] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T20:08:51.606673] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:51.657818] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-15T20:08:52.457935] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-15T20:08:53.071711] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T20:08:53.257908] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-15T20:08:53.808009] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T20:08:53.809583] [INFO ] [REMOTE ] RCD: Full fetch complete (4510 records). [2025-09-15T20:08:53.809705] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-15T20:08:54.022808] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T20:08:54.061193] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-15T20:08:54.390781] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-09-15T20:08:54.390871] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-09-15T20:08:54.391059] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-09-15T20:08:54.391111] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-09-15T20:08:54.391686] [DEBUG] [LOCAL ] RCD: Trimmed 4510 records to 2563 (keeping 150 days of data) [2025-09-15T20:08:54.411150] [DEBUG] [LOCAL ] RCD: Primary data saved (2563 records). [2025-09-15T20:08:54.411352] [INFO ] [MAIN ] RCD: Full history saved. [2025-09-15T20:08:54.411494] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RCD took 26.1s. Estimated remaining: 1h 2m 46s. Rate: 9.4 symbols/min [2025-09-15T20:08:54.595698] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:54.647916] [DEBUG] [LOCAL ] RDDT: Loaded 40527 existing records from primary storage. [2025-09-15T20:08:54.648069] [INFO ] [MAIN ] RDDT: Loaded 40527 existing records. [2025-09-15T20:08:54.839042] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:54.839406] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-15T20:08:54.839452] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-15T20:08:54.840752] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-15T20:08:54.840805] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-15T20:08:54.862961] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-15T20:08:55.198071] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:55.574604] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:08:55.616286] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T20:08:55.657904] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-15T20:08:56.455882] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T20:08:56.458382] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-15T20:08:57.257896] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-15T20:08:57.999926] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T20:08:58.057846] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-15T20:08:58.138701] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T20:08:58.140470] [INFO ] [REMOTE ] RCS: Full fetch complete (12831 records). [2025-09-15T20:08:58.140551] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-15T20:08:58.493063] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-15T20:08:58.493140] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-15T20:08:58.493420] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-15T20:08:58.493458] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-15T20:08:58.493942] [DEBUG] [LOCAL ] RCS: Trimmed 12831 records to 8371 (keeping 150 days of data) [2025-09-15T20:08:58.545402] [DEBUG] [LOCAL ] RCS: Primary data saved (8371 records). [2025-09-15T20:08:58.545529] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-15T20:08:58.545610] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RCS took 20.5s. Estimated remaining: 1h 2m 39s. Rate: 9.4 symbols/min [2025-09-15T20:08:58.715028] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:08:58.748139] [DEBUG] [LOCAL ] RDN: Loaded 33040 existing records from primary storage. [2025-09-15T20:08:58.748324] [INFO ] [MAIN ] RDN: Loaded 33040 existing records. [2025-09-15T20:08:58.862946] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-15T20:08:58.929585] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:08:58.929850] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-15T20:08:58.929913] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-15T20:08:58.930813] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-15T20:08:58.930874] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-15T20:08:59.280565] [INFO ] [REMOTE ] RDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:08:59.312206] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T20:08:59.657898] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-15T20:09:00.457921] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-15T20:09:01.048335] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T20:09:01.257877] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-15T20:09:01.298525] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T20:09:02.058080] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-15T20:09:02.824890] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-15T20:09:02.857873] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-15T20:09:03.662942] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-15T20:09:03.678019] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-15T20:09:04.457886] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-15T20:09:05.166052] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T20:09:05.260828] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-15T20:09:05.268653] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-15T20:09:05.656984] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-15T20:09:06.057889] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-15T20:09:06.219085] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T20:09:06.224826] [INFO ] [REMOTE ] RCL: Full fetch complete (56792 records). [2025-09-15T20:09:06.224988] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-15T20:09:06.605060] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-09-15T20:09:06.605144] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-09-15T20:09:06.606068] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-09-15T20:09:06.606112] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-09-15T20:09:06.607278] [DEBUG] [LOCAL ] RCL: Trimmed 56792 records to 38346 (keeping 150 days of data) [2025-09-15T20:09:06.736927] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T20:09:06.858099] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-15T20:09:06.889805] [DEBUG] [LOCAL ] RCL: Primary data saved (38346 records). [2025-09-15T20:09:06.889977] [INFO ] [MAIN ] RCL: Full history saved. [2025-09-15T20:09:06.890956] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RCL took 33.8s. Estimated remaining: 1h 2m 34s. Rate: 9.4 symbols/min [2025-09-15T20:09:07.064737] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:07.110066] [DEBUG] [LOCAL ] RDW: Loaded 39148 existing records from primary storage. [2025-09-15T20:09:07.110207] [INFO ] [MAIN ] RDW: Loaded 39148 existing records. [2025-09-15T20:09:07.288180] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:07.288448] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-15T20:09:07.288495] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-15T20:09:07.289452] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-15T20:09:07.289503] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-15T20:09:07.648558] [INFO ] [REMOTE ] RDW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:07.657814] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-15T20:09:07.703484] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T20:09:08.121829] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T20:09:08.457877] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-15T20:09:09.257830] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-15T20:09:09.754996] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-15T20:09:09.826118] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:09:09.830794] [INFO ] [REMOTE ] RCUS: Full fetch complete (46816 records). [2025-09-15T20:09:09.830886] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-15T20:09:10.062956] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-15T20:09:10.210617] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-15T20:09:10.210712] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-15T20:09:10.211523] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-15T20:09:10.211562] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-15T20:09:10.212547] [DEBUG] [LOCAL ] RCUS: Trimmed 46816 records to 31419 (keeping 150 days of data) [2025-09-15T20:09:10.397224] [DEBUG] [LOCAL ] RCUS: Primary data saved (31419 records). [2025-09-15T20:09:10.397357] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-15T20:09:10.397441] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RCUS took 19.6s. Estimated remaining: 1h 2m 26s. Rate: 9.4 symbols/min [2025-09-15T20:09:10.564808] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:10.598159] [DEBUG] [LOCAL ] RDY: Loaded 35140 existing records from primary storage. [2025-09-15T20:09:10.598318] [INFO ] [MAIN ] RDY: Loaded 35140 existing records. [2025-09-15T20:09:10.775663] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:10.775897] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-15T20:09:10.775941] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-15T20:09:10.776884] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-15T20:09:10.776948] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-15T20:09:10.867211] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-15T20:09:11.155712] [INFO ] [REMOTE ] RDY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:11.396824] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T20:09:11.657899] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-15T20:09:12.095817] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T20:09:12.110494] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T20:09:12.457884] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-15T20:09:13.257919] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-15T20:09:14.057869] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-15T20:09:14.059774] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-15T20:09:14.126740] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:09:14.857890] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-15T20:09:15.440942] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-15T20:09:15.657862] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-15T20:09:16.008428] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T20:09:16.457871] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-15T20:09:17.257838] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-15T20:09:17.395356] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-15T20:09:17.961891] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:09:18.011104] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-15T20:09:18.057869] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-15T20:09:18.767910] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:09:18.857870] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-15T20:09:19.657957] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-15T20:09:20.157525] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T20:09:20.457987] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-15T20:09:20.756980] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-15T20:09:21.042848] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T20:09:21.257853] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-15T20:09:21.751509] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:09:21.756030] [INFO ] [REMOTE ] RDN: Full fetch complete (49524 records). [2025-09-15T20:09:21.756124] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-15T20:09:22.062966] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-15T20:09:22.136531] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-15T20:09:22.136623] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-15T20:09:22.137513] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-15T20:09:22.137591] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-15T20:09:22.138612] [DEBUG] [LOCAL ] RDN: Trimmed 49524 records to 32335 (keeping 150 days of data) [2025-09-15T20:09:22.336987] [DEBUG] [LOCAL ] RDN: Primary data saved (32335 records). [2025-09-15T20:09:22.337150] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-15T20:09:22.337799] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RDN took 23.8s. Estimated remaining: 1h 2m 22s. Rate: 9.4 symbols/min [2025-09-15T20:09:22.509082] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:22.548800] [DEBUG] [LOCAL ] RELX: Loaded 36245 existing records from primary storage. [2025-09-15T20:09:22.548995] [INFO ] [MAIN ] RELX: Loaded 36245 existing records. [2025-09-15T20:09:22.676938] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:09:22.764459] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:22.764744] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-15T20:09:22.764793] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-15T20:09:22.765702] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-15T20:09:22.765753] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-15T20:09:22.865698] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-15T20:09:23.135485] [INFO ] [REMOTE ] RELX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:23.657926] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-15T20:09:23.898673] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T20:09:24.382250] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T20:09:24.457895] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-15T20:09:25.257940] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-15T20:09:25.828011] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T20:09:26.057911] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-15T20:09:26.857980] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-15T20:09:27.325427] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-15T20:09:27.657939] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-15T20:09:27.798279] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-15T20:09:28.089353] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T20:09:28.458721] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-15T20:09:28.460957] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-15T20:09:28.467032] [INFO ] [REMOTE ] RDDT: Full fetch complete (58461 records). [2025-09-15T20:09:28.467138] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-15T20:09:28.882322] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-15T20:09:28.882426] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-15T20:09:28.883475] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-15T20:09:28.883530] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-15T20:09:28.886113] [DEBUG] [LOCAL ] RDDT: Trimmed 58461 records to 39748 (keeping 150 days of data) [2025-09-15T20:09:29.150738] [DEBUG] [LOCAL ] RDDT: Primary data saved (39748 records). [2025-09-15T20:09:29.151056] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-15T20:09:29.151820] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RDDT took 34.7s. Estimated remaining: 1h 2m 15s. Rate: 9.4 symbols/min [2025-09-15T20:09:29.263101] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-15T20:09:29.322678] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:29.353490] [DEBUG] [LOCAL ] RERE: Loaded 31030 existing records from primary storage. [2025-09-15T20:09:29.353659] [INFO ] [MAIN ] RERE: Loaded 31030 existing records. [2025-09-15T20:09:29.531910] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:29.532254] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-15T20:09:29.532442] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-15T20:09:29.533287] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-15T20:09:29.533344] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-15T20:09:29.937059] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-15T20:09:29.942062] [INFO ] [REMOTE ] RERE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:30.009366] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:09:30.057838] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-15T20:09:30.736704] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:09:30.857880] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-15T20:09:31.657944] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-15T20:09:32.219166] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-15T20:09:32.225129] [INFO ] [REMOTE ] RDW: Full fetch complete (56517 records). [2025-09-15T20:09:32.225277] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-15T20:09:32.481715] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-15T20:09:32.615253] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-15T20:09:32.615496] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-15T20:09:32.616781] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-15T20:09:32.616954] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-15T20:09:32.618957] [DEBUG] [LOCAL ] RDW: Trimmed 56517 records to 38426 (keeping 150 days of data) [2025-09-15T20:09:32.639383] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:09:32.786535] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:09:32.932250] [DEBUG] [LOCAL ] RDW: Primary data saved (38426 records). [2025-09-15T20:09:32.932432] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-15T20:09:32.933171] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. RDW took 26.0s. Estimated remaining: 1h 2m 8s. Rate: 9.4 symbols/min [2025-09-15T20:09:33.108657] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:33.144277] [DEBUG] [LOCAL ] RES: Loaded 35403 existing records from primary storage. [2025-09-15T20:09:33.144420] [INFO ] [MAIN ] RES: Loaded 35403 existing records. [2025-09-15T20:09:33.263235] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-15T20:09:33.322266] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:33.322554] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-15T20:09:33.322600] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-15T20:09:33.323828] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-15T20:09:33.323880] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-15T20:09:33.676428] [INFO ] [REMOTE ] RES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:33.690812] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T20:09:33.695653] [INFO ] [REMOTE ] RDY: Full fetch complete (51556 records). [2025-09-15T20:09:33.695750] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-15T20:09:34.068560] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-15T20:09:34.086519] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-15T20:09:34.086612] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-15T20:09:34.087571] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-15T20:09:34.087616] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-15T20:09:34.088784] [DEBUG] [LOCAL ] RDY: Trimmed 51556 records to 34394 (keeping 150 days of data) [2025-09-15T20:09:34.302184] [DEBUG] [LOCAL ] RDY: Primary data saved (34394 records). [2025-09-15T20:09:34.302339] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-15T20:09:34.302424] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. RDY took 23.9s. Estimated remaining: 1h 2m 0s. Rate: 9.4 symbols/min [2025-09-15T20:09:34.473394] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:34.502688] [DEBUG] [LOCAL ] REVG: Loaded 30564 existing records from primary storage. [2025-09-15T20:09:34.502827] [INFO ] [MAIN ] REVG: Loaded 30564 existing records. [2025-09-15T20:09:34.684350] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:34.684613] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-15T20:09:34.684686] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-15T20:09:34.685635] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-15T20:09:34.685706] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-15T20:09:34.861741] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-15T20:09:35.059664] [INFO ] [REMOTE ] REVG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:35.093189] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T20:09:35.188701] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T20:09:35.657873] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-15T20:09:36.418316] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:09:36.457898] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-15T20:09:36.566398] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T20:09:37.257898] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-15T20:09:38.057882] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-15T20:09:38.133868] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T20:09:38.576292] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:09:38.857888] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-15T20:09:39.200979] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T20:09:39.657869] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-15T20:09:40.226129] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:09:40.457891] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-15T20:09:41.257890] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-15T20:09:41.769341] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T20:09:41.785580] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T20:09:42.057866] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-15T20:09:42.321793] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T20:09:42.857897] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-15T20:09:43.603608] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T20:09:43.657821] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-15T20:09:44.240544] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T20:09:44.457911] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-15T20:09:45.254710] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T20:09:45.264571] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-15T20:09:46.057908] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-15T20:09:46.202856] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T20:09:46.831588] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:09:46.839582] [INFO ] [REMOTE ] RELX: Full fetch complete (51588 records). [2025-09-15T20:09:46.839874] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-15T20:09:46.865140] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-15T20:09:47.308192] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-15T20:09:47.308364] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-15T20:09:47.310474] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-15T20:09:47.310593] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-15T20:09:47.345102] [DEBUG] [LOCAL ] RELX: Trimmed 51588 records to 35632 (keeping 150 days of data) [2025-09-15T20:09:47.347765] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T20:09:47.587462] [DEBUG] [LOCAL ] RELX: Primary data saved (35632 records). [2025-09-15T20:09:47.587634] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-15T20:09:47.588660] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. RELX took 25.3s. Estimated remaining: 1h 1m 56s. Rate: 9.4 symbols/min [2025-09-15T20:09:47.663388] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-15T20:09:47.762637] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:47.774854] [DEBUG] [LOCAL ] REX: Loaded 9452 existing records from primary storage. [2025-09-15T20:09:47.774993] [INFO ] [MAIN ] REX: Loaded 9452 existing records. [2025-09-15T20:09:47.950750] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:47.951022] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-15T20:09:47.951070] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-15T20:09:47.951427] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-15T20:09:47.951476] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-15T20:09:48.304911] [INFO ] [REMOTE ] REX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:48.457869] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-15T20:09:48.652267] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T20:09:49.052915] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T20:09:49.257913] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-15T20:09:49.436184] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:09:50.057926] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-15T20:09:50.555112] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T20:09:50.857861] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-15T20:09:51.203925] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:09:51.210013] [INFO ] [REMOTE ] RES: Full fetch complete (51607 records). [2025-09-15T20:09:51.210157] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-15T20:09:51.604489] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-15T20:09:51.604573] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-15T20:09:51.605482] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-15T20:09:51.605526] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-15T20:09:51.606627] [DEBUG] [LOCAL ] RES: Trimmed 51607 records to 34685 (keeping 150 days of data) [2025-09-15T20:09:51.663059] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-15T20:09:51.839276] [DEBUG] [LOCAL ] RES: Primary data saved (34685 records). [2025-09-15T20:09:51.839491] [INFO ] [MAIN ] RES: Full history saved. [2025-09-15T20:09:51.839621] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. RES took 18.9s. Estimated remaining: 1h 1m 49s. Rate: 9.4 symbols/min [2025-09-15T20:09:52.012902] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:52.058218] [DEBUG] [LOCAL ] REXR: Loaded 39194 existing records from primary storage. [2025-09-15T20:09:52.058418] [INFO ] [MAIN ] REXR: Loaded 39194 existing records. [2025-09-15T20:09:52.251079] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:52.251472] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-15T20:09:52.251526] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-15T20:09:52.252381] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-15T20:09:52.252452] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-15T20:09:52.464680] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-15T20:09:52.656354] [INFO ] [REMOTE ] REXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:52.667436] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T20:09:53.056686] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T20:09:53.062013] [INFO ] [REMOTE ] RERE: Full fetch complete (43991 records). [2025-09-15T20:09:53.062099] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-15T20:09:53.263917] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-15T20:09:53.332499] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T20:09:53.466034] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-15T20:09:53.466116] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-15T20:09:53.466958] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-15T20:09:53.467002] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-15T20:09:53.468002] [DEBUG] [LOCAL ] RERE: Trimmed 43991 records to 30441 (keeping 150 days of data) [2025-09-15T20:09:53.647682] [DEBUG] [LOCAL ] RERE: Primary data saved (30441 records). [2025-09-15T20:09:53.647839] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-15T20:09:53.647941] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. RERE took 24.5s. Estimated remaining: 1h 1m 41s. Rate: 9.4 symbols/min [2025-09-15T20:09:53.819796] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:09:53.855885] [DEBUG] [LOCAL ] REZI: Loaded 35073 existing records from primary storage. [2025-09-15T20:09:53.856046] [INFO ] [MAIN ] REZI: Loaded 35073 existing records. [2025-09-15T20:09:54.034399] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:09:54.034665] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-15T20:09:54.034713] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-15T20:09:54.035384] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-15T20:09:54.035432] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-15T20:09:54.066422] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-15T20:09:54.405546] [INFO ] [REMOTE ] REZI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:09:54.734529] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T20:09:54.857875] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-15T20:09:55.176450] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T20:09:55.657876] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-15T20:09:55.897251] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:09:56.457882] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-15T20:09:57.121415] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T20:09:57.257861] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-15T20:09:58.021451] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:09:58.057871] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-15T20:09:58.857920] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-15T20:09:59.022132] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T20:09:59.160189] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T20:09:59.657882] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-15T20:09:59.945758] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T20:10:00.457874] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-15T20:10:01.257841] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-15T20:10:01.304046] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T20:10:01.507269] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T20:10:02.057919] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-15T20:10:02.527382] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T20:10:02.858000] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-15T20:10:03.657939] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-15T20:10:03.724763] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T20:10:04.170191] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T20:10:04.242751] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T20:10:04.457917] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-15T20:10:05.000938] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T20:10:05.257881] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-15T20:10:06.057907] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-15T20:10:06.440237] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T20:10:06.858890] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-15T20:10:06.859897] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T20:10:07.657940] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-15T20:10:07.941791] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T20:10:08.457922] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-15T20:10:09.027544] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:10:09.034105] [INFO ] [REMOTE ] REVG: Full fetch complete (44473 records). [2025-09-15T20:10:09.034346] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-15T20:10:09.265299] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-15T20:10:09.454012] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-15T20:10:09.454167] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-15T20:10:09.455736] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-15T20:10:09.455815] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-15T20:10:09.457728] [DEBUG] [LOCAL ] REVG: Trimmed 44473 records to 29937 (keeping 150 days of data) [2025-09-15T20:10:09.673910] [DEBUG] [LOCAL ] REVG: Primary data saved (29937 records). [2025-09-15T20:10:09.674125] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-15T20:10:09.674268] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. REVG took 35.4s. Estimated remaining: 1h 1m 38s. Rate: 9.4 symbols/min [2025-09-15T20:10:09.863818] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:09.898659] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T20:10:09.943281] [DEBUG] [LOCAL ] RF: Loaded 40373 existing records from primary storage. [2025-09-15T20:10:09.943484] [INFO ] [MAIN ] RF: Loaded 40373 existing records. [2025-09-15T20:10:10.063109] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-15T20:10:10.137212] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:10.137588] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-15T20:10:10.137664] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-15T20:10:10.138735] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-15T20:10:10.138792] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-15T20:10:10.519130] [INFO ] [REMOTE ] RF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:10.865853] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-15T20:10:10.875548] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T20:10:11.601406] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T20:10:11.657934] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-15T20:10:12.457904] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-15T20:10:12.696820] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T20:10:13.258024] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-15T20:10:13.306928] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:10:14.057374] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T20:10:14.063256] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-15T20:10:14.077455] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T20:10:14.080420] [INFO ] [REMOTE ] REX: Full fetch complete (14833 records). [2025-09-15T20:10:14.080507] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-15T20:10:14.468150] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-15T20:10:14.468244] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-15T20:10:14.468705] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-15T20:10:14.468761] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-15T20:10:14.469380] [DEBUG] [LOCAL ] REX: Trimmed 14833 records to 9096 (keeping 150 days of data) [2025-09-15T20:10:14.530399] [DEBUG] [LOCAL ] REX: Primary data saved (9096 records). [2025-09-15T20:10:14.530565] [INFO ] [MAIN ] REX: Full history saved. [2025-09-15T20:10:14.530684] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. REX took 26.9s. Estimated remaining: 1h 1m 31s. Rate: 9.4 symbols/min [2025-09-15T20:10:14.719799] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:14.729904] [DEBUG] [LOCAL ] RFI: Loaded 7764 existing records from primary storage. [2025-09-15T20:10:14.730042] [INFO ] [MAIN ] RFI: Loaded 7764 existing records. [2025-09-15T20:10:14.862980] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-15T20:10:14.921800] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:14.922029] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-15T20:10:14.922093] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-15T20:10:14.922479] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-15T20:10:14.922536] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-15T20:10:15.302316] [INFO ] [REMOTE ] RFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:15.657919] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-15T20:10:15.909207] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T20:10:15.915241] [INFO ] [REMOTE ] REXR: Full fetch complete (56399 records). [2025-09-15T20:10:15.915359] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-15T20:10:16.337039] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-15T20:10:16.337157] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-15T20:10:16.338566] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-15T20:10:16.346451] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-15T20:10:16.347736] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T20:10:16.351770] [DEBUG] [LOCAL ] REXR: Trimmed 56399 records to 38408 (keeping 150 days of data) [2025-09-15T20:10:16.457900] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-15T20:10:16.600329] [DEBUG] [LOCAL ] REXR: Primary data saved (38408 records). [2025-09-15T20:10:16.600535] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-15T20:10:16.602040] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. REXR took 24.8s. Estimated remaining: 1h 1m 23s. Rate: 9.4 symbols/min [2025-09-15T20:10:16.792280] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:16.793828] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T20:10:16.800660] [INFO ] [REMOTE ] REZI: Full fetch complete (50425 records). [2025-09-15T20:10:16.800782] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-15T20:10:16.913978] [DEBUG] [LOCAL ] RFL: Loaded 8876 existing records from primary storage. [2025-09-15T20:10:16.919893] [INFO ] [MAIN ] RFL: Loaded 8876 existing records. [2025-09-15T20:10:17.274809] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-15T20:10:17.307981] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:17.350994] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-15T20:10:17.351140] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-15T20:10:17.361813] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-15T20:10:17.371895] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-15T20:10:17.512239] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-15T20:10:17.514995] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-15T20:10:17.516234] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-15T20:10:17.516626] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-15T20:10:17.577483] [DEBUG] [LOCAL ] REZI: Trimmed 50425 records to 34450 (keeping 150 days of data) [2025-09-15T20:10:17.876144] [INFO ] [REMOTE ] RFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:18.013257] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:10:18.019636] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:10:18.049359] [DEBUG] [LOCAL ] REZI: Primary data saved (34450 records). [2025-09-15T20:10:18.049522] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-15T20:10:18.049618] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. REZI took 24.4s. Estimated remaining: 1h 1m 15s. Rate: 9.4 symbols/min [2025-09-15T20:10:18.063028] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-15T20:10:18.228127] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:18.233920] [DEBUG] [LOCAL ] RFM: Loaded 2930 existing records from primary storage. [2025-09-15T20:10:18.234009] [INFO ] [MAIN ] RFM: Loaded 2930 existing records. [2025-09-15T20:10:18.413862] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:18.414148] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-15T20:10:18.414229] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-15T20:10:18.414464] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-15T20:10:18.414512] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-15T20:10:18.708206] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T20:10:18.787238] [INFO ] [REMOTE ] RFM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:18.857844] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-15T20:10:19.300513] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T20:10:19.657909] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-15T20:10:20.457930] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-15T20:10:20.883250] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T20:10:21.095567] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T20:10:21.257949] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-15T20:10:21.833268] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T20:10:22.057915] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-15T20:10:22.778134] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T20:10:22.857890] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-15T20:10:23.310767] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T20:10:23.657961] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-15T20:10:24.166238] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T20:10:24.457890] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-15T20:10:25.257934] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-15T20:10:25.532781] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:10:26.057885] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-15T20:10:26.863041] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-15T20:10:26.866213] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T20:10:27.011035] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:10:27.492629] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T20:10:27.657883] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-15T20:10:28.097846] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T20:10:28.457890] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-15T20:10:29.138556] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T20:10:29.257884] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-15T20:10:30.057897] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-15T20:10:30.527719] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T20:10:30.857911] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-15T20:10:30.945693] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T20:10:31.402134] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T20:10:31.657881] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-15T20:10:32.457871] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-15T20:10:33.247408] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T20:10:33.257811] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-15T20:10:33.478733] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T20:10:33.896404] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T20:10:34.057925] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-15T20:10:34.717866] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T20:10:34.719664] [INFO ] [REMOTE ] RFI: Full fetch complete (11482 records). [2025-09-15T20:10:34.719742] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-15T20:10:34.863016] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-15T20:10:35.093537] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-15T20:10:35.093627] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-15T20:10:35.093923] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-15T20:10:35.093966] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-15T20:10:35.094689] [DEBUG] [LOCAL ] RFI: Trimmed 11482 records to 7712 (keeping 150 days of data) [2025-09-15T20:10:35.143220] [DEBUG] [LOCAL ] RFI: Primary data saved (7712 records). [2025-09-15T20:10:35.143367] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-15T20:10:35.143518] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. RFI took 20.6s. Estimated remaining: 1h 1m 12s. Rate: 9.4 symbols/min [2025-09-15T20:10:35.315309] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:35.324288] [DEBUG] [LOCAL ] RFMZ: Loaded 6214 existing records from primary storage. [2025-09-15T20:10:35.324404] [INFO ] [MAIN ] RFMZ: Loaded 6214 existing records. [2025-09-15T20:10:35.508700] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:35.510996] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T20:10:35.511231] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-15T20:10:35.512777] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-15T20:10:35.513141] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-15T20:10:35.513199] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-15T20:10:35.661062] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-15T20:10:35.873757] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:36.267257] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T20:10:36.457883] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-15T20:10:37.247396] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T20:10:37.249729] [INFO ] [REMOTE ] RFL: Full fetch complete (10458 records). [2025-09-15T20:10:37.249803] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-15T20:10:37.263089] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-15T20:10:37.607423] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-15T20:10:37.607503] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-15T20:10:37.607764] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-15T20:10:37.607810] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-15T20:10:37.608282] [DEBUG] [LOCAL ] RFL: Trimmed 10458 records to 9000 (keeping 150 days of data) [2025-09-15T20:10:37.666495] [DEBUG] [LOCAL ] RFL: Primary data saved (9000 records). [2025-09-15T20:10:37.666691] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-15T20:10:37.666863] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RFL took 21.1s. Estimated remaining: 1h 1m 5s. Rate: 9.4 symbols/min [2025-09-15T20:10:37.837123] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:37.861917] [DEBUG] [LOCAL ] RGA: Loaded 21448 existing records from primary storage. [2025-09-15T20:10:37.862075] [INFO ] [MAIN ] RGA: Loaded 21448 existing records. [2025-09-15T20:10:37.977715] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T20:10:38.046149] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:38.046390] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-15T20:10:38.046437] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-15T20:10:38.047012] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-15T20:10:38.047067] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-15T20:10:38.067089] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-15T20:10:38.409388] [INFO ] [REMOTE ] RGA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:38.707718] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T20:10:38.857869] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-15T20:10:39.657889] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-15T20:10:40.432808] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T20:10:40.457856] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-15T20:10:40.498493] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:10:41.257874] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-15T20:10:41.872071] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T20:10:42.057885] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-15T20:10:42.857920] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-15T20:10:42.910194] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T20:10:42.916153] [INFO ] [REMOTE ] RF: Full fetch complete (58305 records). [2025-09-15T20:10:42.916263] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-15T20:10:43.311098] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-15T20:10:43.311226] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-15T20:10:43.312238] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-15T20:10:43.312328] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-15T20:10:43.313959] [DEBUG] [LOCAL ] RF: Trimmed 58305 records to 39593 (keeping 150 days of data) [2025-09-15T20:10:43.444471] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:10:43.600517] [DEBUG] [LOCAL ] RF: Primary data saved (39593 records). [2025-09-15T20:10:43.600703] [INFO ] [MAIN ] RF: Full history saved. [2025-09-15T20:10:43.600812] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RF took 33.9s. Estimated remaining: 1h 0m 58s. Rate: 9.4 symbols/min [2025-09-15T20:10:43.663042] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-15T20:10:43.723985] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T20:10:43.793456] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:43.810060] [DEBUG] [LOCAL ] RGR: Loaded 15444 existing records from primary storage. [2025-09-15T20:10:43.810223] [INFO ] [MAIN ] RGR: Loaded 15444 existing records. [2025-09-15T20:10:43.993439] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:43.993775] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-15T20:10:43.993846] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-15T20:10:43.994279] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-15T20:10:43.994328] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-15T20:10:44.348715] [INFO ] [REMOTE ] RGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:44.408121] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T20:10:44.409558] [INFO ] [REMOTE ] RFM: Full fetch complete (4212 records). [2025-09-15T20:10:44.409628] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-15T20:10:44.463084] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-15T20:10:44.762964] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-15T20:10:44.763071] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-15T20:10:44.763199] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-15T20:10:44.763249] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-15T20:10:44.763677] [DEBUG] [LOCAL ] RFM: Trimmed 4212 records to 2869 (keeping 150 days of data) [2025-09-15T20:10:44.781880] [DEBUG] [LOCAL ] RFM: Primary data saved (2869 records). [2025-09-15T20:10:44.781939] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-15T20:10:44.782039] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RFM took 26.7s. Estimated remaining: 1h 0m 50s. Rate: 9.4 symbols/min [2025-09-15T20:10:44.950550] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:10:44.955389] [DEBUG] [LOCAL ] RGT: Loaded 2040 existing records from primary storage. [2025-09-15T20:10:44.955466] [INFO ] [MAIN ] RGT: Loaded 2040 existing records. [2025-09-15T20:10:45.130880] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:10:45.131241] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-15T20:10:45.131323] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-15T20:10:45.136300] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-15T20:10:45.138415] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-15T20:10:45.139266] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T20:10:45.262952] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-15T20:10:45.556000] [INFO ] [REMOTE ] RGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:10:46.060836] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-15T20:10:46.062022] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T20:10:46.857882] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-15T20:10:47.290815] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T20:10:47.616356] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T20:10:47.657856] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-15T20:10:48.165431] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T20:10:48.457903] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-15T20:10:49.257952] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-15T20:10:49.618611] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T20:10:49.877587] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:10:50.057965] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-15T20:10:50.851203] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:10:50.857808] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-15T20:10:51.657906] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-15T20:10:51.928053] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T20:10:52.214957] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:10:52.457879] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-15T20:10:53.182364] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:10:53.183994] [INFO ] [REMOTE ] RFMZ: Full fetch complete (8942 records). [2025-09-15T20:10:53.184068] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-15T20:10:53.262950] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-15T20:10:53.549397] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-15T20:10:53.549726] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-15T20:10:53.550004] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-15T20:10:53.550158] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-15T20:10:53.551089] [DEBUG] [LOCAL ] RFMZ: Trimmed 8942 records to 6003 (keeping 150 days of data) [2025-09-15T20:10:53.592663] [DEBUG] [LOCAL ] RFMZ: Primary data saved (6003 records). [2025-09-15T20:10:53.592839] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-15T20:10:53.592956] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RFMZ took 18.4s. Estimated remaining: 1h 0m 45s. Rate: 9.4 symbols/min [2025-09-15T20:10:53.908068] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T20:10:54.057914] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-15T20:10:54.857858] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-15T20:10:55.132214] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:10:55.657865] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-15T20:10:55.730217] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T20:10:56.457884] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-15T20:10:57.014527] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T20:10:57.181809] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T20:10:57.257922] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-15T20:10:57.824925] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T20:10:58.057890] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-15T20:10:58.481361] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T20:10:58.857941] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-15T20:10:59.240535] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T20:10:59.657952] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-15T20:11:00.457907] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-15T20:11:00.871838] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T20:11:01.257918] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-15T20:11:01.618963] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T20:11:01.743260] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T20:11:02.057885] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-15T20:11:02.857884] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-15T20:11:03.111871] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T20:11:03.161888] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-15T20:11:03.657903] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-15T20:11:04.424257] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:11:04.427015] [INFO ] [REMOTE ] RGR: Full fetch complete (21636 records). [2025-09-15T20:11:04.427114] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-15T20:11:04.463125] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-15T20:11:04.796165] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-15T20:11:04.796261] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-15T20:11:04.796972] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-15T20:11:04.797048] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-15T20:11:04.797775] [DEBUG] [LOCAL ] RGR: Trimmed 21636 records to 15312 (keeping 150 days of data) [2025-09-15T20:11:04.899697] [DEBUG] [LOCAL ] RGR: Primary data saved (15312 records). [2025-09-15T20:11:04.899860] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-15T20:11:04.900029] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RGR took 21.3s. Estimated remaining: 1h 0m 40s. Rate: 9.4 symbols/min [2025-09-15T20:11:04.996346] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T20:11:04.997263] [INFO ] [REMOTE ] RGT: Full fetch complete (3047 records). [2025-09-15T20:11:04.997333] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-15T20:11:05.263125] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-15T20:11:05.350067] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-15T20:11:05.350141] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-15T20:11:05.350251] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-15T20:11:05.350288] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-15T20:11:05.350630] [DEBUG] [LOCAL ] RGT: Trimmed 3047 records to 1962 (keeping 150 days of data) [2025-09-15T20:11:05.363182] [DEBUG] [LOCAL ] RGT: Primary data saved (1962 records). [2025-09-15T20:11:05.363241] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-15T20:11:05.363326] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RGT took 20.6s. Estimated remaining: 1h 0m 32s. Rate: 9.4 symbols/min [2025-09-15T20:11:06.430444] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:11:06.433927] [INFO ] [REMOTE ] RGA: Full fetch complete (33696 records). [2025-09-15T20:11:06.434027] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-15T20:11:06.822157] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-15T20:11:06.822236] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-15T20:11:06.822912] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-15T20:11:06.822955] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-15T20:11:06.823715] [DEBUG] [LOCAL ] RGA: Trimmed 33696 records to 21089 (keeping 150 days of data) [2025-09-15T20:11:06.970156] [DEBUG] [LOCAL ] RGA: Primary data saved (21089 records). [2025-09-15T20:11:06.970289] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-15T20:11:06.970383] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RGA took 29.3s. Estimated remaining: 1h 0m 24s. Rate: 9.4 symbols/min [2025-09-15T20:11:07.609731] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:07.623491] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:07.671962] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:07.698622] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:07.788301] [DEBUG] [LOCAL ] RHI: Loaded 37368 existing records from primary storage. [2025-09-15T20:11:07.787521] [DEBUG] [LOCAL ] RHP: Loaded 30244 existing records from primary storage. [2025-09-15T20:11:07.799279] [INFO ] [MAIN ] RHI: Loaded 37368 existing records. [2025-09-15T20:11:07.799219] [INFO ] [MAIN ] RHP: Loaded 30244 existing records. [2025-09-15T20:11:07.810847] [DEBUG] [LOCAL ] RH: Loaded 35612 existing records from primary storage. [2025-09-15T20:11:07.911286] [INFO ] [MAIN ] RH: Loaded 35612 existing records. [2025-09-15T20:11:07.958595] [DEBUG] [LOCAL ] RIG: Loaded 40421 existing records from primary storage. [2025-09-15T20:11:08.059881] [INFO ] [MAIN ] RIG: Loaded 40421 existing records. [2025-09-15T20:11:08.426521] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:08.442498] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:08.541868] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:08.583094] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-15T20:11:08.582945] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:08.583409] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-15T20:11:08.583236] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-15T20:11:08.583585] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-15T20:11:08.583778] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-15T20:11:08.583537] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-15T20:11:08.584023] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-15T20:11:08.584076] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-15T20:11:08.584859] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-15T20:11:08.584817] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-15T20:11:08.584946] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-15T20:11:08.590270] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-15T20:11:08.590326] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-15T20:11:08.585090] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-15T20:11:08.596410] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-15T20:11:08.671486] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-15T20:11:09.781197] [INFO ] [REMOTE ] RH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:09.856735] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-15T20:11:09.969117] [INFO ] [REMOTE ] RIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:09.984995] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-15T20:11:10.054726] [INFO ] [REMOTE ] RHP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:10.094110] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-15T20:11:10.093689] [INFO ] [REMOTE ] RHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:10.095370] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-15T20:11:11.092523] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T20:11:11.100396] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-15T20:11:11.150363] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T20:11:11.157582] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-15T20:11:11.538747] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T20:11:11.548830] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-15T20:11:11.630618] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:11:11.657808] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-15T20:11:12.544770] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:11:12.554347] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-15T20:11:12.681026] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T20:11:13.035083] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T20:11:13.064598] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T20:11:13.257830] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-15T20:11:14.057898] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-15T20:11:14.249374] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:11:14.857838] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-15T20:11:15.067779] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T20:11:15.563338] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T20:11:15.657955] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-15T20:11:16.457856] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-15T20:11:16.640895] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T20:11:17.211702] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T20:11:17.257813] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-15T20:11:17.820186] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:11:18.057871] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-15T20:11:18.857882] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-15T20:11:19.156680] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T20:11:19.654240] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T20:11:19.663323] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-15T20:11:20.079124] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T20:11:20.457878] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-15T20:11:21.252045] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:11:21.262952] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-15T20:11:21.593826] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T20:11:22.057870] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-15T20:11:22.439674] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T20:11:22.857873] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-15T20:11:23.657897] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-15T20:11:23.866657] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T20:11:24.113324] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T20:11:24.457882] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-15T20:11:24.664507] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T20:11:25.257900] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-15T20:11:25.861915] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T20:11:26.057879] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-15T20:11:26.835479] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:11:26.857826] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-15T20:11:27.071109] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T20:11:27.075708] [INFO ] [REMOTE ] RHP: Full fetch complete (45071 records). [2025-09-15T20:11:27.075824] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-15T20:11:27.464267] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-15T20:11:27.464363] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-15T20:11:27.465352] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-15T20:11:27.465447] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-15T20:11:27.466747] [DEBUG] [LOCAL ] RHP: Trimmed 45071 records to 29562 (keeping 150 days of data) [2025-09-15T20:11:27.653655] [DEBUG] [LOCAL ] RHP: Primary data saved (29562 records). [2025-09-15T20:11:27.653797] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-15T20:11:27.653889] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RHP took 20.7s. Estimated remaining: 1h 0m 22s. Rate: 9.4 symbols/min [2025-09-15T20:11:27.665558] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-15T20:11:27.835213] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:27.876498] [DEBUG] [LOCAL ] RIO: Loaded 40165 existing records from primary storage. [2025-09-15T20:11:27.876670] [INFO ] [MAIN ] RIO: Loaded 40165 existing records. [2025-09-15T20:11:28.064064] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:28.064316] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-15T20:11:28.064365] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-15T20:11:28.065361] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-15T20:11:28.065415] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-15T20:11:28.432134] [INFO ] [REMOTE ] RIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:28.448351] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:11:28.454435] [INFO ] [REMOTE ] RIG: Full fetch complete (58352 records). [2025-09-15T20:11:28.454585] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-15T20:11:28.466382] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-15T20:11:28.839963] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-15T20:11:28.840075] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-15T20:11:28.841251] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-15T20:11:28.841318] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-15T20:11:28.842875] [DEBUG] [LOCAL ] RIG: Trimmed 58352 records to 39641 (keeping 150 days of data) [2025-09-15T20:11:29.079285] [DEBUG] [LOCAL ] RIG: Primary data saved (39641 records). [2025-09-15T20:11:29.079443] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-15T20:11:29.079531] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RIG took 22.1s. Estimated remaining: 1h 0m 14s. Rate: 9.4 symbols/min [2025-09-15T20:11:29.251767] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:29.262844] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-15T20:11:29.282295] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T20:11:29.328528] [DEBUG] [LOCAL ] RITM: Loaded 39747 existing records from primary storage. [2025-09-15T20:11:29.328694] [INFO ] [MAIN ] RITM: Loaded 39747 existing records. [2025-09-15T20:11:29.508126] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:29.508370] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-15T20:11:29.508415] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-15T20:11:29.509295] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-15T20:11:29.509347] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-15T20:11:29.858302] [INFO ] [REMOTE ] RITM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:30.057983] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-15T20:11:30.373166] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T20:11:30.822758] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T20:11:30.857838] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-15T20:11:31.657938] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-15T20:11:31.764149] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T20:11:31.769441] [INFO ] [REMOTE ] RH: Full fetch complete (51122 records). [2025-09-15T20:11:31.769527] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-15T20:11:32.147061] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-15T20:11:32.147245] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-15T20:11:32.148109] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-15T20:11:32.148170] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-15T20:11:32.149361] [DEBUG] [LOCAL ] RH: Trimmed 51122 records to 34838 (keeping 150 days of data) [2025-09-15T20:11:32.351929] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:11:32.415715] [DEBUG] [LOCAL ] RH: Primary data saved (34838 records). [2025-09-15T20:11:32.415840] [INFO ] [MAIN ] RH: Full history saved. [2025-09-15T20:11:32.416768] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RH took 25.4s. Estimated remaining: 1h 0m 7s. Rate: 9.4 symbols/min [2025-09-15T20:11:32.463159] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-15T20:11:32.587706] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:32.600895] [DEBUG] [LOCAL ] RIV: Loaded 8659 existing records from primary storage. [2025-09-15T20:11:32.601033] [INFO ] [MAIN ] RIV: Loaded 8659 existing records. [2025-09-15T20:11:32.781324] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:32.781822] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-15T20:11:32.781871] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-15T20:11:32.782234] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-15T20:11:32.782279] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-15T20:11:33.126197] [INFO ] [REMOTE ] RIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:33.257842] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-15T20:11:33.741674] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T20:11:33.846415] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T20:11:33.985844] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:11:34.057910] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-15T20:11:34.823379] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T20:11:34.857878] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-15T20:11:35.642223] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T20:11:35.657810] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-15T20:11:36.346058] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T20:11:36.457891] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-15T20:11:37.257933] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-15T20:11:37.983395] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:11:37.994150] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T20:11:37.997343] [INFO ] [REMOTE ] RHI: Full fetch complete (53454 records). [2025-09-15T20:11:37.997434] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-15T20:11:38.063019] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-15T20:11:38.379003] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-15T20:11:38.379101] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-15T20:11:38.379996] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-15T20:11:38.380046] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-15T20:11:38.381112] [DEBUG] [LOCAL ] RHI: Trimmed 53454 records to 36687 (keeping 150 days of data) [2025-09-15T20:11:38.608027] [DEBUG] [LOCAL ] RHI: Primary data saved (36687 records). [2025-09-15T20:11:38.608174] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-15T20:11:38.608269] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RHI took 31.6s. Estimated remaining: 1h 0m 0s. Rate: 9.4 symbols/min [2025-09-15T20:11:38.778693] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:38.818529] [DEBUG] [LOCAL ] RJF: Loaded 34710 existing records from primary storage. [2025-09-15T20:11:38.819167] [INFO ] [MAIN ] RJF: Loaded 34710 existing records. [2025-09-15T20:11:38.863030] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-15T20:11:38.995131] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:38.995449] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-15T20:11:38.995496] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-15T20:11:38.996493] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-15T20:11:38.996544] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-15T20:11:39.339373] [INFO ] [REMOTE ] RJF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:39.657821] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-15T20:11:40.147908] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T20:11:40.304073] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T20:11:40.457858] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-15T20:11:41.061009] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T20:11:41.257854] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-15T20:11:42.057949] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-15T20:11:42.098520] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T20:11:42.349590] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T20:11:42.857874] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-15T20:11:43.611782] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T20:11:43.657825] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-15T20:11:43.809659] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:11:44.457858] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-15T20:11:44.593564] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T20:11:44.596851] [INFO ] [REMOTE ] RIV: Full fetch complete (12327 records). [2025-09-15T20:11:44.596969] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-15T20:11:44.953805] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-15T20:11:44.953882] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-15T20:11:44.954153] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-15T20:11:44.954242] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-15T20:11:44.954740] [DEBUG] [LOCAL ] RIV: Trimmed 12327 records to 8646 (keeping 150 days of data) [2025-09-15T20:11:45.009873] [DEBUG] [LOCAL ] RIV: Primary data saved (8646 records). [2025-09-15T20:11:45.010014] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-15T20:11:45.010122] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RIV took 12.6s. Estimated remaining: 59m 54s. Rate: 9.4 symbols/min [2025-09-15T20:11:45.183006] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:45.223065] [DEBUG] [LOCAL ] RKT: Loaded 40469 existing records from primary storage. [2025-09-15T20:11:45.223211] [INFO ] [MAIN ] RKT: Loaded 40469 existing records. [2025-09-15T20:11:45.265520] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-15T20:11:45.401068] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:45.401303] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-15T20:11:45.401347] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-15T20:11:45.402198] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-15T20:11:45.402249] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-15T20:11:45.752836] [INFO ] [REMOTE ] RKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:11:46.058264] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-15T20:11:46.064173] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T20:11:46.668309] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:11:46.857883] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-15T20:11:47.642010] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T20:11:47.657818] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-15T20:11:48.366003] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T20:11:48.457873] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-15T20:11:49.257974] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-15T20:11:49.596931] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T20:11:49.942876] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:11:50.057851] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-15T20:11:50.857911] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-15T20:11:51.244466] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-15T20:11:51.286848] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T20:11:51.657939] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-15T20:11:52.165876] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T20:11:52.457929] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-15T20:11:53.257870] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-15T20:11:53.380621] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T20:11:54.057932] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-15T20:11:54.615337] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T20:11:54.652123] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T20:11:54.857873] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-15T20:11:55.653120] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T20:11:55.663457] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-15T20:11:56.374347] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:11:56.457845] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-15T20:11:57.257957] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-15T20:11:57.419142] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:11:58.057972] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-15T20:11:58.279058] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T20:11:58.284887] [INFO ] [REMOTE ] RITM: Full fetch complete (57405 records). [2025-09-15T20:11:58.284991] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-15T20:11:58.667688] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-15T20:11:58.667777] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-15T20:11:58.668727] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-15T20:11:58.668777] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-15T20:11:58.670043] [DEBUG] [LOCAL ] RITM: Trimmed 57405 records to 38979 (keeping 150 days of data) [2025-09-15T20:11:58.857941] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-15T20:11:58.918294] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T20:11:58.925410] [INFO ] [REMOTE ] RIO: Full fetch complete (58053 records). [2025-09-15T20:11:58.926024] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-15T20:11:59.162361] [DEBUG] [LOCAL ] RITM: Primary data saved (38979 records). [2025-09-15T20:11:59.200345] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-15T20:11:59.222679] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RITM took 30.1s. Estimated remaining: 59m 50s. Rate: 9.4 symbols/min [2025-09-15T20:11:59.423828] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-15T20:11:59.424373] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-15T20:11:59.425331] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-15T20:11:59.425448] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-15T20:11:59.480223] [DEBUG] [LOCAL ] RIO: Trimmed 58053 records to 39386 (keeping 150 days of data) [2025-09-15T20:11:59.498518] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:11:59.621574] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T20:11:59.661708] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-15T20:11:59.666251] [DEBUG] [LOCAL ] RL: Loaded 30364 existing records from primary storage. [2025-09-15T20:11:59.667110] [INFO ] [MAIN ] RL: Loaded 30364 existing records. [2025-09-15T20:11:59.854033] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:11:59.855698] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-15T20:11:59.856712] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-15T20:11:59.857692] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-15T20:11:59.858012] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-15T20:12:00.225979] [INFO ] [REMOTE ] RL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:00.351231] [DEBUG] [LOCAL ] RIO: Primary data saved (39386 records). [2025-09-15T20:12:00.351387] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-15T20:12:00.352100] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RIO took 32.7s. Estimated remaining: 59m 42s. Rate: 9.4 symbols/min [2025-09-15T20:12:00.462928] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-15T20:12:00.522223] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:00.547744] [DEBUG] [LOCAL ] RLI: Loaded 25165 existing records from primary storage. [2025-09-15T20:12:00.547907] [INFO ] [MAIN ] RLI: Loaded 25165 existing records. [2025-09-15T20:12:00.726221] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:00.726602] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-15T20:12:00.726700] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-15T20:12:00.727291] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-15T20:12:00.727383] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-15T20:12:01.020689] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-15T20:12:01.132518] [INFO ] [REMOTE ] RLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:01.184430] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:12:01.257841] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-15T20:12:02.057924] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-15T20:12:02.501174] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T20:12:02.857942] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-15T20:12:03.604056] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-15T20:12:03.609038] [INFO ] [REMOTE ] RJF: Full fetch complete (51465 records). [2025-09-15T20:12:03.609146] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-15T20:12:03.672695] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-15T20:12:04.008232] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-15T20:12:04.008482] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-15T20:12:04.010075] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-15T20:12:04.010137] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-15T20:12:04.011760] [DEBUG] [LOCAL ] RJF: Trimmed 51465 records to 33970 (keeping 150 days of data) [2025-09-15T20:12:04.242498] [DEBUG] [LOCAL ] RJF: Primary data saved (33970 records). [2025-09-15T20:12:04.242730] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-15T20:12:04.242894] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RJF took 25.6s. Estimated remaining: 59m 35s. Rate: 9.4 symbols/min [2025-09-15T20:12:04.431698] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:04.470871] [DEBUG] [LOCAL ] RLJ: Loaded 35839 existing records from primary storage. [2025-09-15T20:12:04.471122] [INFO ] [MAIN ] RLJ: Loaded 35839 existing records. [2025-09-15T20:12:04.676969] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:04.677368] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-15T20:12:04.677420] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-15T20:12:04.678253] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-15T20:12:04.678313] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-15T20:12:05.064919] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:05.065367] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-15T20:12:05.293577] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-15T20:12:05.300311] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-15T20:12:05.422288] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T20:12:05.904573] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (3.85 seconds). [2025-09-15T20:12:06.057834] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-15T20:12:06.226346] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T20:12:06.297656] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T20:12:06.857909] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-15T20:12:07.511977] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:12:07.657831] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-15T20:12:08.024779] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T20:12:08.457909] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-15T20:12:09.098065] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:12:09.257845] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-15T20:12:09.701680] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T20:12:10.057911] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-15T20:12:10.674520] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:12:10.857882] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-15T20:12:11.432938] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T20:12:11.657923] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-15T20:12:12.359861] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T20:12:12.457823] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-15T20:12:13.257903] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-15T20:12:13.454807] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T20:12:14.057892] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-15T20:12:14.617764] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T20:12:14.857938] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-15T20:12:15.294940] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T20:12:15.657841] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-15T20:12:15.935994] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T20:12:16.120375] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-15T20:12:16.457866] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-15T20:12:16.839901] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T20:12:17.257924] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-15T20:12:17.764561] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T20:12:18.057928] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-15T20:12:18.553541] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T20:12:18.857912] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-15T20:12:19.423188] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:12:19.657917] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-15T20:12:20.457883] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-15T20:12:20.728828] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T20:12:20.734474] [INFO ] [REMOTE ] RLI: Full fetch complete (36094 records). [2025-09-15T20:12:20.734572] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-15T20:12:21.131738] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-15T20:12:21.131870] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-15T20:12:21.132666] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-15T20:12:21.132753] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-15T20:12:21.133757] [DEBUG] [LOCAL ] RLI: Trimmed 36094 records to 24791 (keeping 150 days of data) [2025-09-15T20:12:21.150809] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-15T20:12:21.221937] [INFO ] [REMOTE ] RKT: Full fetch complete (58278 records). [2025-09-15T20:12:21.252739] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-15T20:12:21.267822] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-15T20:12:21.682854] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-15T20:12:21.684522] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-15T20:12:21.685925] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-15T20:12:21.686436] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-15T20:12:21.692334] [DEBUG] [LOCAL ] RKT: Trimmed 58278 records to 39690 (keeping 150 days of data) [2025-09-15T20:12:21.826292] [DEBUG] [LOCAL ] RLI: Primary data saved (24791 records). [2025-09-15T20:12:21.827571] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-15T20:12:21.828436] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RLI took 21.5s. Estimated remaining: 59m 32s. Rate: 9.4 symbols/min [2025-09-15T20:12:22.029010] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:22.046195] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:12:22.114343] [DEBUG] [LOCAL ] RLTY: Loaded 8084 existing records from primary storage. [2025-09-15T20:12:22.123959] [INFO ] [MAIN ] RLTY: Loaded 8084 existing records. [2025-09-15T20:12:22.123727] [INFO ] [REMOTE ] RL: Full fetch complete (45625 records). [2025-09-15T20:12:22.190490] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-15T20:12:22.435234] [DEBUG] [LOCAL ] RKT: Primary data saved (39690 records). [2025-09-15T20:12:22.485916] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-15T20:12:22.485752] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:22.486902] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RKT took 37.5s. Estimated remaining: 59m 24s. Rate: 9.4 symbols/min [2025-09-15T20:12:22.503063] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-15T20:12:22.586014] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-15T20:12:22.640677] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-15T20:12:22.655766] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-15T20:12:22.985393] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:23.335871] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-15T20:12:23.372787] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-15T20:12:23.409380] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-15T20:12:23.415143] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:23.416607] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-15T20:12:23.417366] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-15T20:12:23.464998] [DEBUG] [LOCAL ] RLX: Loaded 35814 existing records from primary storage. [2025-09-15T20:12:23.465856] [INFO ] [MAIN ] RLX: Loaded 35814 existing records. [2025-09-15T20:12:23.502544] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-15T20:12:23.546594] [DEBUG] [LOCAL ] RL: Trimmed 45625 records to 29642 (keeping 150 days of data) [2025-09-15T20:12:23.590170] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-15T20:12:23.790000] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:23.793285] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-15T20:12:23.793767] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-15T20:12:23.795182] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-15T20:12:23.795250] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-15T20:12:24.181810] [INFO ] [REMOTE ] RLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:24.184045] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-15T20:12:24.262328] [DEBUG] [LOCAL ] RL: Primary data saved (29642 records). [2025-09-15T20:12:24.262523] [INFO ] [MAIN ] RL: Full history saved. [2025-09-15T20:12:24.262634] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RL took 25.0s. Estimated remaining: 59m 16s. Rate: 9.4 symbols/min [2025-09-15T20:12:24.435765] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:24.435946] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-09-15T20:12:24.435985] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-09-15T20:12:24.436117] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-15T20:12:24.436192] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-15T20:12:24.436234] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-09-15T20:12:24.436267] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-15T20:12:24.795972] [INFO ] [REMOTE ] RM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:24.796278] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-15T20:12:24.863938] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:12:25.257914] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-15T20:12:25.525602] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T20:12:25.531749] [INFO ] [REMOTE ] RLJ: Full fetch complete (52255 records). [2025-09-15T20:12:25.531897] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-15T20:12:25.973135] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T20:12:25.973337] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-15T20:12:25.973549] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-15T20:12:25.983459] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-15T20:12:25.984389] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-15T20:12:25.993383] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:12:25.993559] [DEBUG] [LOCAL ] RLJ: Trimmed 52255 records to 35030 (keeping 150 days of data) [2025-09-15T20:12:26.003954] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T20:12:26.063495] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-15T20:12:26.215520] [DEBUG] [LOCAL ] RLJ: Primary data saved (35030 records). [2025-09-15T20:12:26.215700] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-15T20:12:26.215800] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RLJ took 22.0s. Estimated remaining: 59m 8s. Rate: 9.4 symbols/min [2025-09-15T20:12:26.385260] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:26.401904] [DEBUG] [LOCAL ] RMAX: Loaded 16702 existing records from primary storage. [2025-09-15T20:12:26.402038] [INFO ] [MAIN ] RMAX: Loaded 16702 existing records. [2025-09-15T20:12:26.586336] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:26.586716] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-15T20:12:26.586781] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-15T20:12:26.587290] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-15T20:12:26.587347] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-15T20:12:26.864377] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-15T20:12:26.956256] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:27.657905] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-15T20:12:27.918803] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T20:12:27.976610] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T20:12:28.388693] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:12:28.457902] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-15T20:12:29.257936] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-15T20:12:29.920081] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:12:30.038123] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T20:12:30.057828] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-15T20:12:30.805469] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:12:30.857863] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-15T20:12:31.610241] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:12:31.657879] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-15T20:12:32.433161] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T20:12:32.457824] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-15T20:12:33.206156] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:12:33.257849] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-15T20:12:34.057902] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-15T20:12:34.613073] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:12:34.849102] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T20:12:34.858014] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-15T20:12:35.657879] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-15T20:12:36.189582] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T20:12:36.457909] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-15T20:12:36.502533] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T20:12:37.257898] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-15T20:12:37.384413] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T20:12:37.932029] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T20:12:37.933687] [INFO ] [REMOTE ] RLTY: Full fetch complete (12971 records). [2025-09-15T20:12:37.933757] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-15T20:12:38.072893] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-15T20:12:38.294705] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-15T20:12:38.294789] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-15T20:12:38.295105] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-15T20:12:38.295143] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-15T20:12:38.295611] [DEBUG] [LOCAL ] RLTY: Trimmed 12971 records to 7881 (keeping 150 days of data) [2025-09-15T20:12:38.349917] [DEBUG] [LOCAL ] RLTY: Primary data saved (7881 records). [2025-09-15T20:12:38.350139] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-15T20:12:38.350275] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RLTY took 16.5s. Estimated remaining: 59m 4s. Rate: 9.4 symbols/min [2025-09-15T20:12:38.517354] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:38.561517] [DEBUG] [LOCAL ] RMD: Loaded 31549 existing records from primary storage. [2025-09-15T20:12:38.561678] [INFO ] [MAIN ] RMD: Loaded 31549 existing records. [2025-09-15T20:12:38.734464] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:38.734797] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-15T20:12:38.734863] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-15T20:12:38.735725] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-15T20:12:38.735784] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-15T20:12:38.862479] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-15T20:12:39.093554] [INFO ] [REMOTE ] RMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:39.177742] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T20:12:39.657894] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-15T20:12:39.673184] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T20:12:40.457882] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-15T20:12:41.231144] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:12:41.257810] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-15T20:12:41.850398] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T20:12:42.057875] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-15T20:12:42.857907] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-15T20:12:43.020529] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T20:12:43.508513] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:12:43.528950] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:12:43.657865] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-15T20:12:44.457908] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-15T20:12:45.182334] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T20:12:45.267271] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-15T20:12:45.290459] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T20:12:46.032743] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T20:12:46.057829] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-15T20:12:46.731587] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T20:12:46.732986] [INFO ] [REMOTE ] RM: Full fetch complete (8395 records). [2025-09-15T20:12:46.733054] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-15T20:12:46.863018] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-15T20:12:47.100145] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-15T20:12:47.100232] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-15T20:12:47.100461] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-15T20:12:47.100501] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-15T20:12:47.101018] [DEBUG] [LOCAL ] RM: Trimmed 8395 records to 5576 (keeping 150 days of data) [2025-09-15T20:12:47.138797] [DEBUG] [LOCAL ] RM: Primary data saved (5576 records). [2025-09-15T20:12:47.138951] [INFO ] [MAIN ] RM: Full history saved. [2025-09-15T20:12:47.139033] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RM took 22.9s. Estimated remaining: 58m 58s. Rate: 9.4 symbols/min [2025-09-15T20:12:47.313860] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:47.320486] [DEBUG] [LOCAL ] RMI: Loaded 3564 existing records from primary storage. [2025-09-15T20:12:47.320618] [INFO ] [MAIN ] RMI: Loaded 3564 existing records. [2025-09-15T20:12:47.506387] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:47.506639] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-15T20:12:47.506707] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-15T20:12:47.506983] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-15T20:12:47.507031] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-15T20:12:47.659423] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-15T20:12:47.871865] [INFO ] [REMOTE ] RMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:48.457844] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-15T20:12:48.489675] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T20:12:48.495165] [INFO ] [REMOTE ] RLX: Full fetch complete (52242 records). [2025-09-15T20:12:48.495256] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-15T20:12:48.824508] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T20:12:48.904848] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-15T20:12:48.905027] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T20:12:48.905207] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-15T20:12:48.907481] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-15T20:12:48.907530] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-15T20:12:48.908768] [DEBUG] [LOCAL ] RLX: Trimmed 52242 records to 35046 (keeping 150 days of data) [2025-09-15T20:12:49.130259] [DEBUG] [LOCAL ] RLX: Primary data saved (35046 records). [2025-09-15T20:12:49.130418] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-15T20:12:49.130516] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RLX took 26.6s. Estimated remaining: 58m 50s. Rate: 9.4 symbols/min [2025-09-15T20:12:49.263186] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-15T20:12:49.319870] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:12:49.331309] [DEBUG] [LOCAL ] RMM: Loaded 7621 existing records from primary storage. [2025-09-15T20:12:49.331542] [INFO ] [MAIN ] RMM: Loaded 7621 existing records. [2025-09-15T20:12:49.517831] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:12:49.518272] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-15T20:12:49.518326] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-15T20:12:49.518812] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-15T20:12:49.518868] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-15T20:12:49.804817] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T20:12:49.886378] [INFO ] [REMOTE ] RMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:12:50.057925] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-15T20:12:50.761540] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:12:50.857882] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-15T20:12:51.330376] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T20:12:51.657877] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-15T20:12:52.457899] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-15T20:12:52.575957] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T20:12:53.257908] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-15T20:12:53.780134] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:12:53.817854] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T20:12:54.057865] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-15T20:12:54.586601] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T20:12:54.857936] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-15T20:12:55.420118] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T20:12:55.657884] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-15T20:12:56.457920] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-15T20:12:57.086332] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T20:12:57.141282] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:12:57.257889] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-15T20:12:58.057879] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-15T20:12:58.772902] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T20:12:58.811234] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:12:58.857832] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-15T20:12:59.657896] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-15T20:13:00.212045] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T20:13:00.215605] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T20:13:00.457932] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-15T20:13:01.257934] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-15T20:13:01.933639] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T20:13:02.010319] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T20:13:02.015627] [INFO ] [REMOTE ] RMD: Full fetch complete (46240 records). [2025-09-15T20:13:02.015848] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-15T20:13:02.063034] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-15T20:13:02.404303] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-15T20:13:02.404427] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-15T20:13:02.405368] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-15T20:13:02.405417] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-15T20:13:02.406725] [DEBUG] [LOCAL ] RMD: Trimmed 46240 records to 30817 (keeping 150 days of data) [2025-09-15T20:13:02.614276] [DEBUG] [LOCAL ] RMD: Primary data saved (30817 records). [2025-09-15T20:13:02.614472] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-15T20:13:02.616116] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMD took 24.3s. Estimated remaining: 58m 46s. Rate: 9.4 symbols/min [2025-09-15T20:13:02.800942] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T20:13:02.802852] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:02.812316] [DEBUG] [LOCAL ] RMMZ: Loaded 3746 existing records from primary storage. [2025-09-15T20:13:02.812464] [INFO ] [MAIN ] RMMZ: Loaded 3746 existing records. [2025-09-15T20:13:02.865056] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-15T20:13:02.996397] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:02.996727] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-15T20:13:02.996781] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-15T20:13:02.997011] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-15T20:13:02.997079] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-15T20:13:03.347010] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:03.645722] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T20:13:03.647468] [INFO ] [REMOTE ] RMI: Full fetch complete (4764 records). [2025-09-15T20:13:03.647553] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-15T20:13:03.662990] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-15T20:13:04.022036] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-15T20:13:04.022127] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-15T20:13:04.022296] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-15T20:13:04.022341] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-15T20:13:04.022768] [DEBUG] [LOCAL ] RMI: Trimmed 4764 records to 3512 (keeping 150 days of data) [2025-09-15T20:13:04.046853] [DEBUG] [LOCAL ] RMI: Primary data saved (3512 records). [2025-09-15T20:13:04.047070] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-15T20:13:04.047205] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMI took 16.9s. Estimated remaining: 58m 38s. Rate: 9.4 symbols/min [2025-09-15T20:13:04.231132] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:04.247207] [DEBUG] [LOCAL ] RMT: Loaded 12915 existing records from primary storage. [2025-09-15T20:13:04.247420] [INFO ] [MAIN ] RMT: Loaded 12915 existing records. [2025-09-15T20:13:04.430976] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:04.431399] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-15T20:13:04.431467] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-15T20:13:04.440173] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-15T20:13:04.440291] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-15T20:13:04.463054] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-15T20:13:04.464135] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T20:13:04.798993] [INFO ] [REMOTE ] RMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:05.257877] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-15T20:13:05.844397] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T20:13:05.858754] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T20:13:06.057880] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-15T20:13:06.827508] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T20:13:06.857830] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-15T20:13:07.657883] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-15T20:13:07.872966] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T20:13:08.121620] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T20:13:08.457855] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-15T20:13:08.907178] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:13:09.257898] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-15T20:13:09.729600] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T20:13:10.057903] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-15T20:13:10.857887] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-15T20:13:10.890172] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T20:13:10.892406] [INFO ] [REMOTE ] RMM: Full fetch complete (10872 records). [2025-09-15T20:13:10.892481] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-15T20:13:11.289495] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-15T20:13:11.289589] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-15T20:13:11.289942] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-15T20:13:11.289987] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-15T20:13:11.290470] [DEBUG] [LOCAL ] RMM: Trimmed 10872 records to 7506 (keeping 150 days of data) [2025-09-15T20:13:11.338605] [DEBUG] [LOCAL ] RMM: Primary data saved (7506 records). [2025-09-15T20:13:11.338775] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-15T20:13:11.338865] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMM took 22.2s. Estimated remaining: 58m 32s. Rate: 9.4 symbols/min [2025-09-15T20:13:11.525167] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:11.560706] [DEBUG] [LOCAL ] RNG: Loaded 35802 existing records from primary storage. [2025-09-15T20:13:11.560858] [INFO ] [MAIN ] RNG: Loaded 35802 existing records. [2025-09-15T20:13:11.660958] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-15T20:13:11.738451] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:11.738731] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-15T20:13:11.738794] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-15T20:13:11.739668] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-15T20:13:11.739730] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-15T20:13:11.873007] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T20:13:11.916932] [INFO ] [REMOTE ] RMAX: Full fetch complete (23153 records). [2025-09-15T20:13:11.928599] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-15T20:13:12.150441] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T20:13:12.408768] [INFO ] [REMOTE ] RNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:12.462939] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-15T20:13:12.532458] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-15T20:13:12.532542] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-15T20:13:12.533085] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-15T20:13:12.533131] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-15T20:13:12.533875] [DEBUG] [LOCAL ] RMAX: Trimmed 23153 records to 16511 (keeping 150 days of data) [2025-09-15T20:13:12.630362] [DEBUG] [LOCAL ] RMAX: Primary data saved (16511 records). [2025-09-15T20:13:12.630524] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-15T20:13:12.630636] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RMAX took 46.4s. Estimated remaining: 58m 24s. Rate: 9.4 symbols/min [2025-09-15T20:13:12.803374] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:12.825980] [DEBUG] [LOCAL ] RNGR: Loaded 15606 existing records from primary storage. [2025-09-15T20:13:12.826167] [INFO ] [MAIN ] RNGR: Loaded 15606 existing records. [2025-09-15T20:13:13.004290] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:13.004598] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-15T20:13:13.004661] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-15T20:13:13.005414] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-15T20:13:13.005462] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-15T20:13:13.264046] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-15T20:13:13.376538] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:13.770449] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T20:13:14.057890] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-15T20:13:14.306213] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T20:13:14.862715] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-15T20:13:14.866072] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T20:13:15.657881] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-15T20:13:15.963007] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T20:13:16.457860] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-15T20:13:16.774819] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T20:13:17.222153] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:13:17.257870] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-15T20:13:18.057891] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-15T20:13:18.725635] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:13:18.806308] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:13:18.857876] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-15T20:13:19.657896] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-15T20:13:20.087093] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T20:13:20.240904] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:13:20.457864] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-15T20:13:20.845037] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T20:13:21.257880] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-15T20:13:22.057919] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-15T20:13:22.216477] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T20:13:22.596111] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T20:13:22.597505] [INFO ] [REMOTE ] RMMZ: Full fetch complete (5093 records). [2025-09-15T20:13:22.597590] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-15T20:13:22.863067] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-15T20:13:22.976690] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-15T20:13:22.976840] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-15T20:13:22.977043] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-15T20:13:22.977106] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-15T20:13:22.977542] [DEBUG] [LOCAL ] RMMZ: Trimmed 5093 records to 3661 (keeping 150 days of data) [2025-09-15T20:13:23.002090] [DEBUG] [LOCAL ] RMMZ: Primary data saved (3661 records). [2025-09-15T20:13:23.002231] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-15T20:13:23.002331] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RMMZ took 20.4s. Estimated remaining: 58m 19s. Rate: 9.4 symbols/min [2025-09-15T20:13:23.176042] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:23.188946] [DEBUG] [LOCAL ] RNP: Loaded 11789 existing records from primary storage. [2025-09-15T20:13:23.189067] [INFO ] [MAIN ] RNP: Loaded 11789 existing records. [2025-09-15T20:13:23.361821] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:23.362088] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-15T20:13:23.362140] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-15T20:13:23.362697] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-15T20:13:23.362749] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-15T20:13:23.663127] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-15T20:13:23.724636] [INFO ] [REMOTE ] RNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:23.816577] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T20:13:24.457892] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-15T20:13:24.966595] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:13:25.096323] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T20:13:25.257909] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-15T20:13:25.831744] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T20:13:26.057941] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-15T20:13:26.857885] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-15T20:13:27.033297] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T20:13:27.593783] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T20:13:27.657956] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-15T20:13:28.457862] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-15T20:13:28.627844] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:13:29.257874] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-15T20:13:29.818391] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T20:13:30.057891] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-15T20:13:30.394706] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T20:13:30.618048] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T20:13:30.857898] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-15T20:13:31.657864] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-15T20:13:31.998387] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T20:13:32.457905] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-15T20:13:32.561116] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:13:33.257911] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-15T20:13:33.393452] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:13:34.057861] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-15T20:13:34.217870] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T20:13:34.691355] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T20:13:34.693919] [INFO ] [REMOTE ] RMT: Full fetch complete (19198 records). [2025-09-15T20:13:34.694020] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-15T20:13:34.874848] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-15T20:13:35.064463] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-15T20:13:35.064543] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-15T20:13:35.064963] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-15T20:13:35.065006] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-15T20:13:35.065590] [DEBUG] [LOCAL ] RMT: Trimmed 19198 records to 12619 (keeping 150 days of data) [2025-09-15T20:13:35.142809] [DEBUG] [LOCAL ] RMT: Primary data saved (12619 records). [2025-09-15T20:13:35.142952] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-15T20:13:35.143109] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RMT took 31.1s. Estimated remaining: 58m 14s. Rate: 9.4 symbols/min [2025-09-15T20:13:35.343847] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:35.368861] [DEBUG] [LOCAL ] RNR: Loaded 25420 existing records from primary storage. [2025-09-15T20:13:35.368998] [INFO ] [MAIN ] RNR: Loaded 25420 existing records. [2025-09-15T20:13:35.552322] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:35.552578] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-15T20:13:35.552626] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-15T20:13:35.553254] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-15T20:13:35.553306] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-15T20:13:35.662910] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-15T20:13:35.906514] [INFO ] [REMOTE ] RNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:35.971816] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T20:13:35.974041] [INFO ] [REMOTE ] RNGR: Full fetch complete (21479 records). [2025-09-15T20:13:35.974112] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-15T20:13:36.369418] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-15T20:13:36.369535] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-15T20:13:36.370585] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-15T20:13:36.370660] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-15T20:13:36.371622] [DEBUG] [LOCAL ] RNGR: Trimmed 21479 records to 15569 (keeping 150 days of data) [2025-09-15T20:13:36.462469] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-15T20:13:36.481098] [DEBUG] [LOCAL ] RNGR: Primary data saved (15569 records). [2025-09-15T20:13:36.481355] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-15T20:13:36.481505] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNGR took 23.9s. Estimated remaining: 58m 6s. Rate: 9.4 symbols/min [2025-09-15T20:13:36.669019] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:36.684321] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T20:13:36.718099] [DEBUG] [LOCAL ] RNST: Loaded 27088 existing records from primary storage. [2025-09-15T20:13:36.718318] [INFO ] [MAIN ] RNST: Loaded 27088 existing records. [2025-09-15T20:13:36.905345] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:36.905698] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-15T20:13:36.905754] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-15T20:13:36.906623] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-15T20:13:36.906702] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-15T20:13:37.266471] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-15T20:13:37.271099] [INFO ] [REMOTE ] RNST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:38.059063] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-15T20:13:38.065195] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T20:13:38.199733] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T20:13:38.857968] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-15T20:13:39.535480] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:13:39.657869] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-15T20:13:40.054803] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T20:13:40.060361] [INFO ] [REMOTE ] RNG: Full fetch complete (52500 records). [2025-09-15T20:13:40.060492] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-15T20:13:40.464761] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-15T20:13:40.469074] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-15T20:13:40.469152] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-15T20:13:40.470301] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-15T20:13:40.470445] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-15T20:13:40.471781] [DEBUG] [LOCAL ] RNG: Trimmed 52500 records to 35080 (keeping 150 days of data) [2025-09-15T20:13:40.685016] [DEBUG] [LOCAL ] RNG: Primary data saved (35080 records). [2025-09-15T20:13:40.685173] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-15T20:13:40.685801] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. RNG took 29.3s. Estimated remaining: 57m 59s. Rate: 9.4 symbols/min [2025-09-15T20:13:40.856024] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:40.875401] [DEBUG] [LOCAL ] ROG: Loaded 17081 existing records from primary storage. [2025-09-15T20:13:40.875540] [INFO ] [MAIN ] ROG: Loaded 17081 existing records. [2025-09-15T20:13:41.053368] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:13:41.092486] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:41.094059] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-15T20:13:41.094131] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-15T20:13:41.094679] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-15T20:13:41.094737] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-15T20:13:41.264043] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-15T20:13:41.465560] [INFO ] [REMOTE ] ROG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:41.483368] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T20:13:41.485517] [INFO ] [REMOTE ] RNP: Full fetch complete (17304 records). [2025-09-15T20:13:41.485588] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-15T20:13:41.850689] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-15T20:13:41.850771] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-15T20:13:41.851134] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-15T20:13:41.851174] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-15T20:13:41.851713] [DEBUG] [LOCAL ] RNP: Trimmed 17304 records to 11608 (keeping 150 days of data) [2025-09-15T20:13:41.931511] [DEBUG] [LOCAL ] RNP: Primary data saved (11608 records). [2025-09-15T20:13:41.931704] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-15T20:13:41.931804] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. RNP took 18.9s. Estimated remaining: 57m 52s. Rate: 9.4 symbols/min [2025-09-15T20:13:42.063024] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-15T20:13:42.113237] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:42.149851] [DEBUG] [LOCAL ] ROK: Loaded 32763 existing records from primary storage. [2025-09-15T20:13:42.150038] [INFO ] [MAIN ] ROK: Loaded 32763 existing records. [2025-09-15T20:13:42.326007] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:42.326272] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-15T20:13:42.326321] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-15T20:13:42.327099] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-15T20:13:42.327151] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-15T20:13:42.687619] [INFO ] [REMOTE ] ROK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:42.710948] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:13:42.857911] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-15T20:13:43.084951] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T20:13:43.657886] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-15T20:13:43.952389] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T20:13:44.457928] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-15T20:13:44.826567] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T20:13:45.257998] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-15T20:13:46.057887] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-15T20:13:46.113589] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T20:13:46.156369] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:13:46.857976] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-15T20:13:47.390468] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:13:47.657875] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-15T20:13:47.915027] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T20:13:48.457946] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-15T20:13:48.729977] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T20:13:49.257874] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-15T20:13:49.975663] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T20:13:50.006473] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:13:50.057887] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-15T20:13:50.857945] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-15T20:13:51.603241] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:13:51.657906] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-15T20:13:51.769941] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T20:13:52.439619] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:13:52.457826] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-15T20:13:53.257947] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-15T20:13:53.448443] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:13:54.057875] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-15T20:13:54.610078] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:13:54.857875] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-15T20:13:55.595555] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T20:13:55.657901] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-15T20:13:56.406835] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:13:56.449039] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T20:13:56.451906] [INFO ] [REMOTE ] ROG: Full fetch complete (25188 records). [2025-09-15T20:13:56.452041] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-15T20:13:56.463413] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-15T20:13:56.823856] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-15T20:13:56.823935] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-15T20:13:56.824510] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-15T20:13:56.824567] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-15T20:13:56.825292] [DEBUG] [LOCAL ] ROG: Trimmed 25188 records to 16384 (keeping 150 days of data) [2025-09-15T20:13:56.925402] [DEBUG] [LOCAL ] ROG: Primary data saved (16384 records). [2025-09-15T20:13:56.925559] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-15T20:13:56.925668] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. ROG took 16.2s. Estimated remaining: 57m 48s. Rate: 9.4 symbols/min [2025-09-15T20:13:57.102018] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:57.147047] [DEBUG] [LOCAL ] ROL: Loaded 37448 existing records from primary storage. [2025-09-15T20:13:57.147196] [INFO ] [MAIN ] ROL: Loaded 37448 existing records. [2025-09-15T20:13:57.263146] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-15T20:13:57.324584] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:57.324927] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-15T20:13:57.324979] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-15T20:13:57.325892] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-15T20:13:57.325943] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-15T20:13:57.674357] [INFO ] [REMOTE ] ROL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:13:57.695807] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T20:13:58.057868] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-15T20:13:58.782511] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T20:13:58.857843] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-15T20:13:59.047251] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T20:13:59.051148] [INFO ] [REMOTE ] RNST: Full fetch complete (40493 records). [2025-09-15T20:13:59.051225] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-15T20:13:59.424071] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-15T20:13:59.424172] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-15T20:13:59.425156] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-15T20:13:59.425208] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-15T20:13:59.426380] [DEBUG] [LOCAL ] RNST: Trimmed 40493 records to 26356 (keeping 150 days of data) [2025-09-15T20:13:59.585103] [DEBUG] [LOCAL ] RNST: Primary data saved (26356 records). [2025-09-15T20:13:59.585267] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-15T20:13:59.585393] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. RNST took 23.1s. Estimated remaining: 57m 40s. Rate: 9.4 symbols/min [2025-09-15T20:13:59.663759] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-15T20:13:59.762469] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:13:59.796989] [DEBUG] [LOCAL ] RPM: Loaded 31152 existing records from primary storage. [2025-09-15T20:13:59.797144] [INFO ] [MAIN ] RPM: Loaded 31152 existing records. [2025-09-15T20:13:59.970270] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:13:59.970592] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-15T20:13:59.970683] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-15T20:13:59.971478] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-15T20:13:59.971542] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-15T20:14:00.327732] [INFO ] [REMOTE ] RPM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:00.457881] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-15T20:14:00.502155] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:14:01.198028] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T20:14:01.257866] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-15T20:14:01.651092] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:14:02.057929] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-15T20:14:02.857900] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-15T20:14:03.021306] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T20:14:03.278255] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:14:03.657950] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-15T20:14:04.065596] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T20:14:04.457933] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-15T20:14:04.802068] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T20:14:05.257890] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-15T20:14:05.797554] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T20:14:06.057922] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-15T20:14:06.512980] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T20:14:06.857893] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-15T20:14:07.528663] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:14:07.657828] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-15T20:14:08.391509] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:14:08.395965] [INFO ] [REMOTE ] ROK: Full fetch complete (48077 records). [2025-09-15T20:14:08.396079] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-15T20:14:08.463134] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-15T20:14:08.776157] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-15T20:14:08.776240] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-15T20:14:08.777093] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-15T20:14:08.777135] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-15T20:14:08.778130] [DEBUG] [LOCAL ] ROK: Trimmed 48077 records to 32014 (keeping 150 days of data) [2025-09-15T20:14:08.995199] [DEBUG] [LOCAL ] ROK: Primary data saved (32014 records). [2025-09-15T20:14:08.995446] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-15T20:14:08.996371] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. ROK took 27.1s. Estimated remaining: 57m 35s. Rate: 9.4 symbols/min [2025-09-15T20:14:09.180085] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:09.211314] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T20:14:09.235091] [DEBUG] [LOCAL ] RPT: Loaded 14770 existing records from primary storage. [2025-09-15T20:14:09.235310] [INFO ] [MAIN ] RPT: Loaded 14770 existing records. [2025-09-15T20:14:09.266253] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-15T20:14:09.420733] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:09.421538] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-15T20:14:09.421594] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-15T20:14:09.422161] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-15T20:14:09.422221] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-15T20:14:09.783933] [INFO ] [REMOTE ] RPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:09.925952] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T20:14:10.057862] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-15T20:14:10.550994] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:14:10.857881] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-15T20:14:11.528684] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:14:11.573490] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T20:14:11.657842] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-15T20:14:12.457914] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-15T20:14:12.686161] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T20:14:13.257890] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-15T20:14:13.858426] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T20:14:14.057905] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-15T20:14:14.251200] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:14:14.857946] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-15T20:14:15.657866] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-15T20:14:15.802333] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T20:14:15.850196] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T20:14:16.457923] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-15T20:14:16.791150] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T20:14:16.794958] [INFO ] [REMOTE ] RNR: Full fetch complete (38256 records). [2025-09-15T20:14:16.795037] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-15T20:14:17.168152] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-15T20:14:17.168246] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-15T20:14:17.169020] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-15T20:14:17.169074] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-15T20:14:17.170859] [DEBUG] [LOCAL ] RNR: Trimmed 38256 records to 25005 (keeping 150 days of data) [2025-09-15T20:14:17.272675] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-15T20:14:17.342184] [DEBUG] [LOCAL ] RNR: Primary data saved (25005 records). [2025-09-15T20:14:17.342314] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-15T20:14:17.342427] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. RNR took 42.2s. Estimated remaining: 57m 29s. Rate: 9.4 symbols/min [2025-09-15T20:14:17.509149] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:17.531085] [DEBUG] [LOCAL ] RQI: Loaded 21324 existing records from primary storage. [2025-09-15T20:14:17.531205] [INFO ] [MAIN ] RQI: Loaded 21324 existing records. [2025-09-15T20:14:17.734280] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:17.734668] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-15T20:14:17.734725] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-15T20:14:17.735376] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-15T20:14:17.735431] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-15T20:14:18.062112] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-15T20:14:18.103750] [INFO ] [REMOTE ] RQI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:18.135745] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T20:14:18.238857] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:14:18.857866] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-15T20:14:19.528374] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:14:19.657872] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-15T20:14:19.745143] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T20:14:20.457928] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-15T20:14:21.003747] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T20:14:21.257938] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-15T20:14:21.655106] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T20:14:22.057943] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-15T20:14:22.132899] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T20:14:22.857933] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-15T20:14:23.461918] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:14:23.467305] [INFO ] [REMOTE ] ROL: Full fetch complete (54731 records). [2025-09-15T20:14:23.467392] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-15T20:14:23.667548] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-15T20:14:23.848685] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-15T20:14:23.848806] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-15T20:14:23.849794] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-15T20:14:23.849852] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-15T20:14:23.868455] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T20:14:23.875211] [DEBUG] [LOCAL ] ROL: Trimmed 54731 records to 36702 (keeping 150 days of data) [2025-09-15T20:14:24.116685] [DEBUG] [LOCAL ] ROL: Primary data saved (36702 records). [2025-09-15T20:14:24.116870] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-15T20:14:24.117441] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. ROL took 27.2s. Estimated remaining: 57m 23s. Rate: 9.4 symbols/min [2025-09-15T20:14:24.291088] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:24.333336] [DEBUG] [LOCAL ] RRC: Loaded 39706 existing records from primary storage. [2025-09-15T20:14:24.333481] [INFO ] [MAIN ] RRC: Loaded 39706 existing records. [2025-09-15T20:14:24.473421] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-15T20:14:24.511894] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:24.512128] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-15T20:14:24.512175] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-15T20:14:24.513056] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-15T20:14:24.513109] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-15T20:14:24.838374] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T20:14:24.930105] [INFO ] [REMOTE ] RRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:25.257890] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-15T20:14:25.815924] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:14:25.820585] [INFO ] [REMOTE ] RPM: Full fetch complete (44509 records). [2025-09-15T20:14:25.820711] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-15T20:14:26.062980] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-15T20:14:26.209725] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-15T20:14:26.209914] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-15T20:14:26.210780] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-15T20:14:26.210887] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-15T20:14:26.236090] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T20:14:26.244692] [DEBUG] [LOCAL ] RPM: Trimmed 44509 records to 30551 (keeping 150 days of data) [2025-09-15T20:14:26.463962] [DEBUG] [LOCAL ] RPM: Primary data saved (30551 records). [2025-09-15T20:14:26.464139] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-15T20:14:26.464281] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. RPM took 26.9s. Estimated remaining: 57m 15s. Rate: 9.4 symbols/min [2025-09-15T20:14:26.642619] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:26.680600] [DEBUG] [LOCAL ] RRX: Loaded 30539 existing records from primary storage. [2025-09-15T20:14:26.680936] [INFO ] [MAIN ] RRX: Loaded 30539 existing records. [2025-09-15T20:14:26.869322] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-15T20:14:26.880800] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:26.894761] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-15T20:14:26.896314] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-15T20:14:26.896077] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T20:14:26.898124] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-15T20:14:26.901348] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-15T20:14:27.255456] [INFO ] [REMOTE ] RRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:27.657869] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-15T20:14:27.814935] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T20:14:28.457908] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-15T20:14:29.137873] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:14:29.257870] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-15T20:14:29.618889] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T20:14:30.057926] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-15T20:14:30.857951] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-15T20:14:31.035855] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T20:14:31.363677] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T20:14:31.657878] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-15T20:14:31.716247] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T20:14:31.718661] [INFO ] [REMOTE ] RPT: Full fetch complete (21322 records). [2025-09-15T20:14:31.718748] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-15T20:14:32.081419] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-15T20:14:32.081495] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-15T20:14:32.081944] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-15T20:14:32.081999] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-15T20:14:32.082668] [DEBUG] [LOCAL ] RPT: Trimmed 21322 records to 14420 (keeping 150 days of data) [2025-09-15T20:14:32.172965] [DEBUG] [LOCAL ] RPT: Primary data saved (14420 records). [2025-09-15T20:14:32.173094] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-15T20:14:32.173193] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RPT took 23.2s. Estimated remaining: 57m 9s. Rate: 9.4 symbols/min [2025-09-15T20:14:32.341868] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:32.360885] [DEBUG] [LOCAL ] RS: Loaded 18263 existing records from primary storage. [2025-09-15T20:14:32.361075] [INFO ] [MAIN ] RS: Loaded 18263 existing records. [2025-09-15T20:14:32.460258] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-15T20:14:32.537379] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:32.537567] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-15T20:14:32.537619] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-15T20:14:32.538213] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-15T20:14:32.538262] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-15T20:14:32.889106] [INFO ] [REMOTE ] RS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:32.900540] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T20:14:32.904283] [INFO ] [REMOTE ] RQI: Full fetch complete (31470 records). [2025-09-15T20:14:32.904387] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-15T20:14:33.263163] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-15T20:14:33.277115] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-15T20:14:33.277262] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-15T20:14:33.278831] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-15T20:14:33.279002] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-15T20:14:33.280242] [DEBUG] [LOCAL ] RQI: Trimmed 31470 records to 20791 (keeping 150 days of data) [2025-09-15T20:14:33.428759] [DEBUG] [LOCAL ] RQI: Primary data saved (20791 records). [2025-09-15T20:14:33.428944] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-15T20:14:33.429066] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RQI took 16.1s. Estimated remaining: 57m 1s. Rate: 9.4 symbols/min [2025-09-15T20:14:33.609690] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:33.616457] [DEBUG] [LOCAL ] RSF: Loaded 3410 existing records from primary storage. [2025-09-15T20:14:33.616595] [INFO ] [MAIN ] RSF: Loaded 3410 existing records. [2025-09-15T20:14:33.798035] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:33.798536] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-15T20:14:33.798705] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-15T20:14:33.799029] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-15T20:14:33.799124] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-15T20:14:34.068293] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-15T20:14:34.192169] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:14:34.216745] [INFO ] [REMOTE ] RSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:34.708876] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:14:34.857919] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-15T20:14:35.395065] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T20:14:35.663767] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-15T20:14:35.683775] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:14:36.457862] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-15T20:14:36.975357] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T20:14:37.257917] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-15T20:14:38.057929] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-15T20:14:38.130221] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:14:38.317327] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T20:14:38.387046] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-15T20:14:38.857896] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-15T20:14:39.657869] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-15T20:14:40.457875] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-15T20:14:40.506547] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:14:40.508611] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T20:14:41.257871] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-15T20:14:41.832955] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:14:42.057896] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-15T20:14:42.215495] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T20:14:42.857953] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-15T20:14:43.405906] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T20:14:43.657972] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-15T20:14:44.187407] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T20:14:44.201935] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T20:14:44.457936] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-15T20:14:45.036492] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T20:14:45.257973] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-15T20:14:45.754615] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T20:14:46.057906] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-15T20:14:46.857882] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-15T20:14:47.303300] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T20:14:47.558216] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:14:47.657892] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-15T20:14:48.457900] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-15T20:14:49.086823] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T20:14:49.257888] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-15T20:14:49.565846] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:14:50.057873] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-15T20:14:50.844538] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:14:50.851222] [INFO ] [REMOTE ] RRC: Full fetch complete (57413 records). [2025-09-15T20:14:50.851452] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-15T20:14:50.864504] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-15T20:14:51.431856] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-15T20:14:51.432088] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-15T20:14:51.434589] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-15T20:14:51.434819] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-15T20:14:51.446529] [DEBUG] [LOCAL ] RRC: Trimmed 57413 records to 38931 (keeping 150 days of data) [2025-09-15T20:14:51.465695] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T20:14:51.681047] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T20:14:51.680370] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-15T20:14:51.695606] [INFO ] [REMOTE ] RSF: Full fetch complete (4441 records). [2025-09-15T20:14:51.732675] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-15T20:14:52.137778] [DEBUG] [LOCAL ] RRC: Primary data saved (38931 records). [2025-09-15T20:14:52.153403] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-15T20:14:52.171057] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RRC took 28.1s. Estimated remaining: 56m 58s. Rate: 9.4 symbols/min [2025-09-15T20:14:52.296738] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-15T20:14:52.322363] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-15T20:14:52.322732] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-15T20:14:52.323099] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-15T20:14:52.349993] [DEBUG] [LOCAL ] RSF: Trimmed 4441 records to 3387 (keeping 150 days of data) [2025-09-15T20:14:52.408339] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:52.418784] [DEBUG] [LOCAL ] RSF: Primary data saved (3387 records). [2025-09-15T20:14:52.419324] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-15T20:14:52.419427] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RSF took 19.0s. Estimated remaining: 56m 50s. Rate: 9.4 symbols/min [2025-09-15T20:14:52.468050] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-15T20:14:52.628542] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:52.644742] [DEBUG] [LOCAL ] RSG: Loaded 35548 existing records from primary storage. [2025-09-15T20:14:52.644925] [INFO ] [MAIN ] RSG: Loaded 35548 existing records. [2025-09-15T20:14:52.852579] [DEBUG] [LOCAL ] RSI: Loaded 34908 existing records from primary storage. [2025-09-15T20:14:52.851103] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:52.853043] [INFO ] [MAIN ] RSI: Loaded 34908 existing records. [2025-09-15T20:14:52.853217] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-15T20:14:52.858674] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-15T20:14:52.919145] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-15T20:14:52.941580] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-15T20:14:53.160460] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:53.160891] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-15T20:14:53.161008] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-15T20:14:53.166717] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-15T20:14:53.187306] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-15T20:14:53.370882] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T20:14:53.478594] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-15T20:14:53.633227] [INFO ] [REMOTE ] RSG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:53.816885] [INFO ] [REMOTE ] RSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:53.898946] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:14:54.057871] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-15T20:14:54.574334] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:14:54.857886] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-15T20:14:55.344450] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:14:55.657899] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-15T20:14:56.043953] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:14:56.457894] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-15T20:14:56.738999] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T20:14:56.741681] [INFO ] [REMOTE ] RS: Full fetch complete (28853 records). [2025-09-15T20:14:56.741754] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-15T20:14:57.118659] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-15T20:14:57.118739] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-15T20:14:57.119391] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-15T20:14:57.119432] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-15T20:14:57.120150] [DEBUG] [LOCAL ] RS: Trimmed 28853 records to 17927 (keeping 150 days of data) [2025-09-15T20:14:57.238685] [DEBUG] [LOCAL ] RS: Primary data saved (17927 records). [2025-09-15T20:14:57.238843] [INFO ] [MAIN ] RS: Full history saved. [2025-09-15T20:14:57.238927] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RS took 25.1s. Estimated remaining: 56m 43s. Rate: 9.4 symbols/min [2025-09-15T20:14:57.262965] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-15T20:14:57.409902] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:57.432849] [DEBUG] [LOCAL ] RSKD: Loaded 25033 existing records from primary storage. [2025-09-15T20:14:57.433001] [INFO ] [MAIN ] RSKD: Loaded 25033 existing records. [2025-09-15T20:14:57.606385] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:57.606630] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-15T20:14:57.606696] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-15T20:14:57.607221] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-15T20:14:57.607269] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-15T20:14:57.960295] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:14:58.057845] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-15T20:14:58.119161] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T20:14:58.555006] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:14:58.560682] [INFO ] [REMOTE ] RRX: Full fetch complete (44811 records). [2025-09-15T20:14:58.560766] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-15T20:14:58.862984] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-15T20:14:58.940772] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-15T20:14:58.940862] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-15T20:14:58.941771] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-15T20:14:58.941817] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-15T20:14:58.942742] [DEBUG] [LOCAL ] RRX: Trimmed 44811 records to 29859 (keeping 150 days of data) [2025-09-15T20:14:59.137572] [DEBUG] [LOCAL ] RRX: Primary data saved (29859 records). [2025-09-15T20:14:59.137744] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-15T20:14:59.137839] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RRX took 32.7s. Estimated remaining: 56m 35s. Rate: 9.4 symbols/min [2025-09-15T20:14:59.311298] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:14:59.327952] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T20:14:59.358543] [DEBUG] [LOCAL ] RTO: Loaded 29502 existing records from primary storage. [2025-09-15T20:14:59.358701] [INFO ] [MAIN ] RTO: Loaded 29502 existing records. [2025-09-15T20:14:59.533452] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:14:59.533723] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-15T20:14:59.533770] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-15T20:14:59.534717] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-15T20:14:59.534770] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-15T20:14:59.662930] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-15T20:14:59.888359] [INFO ] [REMOTE ] RTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:00.457858] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-15T20:15:00.715818] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T20:15:01.166593] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:15:01.257903] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-15T20:15:02.057885] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-15T20:15:02.586299] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-15T20:15:02.857854] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-15T20:15:02.927908] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:15:03.657875] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-15T20:15:04.462948] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-15T20:15:04.479842] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-15T20:15:04.828757] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T20:15:05.257850] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-15T20:15:05.707700] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T20:15:06.057949] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-15T20:15:06.337929] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-15T20:15:06.857898] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-15T20:15:06.887848] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:15:07.426041] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T20:15:07.657877] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-15T20:15:08.262380] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T20:15:08.457888] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-15T20:15:09.058276] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T20:15:09.257885] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-15T20:15:09.655016] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T20:15:10.057943] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-15T20:15:10.669620] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T20:15:10.857880] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-15T20:15:11.657885] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-15T20:15:11.861806] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T20:15:11.920573] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T20:15:12.457909] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-15T20:15:13.047417] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T20:15:13.257896] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-15T20:15:14.057952] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-15T20:15:14.244058] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T20:15:14.857977] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-15T20:15:14.979375] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T20:15:15.657899] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-15T20:15:16.457943] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-15T20:15:16.644147] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-15T20:15:17.185222] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-15T20:15:17.217523] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:15:17.257839] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-15T20:15:17.643814] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:15:17.648806] [INFO ] [REMOTE ] RSKD: Full fetch complete (36903 records). [2025-09-15T20:15:17.648966] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-15T20:15:18.049614] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-15T20:15:18.049731] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-15T20:15:18.050620] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-15T20:15:18.050683] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-15T20:15:18.051702] [DEBUG] [LOCAL ] RSKD: Trimmed 36903 records to 24745 (keeping 150 days of data) [2025-09-15T20:15:18.098834] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-15T20:15:18.194971] [DEBUG] [LOCAL ] RSKD: Primary data saved (24745 records). [2025-09-15T20:15:18.195126] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-15T20:15:18.195219] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RSKD took 21.0s. Estimated remaining: 56m 33s. Rate: 9.4 symbols/min [2025-09-15T20:15:18.656712] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:15:18.662123] [INFO ] [REMOTE ] RSG: Full fetch complete (51487 records). [2025-09-15T20:15:18.662238] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-15T20:15:18.888130] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-15T20:15:19.050688] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-15T20:15:19.050774] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-15T20:15:19.051657] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-15T20:15:19.051735] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-15T20:15:19.052875] [DEBUG] [LOCAL ] RSG: Trimmed 51487 records to 34830 (keeping 150 days of data) [2025-09-15T20:15:19.275175] [DEBUG] [LOCAL ] RSG: Primary data saved (34830 records). [2025-09-15T20:15:19.275376] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-15T20:15:19.276628] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RSG took 27.1s. Estimated remaining: 56m 25s. Rate: 9.4 symbols/min [2025-09-15T20:15:19.672033] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:15:19.677392] [INFO ] [REMOTE ] RSI: Full fetch complete (51836 records). [2025-09-15T20:15:19.677558] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-15T20:15:20.071795] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-15T20:15:20.071892] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-15T20:15:20.072898] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-15T20:15:20.072947] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-15T20:15:20.074256] [DEBUG] [LOCAL ] RSI: Trimmed 51836 records to 34276 (keeping 150 days of data) [2025-09-15T20:15:20.282630] [DEBUG] [LOCAL ] RSI: Primary data saved (34276 records). [2025-09-15T20:15:20.282806] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-15T20:15:20.282911] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RSI took 27.9s. Estimated remaining: 56m 17s. Rate: 9.4 symbols/min [2025-09-15T20:15:20.320115] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T20:15:20.328025] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-15T20:15:21.678129] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:15:21.687219] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-15T20:15:23.134933] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T20:15:23.144439] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-15T20:15:24.436969] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:15:24.443304] [INFO ] [REMOTE ] RTO: Full fetch complete (43890 records). [2025-09-15T20:15:24.443486] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-15T20:15:24.862150] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-15T20:15:24.862244] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-15T20:15:24.863180] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-15T20:15:24.863238] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-15T20:15:24.864385] [DEBUG] [LOCAL ] RTO: Trimmed 43890 records to 28955 (keeping 150 days of data) [2025-09-15T20:15:25.050989] [DEBUG] [LOCAL ] RTO: Primary data saved (28955 records). [2025-09-15T20:15:25.051158] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-15T20:15:25.051254] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RTO took 25.9s. Estimated remaining: 56m 10s. Rate: 9.4 symbols/min [2025-09-15T20:15:25.665603] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:25.701039] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:25.755734] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:25.780322] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:25.799292] [DEBUG] [LOCAL ] RVT: Loaded 19660 existing records from primary storage. [2025-09-15T20:15:25.799592] [INFO ] [MAIN ] RVT: Loaded 19660 existing records. [2025-09-15T20:15:25.981119] [DEBUG] [LOCAL ] RVLV: Loaded 35712 existing records from primary storage. [2025-09-15T20:15:26.026506] [INFO ] [MAIN ] RVLV: Loaded 35712 existing records. [2025-09-15T20:15:26.058977] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:15:26.060449] [DEBUG] [LOCAL ] RTX: Loaded 40455 existing records from primary storage. [2025-09-15T20:15:26.072054] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-15T20:15:26.059839] [DEBUG] [LOCAL ] RVTY: Loaded 35767 existing records from primary storage. [2025-09-15T20:15:26.071837] [INFO ] [MAIN ] RTX: Loaded 40455 existing records. [2025-09-15T20:15:26.081835] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-15T20:15:26.100982] [INFO ] [MAIN ] RVTY: Loaded 35767 existing records. [2025-09-15T20:15:26.152993] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-15T20:15:26.257707] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-15T20:15:26.602226] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:15:26.759382] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:15:26.775498] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-15T20:15:26.789436] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:15:26.798249] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-15T20:15:26.797880] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-15T20:15:26.806612] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-15T20:15:26.815678] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-15T20:15:26.840452] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-15T20:15:26.815603] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-15T20:15:26.855019] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-15T20:15:26.854889] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-15T20:15:26.860273] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-15T20:15:26.891542] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-15T20:15:26.980525] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-15T20:15:27.280512] [INFO ] [REMOTE ] RVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:27.402540] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-15T20:15:27.933409] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:27.944172] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-15T20:15:28.044884] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:28.067796] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-15T20:15:28.071385] [INFO ] [REMOTE ] RTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:28.072309] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-15T20:15:28.425720] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T20:15:28.430990] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-15T20:15:29.378032] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T20:15:29.387557] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-15T20:15:29.481401] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T20:15:29.490080] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-15T20:15:29.770960] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T20:15:29.777907] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-15T20:15:30.982917] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T20:15:30.993164] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-15T20:15:31.061828] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T20:15:31.068689] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-15T20:15:32.192017] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T20:15:32.197568] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-15T20:15:32.499579] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T20:15:32.510802] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-15T20:15:33.314839] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T20:15:33.320875] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-15T20:15:42.224454] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (9.71 seconds). [2025-09-15T20:15:42.234750] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-15T20:15:42.311167] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (8.99 seconds). [2025-09-15T20:15:42.318052] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-15T20:15:44.249556] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T20:15:44.259926] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-15T20:15:44.304547] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (16.23 seconds). [2025-09-15T20:15:44.321431] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-15T20:15:44.475013] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-15T20:15:44.490318] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-15T20:15:45.486370] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:15:45.490398] [INFO ] [REMOTE ] RVT: Full fetch complete (29644 records). [2025-09-15T20:15:45.490553] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-15T20:15:45.887184] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-15T20:15:45.887325] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-15T20:15:45.888007] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-15T20:15:45.888073] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-15T20:15:45.889173] [DEBUG] [LOCAL ] RVT: Trimmed 29644 records to 19314 (keeping 150 days of data) [2025-09-15T20:15:46.010336] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T20:15:46.034581] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-15T20:15:46.055217] [DEBUG] [LOCAL ] RVT: Primary data saved (19314 records). [2025-09-15T20:15:46.055539] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-15T20:15:46.055695] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RVT took 21.0s. Estimated remaining: 56m 8s. Rate: 9.4 symbols/min [2025-09-15T20:15:46.237489] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:46.269874] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T20:15:46.281250] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-15T20:15:46.313075] [DEBUG] [LOCAL ] RWT: Loaded 30008 existing records from primary storage. [2025-09-15T20:15:46.313275] [INFO ] [MAIN ] RWT: Loaded 30008 existing records. [2025-09-15T20:15:46.502461] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:15:46.502775] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-15T20:15:46.502822] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-15T20:15:46.503610] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-15T20:15:46.503695] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-15T20:15:46.851774] [INFO ] [REMOTE ] RWT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:46.852115] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-15T20:15:47.500855] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T20:15:47.511108] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-15T20:15:47.742250] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T20:15:47.749390] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-15T20:15:48.389600] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T20:15:48.402209] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-15T20:15:48.791426] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T20:15:48.800087] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-15T20:15:48.876773] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:15:48.881877] [INFO ] [REMOTE ] RVTY: Full fetch complete (51392 records). [2025-09-15T20:15:48.881969] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-15T20:15:49.263651] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-15T20:15:49.263737] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-15T20:15:49.264621] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-15T20:15:49.264680] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-15T20:15:49.265799] [DEBUG] [LOCAL ] RVTY: Trimmed 51392 records to 34959 (keeping 150 days of data) [2025-09-15T20:15:49.483943] [DEBUG] [LOCAL ] RVTY: Primary data saved (34959 records). [2025-09-15T20:15:49.484094] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-15T20:15:49.487604] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RVTY took 24.4s. Estimated remaining: 56m 1s. Rate: 9.4 symbols/min [2025-09-15T20:15:49.656106] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:49.656311] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-15T20:15:49.656351] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-15T20:15:49.656471] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-15T20:15:49.656509] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-15T20:15:49.656549] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-15T20:15:49.656581] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-15T20:15:50.009715] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:50.010018] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-15T20:15:50.267775] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (20.88 seconds). [2025-09-15T20:15:50.281695] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-15T20:15:50.313034] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-15T20:15:50.317822] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-15T20:15:50.321216] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T20:15:50.337146] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-15T20:15:50.369674] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:15:50.379931] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-15T20:15:50.615668] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-15T20:15:50.617011] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-15T20:15:50.932276] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T20:15:50.933615] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-15T20:15:51.370733] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T20:15:51.372163] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-15T20:15:51.670484] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T20:15:51.682766] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T20:15:51.683156] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-15T20:15:51.684214] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-15T20:15:51.708732] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T20:15:51.718277] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-15T20:15:52.084874] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T20:15:52.085914] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-15T20:15:52.307435] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T20:15:52.318802] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-15T20:15:52.417748] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T20:15:52.457854] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-15T20:15:52.912319] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T20:15:52.945750] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T20:15:52.947215] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T20:15:52.948277] [INFO ] [REMOTE ] RWTN: Full fetch complete (2255 records). [2025-09-15T20:15:52.955472] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-15T20:15:53.136995] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T20:15:53.137205] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:15:53.137268] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:15:53.137311] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-15T20:15:53.137369] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-15T20:15:53.137416] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-15T20:15:53.137468] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-15T20:15:53.137539] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RWTN took 3.6s. Estimated remaining: 55m 53s. Rate: 9.4 symbols/min [2025-09-15T20:15:53.263031] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-15T20:15:53.315309] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:15:53.315429] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-15T20:15:53.315469] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-15T20:15:53.315589] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-15T20:15:53.315632] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-15T20:15:53.315708] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-15T20:15:53.315744] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-15T20:15:53.690372] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:15:54.057904] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-15T20:15:54.143215] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T20:15:54.326572] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-15T20:15:54.857927] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-15T20:15:54.901418] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:15:55.657922] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-15T20:15:56.457844] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-15T20:15:56.509672] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:15:57.266871] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-15T20:15:57.272214] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:15:57.457138] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T20:15:57.698241] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T20:15:58.057905] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-15T20:15:58.857907] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-15T20:15:59.657891] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-15T20:15:59.802867] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:15:59.808796] [INFO ] [REMOTE ] RTX: Full fetch complete (58391 records). [2025-09-15T20:15:59.808911] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-15T20:16:00.133003] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T20:16:00.255237] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:16:00.255532] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-15T20:16:00.260014] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-15T20:16:00.261718] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-15T20:16:00.261952] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-15T20:16:00.262201] [INFO ] [REMOTE ] RWT: Full fetch complete (43798 records). [2025-09-15T20:16:00.262755] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-15T20:16:00.269167] [DEBUG] [LOCAL ] RTX: Trimmed 58391 records to 39675 (keeping 150 days of data) [2025-09-15T20:16:00.460920] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-15T20:16:00.787467] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-15T20:16:00.787804] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-15T20:16:00.789138] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-15T20:16:00.789209] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-15T20:16:00.810138] [DEBUG] [LOCAL ] RWT: Trimmed 43798 records to 29329 (keeping 150 days of data) [2025-09-15T20:16:01.069450] [DEBUG] [LOCAL ] RTX: Primary data saved (39675 records). [2025-09-15T20:16:01.070387] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-15T20:16:01.070763] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RTX took 36.0s. Estimated remaining: 55m 48s. Rate: 9.4 symbols/min [2025-09-15T20:16:01.259973] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:01.260089] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-15T20:16:01.307332] [DEBUG] [LOCAL ] RWTP: Loaded 2038 existing records from primary storage. [2025-09-15T20:16:01.308024] [INFO ] [MAIN ] RWTP: Loaded 2038 existing records. [2025-09-15T20:16:01.504543] [WARN ] [MAIN ] RWTP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:01.506765] [DEBUG] [LOCAL ] RWT: Primary data saved (29329 records). [2025-09-15T20:16:01.507013] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-15T20:16:01.507052] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-15T20:16:01.507124] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-15T20:16:01.507195] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RWT took 15.5s. Estimated remaining: 55m 39s. Rate: 9.4 symbols/min [2025-09-15T20:16:01.539105] [DEBUG] [LOCAL ] RWTP: Deleted primary data file. [2025-09-15T20:16:01.571956] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-15T20:16:01.836372] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:01.862269] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T20:16:02.068895] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-15T20:16:02.074753] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:02.107886] [DEBUG] [LOCAL ] RXO: Loaded 35965 existing records from primary storage. [2025-09-15T20:16:02.108127] [INFO ] [MAIN ] RXO: Loaded 35965 existing records. [2025-09-15T20:16:02.306406] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:02.306919] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-15T20:16:02.307115] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-15T20:16:02.308351] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-15T20:16:02.308678] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-15T20:16:02.510587] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T20:16:02.740962] [INFO ] [REMOTE ] RXO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:02.857893] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-15T20:16:03.506558] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T20:16:03.657924] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-15T20:16:04.457904] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-15T20:16:05.257944] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-15T20:16:05.329532] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T20:16:05.886966] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T20:16:06.057936] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-15T20:16:06.857931] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-15T20:16:07.458437] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:16:07.463877] [INFO ] [REMOTE ] RVLV: Full fetch complete (52209 records). [2025-09-15T20:16:07.464022] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-15T20:16:07.587348] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T20:16:07.668383] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-15T20:16:07.867739] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-15T20:16:07.867856] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-15T20:16:07.868961] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-15T20:16:07.869033] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-15T20:16:07.870453] [DEBUG] [LOCAL ] RVLV: Trimmed 52209 records to 35067 (keeping 150 days of data) [2025-09-15T20:16:08.086819] [DEBUG] [LOCAL ] RVLV: Primary data saved (35067 records). [2025-09-15T20:16:08.086985] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-15T20:16:08.087475] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RVLV took 43.0s. Estimated remaining: 55m 33s. Rate: 9.4 symbols/min [2025-09-15T20:16:08.264919] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:08.310393] [DEBUG] [LOCAL ] RY: Loaded 35706 existing records from primary storage. [2025-09-15T20:16:08.310613] [INFO ] [MAIN ] RY: Loaded 35706 existing records. [2025-09-15T20:16:08.502824] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:08.503157] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-15T20:16:08.503205] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-15T20:16:08.504212] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-15T20:16:08.504268] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-15T20:16:08.860042] [INFO ] [REMOTE ] RY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:08.860376] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-15T20:16:18.116113] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (13.66 seconds). [2025-09-15T20:16:18.125039] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-15T20:16:19.338776] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (11.67 seconds). [2025-09-15T20:16:19.340144] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-15T20:16:19.705435] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T20:16:19.707457] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-15T20:16:19.757855] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:16:19.769131] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-15T20:16:20.210849] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T20:16:20.212166] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-15T20:16:20.767576] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:16:20.769490] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-15T20:16:21.181227] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T20:16:21.182766] [INFO ] [REMOTE ] RWTP: Full fetch complete (3371 records). [2025-09-15T20:16:21.182885] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-15T20:16:21.454117] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:16:21.536084] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-15T20:16:21.612104] [DEBUG] [VALIDATOR ] RWTP: All expected trading days are present. [2025-09-15T20:16:21.612212] [DEBUG] [VALIDATOR ] RWTP: Primary data validation passed. [2025-09-15T20:16:21.612331] [INFO ] [MAIN ] RWTP: Fetched primary data is valid. [2025-09-15T20:16:21.612379] [DEBUG] [LOCAL ] RWTP: Saving primary data. [2025-09-15T20:16:21.612938] [DEBUG] [LOCAL ] RWTP: Trimmed 3371 records to 1986 (keeping 150 days of data) [2025-09-15T20:16:21.626231] [DEBUG] [LOCAL ] RWTP: Primary data saved (1986 records). [2025-09-15T20:16:21.626311] [INFO ] [MAIN ] RWTP: Full history saved. [2025-09-15T20:16:21.626391] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RWTP took 20.6s. Estimated remaining: 55m 29s. Rate: 9.4 symbols/min [2025-09-15T20:16:21.822235] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (12.96 seconds). [2025-09-15T20:16:21.842582] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:21.852746] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-15T20:16:21.883797] [DEBUG] [LOCAL ] RYAM: Loaded 26099 existing records from primary storage. [2025-09-15T20:16:21.884073] [INFO ] [MAIN ] RYAM: Loaded 26099 existing records. [2025-09-15T20:16:21.993724] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (19.92 seconds). [2025-09-15T20:16:22.007391] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-15T20:16:22.094467] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:22.094780] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-15T20:16:22.094829] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-15T20:16:22.095417] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-15T20:16:22.095464] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-15T20:16:22.445106] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:22.445452] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-15T20:16:22.728682] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T20:16:22.730626] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-15T20:16:23.291994] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:16:23.293915] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-15T20:16:23.328519] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:16:23.339193] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-15T20:16:23.695259] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T20:16:23.697297] [INFO ] [REMOTE ] RWTO: Full fetch complete (3507 records). [2025-09-15T20:16:23.699714] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-15T20:16:23.699582] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T20:16:23.806977] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-15T20:16:23.890700] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:16:23.915444] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-15T20:16:23.919896] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T20:16:23.920097] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:16:23.920894] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:16:23.920949] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-15T20:16:23.921003] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-15T20:16:23.921038] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-15T20:16:23.921078] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-15T20:16:23.921138] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RWTO took 30.8s. Estimated remaining: 55m 21s. Rate: 9.4 symbols/min [2025-09-15T20:16:24.102026] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:24.133929] [DEBUG] [LOCAL ] RYAN: Loaded 32666 existing records from primary storage. [2025-09-15T20:16:24.134071] [INFO ] [MAIN ] RYAN: Loaded 32666 existing records. [2025-09-15T20:16:24.312728] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:24.312998] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-15T20:16:24.313049] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-15T20:16:24.313904] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-15T20:16:24.313979] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-15T20:16:24.673526] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:24.673885] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-15T20:16:24.748474] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T20:16:24.758729] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-15T20:16:25.182453] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T20:16:25.190987] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-15T20:16:25.330816] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T20:16:25.341799] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-15T20:16:25.966467] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T20:16:25.974828] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-15T20:16:26.162133] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T20:16:26.170525] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-15T20:16:26.202216] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T20:16:26.213091] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-15T20:16:26.861931] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T20:16:26.872523] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-15T20:16:27.331530] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T20:16:27.420792] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:16:27.657870] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-15T20:16:27.840755] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T20:16:28.457882] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-15T20:16:28.752986] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T20:16:28.912617] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T20:16:29.257926] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-15T20:16:30.057898] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-15T20:16:30.857908] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-15T20:16:30.907488] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-15T20:16:30.912957] [INFO ] [REMOTE ] RXO: Full fetch complete (51578 records). [2025-09-15T20:16:30.913095] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-15T20:16:31.302066] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-15T20:16:31.302156] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-15T20:16:31.303034] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-15T20:16:31.303086] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-15T20:16:31.304309] [DEBUG] [LOCAL ] RXO: Trimmed 51578 records to 35301 (keeping 150 days of data) [2025-09-15T20:16:31.518179] [DEBUG] [LOCAL ] RXO: Primary data saved (35301 records). [2025-09-15T20:16:31.518314] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-15T20:16:31.518397] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RXO took 30.0s. Estimated remaining: 55m 15s. Rate: 9.4 symbols/min [2025-09-15T20:16:31.694979] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:31.714367] [DEBUG] [LOCAL ] RYI: Loaded 16156 existing records from primary storage. [2025-09-15T20:16:31.714506] [INFO ] [MAIN ] RYI: Loaded 16156 existing records. [2025-09-15T20:16:31.892751] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:31.893145] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-15T20:16:31.893245] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-15T20:16:31.893724] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-15T20:16:31.893787] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-15T20:16:32.183259] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T20:16:32.230216] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-15T20:16:32.349612] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-09-15T20:16:32.351970] [INFO ] [REMOTE ] RYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:32.457840] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-15T20:16:32.530668] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T20:16:33.257876] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-15T20:16:33.649627] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:16:33.672943] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T20:16:34.057862] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-15T20:16:34.803530] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:16:34.857834] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-15T20:16:34.942789] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:16:35.657873] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-15T20:16:35.978348] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T20:16:36.457925] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-15T20:16:37.105122] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T20:16:37.257865] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-15T20:16:37.748337] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:16:38.057897] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-15T20:16:38.315628] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T20:16:38.322918] [INFO ] [REMOTE ] RYAM: Full fetch complete (37550 records). [2025-09-15T20:16:38.323174] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-15T20:16:38.804879] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-15T20:16:38.805020] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-15T20:16:38.805951] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-15T20:16:38.806003] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-15T20:16:38.807148] [DEBUG] [LOCAL ] RYAM: Trimmed 37550 records to 25610 (keeping 150 days of data) [2025-09-15T20:16:38.858312] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-15T20:16:38.966228] [DEBUG] [LOCAL ] RYAM: Primary data saved (25610 records). [2025-09-15T20:16:38.966384] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-15T20:16:38.966530] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RYAM took 17.3s. Estimated remaining: 55m 9s. Rate: 9.4 symbols/min [2025-09-15T20:16:39.146790] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:39.185892] [DEBUG] [LOCAL ] RYN: Loaded 34168 existing records from primary storage. [2025-09-15T20:16:39.186098] [INFO ] [MAIN ] RYN: Loaded 34168 existing records. [2025-09-15T20:16:39.364973] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:39.365266] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-15T20:16:39.365311] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-15T20:16:39.366223] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-15T20:16:39.366289] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-15T20:16:39.663089] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-15T20:16:39.747516] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T20:16:39.751789] [INFO ] [REMOTE ] RYN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:39.758937] [INFO ] [REMOTE ] RY: Full fetch complete (52151 records). [2025-09-15T20:16:39.759069] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-15T20:16:40.144614] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-15T20:16:40.144715] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-15T20:16:40.145598] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-15T20:16:40.145661] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-15T20:16:40.146787] [DEBUG] [LOCAL ] RY: Trimmed 52151 records to 34981 (keeping 150 days of data) [2025-09-15T20:16:40.395948] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T20:16:40.431190] [DEBUG] [LOCAL ] RY: Primary data saved (34981 records). [2025-09-15T20:16:40.431373] [INFO ] [MAIN ] RY: Full history saved. [2025-09-15T20:16:40.431943] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RY took 32.3s. Estimated remaining: 55m 1s. Rate: 9.4 symbols/min [2025-09-15T20:16:40.463078] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-15T20:16:40.606335] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:40.618104] [DEBUG] [LOCAL ] RZB: Loaded 4775 existing records from primary storage. [2025-09-15T20:16:40.618265] [INFO ] [MAIN ] RZB: Loaded 4775 existing records. [2025-09-15T20:16:40.799774] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:40.800325] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-15T20:16:40.800489] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-15T20:16:40.800839] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-15T20:16:40.800912] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-15T20:16:40.940333] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T20:16:41.196041] [INFO ] [REMOTE ] RZB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:41.257902] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-15T20:16:42.012075] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:16:42.057838] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-15T20:16:42.851919] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:16:42.860235] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-15T20:16:43.158974] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T20:16:43.164134] [INFO ] [REMOTE ] RYAN: Full fetch complete (47691 records). [2025-09-15T20:16:43.164286] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-15T20:16:43.572696] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-15T20:16:43.572816] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-15T20:16:43.573664] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-15T20:16:43.573709] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-15T20:16:43.574761] [DEBUG] [LOCAL ] RYAN: Trimmed 47691 records to 32151 (keeping 150 days of data) [2025-09-15T20:16:43.676230] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-15T20:16:43.694588] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T20:16:43.802310] [DEBUG] [LOCAL ] RYAN: Primary data saved (32151 records). [2025-09-15T20:16:43.802524] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-15T20:16:43.802671] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RYAN took 19.9s. Estimated remaining: 54m 54s. Rate: 9.4 symbols/min [2025-09-15T20:16:43.976895] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:43.983548] [DEBUG] [LOCAL ] RZC: Loaded 5053 existing records from primary storage. [2025-09-15T20:16:43.983637] [INFO ] [MAIN ] RZC: Loaded 5053 existing records. [2025-09-15T20:16:44.162501] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:44.162800] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-15T20:16:44.162847] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-15T20:16:44.163178] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-15T20:16:44.163224] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-15T20:16:44.463163] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-15T20:16:44.529256] [INFO ] [REMOTE ] RZC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:16:45.257937] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-15T20:16:45.280986] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T20:16:46.030949] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-15T20:16:46.053107] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T20:16:46.057814] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-15T20:16:46.567216] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T20:16:46.857878] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-15T20:16:47.657913] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-15T20:16:48.385885] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:16:48.457874] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-15T20:16:48.583156] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T20:16:48.911993] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:16:49.257847] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-15T20:16:50.057905] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-15T20:16:50.104480] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:16:50.857874] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-15T20:16:51.429341] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T20:16:51.633392] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T20:16:51.657824] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-15T20:16:52.457880] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-15T20:16:53.221008] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T20:16:53.257827] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-15T20:16:53.409742] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T20:16:54.057920] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-15T20:16:54.575547] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T20:16:54.862809] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-15T20:16:54.873681] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:16:55.657878] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-15T20:16:56.044759] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T20:16:56.401132] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T20:16:56.457824] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-15T20:16:57.101661] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T20:16:57.257888] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-15T20:16:57.850209] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T20:16:58.057868] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-15T20:16:58.588289] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T20:16:58.589860] [INFO ] [REMOTE ] RZB: Full fetch complete (6700 records). [2025-09-15T20:16:58.589951] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-15T20:16:58.863030] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-15T20:16:58.968961] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-15T20:16:58.969078] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-15T20:16:58.969363] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-15T20:16:58.969406] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-15T20:16:58.969886] [DEBUG] [LOCAL ] RZB: Trimmed 6700 records to 4721 (keeping 150 days of data) [2025-09-15T20:16:59.004962] [DEBUG] [LOCAL ] RZB: Primary data saved (4721 records). [2025-09-15T20:16:59.005215] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-15T20:16:59.005339] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RZB took 18.6s. Estimated remaining: 54m 50s. Rate: 9.4 symbols/min [2025-09-15T20:16:59.181921] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:16:59.231015] [DEBUG] [LOCAL ] S: Loaded 40297 existing records from primary storage. [2025-09-15T20:16:59.231270] [INFO ] [MAIN ] S: Loaded 40297 existing records. [2025-09-15T20:16:59.411533] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:16:59.411883] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-15T20:16:59.411935] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-15T20:16:59.412968] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-15T20:16:59.413023] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-15T20:16:59.539354] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T20:16:59.667531] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-15T20:16:59.801914] [INFO ] [REMOTE ] S: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:00.457979] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-15T20:17:01.247982] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:17:01.257752] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-15T20:17:01.502947] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T20:17:02.057922] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-15T20:17:02.582911] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T20:17:02.587954] [INFO ] [REMOTE ] RYN: Full fetch complete (49655 records). [2025-09-15T20:17:02.588076] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-15T20:17:02.858229] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-15T20:17:02.938036] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T20:17:02.980058] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-15T20:17:02.980234] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-15T20:17:02.981250] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-15T20:17:02.981312] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-15T20:17:02.981400] [INFO ] [REMOTE ] RYI: Full fetch complete (23591 records). [2025-09-15T20:17:02.981598] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-15T20:17:03.064756] [DEBUG] [LOCAL ] RYN: Trimmed 49655 records to 33478 (keeping 150 days of data) [2025-09-15T20:17:03.480150] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-15T20:17:03.480623] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-15T20:17:03.482051] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-15T20:17:03.482463] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-15T20:17:03.489479] [DEBUG] [LOCAL ] RYI: Trimmed 23591 records to 15971 (keeping 150 days of data) [2025-09-15T20:17:03.659072] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-15T20:17:03.696274] [DEBUG] [LOCAL ] RYI: Primary data saved (15971 records). [2025-09-15T20:17:03.697091] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-15T20:17:03.698081] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. RYI took 32.2s. Estimated remaining: 54m 43s. Rate: 9.4 symbols/min [2025-09-15T20:17:03.871014] [DEBUG] [LOCAL ] RYN: Primary data saved (33478 records). [2025-09-15T20:17:03.890142] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-15T20:17:03.891169] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. RYN took 24.9s. Estimated remaining: 54m 35s. Rate: 9.4 symbols/min [2025-09-15T20:17:03.890043] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:04.089703] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:04.109505] [DEBUG] [LOCAL ] SA: Loaded 32071 existing records from primary storage. [2025-09-15T20:17:04.109773] [INFO ] [MAIN ] SA: Loaded 32071 existing records. [2025-09-15T20:17:04.188034] [DEBUG] [LOCAL ] SABA: Loaded 6842 existing records from primary storage. [2025-09-15T20:17:04.221323] [INFO ] [MAIN ] SABA: Loaded 6842 existing records. [2025-09-15T20:17:04.457441] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:04.520893] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:04.522862] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T20:17:04.521896] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-15T20:17:04.525281] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-15T20:17:04.525354] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-15T20:17:04.525924] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-15T20:17:04.526501] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-15T20:17:04.526476] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-15T20:17:04.526617] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-15T20:17:04.527592] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-15T20:17:04.548891] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-15T20:17:05.133223] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T20:17:05.143909] [INFO ] [REMOTE ] RZC: Full fetch complete (7606 records). [2025-09-15T20:17:05.164878] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-15T20:17:05.227021] [INFO ] [REMOTE ] SA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:05.263693] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-15T20:17:05.373486] [INFO ] [REMOTE ] SABA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:05.645727] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-15T20:17:05.742310] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-15T20:17:05.742414] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-15T20:17:05.742843] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-15T20:17:05.742892] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-15T20:17:05.743378] [DEBUG] [LOCAL ] RZC: Trimmed 7606 records to 4930 (keeping 150 days of data) [2025-09-15T20:17:05.776390] [DEBUG] [LOCAL ] RZC: Primary data saved (4930 records). [2025-09-15T20:17:05.776577] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-15T20:17:05.776737] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. RZC took 22.0s. Estimated remaining: 54m 28s. Rate: 9.4 symbols/min [2025-09-15T20:17:05.949752] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:05.973568] [DEBUG] [LOCAL ] SAFE: Loaded 22773 existing records from primary storage. [2025-09-15T20:17:05.973737] [INFO ] [MAIN ] SAFE: Loaded 22773 existing records. [2025-09-15T20:17:06.064114] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-15T20:17:06.153737] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:06.154028] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-15T20:17:06.154085] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-15T20:17:06.154764] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-15T20:17:06.154818] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-15T20:17:06.508843] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:06.661154] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T20:17:06.857878] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-15T20:17:07.657880] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-15T20:17:07.873992] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T20:17:08.128297] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T20:17:08.457844] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-15T20:17:08.637598] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:17:09.257921] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-15T20:17:10.057842] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-15T20:17:10.277564] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T20:17:10.312179] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T20:17:10.857867] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-15T20:17:10.984745] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:17:11.657877] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-15T20:17:12.457872] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-15T20:17:12.530988] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T20:17:13.202875] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:17:13.212562] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T20:17:13.257851] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-15T20:17:14.057879] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-15T20:17:14.859737] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-15T20:17:14.862269] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T20:17:15.410035] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:17:15.657864] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-15T20:17:16.446064] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:17:16.457884] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-15T20:17:16.964897] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:17:17.257892] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-15T20:17:17.402658] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T20:17:18.057883] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-15T20:17:18.395130] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T20:17:18.857936] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-15T20:17:18.886069] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T20:17:19.657876] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-15T20:17:20.078091] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T20:17:20.457869] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-15T20:17:20.466434] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T20:17:21.257887] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-15T20:17:21.458037] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T20:17:22.057894] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-15T20:17:22.424147] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T20:17:22.857899] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-15T20:17:23.657945] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-15T20:17:23.990014] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T20:17:24.388126] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-15T20:17:24.457933] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-15T20:17:25.122797] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:17:25.137421] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T20:17:25.137108] [INFO ] [REMOTE ] SA: Full fetch complete (46599 records). [2025-09-15T20:17:25.140167] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-15T20:17:25.263126] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-15T20:17:25.533783] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-15T20:17:25.533901] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-15T20:17:25.542126] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-15T20:17:25.542426] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-15T20:17:25.544064] [DEBUG] [LOCAL ] SA: Trimmed 46599 records to 31513 (keeping 150 days of data) [2025-09-15T20:17:25.741882] [DEBUG] [LOCAL ] SA: Primary data saved (31513 records). [2025-09-15T20:17:25.742088] [INFO ] [MAIN ] SA: Full history saved. [2025-09-15T20:17:25.742204] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. SA took 22.0s. Estimated remaining: 54m 25s. Rate: 9.4 symbols/min [2025-09-15T20:17:25.912930] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:25.931902] [DEBUG] [LOCAL ] SAH: Loaded 15981 existing records from primary storage. [2025-09-15T20:17:25.932106] [INFO ] [MAIN ] SAH: Loaded 15981 existing records. [2025-09-15T20:17:26.073972] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-15T20:17:26.114779] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:26.115098] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-15T20:17:26.115150] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-15T20:17:26.115815] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-15T20:17:26.115871] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-15T20:17:26.488107] [INFO ] [REMOTE ] SAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:26.857885] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-15T20:17:27.019131] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:17:27.149732] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T20:17:27.657883] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-15T20:17:28.186225] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T20:17:28.457881] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-15T20:17:29.178417] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:17:29.180933] [INFO ] [REMOTE ] SABA: Full fetch complete (10449 records). [2025-09-15T20:17:29.181036] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-15T20:17:29.262946] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-15T20:17:29.545517] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-15T20:17:29.545711] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-15T20:17:29.545981] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-15T20:17:29.546054] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-15T20:17:29.546585] [DEBUG] [LOCAL ] SABA: Trimmed 10449 records to 6815 (keeping 150 days of data) [2025-09-15T20:17:29.582365] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-15T20:17:29.602739] [INFO ] [REMOTE ] S: Full fetch complete (58206 records). [2025-09-15T20:17:29.605478] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-15T20:17:29.786953] [DEBUG] [LOCAL ] SABA: Primary data saved (6815 records). [2025-09-15T20:17:29.807827] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-15T20:17:29.868301] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SABA took 26.0s. Estimated remaining: 54m 18s. Rate: 9.4 symbols/min [2025-09-15T20:17:30.087466] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-15T20:17:30.144947] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-15T20:17:30.172541] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-15T20:17:30.174479] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-15T20:17:30.174561] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-15T20:17:30.177488] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:30.178078] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-15T20:17:30.178119] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-15T20:17:30.178250] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-15T20:17:30.178288] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-15T20:17:30.178345] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-15T20:17:30.178386] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-15T20:17:30.279176] [DEBUG] [LOCAL ] S: Trimmed 58206 records to 39521 (keeping 150 days of data) [2025-09-15T20:17:30.744138] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:30.782962] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T20:17:30.861239] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-15T20:17:30.973061] [DEBUG] [LOCAL ] S: Primary data saved (39521 records). [2025-09-15T20:17:30.973318] [INFO ] [MAIN ] S: Full history saved. [2025-09-15T20:17:30.974267] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. S took 32.0s. Estimated remaining: 54m 10s. Rate: 9.4 symbols/min [2025-09-15T20:17:31.223794] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:31.243037] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T20:17:31.249229] [INFO ] [REMOTE ] SAFE: Full fetch complete (33182 records). [2025-09-15T20:17:31.249442] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-15T20:17:31.429318] [DEBUG] [LOCAL ] SAM: Loaded 16280 existing records from primary storage. [2025-09-15T20:17:31.433407] [INFO ] [MAIN ] SAM: Loaded 16280 existing records. [2025-09-15T20:17:31.689393] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-15T20:17:31.867322] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:31.889453] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-15T20:17:31.895101] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-15T20:17:31.921185] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-15T20:17:31.952186] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-15T20:17:32.029690] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-15T20:17:32.063495] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-15T20:17:32.090610] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-15T20:17:32.099855] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-15T20:17:32.250374] [DEBUG] [LOCAL ] SAFE: Trimmed 33182 records to 22255 (keeping 150 days of data) [2025-09-15T20:17:32.270762] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T20:17:32.262994] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:17:32.469499] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-15T20:17:32.511779] [INFO ] [REMOTE ] SAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:32.562033] [DEBUG] [LOCAL ] SAFE: Primary data saved (22255 records). [2025-09-15T20:17:32.562175] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-15T20:17:32.562288] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. SAFE took 26.8s. Estimated remaining: 54m 3s. Rate: 9.4 symbols/min [2025-09-15T20:17:32.741758] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:32.779712] [DEBUG] [LOCAL ] SAN: Loaded 39900 existing records from primary storage. [2025-09-15T20:17:32.779864] [INFO ] [MAIN ] SAN: Loaded 39900 existing records. [2025-09-15T20:17:32.940338] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T20:17:32.961314] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:32.961566] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-15T20:17:32.961614] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-15T20:17:32.962717] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-15T20:17:32.962773] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-15T20:17:33.262969] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-15T20:17:33.319807] [INFO ] [REMOTE ] SAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:34.057875] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-15T20:17:34.368590] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T20:17:34.857877] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-15T20:17:35.265608] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T20:17:35.654405] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T20:17:35.663523] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-15T20:17:36.044694] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T20:17:36.457877] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-15T20:17:37.257892] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-15T20:17:37.752943] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T20:17:38.057863] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-15T20:17:38.857861] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-15T20:17:39.065080] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T20:17:39.090018] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T20:17:39.657880] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-15T20:17:39.786815] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T20:17:40.457904] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-15T20:17:40.709347] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T20:17:41.257833] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-15T20:17:41.412608] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T20:17:41.596535] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T20:17:42.057894] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-15T20:17:42.857888] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-15T20:17:43.025427] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T20:17:43.222354] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T20:17:43.657907] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-15T20:17:44.009243] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-15T20:17:44.457880] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-15T20:17:45.257900] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-15T20:17:45.586527] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T20:17:46.057915] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-15T20:17:46.779785] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:17:46.782089] [INFO ] [REMOTE ] SAH: Full fetch complete (24413 records). [2025-09-15T20:17:46.782163] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-15T20:17:46.863015] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-15T20:17:47.159079] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-15T20:17:47.159213] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-15T20:17:47.159748] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-15T20:17:47.159801] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-15T20:17:47.160731] [DEBUG] [LOCAL ] SAH: Trimmed 24413 records to 15553 (keeping 150 days of data) [2025-09-15T20:17:47.268002] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:17:47.292111] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T20:17:47.293799] [INFO ] [REMOTE ] SAJ: Full fetch complete (700 records). [2025-09-15T20:17:47.294653] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-15T20:17:47.467204] [DEBUG] [LOCAL ] SAH: Primary data saved (15553 records). [2025-09-15T20:17:47.487318] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-15T20:17:47.487225] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T20:17:47.487468] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:17:47.487578] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAH took 21.7s. Estimated remaining: 53m 59s. Rate: 9.4 symbols/min [2025-09-15T20:17:47.487704] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:17:47.487969] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-15T20:17:47.570102] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-15T20:17:47.593120] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-15T20:17:47.593271] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-15T20:17:47.593591] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAJ took 17.7s. Estimated remaining: 53m 50s. Rate: 9.4 symbols/min [2025-09-15T20:17:47.672129] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-15T20:17:47.738410] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:47.840945] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:17:47.875601] [DEBUG] [LOCAL ] SAND: Loaded 38913 existing records from primary storage. [2025-09-15T20:17:47.875775] [INFO ] [MAIN ] SAND: Loaded 38913 existing records. [2025-09-15T20:17:48.079705] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:48.080864] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-15T20:17:48.080926] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-15T20:17:48.081923] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-15T20:17:48.082002] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-15T20:17:48.081888] [DEBUG] [LOCAL ] SAP: Loaded 37315 existing records from primary storage. [2025-09-15T20:17:48.087846] [INFO ] [MAIN ] SAP: Loaded 37315 existing records. [2025-09-15T20:17:48.458798] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-15T20:17:48.480811] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:17:48.583001] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-15T20:17:48.583138] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-15T20:17:48.589073] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-15T20:17:48.599358] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-15T20:17:48.765922] [INFO ] [REMOTE ] SAND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:49.021429] [INFO ] [REMOTE ] SAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:17:49.257862] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-15T20:17:49.526524] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T20:17:49.565893] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T20:17:50.057899] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-15T20:17:50.857929] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-15T20:17:51.008627] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T20:17:51.657890] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-15T20:17:51.722138] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T20:17:52.457863] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-15T20:17:52.542347] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T20:17:52.858825] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T20:17:53.257883] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-15T20:17:54.057903] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-15T20:17:54.261502] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T20:17:54.651678] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T20:17:54.857931] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-15T20:17:55.657916] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-15T20:17:55.781676] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T20:17:56.465816] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-15T20:17:56.506535] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T20:17:57.257931] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-15T20:17:57.365176] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:17:57.538580] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T20:17:58.057901] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-15T20:17:58.822092] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T20:17:58.857839] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-15T20:17:59.559804] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T20:17:59.657889] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-15T20:18:00.394050] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T20:18:00.399907] [INFO ] [REMOTE ] SAN: Full fetch complete (57628 records). [2025-09-15T20:18:00.400030] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-15T20:18:00.465183] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-15T20:18:00.791935] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-15T20:18:00.792045] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-15T20:18:00.793036] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-15T20:18:00.793084] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-15T20:18:00.794377] [DEBUG] [LOCAL ] SAN: Trimmed 57628 records to 39127 (keeping 150 days of data) [2025-09-15T20:18:01.033797] [DEBUG] [LOCAL ] SAN: Primary data saved (39127 records). [2025-09-15T20:18:01.033966] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-15T20:18:01.034083] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAN took 28.5s. Estimated remaining: 53m 46s. Rate: 9.4 symbols/min [2025-09-15T20:18:01.202128] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:01.214328] [DEBUG] [LOCAL ] SAR: Loaded 12203 existing records from primary storage. [2025-09-15T20:18:01.214425] [INFO ] [MAIN ] SAR: Loaded 12203 existing records. [2025-09-15T20:18:01.267997] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-15T20:18:01.412879] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:01.413206] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-15T20:18:01.413260] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-15T20:18:01.429055] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-15T20:18:01.455993] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-15T20:18:01.533407] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T20:18:01.826084] [INFO ] [REMOTE ] SAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:02.057868] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-15T20:18:02.452312] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T20:18:02.455499] [INFO ] [REMOTE ] SAM: Full fetch complete (23836 records). [2025-09-15T20:18:02.455577] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-15T20:18:02.841948] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-15T20:18:02.842037] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-15T20:18:02.842592] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-15T20:18:02.842659] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-15T20:18:02.843387] [DEBUG] [LOCAL ] SAM: Trimmed 23836 records to 16106 (keeping 150 days of data) [2025-09-15T20:18:02.885502] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-15T20:18:02.946941] [DEBUG] [LOCAL ] SAM: Primary data saved (16106 records). [2025-09-15T20:18:02.947101] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-15T20:18:02.947192] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAM took 32.0s. Estimated remaining: 53m 38s. Rate: 9.4 symbols/min [2025-09-15T20:18:03.121333] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:03.159376] [DEBUG] [LOCAL ] SARO: Loaded 36248 existing records from primary storage. [2025-09-15T20:18:03.159522] [INFO ] [MAIN ] SARO: Loaded 36248 existing records. [2025-09-15T20:18:03.377927] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:03.380022] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-15T20:18:03.380077] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-15T20:18:03.390345] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-15T20:18:03.391637] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-15T20:18:03.391713] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-15T20:18:03.663012] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-15T20:18:03.766836] [INFO ] [REMOTE ] SARO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:04.198916] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-15T20:18:04.457889] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-15T20:18:05.257901] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-15T20:18:05.750927] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T20:18:05.830510] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-09-15T20:18:05.863023] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T20:18:05.947042] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T20:18:06.057899] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-15T20:18:06.857884] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-15T20:18:07.657938] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-15T20:18:07.892786] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T20:18:07.970417] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T20:18:08.457908] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-15T20:18:09.257886] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-15T20:18:09.536844] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T20:18:09.949050] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:18:10.057880] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-15T20:18:10.850779] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T20:18:10.860749] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-15T20:18:11.624833] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:18:11.630495] [INFO ] [REMOTE ] SAP: Full fetch complete (54285 records). [2025-09-15T20:18:11.630618] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-15T20:18:11.662996] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-15T20:18:12.013166] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-15T20:18:12.013263] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-15T20:18:12.014236] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-15T20:18:12.014287] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-15T20:18:12.015541] [DEBUG] [LOCAL ] SAP: Trimmed 54285 records to 36605 (keeping 150 days of data) [2025-09-15T20:18:12.261299] [DEBUG] [LOCAL ] SAP: Primary data saved (36605 records). [2025-09-15T20:18:12.261508] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-15T20:18:12.262205] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SAP took 24.7s. Estimated remaining: 53m 33s. Rate: 9.4 symbols/min [2025-09-15T20:18:12.440714] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:12.440903] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-15T20:18:12.440944] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-15T20:18:12.441079] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-15T20:18:12.441120] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-15T20:18:12.441207] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-15T20:18:12.441245] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-15T20:18:12.474384] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-15T20:18:12.806934] [INFO ] [REMOTE ] SAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:12.843050] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T20:18:13.247345] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:18:13.257897] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-15T20:18:13.570532] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T20:18:14.057931] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-15T20:18:14.857879] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-15T20:18:15.265240] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-15T20:18:15.271084] [INFO ] [REMOTE ] SAND: Full fetch complete (56262 records). [2025-09-15T20:18:15.271200] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-15T20:18:15.657769] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-15T20:18:15.657907] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-15T20:18:15.658986] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-15T20:18:15.657865] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-15T20:18:15.659076] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-15T20:18:15.664409] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T20:18:15.664558] [DEBUG] [LOCAL ] SAND: Trimmed 56262 records to 38135 (keeping 150 days of data) [2025-09-15T20:18:15.778426] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T20:18:15.922774] [DEBUG] [LOCAL ] SAND: Primary data saved (38135 records). [2025-09-15T20:18:15.922930] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-15T20:18:15.923031] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAND took 28.4s. Estimated remaining: 53m 26s. Rate: 9.4 symbols/min [2025-09-15T20:18:16.093281] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:16.093477] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-15T20:18:16.093517] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-15T20:18:16.093700] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-15T20:18:16.093741] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-15T20:18:16.093783] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-15T20:18:16.093825] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-15T20:18:16.442542] [INFO ] [REMOTE ] SAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:16.457821] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-15T20:18:16.853595] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-15T20:18:17.257936] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-15T20:18:17.440501] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T20:18:17.773818] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T20:18:18.057878] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-15T20:18:18.511369] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:18:18.857883] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-15T20:18:19.247012] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T20:18:19.657928] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-15T20:18:20.104116] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T20:18:20.457878] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-15T20:18:20.861039] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T20:18:21.257875] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-15T20:18:21.690287] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T20:18:22.057892] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-15T20:18:22.857872] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-15T20:18:23.048265] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:18:23.308081] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T20:18:23.657915] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-15T20:18:24.457886] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-15T20:18:24.686178] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T20:18:24.864790] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T20:18:25.257880] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-15T20:18:26.057862] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-15T20:18:26.162389] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:18:26.165051] [INFO ] [REMOTE ] SAR: Full fetch complete (18171 records). [2025-09-15T20:18:26.165126] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-15T20:18:26.543273] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-15T20:18:26.543364] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-15T20:18:26.543764] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-15T20:18:26.543816] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-15T20:18:26.544463] [DEBUG] [LOCAL ] SAR: Trimmed 18171 records to 12085 (keeping 150 days of data) [2025-09-15T20:18:26.626292] [DEBUG] [LOCAL ] SAR: Primary data saved (12085 records). [2025-09-15T20:18:26.626454] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-15T20:18:26.626560] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SAR took 25.6s. Estimated remaining: 53m 21s. Rate: 9.4 symbols/min [2025-09-15T20:18:26.808699] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:26.808903] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-15T20:18:26.808942] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-15T20:18:26.809073] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-15T20:18:26.809115] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-15T20:18:26.809155] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-15T20:18:26.809188] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-15T20:18:26.865094] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-15T20:18:27.175362] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:27.276868] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T20:18:27.657883] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-15T20:18:27.802795] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T20:18:28.073938] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T20:18:28.457877] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-15T20:18:29.257880] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-15T20:18:29.614969] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T20:18:29.837232] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:18:30.057870] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-15T20:18:30.458784] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T20:18:30.857880] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-15T20:18:31.657868] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-15T20:18:31.977451] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T20:18:31.978233] [INFO ] [REMOTE ] SAY: Full fetch complete (1054 records). [2025-09-15T20:18:31.978302] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-15T20:18:32.154220] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-15T20:18:32.154419] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:18:32.154485] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:18:32.154535] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-15T20:18:32.154596] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-15T20:18:32.154675] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-15T20:18:32.154730] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-15T20:18:32.154806] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SAY took 16.2s. Estimated remaining: 53m 14s. Rate: 9.4 symbols/min [2025-09-15T20:18:32.332329] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:32.363354] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:18:32.393960] [DEBUG] [LOCAL ] SB: Loaded 24605 existing records from primary storage. [2025-09-15T20:18:32.394119] [INFO ] [MAIN ] SB: Loaded 24605 existing records. [2025-09-15T20:18:32.463005] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-15T20:18:32.576634] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:32.576974] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-15T20:18:32.577027] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-15T20:18:32.577764] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-15T20:18:32.577821] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-15T20:18:32.933901] [INFO ] [REMOTE ] SB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:32.966259] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T20:18:33.257877] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-15T20:18:34.057883] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-15T20:18:34.550195] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T20:18:34.660424] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T20:18:34.857912] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-15T20:18:35.657873] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-15T20:18:35.945362] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T20:18:36.025667] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T20:18:36.457894] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-15T20:18:37.257879] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-15T20:18:37.665103] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T20:18:37.665823] [INFO ] [REMOTE ] SAT: Full fetch complete (1140 records). [2025-09-15T20:18:37.665893] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-15T20:18:37.867384] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T20:18:37.886601] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T20:18:37.895771] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:18:37.895846] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:18:37.896076] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-15T20:18:37.896165] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-15T20:18:37.896206] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-15T20:18:37.896254] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-15T20:18:37.896355] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SAT took 25.6s. Estimated remaining: 53m 7s. Rate: 9.4 symbols/min [2025-09-15T20:18:38.067049] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:38.064610] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-15T20:18:38.067241] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-15T20:18:38.068148] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-15T20:18:38.068273] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-15T20:18:38.068344] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-15T20:18:38.068386] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-15T20:18:38.068418] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-15T20:18:38.417077] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:38.615738] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T20:18:38.857876] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-15T20:18:39.153798] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:18:39.154197] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-15T20:18:39.657877] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-15T20:18:39.954578] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:18:39.954950] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-15T20:18:40.457867] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-15T20:18:40.728927] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:18:40.729287] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-15T20:18:41.257937] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-15T20:18:42.057918] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-15T20:18:42.451562] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T20:18:42.532560] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:18:42.539912] [INFO ] [REMOTE ] SARO: Full fetch complete (52164 records). [2025-09-15T20:18:42.540117] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-15T20:18:42.862986] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-15T20:18:42.939013] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-15T20:18:42.939182] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-15T20:18:42.940311] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-15T20:18:42.940381] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-15T20:18:42.941820] [DEBUG] [LOCAL ] SARO: Trimmed 52164 records to 35494 (keeping 150 days of data) [2025-09-15T20:18:43.164769] [DEBUG] [LOCAL ] SARO: Primary data saved (35494 records). [2025-09-15T20:18:43.164932] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-15T20:18:43.165423] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SARO took 40.2s. Estimated remaining: 53m 1s. Rate: 9.4 symbols/min [2025-09-15T20:18:43.333243] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:43.372780] [DEBUG] [LOCAL ] SBH: Loaded 37080 existing records from primary storage. [2025-09-15T20:18:43.372931] [INFO ] [MAIN ] SBH: Loaded 37080 existing records. [2025-09-15T20:18:43.544908] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:43.545206] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-15T20:18:43.545264] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-15T20:18:43.546301] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-15T20:18:43.546357] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-15T20:18:43.663117] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-15T20:18:43.931742] [INFO ] [REMOTE ] SBH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:44.043747] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T20:18:44.148242] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T20:18:44.457916] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-15T20:18:44.712858] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:18:44.713405] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-15T20:18:45.257968] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-15T20:18:45.526097] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:18:45.526535] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-15T20:18:46.057873] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-15T20:18:46.530872] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T20:18:46.857871] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-15T20:18:47.657912] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-15T20:18:48.048536] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T20:18:48.278758] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T20:18:48.457949] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-15T20:18:49.090462] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T20:18:49.257890] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-15T20:18:50.057881] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-15T20:18:50.858388] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-15T20:18:50.863909] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:18:51.006417] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T20:18:51.305885] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-15T20:18:51.306895] [INFO ] [REMOTE ] SBDS: Full fetch complete (866 records). [2025-09-15T20:18:51.306964] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-15T20:18:51.494627] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-15T20:18:51.494912] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:18:51.494970] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:18:51.495026] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-15T20:18:51.495111] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-15T20:18:51.495151] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-15T20:18:51.495199] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-15T20:18:51.495273] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SBDS took 13.6s. Estimated remaining: 52m 55s. Rate: 9.4 symbols/min [2025-09-15T20:18:51.666870] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-15T20:18:51.669455] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:51.687564] [DEBUG] [LOCAL ] SBI: Loaded 5659 existing records from primary storage. [2025-09-15T20:18:51.687723] [INFO ] [MAIN ] SBI: Loaded 5659 existing records. [2025-09-15T20:18:51.874905] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:51.875188] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-15T20:18:51.875234] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-15T20:18:51.875607] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-15T20:18:51.875684] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-15T20:18:52.222467] [INFO ] [REMOTE ] SBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:52.457872] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-15T20:18:52.852496] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T20:18:53.154427] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:18:53.257853] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-15T20:18:54.057871] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-15T20:18:54.232380] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:18:54.236139] [INFO ] [REMOTE ] SB: Full fetch complete (37359 records). [2025-09-15T20:18:54.236248] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-15T20:18:54.429817] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T20:18:54.448770] [INFO ] [REMOTE ] SAZ: Full fetch complete (1496 records). [2025-09-15T20:18:54.465818] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-15T20:18:54.845475] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-15T20:18:54.845344] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T20:18:54.845604] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-15T20:18:54.846472] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-15T20:18:54.846533] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:18:54.846628] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-15T20:18:54.846708] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:18:54.846841] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-15T20:18:54.846912] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-15T20:18:54.846953] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-15T20:18:54.847128] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-15T20:18:54.847270] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SAZ took 28.2s. Estimated remaining: 52m 48s. Rate: 9.4 symbols/min [2025-09-15T20:18:54.867563] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-15T20:18:54.884112] [DEBUG] [LOCAL ] SB: Trimmed 37359 records to 24037 (keeping 150 days of data) [2025-09-15T20:18:55.112788] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:55.128871] [DEBUG] [LOCAL ] SBR: Loaded 5266 existing records from primary storage. [2025-09-15T20:18:55.129485] [INFO ] [MAIN ] SBR: Loaded 5266 existing records. [2025-09-15T20:18:55.314535] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:55.318060] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-15T20:18:55.318668] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-15T20:18:55.320544] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-15T20:18:55.321355] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-15T20:18:55.658781] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-15T20:18:55.714389] [INFO ] [REMOTE ] SBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:55.719658] [DEBUG] [LOCAL ] SB: Primary data saved (24037 records). [2025-09-15T20:18:55.719767] [INFO ] [MAIN ] SB: Full history saved. [2025-09-15T20:18:55.719854] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SB took 23.6s. Estimated remaining: 52m 40s. Rate: 9.4 symbols/min [2025-09-15T20:18:55.896085] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:18:55.936035] [DEBUG] [LOCAL ] SBS: Loaded 37095 existing records from primary storage. [2025-09-15T20:18:55.936264] [INFO ] [MAIN ] SBS: Loaded 37095 existing records. [2025-09-15T20:18:56.149266] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:18:56.150013] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-15T20:18:56.150105] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-15T20:18:56.150958] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-15T20:18:56.151012] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-15T20:18:56.449514] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:18:56.459907] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-15T20:18:56.524782] [INFO ] [REMOTE ] SBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:18:56.622004] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T20:18:57.176626] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T20:18:57.257912] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-15T20:18:57.981273] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T20:18:58.057912] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-15T20:18:58.728410] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:18:58.857881] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-15T20:18:59.635881] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T20:18:59.657836] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-15T20:19:00.420395] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T20:19:00.457837] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-15T20:19:01.257877] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-15T20:19:01.314309] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T20:19:02.057927] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-15T20:19:02.679051] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T20:19:02.857863] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-15T20:19:03.324357] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T20:19:03.372057] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T20:19:03.373109] [INFO ] [REMOTE ] SBI: Full fetch complete (8195 records). [2025-09-15T20:19:03.373182] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-15T20:19:03.662956] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-15T20:19:03.733913] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-15T20:19:03.733996] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-15T20:19:03.734240] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-15T20:19:03.734283] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-15T20:19:03.734711] [DEBUG] [LOCAL ] SBI: Trimmed 8195 records to 5385 (keeping 150 days of data) [2025-09-15T20:19:03.769827] [DEBUG] [LOCAL ] SBI: Primary data saved (5385 records). [2025-09-15T20:19:03.769966] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-15T20:19:03.770055] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBI took 12.3s. Estimated remaining: 52m 34s. Rate: 9.4 symbols/min [2025-09-15T20:19:03.941304] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:03.953985] [DEBUG] [LOCAL ] SBSI: Loaded 10587 existing records from primary storage. [2025-09-15T20:19:03.954092] [INFO ] [MAIN ] SBSI: Loaded 10587 existing records. [2025-09-15T20:19:04.130785] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:04.131045] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-15T20:19:04.131092] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-15T20:19:04.131496] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-15T20:19:04.131547] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-15T20:19:04.460126] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-15T20:19:04.480086] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T20:19:04.503511] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:05.257897] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-15T20:19:05.968410] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:19:06.057877] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-15T20:19:06.771894] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:19:06.857873] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-15T20:19:07.516440] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:19:07.657848] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-15T20:19:08.228901] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:19:08.457911] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-15T20:19:09.014999] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T20:19:09.257915] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-15T20:19:09.417112] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T20:19:10.057888] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-15T20:19:10.857910] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-15T20:19:10.919107] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T20:19:11.089145] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T20:19:11.506466] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T20:19:11.657901] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-15T20:19:12.269353] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:19:12.457883] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-15T20:19:13.257875] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-15T20:19:14.034529] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:19:14.061031] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-15T20:19:14.067138] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:19:14.857873] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-15T20:19:15.442622] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T20:19:15.661872] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-15T20:19:15.667505] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T20:19:16.374242] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:19:16.375841] [INFO ] [REMOTE ] SBR: Full fetch complete (8007 records). [2025-09-15T20:19:16.375912] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-15T20:19:16.463028] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-15T20:19:16.734918] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-15T20:19:16.734996] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-15T20:19:16.735188] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-15T20:19:16.735225] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-15T20:19:16.735630] [DEBUG] [LOCAL ] SBR: Trimmed 8007 records to 5227 (keeping 150 days of data) [2025-09-15T20:19:16.768312] [DEBUG] [LOCAL ] SBR: Primary data saved (5227 records). [2025-09-15T20:19:16.768414] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-15T20:19:16.768534] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBR took 21.9s. Estimated remaining: 52m 29s. Rate: 9.4 symbols/min [2025-09-15T20:19:16.934908] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:16.977060] [DEBUG] [LOCAL ] SBSW: Loaded 39957 existing records from primary storage. [2025-09-15T20:19:16.977248] [INFO ] [MAIN ] SBSW: Loaded 39957 existing records. [2025-09-15T20:19:17.158095] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:17.158352] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-15T20:19:17.158398] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-15T20:19:17.159097] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-15T20:19:17.159145] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-15T20:19:17.260746] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-15T20:19:17.514269] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:17.977899] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T20:19:17.984070] [INFO ] [REMOTE ] SBH: Full fetch complete (54312 records). [2025-09-15T20:19:17.984255] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-15T20:19:18.062970] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-15T20:19:18.387029] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-15T20:19:18.387131] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-15T20:19:18.388379] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-15T20:19:18.388537] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-15T20:19:18.399589] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T20:19:18.403076] [DEBUG] [LOCAL ] SBH: Trimmed 54312 records to 36343 (keeping 150 days of data) [2025-09-15T20:19:18.626005] [DEBUG] [LOCAL ] SBH: Primary data saved (36343 records). [2025-09-15T20:19:18.626175] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-15T20:19:18.626917] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBH took 35.5s. Estimated remaining: 52m 22s. Rate: 9.4 symbols/min [2025-09-15T20:19:18.801601] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:18.801832] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-15T20:19:18.801875] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-15T20:19:18.802003] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-15T20:19:18.802045] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-15T20:19:18.802104] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-15T20:19:18.802139] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-15T20:19:18.864579] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-15T20:19:19.161442] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:19.655902] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:19:19.665921] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-15T20:19:19.950716] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-15T20:19:20.052141] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T20:19:20.457877] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-15T20:19:20.840756] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T20:19:21.257885] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-15T20:19:22.057888] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-15T20:19:22.322175] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-15T20:19:22.857868] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-15T20:19:23.125548] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T20:19:23.230130] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T20:19:23.657912] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-15T20:19:24.457891] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-15T20:19:24.567395] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T20:19:25.257881] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-15T20:19:26.057892] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-15T20:19:26.230702] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T20:19:26.721182] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:19:26.857876] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-15T20:19:27.023241] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T20:19:27.657870] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-15T20:19:28.455033] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T20:19:28.458582] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-15T20:19:29.048606] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T20:19:29.257874] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-15T20:19:30.001061] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T20:19:30.006795] [INFO ] [REMOTE ] SBS: Full fetch complete (53302 records). [2025-09-15T20:19:30.006901] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-15T20:19:30.067715] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-15T20:19:30.390711] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-15T20:19:30.390801] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-15T20:19:30.391712] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-15T20:19:30.391758] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-15T20:19:30.392998] [DEBUG] [LOCAL ] SBS: Trimmed 53302 records to 36305 (keeping 150 days of data) [2025-09-15T20:19:30.612028] [DEBUG] [LOCAL ] SBS: Primary data saved (36305 records). [2025-09-15T20:19:30.612177] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-15T20:19:30.613899] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBS took 34.9s. Estimated remaining: 52m 17s. Rate: 9.4 symbols/min [2025-09-15T20:19:30.852727] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:19:30.857800] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-15T20:19:30.944739] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T20:19:31.347471] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T20:19:31.657881] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-15T20:19:32.457923] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-15T20:19:33.220707] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T20:19:33.257875] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-15T20:19:33.639207] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T20:19:34.057921] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-15T20:19:34.093956] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T20:19:34.096193] [INFO ] [REMOTE ] SBSI: Full fetch complete (15591 records). [2025-09-15T20:19:34.096281] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-15T20:19:34.467166] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-15T20:19:34.467275] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-15T20:19:34.467856] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-15T20:19:34.467902] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-15T20:19:34.468596] [DEBUG] [LOCAL ] SBSI: Trimmed 15591 records to 10355 (keeping 150 days of data) [2025-09-15T20:19:34.542560] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T20:19:34.550063] [DEBUG] [LOCAL ] SBSI: Primary data saved (10355 records). [2025-09-15T20:19:34.550225] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-15T20:19:34.550324] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SBSI took 30.8s. Estimated remaining: 52m 10s. Rate: 9.4 symbols/min [2025-09-15T20:19:34.857887] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-15T20:19:35.255633] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T20:19:35.256594] [INFO ] [REMOTE ] SBXD: Full fetch complete (2929 records). [2025-09-15T20:19:35.256739] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-15T20:19:35.443224] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-15T20:19:35.443491] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:19:35.443544] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:19:35.443594] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-15T20:19:35.443682] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-15T20:19:35.443727] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-15T20:19:35.443771] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-15T20:19:35.443840] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SBXD took 16.8s. Estimated remaining: 52m 2s. Rate: 9.4 symbols/min [2025-09-15T20:19:35.657885] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-15T20:19:37.612381] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T20:19:37.631108] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-15T20:19:39.270795] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:19:39.282491] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-15T20:19:40.747508] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T20:19:40.753482] [INFO ] [REMOTE ] SBSW: Full fetch complete (57513 records). [2025-09-15T20:19:40.753661] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-15T20:19:41.144912] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-15T20:19:41.145012] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-15T20:19:41.145969] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-15T20:19:41.146026] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-15T20:19:41.147408] [DEBUG] [LOCAL ] SBSW: Trimmed 57513 records to 39176 (keeping 150 days of data) [2025-09-15T20:19:41.388518] [DEBUG] [LOCAL ] SBSW: Primary data saved (39176 records). [2025-09-15T20:19:41.388897] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-15T20:19:41.389007] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SBSW took 24.6s. Estimated remaining: 51m 56s. Rate: 9.4 symbols/min [2025-09-15T20:19:41.926122] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:42.008854] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:42.064109] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:42.107488] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:42.121511] [DEBUG] [LOCAL ] SCD: Loaded 10340 existing records from primary storage. [2025-09-15T20:19:42.126028] [INFO ] [MAIN ] SCD: Loaded 10340 existing records. [2025-09-15T20:19:42.354565] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:42.356566] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-15T20:19:42.371056] [DEBUG] [LOCAL ] SCI: Loaded 35142 existing records from primary storage. [2025-09-15T20:19:42.370411] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-15T20:19:42.371311] [INFO ] [MAIN ] SCI: Loaded 35142 existing records. [2025-09-15T20:19:42.376711] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-15T20:19:42.404383] [DEBUG] [LOCAL ] SCHW: Loaded 40425 existing records from primary storage. [2025-09-15T20:19:42.414819] [INFO ] [MAIN ] SCHW: Loaded 40425 existing records. [2025-09-15T20:19:42.394300] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-15T20:19:42.524443] [DEBUG] [LOCAL ] SCCO: Loaded 36751 existing records from primary storage. [2025-09-15T20:19:42.540439] [INFO ] [MAIN ] SCCO: Loaded 36751 existing records. [2025-09-15T20:19:42.969578] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:43.066329] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-15T20:19:43.083672] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-15T20:19:43.127335] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:43.134921] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:43.154251] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-15T20:19:43.170066] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-15T20:19:43.170222] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-15T20:19:43.170307] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-15T20:19:43.188724] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-15T20:19:43.194073] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-15T20:19:43.188793] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-15T20:19:43.199427] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-15T20:19:43.209836] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-15T20:19:43.221192] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-15T20:19:43.792253] [INFO ] [REMOTE ] SCD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:44.058169] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-15T20:19:44.393285] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:44.452847] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-15T20:19:44.501260] [INFO ] [REMOTE ] SCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:44.497704] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:19:44.503100] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-15T20:19:44.503804] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-15T20:19:44.980255] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T20:19:44.983038] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-15T20:19:45.790689] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T20:19:45.793008] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-15T20:19:45.935704] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T20:19:45.945576] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-15T20:19:46.140435] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T20:19:46.150801] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-15T20:19:46.184141] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T20:19:46.195299] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-15T20:19:46.438138] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T20:19:46.442049] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-15T20:19:46.995149] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T20:19:46.999309] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-15T20:19:47.559123] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T20:19:47.571491] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-15T20:19:47.615269] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T20:19:47.658115] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-15T20:19:47.703472] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T20:19:47.747714] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T20:19:48.457901] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-15T20:19:49.125230] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:19:49.226554] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:19:49.252374] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T20:19:49.257802] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-15T20:19:50.057892] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-15T20:19:50.246729] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:19:50.857890] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-15T20:19:51.657899] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-15T20:19:51.871082] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:19:52.457907] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-15T20:19:52.576412] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T20:19:53.257901] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-15T20:19:53.428295] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T20:19:53.872005] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T20:19:54.057873] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-15T20:19:54.857883] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-15T20:19:55.314477] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T20:19:55.502508] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T20:19:55.657909] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-15T20:19:56.413377] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T20:19:56.457866] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-15T20:19:56.945275] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:19:57.257883] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-15T20:19:58.057832] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-15T20:19:58.488163] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:19:58.576537] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T20:19:58.578462] [INFO ] [REMOTE ] SCD: Full fetch complete (13068 records). [2025-09-15T20:19:58.578531] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-15T20:19:58.862947] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-15T20:19:58.968918] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-15T20:19:58.969009] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-15T20:19:58.969451] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-15T20:19:58.969533] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-15T20:19:58.970231] [DEBUG] [LOCAL ] SCD: Trimmed 13068 records to 10234 (keeping 150 days of data) [2025-09-15T20:19:59.057063] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T20:19:59.078520] [DEBUG] [LOCAL ] SCD: Primary data saved (10234 records). [2025-09-15T20:19:59.078683] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-15T20:19:59.078770] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCD took 17.7s. Estimated remaining: 51m 52s. Rate: 9.4 symbols/min [2025-09-15T20:19:59.247208] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:19:59.258969] [DEBUG] [LOCAL ] SCL: Loaded 10822 existing records from primary storage. [2025-09-15T20:19:59.259107] [INFO ] [MAIN ] SCL: Loaded 10822 existing records. [2025-09-15T20:19:59.439547] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:19:59.439897] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-15T20:19:59.439984] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-15T20:19:59.440586] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-15T20:19:59.440687] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-15T20:19:59.663078] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-15T20:19:59.796735] [INFO ] [REMOTE ] SCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:00.251044] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T20:20:00.256055] [INFO ] [REMOTE ] SCI: Full fetch complete (51222 records). [2025-09-15T20:20:00.256180] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-15T20:20:00.463080] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-15T20:20:00.647715] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-15T20:20:00.647814] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-15T20:20:00.648917] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-15T20:20:00.648975] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-15T20:20:00.650224] [DEBUG] [LOCAL ] SCI: Trimmed 51222 records to 34407 (keeping 150 days of data) [2025-09-15T20:20:00.887511] [DEBUG] [LOCAL ] SCI: Primary data saved (34407 records). [2025-09-15T20:20:00.887700] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-15T20:20:00.887828] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCI took 19.5s. Estimated remaining: 51m 45s. Rate: 9.4 symbols/min [2025-09-15T20:20:01.065503] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:01.080715] [DEBUG] [LOCAL ] SCM: Loaded 13776 existing records from primary storage. [2025-09-15T20:20:01.080863] [INFO ] [MAIN ] SCM: Loaded 13776 existing records. [2025-09-15T20:20:01.271972] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:01.272503] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-15T20:20:01.272663] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-15T20:20:01.266933] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-15T20:20:01.274343] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-15T20:20:01.274472] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-15T20:20:01.660300] [INFO ] [REMOTE ] SCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:01.693479] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T20:20:02.057925] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-15T20:20:02.857946] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-15T20:20:04.019123] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (3.56 seconds). [2025-09-15T20:20:04.022247] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-15T20:20:04.693052] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-15T20:20:04.696787] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-15T20:20:04.910247] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T20:20:05.131155] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (3.86 seconds). [2025-09-15T20:20:05.209581] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-15T20:20:05.215245] [INFO ] [REMOTE ] SCCO: Full fetch complete (53659 records). [2025-09-15T20:20:05.215451] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-15T20:20:05.263075] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-15T20:20:05.607883] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-15T20:20:05.607975] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-15T20:20:05.608986] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-15T20:20:05.609069] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-15T20:20:05.610330] [DEBUG] [LOCAL ] SCCO: Trimmed 53659 records to 36022 (keeping 150 days of data) [2025-09-15T20:20:05.840058] [DEBUG] [LOCAL ] SCCO: Primary data saved (36022 records). [2025-09-15T20:20:05.840204] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-15T20:20:05.840308] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCCO took 24.4s. Estimated remaining: 51m 38s. Rate: 9.4 symbols/min [2025-09-15T20:20:06.009558] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:06.046052] [DEBUG] [LOCAL ] SCS: Loaded 31859 existing records from primary storage. [2025-09-15T20:20:06.046235] [INFO ] [MAIN ] SCS: Loaded 31859 existing records. [2025-09-15T20:20:06.077725] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-15T20:20:06.227132] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:06.242735] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-15T20:20:06.244306] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T20:20:06.243482] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-15T20:20:06.250876] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-15T20:20:06.250958] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-15T20:20:06.420837] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T20:20:06.620364] [INFO ] [REMOTE ] SCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:06.857859] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-15T20:20:07.657916] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-15T20:20:08.129062] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T20:20:08.406264] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T20:20:08.457894] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-15T20:20:08.812426] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T20:20:09.173363] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:20:09.180172] [INFO ] [REMOTE ] SCHW: Full fetch complete (58365 records). [2025-09-15T20:20:09.180613] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-15T20:20:09.263077] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-15T20:20:09.575459] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-15T20:20:09.575547] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-15T20:20:09.576561] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-15T20:20:09.576616] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-15T20:20:09.577885] [DEBUG] [LOCAL ] SCHW: Trimmed 58365 records to 39645 (keeping 150 days of data) [2025-09-15T20:20:09.837079] [DEBUG] [LOCAL ] SCHW: Primary data saved (39645 records). [2025-09-15T20:20:09.837231] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-15T20:20:09.837331] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCHW took 28.4s. Estimated remaining: 51m 31s. Rate: 9.4 symbols/min [2025-09-15T20:20:10.005822] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:10.031235] [DEBUG] [LOCAL ] SD: Loaded 21092 existing records from primary storage. [2025-09-15T20:20:10.031392] [INFO ] [MAIN ] SD: Loaded 21092 existing records. [2025-09-15T20:20:10.062992] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-15T20:20:10.211467] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:10.211740] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-15T20:20:10.211792] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-15T20:20:10.212322] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-15T20:20:10.212372] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-15T20:20:10.562303] [INFO ] [REMOTE ] SD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:10.673179] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T20:20:10.857883] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-15T20:20:11.229272] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T20:20:11.657869] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-15T20:20:11.970968] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T20:20:12.457862] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-15T20:20:12.495153] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T20:20:13.257896] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-15T20:20:13.301019] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T20:20:14.057888] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-15T20:20:14.767604] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T20:20:14.857892] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-15T20:20:15.047908] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:20:15.657892] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-15T20:20:16.456442] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T20:20:16.463754] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-15T20:20:16.553711] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:20:17.257869] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-15T20:20:17.496181] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T20:20:18.057903] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-15T20:20:18.764285] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T20:20:18.857914] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-15T20:20:19.187975] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T20:20:19.657871] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-15T20:20:20.190870] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T20:20:20.311736] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T20:20:20.457837] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-15T20:20:21.257863] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-15T20:20:21.442154] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:20:21.444876] [INFO ] [REMOTE ] SCM: Full fetch complete (21634 records). [2025-09-15T20:20:21.444955] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-15T20:20:21.829324] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-15T20:20:21.829437] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-15T20:20:21.829914] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-15T20:20:21.829959] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-15T20:20:21.830529] [DEBUG] [LOCAL ] SCM: Trimmed 21634 records to 13544 (keeping 150 days of data) [2025-09-15T20:20:21.916744] [DEBUG] [LOCAL ] SCM: Primary data saved (13544 records). [2025-09-15T20:20:21.916898] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-15T20:20:21.916994] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SCM took 21.0s. Estimated remaining: 51m 26s. Rate: 9.4 symbols/min [2025-09-15T20:20:22.063002] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-15T20:20:22.087129] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:22.096481] [DEBUG] [LOCAL ] SDHC: Loaded 7254 existing records from primary storage. [2025-09-15T20:20:22.096608] [INFO ] [MAIN ] SDHC: Loaded 7254 existing records. [2025-09-15T20:20:22.271083] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:22.271325] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-15T20:20:22.271370] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-15T20:20:22.271713] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-15T20:20:22.271790] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-15T20:20:22.626616] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:22.645612] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T20:20:22.713361] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T20:20:22.716076] [INFO ] [REMOTE ] SCL: Full fetch complete (15850 records). [2025-09-15T20:20:22.716163] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-15T20:20:22.866692] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-15T20:20:23.093950] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-15T20:20:23.094029] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-15T20:20:23.094391] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-15T20:20:23.094433] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-15T20:20:23.094957] [DEBUG] [LOCAL ] SCL: Trimmed 15850 records to 10664 (keeping 150 days of data) [2025-09-15T20:20:23.161419] [DEBUG] [LOCAL ] SCL: Primary data saved (10664 records). [2025-09-15T20:20:23.161556] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-15T20:20:23.161662] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SCL took 24.1s. Estimated remaining: 51m 18s. Rate: 9.4 symbols/min [2025-09-15T20:20:23.370782] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:23.380910] [DEBUG] [LOCAL ] SDHY: Loaded 7727 existing records from primary storage. [2025-09-15T20:20:23.381070] [INFO ] [MAIN ] SDHY: Loaded 7727 existing records. [2025-09-15T20:20:23.562412] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:23.562708] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-15T20:20:23.562756] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-15T20:20:23.563095] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-15T20:20:23.563140] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-15T20:20:23.661768] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-15T20:20:23.970018] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:24.281400] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T20:20:24.457868] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-15T20:20:24.575677] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T20:20:25.257869] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-15T20:20:25.470193] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T20:20:25.997589] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:20:26.057877] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-15T20:20:26.857875] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-15T20:20:26.915911] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T20:20:27.657866] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-15T20:20:28.335868] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T20:20:28.370514] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:20:28.457884] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-15T20:20:29.257886] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-15T20:20:29.277934] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T20:20:29.932236] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T20:20:30.057869] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-15T20:20:30.857945] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-15T20:20:31.072963] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T20:20:31.657946] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-15T20:20:31.928745] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T20:20:32.447132] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T20:20:32.457830] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-15T20:20:33.102681] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T20:20:33.257873] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-15T20:20:34.057873] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-15T20:20:34.772608] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:20:34.790835] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T20:20:34.857822] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-15T20:20:35.657867] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-15T20:20:35.708661] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T20:20:36.457842] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-15T20:20:36.693240] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T20:20:37.167742] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:20:37.169551] [INFO ] [REMOTE ] SDHY: Full fetch complete (11622 records). [2025-09-15T20:20:37.169623] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-15T20:20:37.263094] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-15T20:20:37.568549] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-15T20:20:37.568721] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-15T20:20:37.569071] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-15T20:20:37.569130] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-15T20:20:37.569634] [DEBUG] [LOCAL ] SDHY: Trimmed 11622 records to 7627 (keeping 150 days of data) [2025-09-15T20:20:37.620366] [DEBUG] [LOCAL ] SDHY: Primary data saved (7627 records). [2025-09-15T20:20:37.620508] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-15T20:20:37.620597] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SDHY took 14.5s. Estimated remaining: 51m 14s. Rate: 9.4 symbols/min [2025-09-15T20:20:37.796536] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:37.830275] [DEBUG] [LOCAL ] SDRL: Loaded 30940 existing records from primary storage. [2025-09-15T20:20:37.830422] [INFO ] [MAIN ] SDRL: Loaded 30940 existing records. [2025-09-15T20:20:38.045346] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:38.045593] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-15T20:20:38.045663] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-15T20:20:38.046365] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-15T20:20:38.046415] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-15T20:20:38.066809] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-15T20:20:38.423225] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:38.447446] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T20:20:38.456170] [INFO ] [REMOTE ] SCS: Full fetch complete (45976 records). [2025-09-15T20:20:38.456378] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-15T20:20:38.859753] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-15T20:20:38.894093] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-15T20:20:38.894201] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-15T20:20:38.895240] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-15T20:20:38.895301] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-15T20:20:38.896591] [DEBUG] [LOCAL ] SCS: Trimmed 45976 records to 31263 (keeping 150 days of data) [2025-09-15T20:20:39.011046] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:20:39.112952] [DEBUG] [LOCAL ] SCS: Primary data saved (31263 records). [2025-09-15T20:20:39.113114] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-15T20:20:39.113197] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SCS took 33.3s. Estimated remaining: 51m 6s. Rate: 9.4 symbols/min [2025-09-15T20:20:39.299620] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:39.342146] [DEBUG] [LOCAL ] SE: Loaded 40176 existing records from primary storage. [2025-09-15T20:20:39.342312] [INFO ] [MAIN ] SE: Loaded 40176 existing records. [2025-09-15T20:20:39.517305] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:39.517565] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-15T20:20:39.517612] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-15T20:20:39.518638] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-15T20:20:39.518707] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-15T20:20:39.658036] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-15T20:20:39.877409] [INFO ] [REMOTE ] SE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:39.886497] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T20:20:39.889977] [INFO ] [REMOTE ] SD: Full fetch complete (31277 records). [2025-09-15T20:20:39.890053] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-15T20:20:40.266354] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-15T20:20:40.266464] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-15T20:20:40.267240] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-15T20:20:40.267301] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-15T20:20:40.268560] [DEBUG] [LOCAL ] SD: Trimmed 31277 records to 20654 (keeping 150 days of data) [2025-09-15T20:20:40.403955] [DEBUG] [LOCAL ] SD: Primary data saved (20654 records). [2025-09-15T20:20:40.404090] [INFO ] [MAIN ] SD: Full history saved. [2025-09-15T20:20:40.404225] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SD took 30.6s. Estimated remaining: 50m 59s. Rate: 9.4 symbols/min [2025-09-15T20:20:40.468364] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-15T20:20:40.580801] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:40.589193] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T20:20:40.631001] [DEBUG] [LOCAL ] SEE: Loaded 35894 existing records from primary storage. [2025-09-15T20:20:40.631148] [INFO ] [MAIN ] SEE: Loaded 35894 existing records. [2025-09-15T20:20:40.810314] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:40.810716] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-15T20:20:40.811407] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-15T20:20:40.812261] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-15T20:20:40.812318] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-15T20:20:41.200179] [INFO ] [REMOTE ] SEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:41.257921] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-15T20:20:41.894845] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T20:20:42.059207] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-15T20:20:42.062073] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:20:42.857878] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-15T20:20:43.343144] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T20:20:43.551398] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:20:43.552969] [INFO ] [REMOTE ] SDHC: Full fetch complete (11743 records). [2025-09-15T20:20:43.553041] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-15T20:20:43.662942] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-15T20:20:43.915286] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-15T20:20:43.915408] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-15T20:20:43.915708] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-15T20:20:43.915753] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-15T20:20:43.916241] [DEBUG] [LOCAL ] SDHC: Trimmed 11743 records to 7184 (keeping 150 days of data) [2025-09-15T20:20:43.960002] [DEBUG] [LOCAL ] SDHC: Primary data saved (7184 records). [2025-09-15T20:20:43.960118] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-15T20:20:43.960211] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SDHC took 22.0s. Estimated remaining: 50m 52s. Rate: 9.4 symbols/min [2025-09-15T20:20:44.131244] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:20:44.142062] [DEBUG] [LOCAL ] SEG: Loaded 9710 existing records from primary storage. [2025-09-15T20:20:44.142161] [INFO ] [MAIN ] SEG: Loaded 9710 existing records. [2025-09-15T20:20:44.338219] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:20:44.338494] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-15T20:20:44.338541] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-15T20:20:44.338875] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-15T20:20:44.338923] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-15T20:20:44.462929] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-15T20:20:44.714959] [INFO ] [REMOTE ] SEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:20:45.257879] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-15T20:20:45.946109] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-15T20:20:45.986297] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T20:20:46.057849] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-15T20:20:46.740809] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T20:20:46.857880] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-15T20:20:47.657906] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-15T20:20:47.889812] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:20:48.181327] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T20:20:48.457878] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-15T20:20:49.257944] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-15T20:20:49.670811] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:20:49.968923] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T20:20:50.057858] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-15T20:20:50.563334] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:20:50.857867] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-15T20:20:51.657886] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-15T20:20:51.814334] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:20:52.457903] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-15T20:20:52.526683] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T20:20:52.683432] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T20:20:53.257882] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-15T20:20:54.057917] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-15T20:20:54.133374] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T20:20:54.857931] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-15T20:20:55.054322] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T20:20:55.407047] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:20:55.657903] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-15T20:20:56.129208] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T20:20:56.457920] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-15T20:20:57.257958] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-15T20:20:57.690237] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:20:57.858161] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T20:20:58.057925] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-15T20:20:58.478131] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T20:20:58.857878] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-15T20:20:59.657869] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-15T20:20:59.874052] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T20:21:00.357773] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T20:21:00.381335] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T20:21:00.457876] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-15T20:21:01.257876] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-15T20:21:02.057935] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-15T20:21:02.119111] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T20:21:02.124511] [INFO ] [REMOTE ] SEE: Full fetch complete (52702 records). [2025-09-15T20:21:02.124636] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-15T20:21:02.518090] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-15T20:21:02.518294] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-15T20:21:02.519851] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-15T20:21:02.519905] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-15T20:21:02.521701] [DEBUG] [LOCAL ] SEE: Trimmed 52702 records to 35145 (keeping 150 days of data) [2025-09-15T20:21:02.773306] [DEBUG] [LOCAL ] SEE: Primary data saved (35145 records). [2025-09-15T20:21:02.773532] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-15T20:21:02.774452] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SEE took 22.4s. Estimated remaining: 50m 48s. Rate: 9.4 symbols/min [2025-09-15T20:21:02.869342] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-15T20:21:02.954585] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:03.004293] [DEBUG] [LOCAL ] SEI: Loaded 36952 existing records from primary storage. [2025-09-15T20:21:03.004590] [INFO ] [MAIN ] SEI: Loaded 36952 existing records. [2025-09-15T20:21:03.192233] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:03.206614] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-15T20:21:03.206806] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-15T20:21:03.208798] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-15T20:21:03.208716] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T20:21:03.208903] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-15T20:21:03.298288] [INFO ] [REMOTE ] SDRL: Full fetch complete (46443 records). [2025-09-15T20:21:03.320798] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-15T20:21:03.989967] [INFO ] [REMOTE ] SEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:04.006383] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-15T20:21:04.072750] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-15T20:21:04.072872] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-15T20:21:04.074002] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-15T20:21:04.074086] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-15T20:21:04.075767] [DEBUG] [LOCAL ] SDRL: Trimmed 46443 records to 30303 (keeping 150 days of data) [2025-09-15T20:21:04.268204] [DEBUG] [LOCAL ] SDRL: Primary data saved (30303 records). [2025-09-15T20:21:04.268395] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-15T20:21:04.268517] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SDRL took 26.6s. Estimated remaining: 50m 41s. Rate: 9.4 symbols/min [2025-09-15T20:21:04.441357] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:04.477332] [DEBUG] [LOCAL ] SEM: Loaded 32787 existing records from primary storage. [2025-09-15T20:21:04.477557] [INFO ] [MAIN ] SEM: Loaded 32787 existing records. [2025-09-15T20:21:04.654764] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:04.655010] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-15T20:21:04.655062] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-15T20:21:04.655837] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-15T20:21:04.655891] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-15T20:21:05.038707] [INFO ] [REMOTE ] SEM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:05.039118] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-15T20:21:05.049892] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-15T20:21:05.257942] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-15T20:21:05.293092] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-09-15T20:21:05.301231] [INFO ] [REMOTE ] SE: Full fetch complete (58058 records). [2025-09-15T20:21:05.301414] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-15T20:21:05.697607] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-15T20:21:05.697715] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-15T20:21:05.698661] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-15T20:21:05.698706] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-15T20:21:05.700412] [DEBUG] [LOCAL ] SE: Trimmed 58058 records to 39397 (keeping 150 days of data) [2025-09-15T20:21:05.827405] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T20:21:05.980117] [DEBUG] [LOCAL ] SE: Primary data saved (39397 records). [2025-09-15T20:21:05.980268] [INFO ] [MAIN ] SE: Full history saved. [2025-09-15T20:21:05.981415] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SE took 26.9s. Estimated remaining: 50m 33s. Rate: 9.4 symbols/min [2025-09-15T20:21:06.072601] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-15T20:21:06.155563] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:06.164389] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T20:21:06.195797] [DEBUG] [LOCAL ] SEMR: Loaded 31104 existing records from primary storage. [2025-09-15T20:21:06.195940] [INFO ] [MAIN ] SEMR: Loaded 31104 existing records. [2025-09-15T20:21:06.374012] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:06.374403] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-15T20:21:06.374509] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-15T20:21:06.375170] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-15T20:21:06.375224] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-15T20:21:06.583820] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:21:06.764708] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:06.857890] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-15T20:21:07.657931] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-15T20:21:07.905305] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:21:08.347156] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T20:21:08.457885] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-15T20:21:09.131074] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:21:09.257877] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-15T20:21:09.892150] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T20:21:10.057905] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-15T20:21:10.857880] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-15T20:21:11.041944] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T20:21:11.496749] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T20:21:11.657873] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-15T20:21:12.229358] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:21:12.457924] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-15T20:21:13.257943] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-15T20:21:14.057887] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-15T20:21:14.296723] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-15T20:21:14.857894] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-15T20:21:14.940215] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:21:15.135095] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-15T20:21:15.250119] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T20:21:15.657879] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-15T20:21:16.017861] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T20:21:16.457876] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-15T20:21:17.190956] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T20:21:17.257921] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-15T20:21:17.787060] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:21:18.057876] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-15T20:21:18.857939] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-15T20:21:18.974214] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T20:21:19.426361] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T20:21:19.657826] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-15T20:21:20.445392] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:21:20.457831] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-15T20:21:21.262604] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-15T20:21:21.269136] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T20:21:21.949187] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T20:21:22.057829] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-15T20:21:22.111054] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T20:21:22.857891] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-15T20:21:23.657950] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-15T20:21:23.770342] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T20:21:24.355367] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:21:24.361443] [INFO ] [REMOTE ] SEMR: Full fetch complete (45096 records). [2025-09-15T20:21:24.361638] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-15T20:21:24.463024] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-15T20:21:24.811879] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-15T20:21:24.812535] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-15T20:21:24.813404] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-15T20:21:24.814326] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:21:24.814458] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-15T20:21:24.820858] [DEBUG] [LOCAL ] SEMR: Trimmed 45096 records to 30594 (keeping 150 days of data) [2025-09-15T20:21:25.003963] [DEBUG] [LOCAL ] SEMR: Primary data saved (30594 records). [2025-09-15T20:21:25.004102] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-15T20:21:25.004199] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEMR took 19.0s. Estimated remaining: 50m 30s. Rate: 9.4 symbols/min [2025-09-15T20:21:25.223612] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:25.262999] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-15T20:21:25.265422] [DEBUG] [LOCAL ] SES: Loaded 38498 existing records from primary storage. [2025-09-15T20:21:25.265590] [INFO ] [MAIN ] SES: Loaded 38498 existing records. [2025-09-15T20:21:25.455755] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:25.456018] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-15T20:21:25.456065] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-15T20:21:25.456960] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-15T20:21:25.457014] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-15T20:21:25.751873] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:21:25.767469] [INFO ] [REMOTE ] SEM: Full fetch complete (46771 records). [2025-09-15T20:21:25.777796] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-15T20:21:25.934855] [INFO ] [REMOTE ] SES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:26.062935] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-15T20:21:26.221539] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-15T20:21:26.221623] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-15T20:21:26.222595] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-15T20:21:26.222664] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-15T20:21:26.223763] [DEBUG] [LOCAL ] SEM: Trimmed 46771 records to 32216 (keeping 150 days of data) [2025-09-15T20:21:26.432418] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:21:26.442895] [INFO ] [REMOTE ] SEI: Full fetch complete (53382 records). [2025-09-15T20:21:26.445024] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-15T20:21:26.568013] [DEBUG] [LOCAL ] SEM: Primary data saved (32216 records). [2025-09-15T20:21:26.573959] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-15T20:21:26.579872] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SEM took 22.3s. Estimated remaining: 50m 22s. Rate: 9.4 symbols/min [2025-09-15T20:21:26.834973] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:21:26.859183] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-15T20:21:26.938615] [INFO ] [REMOTE ] SEG: Full fetch complete (15697 records). [2025-09-15T20:21:26.954756] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-15T20:21:26.944114] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:27.185350] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-15T20:21:27.188313] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-15T20:21:27.189889] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-15T20:21:27.190060] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-15T20:21:27.261723] [DEBUG] [LOCAL ] SEI: Trimmed 53382 records to 36257 (keeping 150 days of data) [2025-09-15T20:21:27.535441] [DEBUG] [LOCAL ] SF: Loaded 30808 existing records from primary storage. [2025-09-15T20:21:27.549607] [INFO ] [MAIN ] SF: Loaded 30808 existing records. [2025-09-15T20:21:27.759050] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-15T20:21:27.785002] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-15T20:21:27.794335] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-15T20:21:27.796191] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-15T20:21:27.817917] [DEBUG] [LOCAL ] SEG: Trimmed 15697 records to 9597 (keeping 150 days of data) [2025-09-15T20:21:27.933049] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:27.956224] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-15T20:21:27.958906] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-15T20:21:28.031758] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-15T20:21:28.060734] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-15T20:21:28.091121] [DEBUG] [LOCAL ] SEG: Primary data saved (9597 records). [2025-09-15T20:21:28.091223] [DEBUG] [LOCAL ] SEI: Primary data saved (36257 records). [2025-09-15T20:21:28.125498] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-15T20:21:28.106876] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-15T20:21:28.140856] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SEI took 25.4s. Estimated remaining: 50m 15s. Rate: 9.4 symbols/min [2025-09-15T20:21:28.170701] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SEG took 44.2s. Estimated remaining: 50m 7s. Rate: 9.4 symbols/min [2025-09-15T20:21:28.721369] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:28.741612] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:28.823735] [INFO ] [REMOTE ] SF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:28.824588] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-15T20:21:28.828193] [DEBUG] [LOCAL ] SFB: Loaded 2633 existing records from primary storage. [2025-09-15T20:21:28.828360] [INFO ] [MAIN ] SFB: Loaded 2633 existing records. [2025-09-15T20:21:28.942634] [DEBUG] [LOCAL ] SFBS: Loaded 15651 existing records from primary storage. [2025-09-15T20:21:28.958943] [INFO ] [MAIN ] SFBS: Loaded 15651 existing records. [2025-09-15T20:21:29.061032] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:29.136745] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-15T20:21:29.137076] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-15T20:21:29.147938] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-15T20:21:29.153290] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-15T20:21:29.262713] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:29.285447] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-15T20:21:29.297468] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-15T20:21:29.331248] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-15T20:21:29.366990] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-15T20:21:29.651024] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-15T20:21:29.790343] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-15T20:21:29.823666] [INFO ] [REMOTE ] SFB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:29.850249] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-15T20:21:30.010514] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:30.057848] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-15T20:21:30.088585] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T20:21:30.432515] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T20:21:30.819292] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T20:21:30.857849] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-15T20:21:31.657886] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-15T20:21:31.740383] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:21:32.094485] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-15T20:21:32.450086] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:21:32.457803] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-15T20:21:33.035313] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T20:21:33.257871] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-15T20:21:34.057895] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-15T20:21:34.568045] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T20:21:34.857846] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-15T20:21:35.274568] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T20:21:35.657907] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-15T20:21:36.308361] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:21:36.372739] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T20:21:36.457871] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-15T20:21:37.101254] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T20:21:37.257881] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-15T20:21:37.752022] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T20:21:38.057848] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-15T20:21:38.857893] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-15T20:21:39.657895] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-15T20:21:40.278198] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T20:21:40.354375] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T20:21:40.445908] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:21:40.457894] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-15T20:21:41.257914] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-15T20:21:41.553883] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T20:21:42.057919] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-15T20:21:42.775160] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T20:21:42.857867] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-15T20:21:43.657928] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-15T20:21:44.118476] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T20:21:44.331820] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:21:44.354537] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T20:21:44.457867] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-15T20:21:45.257903] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-15T20:21:45.919043] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:21:46.029208] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:21:46.031905] [INFO ] [REMOTE ] SFBS: Full fetch complete (22962 records). [2025-09-15T20:21:46.031979] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-15T20:21:46.062970] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-15T20:21:46.400143] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-15T20:21:46.400270] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-15T20:21:46.400877] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-15T20:21:46.400938] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-15T20:21:46.402068] [DEBUG] [LOCAL ] SFBS: Trimmed 22962 records to 15262 (keeping 150 days of data) [2025-09-15T20:21:46.504265] [DEBUG] [LOCAL ] SFBS: Primary data saved (15262 records). [2025-09-15T20:21:46.504431] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-15T20:21:46.504523] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SFBS took 18.3s. Estimated remaining: 50m 3s. Rate: 9.4 symbols/min [2025-09-15T20:21:46.680809] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:46.715901] [DEBUG] [LOCAL ] SFL: Loaded 33415 existing records from primary storage. [2025-09-15T20:21:46.716065] [INFO ] [MAIN ] SFL: Loaded 33415 existing records. [2025-09-15T20:21:46.865878] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T20:21:46.904534] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:46.865967] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-15T20:21:46.906528] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-15T20:21:46.906749] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-15T20:21:46.907540] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-15T20:21:46.907597] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-15T20:21:47.258910] [INFO ] [REMOTE ] SFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:47.657869] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-15T20:21:48.199235] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T20:21:48.457906] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-15T20:21:48.775055] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T20:21:49.257892] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-15T20:21:49.913330] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T20:21:50.057900] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-15T20:21:50.857920] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-15T20:21:51.209502] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T20:21:51.334402] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T20:21:51.352409] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T20:21:51.353338] [INFO ] [REMOTE ] SFB: Full fetch complete (4352 records). [2025-09-15T20:21:51.353406] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-15T20:21:51.663018] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-15T20:21:51.717219] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-15T20:21:51.717298] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-15T20:21:51.717423] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-15T20:21:51.717461] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-15T20:21:51.717858] [DEBUG] [LOCAL ] SFB: Trimmed 4352 records to 2574 (keeping 150 days of data) [2025-09-15T20:21:51.734704] [DEBUG] [LOCAL ] SFB: Primary data saved (2574 records). [2025-09-15T20:21:51.734771] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-15T20:21:51.734840] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SFB took 23.6s. Estimated remaining: 49m 57s. Rate: 9.4 symbols/min [2025-09-15T20:21:51.911677] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:51.957699] [DEBUG] [LOCAL ] SG: Loaded 40295 existing records from primary storage. [2025-09-15T20:21:51.957854] [INFO ] [MAIN ] SG: Loaded 40295 existing records. [2025-09-15T20:21:52.138321] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:52.139162] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-15T20:21:52.139216] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-15T20:21:52.140366] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-15T20:21:52.140421] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-15T20:21:52.470203] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-15T20:21:52.513519] [INFO ] [REMOTE ] SG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:52.895189] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:21:52.899715] [INFO ] [REMOTE ] SF: Full fetch complete (45436 records). [2025-09-15T20:21:52.899807] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-15T20:21:53.265443] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-15T20:21:53.281852] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-15T20:21:53.281934] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-15T20:21:53.282865] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-15T20:21:53.282919] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-15T20:21:53.283885] [DEBUG] [LOCAL ] SF: Trimmed 45436 records to 30057 (keeping 150 days of data) [2025-09-15T20:21:53.486276] [DEBUG] [LOCAL ] SF: Primary data saved (30057 records). [2025-09-15T20:21:53.486447] [INFO ] [MAIN ] SF: Full history saved. [2025-09-15T20:21:53.486551] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SF took 26.9s. Estimated remaining: 49m 49s. Rate: 9.4 symbols/min [2025-09-15T20:21:53.663255] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:53.700749] [DEBUG] [LOCAL ] SGHC: Loaded 34823 existing records from primary storage. [2025-09-15T20:21:53.700907] [INFO ] [MAIN ] SGHC: Loaded 34823 existing records. [2025-09-15T20:21:53.886834] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:21:53.887068] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-15T20:21:53.887115] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-15T20:21:53.887876] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-15T20:21:53.887929] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-15T20:21:54.067735] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-15T20:21:54.268769] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:21:54.298263] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T20:21:54.857892] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-15T20:21:55.127921] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T20:21:55.657907] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-15T20:21:55.747153] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T20:21:56.299390] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T20:21:56.457886] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-15T20:21:57.263392] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-15T20:21:57.266349] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T20:21:57.477369] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T20:21:58.058000] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-15T20:21:58.797683] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T20:21:58.805253] [INFO ] [REMOTE ] SES: Full fetch complete (56217 records). [2025-09-15T20:21:58.805483] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-15T20:21:58.865751] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-15T20:21:59.224265] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-15T20:21:59.224406] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-15T20:21:59.226200] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-15T20:21:59.226362] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-15T20:21:59.261409] [DEBUG] [LOCAL ] SES: Trimmed 56217 records to 37762 (keeping 150 days of data) [2025-09-15T20:21:59.263008] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T20:21:59.509153] [DEBUG] [LOCAL ] SES: Primary data saved (37762 records). [2025-09-15T20:21:59.509322] [INFO ] [MAIN ] SES: Full history saved. [2025-09-15T20:21:59.510098] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SES took 34.5s. Estimated remaining: 49m 43s. Rate: 9.4 symbols/min [2025-09-15T20:21:59.664821] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-15T20:21:59.685355] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:21:59.686511] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-15T20:21:59.686555] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-15T20:21:59.686705] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-15T20:21:59.686748] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-15T20:21:59.686791] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-15T20:21:59.686825] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-15T20:22:00.054138] [INFO ] [REMOTE ] SGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:00.457897] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-15T20:22:00.498581] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T20:22:01.214591] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T20:22:01.257823] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-15T20:22:02.057900] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-15T20:22:02.494384] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-15T20:22:02.857877] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-15T20:22:02.959156] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T20:22:03.360418] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T20:22:03.657880] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-15T20:22:04.457883] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-15T20:22:04.617801] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:22:05.104733] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T20:22:05.257883] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-15T20:22:06.057920] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-15T20:22:06.091769] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T20:22:06.857897] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-15T20:22:07.035805] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T20:22:07.256278] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T20:22:07.657919] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-15T20:22:08.184487] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T20:22:08.189591] [INFO ] [REMOTE ] SFL: Full fetch complete (49811 records). [2025-09-15T20:22:08.189739] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-15T20:22:08.463006] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-15T20:22:08.589313] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-15T20:22:08.589418] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-15T20:22:08.590379] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-15T20:22:08.590437] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-15T20:22:08.591659] [DEBUG] [LOCAL ] SFL: Trimmed 49811 records to 32732 (keeping 150 days of data) [2025-09-15T20:22:08.797325] [DEBUG] [LOCAL ] SFL: Primary data saved (32732 records). [2025-09-15T20:22:08.797485] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-15T20:22:08.797600] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SFL took 22.3s. Estimated remaining: 49m 37s. Rate: 9.4 symbols/min [2025-09-15T20:22:08.969669] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:08.976526] [DEBUG] [LOCAL ] SGU: Loaded 5139 existing records from primary storage. [2025-09-15T20:22:08.976626] [INFO ] [MAIN ] SGU: Loaded 5139 existing records. [2025-09-15T20:22:09.156279] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:09.156546] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-15T20:22:09.156598] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-15T20:22:09.156883] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-15T20:22:09.156933] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-15T20:22:09.263036] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-15T20:22:09.511254] [INFO ] [REMOTE ] SGU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:09.547534] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:22:09.931831] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:22:10.057880] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-15T20:22:10.727265] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T20:22:10.838235] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T20:22:10.857822] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-15T20:22:11.657883] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-15T20:22:12.261911] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T20:22:12.394669] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:22:12.457837] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-15T20:22:13.141207] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T20:22:13.257860] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-15T20:22:14.057871] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-15T20:22:14.857856] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-15T20:22:15.342316] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T20:22:15.492530] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:22:15.501817] [INFO ] [REMOTE ] SGHC: Full fetch complete (49031 records). [2025-09-15T20:22:15.502430] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-15T20:22:15.502377] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T20:22:15.660515] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-15T20:22:15.889310] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-15T20:22:15.889389] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-15T20:22:15.890285] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-15T20:22:15.890332] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-15T20:22:15.891370] [DEBUG] [LOCAL ] SGHC: Trimmed 49031 records to 34314 (keeping 150 days of data) [2025-09-15T20:22:16.099659] [DEBUG] [LOCAL ] SGHC: Primary data saved (34314 records). [2025-09-15T20:22:16.099799] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-15T20:22:16.100491] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SGHC took 22.6s. Estimated remaining: 49m 31s. Rate: 9.4 symbols/min [2025-09-15T20:22:16.270206] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:16.309180] [DEBUG] [LOCAL ] SHAK: Loaded 36751 existing records from primary storage. [2025-09-15T20:22:16.309324] [INFO ] [MAIN ] SHAK: Loaded 36751 existing records. [2025-09-15T20:22:16.462943] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-15T20:22:16.491158] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:16.491349] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-15T20:22:16.491398] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-15T20:22:16.492117] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-15T20:22:16.492167] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-15T20:22:16.845538] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:17.257935] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-15T20:22:17.376847] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T20:22:17.382632] [INFO ] [REMOTE ] SG: Full fetch complete (58135 records). [2025-09-15T20:22:17.382752] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-15T20:22:17.759730] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-15T20:22:17.759844] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-15T20:22:17.760775] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-15T20:22:17.760821] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-15T20:22:17.762255] [DEBUG] [LOCAL ] SG: Trimmed 58135 records to 39519 (keeping 150 days of data) [2025-09-15T20:22:18.023133] [DEBUG] [LOCAL ] SG: Primary data saved (39519 records). [2025-09-15T20:22:18.023304] [INFO ] [MAIN ] SG: Full history saved. [2025-09-15T20:22:18.024146] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SG took 26.3s. Estimated remaining: 49m 24s. Rate: 9.4 symbols/min [2025-09-15T20:22:18.067052] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-15T20:22:18.202838] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:22:18.244001] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:18.265412] [DEBUG] [LOCAL ] SHCO: Loaded 18424 existing records from primary storage. [2025-09-15T20:22:18.265560] [INFO ] [MAIN ] SHCO: Loaded 18424 existing records. [2025-09-15T20:22:18.444820] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:18.445079] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-15T20:22:18.445126] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-15T20:22:18.445572] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-15T20:22:18.445621] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-15T20:22:18.795804] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:18.842395] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T20:22:18.865756] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-15T20:22:18.883980] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T20:22:19.657909] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-15T20:22:20.276171] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T20:22:20.457928] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-15T20:22:20.679491] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:22:21.261062] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-15T20:22:21.264007] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T20:22:22.057844] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-15T20:22:22.433133] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T20:22:22.752780] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:22:22.754383] [INFO ] [REMOTE ] SGU: Full fetch complete (7037 records). [2025-09-15T20:22:22.754453] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-15T20:22:22.863068] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-15T20:22:23.144587] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-15T20:22:23.144688] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-15T20:22:23.144898] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-15T20:22:23.144936] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-15T20:22:23.145354] [DEBUG] [LOCAL ] SGU: Trimmed 7037 records to 5060 (keeping 150 days of data) [2025-09-15T20:22:23.176843] [DEBUG] [LOCAL ] SGU: Primary data saved (5060 records). [2025-09-15T20:22:23.176915] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-15T20:22:23.177001] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SGU took 14.4s. Estimated remaining: 49m 17s. Rate: 9.4 symbols/min [2025-09-15T20:22:23.343200] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:23.380786] [DEBUG] [LOCAL ] SHEL: Loaded 40417 existing records from primary storage. [2025-09-15T20:22:23.380929] [INFO ] [MAIN ] SHEL: Loaded 40417 existing records. [2025-09-15T20:22:23.561676] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:23.562002] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-15T20:22:23.562059] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-15T20:22:23.562948] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-15T20:22:23.563007] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-15T20:22:23.661028] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-15T20:22:23.916911] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:24.471992] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-15T20:22:24.474759] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:22:25.137211] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:22:25.257894] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-15T20:22:25.448316] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:22:26.057936] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-15T20:22:26.857876] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-15T20:22:27.053619] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:22:27.595606] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T20:22:27.657919] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-15T20:22:28.457914] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-15T20:22:28.745136] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:22:29.257909] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-15T20:22:29.526055] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T20:22:30.057889] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-15T20:22:30.488424] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T20:22:30.576953] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T20:22:30.857898] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-15T20:22:31.361254] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T20:22:31.657867] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-15T20:22:32.457875] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-15T20:22:32.684835] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T20:22:32.714974] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T20:22:33.257874] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-15T20:22:33.974045] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T20:22:34.057845] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-15T20:22:34.775878] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T20:22:34.857828] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-15T20:22:35.658750] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-15T20:22:35.663942] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T20:22:35.670255] [INFO ] [REMOTE ] SGI: Full fetch complete (54914 records). [2025-09-15T20:22:35.670416] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-15T20:22:35.875574] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-15T20:22:35.876238] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:22:35.876316] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:22:35.876365] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-15T20:22:35.876500] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-15T20:22:35.876546] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-15T20:22:35.876598] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-15T20:22:35.876688] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SGI took 36.4s. Estimated remaining: 49m 12s. Rate: 9.4 symbols/min [2025-09-15T20:22:36.058099] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:36.081183] [DEBUG] [LOCAL ] SHG: Loaded 19301 existing records from primary storage. [2025-09-15T20:22:36.081345] [INFO ] [MAIN ] SHG: Loaded 19301 existing records. [2025-09-15T20:22:36.259911] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:36.260182] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-15T20:22:36.260229] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-15T20:22:36.260824] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-15T20:22:36.260875] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-15T20:22:36.477729] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-15T20:22:36.629576] [INFO ] [REMOTE ] SHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:36.716579] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T20:22:37.261053] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-15T20:22:37.265199] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T20:22:37.353900] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:22:38.057951] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-15T20:22:38.857849] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-15T20:22:39.343527] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T20:22:39.376127] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:22:39.657895] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-15T20:22:40.457907] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-15T20:22:40.578535] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T20:22:40.853680] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T20:22:41.257892] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-15T20:22:41.758983] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T20:22:42.057913] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-15T20:22:42.511702] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:22:42.517025] [INFO ] [REMOTE ] SHAK: Full fetch complete (53775 records). [2025-09-15T20:22:42.517125] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-15T20:22:42.876215] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-15T20:22:42.894290] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-15T20:22:42.895077] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-15T20:22:42.896004] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-15T20:22:42.896145] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-15T20:22:42.897355] [DEBUG] [LOCAL ] SHAK: Trimmed 53775 records to 36037 (keeping 150 days of data) [2025-09-15T20:22:43.133270] [DEBUG] [LOCAL ] SHAK: Primary data saved (36037 records). [2025-09-15T20:22:43.133499] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-15T20:22:43.134587] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHAK took 27.0s. Estimated remaining: 49m 6s. Rate: 9.4 symbols/min [2025-09-15T20:22:43.320463] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:43.366301] [DEBUG] [LOCAL ] SHO: Loaded 37266 existing records from primary storage. [2025-09-15T20:22:43.366462] [INFO ] [MAIN ] SHO: Loaded 37266 existing records. [2025-09-15T20:22:43.549002] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:43.549392] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-15T20:22:43.549477] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-15T20:22:43.550544] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-15T20:22:43.550605] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-15T20:22:43.664459] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-15T20:22:43.680057] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:22:43.945062] [INFO ] [REMOTE ] SHO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:43.957226] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T20:22:43.961433] [INFO ] [REMOTE ] SHCO: Full fetch complete (28214 records). [2025-09-15T20:22:43.961605] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-15T20:22:44.342041] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-15T20:22:44.342130] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-15T20:22:44.342825] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-15T20:22:44.342872] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-15T20:22:44.343826] [DEBUG] [LOCAL ] SHCO: Trimmed 28214 records to 18137 (keeping 150 days of data) [2025-09-15T20:22:44.458057] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-15T20:22:44.464067] [DEBUG] [LOCAL ] SHCO: Primary data saved (18137 records). [2025-09-15T20:22:44.464299] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-15T20:22:44.464474] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SHCO took 26.4s. Estimated remaining: 48m 58s. Rate: 9.4 symbols/min [2025-09-15T20:22:44.640854] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:44.645861] [DEBUG] [LOCAL ] SHOC: Loaded 2100 existing records from primary storage. [2025-09-15T20:22:44.645966] [INFO ] [MAIN ] SHOC: Loaded 2100 existing records. [2025-09-15T20:22:44.826419] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:44.826804] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-15T20:22:44.826869] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-15T20:22:44.827060] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-15T20:22:44.827103] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-15T20:22:45.173036] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:45.257897] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-15T20:22:45.477169] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:22:45.785597] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T20:22:46.058596] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-15T20:22:46.061554] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T20:22:46.857947] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-15T20:22:46.872737] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T20:22:47.658091] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-15T20:22:47.931809] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T20:22:48.457920] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-15T20:22:48.998821] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:22:49.005540] [INFO ] [REMOTE ] SHEL: Full fetch complete (58345 records). [2025-09-15T20:22:49.005747] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-15T20:22:49.267074] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-15T20:22:49.440925] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-15T20:22:49.441214] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-15T20:22:49.445801] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-15T20:22:49.445966] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-15T20:22:49.448727] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T20:22:49.456421] [DEBUG] [LOCAL ] SHEL: Trimmed 58345 records to 39637 (keeping 150 days of data) [2025-09-15T20:22:49.733920] [DEBUG] [LOCAL ] SHEL: Primary data saved (39637 records). [2025-09-15T20:22:49.734145] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-15T20:22:49.734300] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SHEL took 26.6s. Estimated remaining: 48m 52s. Rate: 9.4 symbols/min [2025-09-15T20:22:49.914032] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:49.960258] [DEBUG] [LOCAL ] SHW: Loaded 37713 existing records from primary storage. [2025-09-15T20:22:49.960504] [INFO ] [MAIN ] SHW: Loaded 37713 existing records. [2025-09-15T20:22:50.063491] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-15T20:22:50.074258] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T20:22:50.157617] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:22:50.158060] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-15T20:22:50.158111] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-15T20:22:50.159099] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-15T20:22:50.159157] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-15T20:22:50.528449] [INFO ] [REMOTE ] SHW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:22:50.857918] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-15T20:22:51.361225] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T20:22:51.458995] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:22:51.657884] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-15T20:22:52.448214] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:22:52.457814] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-15T20:22:53.257901] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-15T20:22:53.788113] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:22:54.057885] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-15T20:22:54.616148] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T20:22:54.747260] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:22:54.857845] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-15T20:22:55.368792] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T20:22:55.657862] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-15T20:22:56.457844] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-15T20:22:56.753025] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:22:56.993126] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T20:22:57.257940] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-15T20:22:58.057885] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-15T20:22:58.857855] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-15T20:22:59.053000] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T20:22:59.056595] [INFO ] [REMOTE ] SHG: Full fetch complete (31077 records). [2025-09-15T20:22:59.056699] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-15T20:22:59.462922] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-15T20:22:59.486176] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-15T20:22:59.486272] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-15T20:22:59.486998] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-15T20:22:59.487046] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-15T20:22:59.487922] [DEBUG] [LOCAL ] SHG: Trimmed 31077 records to 18956 (keeping 150 days of data) [2025-09-15T20:22:59.617001] [DEBUG] [LOCAL ] SHG: Primary data saved (18956 records). [2025-09-15T20:22:59.617164] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-15T20:22:59.617259] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHG took 23.7s. Estimated remaining: 48m 46s. Rate: 9.4 symbols/min [2025-09-15T20:22:59.663122] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-15T20:22:59.791817] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:22:59.792001] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-15T20:22:59.792038] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-15T20:22:59.792208] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-15T20:22:59.792257] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-15T20:22:59.792300] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-15T20:22:59.792332] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-15T20:23:00.141145] [INFO ] [REMOTE ] SI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:00.203719] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T20:23:00.204907] [INFO ] [REMOTE ] SHOC: Full fetch complete (4808 records). [2025-09-15T20:23:00.205027] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-15T20:23:00.465379] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-15T20:23:00.568572] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-15T20:23:00.568678] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-15T20:23:00.568852] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-15T20:23:00.568892] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-15T20:23:00.569252] [DEBUG] [LOCAL ] SHOC: Trimmed 4808 records to 2053 (keeping 150 days of data) [2025-09-15T20:23:00.583040] [DEBUG] [LOCAL ] SHOC: Primary data saved (2053 records). [2025-09-15T20:23:00.583108] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-15T20:23:00.583179] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHOC took 16.1s. Estimated remaining: 48m 38s. Rate: 9.4 symbols/min [2025-09-15T20:23:00.748469] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:00.786763] [DEBUG] [LOCAL ] SID: Loaded 31896 existing records from primary storage. [2025-09-15T20:23:00.786908] [INFO ] [MAIN ] SID: Loaded 31896 existing records. [2025-09-15T20:23:00.958689] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:00.958951] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-15T20:23:00.958998] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-15T20:23:00.959784] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-15T20:23:00.959835] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-15T20:23:01.271263] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-15T20:23:01.308917] [INFO ] [REMOTE ] SID: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:02.057933] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-15T20:23:02.243063] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T20:23:02.857890] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-15T20:23:03.290637] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:23:03.291384] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-15T20:23:03.657886] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-15T20:23:04.074484] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:23:04.074873] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-15T20:23:04.457886] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-15T20:23:04.757012] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:23:04.757368] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-15T20:23:04.797309] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-09-15T20:23:05.264736] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-15T20:23:05.283947] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (6.43 seconds). [2025-09-15T20:23:05.787321] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-15T20:23:06.057865] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-15T20:23:06.762453] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:23:06.857907] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-15T20:23:07.443611] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T20:23:07.657877] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-15T20:23:08.345479] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:23:08.457894] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-15T20:23:08.702845] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:23:08.703831] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-15T20:23:09.083199] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:23:09.257919] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-15T20:23:10.057912] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-15T20:23:10.327716] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:23:10.328163] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-15T20:23:10.857893] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-15T20:23:11.134743] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T20:23:11.657894] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-15T20:23:12.457953] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-15T20:23:12.515442] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T20:23:12.897214] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T20:23:13.040413] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:23:13.257880] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-15T20:23:14.057880] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-15T20:23:14.422760] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T20:23:14.857883] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-15T20:23:15.547671] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T20:23:15.553354] [INFO ] [REMOTE ] SHO: Full fetch complete (53807 records). [2025-09-15T20:23:15.553527] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-15T20:23:15.660185] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-15T20:23:15.959834] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-15T20:23:15.959933] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-15T20:23:15.961020] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-15T20:23:15.961088] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-15T20:23:15.962383] [DEBUG] [LOCAL ] SHO: Trimmed 53807 records to 36534 (keeping 150 days of data) [2025-09-15T20:23:16.199714] [DEBUG] [LOCAL ] SHO: Primary data saved (36534 records). [2025-09-15T20:23:16.199899] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-15T20:23:16.201148] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SHO took 33.1s. Estimated remaining: 48m 34s. Rate: 9.4 symbols/min [2025-09-15T20:23:16.371839] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:16.406469] [DEBUG] [LOCAL ] SIG: Loaded 34498 existing records from primary storage. [2025-09-15T20:23:16.406617] [INFO ] [MAIN ] SIG: Loaded 34498 existing records. [2025-09-15T20:23:16.463910] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-15T20:23:16.594344] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:16.595330] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-15T20:23:16.595540] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-15T20:23:16.602145] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-15T20:23:16.610471] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-15T20:23:16.634123] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T20:23:16.942695] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-15T20:23:17.028509] [INFO ] [REMOTE ] SIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:17.257933] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-15T20:23:17.865716] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T20:23:18.057879] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-15T20:23:18.857872] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-15T20:23:18.909172] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:23:19.558883] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T20:23:19.561393] [INFO ] [REMOTE ] SI: Full fetch complete (4914 records). [2025-09-15T20:23:19.561467] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-15T20:23:19.662962] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-15T20:23:19.751450] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 32 unique days, need 150 days [2025-09-15T20:23:19.751851] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:23:19.751976] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:23:19.752048] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-15T20:23:19.752225] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-15T20:23:19.752310] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-15T20:23:19.752430] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-15T20:23:19.752524] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SI took 20.1s. Estimated remaining: 48m 27s. Rate: 9.4 symbols/min [2025-09-15T20:23:19.941163] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:19.983281] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T20:23:20.011027] [DEBUG] [LOCAL ] SII: Loaded 17573 existing records from primary storage. [2025-09-15T20:23:20.011225] [INFO ] [MAIN ] SII: Loaded 17573 existing records. [2025-09-15T20:23:20.193082] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:20.193419] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-15T20:23:20.193471] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-15T20:23:20.194042] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-15T20:23:20.194096] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-15T20:23:20.463078] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-15T20:23:20.568758] [INFO ] [REMOTE ] SII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:21.032561] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:23:21.257917] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-15T20:23:22.057982] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-15T20:23:22.193949] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T20:23:22.295423] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:23:22.857927] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-15T20:23:22.978463] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T20:23:22.982892] [INFO ] [REMOTE ] SID: Full fetch complete (45189 records). [2025-09-15T20:23:22.983023] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-15T20:23:23.357385] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-15T20:23:23.357467] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-15T20:23:23.358320] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-15T20:23:23.358369] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-15T20:23:23.359429] [DEBUG] [LOCAL ] SID: Trimmed 45189 records to 31348 (keeping 150 days of data) [2025-09-15T20:23:23.548679] [DEBUG] [LOCAL ] SID: Primary data saved (31348 records). [2025-09-15T20:23:23.549008] [INFO ] [MAIN ] SID: Full history saved. [2025-09-15T20:23:23.550136] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SID took 23.0s. Estimated remaining: 48m 20s. Rate: 9.4 symbols/min [2025-09-15T20:23:23.662983] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-15T20:23:23.724144] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:23.748680] [DEBUG] [LOCAL ] SILA: Loaded 23103 existing records from primary storage. [2025-09-15T20:23:23.748827] [INFO ] [MAIN ] SILA: Loaded 23103 existing records. [2025-09-15T20:23:23.925206] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:23.925466] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-15T20:23:23.925522] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-15T20:23:23.926218] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-15T20:23:23.926271] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-15T20:23:24.282211] [INFO ] [REMOTE ] SILA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:24.346430] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T20:23:24.353274] [INFO ] [REMOTE ] SHW: Full fetch complete (54882 records). [2025-09-15T20:23:24.353557] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-15T20:23:24.463045] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-15T20:23:24.744067] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-15T20:23:24.744207] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-15T20:23:24.745796] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-15T20:23:24.745863] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-15T20:23:24.747580] [DEBUG] [LOCAL ] SHW: Trimmed 54882 records to 36988 (keeping 150 days of data) [2025-09-15T20:23:25.000533] [DEBUG] [LOCAL ] SHW: Primary data saved (36988 records). [2025-09-15T20:23:25.000771] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-15T20:23:25.000883] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SHW took 35.3s. Estimated remaining: 48m 13s. Rate: 9.4 symbols/min [2025-09-15T20:23:25.179959] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:25.214998] [DEBUG] [LOCAL ] SITC: Loaded 30807 existing records from primary storage. [2025-09-15T20:23:25.215189] [INFO ] [MAIN ] SITC: Loaded 30807 existing records. [2025-09-15T20:23:25.275714] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-15T20:23:25.414580] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:25.415407] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-15T20:23:25.415711] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-15T20:23:25.416756] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-15T20:23:25.416820] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-15T20:23:25.846024] [INFO ] [REMOTE ] SITC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:25.881606] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T20:23:25.911589] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:23:26.057858] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-15T20:23:26.081205] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T20:23:26.857911] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-15T20:23:27.016996] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T20:23:27.657946] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-15T20:23:27.870586] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T20:23:28.457893] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-15T20:23:29.259271] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-15T20:23:29.264295] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:23:29.396740] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T20:23:30.057895] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-15T20:23:30.605585] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T20:23:30.857899] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-15T20:23:30.894925] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T20:23:31.657933] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-15T20:23:32.164717] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T20:23:32.457937] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-15T20:23:33.126601] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:23:33.197297] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T20:23:33.257825] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-15T20:23:34.057875] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-15T20:23:34.147317] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T20:23:34.857880] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-15T20:23:35.474662] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:23:35.657887] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-15T20:23:35.967930] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T20:23:36.457901] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-15T20:23:37.257878] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-15T20:23:37.486345] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T20:23:37.626616] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T20:23:38.057916] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-15T20:23:38.727913] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:23:38.857882] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-15T20:23:38.924229] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T20:23:39.657876] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-15T20:23:40.463538] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-15T20:23:40.475573] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:23:40.518283] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T20:23:40.521221] [INFO ] [REMOTE ] SII: Full fetch complete (24200 records). [2025-09-15T20:23:40.521301] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-15T20:23:40.890683] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-15T20:23:40.890767] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-15T20:23:40.891259] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-15T20:23:40.891298] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-15T20:23:40.892055] [DEBUG] [LOCAL ] SII: Trimmed 24200 records to 16892 (keeping 150 days of data) [2025-09-15T20:23:40.997782] [DEBUG] [LOCAL ] SII: Primary data saved (16892 records). [2025-09-15T20:23:40.997933] [INFO ] [MAIN ] SII: Full history saved. [2025-09-15T20:23:40.998025] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SII took 21.2s. Estimated remaining: 48m 9s. Rate: 9.4 symbols/min [2025-09-15T20:23:41.168775] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:41.196329] [DEBUG] [LOCAL ] SITE: Loaded 26142 existing records from primary storage. [2025-09-15T20:23:41.196500] [INFO ] [MAIN ] SITE: Loaded 26142 existing records. [2025-09-15T20:23:41.262971] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-15T20:23:41.382574] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:41.382831] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-15T20:23:41.382877] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-15T20:23:41.383478] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-15T20:23:41.383526] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-15T20:23:41.742797] [INFO ] [REMOTE ] SITE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:41.887559] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:23:42.057886] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-15T20:23:42.857894] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-15T20:23:42.890604] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T20:23:43.405920] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T20:23:43.657869] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-15T20:23:44.457849] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-15T20:23:44.546273] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T20:23:45.194122] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:23:45.257827] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-15T20:23:45.313174] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T20:23:46.057895] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-15T20:23:46.609167] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:23:46.857927] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-15T20:23:47.045402] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T20:23:47.049462] [INFO ] [REMOTE ] SILA: Full fetch complete (34273 records). [2025-09-15T20:23:47.049732] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-15T20:23:47.466202] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-15T20:23:47.466300] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-15T20:23:47.467106] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-15T20:23:47.467162] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-15T20:23:47.468075] [DEBUG] [LOCAL ] SILA: Trimmed 34273 records to 22658 (keeping 150 days of data) [2025-09-15T20:23:47.609830] [DEBUG] [LOCAL ] SILA: Primary data saved (22658 records). [2025-09-15T20:23:47.609971] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-15T20:23:47.610086] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SILA took 24.1s. Estimated remaining: 48m 2s. Rate: 9.4 symbols/min [2025-09-15T20:23:47.657882] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-15T20:23:48.305795] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T20:23:48.457926] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-15T20:23:48.928418] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:23:48.933566] [INFO ] [REMOTE ] SITC: Full fetch complete (45275 records). [2025-09-15T20:23:48.933684] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-15T20:23:49.264349] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-15T20:23:49.313244] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-15T20:23:49.313323] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-15T20:23:49.314260] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-15T20:23:49.314312] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-15T20:23:49.315401] [DEBUG] [LOCAL ] SITC: Trimmed 45275 records to 30304 (keeping 150 days of data) [2025-09-15T20:23:49.498502] [DEBUG] [LOCAL ] SITC: Primary data saved (30304 records). [2025-09-15T20:23:49.498661] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-15T20:23:49.498770] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SITC took 24.5s. Estimated remaining: 47m 55s. Rate: 9.4 symbols/min [2025-09-15T20:23:49.803709] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:23:50.057907] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-15T20:23:50.692838] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T20:23:50.857906] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-15T20:23:51.611477] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:23:51.657872] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-15T20:23:52.113214] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T20:23:52.457903] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-15T20:23:52.811306] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:23:52.816345] [INFO ] [REMOTE ] SIG: Full fetch complete (51092 records). [2025-09-15T20:23:52.816472] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-15T20:23:53.200119] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-15T20:23:53.200203] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-15T20:23:53.201169] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-15T20:23:53.201216] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-15T20:23:53.202259] [DEBUG] [LOCAL ] SIG: Trimmed 51092 records to 33768 (keeping 150 days of data) [2025-09-15T20:23:53.414760] [DEBUG] [LOCAL ] SIG: Primary data saved (33768 records). [2025-09-15T20:23:53.414919] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-15T20:23:53.415577] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SIG took 37.2s. Estimated remaining: 47m 48s. Rate: 9.4 symbols/min [2025-09-15T20:23:53.846982] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T20:23:53.854558] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-15T20:23:54.896341] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T20:23:54.902615] [INFO ] [REMOTE ] SITE: Full fetch complete (38570 records). [2025-09-15T20:23:54.902804] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-15T20:23:55.281628] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-15T20:23:55.281749] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-15T20:23:55.282613] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-15T20:23:55.282685] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-15T20:23:55.283926] [DEBUG] [LOCAL ] SITE: Trimmed 38570 records to 25540 (keeping 150 days of data) [2025-09-15T20:23:55.444069] [DEBUG] [LOCAL ] SITE: Primary data saved (25540 records). [2025-09-15T20:23:55.444229] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-15T20:23:55.444334] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SITE took 14.4s. Estimated remaining: 47m 41s. Rate: 9.4 symbols/min [2025-09-15T20:23:56.105446] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:56.157673] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:56.159887] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:56.159063] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:23:56.175319] [DEBUG] [LOCAL ] SKIL: Loaded 4455 existing records from primary storage. [2025-09-15T20:23:56.175672] [INFO ] [MAIN ] SKIL: Loaded 4455 existing records. [2025-09-15T20:23:56.228473] [DEBUG] [LOCAL ] SJT: Loaded 16927 existing records from primary storage. [2025-09-15T20:23:56.251283] [INFO ] [MAIN ] SJT: Loaded 16927 existing records. [2025-09-15T20:23:56.511181] [DEBUG] [LOCAL ] SKE: Loaded 26035 existing records from primary storage. [2025-09-15T20:23:56.515077] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:56.515631] [DEBUG] [LOCAL ] SJM: Loaded 37734 existing records from primary storage. [2025-09-15T20:23:56.516660] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-15T20:23:56.527236] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-15T20:23:56.527127] [INFO ] [MAIN ] SKE: Loaded 26035 existing records. [2025-09-15T20:23:56.527045] [INFO ] [MAIN ] SJM: Loaded 37734 existing records. [2025-09-15T20:23:56.657093] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-15T20:23:56.718162] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:56.761481] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-15T20:23:56.777056] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-15T20:23:56.798163] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-15T20:23:56.880519] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-15T20:23:57.011733] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:57.016936] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-15T20:23:57.075095] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-15T20:23:57.081083] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:23:57.152256] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-15T20:23:57.192260] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-15T20:23:57.252268] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-15T20:23:57.252147] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-15T20:23:57.303832] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-15T20:23:57.327173] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-15T20:23:57.327045] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-15T20:23:57.800711] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:57.805200] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-15T20:23:57.986576] [INFO ] [REMOTE ] SJT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:58.049885] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-15T20:23:58.340931] [INFO ] [REMOTE ] SKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:58.369249] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-15T20:23:58.397467] [INFO ] [REMOTE ] SJM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:23:58.397812] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-15T20:23:58.717451] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T20:23:58.719458] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-15T20:23:59.087739] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:23:59.092557] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-15T20:23:59.336142] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T20:23:59.343068] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-15T20:23:59.438470] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T20:23:59.657928] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-15T20:23:59.695312] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T20:23:59.937522] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T20:24:00.399961] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T20:24:00.457895] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-15T20:24:00.817921] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:24:01.257835] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-15T20:24:01.647121] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T20:24:01.702261] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T20:24:02.057916] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-15T20:24:02.857898] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-15T20:24:03.657937] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-15T20:24:04.428103] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T20:24:04.457868] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-15T20:24:04.893627] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-15T20:24:05.257882] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-15T20:24:05.393284] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T20:24:05.688572] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T20:24:06.057881] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-15T20:24:06.502332] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T20:24:06.857909] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-15T20:24:07.111601] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T20:24:07.657889] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-15T20:24:08.293702] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T20:24:08.360263] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:24:08.457891] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-15T20:24:09.139329] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T20:24:09.140700] [INFO ] [REMOTE ] SKIL: Full fetch complete (6783 records). [2025-09-15T20:24:09.140790] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-15T20:24:09.262985] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-15T20:24:09.515521] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-15T20:24:09.515620] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-15T20:24:09.515872] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-15T20:24:09.515937] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-15T20:24:09.516493] [DEBUG] [LOCAL ] SKIL: Trimmed 6783 records to 4404 (keeping 150 days of data) [2025-09-15T20:24:09.544315] [DEBUG] [LOCAL ] SKIL: Primary data saved (4404 records). [2025-09-15T20:24:09.544474] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-15T20:24:09.544571] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 14.1s. Estimated remaining: 47m 36s. Rate: 9.4 symbols/min [2025-09-15T20:24:09.731257] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:09.740883] [DEBUG] [LOCAL ] SKLZ: Loaded 8626 existing records from primary storage. [2025-09-15T20:24:09.741013] [INFO ] [MAIN ] SKLZ: Loaded 8626 existing records. [2025-09-15T20:24:09.917948] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:09.918223] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-15T20:24:09.918270] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-15T20:24:09.918593] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-15T20:24:09.918666] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-15T20:24:10.061002] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-15T20:24:10.274815] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:10.285409] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T20:24:10.857875] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-15T20:24:11.365288] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:24:11.405838] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T20:24:11.657863] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-15T20:24:12.457891] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-15T20:24:12.515433] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T20:24:13.257837] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-15T20:24:13.621464] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:24:14.057929] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-15T20:24:14.112043] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:24:14.857920] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-15T20:24:15.657935] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-15T20:24:16.143525] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T20:24:16.170177] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T20:24:16.172860] [INFO ] [REMOTE ] SJT: Full fetch complete (24393 records). [2025-09-15T20:24:16.172936] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-15T20:24:16.467270] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-15T20:24:16.556470] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-15T20:24:16.556576] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-15T20:24:16.557426] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-15T20:24:16.557471] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-15T20:24:16.558422] [DEBUG] [LOCAL ] SJT: Trimmed 24393 records to 16610 (keeping 150 days of data) [2025-09-15T20:24:16.663053] [DEBUG] [LOCAL ] SJT: Primary data saved (16610 records). [2025-09-15T20:24:16.663280] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-15T20:24:16.663433] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SJT took 21.2s. Estimated remaining: 47m 30s. Rate: 9.4 symbols/min [2025-09-15T20:24:16.837408] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:16.868883] [DEBUG] [LOCAL ] SKM: Loaded 26547 existing records from primary storage. [2025-09-15T20:24:16.869082] [INFO ] [MAIN ] SKM: Loaded 26547 existing records. [2025-09-15T20:24:17.117054] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:17.117498] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-15T20:24:17.117718] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-15T20:24:17.118427] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-15T20:24:17.118486] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-15T20:24:17.258755] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-15T20:24:17.265537] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T20:24:17.455764] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T20:24:17.546352] [INFO ] [REMOTE ] SKM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:18.057869] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-15T20:24:18.857829] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-15T20:24:18.911178] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:24:18.937697] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:24:19.657933] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-15T20:24:20.005942] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T20:24:20.457879] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-15T20:24:20.646051] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:24:21.257894] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-15T20:24:21.613912] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:24:22.057962] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-15T20:24:22.203112] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:24:22.857895] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-15T20:24:23.229798] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T20:24:23.602317] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T20:24:23.604299] [INFO ] [REMOTE ] SKLZ: Full fetch complete (13020 records). [2025-09-15T20:24:23.604398] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-15T20:24:23.663065] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-15T20:24:23.974508] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-15T20:24:23.974592] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-15T20:24:23.974942] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-15T20:24:23.974985] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-15T20:24:23.975460] [DEBUG] [LOCAL ] SKLZ: Trimmed 13020 records to 8497 (keeping 150 days of data) [2025-09-15T20:24:24.024617] [DEBUG] [LOCAL ] SKLZ: Primary data saved (8497 records). [2025-09-15T20:24:24.024780] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-15T20:24:24.024866] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SKLZ took 14.5s. Estimated remaining: 47m 24s. Rate: 9.4 symbols/min [2025-09-15T20:24:24.200846] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:24.241894] [DEBUG] [LOCAL ] SKT: Loaded 31692 existing records from primary storage. [2025-09-15T20:24:24.242093] [INFO ] [MAIN ] SKT: Loaded 31692 existing records. [2025-09-15T20:24:24.435460] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:24.435841] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-15T20:24:24.435893] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-15T20:24:24.436622] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-15T20:24:24.436712] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-15T20:24:24.469936] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-15T20:24:24.874584] [INFO ] [REMOTE ] SKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:25.258018] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-15T20:24:25.561611] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T20:24:25.932184] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:24:26.057916] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-15T20:24:26.857918] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-15T20:24:27.657951] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-15T20:24:27.744669] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-15T20:24:28.026538] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T20:24:28.086040] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:24:28.091119] [INFO ] [REMOTE ] SKE: Full fetch complete (38050 records). [2025-09-15T20:24:28.091218] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-15T20:24:28.466483] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-15T20:24:28.483287] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-15T20:24:28.483387] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-15T20:24:28.484391] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-15T20:24:28.484444] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-15T20:24:28.485909] [DEBUG] [LOCAL ] SKE: Trimmed 38050 records to 25499 (keeping 150 days of data) [2025-09-15T20:24:28.648577] [DEBUG] [LOCAL ] SKE: Primary data saved (25499 records). [2025-09-15T20:24:28.648742] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-15T20:24:28.648858] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKE took 33.2s. Estimated remaining: 47m 17s. Rate: 9.4 symbols/min [2025-09-15T20:24:28.818964] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:28.847841] [DEBUG] [LOCAL ] SKY: Loaded 28735 existing records from primary storage. [2025-09-15T20:24:28.848002] [INFO ] [MAIN ] SKY: Loaded 28735 existing records. [2025-09-15T20:24:29.038431] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:29.038752] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-15T20:24:29.038809] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-15T20:24:29.039575] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-15T20:24:29.039632] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-15T20:24:29.267900] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-15T20:24:29.412217] [INFO ] [REMOTE ] SKY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:29.447398] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T20:24:29.820744] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:24:30.057876] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-15T20:24:30.607072] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T20:24:30.857899] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-15T20:24:31.144996] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T20:24:31.657865] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-15T20:24:32.457873] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-15T20:24:32.498609] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:24:33.257855] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-15T20:24:33.343129] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T20:24:33.401014] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T20:24:34.057869] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-15T20:24:34.427173] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T20:24:34.857906] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-15T20:24:35.008450] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:24:35.657881] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-15T20:24:36.305530] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:24:36.457876] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-15T20:24:37.091258] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:24:37.096972] [INFO ] [REMOTE ] SJM: Full fetch complete (54489 records). [2025-09-15T20:24:37.097071] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-15T20:24:37.268018] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-15T20:24:37.477350] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-15T20:24:37.477447] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-15T20:24:37.478626] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-15T20:24:37.478689] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-15T20:24:37.480103] [DEBUG] [LOCAL ] SJM: Trimmed 54489 records to 37109 (keeping 150 days of data) [2025-09-15T20:24:37.735355] [DEBUG] [LOCAL ] SJM: Primary data saved (37109 records). [2025-09-15T20:24:37.735731] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-15T20:24:37.735882] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SJM took 42.3s. Estimated remaining: 47m 11s. Rate: 9.4 symbols/min [2025-09-15T20:24:37.926407] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:24:37.946098] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:37.969066] [DEBUG] [LOCAL ] SKYH: Loaded 11692 existing records from primary storage. [2025-09-15T20:24:37.969218] [INFO ] [MAIN ] SKYH: Loaded 11692 existing records. [2025-09-15T20:24:38.068048] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-15T20:24:38.153857] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:38.155015] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-15T20:24:38.155077] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-15T20:24:38.155484] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-15T20:24:38.155534] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-15T20:24:38.524270] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:38.542922] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:24:38.548262] [INFO ] [REMOTE ] SKM: Full fetch complete (38237 records). [2025-09-15T20:24:38.548532] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-15T20:24:38.863125] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-15T20:24:38.978420] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-15T20:24:38.978506] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-15T20:24:38.979344] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-15T20:24:38.979445] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-15T20:24:38.980386] [DEBUG] [LOCAL ] SKM: Trimmed 38237 records to 26017 (keeping 150 days of data) [2025-09-15T20:24:39.149602] [DEBUG] [LOCAL ] SKM: Primary data saved (26017 records). [2025-09-15T20:24:39.149794] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-15T20:24:39.149920] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SKM took 22.5s. Estimated remaining: 47m 4s. Rate: 9.4 symbols/min [2025-09-15T20:24:39.324700] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:39.365140] [DEBUG] [LOCAL ] SLB: Loaded 40437 existing records from primary storage. [2025-09-15T20:24:39.365398] [INFO ] [MAIN ] SLB: Loaded 40437 existing records. [2025-09-15T20:24:39.553205] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:39.559800] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:24:39.559531] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-15T20:24:39.561962] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-15T20:24:39.563245] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-15T20:24:39.563296] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-15T20:24:39.660042] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-15T20:24:39.837553] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T20:24:39.956295] [INFO ] [REMOTE ] SLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:40.457950] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-15T20:24:40.819045] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T20:24:41.257914] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-15T20:24:42.035616] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T20:24:42.057816] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-15T20:24:42.483948] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T20:24:42.857896] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-15T20:24:43.467256] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T20:24:43.657949] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-15T20:24:44.457917] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-15T20:24:44.656631] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:24:45.129904] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T20:24:45.257939] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-15T20:24:45.562105] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T20:24:46.057966] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-15T20:24:46.466214] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T20:24:46.473361] [INFO ] [REMOTE ] SKY: Full fetch complete (40275 records). [2025-09-15T20:24:46.473475] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-15T20:24:46.861612] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-15T20:24:46.876815] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T20:24:46.877083] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-15T20:24:46.881208] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-15T20:24:46.883098] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-15T20:24:46.883702] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-15T20:24:46.885480] [DEBUG] [LOCAL ] SKY: Trimmed 40275 records to 28322 (keeping 150 days of data) [2025-09-15T20:24:47.074277] [DEBUG] [LOCAL ] SKY: Primary data saved (28322 records). [2025-09-15T20:24:47.074476] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-15T20:24:47.074600] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SKY took 18.4s. Estimated remaining: 46m 58s. Rate: 9.4 symbols/min [2025-09-15T20:24:47.251243] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:47.288689] [DEBUG] [LOCAL ] SLF: Loaded 29232 existing records from primary storage. [2025-09-15T20:24:47.288900] [INFO ] [MAIN ] SLF: Loaded 29232 existing records. [2025-09-15T20:24:47.475788] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:47.476127] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-15T20:24:47.476234] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-15T20:24:47.477082] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-15T20:24:47.477140] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-15T20:24:47.666108] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-15T20:24:47.841782] [INFO ] [REMOTE ] SLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:48.457933] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-15T20:24:48.771689] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T20:24:48.945056] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:24:49.257922] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-15T20:24:49.616442] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T20:24:50.057901] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-15T20:24:50.845269] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:24:50.857817] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-15T20:24:51.045515] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T20:24:51.657904] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-15T20:24:51.847489] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:24:52.457910] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-15T20:24:53.119064] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:24:53.257867] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-15T20:24:54.057983] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-15T20:24:54.377251] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T20:24:54.484999] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:24:54.490493] [INFO ] [REMOTE ] SKT: Full fetch complete (46127 records). [2025-09-15T20:24:54.490631] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-15T20:24:54.870936] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-15T20:24:54.873595] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-15T20:24:54.874662] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-15T20:24:54.875569] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-15T20:24:54.875722] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-15T20:24:54.876888] [DEBUG] [LOCAL ] SKT: Trimmed 46127 records to 31192 (keeping 150 days of data) [2025-09-15T20:24:55.074487] [DEBUG] [LOCAL ] SKT: Primary data saved (31192 records). [2025-09-15T20:24:55.074660] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-15T20:24:55.074763] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SKT took 31.0s. Estimated remaining: 46m 52s. Rate: 9.4 symbols/min [2025-09-15T20:24:55.243996] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:55.281372] [DEBUG] [LOCAL ] SLG: Loaded 34484 existing records from primary storage. [2025-09-15T20:24:55.281515] [INFO ] [MAIN ] SLG: Loaded 34484 existing records. [2025-09-15T20:24:55.462078] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:55.462662] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-15T20:24:55.462791] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-15T20:24:55.463533] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-15T20:24:55.463584] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-15T20:24:55.666267] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-15T20:24:55.666161] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:24:55.852337] [INFO ] [REMOTE ] SLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:56.457855] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-15T20:24:56.523144] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T20:24:56.737713] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T20:24:57.257876] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-15T20:24:57.693999] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T20:24:57.695990] [INFO ] [REMOTE ] SKYH: Full fetch complete (17388 records). [2025-09-15T20:24:57.696061] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-15T20:24:58.022591] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T20:24:58.059389] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-15T20:24:58.105145] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-15T20:24:58.105210] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-15T20:24:58.105629] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-15T20:24:58.105700] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-15T20:24:58.106361] [DEBUG] [LOCAL ] SKYH: Trimmed 17388 records to 11393 (keeping 150 days of data) [2025-09-15T20:24:58.173129] [DEBUG] [LOCAL ] SKYH: Primary data saved (11393 records). [2025-09-15T20:24:58.173570] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-15T20:24:58.173678] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SKYH took 20.4s. Estimated remaining: 46m 44s. Rate: 9.4 symbols/min [2025-09-15T20:24:58.350614] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:24:58.382231] [DEBUG] [LOCAL ] SLGN: Loaded 29671 existing records from primary storage. [2025-09-15T20:24:58.382373] [INFO ] [MAIN ] SLGN: Loaded 29671 existing records. [2025-09-15T20:24:58.561890] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:24:58.562119] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-15T20:24:58.562175] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-15T20:24:58.562878] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-15T20:24:58.562934] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-15T20:24:58.862969] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-15T20:24:58.928322] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:24:59.392551] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:24:59.657931] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-15T20:25:00.438172] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T20:25:00.457833] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-15T20:25:00.661064] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T20:25:01.257899] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-15T20:25:01.528560] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:25:02.057931] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-15T20:25:02.730335] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:25:02.857892] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-15T20:25:03.657877] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-15T20:25:03.704708] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T20:25:04.462961] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-15T20:25:04.480634] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:25:05.229886] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:25:05.257821] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-15T20:25:05.903108] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:25:06.057877] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-15T20:25:06.752527] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T20:25:06.863933] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-15T20:25:06.869013] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:25:06.874168] [INFO ] [REMOTE ] SLF: Full fetch complete (43151 records). [2025-09-15T20:25:06.874358] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-15T20:25:07.256097] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-15T20:25:07.256188] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-15T20:25:07.257090] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-15T20:25:07.257135] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-15T20:25:07.258103] [DEBUG] [LOCAL ] SLF: Trimmed 43151 records to 28676 (keeping 150 days of data) [2025-09-15T20:25:07.436786] [DEBUG] [LOCAL ] SLF: Primary data saved (28676 records). [2025-09-15T20:25:07.436938] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-15T20:25:07.437034] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLF took 20.4s. Estimated remaining: 46m 39s. Rate: 9.4 symbols/min [2025-09-15T20:25:07.604434] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:07.604667] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-15T20:25:07.604707] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-15T20:25:07.604830] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-15T20:25:07.604869] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-15T20:25:07.604909] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-15T20:25:07.604942] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-15T20:25:07.667970] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-15T20:25:08.013301] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:08.457889] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-15T20:25:08.470244] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:25:09.257920] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-15T20:25:09.546103] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T20:25:10.063324] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-15T20:25:10.065884] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T20:25:10.447946] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T20:25:10.863053] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-15T20:25:10.876022] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:25:11.237466] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T20:25:11.657890] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-15T20:25:12.457931] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-15T20:25:13.257897] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-15T20:25:13.480734] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T20:25:13.558504] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:25:14.057868] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-15T20:25:14.673221] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:25:14.857969] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-15T20:25:15.227093] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T20:25:15.504163] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T20:25:15.509984] [INFO ] [REMOTE ] SLB: Full fetch complete (58377 records). [2025-09-15T20:25:15.510081] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-15T20:25:15.661995] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-15T20:25:15.889547] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-15T20:25:15.889631] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-15T20:25:15.890598] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-15T20:25:15.890654] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-15T20:25:15.891859] [DEBUG] [LOCAL ] SLB: Trimmed 58377 records to 39657 (keeping 150 days of data) [2025-09-15T20:25:16.145205] [DEBUG] [LOCAL ] SLB: Primary data saved (39657 records). [2025-09-15T20:25:16.145359] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-15T20:25:16.145461] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLB took 37.0s. Estimated remaining: 46m 33s. Rate: 9.4 symbols/min [2025-09-15T20:25:16.318867] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:16.350810] [DEBUG] [LOCAL ] SLQT: Loaded 33229 existing records from primary storage. [2025-09-15T20:25:16.350952] [INFO ] [MAIN ] SLQT: Loaded 33229 existing records. [2025-09-15T20:25:16.462958] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-15T20:25:16.533250] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:16.533530] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-15T20:25:16.533579] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-15T20:25:16.534262] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-15T20:25:16.534319] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-15T20:25:16.889069] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:16.909442] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T20:25:17.257874] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-15T20:25:17.708299] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:25:17.713510] [INFO ] [REMOTE ] SLG: Full fetch complete (49208 records). [2025-09-15T20:25:17.713609] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-15T20:25:18.071047] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-15T20:25:18.127287] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-15T20:25:18.127437] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-15T20:25:18.129005] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-15T20:25:18.129067] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-15T20:25:18.130581] [DEBUG] [LOCAL ] SLG: Trimmed 49208 records to 33726 (keeping 150 days of data) [2025-09-15T20:25:18.361310] [DEBUG] [LOCAL ] SLG: Primary data saved (33726 records). [2025-09-15T20:25:18.361489] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-15T20:25:18.361585] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SLG took 23.3s. Estimated remaining: 46m 26s. Rate: 9.4 symbols/min [2025-09-15T20:25:18.619297] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:18.651577] [DEBUG] [LOCAL ] SLVM: Loaded 20614 existing records from primary storage. [2025-09-15T20:25:18.651806] [INFO ] [MAIN ] SLVM: Loaded 20614 existing records. [2025-09-15T20:25:18.861200] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-15T20:25:18.954978] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:18.955594] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-15T20:25:18.955677] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-15T20:25:18.971523] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-15T20:25:18.978207] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-15T20:25:19.093938] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T20:25:19.479206] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:19.628071] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T20:25:19.660073] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-15T20:25:19.663268] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:25:20.045443] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T20:25:20.457931] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-15T20:25:20.836129] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T20:25:21.257891] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-15T20:25:22.057895] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-15T20:25:22.707413] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:25:22.857893] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-15T20:25:23.613963] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T20:25:23.657831] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-15T20:25:24.207571] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:25:24.457876] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-15T20:25:24.940140] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T20:25:24.955091] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:25:24.960157] [INFO ] [REMOTE ] SLGN: Full fetch complete (43723 records). [2025-09-15T20:25:24.960262] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-15T20:25:25.262955] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-15T20:25:25.342882] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-15T20:25:25.342995] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-15T20:25:25.343965] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-15T20:25:25.344015] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-15T20:25:25.345269] [DEBUG] [LOCAL ] SLGN: Trimmed 43723 records to 29229 (keeping 150 days of data) [2025-09-15T20:25:25.531765] [DEBUG] [LOCAL ] SLGN: Primary data saved (29229 records). [2025-09-15T20:25:25.531932] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-15T20:25:25.532040] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SLGN took 27.4s. Estimated remaining: 46m 19s. Rate: 9.4 symbols/min [2025-09-15T20:25:25.707362] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:25.746219] [DEBUG] [LOCAL ] SM: Loaded 39255 existing records from primary storage. [2025-09-15T20:25:25.746412] [INFO ] [MAIN ] SM: Loaded 39255 existing records. [2025-09-15T20:25:25.922299] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:25.922544] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-15T20:25:25.922589] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-15T20:25:25.923452] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-15T20:25:25.923503] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-15T20:25:26.062986] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-15T20:25:26.284831] [INFO ] [REMOTE ] SM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:26.487385] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T20:25:26.488422] [INFO ] [REMOTE ] SLNZ: Full fetch complete (803 records). [2025-09-15T20:25:26.488506] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-15T20:25:26.670635] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T20:25:26.670906] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:25:26.670975] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:25:26.671034] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-15T20:25:26.671126] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-15T20:25:26.671317] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-15T20:25:26.671406] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-15T20:25:26.671482] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SLNZ took 19.2s. Estimated remaining: 46m 12s. Rate: 9.4 symbols/min [2025-09-15T20:25:26.839630] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:26.839909] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-15T20:25:26.839958] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-15T20:25:26.840087] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-15T20:25:26.840129] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-15T20:25:26.840281] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-15T20:25:26.840356] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-15T20:25:26.862923] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-15T20:25:26.969108] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T20:25:27.230141] [INFO ] [REMOTE ] SMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:27.657869] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-15T20:25:28.457875] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-15T20:25:28.504780] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T20:25:28.562002] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T20:25:28.698974] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:25:28.699361] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-15T20:25:29.257883] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-15T20:25:30.057898] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-15T20:25:30.607175] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T20:25:30.857931] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-15T20:25:31.162766] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:25:31.163123] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-15T20:25:31.448261] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T20:25:31.657844] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-15T20:25:32.457904] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-15T20:25:33.030984] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:25:33.257891] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-15T20:25:33.903427] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:25:34.057886] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-15T20:25:34.376961] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T20:25:34.857903] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-15T20:25:35.191624] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T20:25:35.657899] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-15T20:25:36.457878] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-15T20:25:36.646324] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T20:25:36.700594] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T20:25:37.257893] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-15T20:25:38.048771] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:25:38.058432] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-15T20:25:38.343257] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T20:25:38.857928] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-15T20:25:39.525588] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:25:39.657868] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-15T20:25:40.229429] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:25:40.457886] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-15T20:25:40.801802] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T20:25:40.806535] [INFO ] [REMOTE ] SLQT: Full fetch complete (48871 records). [2025-09-15T20:25:40.806719] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-15T20:25:41.189622] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-15T20:25:41.189750] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-15T20:25:41.190690] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-15T20:25:41.190742] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-15T20:25:41.192025] [DEBUG] [LOCAL ] SLQT: Trimmed 48871 records to 32427 (keeping 150 days of data) [2025-09-15T20:25:41.284101] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-15T20:25:41.409334] [DEBUG] [LOCAL ] SLQT: Primary data saved (32427 records). [2025-09-15T20:25:41.409475] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-15T20:25:41.409577] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SLQT took 25.3s. Estimated remaining: 46m 7s. Rate: 9.4 symbols/min [2025-09-15T20:25:41.578395] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:41.585822] [DEBUG] [LOCAL ] SMBK: Loaded 6091 existing records from primary storage. [2025-09-15T20:25:41.585990] [INFO ] [MAIN ] SMBK: Loaded 6091 existing records. [2025-09-15T20:25:41.769043] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:41.769324] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-15T20:25:41.769373] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-15T20:25:41.769628] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-15T20:25:41.769703] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-15T20:25:42.059778] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-15T20:25:42.146006] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:42.181088] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T20:25:42.494437] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T20:25:42.857903] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-15T20:25:43.504278] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T20:25:43.657847] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-15T20:25:43.990688] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T20:25:44.457884] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-15T20:25:44.941557] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T20:25:44.945395] [INFO ] [REMOTE ] SMA: Full fetch complete (27961 records). [2025-09-15T20:25:44.945482] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-15T20:25:45.129762] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 114 unique days, need 150 days [2025-09-15T20:25:45.134914] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T20:25:45.134713] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:25:45.136767] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:25:45.136825] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-15T20:25:45.136885] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-15T20:25:45.136921] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-15T20:25:45.136960] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-15T20:25:45.137053] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SMA took 18.5s. Estimated remaining: 46m 0s. Rate: 9.4 symbols/min [2025-09-15T20:25:45.262972] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-15T20:25:45.309564] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:45.318809] [DEBUG] [LOCAL ] SMC: Loaded 7971 existing records from primary storage. [2025-09-15T20:25:45.318964] [INFO ] [MAIN ] SMC: Loaded 7971 existing records. [2025-09-15T20:25:45.499544] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:45.499837] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-15T20:25:45.499885] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-15T20:25:45.500229] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-15T20:25:45.500276] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-15T20:25:45.873280] [INFO ] [REMOTE ] SMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:46.057869] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-15T20:25:46.341187] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T20:25:46.581267] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T20:25:46.857896] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-15T20:25:47.657874] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-15T20:25:48.365466] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:25:48.457835] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-15T20:25:48.550187] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T20:25:49.257885] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-15T20:25:50.057845] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-15T20:25:50.152023] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T20:25:50.270602] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T20:25:50.857881] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-15T20:25:51.270109] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T20:25:51.561019] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T20:25:51.657934] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-15T20:25:52.457854] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-15T20:25:52.774108] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T20:25:52.777670] [INFO ] [REMOTE ] SLVM: Full fetch complete (30730 records). [2025-09-15T20:25:52.777770] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-15T20:25:53.141532] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-15T20:25:53.141613] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-15T20:25:53.142265] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-15T20:25:53.142316] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-15T20:25:53.143099] [DEBUG] [LOCAL ] SLVM: Trimmed 30730 records to 20291 (keeping 150 days of data) [2025-09-15T20:25:53.264857] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-15T20:25:53.276541] [DEBUG] [LOCAL ] SLVM: Primary data saved (20291 records). [2025-09-15T20:25:53.276715] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-15T20:25:53.276829] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SLVM took 34.9s. Estimated remaining: 45m 54s. Rate: 9.4 symbols/min [2025-09-15T20:25:53.465380] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:53.504759] [DEBUG] [LOCAL ] SMFG: Loaded 36185 existing records from primary storage. [2025-09-15T20:25:53.504927] [INFO ] [MAIN ] SMFG: Loaded 36185 existing records. [2025-09-15T20:25:53.683736] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:53.684000] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-15T20:25:53.684045] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-15T20:25:53.684801] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-15T20:25:53.684852] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-15T20:25:54.047456] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:54.063041] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-15T20:25:54.066160] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T20:25:54.072633] [INFO ] [REMOTE ] SM: Full fetch complete (56937 records). [2025-09-15T20:25:54.072835] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-15T20:25:54.406364] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T20:25:54.499539] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-15T20:25:54.499624] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-15T20:25:54.500585] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-15T20:25:54.500629] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-15T20:25:54.501892] [DEBUG] [LOCAL ] SM: Trimmed 56937 records to 38476 (keeping 150 days of data) [2025-09-15T20:25:54.745289] [DEBUG] [LOCAL ] SM: Primary data saved (38476 records). [2025-09-15T20:25:54.745461] [INFO ] [MAIN ] SM: Full history saved. [2025-09-15T20:25:54.746131] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SM took 29.2s. Estimated remaining: 45m 47s. Rate: 9.4 symbols/min [2025-09-15T20:25:54.863085] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-15T20:25:54.920025] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:25:54.958799] [DEBUG] [LOCAL ] SMG: Loaded 32743 existing records from primary storage. [2025-09-15T20:25:54.959026] [INFO ] [MAIN ] SMG: Loaded 32743 existing records. [2025-09-15T20:25:55.136605] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:25:55.136885] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-15T20:25:55.136934] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-15T20:25:55.137711] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-15T20:25:55.137767] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-15T20:25:55.523934] [INFO ] [REMOTE ] SMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:25:55.656051] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:25:55.658349] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-15T20:25:55.684060] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T20:25:56.457938] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-15T20:25:56.514969] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T20:25:57.257901] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-15T20:25:57.307354] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:25:58.057894] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-15T20:25:58.752822] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T20:25:58.770734] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T20:25:58.857883] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-15T20:25:59.538931] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T20:25:59.540595] [INFO ] [REMOTE ] SMC: Full fetch complete (12569 records). [2025-09-15T20:25:59.540686] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-15T20:25:59.663035] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-15T20:25:59.919346] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-15T20:25:59.919437] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-15T20:25:59.919740] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-15T20:25:59.919782] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-15T20:25:59.920336] [DEBUG] [LOCAL ] SMC: Trimmed 12569 records to 7771 (keeping 150 days of data) [2025-09-15T20:25:59.968234] [DEBUG] [LOCAL ] SMC: Primary data saved (7771 records). [2025-09-15T20:25:59.968380] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-15T20:25:59.968467] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMC took 14.8s. Estimated remaining: 45m 40s. Rate: 9.4 symbols/min [2025-09-15T20:26:00.147261] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:00.157860] [DEBUG] [LOCAL ] SMHI: Loaded 9825 existing records from primary storage. [2025-09-15T20:26:00.157976] [INFO ] [MAIN ] SMHI: Loaded 9825 existing records. [2025-09-15T20:26:00.338091] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:00.338369] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-15T20:26:00.338418] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-15T20:26:00.338809] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-15T20:26:00.338861] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-15T20:26:00.462938] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-15T20:26:00.634227] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:26:00.711853] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:01.257895] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-15T20:26:02.057915] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-15T20:26:02.857879] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-15T20:26:03.773308] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (3.31 seconds). [2025-09-15T20:26:03.784492] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-15T20:26:03.795844] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-15T20:26:04.026786] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T20:26:04.457877] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-15T20:26:05.235427] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:26:05.257817] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-15T20:26:05.283330] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T20:26:05.425878] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T20:26:06.057872] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-15T20:26:06.075864] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T20:26:06.857899] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-15T20:26:07.657875] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-15T20:26:07.816398] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T20:26:07.837138] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:26:08.087762] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T20:26:08.089049] [INFO ] [REMOTE ] SMBK: Full fetch complete (8753 records). [2025-09-15T20:26:08.089118] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-15T20:26:08.447502] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-15T20:26:08.447601] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-15T20:26:08.447938] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-15T20:26:08.447990] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-15T20:26:08.448516] [DEBUG] [LOCAL ] SMBK: Trimmed 8753 records to 5894 (keeping 150 days of data) [2025-09-15T20:26:08.466026] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-15T20:26:08.491306] [DEBUG] [LOCAL ] SMBK: Primary data saved (5894 records). [2025-09-15T20:26:08.491443] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-15T20:26:08.491527] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMBK took 27.1s. Estimated remaining: 45m 34s. Rate: 9.4 symbols/min [2025-09-15T20:26:08.668882] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:08.684246] [DEBUG] [LOCAL ] SMP: Loaded 14146 existing records from primary storage. [2025-09-15T20:26:08.684383] [INFO ] [MAIN ] SMP: Loaded 14146 existing records. [2025-09-15T20:26:08.860405] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:08.860742] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-15T20:26:08.860804] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-15T20:26:08.861254] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-15T20:26:08.861328] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-15T20:26:09.224517] [INFO ] [REMOTE ] SMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:09.257886] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-15T20:26:09.975671] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T20:26:10.057874] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-15T20:26:10.245857] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T20:26:10.857905] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-15T20:26:11.586418] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T20:26:11.657907] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-15T20:26:12.063128] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T20:26:12.457926] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-15T20:26:12.914549] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T20:26:13.257866] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-15T20:26:13.815062] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T20:26:14.057938] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-15T20:26:14.857895] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-15T20:26:15.536334] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-15T20:26:15.584376] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T20:26:15.657875] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-15T20:26:15.697308] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T20:26:16.457877] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-15T20:26:16.813169] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T20:26:17.257905] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-15T20:26:17.329266] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T20:26:18.057886] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-15T20:26:18.771190] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T20:26:18.777068] [INFO ] [REMOTE ] SMFG: Full fetch complete (52097 records). [2025-09-15T20:26:18.777258] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-15T20:26:18.860539] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-15T20:26:19.077748] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T20:26:19.180327] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-15T20:26:19.180410] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-15T20:26:19.181365] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-15T20:26:19.181418] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-15T20:26:19.182596] [DEBUG] [LOCAL ] SMFG: Trimmed 52097 records to 35393 (keeping 150 days of data) [2025-09-15T20:26:19.403102] [DEBUG] [LOCAL ] SMFG: Primary data saved (35393 records). [2025-09-15T20:26:19.403264] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-15T20:26:19.405131] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMFG took 26.1s. Estimated remaining: 45m 29s. Rate: 9.4 symbols/min [2025-09-15T20:26:19.573944] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:19.622603] [DEBUG] [LOCAL ] SMR: Loaded 40540 existing records from primary storage. [2025-09-15T20:26:19.622798] [INFO ] [MAIN ] SMR: Loaded 40540 existing records. [2025-09-15T20:26:19.662992] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-15T20:26:19.807504] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:19.807761] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-15T20:26:19.807809] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-15T20:26:19.808542] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-15T20:26:19.808594] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-15T20:26:20.166812] [INFO ] [REMOTE ] SMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:20.457841] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-15T20:26:20.556439] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T20:26:20.794631] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T20:26:21.194771] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T20:26:21.257876] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-15T20:26:22.057873] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-15T20:26:22.857849] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-15T20:26:22.950928] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T20:26:23.364153] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-15T20:26:23.657869] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-15T20:26:23.763410] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T20:26:24.320690] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T20:26:24.322424] [INFO ] [REMOTE ] SMHI: Full fetch complete (16403 records). [2025-09-15T20:26:24.322537] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-15T20:26:24.467840] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-15T20:26:24.702982] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-15T20:26:24.703087] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-15T20:26:24.703513] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-15T20:26:24.703554] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-15T20:26:24.704209] [DEBUG] [LOCAL ] SMHI: Trimmed 16403 records to 9490 (keeping 150 days of data) [2025-09-15T20:26:24.760468] [DEBUG] [LOCAL ] SMHI: Primary data saved (9490 records). [2025-09-15T20:26:24.760606] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-15T20:26:24.760750] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMHI took 24.8s. Estimated remaining: 45m 22s. Rate: 9.4 symbols/min [2025-09-15T20:26:24.931347] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:24.967418] [DEBUG] [LOCAL ] SMRT: Loaded 33340 existing records from primary storage. [2025-09-15T20:26:24.967563] [INFO ] [MAIN ] SMRT: Loaded 33340 existing records. [2025-09-15T20:26:25.147374] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:25.147636] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-15T20:26:25.147703] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-15T20:26:25.148402] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-15T20:26:25.148452] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-15T20:26:25.262999] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-15T20:26:25.509202] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:26.057915] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-15T20:26:26.710445] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T20:26:26.859263] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-15T20:26:26.884147] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-15T20:26:27.499393] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T20:26:27.657896] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-15T20:26:28.379461] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:26:28.382193] [INFO ] [REMOTE ] SMP: Full fetch complete (21374 records). [2025-09-15T20:26:28.382294] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-15T20:26:28.473372] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-15T20:26:28.513135] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T20:26:28.784754] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-15T20:26:28.784832] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-15T20:26:28.785295] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-15T20:26:28.785370] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-15T20:26:28.785993] [DEBUG] [LOCAL ] SMP: Trimmed 21374 records to 13679 (keeping 150 days of data) [2025-09-15T20:26:28.874777] [DEBUG] [LOCAL ] SMP: Primary data saved (13679 records). [2025-09-15T20:26:28.874918] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-15T20:26:28.875015] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMP took 20.4s. Estimated remaining: 45m 16s. Rate: 9.4 symbols/min [2025-09-15T20:26:29.049351] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:29.074032] [DEBUG] [LOCAL ] SMWB: Loaded 25149 existing records from primary storage. [2025-09-15T20:26:29.074164] [INFO ] [MAIN ] SMWB: Loaded 25149 existing records. [2025-09-15T20:26:29.248207] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:29.248485] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-15T20:26:29.248532] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-15T20:26:29.249046] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-15T20:26:29.249110] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-15T20:26:29.263099] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-15T20:26:29.607945] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:30.057877] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-15T20:26:30.862522] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-15T20:26:30.869394] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-15T20:26:30.970400] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T20:26:31.496570] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:26:31.657901] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-15T20:26:32.452970] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:26:32.461233] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-15T20:26:32.976826] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:26:32.981846] [INFO ] [REMOTE ] SMG: Full fetch complete (48505 records). [2025-09-15T20:26:32.982021] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-15T20:26:33.263202] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-15T20:26:33.383773] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-15T20:26:33.383892] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-15T20:26:33.385313] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-15T20:26:33.385367] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-15T20:26:33.387021] [DEBUG] [LOCAL ] SMG: Trimmed 48505 records to 32007 (keeping 150 days of data) [2025-09-15T20:26:33.629193] [DEBUG] [LOCAL ] SMG: Primary data saved (32007 records). [2025-09-15T20:26:33.629409] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-15T20:26:33.630038] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMG took 38.9s. Estimated remaining: 45m 9s. Rate: 9.4 symbols/min [2025-09-15T20:26:33.823041] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:33.874010] [DEBUG] [LOCAL ] SN: Loaded 37572 existing records from primary storage. [2025-09-15T20:26:33.874235] [INFO ] [MAIN ] SN: Loaded 37572 existing records. [2025-09-15T20:26:34.068550] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-15T20:26:34.074967] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:34.076408] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-15T20:26:34.076475] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-15T20:26:34.077323] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-15T20:26:34.077383] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-15T20:26:34.461634] [INFO ] [REMOTE ] SN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:34.643492] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T20:26:34.857975] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-15T20:26:35.218859] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-15T20:26:35.281273] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T20:26:35.657895] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-15T20:26:36.017291] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T20:26:36.457872] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-15T20:26:37.257853] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-15T20:26:37.364874] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T20:26:37.894381] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:26:38.057884] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-15T20:26:38.561824] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T20:26:38.857891] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-15T20:26:39.030622] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T20:26:39.657914] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-15T20:26:40.240432] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T20:26:40.457878] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-15T20:26:40.985997] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T20:26:41.257941] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-15T20:26:42.051409] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:26:42.060525] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-15T20:26:42.857934] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-15T20:26:43.657853] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-15T20:26:43.740143] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:26:43.806130] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T20:26:43.888694] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-15T20:26:44.457887] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-15T20:26:44.945120] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:26:45.257896] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-15T20:26:46.057897] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-15T20:26:46.262825] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T20:26:46.510037] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:26:46.515924] [INFO ] [REMOTE ] SMRT: Full fetch complete (48181 records). [2025-09-15T20:26:46.516061] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-15T20:26:46.865741] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-15T20:26:46.898736] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-15T20:26:46.898830] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-15T20:26:46.899989] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-15T20:26:46.900053] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-15T20:26:46.901173] [DEBUG] [LOCAL ] SMRT: Trimmed 48181 records to 32661 (keeping 150 days of data) [2025-09-15T20:26:47.102663] [DEBUG] [LOCAL ] SMRT: Primary data saved (32661 records). [2025-09-15T20:26:47.102825] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-15T20:26:47.102915] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SMRT took 22.3s. Estimated remaining: 45m 4s. Rate: 9.4 symbols/min [2025-09-15T20:26:47.280240] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:47.302596] [DEBUG] [LOCAL ] SNA: Loaded 18915 existing records from primary storage. [2025-09-15T20:26:47.302806] [INFO ] [MAIN ] SNA: Loaded 18915 existing records. [2025-09-15T20:26:47.496866] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:47.497293] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-15T20:26:47.497348] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-15T20:26:47.497984] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-15T20:26:47.498042] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-15T20:26:47.671374] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-15T20:26:47.888453] [INFO ] [REMOTE ] SNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:47.890368] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:26:48.457876] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-15T20:26:49.257840] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-15T20:26:49.292418] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T20:26:49.438547] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:26:49.442372] [INFO ] [REMOTE ] SMWB: Full fetch complete (37441 records). [2025-09-15T20:26:49.442468] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-15T20:26:49.835727] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-15T20:26:49.835827] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-15T20:26:49.836866] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-15T20:26:49.836924] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-15T20:26:49.838115] [DEBUG] [LOCAL ] SMWB: Trimmed 37441 records to 24632 (keeping 150 days of data) [2025-09-15T20:26:49.958220] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-09-15T20:26:50.023967] [DEBUG] [LOCAL ] SMWB: Primary data saved (24632 records). [2025-09-15T20:26:50.024113] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-15T20:26:50.024224] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SMWB took 21.1s. Estimated remaining: 44m 57s. Rate: 9.4 symbols/min [2025-09-15T20:26:50.066345] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-15T20:26:50.199712] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:50.237663] [DEBUG] [LOCAL ] SNAP: Loaded 40536 existing records from primary storage. [2025-09-15T20:26:50.237815] [INFO ] [MAIN ] SNAP: Loaded 40536 existing records. [2025-09-15T20:26:50.416552] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:50.416869] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-15T20:26:50.416917] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-15T20:26:50.417739] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-15T20:26:50.417795] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-15T20:26:50.768320] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:50.784152] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T20:26:50.857937] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-15T20:26:51.657901] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-15T20:26:52.457912] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-15T20:26:52.534954] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-15T20:26:52.933801] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:26:53.167085] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-15T20:26:53.257827] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-15T20:26:53.738169] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T20:26:54.057889] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-15T20:26:54.857918] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-15T20:26:55.141181] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T20:26:55.657916] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-15T20:26:56.208979] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:26:56.457842] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-15T20:26:56.526969] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-15T20:26:56.534072] [INFO ] [REMOTE ] SMR: Full fetch complete (58477 records). [2025-09-15T20:26:56.534237] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-15T20:26:56.923011] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-15T20:26:56.923100] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-15T20:26:56.924080] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-15T20:26:56.924125] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-15T20:26:56.926688] [DEBUG] [LOCAL ] SMR: Trimmed 58477 records to 39761 (keeping 150 days of data) [2025-09-15T20:26:57.178896] [DEBUG] [LOCAL ] SMR: Primary data saved (39761 records). [2025-09-15T20:26:57.179052] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-15T20:26:57.180431] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SMR took 37.8s. Estimated remaining: 44m 51s. Rate: 9.4 symbols/min [2025-09-15T20:26:57.271424] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-15T20:26:57.355597] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:26:57.362864] [DEBUG] [LOCAL ] SNDA: Loaded 3402 existing records from primary storage. [2025-09-15T20:26:57.362977] [INFO ] [MAIN ] SNDA: Loaded 3402 existing records. [2025-09-15T20:26:57.542882] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:26:57.543194] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-15T20:26:57.543389] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-15T20:26:57.543813] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-15T20:26:57.543889] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-15T20:26:57.682599] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T20:26:57.917967] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:26:58.057878] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-15T20:26:58.168220] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-15T20:26:58.582048] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T20:26:58.857875] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-15T20:26:58.871659] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T20:26:59.657900] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-15T20:27:00.454009] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T20:27:00.458954] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-15T20:27:01.037235] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-15T20:27:01.257909] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-15T20:27:01.762089] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:27:02.031395] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T20:27:02.057829] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-15T20:27:02.857936] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-15T20:27:03.657880] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-15T20:27:04.453813] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T20:27:04.459417] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-15T20:27:05.012340] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T20:27:05.258700] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-15T20:27:05.262536] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T20:27:05.267839] [INFO ] [REMOTE ] SN: Full fetch complete (54202 records). [2025-09-15T20:27:05.267945] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-15T20:27:05.663464] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-15T20:27:05.663635] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-15T20:27:05.664731] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-15T20:27:05.664919] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-15T20:27:05.666368] [DEBUG] [LOCAL ] SN: Trimmed 54202 records to 36868 (keeping 150 days of data) [2025-09-15T20:27:05.797899] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.94 seconds). [2025-09-15T20:27:05.946200] [DEBUG] [LOCAL ] SN: Primary data saved (36868 records). [2025-09-15T20:27:05.946379] [INFO ] [MAIN ] SN: Full history saved. [2025-09-15T20:27:05.947707] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SN took 32.3s. Estimated remaining: 44m 45s. Rate: 9.4 symbols/min [2025-09-15T20:27:06.062015] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-15T20:27:06.140836] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:06.156250] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:27:06.189911] [DEBUG] [LOCAL ] SNDR: Loaded 30052 existing records from primary storage. [2025-09-15T20:27:06.190081] [INFO ] [MAIN ] SNDR: Loaded 30052 existing records. [2025-09-15T20:27:06.372727] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:06.373011] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-15T20:27:06.373067] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-15T20:27:06.373940] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-15T20:27:06.373991] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-15T20:27:06.798201] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T20:27:06.804248] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:06.857874] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-15T20:27:07.657888] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-15T20:27:08.450701] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:27:08.458236] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-15T20:27:09.068691] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T20:27:09.257878] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-15T20:27:09.996619] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-15T20:27:10.061988] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-15T20:27:10.062913] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:27:10.066546] [INFO ] [REMOTE ] SNA: Full fetch complete (28831 records). [2025-09-15T20:27:10.066624] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-15T20:27:10.434403] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-15T20:27:10.434492] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-15T20:27:10.435229] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-15T20:27:10.435272] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-15T20:27:10.435980] [DEBUG] [LOCAL ] SNA: Trimmed 28831 records to 18248 (keeping 150 days of data) [2025-09-15T20:27:10.553466] [DEBUG] [LOCAL ] SNA: Primary data saved (18248 records). [2025-09-15T20:27:10.553694] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-15T20:27:10.553815] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNA took 23.5s. Estimated remaining: 44m 38s. Rate: 9.4 symbols/min [2025-09-15T20:27:10.659063] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T20:27:10.742634] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:10.784013] [DEBUG] [LOCAL ] SNN: Loaded 33604 existing records from primary storage. [2025-09-15T20:27:10.784227] [INFO ] [MAIN ] SNN: Loaded 33604 existing records. [2025-09-15T20:27:10.863011] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-15T20:27:10.967440] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:10.967733] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-15T20:27:10.967791] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-15T20:27:10.968503] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-15T20:27:10.968554] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-15T20:27:11.317083] [INFO ] [REMOTE ] SNN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:11.657931] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-15T20:27:12.457916] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-15T20:27:13.247438] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T20:27:13.257810] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-15T20:27:13.673567] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-15T20:27:14.057865] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-15T20:27:14.281510] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T20:27:14.857932] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-15T20:27:15.493286] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T20:27:15.657867] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-15T20:27:16.457833] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-15T20:27:16.930019] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-15T20:27:16.936302] [INFO ] [REMOTE ] SNAP: Full fetch complete (58475 records). [2025-09-15T20:27:16.961944] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-15T20:27:16.967450] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-15T20:27:17.013801] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:27:17.040629] [INFO ] [REMOTE ] SNDA: Full fetch complete (5321 records). [2025-09-15T20:27:17.071424] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-15T20:27:17.272778] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-15T20:27:17.383166] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T20:27:17.814923] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-15T20:27:17.814850] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-15T20:27:17.815122] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-15T20:27:17.815320] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-15T20:27:17.815162] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-15T20:27:17.816527] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-15T20:27:17.816637] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-15T20:27:17.816602] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-15T20:27:17.817520] [DEBUG] [LOCAL ] SNDA: Trimmed 5321 records to 3259 (keeping 150 days of data) [2025-09-15T20:27:17.818284] [DEBUG] [LOCAL ] SNAP: Trimmed 58475 records to 39756 (keeping 150 days of data) [2025-09-15T20:27:17.931190] [DEBUG] [LOCAL ] SNDA: Primary data saved (3259 records). [2025-09-15T20:27:17.932580] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-15T20:27:17.932716] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SNDA took 20.8s. Estimated remaining: 44m 32s. Rate: 9.4 symbols/min [2025-09-15T20:27:18.107834] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-15T20:27:18.235306] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:18.255231] [DEBUG] [LOCAL ] SNAP: Primary data saved (39756 records). [2025-09-15T20:27:18.255411] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-15T20:27:18.255571] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNAP took 28.2s. Estimated remaining: 44m 24s. Rate: 9.4 symbols/min [2025-09-15T20:27:18.464869] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:18.465965] [DEBUG] [LOCAL ] SNOW: Loaded 40348 existing records from primary storage. [2025-09-15T20:27:18.466183] [INFO ] [MAIN ] SNOW: Loaded 40348 existing records. [2025-09-15T20:27:18.651041] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:18.651287] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-15T20:27:18.651333] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-15T20:27:18.652349] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-15T20:27:18.652404] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-15T20:27:18.762696] [DEBUG] [LOCAL ] SNV: Loaded 36219 existing records from primary storage. [2025-09-15T20:27:18.768425] [INFO ] [MAIN ] SNV: Loaded 36219 existing records. [2025-09-15T20:27:19.186573] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:19.188012] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-15T20:27:19.188180] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-15T20:27:19.206485] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-15T20:27:19.206615] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-15T20:27:19.206432] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:19.239491] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-15T20:27:19.578707] [INFO ] [REMOTE ] SNV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:19.633010] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-15T20:27:19.634010] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T20:27:19.657818] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-15T20:27:20.457883] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-15T20:27:21.131262] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:27:21.249716] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-15T20:27:21.259378] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-15T20:27:22.057862] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-15T20:27:22.141836] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T20:27:22.415064] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T20:27:22.857942] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-15T20:27:23.192143] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T20:27:23.657951] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-15T20:27:24.270707] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T20:27:24.457930] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-15T20:27:25.257900] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-15T20:27:25.550100] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T20:27:26.057915] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-15T20:27:26.356168] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T20:27:26.662806] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T20:27:26.857889] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-15T20:27:27.638495] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:27:27.657823] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-15T20:27:28.199551] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:27:28.203977] [INFO ] [REMOTE ] SNDR: Full fetch complete (44074 records). [2025-09-15T20:27:28.204111] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-15T20:27:28.463003] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-15T20:27:28.588679] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-15T20:27:28.588784] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-15T20:27:28.589837] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-15T20:27:28.589889] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-15T20:27:28.591635] [DEBUG] [LOCAL ] SNDR: Trimmed 44074 records to 29459 (keeping 150 days of data) [2025-09-15T20:27:28.711606] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T20:27:28.719157] [INFO ] [REMOTE ] SNN: Full fetch complete (47909 records). [2025-09-15T20:27:28.719932] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-15T20:27:29.117713] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-15T20:27:29.118288] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-15T20:27:29.119614] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-15T20:27:29.119955] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-15T20:27:29.149684] [DEBUG] [LOCAL ] SNN: Trimmed 47909 records to 32922 (keeping 150 days of data) [2025-09-15T20:27:29.258144] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-15T20:27:29.284802] [DEBUG] [LOCAL ] SNDR: Primary data saved (29459 records). [2025-09-15T20:27:29.287069] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-15T20:27:29.289496] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNDR took 23.3s. Estimated remaining: 44m 19s. Rate: 9.4 symbols/min [2025-09-15T20:27:29.471142] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:29.575567] [DEBUG] [LOCAL ] SNX: Loaded 28354 existing records from primary storage. [2025-09-15T20:27:29.576245] [INFO ] [MAIN ] SNX: Loaded 28354 existing records. [2025-09-15T20:27:29.634286] [DEBUG] [LOCAL ] SNN: Primary data saved (32922 records). [2025-09-15T20:27:29.648909] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-15T20:27:29.659954] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNN took 19.1s. Estimated remaining: 44m 11s. Rate: 9.4 symbols/min [2025-09-15T20:27:29.893422] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:29.940389] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-15T20:27:29.939898] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:29.941195] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-15T20:27:29.942076] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-15T20:27:29.942260] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-15T20:27:30.260831] [DEBUG] [LOCAL ] SO: Loaded 40357 existing records from primary storage. [2025-09-15T20:27:30.289223] [INFO ] [MAIN ] SO: Loaded 40357 existing records. [2025-09-15T20:27:30.391979] [INFO ] [REMOTE ] SNX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:30.439754] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-15T20:27:30.482388] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T20:27:30.572182] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:30.572415] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-15T20:27:30.572463] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-15T20:27:30.573299] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-15T20:27:30.573349] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-15T20:27:30.862933] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-15T20:27:30.925237] [INFO ] [REMOTE ] SO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:31.563435] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-15T20:27:31.657867] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-15T20:27:31.755701] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T20:27:32.435532] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T20:27:32.457822] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-15T20:27:33.082138] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T20:27:33.257878] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-15T20:27:33.625263] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T20:27:34.057934] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-15T20:27:34.857960] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-15T20:27:35.657847] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-15T20:27:35.733153] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-15T20:27:35.808634] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T20:27:36.199600] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T20:27:36.457869] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-15T20:27:37.261560] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-15T20:27:37.264384] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:27:38.057938] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-15T20:27:38.326018] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T20:27:38.857908] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-15T20:27:39.150247] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T20:27:39.666593] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-15T20:27:39.684513] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T20:27:40.248442] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T20:27:40.457916] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-15T20:27:41.257926] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-15T20:27:41.465253] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T20:27:41.825599] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T20:27:42.057884] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-15T20:27:42.724875] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:27:42.857863] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-15T20:27:43.301733] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T20:27:43.657931] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-15T20:27:44.457916] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-15T20:27:44.529634] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T20:27:45.257954] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-15T20:27:45.701693] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-15T20:27:46.057951] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-15T20:27:46.113533] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T20:27:46.857897] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-15T20:27:47.293243] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T20:27:47.657874] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-15T20:27:48.049175] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:27:48.055108] [INFO ] [REMOTE ] SNV: Full fetch complete (53213 records). [2025-09-15T20:27:48.055322] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-15T20:27:48.482136] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-15T20:27:48.486913] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-15T20:27:48.540216] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-15T20:27:48.540515] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-15T20:27:48.541787] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-15T20:27:48.541918] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-15T20:27:48.560887] [DEBUG] [LOCAL ] SNV: Trimmed 53213 records to 35457 (keeping 150 days of data) [2025-09-15T20:27:48.563227] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T20:27:48.661236] [INFO ] [REMOTE ] SO: Full fetch complete (57890 records). [2025-09-15T20:27:48.667709] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-15T20:27:48.670442] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:27:48.670939] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:27:48.671402] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:27:48.671899] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-15T20:27:48.672274] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-15T20:27:48.673184] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-15T20:27:48.674242] [DEBUG] [LOCAL ] SO: Deleted derivative data file. [2025-09-15T20:27:48.674666] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SO took 19.0s. Estimated remaining: 44m 7s. Rate: 9.4 symbols/min [2025-09-15T20:27:48.878255] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:48.993825] [DEBUG] [LOCAL ] SNV: Primary data saved (35457 records). [2025-09-15T20:27:48.994806] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-15T20:27:48.994936] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SNV took 30.7s. Estimated remaining: 43m 60s. Rate: 9.4 symbols/min [2025-09-15T20:27:49.107804] [DEBUG] [LOCAL ] SOBO: Loaded 29189 existing records from primary storage. [2025-09-15T20:27:49.110808] [INFO ] [MAIN ] SOBO: Loaded 29189 existing records. [2025-09-15T20:27:49.260245] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-15T20:27:49.294912] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:49.410824] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:49.411174] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-15T20:27:49.411223] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-15T20:27:49.412029] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-15T20:27:49.412095] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-15T20:27:49.570576] [DEBUG] [LOCAL ] SOC: Loaded 38142 existing records from primary storage. [2025-09-15T20:27:49.581078] [INFO ] [MAIN ] SOC: Loaded 38142 existing records. [2025-09-15T20:27:50.074782] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:50.099872] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:50.100982] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-15T20:27:50.100528] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-15T20:27:50.102314] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-15T20:27:50.103308] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-15T20:27:50.103383] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-15T20:27:50.255535] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T20:27:50.569912] [INFO ] [REMOTE ] SOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:50.857930] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-15T20:27:51.547827] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-15T20:27:51.556163] [INFO ] [REMOTE ] SNOW: Full fetch complete (58250 records). [2025-09-15T20:27:51.556440] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-15T20:27:51.664364] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-15T20:27:51.959661] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-15T20:27:51.959862] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-15T20:27:51.960899] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-15T20:27:51.961039] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-15T20:27:51.985262] [DEBUG] [LOCAL ] SNOW: Trimmed 58250 records to 39579 (keeping 150 days of data) [2025-09-15T20:27:51.988490] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T20:27:52.253579] [DEBUG] [LOCAL ] SNOW: Primary data saved (39579 records). [2025-09-15T20:27:52.253777] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-15T20:27:52.254555] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SNOW took 34.3s. Estimated remaining: 43m 53s. Rate: 9.4 symbols/min [2025-09-15T20:27:52.428048] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:27:52.433847] [DEBUG] [LOCAL ] SOJC: Loaded 3322 existing records from primary storage. [2025-09-15T20:27:52.433963] [INFO ] [MAIN ] SOJC: Loaded 3322 existing records. [2025-09-15T20:27:52.464450] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-15T20:27:52.661027] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:27:52.665031] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:27:52.678703] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-15T20:27:52.678853] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-15T20:27:52.679220] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-15T20:27:52.679340] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-15T20:27:52.787054] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T20:27:52.823051] [INFO ] [REMOTE ] SNX: Full fetch complete (42525 records). [2025-09-15T20:27:52.846436] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-15T20:27:53.269663] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:27:53.264376] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-15T20:27:53.446941] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-15T20:27:53.447052] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-15T20:27:53.448227] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-15T20:27:53.448280] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-15T20:27:53.449523] [DEBUG] [LOCAL ] SNX: Trimmed 42525 records to 27621 (keeping 150 days of data) [2025-09-15T20:27:53.636468] [DEBUG] [LOCAL ] SNX: Primary data saved (27621 records). [2025-09-15T20:27:53.636682] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-15T20:27:53.636797] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SNX took 24.3s. Estimated remaining: 43m 45s. Rate: 9.4 symbols/min [2025-09-15T20:27:54.063445] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-15T20:27:54.081981] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:27:54.753019] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T20:27:54.857863] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-15T20:27:54.963256] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T20:27:55.483446] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T20:27:55.657963] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-15T20:27:56.253888] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T20:27:56.457958] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-15T20:27:57.091477] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T20:27:57.257896] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-15T20:27:57.824683] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T20:27:58.057932] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-15T20:27:58.857962] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-15T20:27:59.657956] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-15T20:27:59.767924] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T20:28:00.051856] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T20:28:00.182497] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T20:28:00.457940] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-15T20:28:01.257931] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-15T20:28:01.843100] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T20:28:02.057859] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-15T20:28:02.138751] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T20:28:02.614267] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:28:02.615398] [INFO ] [REMOTE ] SOJC: Full fetch complete (5442 records). [2025-09-15T20:28:02.615476] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-15T20:28:02.866149] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-15T20:28:02.970833] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-15T20:28:02.970918] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-15T20:28:02.971100] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-15T20:28:02.971147] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-15T20:28:02.971584] [DEBUG] [LOCAL ] SOJC: Trimmed 5442 records to 3263 (keeping 150 days of data) [2025-09-15T20:28:02.993435] [DEBUG] [LOCAL ] SOJC: Primary data saved (3263 records). [2025-09-15T20:28:02.993553] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-15T20:28:02.993684] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SOJC took 10.7s. Estimated remaining: 43m 40s. Rate: 9.4 symbols/min [2025-09-15T20:28:03.657972] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-15T20:28:04.129907] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T20:28:04.457940] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-15T20:28:05.289418] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T20:28:05.300157] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-15T20:28:05.647482] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T20:28:06.057881] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-15T20:28:07.333089] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:28:07.345445] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-15T20:28:07.373757] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:28:07.657856] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-15T20:28:08.812790] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T20:28:08.821073] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-15T20:28:09.153430] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:28:09.257837] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-15T20:28:10.048789] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:28:10.053338] [INFO ] [REMOTE ] SOBO: Full fetch complete (43637 records). [2025-09-15T20:28:10.053432] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-15T20:28:10.446292] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-15T20:28:10.446378] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-15T20:28:10.447342] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-15T20:28:10.447398] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-15T20:28:10.448380] [DEBUG] [LOCAL ] SOBO: Trimmed 43637 records to 28587 (keeping 150 days of data) [2025-09-15T20:28:10.630006] [DEBUG] [LOCAL ] SOBO: Primary data saved (28587 records). [2025-09-15T20:28:10.630202] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-15T20:28:10.630326] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOBO took 22.0s. Estimated remaining: 43m 33s. Rate: 9.4 symbols/min [2025-09-15T20:28:10.747461] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T20:28:10.753672] [INFO ] [REMOTE ] SOC: Full fetch complete (54345 records). [2025-09-15T20:28:10.753776] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-15T20:28:11.126979] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-15T20:28:11.127104] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-15T20:28:11.128061] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-15T20:28:11.128109] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-15T20:28:11.129273] [DEBUG] [LOCAL ] SOC: Trimmed 54345 records to 37427 (keeping 150 days of data) [2025-09-15T20:28:11.357051] [DEBUG] [LOCAL ] SOC: Primary data saved (37427 records). [2025-09-15T20:28:11.357207] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-15T20:28:11.357294] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOC took 22.4s. Estimated remaining: 43m 26s. Rate: 9.4 symbols/min [2025-09-15T20:28:11.876405] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:11.958908] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:12.050324] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:12.080358] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:12.087047] [DEBUG] [LOCAL ] SOJE: Loaded 6732 existing records from primary storage. [2025-09-15T20:28:12.087237] [INFO ] [MAIN ] SOJE: Loaded 6732 existing records. [2025-09-15T20:28:12.173333] [DEBUG] [LOCAL ] SOJF: Loaded 6057 existing records from primary storage. [2025-09-15T20:28:12.213881] [DEBUG] [LOCAL ] SOJD: Loaded 9332 existing records from primary storage. [2025-09-15T20:28:12.215330] [DEBUG] [LOCAL ] SOL: Loaded 9735 existing records from primary storage. [2025-09-15T20:28:12.215488] [INFO ] [MAIN ] SOJD: Loaded 9332 existing records. [2025-09-15T20:28:12.214126] [INFO ] [MAIN ] SOJF: Loaded 6057 existing records. [2025-09-15T20:28:12.236820] [INFO ] [MAIN ] SOL: Loaded 9735 existing records. [2025-09-15T20:28:12.440097] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:12.519157] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-15T20:28:12.534728] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-15T20:28:12.607349] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-15T20:28:12.612701] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-15T20:28:12.992548] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:13.045236] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:13.045106] [WARN ] [MAIN ] SOJF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:13.066877] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-15T20:28:13.072112] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-15T20:28:13.086930] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-15T20:28:13.087033] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-15T20:28:13.086636] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-15T20:28:13.135889] [DEBUG] [LOCAL ] SOJF: Deleted primary data file. [2025-09-15T20:28:13.136105] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-15T20:28:13.136055] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-15T20:28:13.162715] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-15T20:28:13.191398] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-15T20:28:13.238955] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-15T20:28:13.286470] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-15T20:28:13.634740] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:13.730109] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-15T20:28:14.322965] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:14.369682] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-15T20:28:14.391894] [INFO ] [REMOTE ] SOL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:14.393736] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-15T20:28:14.472498] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:14.472877] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-15T20:28:14.815475] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T20:28:14.817941] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-15T20:28:15.149438] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T20:28:15.152609] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-15T20:28:15.184854] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T20:28:15.187971] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-15T20:28:15.209281] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T20:28:15.416050] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T20:28:15.657893] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-15T20:28:16.131560] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:28:16.163749] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:28:16.457901] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-15T20:28:16.505187] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:28:17.161207] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T20:28:17.257948] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-15T20:28:18.014530] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T20:28:18.057815] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-15T20:28:18.798515] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T20:28:18.857839] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-15T20:28:19.645880] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:28:19.657813] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-15T20:28:20.457894] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-15T20:28:20.473374] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T20:28:21.257900] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-15T20:28:21.293284] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T20:28:21.995415] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T20:28:22.057880] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-15T20:28:22.766720] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T20:28:22.857889] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-15T20:28:23.657896] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-15T20:28:23.685747] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T20:28:24.457864] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-15T20:28:24.731097] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:28:25.070555] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:28:25.257892] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-15T20:28:26.057917] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-15T20:28:26.058941] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T20:28:26.857866] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-15T20:28:27.112001] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T20:28:27.331384] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T20:28:27.657918] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-15T20:28:28.457881] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-15T20:28:28.512514] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T20:28:28.877689] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T20:28:28.879028] [INFO ] [REMOTE ] SOJF: Full fetch complete (9661 records). [2025-09-15T20:28:28.879095] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-15T20:28:29.235863] [DEBUG] [VALIDATOR ] SOJF: All expected trading days are present. [2025-09-15T20:28:29.235967] [DEBUG] [VALIDATOR ] SOJF: Primary data validation passed. [2025-09-15T20:28:29.236226] [INFO ] [MAIN ] SOJF: Fetched primary data is valid. [2025-09-15T20:28:29.236266] [DEBUG] [LOCAL ] SOJF: Saving primary data. [2025-09-15T20:28:29.236727] [DEBUG] [LOCAL ] SOJF: Trimmed 9661 records to 5906 (keeping 150 days of data) [2025-09-15T20:28:29.264228] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-15T20:28:29.279252] [DEBUG] [LOCAL ] SOJF: Primary data saved (5906 records). [2025-09-15T20:28:29.279346] [INFO ] [MAIN ] SOJF: Full history saved. [2025-09-15T20:28:29.279462] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOJF took 17.9s. Estimated remaining: 43m 22s. Rate: 9.4 symbols/min [2025-09-15T20:28:29.451820] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:29.488039] [DEBUG] [LOCAL ] SOLV: Loaded 32609 existing records from primary storage. [2025-09-15T20:28:29.488189] [INFO ] [MAIN ] SOLV: Loaded 32609 existing records. [2025-09-15T20:28:29.662792] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:29.663060] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-15T20:28:29.663111] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-15T20:28:29.663733] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-15T20:28:29.663784] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-15T20:28:30.012592] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:30.057827] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-15T20:28:30.091289] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T20:28:30.857924] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-15T20:28:31.580434] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T20:28:31.657838] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-15T20:28:31.844666] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T20:28:32.457885] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-15T20:28:33.172887] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:28:33.174681] [INFO ] [REMOTE ] SOL: Full fetch complete (15024 records). [2025-09-15T20:28:33.174766] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-15T20:28:33.258120] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-15T20:28:33.587945] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T20:28:33.592282] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-15T20:28:33.601945] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-15T20:28:33.602731] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-15T20:28:33.602781] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-15T20:28:33.603348] [DEBUG] [LOCAL ] SOL: Trimmed 15024 records to 9596 (keeping 150 days of data) [2025-09-15T20:28:33.660100] [DEBUG] [LOCAL ] SOL: Primary data saved (9596 records). [2025-09-15T20:28:33.660258] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-15T20:28:33.660365] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOL took 22.3s. Estimated remaining: 43m 15s. Rate: 9.4 symbols/min [2025-09-15T20:28:33.829392] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:33.863589] [DEBUG] [LOCAL ] SON: Loaded 31881 existing records from primary storage. [2025-09-15T20:28:33.863763] [INFO ] [MAIN ] SON: Loaded 31881 existing records. [2025-09-15T20:28:34.037420] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:34.037728] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-15T20:28:34.037794] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-15T20:28:34.038489] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-15T20:28:34.038550] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-15T20:28:34.068948] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-15T20:28:34.193532] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:28:34.414438] [INFO ] [REMOTE ] SON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:34.779318] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:28:34.781035] [INFO ] [REMOTE ] SOJE: Full fetch complete (10309 records). [2025-09-15T20:28:34.781109] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-15T20:28:34.863014] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-15T20:28:35.140813] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-15T20:28:35.140914] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-15T20:28:35.141155] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-15T20:28:35.141206] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-15T20:28:35.141631] [DEBUG] [LOCAL ] SOJE: Trimmed 10309 records to 6610 (keeping 150 days of data) [2025-09-15T20:28:35.184674] [DEBUG] [LOCAL ] SOJE: Primary data saved (6610 records). [2025-09-15T20:28:35.184808] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-15T20:28:35.184890] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SOJE took 23.8s. Estimated remaining: 43m 8s. Rate: 9.4 symbols/min [2025-09-15T20:28:35.352920] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:35.407194] [DEBUG] [LOCAL ] SONY: Loaded 40174 existing records from primary storage. [2025-09-15T20:28:35.407363] [INFO ] [MAIN ] SONY: Loaded 40174 existing records. [2025-09-15T20:28:35.588435] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:35.588706] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-15T20:28:35.588756] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-15T20:28:35.589666] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-15T20:28:35.589723] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-15T20:28:35.664165] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-15T20:28:35.952894] [INFO ] [REMOTE ] SONY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:36.452904] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T20:28:36.462310] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-15T20:28:36.566764] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T20:28:37.257925] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-15T20:28:38.057920] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-15T20:28:38.185408] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T20:28:38.846296] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:28:38.857813] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-15T20:28:38.937971] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T20:28:39.657868] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-15T20:28:40.299291] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T20:28:40.457911] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-15T20:28:41.257899] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-15T20:28:41.487312] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:28:42.022429] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T20:28:42.057823] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-15T20:28:42.741174] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:28:42.857989] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-15T20:28:43.511387] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T20:28:43.513416] [INFO ] [REMOTE ] SOJD: Full fetch complete (14310 records). [2025-09-15T20:28:43.513528] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-15T20:28:43.659691] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-15T20:28:43.890276] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-15T20:28:43.890416] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-15T20:28:43.890822] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-15T20:28:43.890963] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-15T20:28:43.891870] [DEBUG] [LOCAL ] SOJD: Trimmed 14310 records to 9165 (keeping 150 days of data) [2025-09-15T20:28:43.975779] [DEBUG] [LOCAL ] SOJD: Primary data saved (9165 records). [2025-09-15T20:28:43.978234] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-15T20:28:43.978030] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T20:28:43.978493] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SOJD took 32.6s. Estimated remaining: 43m 2s. Rate: 9.4 symbols/min [2025-09-15T20:28:44.159928] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:44.164112] [DEBUG] [LOCAL ] SOR: Loaded 2202 existing records from primary storage. [2025-09-15T20:28:44.164234] [INFO ] [MAIN ] SOR: Loaded 2202 existing records. [2025-09-15T20:28:44.349045] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:44.349341] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-15T20:28:44.349391] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-15T20:28:44.349603] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-15T20:28:44.349691] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-15T20:28:44.463044] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-15T20:28:44.716614] [INFO ] [REMOTE ] SOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:45.257926] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-15T20:28:45.428807] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T20:28:45.721395] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T20:28:46.057876] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-15T20:28:46.395766] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:28:46.602093] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T20:28:46.857938] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-15T20:28:47.502588] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T20:28:47.657910] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-15T20:28:48.457881] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-15T20:28:48.883503] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:28:48.888723] [INFO ] [REMOTE ] SOLV: Full fetch complete (48027 records). [2025-09-15T20:28:48.888817] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-15T20:28:49.177897] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T20:28:49.265421] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-15T20:28:49.268823] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-15T20:28:49.268878] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-15T20:28:49.269809] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-15T20:28:49.269938] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-15T20:28:49.271200] [DEBUG] [LOCAL ] SOLV: Trimmed 48027 records to 32001 (keeping 150 days of data) [2025-09-15T20:28:49.468311] [DEBUG] [LOCAL ] SOLV: Primary data saved (32001 records). [2025-09-15T20:28:49.468468] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-15T20:28:49.468554] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SOLV took 20.2s. Estimated remaining: 42m 55s. Rate: 9.4 symbols/min [2025-09-15T20:28:49.636137] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:28:49.644038] [DEBUG] [LOCAL ] SOS: Loaded 6662 existing records from primary storage. [2025-09-15T20:28:49.644138] [INFO ] [MAIN ] SOS: Loaded 6662 existing records. [2025-09-15T20:28:49.819555] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:28:49.819799] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-15T20:28:49.819873] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-15T20:28:49.820190] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-15T20:28:49.820238] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-15T20:28:50.067246] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-15T20:28:50.173569] [INFO ] [REMOTE ] SOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:28:50.743332] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T20:28:50.857865] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-15T20:28:50.988903] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T20:28:51.657913] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-15T20:28:52.151432] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T20:28:52.457998] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-15T20:28:52.795922] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T20:28:52.837385] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T20:28:53.257946] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-15T20:28:54.047916] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T20:28:54.057815] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-15T20:28:54.568114] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T20:28:54.857882] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-15T20:28:55.368333] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T20:28:55.657921] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-15T20:28:56.457925] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-15T20:28:57.099744] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T20:28:57.235236] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T20:28:57.257838] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-15T20:28:57.700049] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T20:28:58.057872] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-15T20:28:58.857851] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-15T20:28:59.154878] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T20:28:59.657864] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-15T20:29:00.457895] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-15T20:29:00.568237] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T20:29:00.680876] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T20:29:01.016968] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:29:01.017962] [INFO ] [REMOTE ] SOR: Full fetch complete (3157 records). [2025-09-15T20:29:01.018029] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-15T20:29:01.263030] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-15T20:29:01.373570] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-15T20:29:01.373673] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-15T20:29:01.373795] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-15T20:29:01.373834] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-15T20:29:01.374208] [DEBUG] [LOCAL ] SOR: Trimmed 3157 records to 2158 (keeping 150 days of data) [2025-09-15T20:29:01.388128] [DEBUG] [LOCAL ] SOR: Primary data saved (2158 records). [2025-09-15T20:29:01.388194] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-15T20:29:01.388267] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOR took 17.4s. Estimated remaining: 42m 50s. Rate: 9.4 symbols/min [2025-09-15T20:29:01.557356] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:01.585226] [DEBUG] [LOCAL ] SPB: Loaded 26486 existing records from primary storage. [2025-09-15T20:29:01.585374] [INFO ] [MAIN ] SPB: Loaded 26486 existing records. [2025-09-15T20:29:01.770877] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:01.771220] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-15T20:29:01.771290] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-15T20:29:01.772169] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-15T20:29:01.772257] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-15T20:29:02.063070] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-15T20:29:02.135293] [INFO ] [REMOTE ] SPB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:02.857847] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-15T20:29:03.155792] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T20:29:03.158141] [INFO ] [REMOTE ] SOS: Full fetch complete (7620 records). [2025-09-15T20:29:03.158215] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-15T20:29:03.570513] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-15T20:29:03.570729] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-15T20:29:03.571087] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-15T20:29:03.571147] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-15T20:29:03.572411] [DEBUG] [LOCAL ] SOS: Trimmed 7620 records to 6737 (keeping 150 days of data) [2025-09-15T20:29:03.640580] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T20:29:03.663681] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-15T20:29:03.665695] [DEBUG] [LOCAL ] SOS: Primary data saved (6737 records). [2025-09-15T20:29:03.667333] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-15T20:29:03.667485] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SOS took 14.2s. Estimated remaining: 42m 43s. Rate: 9.4 symbols/min [2025-09-15T20:29:03.860080] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:03.898165] [DEBUG] [LOCAL ] SPCE: Loaded 37283 existing records from primary storage. [2025-09-15T20:29:03.898325] [INFO ] [MAIN ] SPCE: Loaded 37283 existing records. [2025-09-15T20:29:04.077059] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:04.077327] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-15T20:29:04.077373] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-15T20:29:04.078348] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-15T20:29:04.078441] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-15T20:29:04.439408] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:04.463330] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-15T20:29:04.467920] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:29:05.257909] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-15T20:29:05.314236] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T20:29:06.057890] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-15T20:29:06.302081] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T20:29:06.656567] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:29:06.857883] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-15T20:29:07.657853] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-15T20:29:07.897155] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T20:29:08.342201] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T20:29:08.457876] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-15T20:29:09.130308] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:29:09.257938] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-15T20:29:10.057909] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-15T20:29:10.251238] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T20:29:10.262395] [INFO ] [REMOTE ] SONY: Full fetch complete (58013 records). [2025-09-15T20:29:10.262708] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-15T20:29:10.717936] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-15T20:29:10.718128] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-15T20:29:10.719909] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-15T20:29:10.719996] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-15T20:29:10.721819] [DEBUG] [LOCAL ] SONY: Trimmed 58013 records to 39389 (keeping 150 days of data) [2025-09-15T20:29:10.858026] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-15T20:29:10.981532] [DEBUG] [LOCAL ] SONY: Primary data saved (39389 records). [2025-09-15T20:29:10.981691] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-15T20:29:10.982413] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SONY took 35.8s. Estimated remaining: 42m 37s. Rate: 9.4 symbols/min [2025-09-15T20:29:11.196337] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:11.205905] [DEBUG] [LOCAL ] SPE: Loaded 4408 existing records from primary storage. [2025-09-15T20:29:11.206301] [INFO ] [MAIN ] SPE: Loaded 4408 existing records. [2025-09-15T20:29:11.399130] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:11.399616] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-15T20:29:11.399926] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-15T20:29:11.400367] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-15T20:29:11.400490] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-15T20:29:11.641007] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T20:29:11.738257] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-15T20:29:11.785761] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T20:29:11.850005] [INFO ] [REMOTE ] SPE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:12.447288] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:29:12.457835] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-15T20:29:13.257934] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-15T20:29:13.441172] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:29:13.765436] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:29:14.057938] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-15T20:29:14.694301] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T20:29:14.699354] [INFO ] [REMOTE ] SON: Full fetch complete (46669 records). [2025-09-15T20:29:14.699448] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-15T20:29:14.863005] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-15T20:29:15.125046] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-15T20:29:15.125156] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-15T20:29:15.126495] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-15T20:29:15.126544] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-15T20:29:15.127988] [DEBUG] [LOCAL ] SON: Trimmed 46669 records to 31361 (keeping 150 days of data) [2025-09-15T20:29:15.322510] [DEBUG] [LOCAL ] SON: Primary data saved (31361 records). [2025-09-15T20:29:15.322735] [INFO ] [MAIN ] SON: Full history saved. [2025-09-15T20:29:15.322847] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SON took 41.7s. Estimated remaining: 42m 30s. Rate: 9.4 symbols/min [2025-09-15T20:29:15.501569] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:15.541282] [DEBUG] [LOCAL ] SPG: Loaded 37747 existing records from primary storage. [2025-09-15T20:29:15.541464] [INFO ] [MAIN ] SPG: Loaded 37747 existing records. [2025-09-15T20:29:15.663196] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-15T20:29:15.734238] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:15.735363] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-15T20:29:15.735466] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-15T20:29:15.736356] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-15T20:29:15.736410] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-15T20:29:16.152328] [INFO ] [REMOTE ] SPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:16.203496] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T20:29:16.245743] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T20:29:16.457930] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-15T20:29:16.549972] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T20:29:17.257884] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-15T20:29:17.829877] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T20:29:18.057921] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-15T20:29:18.568827] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T20:29:18.857901] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-15T20:29:19.323908] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T20:29:19.657862] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-15T20:29:19.769114] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T20:29:20.457880] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-15T20:29:21.179218] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:29:21.257882] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-15T20:29:21.924358] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:29:22.057866] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-15T20:29:22.189780] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:29:22.804276] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:29:22.857871] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-15T20:29:23.527886] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T20:29:23.657866] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-15T20:29:24.457896] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-15T20:29:25.189250] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T20:29:25.257893] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-15T20:29:25.688764] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:29:26.057870] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-15T20:29:26.857878] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-15T20:29:27.225391] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T20:29:27.657874] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-15T20:29:27.834358] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:29:27.869412] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:29:27.867590] [INFO ] [REMOTE ] SPB: Full fetch complete (36961 records). [2025-09-15T20:29:27.869639] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-15T20:29:28.280379] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-15T20:29:28.280471] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-15T20:29:28.281404] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-15T20:29:28.281454] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-15T20:29:28.282320] [DEBUG] [LOCAL ] SPB: Trimmed 36961 records to 26023 (keeping 150 days of data) [2025-09-15T20:29:28.450683] [DEBUG] [LOCAL ] SPB: Primary data saved (26023 records). [2025-09-15T20:29:28.450823] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-15T20:29:28.450928] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SPB took 27.1s. Estimated remaining: 42m 25s. Rate: 9.4 symbols/min [2025-09-15T20:29:28.464133] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-15T20:29:28.624693] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:28.660762] [DEBUG] [LOCAL ] SPGI: Loaded 33520 existing records from primary storage. [2025-09-15T20:29:28.660907] [INFO ] [MAIN ] SPGI: Loaded 33520 existing records. [2025-09-15T20:29:28.835212] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:28.835482] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-15T20:29:28.835528] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-15T20:29:28.836268] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-15T20:29:28.836322] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-15T20:29:29.143242] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T20:29:29.169454] [INFO ] [REMOTE ] SPE: Full fetch complete (7102 records). [2025-09-15T20:29:29.186990] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-15T20:29:29.212357] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:29.264618] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-15T20:29:29.572367] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-15T20:29:29.572524] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-15T20:29:29.572769] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-15T20:29:29.572822] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-15T20:29:29.573494] [DEBUG] [LOCAL ] SPE: Trimmed 7102 records to 4390 (keeping 150 days of data) [2025-09-15T20:29:29.628596] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T20:29:29.645580] [DEBUG] [LOCAL ] SPE: Primary data saved (4390 records). [2025-09-15T20:29:29.645700] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-15T20:29:29.645826] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPE took 18.7s. Estimated remaining: 42m 17s. Rate: 9.4 symbols/min [2025-09-15T20:29:29.817050] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:29.832220] [DEBUG] [LOCAL ] SPH: Loaded 12937 existing records from primary storage. [2025-09-15T20:29:29.832357] [INFO ] [MAIN ] SPH: Loaded 12937 existing records. [2025-09-15T20:29:30.025193] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:30.025557] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-15T20:29:30.038611] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-15T20:29:30.039538] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:29:30.044956] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-15T20:29:30.045049] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-15T20:29:30.066196] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-15T20:29:30.050262] [INFO ] [REMOTE ] SPCE: Full fetch complete (53953 records). [2025-09-15T20:29:30.089747] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-15T20:29:30.762725] [INFO ] [REMOTE ] SPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:30.794419] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-15T20:29:30.794508] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-15T20:29:30.795382] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-15T20:29:30.795428] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-15T20:29:30.796552] [DEBUG] [LOCAL ] SPCE: Trimmed 53953 records to 36680 (keeping 150 days of data) [2025-09-15T20:29:30.858681] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-15T20:29:31.021317] [DEBUG] [LOCAL ] SPCE: Primary data saved (36680 records). [2025-09-15T20:29:31.021479] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-15T20:29:31.023024] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPCE took 27.4s. Estimated remaining: 42m 10s. Rate: 9.4 symbols/min [2025-09-15T20:29:31.194822] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:31.225080] [DEBUG] [LOCAL ] SPHR: Loaded 29000 existing records from primary storage. [2025-09-15T20:29:31.225213] [INFO ] [MAIN ] SPHR: Loaded 29000 existing records. [2025-09-15T20:29:31.398286] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:31.398511] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-15T20:29:31.398563] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-15T20:29:31.399142] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-15T20:29:31.399189] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-15T20:29:31.663507] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-15T20:29:31.754767] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:31.810599] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T20:29:32.457906] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-15T20:29:32.684395] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T20:29:32.717233] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T20:29:33.257897] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-15T20:29:33.556301] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T20:29:34.057935] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-15T20:29:34.857897] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-15T20:29:35.004081] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T20:29:35.657848] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-15T20:29:35.728214] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T20:29:36.424085] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-15T20:29:36.457810] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-15T20:29:37.257851] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-15T20:29:37.655598] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-15T20:29:38.057930] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-15T20:29:38.098830] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:29:38.857901] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-15T20:29:39.032055] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T20:29:39.574831] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T20:29:39.581148] [INFO ] [REMOTE ] SPG: Full fetch complete (54476 records). [2025-09-15T20:29:39.581279] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-15T20:29:39.663037] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-15T20:29:39.980997] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-15T20:29:39.981152] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-15T20:29:39.982186] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-15T20:29:39.982250] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-15T20:29:39.993219] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T20:29:39.997328] [DEBUG] [LOCAL ] SPG: Trimmed 54476 records to 37013 (keeping 150 days of data) [2025-09-15T20:29:40.239746] [DEBUG] [LOCAL ] SPG: Primary data saved (37013 records). [2025-09-15T20:29:40.239891] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-15T20:29:40.239983] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPG took 24.9s. Estimated remaining: 42m 4s. Rate: 9.4 symbols/min [2025-09-15T20:29:40.406266] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:40.433004] [DEBUG] [LOCAL ] SPIR: Loaded 28150 existing records from primary storage. [2025-09-15T20:29:40.433152] [INFO ] [MAIN ] SPIR: Loaded 28150 existing records. [2025-09-15T20:29:40.463053] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-15T20:29:40.608095] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:40.608321] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-15T20:29:40.608367] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-15T20:29:40.608985] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-15T20:29:40.609034] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-15T20:29:40.957882] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:41.257828] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-15T20:29:41.745609] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T20:29:42.057867] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-15T20:29:42.172038] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T20:29:42.467092] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T20:29:42.827136] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T20:29:42.857859] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-15T20:29:43.657868] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-15T20:29:43.826588] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T20:29:44.457890] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-15T20:29:44.990031] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T20:29:45.257925] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-15T20:29:45.919455] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:29:46.057862] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-15T20:29:46.317888] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T20:29:46.857898] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-15T20:29:47.268393] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T20:29:47.657852] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-15T20:29:48.457872] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-15T20:29:48.607974] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:29:49.257879] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-15T20:29:49.326286] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:29:49.596318] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T20:29:50.057935] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-15T20:29:50.847884] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T20:29:50.866302] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-15T20:29:50.885503] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T20:29:51.657877] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-15T20:29:51.675592] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:29:51.677793] [INFO ] [REMOTE ] SPH: Full fetch complete (20621 records). [2025-09-15T20:29:51.677877] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-15T20:29:52.051691] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-15T20:29:52.051799] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-15T20:29:52.052533] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-15T20:29:52.052594] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-15T20:29:52.053456] [DEBUG] [LOCAL ] SPH: Trimmed 20621 records to 12701 (keeping 150 days of data) [2025-09-15T20:29:52.156940] [DEBUG] [LOCAL ] SPH: Primary data saved (12701 records). [2025-09-15T20:29:52.157184] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-15T20:29:52.157323] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPH took 22.5s. Estimated remaining: 41m 59s. Rate: 9.4 symbols/min [2025-09-15T20:29:52.335340] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:52.342236] [DEBUG] [LOCAL ] SPMC: Loaded 3882 existing records from primary storage. [2025-09-15T20:29:52.342376] [INFO ] [MAIN ] SPMC: Loaded 3882 existing records. [2025-09-15T20:29:52.463119] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-15T20:29:52.534880] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:29:52.535216] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-15T20:29:52.535266] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-15T20:29:52.535600] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-15T20:29:52.535668] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-15T20:29:52.900053] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:52.916938] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T20:29:52.922949] [INFO ] [REMOTE ] SPHR: Full fetch complete (43258 records). [2025-09-15T20:29:52.923068] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-15T20:29:53.263246] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-15T20:29:53.332897] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-15T20:29:53.333024] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-15T20:29:53.334293] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-15T20:29:53.334352] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-15T20:29:53.336831] [DEBUG] [LOCAL ] SPHR: Trimmed 43258 records to 28497 (keeping 150 days of data) [2025-09-15T20:29:53.514366] [DEBUG] [LOCAL ] SPHR: Primary data saved (28497 records). [2025-09-15T20:29:53.514532] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-15T20:29:53.514664] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPHR took 22.5s. Estimated remaining: 41m 52s. Rate: 9.4 symbols/min [2025-09-15T20:29:53.687168] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:29:53.687379] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-15T20:29:53.687476] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-15T20:29:53.687611] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-15T20:29:53.687670] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-15T20:29:53.687714] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-15T20:29:53.687747] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-15T20:29:54.058255] [INFO ] [REMOTE ] SPME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:29:54.058436] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-15T20:29:54.068708] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T20:29:54.093359] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T20:29:54.857959] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-15T20:29:55.551135] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T20:29:55.657915] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-15T20:29:56.314256] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:29:56.457894] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-15T20:29:56.949221] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:29:57.257885] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-15T20:29:57.852119] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T20:29:58.043052] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:29:58.057824] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-15T20:29:58.857885] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-15T20:29:58.865161] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T20:29:59.092194] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:29:59.092485] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-15T20:29:59.657916] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-15T20:30:00.457984] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-15T20:30:00.989197] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T20:30:01.257911] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-15T20:30:01.858104] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T20:30:02.057894] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-15T20:30:02.156727] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T20:30:02.162299] [INFO ] [REMOTE ] SPGI: Full fetch complete (50137 records). [2025-09-15T20:30:02.162493] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-15T20:30:02.577985] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-15T20:30:02.578105] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-15T20:30:02.579032] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-15T20:30:02.579089] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-15T20:30:02.580345] [DEBUG] [LOCAL ] SPGI: Trimmed 50137 records to 32885 (keeping 150 days of data) [2025-09-15T20:30:02.821660] [DEBUG] [LOCAL ] SPGI: Primary data saved (32885 records). [2025-09-15T20:30:02.821822] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-15T20:30:02.823019] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPGI took 34.4s. Estimated remaining: 41m 46s. Rate: 9.4 symbols/min [2025-09-15T20:30:02.866155] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-15T20:30:03.000255] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:03.029191] [DEBUG] [LOCAL ] SPNT: Loaded 25918 existing records from primary storage. [2025-09-15T20:30:03.029333] [INFO ] [MAIN ] SPNT: Loaded 25918 existing records. [2025-09-15T20:30:03.209744] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:03.210006] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-15T20:30:03.210052] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-15T20:30:03.210594] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-15T20:30:03.210672] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-15T20:30:03.561261] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:03.657878] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-15T20:30:04.408620] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-15T20:30:04.414099] [INFO ] [REMOTE ] SPIR: Full fetch complete (41418 records). [2025-09-15T20:30:04.414261] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-15T20:30:04.473695] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-15T20:30:04.845610] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-15T20:30:04.845747] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-15T20:30:04.846593] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-15T20:30:04.846653] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-15T20:30:04.848146] [DEBUG] [LOCAL ] SPIR: Trimmed 41418 records to 27619 (keeping 150 days of data) [2025-09-15T20:30:04.901445] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:30:04.911556] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-15T20:30:05.016523] [DEBUG] [LOCAL ] SPIR: Primary data saved (27619 records). [2025-09-15T20:30:05.016677] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-15T20:30:05.016794] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPIR took 24.8s. Estimated remaining: 41m 39s. Rate: 9.4 symbols/min [2025-09-15T20:30:05.188625] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:05.194315] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-15T20:30:05.231003] [DEBUG] [LOCAL ] SPOT: Loaded 38128 existing records from primary storage. [2025-09-15T20:30:05.231150] [INFO ] [MAIN ] SPOT: Loaded 38128 existing records. [2025-09-15T20:30:05.262923] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-15T20:30:05.411730] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:05.411995] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-15T20:30:05.412042] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-15T20:30:05.412830] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-15T20:30:05.412879] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-15T20:30:05.767332] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:06.041968] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:30:06.059994] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-15T20:30:06.064436] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-15T20:30:06.758024] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T20:30:06.857960] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-15T20:30:07.657889] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-15T20:30:07.903987] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:30:07.904387] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-15T20:30:07.981798] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T20:30:08.457902] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-15T20:30:08.745065] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:30:08.745407] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-15T20:30:09.257881] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-15T20:30:10.057889] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-15T20:30:10.632005] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:30:10.857877] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-15T20:30:11.235498] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:30:11.236747] [INFO ] [REMOTE ] SPMC: Full fetch complete (6486 records). [2025-09-15T20:30:11.236817] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-15T20:30:11.609912] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-15T20:30:11.609994] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-15T20:30:11.610173] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-15T20:30:11.610215] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-15T20:30:11.610738] [DEBUG] [LOCAL ] SPMC: Trimmed 6486 records to 3805 (keeping 150 days of data) [2025-09-15T20:30:11.636594] [DEBUG] [LOCAL ] SPMC: Primary data saved (3805 records). [2025-09-15T20:30:11.636725] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-15T20:30:11.636829] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPMC took 19.5s. Estimated remaining: 41m 32s. Rate: 9.4 symbols/min [2025-09-15T20:30:11.668275] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-15T20:30:11.813100] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:11.849157] [DEBUG] [LOCAL ] SPR: Loaded 30220 existing records from primary storage. [2025-09-15T20:30:11.849306] [INFO ] [MAIN ] SPR: Loaded 30220 existing records. [2025-09-15T20:30:12.030187] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:12.030457] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-15T20:30:12.030504] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-15T20:30:12.031181] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-15T20:30:12.031233] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-15T20:30:12.404044] [INFO ] [REMOTE ] SPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:12.433697] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-15T20:30:12.457819] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-15T20:30:13.028566] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:30:13.257932] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-15T20:30:13.539758] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:30:13.540191] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-15T20:30:14.057915] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-15T20:30:14.857899] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-15T20:30:15.099821] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T20:30:15.657948] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-15T20:30:15.783215] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (3.33 seconds). [2025-09-15T20:30:16.063905] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T20:30:16.457846] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-15T20:30:16.920303] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-15T20:30:17.257899] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-15T20:30:17.609092] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T20:30:18.057885] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-15T20:30:18.857898] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-15T20:30:19.224194] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T20:30:19.224986] [INFO ] [REMOTE ] SPME: Full fetch complete (626 records). [2025-09-15T20:30:19.225055] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-15T20:30:19.404554] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 41 unique days, need 150 days [2025-09-15T20:30:19.404793] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:30:19.404866] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:30:19.404958] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-15T20:30:19.405030] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-15T20:30:19.405068] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-15T20:30:19.405119] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-15T20:30:19.405197] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPME took 25.9s. Estimated remaining: 41m 26s. Rate: 9.4 symbols/min [2025-09-15T20:30:19.576800] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:19.587779] [DEBUG] [LOCAL ] SPRU: Loaded 6819 existing records from primary storage. [2025-09-15T20:30:19.587928] [INFO ] [MAIN ] SPRU: Loaded 6819 existing records. [2025-09-15T20:30:19.663160] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-15T20:30:19.773438] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:19.774013] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-15T20:30:19.774124] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-15T20:30:19.774517] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-15T20:30:19.774705] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-15T20:30:20.075516] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-15T20:30:20.179451] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:20.208502] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-15T20:30:20.457892] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-15T20:30:21.053561] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T20:30:21.257916] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-15T20:30:22.057920] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-15T20:30:22.357711] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:30:22.849873] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-15T20:30:22.861519] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-15T20:30:23.518161] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:30:23.657882] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-15T20:30:24.113681] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:30:24.118495] [INFO ] [REMOTE ] SPNT: Full fetch complete (37684 records). [2025-09-15T20:30:24.118613] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-15T20:30:24.460767] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-15T20:30:24.492429] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-15T20:30:24.492518] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-15T20:30:24.493456] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-15T20:30:24.493502] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-15T20:30:24.494504] [DEBUG] [LOCAL ] SPNT: Trimmed 37684 records to 25474 (keeping 150 days of data) [2025-09-15T20:30:24.653284] [DEBUG] [LOCAL ] SPNT: Primary data saved (25474 records). [2025-09-15T20:30:24.653433] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-15T20:30:24.653556] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPNT took 21.8s. Estimated remaining: 41m 20s. Rate: 9.4 symbols/min [2025-09-15T20:30:24.827856] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:24.846917] [DEBUG] [LOCAL ] SPXC: Loaded 17225 existing records from primary storage. [2025-09-15T20:30:24.847079] [INFO ] [MAIN ] SPXC: Loaded 17225 existing records. [2025-09-15T20:30:25.027039] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:25.027299] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-15T20:30:25.027347] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-15T20:30:25.027850] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-15T20:30:25.027900] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-15T20:30:25.267200] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-15T20:30:25.393776] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:25.419320] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:30:26.040120] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T20:30:26.057810] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-15T20:30:26.457518] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T20:30:26.543323] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T20:30:26.857872] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-15T20:30:27.639698] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T20:30:27.657809] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-15T20:30:28.294162] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T20:30:28.457885] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-15T20:30:29.257951] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-15T20:30:30.057919] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-15T20:30:30.582431] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T20:30:30.695401] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T20:30:30.696084] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T20:30:30.857894] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-15T20:30:31.657889] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-15T20:30:32.452929] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T20:30:32.461318] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-15T20:30:32.622685] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T20:30:33.257923] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-15T20:30:34.057907] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-15T20:30:34.474565] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:30:34.612242] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T20:30:34.857872] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-15T20:30:35.321175] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T20:30:35.657889] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-15T20:30:36.463063] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-15T20:30:36.472517] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T20:30:36.478379] [INFO ] [REMOTE ] SPOT: Full fetch complete (55709 records). [2025-09-15T20:30:36.478475] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-15T20:30:36.865249] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-15T20:30:36.865355] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-15T20:30:36.866310] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-15T20:30:36.866368] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-15T20:30:36.867542] [DEBUG] [LOCAL ] SPOT: Trimmed 55709 records to 37341 (keeping 150 days of data) [2025-09-15T20:30:36.981717] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:30:36.988791] [INFO ] [REMOTE ] SPR: Full fetch complete (44944 records). [2025-09-15T20:30:36.989632] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-15T20:30:37.262716] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-15T20:30:37.404953] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-15T20:30:37.405514] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-15T20:30:37.407047] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-15T20:30:37.407867] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-15T20:30:37.411610] [DEBUG] [LOCAL ] SPR: Trimmed 44944 records to 29600 (keeping 150 days of data) [2025-09-15T20:30:37.654825] [DEBUG] [LOCAL ] SPOT: Primary data saved (37341 records). [2025-09-15T20:30:37.658456] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-15T20:30:37.664526] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPOT took 32.6s. Estimated remaining: 41m 15s. Rate: 9.4 symbols/min [2025-09-15T20:30:37.680488] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T20:30:37.917997] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:37.932001] [DEBUG] [LOCAL ] SPXX: Loaded 6007 existing records from primary storage. [2025-09-15T20:30:37.934389] [DEBUG] [LOCAL ] SPR: Primary data saved (29600 records). [2025-09-15T20:30:37.934488] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-15T20:30:37.934297] [INFO ] [MAIN ] SPXX: Loaded 6007 existing records. [2025-09-15T20:30:37.934632] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPR took 26.3s. Estimated remaining: 41m 7s. Rate: 9.4 symbols/min [2025-09-15T20:30:38.080821] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-15T20:30:38.226575] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:38.255989] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:30:38.261479] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-15T20:30:38.307822] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-15T20:30:38.313098] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:38.314405] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-15T20:30:38.314513] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-15T20:30:38.659467] [DEBUG] [LOCAL ] SQM: Loaded 36523 existing records from primary storage. [2025-09-15T20:30:38.665681] [INFO ] [MAIN ] SQM: Loaded 36523 existing records. [2025-09-15T20:30:38.860137] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-15T20:30:38.860006] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:38.944245] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:38.944528] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-15T20:30:38.944577] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-15T20:30:38.945422] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-15T20:30:38.945476] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-15T20:30:39.316925] [INFO ] [REMOTE ] SQM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:39.383030] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T20:30:39.657893] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-15T20:30:39.855561] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T20:30:40.457876] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-15T20:30:40.730240] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:30:41.257896] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-15T20:30:41.911723] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:30:41.985380] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T20:30:41.987476] [INFO ] [REMOTE ] SPRU: Full fetch complete (8524 records). [2025-09-15T20:30:41.987606] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-15T20:30:42.063160] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-15T20:30:42.376441] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-15T20:30:42.376549] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-15T20:30:42.376988] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-15T20:30:42.377063] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-15T20:30:42.377711] [DEBUG] [LOCAL ] SPRU: Trimmed 8524 records to 6780 (keeping 150 days of data) [2025-09-15T20:30:42.431511] [DEBUG] [LOCAL ] SPRU: Primary data saved (6780 records). [2025-09-15T20:30:42.431734] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-15T20:30:42.431866] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SPRU took 23.0s. Estimated remaining: 41m 0s. Rate: 9.4 symbols/min [2025-09-15T20:30:42.610856] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:42.636054] [DEBUG] [LOCAL ] SQNS: Loaded 22731 existing records from primary storage. [2025-09-15T20:30:42.636251] [INFO ] [MAIN ] SQNS: Loaded 22731 existing records. [2025-09-15T20:30:42.825704] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:42.826098] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-15T20:30:42.826149] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-15T20:30:42.826776] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-15T20:30:42.826844] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-15T20:30:42.863039] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-15T20:30:43.185874] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:43.280531] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T20:30:43.657858] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-15T20:30:43.775021] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T20:30:44.457931] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-15T20:30:44.494860] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T20:30:45.121050] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T20:30:45.257886] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-15T20:30:46.039798] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T20:30:46.057832] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-15T20:30:46.857877] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-15T20:30:46.907879] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:30:47.657919] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-15T20:30:48.452006] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:30:48.458531] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-15T20:30:48.469347] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T20:30:49.257922] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-15T20:30:50.057919] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-15T20:30:50.095565] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T20:30:50.361408] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T20:30:50.857903] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-15T20:30:51.193345] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T20:30:51.196233] [INFO ] [REMOTE ] SPXC: Full fetch complete (25752 records). [2025-09-15T20:30:51.196353] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-15T20:30:51.565983] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-15T20:30:51.566128] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-15T20:30:51.566695] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-15T20:30:51.566739] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-15T20:30:51.567471] [DEBUG] [LOCAL ] SPXC: Trimmed 25752 records to 16773 (keeping 150 days of data) [2025-09-15T20:30:51.658020] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-15T20:30:51.675676] [DEBUG] [LOCAL ] SPXC: Primary data saved (16773 records). [2025-09-15T20:30:51.675880] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-15T20:30:51.675970] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SPXC took 27.0s. Estimated remaining: 40m 54s. Rate: 9.4 symbols/min [2025-09-15T20:30:51.848266] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:30:51.873454] [DEBUG] [LOCAL ] SR: Loaded 24495 existing records from primary storage. [2025-09-15T20:30:51.873615] [INFO ] [MAIN ] SR: Loaded 24495 existing records. [2025-09-15T20:30:52.053592] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:30:52.053858] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-15T20:30:52.053907] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-15T20:30:52.054549] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-15T20:30:52.054603] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-15T20:30:52.417851] [INFO ] [REMOTE ] SR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:30:52.465161] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-15T20:30:52.473312] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:30:52.577232] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T20:30:53.257915] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-15T20:30:53.883705] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T20:30:53.896280] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T20:30:54.057891] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-15T20:30:54.857895] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-15T20:30:55.657913] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-15T20:30:56.096774] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T20:30:56.379920] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-15T20:30:56.457915] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-15T20:30:56.963202] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:30:57.257903] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-15T20:30:57.855877] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T20:30:58.057881] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-15T20:30:58.486761] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T20:30:58.803850] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:30:58.857889] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-15T20:30:59.659477] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-15T20:30:59.660339] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T20:31:00.457936] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-15T20:31:01.257919] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-15T20:31:01.317130] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T20:31:01.322710] [INFO ] [REMOTE ] SQNS: Full fetch complete (25938 records). [2025-09-15T20:31:01.322886] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-15T20:31:01.732242] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-15T20:31:01.732345] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-15T20:31:01.733043] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-15T20:31:01.733093] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-15T20:31:01.734122] [DEBUG] [LOCAL ] SQNS: Trimmed 25938 records to 22962 (keeping 150 days of data) [2025-09-15T20:31:01.907273] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T20:31:01.919191] [DEBUG] [LOCAL ] SQNS: Primary data saved (22962 records). [2025-09-15T20:31:01.919399] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-15T20:31:01.919524] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SQNS took 19.5s. Estimated remaining: 40m 49s. Rate: 9.4 symbols/min [2025-09-15T20:31:02.063049] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-15T20:31:02.093950] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:02.102755] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T20:31:02.148747] [DEBUG] [LOCAL ] SRE: Loaded 40187 existing records from primary storage. [2025-09-15T20:31:02.148905] [INFO ] [MAIN ] SRE: Loaded 40187 existing records. [2025-09-15T20:31:02.332115] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:02.332395] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-15T20:31:02.332443] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-15T20:31:02.333219] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-15T20:31:02.333266] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-15T20:31:02.693765] [INFO ] [REMOTE ] SRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:02.857876] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-15T20:31:03.392174] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T20:31:03.456559] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T20:31:03.458297] [INFO ] [REMOTE ] SPXX: Full fetch complete (9874 records). [2025-09-15T20:31:03.458370] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-15T20:31:03.663073] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-15T20:31:03.813632] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-15T20:31:03.813729] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-15T20:31:03.813972] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-15T20:31:03.814012] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-15T20:31:03.814496] [DEBUG] [LOCAL ] SPXX: Trimmed 9874 records to 5844 (keeping 150 days of data) [2025-09-15T20:31:03.851110] [DEBUG] [LOCAL ] SPXX: Primary data saved (5844 records). [2025-09-15T20:31:03.851215] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-15T20:31:03.851296] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SPXX took 26.2s. Estimated remaining: 40m 42s. Rate: 9.4 symbols/min [2025-09-15T20:31:04.018302] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:04.026717] [DEBUG] [LOCAL ] SREA: Loaded 7599 existing records from primary storage. [2025-09-15T20:31:04.026813] [INFO ] [MAIN ] SREA: Loaded 7599 existing records. [2025-09-15T20:31:04.205557] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:04.205922] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-15T20:31:04.205973] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-15T20:31:04.206355] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-15T20:31:04.206409] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-15T20:31:04.464213] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-15T20:31:04.581335] [INFO ] [REMOTE ] SREA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:05.257899] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-15T20:31:05.480121] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T20:31:06.057878] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-15T20:31:06.097226] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T20:31:06.693408] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T20:31:06.726275] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T20:31:06.857833] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-15T20:31:07.657876] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-15T20:31:08.457906] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-15T20:31:08.746306] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:31:09.257910] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-15T20:31:09.692436] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T20:31:09.747873] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:31:09.795536] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T20:31:10.057879] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-15T20:31:10.857924] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-15T20:31:11.560656] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T20:31:11.657874] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-15T20:31:12.457896] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-15T20:31:12.802700] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T20:31:13.088282] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:31:13.094134] [INFO ] [REMOTE ] SQM: Full fetch complete (52543 records). [2025-09-15T20:31:13.094354] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-15T20:31:13.273394] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-15T20:31:13.462481] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T20:31:13.502397] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-15T20:31:13.502584] [INFO ] [REMOTE ] SR: Full fetch complete (35173 records). [2025-09-15T20:31:13.502700] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-15T20:31:13.503964] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-15T20:31:13.502902] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-15T20:31:13.504279] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-15T20:31:13.611716] [DEBUG] [LOCAL ] SQM: Trimmed 52543 records to 35810 (keeping 150 days of data) [2025-09-15T20:31:14.076786] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-15T20:31:14.304072] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T20:31:14.337142] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-15T20:31:14.337460] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-15T20:31:14.351942] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-15T20:31:14.353299] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-15T20:31:14.368751] [DEBUG] [LOCAL ] SQM: Primary data saved (35810 records). [2025-09-15T20:31:14.369245] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-15T20:31:14.369409] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SQM took 36.4s. Estimated remaining: 40m 36s. Rate: 9.4 symbols/min [2025-09-15T20:31:14.389350] [DEBUG] [LOCAL ] SR: Trimmed 35173 records to 24043 (keeping 150 days of data) [2025-09-15T20:31:14.778479] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:14.844543] [DEBUG] [LOCAL ] SR: Primary data saved (24043 records). [2025-09-15T20:31:14.853615] [INFO ] [MAIN ] SR: Full history saved. [2025-09-15T20:31:14.855139] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SR took 23.2s. Estimated remaining: 40m 28s. Rate: 9.4 symbols/min [2025-09-15T20:31:14.866953] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-15T20:31:14.868044] [DEBUG] [LOCAL ] SRFM: Loaded 28759 existing records from primary storage. [2025-09-15T20:31:14.890081] [INFO ] [MAIN ] SRFM: Loaded 28759 existing records. [2025-09-15T20:31:15.259012] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:15.264129] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:15.264552] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-15T20:31:15.264752] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-15T20:31:15.265320] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-15T20:31:15.265369] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-15T20:31:15.430266] [DEBUG] [LOCAL ] SRG: Loaded 11020 existing records from primary storage. [2025-09-15T20:31:15.521017] [INFO ] [MAIN ] SRG: Loaded 11020 existing records. [2025-09-15T20:31:15.765973] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:15.802685] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-15T20:31:15.830985] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:15.832509] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-15T20:31:15.832806] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-15T20:31:15.838062] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-15T20:31:15.843238] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T20:31:15.842830] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-15T20:31:16.208973] [INFO ] [REMOTE ] SRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:16.265735] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T20:31:16.457926] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-15T20:31:17.103862] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T20:31:17.166449] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T20:31:17.257884] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-15T20:31:18.057876] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-15T20:31:18.107594] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T20:31:18.857877] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-15T20:31:19.657900] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-15T20:31:19.896247] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T20:31:19.945786] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T20:31:20.289261] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T20:31:20.457850] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-15T20:31:21.257878] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-15T20:31:21.481863] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T20:31:22.031732] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T20:31:22.057825] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-15T20:31:22.765860] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:31:22.767339] [INFO ] [REMOTE ] SREA: Full fetch complete (11475 records). [2025-09-15T20:31:22.767413] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-15T20:31:22.863059] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-15T20:31:23.137045] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-15T20:31:23.137250] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-15T20:31:23.137592] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-15T20:31:23.137668] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-15T20:31:23.138195] [DEBUG] [LOCAL ] SREA: Trimmed 11475 records to 7438 (keeping 150 days of data) [2025-09-15T20:31:23.187825] [DEBUG] [LOCAL ] SREA: Primary data saved (7438 records). [2025-09-15T20:31:23.187996] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-15T20:31:23.188106] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SREA took 19.3s. Estimated remaining: 40m 22s. Rate: 9.4 symbols/min [2025-09-15T20:31:23.360889] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:23.380791] [DEBUG] [LOCAL ] SRI: Loaded 20709 existing records from primary storage. [2025-09-15T20:31:23.380935] [INFO ] [MAIN ] SRI: Loaded 20709 existing records. [2025-09-15T20:31:23.554342] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:23.554663] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-15T20:31:23.554713] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-15T20:31:23.555308] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-15T20:31:23.555356] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-15T20:31:23.658840] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-15T20:31:23.931138] [INFO ] [REMOTE ] SRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:24.006050] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T20:31:24.457896] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-15T20:31:25.257889] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-15T20:31:25.302590] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:31:25.330211] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T20:31:26.057918] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-15T20:31:26.367054] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T20:31:26.857883] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-15T20:31:27.270149] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T20:31:27.657860] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-15T20:31:28.399607] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T20:31:28.457898] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-15T20:31:29.119944] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T20:31:29.192569] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T20:31:29.257889] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-15T20:31:29.757867] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:31:29.763339] [INFO ] [REMOTE ] SRE: Full fetch complete (57694 records). [2025-09-15T20:31:29.763464] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-15T20:31:29.764256] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:31:29.764345] [FATAL] [MAIN ] SRE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:31:29.764382] [WARN ] [MAIN ] SRE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:31:29.764432] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-15T20:31:29.764509] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-15T20:31:29.764550] [INFO ] [LOCAL ] SRE: Starting deletion of derivative data. [2025-09-15T20:31:29.764923] [DEBUG] [LOCAL ] SRE: Deleted derivative data file. [2025-09-15T20:31:29.765793] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRE took 27.8s. Estimated remaining: 40m 16s. Rate: 9.4 symbols/min [2025-09-15T20:31:29.943372] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:29.943558] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-15T20:31:29.943597] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-15T20:31:29.943747] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-15T20:31:29.943790] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-15T20:31:29.943833] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-15T20:31:29.943868] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-15T20:31:30.062997] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-15T20:31:30.323800] [INFO ] [REMOTE ] SRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:30.857930] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-15T20:31:31.657907] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-15T20:31:31.701996] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T20:31:32.115477] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T20:31:32.425527] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-15T20:31:32.457817] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-15T20:31:33.257883] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-15T20:31:34.057885] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-15T20:31:34.512760] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:31:34.589356] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-15T20:31:34.644851] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:31:34.857899] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-15T20:31:35.657854] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-15T20:31:35.769483] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T20:31:36.457922] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-15T20:31:37.257929] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-15T20:31:37.337275] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T20:31:37.342760] [INFO ] [REMOTE ] SRFM: Full fetch complete (36710 records). [2025-09-15T20:31:37.342860] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-15T20:31:37.696095] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T20:31:37.726492] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-15T20:31:37.726616] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-15T20:31:37.727634] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-15T20:31:37.727730] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-15T20:31:37.744046] [DEBUG] [LOCAL ] SRFM: Trimmed 36710 records to 28844 (keeping 150 days of data) [2025-09-15T20:31:37.745454] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:31:37.922522] [DEBUG] [LOCAL ] SRFM: Primary data saved (28844 records). [2025-09-15T20:31:37.922698] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-15T20:31:37.922822] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SRFM took 23.6s. Estimated remaining: 40m 10s. Rate: 9.4 symbols/min [2025-09-15T20:31:38.063737] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-15T20:31:38.095996] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:38.103766] [DEBUG] [LOCAL ] SRV: Loaded 5408 existing records from primary storage. [2025-09-15T20:31:38.104005] [INFO ] [MAIN ] SRV: Loaded 5408 existing records. [2025-09-15T20:31:38.287366] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:38.287639] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-15T20:31:38.287714] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-15T20:31:38.288000] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-15T20:31:38.288049] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-15T20:31:38.671216] [INFO ] [REMOTE ] SRV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:38.857892] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-15T20:31:39.014706] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:31:39.590109] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:31:39.657879] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-15T20:31:40.441992] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T20:31:40.457812] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-15T20:31:41.257946] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-15T20:31:41.344436] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T20:31:41.625939] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T20:31:42.057917] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-15T20:31:42.502663] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T20:31:42.857875] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-15T20:31:43.237895] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T20:31:43.657864] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-15T20:31:44.457868] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-15T20:31:44.630547] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:31:45.126783] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T20:31:45.130434] [INFO ] [REMOTE ] SRG: Full fetch complete (17505 records). [2025-09-15T20:31:45.130587] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-15T20:31:45.262961] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-15T20:31:45.527413] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-15T20:31:45.527504] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-15T20:31:45.527934] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-15T20:31:45.527980] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-15T20:31:45.528549] [DEBUG] [LOCAL ] SRG: Trimmed 17505 records to 10559 (keeping 150 days of data) [2025-09-15T20:31:45.591766] [DEBUG] [LOCAL ] SRG: Primary data saved (10559 records). [2025-09-15T20:31:45.591914] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-15T20:31:45.592012] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRG took 30.7s. Estimated remaining: 40m 4s. Rate: 9.4 symbols/min [2025-09-15T20:31:45.767084] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T20:31:45.770248] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:45.806746] [DEBUG] [LOCAL ] SSB: Loaded 32376 existing records from primary storage. [2025-09-15T20:31:45.806895] [INFO ] [MAIN ] SSB: Loaded 32376 existing records. [2025-09-15T20:31:45.989477] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:45.989766] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-15T20:31:45.989815] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-15T20:31:45.990513] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-15T20:31:45.990562] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-15T20:31:46.063020] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-15T20:31:46.354233] [INFO ] [REMOTE ] SSB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:46.857919] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-15T20:31:47.420138] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:31:47.452501] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T20:31:47.657872] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-15T20:31:48.457896] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-15T20:31:48.893856] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T20:31:49.257924] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-15T20:31:49.646761] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:31:50.057883] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-15T20:31:50.478269] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T20:31:50.857882] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-15T20:31:51.401332] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T20:31:51.545668] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:31:51.548490] [INFO ] [REMOTE ] SRI: Full fetch complete (31020 records). [2025-09-15T20:31:51.548569] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-15T20:31:51.662931] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-15T20:31:51.929894] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-15T20:31:51.930002] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-15T20:31:51.931219] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-15T20:31:51.931294] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-15T20:31:51.932313] [DEBUG] [LOCAL ] SRI: Trimmed 31020 records to 20394 (keeping 150 days of data) [2025-09-15T20:31:52.057261] [DEBUG] [LOCAL ] SRI: Primary data saved (20394 records). [2025-09-15T20:31:52.057443] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-15T20:31:52.057555] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SRI took 28.9s. Estimated remaining: 39m 58s. Rate: 9.4 symbols/min [2025-09-15T20:31:52.118160] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T20:31:52.156287] [INFO ] [REMOTE ] SRL: Full fetch complete (1113 records). [2025-09-15T20:31:52.167460] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-15T20:31:52.391807] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:52.434979] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T20:31:52.435442] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:31:52.435519] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:31:52.435585] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-15T20:31:52.435702] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-15T20:31:52.435772] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-15T20:31:52.435832] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-15T20:31:52.435905] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SRL took 22.7s. Estimated remaining: 39m 50s. Rate: 9.4 symbols/min [2025-09-15T20:31:52.468020] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-15T20:31:52.597008] [DEBUG] [LOCAL ] SSD: Loaded 16821 existing records from primary storage. [2025-09-15T20:31:52.626007] [INFO ] [MAIN ] SSD: Loaded 16821 existing records. [2025-09-15T20:31:52.628836] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:31:52.841390] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:52.842579] [DEBUG] [LOCAL ] SSL: Loaded 30733 existing records from primary storage. [2025-09-15T20:31:52.843009] [INFO ] [MAIN ] SSL: Loaded 30733 existing records. [2025-09-15T20:31:52.919603] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-15T20:31:52.935592] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-15T20:31:52.951417] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-15T20:31:52.966818] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-15T20:31:53.121320] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:31:53.133228] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-15T20:31:53.133354] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-15T20:31:53.139334] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-15T20:31:53.149737] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-15T20:31:53.263536] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-15T20:31:53.708995] [INFO ] [REMOTE ] SSD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:53.850742] [INFO ] [REMOTE ] SSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:31:54.056434] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T20:31:54.065121] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-15T20:31:54.180956] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T20:31:54.857880] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-15T20:31:55.631320] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T20:31:55.657826] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-15T20:31:55.769724] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T20:31:56.457892] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-15T20:31:57.168983] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:31:57.262426] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-15T20:31:57.263881] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T20:31:58.057895] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-15T20:31:58.165560] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T20:31:58.857877] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-15T20:31:59.657922] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-15T20:31:59.712868] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T20:32:00.234716] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T20:32:00.236001] [INFO ] [REMOTE ] SRV: Full fetch complete (8462 records). [2025-09-15T20:32:00.236069] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-15T20:32:00.466435] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-15T20:32:00.610137] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-15T20:32:00.610316] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-15T20:32:00.610589] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-15T20:32:00.610669] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-15T20:32:00.611255] [DEBUG] [LOCAL ] SRV: Trimmed 8462 records to 5319 (keeping 150 days of data) [2025-09-15T20:32:00.646522] [DEBUG] [LOCAL ] SRV: Primary data saved (5319 records). [2025-09-15T20:32:00.646682] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-15T20:32:00.646769] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SRV took 22.7s. Estimated remaining: 39m 44s. Rate: 9.4 symbols/min [2025-09-15T20:32:00.819292] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:00.861270] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-15T20:32:00.875099] [DEBUG] [LOCAL ] SST: Loaded 9946 existing records from primary storage. [2025-09-15T20:32:00.875340] [INFO ] [MAIN ] SST: Loaded 9946 existing records. [2025-09-15T20:32:01.053329] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:01.053623] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-15T20:32:01.053693] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-15T20:32:01.053972] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-15T20:32:01.054032] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-15T20:32:01.264369] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-15T20:32:01.439737] [INFO ] [REMOTE ] SST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:01.614887] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T20:32:02.057922] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-15T20:32:02.857900] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-15T20:32:03.010867] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T20:32:03.402944] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T20:32:03.657946] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-15T20:32:04.242117] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:32:04.457872] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-15T20:32:04.653599] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T20:32:05.257910] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-15T20:32:06.057890] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-15T20:32:06.076142] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T20:32:06.126184] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T20:32:06.857912] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-15T20:32:06.944978] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T20:32:07.657971] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-15T20:32:07.761055] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T20:32:08.457884] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-15T20:32:09.234917] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T20:32:09.264998] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-15T20:32:09.283208] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T20:32:10.057893] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-15T20:32:10.349682] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T20:32:10.857908] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-15T20:32:11.578101] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T20:32:11.657889] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-15T20:32:11.757763] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T20:32:12.457910] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-15T20:32:12.940220] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T20:32:13.257914] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-15T20:32:13.704011] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T20:32:14.057975] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-15T20:32:14.611060] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T20:32:14.616557] [INFO ] [REMOTE ] SSB: Full fetch complete (46121 records). [2025-09-15T20:32:14.616742] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-15T20:32:14.867321] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-15T20:32:15.001763] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-15T20:32:15.001857] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-15T20:32:15.003061] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-15T20:32:15.003132] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-15T20:32:15.004458] [DEBUG] [LOCAL ] SSB: Trimmed 46121 records to 31811 (keeping 150 days of data) [2025-09-15T20:32:15.129723] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T20:32:15.137743] [INFO ] [REMOTE ] SSL: Full fetch complete (44475 records). [2025-09-15T20:32:15.138542] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-15T20:32:15.598872] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-15T20:32:15.600752] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-15T20:32:15.601742] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-15T20:32:15.602807] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-15T20:32:15.610134] [DEBUG] [LOCAL ] SSL: Trimmed 44475 records to 30179 (keeping 150 days of data) [2025-09-15T20:32:15.660971] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-15T20:32:15.676696] [DEBUG] [LOCAL ] SSB: Primary data saved (31811 records). [2025-09-15T20:32:15.704823] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-15T20:32:15.707294] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSB took 30.1s. Estimated remaining: 39m 39s. Rate: 9.4 symbols/min [2025-09-15T20:32:15.899315] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:15.928932] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T20:32:15.953476] [DEBUG] [LOCAL ] SSTK: Loaded 18357 existing records from primary storage. [2025-09-15T20:32:15.954149] [INFO ] [MAIN ] SSTK: Loaded 18357 existing records. [2025-09-15T20:32:16.202223] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:16.205422] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-15T20:32:16.206388] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-15T20:32:16.208469] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-15T20:32:16.209150] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-15T20:32:16.461561] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-15T20:32:16.503160] [DEBUG] [LOCAL ] SSL: Primary data saved (30179 records). [2025-09-15T20:32:16.503341] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-15T20:32:16.503764] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. SSL took 24.1s. Estimated remaining: 39m 32s. Rate: 9.4 symbols/min [2025-09-15T20:32:16.580316] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:17.049634] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T20:32:17.257880] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-15T20:32:17.382394] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T20:32:18.057898] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-15T20:32:18.111679] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:32:18.114488] [INFO ] [REMOTE ] SSD: Full fetch complete (24525 records). [2025-09-15T20:32:18.114564] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-15T20:32:18.527541] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-15T20:32:18.527669] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-15T20:32:18.528275] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-15T20:32:18.528327] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-15T20:32:18.530539] [DEBUG] [LOCAL ] SSD: Trimmed 24525 records to 16554 (keeping 150 days of data) [2025-09-15T20:32:18.648351] [DEBUG] [LOCAL ] SSD: Primary data saved (16554 records). [2025-09-15T20:32:18.648535] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-15T20:32:18.648661] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. SSD took 26.6s. Estimated remaining: 39m 25s. Rate: 9.4 symbols/min [2025-09-15T20:32:18.857950] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-15T20:32:19.102850] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:32:19.410917] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T20:32:19.657880] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-15T20:32:20.457890] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-15T20:32:21.019002] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:32:21.020928] [INFO ] [REMOTE ] SST: Full fetch complete (13699 records). [2025-09-15T20:32:21.021019] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-15T20:32:21.402599] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-15T20:32:21.402811] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-15T20:32:21.403209] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-15T20:32:21.403316] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-15T20:32:21.404140] [DEBUG] [LOCAL ] SST: Trimmed 13699 records to 9679 (keeping 150 days of data) [2025-09-15T20:32:21.466484] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T20:32:21.476196] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-15T20:32:21.492147] [DEBUG] [LOCAL ] SST: Primary data saved (9679 records). [2025-09-15T20:32:21.492297] [INFO ] [MAIN ] SST: Full history saved. [2025-09-15T20:32:21.492398] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. SST took 20.8s. Estimated remaining: 39m 18s. Rate: 9.4 symbols/min [2025-09-15T20:32:22.853098] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T20:32:22.860595] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-15T20:32:24.063037] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T20:32:24.068833] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-15T20:32:25.125974] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T20:32:25.131806] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-15T20:32:26.392492] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T20:32:26.398430] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-15T20:32:27.601103] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T20:32:27.607703] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-15T20:32:28.557221] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T20:32:28.560510] [INFO ] [REMOTE ] SSTK: Full fetch complete (30253 records). [2025-09-15T20:32:28.560604] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-15T20:32:28.953325] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-15T20:32:28.953426] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-15T20:32:28.954395] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-15T20:32:28.954453] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-15T20:32:28.955398] [DEBUG] [LOCAL ] SSTK: Trimmed 30253 records to 17985 (keeping 150 days of data) [2025-09-15T20:32:29.100510] [DEBUG] [LOCAL ] SSTK: Primary data saved (17985 records). [2025-09-15T20:32:29.100771] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-15T20:32:29.100908] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. SSTK took 13.4s. Estimated remaining: 39m 12s. Rate: 9.4 symbols/min [2025-09-15T20:32:29.603172] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:29.790359] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:29.794472] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:29.890553] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:29.903874] [DEBUG] [LOCAL ] STE: Loaded 26441 existing records from primary storage. [2025-09-15T20:32:29.904050] [INFO ] [MAIN ] STE: Loaded 26441 existing records. [2025-09-15T20:32:30.030996] [DEBUG] [LOCAL ] STC: Loaded 13380 existing records from primary storage. [2025-09-15T20:32:30.053530] [INFO ] [MAIN ] STC: Loaded 13380 existing records. [2025-09-15T20:32:30.124297] [DEBUG] [LOCAL ] STAG: Loaded 37366 existing records from primary storage. [2025-09-15T20:32:30.154139] [INFO ] [MAIN ] STAG: Loaded 37366 existing records. [2025-09-15T20:32:30.246739] [DEBUG] [LOCAL ] ST: Loaded 37314 existing records from primary storage. [2025-09-15T20:32:30.320860] [INFO ] [MAIN ] ST: Loaded 37314 existing records. [2025-09-15T20:32:30.435048] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:30.543078] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:30.635442] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-15T20:32:30.635353] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-15T20:32:30.664391] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-15T20:32:30.663927] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-15T20:32:30.664188] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:30.674984] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-15T20:32:30.685356] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-15T20:32:30.718753] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-15T20:32:30.735233] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-15T20:32:30.710271] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-15T20:32:30.741161] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-15T20:32:30.741280] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:30.761058] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-15T20:32:30.766747] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-15T20:32:30.805559] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-15T20:32:30.894524] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-15T20:32:30.993770] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-15T20:32:31.014620] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-15T20:32:32.067729] [INFO ] [REMOTE ] STAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:32.207717] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-15T20:32:32.215440] [INFO ] [REMOTE ] STE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:32.231723] [INFO ] [REMOTE ] STC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:32.250928] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-15T20:32:32.257471] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-15T20:32:32.334792] [INFO ] [REMOTE ] ST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:32.335769] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-15T20:32:33.447557] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T20:32:33.451479] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-15T20:32:33.700751] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T20:32:33.710365] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-15T20:32:33.813342] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:32:33.820468] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-15T20:32:33.914900] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T20:32:33.925153] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-15T20:32:34.320576] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T20:32:34.325144] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-15T20:32:35.078176] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:32:35.082773] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-15T20:32:35.154296] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T20:32:35.163167] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-15T20:32:35.242609] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T20:32:35.253309] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-15T20:32:35.304184] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T20:32:35.657901] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-15T20:32:35.931273] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T20:32:36.341739] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T20:32:36.457899] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-15T20:32:37.050054] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T20:32:37.104242] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:32:37.257901] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-15T20:32:37.300148] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T20:32:38.057879] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-15T20:32:38.822324] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:32:38.857848] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-15T20:32:39.272794] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T20:32:39.657898] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-15T20:32:40.414697] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T20:32:40.457844] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-15T20:32:40.735172] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T20:32:41.257882] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-15T20:32:42.057849] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-15T20:32:42.135408] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T20:32:42.857861] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-15T20:32:42.897608] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T20:32:42.900175] [INFO ] [REMOTE ] STC: Full fetch complete (19383 records). [2025-09-15T20:32:42.900249] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-15T20:32:43.044140] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:32:43.309374] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-15T20:32:43.309466] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-15T20:32:43.309913] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-15T20:32:43.309958] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-15T20:32:43.310564] [DEBUG] [LOCAL ] STC: Trimmed 19383 records to 13155 (keeping 150 days of data) [2025-09-15T20:32:43.401758] [DEBUG] [LOCAL ] STC: Primary data saved (13155 records). [2025-09-15T20:32:43.401903] [INFO ] [MAIN ] STC: Full history saved. [2025-09-15T20:32:43.402028] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STC took 14.3s. Estimated remaining: 39m 7s. Rate: 9.4 symbols/min [2025-09-15T20:32:43.571395] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:43.589373] [DEBUG] [LOCAL ] STEL: Loaded 16772 existing records from primary storage. [2025-09-15T20:32:43.589525] [INFO ] [MAIN ] STEL: Loaded 16772 existing records. [2025-09-15T20:32:43.663334] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-15T20:32:43.774304] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:43.774555] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-15T20:32:43.774611] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-15T20:32:43.775144] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-15T20:32:43.775194] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-15T20:32:44.121849] [INFO ] [REMOTE ] STEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:44.457892] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-15T20:32:44.553442] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T20:32:45.257864] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-15T20:32:45.410778] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:32:45.441067] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:32:46.057945] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-15T20:32:46.521795] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T20:32:46.527812] [INFO ] [REMOTE ] ST: Full fetch complete (54362 records). [2025-09-15T20:32:46.527972] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-15T20:32:46.863058] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-15T20:32:46.941991] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-15T20:32:46.942131] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-15T20:32:46.943422] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-15T20:32:46.943491] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-15T20:32:46.945612] [DEBUG] [LOCAL ] ST: Trimmed 54362 records to 36544 (keeping 150 days of data) [2025-09-15T20:32:47.196199] [DEBUG] [LOCAL ] ST: Primary data saved (36544 records). [2025-09-15T20:32:47.196372] [INFO ] [MAIN ] ST: Full history saved. [2025-09-15T20:32:47.196491] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. ST took 18.1s. Estimated remaining: 38m 60s. Rate: 9.4 symbols/min [2025-09-15T20:32:47.368473] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:47.396894] [DEBUG] [LOCAL ] STEM: Loaded 29074 existing records from primary storage. [2025-09-15T20:32:47.397040] [INFO ] [MAIN ] STEM: Loaded 29074 existing records. [2025-09-15T20:32:47.578527] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:47.578920] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-15T20:32:47.579027] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-15T20:32:47.579677] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-15T20:32:47.579729] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-15T20:32:47.661911] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-15T20:32:47.768883] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T20:32:47.985006] [INFO ] [REMOTE ] STEM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:48.457889] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-15T20:32:48.652424] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T20:32:48.772256] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T20:32:49.257988] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-15T20:32:49.728354] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T20:32:50.057934] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-15T20:32:50.857909] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-15T20:32:51.024880] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T20:32:51.059594] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:32:51.657906] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-15T20:32:52.372189] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:32:52.430742] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T20:32:52.457830] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-15T20:32:53.257902] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-15T20:32:53.379937] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T20:32:54.057892] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-15T20:32:54.289619] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T20:32:54.293769] [INFO ] [REMOTE ] STE: Full fetch complete (38212 records). [2025-09-15T20:32:54.293917] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-15T20:32:54.718482] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-15T20:32:54.718613] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-15T20:32:54.719754] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-15T20:32:54.719881] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-15T20:32:54.721037] [DEBUG] [LOCAL ] STE: Trimmed 38212 records to 26012 (keeping 150 days of data) [2025-09-15T20:32:54.858036] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-15T20:32:54.899692] [DEBUG] [LOCAL ] STE: Primary data saved (26012 records). [2025-09-15T20:32:54.899851] [INFO ] [MAIN ] STE: Full history saved. [2025-09-15T20:32:54.899967] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. STE took 25.8s. Estimated remaining: 38m 54s. Rate: 9.4 symbols/min [2025-09-15T20:32:55.067145] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:32:55.079066] [DEBUG] [LOCAL ] STEW: Loaded 11387 existing records from primary storage. [2025-09-15T20:32:55.079177] [INFO ] [MAIN ] STEW: Loaded 11387 existing records. [2025-09-15T20:32:55.259277] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:32:55.259708] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-15T20:32:55.259780] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-15T20:32:55.260301] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-15T20:32:55.260365] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-15T20:32:55.612815] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:32:55.647592] [INFO ] [REMOTE ] STEW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:32:55.657822] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-15T20:32:56.445311] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T20:32:56.457861] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-15T20:32:56.689343] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:32:57.257885] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-15T20:32:57.511410] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T20:32:58.057890] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-15T20:32:58.453545] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T20:32:58.857888] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-15T20:32:59.657906] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-15T20:32:59.853867] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T20:32:59.961363] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T20:33:00.457975] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-15T20:33:01.257871] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-15T20:33:01.699514] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-15T20:33:01.715763] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T20:33:01.721090] [INFO ] [REMOTE ] STEL: Full fetch complete (25501 records). [2025-09-15T20:33:01.721208] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-15T20:33:02.062332] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-15T20:33:02.103893] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-15T20:33:02.103982] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-15T20:33:02.104630] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-15T20:33:02.104722] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-15T20:33:02.105852] [DEBUG] [LOCAL ] STEL: Trimmed 25501 records to 16582 (keeping 150 days of data) [2025-09-15T20:33:02.213612] [DEBUG] [LOCAL ] STEL: Primary data saved (16582 records). [2025-09-15T20:33:02.213802] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-15T20:33:02.213925] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. STEL took 18.8s. Estimated remaining: 38m 47s. Rate: 9.4 symbols/min [2025-09-15T20:33:02.433094] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:02.433315] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-15T20:33:02.433355] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-15T20:33:02.433517] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-15T20:33:02.433560] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-15T20:33:02.433605] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-15T20:33:02.433663] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-15T20:33:02.824943] [INFO ] [REMOTE ] STG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:02.857886] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-15T20:33:03.657892] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-15T20:33:03.872987] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-15T20:33:04.179219] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T20:33:04.457919] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-15T20:33:04.626943] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T20:33:04.801197] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-15T20:33:05.257916] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-15T20:33:06.057879] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-15T20:33:06.238022] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T20:33:06.483710] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T20:33:06.857909] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-15T20:33:07.657898] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-15T20:33:08.457876] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-15T20:33:08.774620] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (4.32 seconds). [2025-09-15T20:33:08.862805] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T20:33:08.882579] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-15T20:33:09.262955] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-15T20:33:09.271933] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T20:33:09.277927] [INFO ] [REMOTE ] STAG: Full fetch complete (54231 records). [2025-09-15T20:33:09.278034] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-15T20:33:09.675146] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-15T20:33:09.675234] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-15T20:33:09.676321] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-15T20:33:09.676368] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-15T20:33:09.677533] [DEBUG] [LOCAL ] STAG: Trimmed 54231 records to 36645 (keeping 150 days of data) [2025-09-15T20:33:09.926976] [DEBUG] [LOCAL ] STAG: Primary data saved (36645 records). [2025-09-15T20:33:09.927116] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-15T20:33:09.927199] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STAG took 40.8s. Estimated remaining: 38m 41s. Rate: 9.4 symbols/min [2025-09-15T20:33:10.066052] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-15T20:33:10.097339] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:10.106265] [DEBUG] [LOCAL ] STK: Loaded 6539 existing records from primary storage. [2025-09-15T20:33:10.106465] [INFO ] [MAIN ] STK: Loaded 6539 existing records. [2025-09-15T20:33:10.279845] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:10.280136] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-15T20:33:10.280182] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-15T20:33:10.280474] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-15T20:33:10.280519] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-15T20:33:10.438619] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T20:33:10.653968] [INFO ] [REMOTE ] STK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:10.857893] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-15T20:33:11.508519] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T20:33:11.657873] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-15T20:33:11.700989] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T20:33:12.184688] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T20:33:12.457877] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-15T20:33:13.170663] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:33:13.172422] [INFO ] [REMOTE ] STEW: Full fetch complete (17323 records). [2025-09-15T20:33:13.172495] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-15T20:33:13.263024] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-15T20:33:13.537938] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-15T20:33:13.538020] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-15T20:33:13.538416] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-15T20:33:13.538455] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-15T20:33:13.539039] [DEBUG] [LOCAL ] STEW: Trimmed 17323 records to 11162 (keeping 150 days of data) [2025-09-15T20:33:13.610154] [DEBUG] [LOCAL ] STEW: Primary data saved (11162 records). [2025-09-15T20:33:13.610324] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-15T20:33:13.610417] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STEW took 18.7s. Estimated remaining: 38m 34s. Rate: 9.4 symbols/min [2025-09-15T20:33:13.786107] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:13.826903] [DEBUG] [LOCAL ] STLA: Loaded 40314 existing records from primary storage. [2025-09-15T20:33:13.827051] [INFO ] [MAIN ] STLA: Loaded 40314 existing records. [2025-09-15T20:33:14.014476] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:14.014994] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-15T20:33:14.015041] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-15T20:33:14.015910] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-15T20:33:14.015959] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-15T20:33:14.063100] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-15T20:33:14.370012] [INFO ] [REMOTE ] STLA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:14.857870] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-15T20:33:15.076425] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:33:15.518476] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:33:15.657871] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-15T20:33:16.457891] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-15T20:33:16.586521] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T20:33:16.767786] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T20:33:17.225127] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:33:17.228611] [INFO ] [REMOTE ] STEM: Full fetch complete (44966 records). [2025-09-15T20:33:17.228838] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-15T20:33:17.263052] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-15T20:33:17.666452] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-15T20:33:17.666598] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-15T20:33:17.667998] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-15T20:33:17.668053] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-15T20:33:17.669299] [DEBUG] [LOCAL ] STEM: Trimmed 44966 records to 28138 (keeping 150 days of data) [2025-09-15T20:33:17.845833] [DEBUG] [LOCAL ] STEM: Primary data saved (28138 records). [2025-09-15T20:33:17.846026] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-15T20:33:17.846157] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STEM took 30.6s. Estimated remaining: 38m 28s. Rate: 9.4 symbols/min [2025-09-15T20:33:18.060790] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-15T20:33:18.060603] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:18.115861] [DEBUG] [LOCAL ] STM: Loaded 40340 existing records from primary storage. [2025-09-15T20:33:18.116122] [INFO ] [MAIN ] STM: Loaded 40340 existing records. [2025-09-15T20:33:18.314086] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:18.314569] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-15T20:33:18.314667] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-15T20:33:18.315557] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-15T20:33:18.315612] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-15T20:33:18.684786] [INFO ] [REMOTE ] STM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:18.857886] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-15T20:33:18.955991] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T20:33:19.662991] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-15T20:33:19.694090] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-15T20:33:20.457899] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-15T20:33:20.529394] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T20:33:21.023709] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T20:33:21.257908] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-15T20:33:22.057904] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-15T20:33:22.209254] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:33:22.491920] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T20:33:22.662063] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T20:33:22.857862] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-15T20:33:23.657897] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-15T20:33:24.457935] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-15T20:33:24.513341] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T20:33:24.515124] [INFO ] [REMOTE ] STK: Full fetch complete (10268 records). [2025-09-15T20:33:24.515237] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-15T20:33:24.916895] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T20:33:24.916598] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-15T20:33:24.917432] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-15T20:33:24.919497] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-15T20:33:24.919563] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-15T20:33:24.920487] [DEBUG] [LOCAL ] STK: Trimmed 10268 records to 6438 (keeping 150 days of data) [2025-09-15T20:33:24.963674] [DEBUG] [LOCAL ] STK: Primary data saved (6438 records). [2025-09-15T20:33:24.963932] [INFO ] [MAIN ] STK: Full history saved. [2025-09-15T20:33:24.964084] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STK took 15.0s. Estimated remaining: 38m 21s. Rate: 9.4 symbols/min [2025-09-15T20:33:25.167547] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:25.174819] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-15T20:33:25.202276] [DEBUG] [LOCAL ] STN: Loaded 17137 existing records from primary storage. [2025-09-15T20:33:25.202428] [INFO ] [MAIN ] STN: Loaded 17137 existing records. [2025-09-15T20:33:25.264528] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-15T20:33:25.390684] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:25.390993] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-15T20:33:25.391041] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-15T20:33:25.391582] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-15T20:33:25.391629] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-15T20:33:25.738259] [INFO ] [REMOTE ] STN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:26.057906] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-15T20:33:26.199711] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T20:33:26.857933] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-15T20:33:27.657888] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-15T20:33:28.092683] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T20:33:28.165393] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T20:33:28.457893] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-15T20:33:29.010621] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T20:33:29.257946] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-15T20:33:29.475776] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T20:33:29.739282] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T20:33:29.740148] [INFO ] [REMOTE ] STG: Full fetch complete (2065 records). [2025-09-15T20:33:29.740238] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-15T20:33:29.925466] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-15T20:33:29.925734] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:33:29.925791] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:33:29.925839] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-15T20:33:29.925921] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-15T20:33:29.925992] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-15T20:33:29.926048] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-15T20:33:29.926118] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STG took 27.7s. Estimated remaining: 38m 15s. Rate: 9.4 symbols/min [2025-09-15T20:33:30.074448] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-15T20:33:30.106895] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:30.145661] [DEBUG] [LOCAL ] STNG: Loaded 32791 existing records from primary storage. [2025-09-15T20:33:30.145829] [INFO ] [MAIN ] STNG: Loaded 32791 existing records. [2025-09-15T20:33:30.324709] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:30.324987] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-15T20:33:30.325036] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-15T20:33:30.325712] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-15T20:33:30.325766] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-15T20:33:30.697557] [INFO ] [REMOTE ] STNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:30.857844] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-15T20:33:31.209287] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T20:33:31.657878] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-15T20:33:32.457932] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-15T20:33:32.949198] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-15T20:33:32.974802] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T20:33:33.257847] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-15T20:33:34.057894] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-15T20:33:34.652766] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-15T20:33:34.857924] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-15T20:33:35.049176] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T20:33:35.378994] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:33:35.657826] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-15T20:33:36.457944] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-15T20:33:36.799236] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T20:33:36.862827] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T20:33:37.257924] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-15T20:33:38.057925] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-15T20:33:38.515094] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T20:33:38.857847] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-15T20:33:39.125854] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T20:33:39.200137] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T20:33:39.657885] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-15T20:33:40.411854] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:33:40.457819] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-15T20:33:41.087670] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:33:41.093461] [INFO ] [REMOTE ] STLA: Full fetch complete (58206 records). [2025-09-15T20:33:41.093578] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-15T20:33:41.264775] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-15T20:33:41.473521] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-15T20:33:41.473609] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-15T20:33:41.474576] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-15T20:33:41.474621] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-15T20:33:41.475795] [DEBUG] [LOCAL ] STLA: Trimmed 58206 records to 39536 (keeping 150 days of data) [2025-09-15T20:33:41.723294] [DEBUG] [LOCAL ] STLA: Primary data saved (39536 records). [2025-09-15T20:33:41.723458] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-15T20:33:41.724069] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STLA took 28.1s. Estimated remaining: 38m 9s. Rate: 9.4 symbols/min [2025-09-15T20:33:41.898839] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:41.909670] [DEBUG] [LOCAL ] STRV: Loaded 7828 existing records from primary storage. [2025-09-15T20:33:41.909810] [INFO ] [MAIN ] STRV: Loaded 7828 existing records. [2025-09-15T20:33:42.065150] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-15T20:33:42.088980] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:42.089276] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-15T20:33:42.089324] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-15T20:33:42.089699] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-15T20:33:42.089749] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-15T20:33:42.447055] [INFO ] [REMOTE ] STRV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:42.462984] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-15T20:33:42.468913] [INFO ] [REMOTE ] STM: Full fetch complete (58239 records). [2025-09-15T20:33:42.469028] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-15T20:33:42.865133] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-15T20:33:42.869541] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-15T20:33:42.869711] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-15T20:33:42.871471] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-15T20:33:42.871685] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-15T20:33:42.873752] [DEBUG] [LOCAL ] STM: Trimmed 58239 records to 39560 (keeping 150 days of data) [2025-09-15T20:33:43.182122] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T20:33:43.186140] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T20:33:43.215215] [DEBUG] [LOCAL ] STM: Primary data saved (39560 records). [2025-09-15T20:33:43.215452] [INFO ] [MAIN ] STM: Full history saved. [2025-09-15T20:33:43.216882] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STM took 25.4s. Estimated remaining: 38m 2s. Rate: 9.4 symbols/min [2025-09-15T20:33:43.394381] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:43.435489] [DEBUG] [LOCAL ] STT: Loaded 38482 existing records from primary storage. [2025-09-15T20:33:43.435668] [INFO ] [MAIN ] STT: Loaded 38482 existing records. [2025-09-15T20:33:43.618998] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:43.626532] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T20:33:43.626636] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-15T20:33:43.626775] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-15T20:33:43.630466] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-15T20:33:43.630519] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-15T20:33:43.662938] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-15T20:33:43.994694] [INFO ] [REMOTE ] STT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:44.457943] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-15T20:33:44.744405] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T20:33:45.257890] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-15T20:33:46.057914] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-15T20:33:46.530007] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T20:33:46.580358] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T20:33:46.857984] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-15T20:33:47.657894] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-15T20:33:47.817997] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T20:33:48.457953] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-15T20:33:48.686321] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:33:48.853795] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T20:33:49.090582] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T20:33:49.257925] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-15T20:33:50.057879] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-15T20:33:50.857894] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-15T20:33:50.927167] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T20:33:51.302928] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T20:33:51.657927] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-15T20:33:52.325698] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:33:52.457839] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-15T20:33:52.701491] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T20:33:52.704211] [INFO ] [REMOTE ] STN: Full fetch complete (25317 records). [2025-09-15T20:33:52.704308] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-15T20:33:53.062295] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-15T20:33:53.062371] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-15T20:33:53.062843] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-15T20:33:53.062887] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-15T20:33:53.063501] [DEBUG] [LOCAL ] STN: Trimmed 25317 records to 16896 (keeping 150 days of data) [2025-09-15T20:33:53.175100] [DEBUG] [LOCAL ] STN: Primary data saved (16896 records). [2025-09-15T20:33:53.175269] [INFO ] [MAIN ] STN: Full history saved. [2025-09-15T20:33:53.175373] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STN took 28.2s. Estimated remaining: 37m 56s. Rate: 9.4 symbols/min [2025-09-15T20:33:53.264226] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-15T20:33:53.345029] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:53.363822] [DEBUG] [LOCAL ] STVN: Loaded 19718 existing records from primary storage. [2025-09-15T20:33:53.363974] [INFO ] [MAIN ] STVN: Loaded 19718 existing records. [2025-09-15T20:33:53.537311] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:53.537550] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-15T20:33:53.537594] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-15T20:33:53.538024] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-15T20:33:53.538072] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-15T20:33:53.890840] [INFO ] [REMOTE ] STVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:53.898440] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T20:33:53.947470] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T20:33:54.057824] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-15T20:33:54.729096] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T20:33:54.857829] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-15T20:33:55.657918] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-15T20:33:55.890943] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T20:33:56.219372] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:33:56.220881] [INFO ] [REMOTE ] STRV: Full fetch complete (12774 records). [2025-09-15T20:33:56.220950] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-15T20:33:56.466142] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-15T20:33:56.633324] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-15T20:33:56.633416] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-15T20:33:56.633753] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-15T20:33:56.633798] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-15T20:33:56.634289] [DEBUG] [LOCAL ] STRV: Trimmed 12774 records to 7590 (keeping 150 days of data) [2025-09-15T20:33:56.680423] [DEBUG] [LOCAL ] STRV: Primary data saved (7590 records). [2025-09-15T20:33:56.680519] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-15T20:33:56.680610] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STRV took 15.0s. Estimated remaining: 37m 50s. Rate: 9.4 symbols/min [2025-09-15T20:33:56.850997] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:33:56.894772] [DEBUG] [LOCAL ] STWD: Loaded 38914 existing records from primary storage. [2025-09-15T20:33:56.894917] [INFO ] [MAIN ] STWD: Loaded 38914 existing records. [2025-09-15T20:33:57.073189] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:33:57.073485] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-15T20:33:57.073530] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-15T20:33:57.074304] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-15T20:33:57.074353] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-15T20:33:57.267478] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-15T20:33:57.442991] [INFO ] [REMOTE ] STWD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:33:58.057933] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-15T20:33:58.396487] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T20:33:58.564234] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T20:33:58.857910] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-15T20:33:59.657921] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-15T20:33:59.717836] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T20:34:00.221458] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T20:34:00.457886] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-15T20:34:01.104348] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T20:34:01.257890] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-15T20:34:02.058109] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-15T20:34:02.400859] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T20:34:02.436255] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T20:34:02.857936] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-15T20:34:03.657897] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-15T20:34:03.832492] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T20:34:03.842991] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T20:34:04.457868] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-15T20:34:05.257887] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-15T20:34:05.506258] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T20:34:05.683369] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:34:06.057880] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-15T20:34:06.857875] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-15T20:34:07.230680] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T20:34:07.566320] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:34:07.657860] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-15T20:34:07.833036] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T20:34:08.028338] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T20:34:08.033548] [INFO ] [REMOTE ] STT: Full fetch complete (55444 records). [2025-09-15T20:34:08.033742] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-15T20:34:08.034534] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:34:08.034613] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:34:08.034686] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:34:08.034745] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-15T20:34:08.034812] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-15T20:34:08.034856] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-09-15T20:34:08.035195] [DEBUG] [LOCAL ] STT: Deleted derivative data file. [2025-09-15T20:34:08.035941] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STT took 24.8s. Estimated remaining: 37m 44s. Rate: 9.4 symbols/min [2025-09-15T20:34:08.210781] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:08.213384] [DEBUG] [LOCAL ] STXD: Loaded 838 existing records from primary storage. [2025-09-15T20:34:08.213455] [INFO ] [MAIN ] STXD: Loaded 838 existing records. [2025-09-15T20:34:08.400056] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:08.400383] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-15T20:34:08.400435] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-15T20:34:08.400692] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-15T20:34:08.400746] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-15T20:34:08.463077] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-15T20:34:08.811531] [INFO ] [REMOTE ] STXD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:09.257900] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-15T20:34:09.629053] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:34:09.635486] [INFO ] [REMOTE ] STVN: Full fetch complete (28970 records). [2025-09-15T20:34:09.635764] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-15T20:34:10.027895] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-15T20:34:10.027999] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-15T20:34:10.028847] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-15T20:34:10.028908] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-15T20:34:10.029940] [DEBUG] [LOCAL ] STVN: Trimmed 28970 records to 19277 (keeping 150 days of data) [2025-09-15T20:34:10.082562] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-15T20:34:10.160382] [DEBUG] [LOCAL ] STVN: Primary data saved (19277 records). [2025-09-15T20:34:10.160612] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-15T20:34:10.160749] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STVN took 17.0s. Estimated remaining: 37m 37s. Rate: 9.4 symbols/min [2025-09-15T20:34:10.345768] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:10.350361] [DEBUG] [LOCAL ] STXE: Loaded 1470 existing records from primary storage. [2025-09-15T20:34:10.350444] [INFO ] [MAIN ] STXE: Loaded 1470 existing records. [2025-09-15T20:34:10.535293] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:10.535639] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-15T20:34:10.535712] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-15T20:34:10.535996] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-15T20:34:10.536046] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-15T20:34:10.726172] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T20:34:10.863103] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-15T20:34:10.923442] [INFO ] [REMOTE ] STXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:11.032410] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T20:34:11.657919] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-15T20:34:12.085236] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T20:34:12.093785] [INFO ] [REMOTE ] STNG: Full fetch complete (48223 records). [2025-09-15T20:34:12.094020] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-15T20:34:12.292020] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T20:34:12.467478] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-15T20:34:12.724677] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-15T20:34:12.724861] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-15T20:34:12.726781] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-15T20:34:12.726870] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-15T20:34:12.730527] [DEBUG] [LOCAL ] STNG: Trimmed 48223 records to 32291 (keeping 150 days of data) [2025-09-15T20:34:13.012999] [DEBUG] [LOCAL ] STNG: Primary data saved (32291 records). [2025-09-15T20:34:13.013170] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-15T20:34:13.013316] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STNG took 43.1s. Estimated remaining: 37m 30s. Rate: 9.4 symbols/min [2025-09-15T20:34:13.198266] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:13.202260] [DEBUG] [LOCAL ] STXG: Loaded 1621 existing records from primary storage. [2025-09-15T20:34:13.202362] [INFO ] [MAIN ] STXG: Loaded 1621 existing records. [2025-09-15T20:34:13.267215] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-15T20:34:13.386526] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:13.386823] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-15T20:34:13.386871] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-15T20:34:13.387078] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-15T20:34:13.387125] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-15T20:34:13.762700] [INFO ] [REMOTE ] STXG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:13.827133] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T20:34:14.057883] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-15T20:34:14.215961] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:34:14.554113] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T20:34:14.857885] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-15T20:34:15.322735] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T20:34:15.657882] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-15T20:34:16.121341] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T20:34:16.457873] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-15T20:34:17.257889] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-15T20:34:17.957425] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:34:18.057878] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-15T20:34:18.433339] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T20:34:18.672021] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T20:34:18.857918] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-15T20:34:19.331547] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T20:34:19.657880] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-15T20:34:20.176352] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T20:34:20.457864] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-15T20:34:21.064324] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:34:21.257874] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-15T20:34:21.629171] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T20:34:22.057873] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-15T20:34:22.588618] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T20:34:22.857881] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-15T20:34:23.481571] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T20:34:23.657913] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-15T20:34:24.258871] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T20:34:24.457882] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-15T20:34:25.022757] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T20:34:25.257883] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-15T20:34:26.057885] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-15T20:34:26.500551] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T20:34:26.857872] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-15T20:34:27.196919] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T20:34:27.325470] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T20:34:27.657906] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-15T20:34:28.032433] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T20:34:28.457926] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-15T20:34:28.774145] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T20:34:28.775161] [INFO ] [REMOTE ] STXD: Full fetch complete (1496 records). [2025-09-15T20:34:28.775246] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-15T20:34:29.141868] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-15T20:34:29.141945] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-15T20:34:29.142035] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-15T20:34:29.142075] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-15T20:34:29.142397] [DEBUG] [LOCAL ] STXD: Trimmed 1496 records to 803 (keeping 150 days of data) [2025-09-15T20:34:29.147989] [DEBUG] [LOCAL ] STXD: Primary data saved (803 records). [2025-09-15T20:34:29.148046] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-15T20:34:29.148167] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STXD took 21.1s. Estimated remaining: 37m 25s. Rate: 9.4 symbols/min [2025-09-15T20:34:29.263097] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-15T20:34:29.319980] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:29.323260] [DEBUG] [LOCAL ] STXK: Loaded 998 existing records from primary storage. [2025-09-15T20:34:29.323338] [INFO ] [MAIN ] STXK: Loaded 998 existing records. [2025-09-15T20:34:29.499168] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:29.499478] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-15T20:34:29.499537] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-15T20:34:29.499737] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-15T20:34:29.499787] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-15T20:34:29.843844] [INFO ] [REMOTE ] STXK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:30.057860] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-15T20:34:30.498266] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T20:34:30.857846] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-15T20:34:30.994220] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T20:34:31.450180] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T20:34:31.657848] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-15T20:34:32.457873] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-15T20:34:32.906563] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-15T20:34:32.907453] [INFO ] [REMOTE ] STXE: Full fetch complete (2540 records). [2025-09-15T20:34:32.907526] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-15T20:34:33.259455] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-15T20:34:33.265700] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-15T20:34:33.265780] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-15T20:34:33.265939] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-15T20:34:33.266009] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-15T20:34:33.267307] [DEBUG] [LOCAL ] STXE: Trimmed 2540 records to 1410 (keeping 150 days of data) [2025-09-15T20:34:33.293423] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T20:34:33.293493] [DEBUG] [LOCAL ] STXE: Primary data saved (1410 records). [2025-09-15T20:34:33.299133] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-15T20:34:33.299877] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXE took 23.1s. Estimated remaining: 37m 19s. Rate: 9.4 symbols/min [2025-09-15T20:34:33.306022] [INFO ] [REMOTE ] STWD: Full fetch complete (56375 records). [2025-09-15T20:34:33.347688] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-15T20:34:33.587959] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:33.603467] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-15T20:34:33.618811] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-15T20:34:33.629345] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-15T20:34:33.635320] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-15T20:34:33.637447] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-15T20:34:33.637779] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-15T20:34:33.881248] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T20:34:34.060734] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-15T20:34:34.165849] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-15T20:34:34.166241] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-15T20:34:34.177839] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-15T20:34:34.188091] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-15T20:34:34.227898] [DEBUG] [LOCAL ] STWD: Trimmed 56375 records to 38133 (keeping 150 days of data) [2025-09-15T20:34:34.247246] [INFO ] [REMOTE ] STXM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:34.489298] [DEBUG] [LOCAL ] STWD: Primary data saved (38133 records). [2025-09-15T20:34:34.489441] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-15T20:34:34.489956] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STWD took 37.8s. Estimated remaining: 37m 11s. Rate: 9.4 symbols/min [2025-09-15T20:34:34.656959] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:34.661713] [DEBUG] [LOCAL ] STXT: Loaded 1916 existing records from primary storage. [2025-09-15T20:34:34.661824] [INFO ] [MAIN ] STXT: Loaded 1916 existing records. [2025-09-15T20:34:34.836539] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:34.836779] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-15T20:34:34.836825] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-15T20:34:34.837049] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-15T20:34:34.837095] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-15T20:34:34.867577] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-15T20:34:34.937295] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T20:34:35.198124] [INFO ] [REMOTE ] STXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:35.437524] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T20:34:35.657890] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-15T20:34:36.169079] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T20:34:36.169939] [INFO ] [REMOTE ] STXG: Full fetch complete (3009 records). [2025-09-15T20:34:36.170007] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-15T20:34:36.463023] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-15T20:34:36.535065] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-15T20:34:36.535157] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-15T20:34:36.535285] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-15T20:34:36.535336] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-15T20:34:36.535723] [DEBUG] [LOCAL ] STXG: Trimmed 3009 records to 1476 (keeping 150 days of data) [2025-09-15T20:34:36.546237] [DEBUG] [LOCAL ] STXG: Primary data saved (1476 records). [2025-09-15T20:34:36.546299] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-15T20:34:36.546379] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STXG took 23.5s. Estimated remaining: 37m 4s. Rate: 9.4 symbols/min [2025-09-15T20:34:36.717310] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:36.721925] [DEBUG] [LOCAL ] STXV: Loaded 1125 existing records from primary storage. [2025-09-15T20:34:36.722068] [INFO ] [MAIN ] STXV: Loaded 1125 existing records. [2025-09-15T20:34:36.898166] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:36.898419] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-15T20:34:36.898465] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-15T20:34:36.898735] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-15T20:34:36.898785] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-15T20:34:37.166604] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:34:37.256323] [INFO ] [REMOTE ] STXV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:37.257819] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-15T20:34:37.958394] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:34:38.057922] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-15T20:34:38.604820] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T20:34:38.857926] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-15T20:34:39.521265] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T20:34:39.657882] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-15T20:34:40.196504] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T20:34:40.457829] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-15T20:34:40.902808] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T20:34:41.257878] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-15T20:34:41.639560] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T20:34:42.057872] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-15T20:34:42.584003] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T20:34:42.857877] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-15T20:34:43.422552] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T20:34:43.657927] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-15T20:34:44.076087] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T20:34:44.457887] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-15T20:34:44.810617] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T20:34:45.257874] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-15T20:34:45.860810] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T20:34:46.057899] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-15T20:34:46.522719] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T20:34:46.857870] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-15T20:34:47.313965] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T20:34:47.657879] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-15T20:34:48.360129] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T20:34:48.457921] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-15T20:34:49.064104] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T20:34:49.257878] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-15T20:34:49.618899] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T20:34:50.057877] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-15T20:34:50.617490] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T20:34:50.857878] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-15T20:34:51.412490] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T20:34:51.657869] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-15T20:34:52.084965] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T20:34:52.085732] [INFO ] [REMOTE ] STXK: Full fetch complete (1714 records). [2025-09-15T20:34:52.085808] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-15T20:34:52.432605] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-15T20:34:52.432711] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-15T20:34:52.432818] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-15T20:34:52.432857] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-15T20:34:52.433191] [DEBUG] [LOCAL ] STXK: Trimmed 1714 records to 952 (keeping 150 days of data) [2025-09-15T20:34:52.440017] [DEBUG] [LOCAL ] STXK: Primary data saved (952 records). [2025-09-15T20:34:52.440073] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-15T20:34:52.440148] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXK took 23.3s. Estimated remaining: 36m 59s. Rate: 9.4 symbols/min [2025-09-15T20:34:52.463000] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-15T20:34:52.612515] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:52.666321] [DEBUG] [LOCAL ] STZ: Loaded 39284 existing records from primary storage. [2025-09-15T20:34:52.666490] [INFO ] [MAIN ] STZ: Loaded 39284 existing records. [2025-09-15T20:34:52.841600] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:52.841849] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-15T20:34:52.841895] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-15T20:34:52.842780] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-15T20:34:52.842830] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-15T20:34:53.175979] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T20:34:53.195228] [INFO ] [REMOTE ] STZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:53.257810] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-15T20:34:54.057877] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-15T20:34:54.619896] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:34:54.857931] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-15T20:34:55.363288] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T20:34:55.516996] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T20:34:55.657868] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-15T20:34:56.037192] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:34:56.038019] [INFO ] [REMOTE ] STXV: Full fetch complete (1948 records). [2025-09-15T20:34:56.038086] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-15T20:34:56.393987] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-15T20:34:56.394065] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-15T20:34:56.394157] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-15T20:34:56.394217] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-15T20:34:56.394546] [DEBUG] [LOCAL ] STXV: Trimmed 1948 records to 1088 (keeping 150 days of data) [2025-09-15T20:34:56.401507] [DEBUG] [LOCAL ] STXV: Primary data saved (1088 records). [2025-09-15T20:34:56.401564] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-15T20:34:56.401638] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXV took 19.9s. Estimated remaining: 36m 53s. Rate: 9.4 symbols/min [2025-09-15T20:34:56.462982] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-15T20:34:56.570532] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:56.620742] [DEBUG] [LOCAL ] SU: Loaded 40234 existing records from primary storage. [2025-09-15T20:34:56.620911] [INFO ] [MAIN ] SU: Loaded 40234 existing records. [2025-09-15T20:34:56.796026] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:56.796299] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-15T20:34:56.796365] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-15T20:34:56.797315] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-15T20:34:56.797382] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-15T20:34:57.151448] [INFO ] [REMOTE ] SU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:34:57.257833] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-15T20:34:58.057897] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-15T20:34:58.465036] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T20:34:58.694715] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T20:34:58.857882] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-15T20:34:59.055230] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:34:59.180497] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T20:34:59.181273] [INFO ] [REMOTE ] STXM: Full fetch complete (1028 records). [2025-09-15T20:34:59.181343] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-15T20:34:59.368814] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T20:34:59.369037] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:34:59.369121] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:34:59.369188] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-15T20:34:59.369286] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-15T20:34:59.369327] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-15T20:34:59.369376] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-15T20:34:59.369444] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. STXM took 26.1s. Estimated remaining: 36m 46s. Rate: 9.4 symbols/min [2025-09-15T20:34:59.546505] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:34:59.585277] [DEBUG] [LOCAL ] SUI: Loaded 31838 existing records from primary storage. [2025-09-15T20:34:59.585435] [INFO ] [MAIN ] SUI: Loaded 31838 existing records. [2025-09-15T20:34:59.663030] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-15T20:34:59.774333] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:34:59.774599] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-15T20:34:59.774669] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-15T20:34:59.775365] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-15T20:34:59.775415] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-15T20:35:00.179484] [INFO ] [REMOTE ] SUI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:00.457869] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-15T20:35:01.257917] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-15T20:35:01.392572] [DEBUG] [REMOTE ] STXT: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-15T20:35:01.393176] [WARN ] [REMOTE ] STXT: No data returned for month 2025-07 [2025-09-15T20:35:01.933025] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-15T20:35:02.057873] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-15T20:35:02.309361] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T20:35:02.857877] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-15T20:35:03.657910] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-15T20:35:04.318343] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-15T20:35:04.395048] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:35:04.457881] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-15T20:35:05.257927] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-15T20:35:05.490352] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:35:05.819741] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T20:35:06.057885] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-15T20:35:06.225872] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T20:35:06.534686] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T20:35:06.535601] [INFO ] [REMOTE ] STXT: Full fetch complete (2362 records). [2025-09-15T20:35:06.535691] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-15T20:35:06.729488] [WARN ] [VALIDATOR ] STXT: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-15T20:35:06.729727] [FATAL] [MAIN ] STXT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:35:06.729774] [WARN ] [MAIN ] STXT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:35:06.729816] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-15T20:35:06.729895] [DEBUG] [LOCAL ] STXT: No primary data file found to delete. [2025-09-15T20:35:06.729935] [INFO ] [LOCAL ] STXT: Starting deletion of derivative data. [2025-09-15T20:35:06.730285] [DEBUG] [LOCAL ] STXT: Deleted derivative data file. [2025-09-15T20:35:06.730376] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. STXT took 32.2s. Estimated remaining: 36m 39s. Rate: 9.4 symbols/min [2025-09-15T20:35:06.869879] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-15T20:35:06.900572] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:06.937046] [DEBUG] [LOCAL ] SUN: Loaded 28696 existing records from primary storage. [2025-09-15T20:35:06.937189] [INFO ] [MAIN ] SUN: Loaded 28696 existing records. [2025-09-15T20:35:07.117232] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:07.117472] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-15T20:35:07.117518] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-15T20:35:07.118095] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-15T20:35:07.118147] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-15T20:35:07.476047] [INFO ] [REMOTE ] SUN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:07.657940] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-15T20:35:08.457887] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-15T20:35:09.009132] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T20:35:09.257857] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-15T20:35:09.429448] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T20:35:09.927608] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:35:10.057875] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-15T20:35:10.857964] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-15T20:35:11.074265] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T20:35:11.657887] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-15T20:35:11.918789] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T20:35:12.075439] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:35:12.457873] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-15T20:35:13.257934] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-15T20:35:13.457596] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T20:35:13.539174] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T20:35:14.057870] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-15T20:35:14.857870] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-15T20:35:15.151074] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:35:15.227888] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T20:35:15.657880] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-15T20:35:16.092001] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T20:35:16.457847] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-15T20:35:17.257869] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-15T20:35:17.840303] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T20:35:18.032694] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:35:18.057834] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-15T20:35:18.735212] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:35:18.857943] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-15T20:35:19.665487] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-15T20:35:19.671271] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T20:35:20.221448] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T20:35:20.457869] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-15T20:35:21.261770] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-15T20:35:21.267963] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T20:35:21.582801] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T20:35:21.588279] [INFO ] [REMOTE ] SUI: Full fetch complete (45795 records). [2025-09-15T20:35:21.588418] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-15T20:35:21.985417] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-15T20:35:21.985564] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-15T20:35:21.986462] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-15T20:35:21.986510] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-15T20:35:21.987797] [DEBUG] [LOCAL ] SUI: Trimmed 45795 records to 31330 (keeping 150 days of data) [2025-09-15T20:35:22.083705] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-15T20:35:22.189822] [DEBUG] [LOCAL ] SUI: Primary data saved (31330 records). [2025-09-15T20:35:22.189949] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-15T20:35:22.190046] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. SUI took 22.8s. Estimated remaining: 36m 35s. Rate: 9.4 symbols/min [2025-09-15T20:35:22.358141] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:22.392459] [DEBUG] [LOCAL ] SUPV: Loaded 35455 existing records from primary storage. [2025-09-15T20:35:22.392621] [INFO ] [MAIN ] SUPV: Loaded 35455 existing records. [2025-09-15T20:35:22.570464] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:22.570757] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-15T20:35:22.570881] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-15T20:35:22.571692] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-15T20:35:22.571748] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-15T20:35:22.863019] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-15T20:35:22.928269] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:22.955910] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T20:35:23.654445] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T20:35:23.664662] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-15T20:35:24.457848] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-15T20:35:24.855072] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T20:35:24.861673] [INFO ] [REMOTE ] STZ: Full fetch complete (56918 records). [2025-09-15T20:35:24.861791] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-15T20:35:25.127201] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:35:25.185147] [INFO ] [REMOTE ] SUN: Full fetch complete (40810 records). [2025-09-15T20:35:25.196299] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-15T20:35:25.258381] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-15T20:35:25.355704] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-15T20:35:25.361253] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-15T20:35:25.382104] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-15T20:35:25.384516] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-15T20:35:25.443913] [DEBUG] [LOCAL ] STZ: Trimmed 56918 records to 38549 (keeping 150 days of data) [2025-09-15T20:35:25.768254] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-15T20:35:25.769727] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-15T20:35:25.772522] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-15T20:35:25.772855] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-15T20:35:25.779572] [DEBUG] [LOCAL ] SUN: Trimmed 40810 records to 28207 (keeping 150 days of data) [2025-09-15T20:35:25.982893] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:35:26.060465] [INFO ] [REMOTE ] SU: Full fetch complete (58138 records). [2025-09-15T20:35:26.097027] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-15T20:35:26.104028] [DEBUG] [LOCAL ] SUN: Primary data saved (28207 records). [2025-09-15T20:35:26.126269] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-15T20:35:26.126631] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. SUN took 19.4s. Estimated remaining: 36m 28s. Rate: 9.4 symbols/min [2025-09-15T20:35:26.424806] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:26.688926] [DEBUG] [LOCAL ] STZ: Primary data saved (38549 records). [2025-09-15T20:35:26.699569] [DEBUG] [LOCAL ] SUZ: Loaded 34309 existing records from primary storage. [2025-09-15T20:35:26.698986] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-15T20:35:26.733291] [INFO ] [MAIN ] SUZ: Loaded 34309 existing records. [2025-09-15T20:35:26.734372] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. STZ took 34.3s. Estimated remaining: 36m 20s. Rate: 9.4 symbols/min [2025-09-15T20:35:26.805265] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-15T20:35:26.816310] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-15T20:35:26.866026] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-15T20:35:26.914979] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-15T20:35:27.036548] [DEBUG] [LOCAL ] SU: Trimmed 58138 records to 39449 (keeping 150 days of data) [2025-09-15T20:35:27.136306] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:27.213378] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:27.224035] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-15T20:35:27.224135] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-15T20:35:27.252304] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-15T20:35:27.252745] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-15T20:35:27.475448] [DEBUG] [LOCAL ] SVV: Loaded 28889 existing records from primary storage. [2025-09-15T20:35:27.507595] [INFO ] [MAIN ] SVV: Loaded 28889 existing records. [2025-09-15T20:35:27.899169] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:27.905747] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-15T20:35:27.918474] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-15T20:35:27.955887] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-15T20:35:27.999092] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:28.000477] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-15T20:35:28.001158] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-15T20:35:28.002601] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-15T20:35:28.003016] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-15T20:35:28.207272] [DEBUG] [LOCAL ] SU: Primary data saved (39449 records). [2025-09-15T20:35:28.279047] [INFO ] [MAIN ] SU: Full history saved. [2025-09-15T20:35:28.291784] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SU took 31.9s. Estimated remaining: 36m 13s. Rate: 9.4 symbols/min [2025-09-15T20:35:28.503143] [INFO ] [REMOTE ] SVV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:28.532373] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-15T20:35:28.563013] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:28.603293] [DEBUG] [LOCAL ] SW: Loaded 39955 existing records from primary storage. [2025-09-15T20:35:28.603437] [INFO ] [MAIN ] SW: Loaded 39955 existing records. [2025-09-15T20:35:28.777677] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:28.777953] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-15T20:35:28.778038] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-15T20:35:28.778761] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-15T20:35:28.778810] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-15T20:35:29.132447] [INFO ] [REMOTE ] SW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:29.132809] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-15T20:35:29.386502] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:35:29.396171] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-15T20:35:29.452796] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T20:35:29.888301] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T20:35:30.057867] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-15T20:35:30.503434] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T20:35:30.652478] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T20:35:30.857919] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-15T20:35:31.653822] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T20:35:31.661788] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-15T20:35:32.457930] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-15T20:35:32.741907] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T20:35:33.199798] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T20:35:33.257913] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-15T20:35:34.057882] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-15T20:35:34.134034] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:35:34.857886] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-15T20:35:35.329453] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-15T20:35:35.432564] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:35:35.657871] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-15T20:35:36.336380] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T20:35:36.457884] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-15T20:35:37.255321] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T20:35:37.264513] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-15T20:35:37.340388] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:35:38.057885] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-15T20:35:38.857893] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-15T20:35:39.050613] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:35:39.513145] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T20:35:39.657832] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-15T20:35:40.219048] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:35:40.457913] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-15T20:35:41.207454] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:35:41.257818] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-15T20:35:42.057897] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-15T20:35:42.129753] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T20:35:42.388168] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T20:35:42.393408] [INFO ] [REMOTE ] SVV: Full fetch complete (42369 records). [2025-09-15T20:35:42.393527] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-15T20:35:42.764862] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-15T20:35:42.764952] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-15T20:35:42.765904] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-15T20:35:42.765958] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-15T20:35:42.766963] [DEBUG] [LOCAL ] SVV: Trimmed 42369 records to 28338 (keeping 150 days of data) [2025-09-15T20:35:42.860693] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-15T20:35:42.939996] [DEBUG] [LOCAL ] SVV: Primary data saved (28338 records). [2025-09-15T20:35:42.940145] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-15T20:35:42.940231] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SVV took 16.2s. Estimated remaining: 36m 8s. Rate: 9.4 symbols/min [2025-09-15T20:35:43.112510] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:43.151217] [DEBUG] [LOCAL ] SWK: Loaded 39632 existing records from primary storage. [2025-09-15T20:35:43.151372] [INFO ] [MAIN ] SWK: Loaded 39632 existing records. [2025-09-15T20:35:43.329170] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:43.329434] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-15T20:35:43.329479] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-15T20:35:43.330338] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-15T20:35:43.330396] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-15T20:35:43.662443] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-15T20:35:43.685524] [INFO ] [REMOTE ] SWK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:43.714801] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T20:35:44.457884] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-15T20:35:44.763802] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T20:35:45.257863] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-15T20:35:45.309502] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:35:46.057853] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-15T20:35:46.167589] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T20:35:46.857942] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-15T20:35:47.140122] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T20:35:47.183601] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T20:35:47.188928] [INFO ] [REMOTE ] SUZ: Full fetch complete (50320 records). [2025-09-15T20:35:47.189081] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-15T20:35:47.597445] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-15T20:35:47.597552] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-15T20:35:47.599026] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-15T20:35:47.599114] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-15T20:35:47.600863] [DEBUG] [LOCAL ] SUZ: Trimmed 50320 records to 33643 (keeping 150 days of data) [2025-09-15T20:35:47.664749] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-15T20:35:47.815366] [DEBUG] [LOCAL ] SUZ: Primary data saved (33643 records). [2025-09-15T20:35:47.815551] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-15T20:35:47.816206] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SUZ took 21.7s. Estimated remaining: 36m 2s. Rate: 9.4 symbols/min [2025-09-15T20:35:47.991694] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:48.016302] [DEBUG] [LOCAL ] SWX: Loaded 23449 existing records from primary storage. [2025-09-15T20:35:48.016448] [INFO ] [MAIN ] SWX: Loaded 23449 existing records. [2025-09-15T20:35:48.201450] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:48.201768] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-15T20:35:48.201818] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-15T20:35:48.202336] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-15T20:35:48.202385] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-15T20:35:48.461449] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-15T20:35:48.566385] [INFO ] [REMOTE ] SWX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:48.602448] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T20:35:49.257947] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-15T20:35:49.476186] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T20:35:50.057923] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-15T20:35:50.289553] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T20:35:50.334976] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T20:35:50.343221] [INFO ] [REMOTE ] SUPV: Full fetch complete (50962 records). [2025-09-15T20:35:50.343422] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-15T20:35:50.743864] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-15T20:35:50.744041] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-15T20:35:50.745593] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-15T20:35:50.745696] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-15T20:35:50.747450] [DEBUG] [LOCAL ] SUPV: Trimmed 50962 records to 34823 (keeping 150 days of data) [2025-09-15T20:35:50.857953] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-15T20:35:51.002962] [DEBUG] [LOCAL ] SUPV: Primary data saved (34823 records). [2025-09-15T20:35:51.003267] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-15T20:35:51.003462] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SUPV took 28.8s. Estimated remaining: 35m 55s. Rate: 9.4 symbols/min [2025-09-15T20:35:51.189061] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:35:51.195823] [DEBUG] [LOCAL ] SWZ: Loaded 4684 existing records from primary storage. [2025-09-15T20:35:51.195934] [INFO ] [MAIN ] SWZ: Loaded 4684 existing records. [2025-09-15T20:35:51.388000] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:35:51.388381] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-15T20:35:51.388440] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-15T20:35:51.388745] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-15T20:35:51.388794] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-15T20:35:51.663026] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-15T20:35:51.788555] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:35:52.229918] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T20:35:52.457944] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-15T20:35:52.882333] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-15T20:35:53.205100] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:35:53.257947] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-15T20:35:54.057912] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-15T20:35:54.620665] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T20:35:54.826036] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T20:35:54.857935] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-15T20:35:55.657918] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-15T20:35:56.323960] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T20:35:56.457983] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-15T20:35:56.869912] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (4.41 seconds). [2025-09-15T20:35:57.258010] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-15T20:35:57.599936] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-15T20:35:57.616506] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T20:35:58.058004] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-15T20:35:58.646356] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T20:35:58.857864] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-15T20:35:58.979519] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T20:35:59.657953] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-15T20:36:00.166217] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T20:36:00.457990] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-15T20:36:01.171182] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T20:36:01.178618] [INFO ] [REMOTE ] SW: Full fetch complete (57771 records). [2025-09-15T20:36:01.178973] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-15T20:36:01.263094] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-15T20:36:01.571808] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-15T20:36:01.571897] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-15T20:36:01.572940] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-15T20:36:01.572986] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-15T20:36:01.574302] [DEBUG] [LOCAL ] SW: Trimmed 57771 records to 39178 (keeping 150 days of data) [2025-09-15T20:36:01.853447] [DEBUG] [LOCAL ] SW: Primary data saved (39178 records). [2025-09-15T20:36:01.853681] [INFO ] [MAIN ] SW: Full history saved. [2025-09-15T20:36:01.853901] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SW took 33.5s. Estimated remaining: 35m 49s. Rate: 9.4 symbols/min [2025-09-15T20:36:02.043009] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:02.062828] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-15T20:36:02.077797] [DEBUG] [LOCAL ] SXC: Loaded 30976 existing records from primary storage. [2025-09-15T20:36:02.077957] [INFO ] [MAIN ] SXC: Loaded 30976 existing records. [2025-09-15T20:36:02.190982] [DEBUG] [REMOTE ] SWZ: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-15T20:36:02.237387] [WARN ] [REMOTE ] SWZ: No data returned for month 2025-06 [2025-09-15T20:36:02.263042] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:02.263662] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-15T20:36:02.263729] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-15T20:36:02.264598] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-15T20:36:02.264710] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-15T20:36:02.483871] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T20:36:02.679687] [INFO ] [REMOTE ] SXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:02.857924] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-15T20:36:03.657932] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-15T20:36:04.457925] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-15T20:36:04.914299] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T20:36:05.257924] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-15T20:36:05.605363] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T20:36:05.697414] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T20:36:05.876508] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T20:36:05.957292] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (3.89 seconds). [2025-09-15T20:36:06.057876] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-15T20:36:06.857887] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-15T20:36:07.339446] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:36:07.657922] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-15T20:36:08.457873] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-15T20:36:08.512264] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:36:09.093469] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T20:36:09.094852] [INFO ] [REMOTE ] SWZ: Full fetch complete (6119 records). [2025-09-15T20:36:09.094939] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-15T20:36:09.259371] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-15T20:36:09.299330] [WARN ] [VALIDATOR ] SWZ: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-15T20:36:09.300934] [FATAL] [MAIN ] SWZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:36:09.301153] [WARN ] [MAIN ] SWZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:36:09.301221] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-15T20:36:09.301307] [DEBUG] [LOCAL ] SWZ: No primary data file found to delete. [2025-09-15T20:36:09.301360] [INFO ] [LOCAL ] SWZ: Starting deletion of derivative data. [2025-09-15T20:36:09.301790] [DEBUG] [LOCAL ] SWZ: Deleted derivative data file. [2025-09-15T20:36:09.301989] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SWZ took 18.3s. Estimated remaining: 35m 43s. Rate: 9.4 symbols/min [2025-09-15T20:36:09.520136] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:09.523200] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T20:36:09.546112] [DEBUG] [LOCAL ] SXI: Loaded 8735 existing records from primary storage. [2025-09-15T20:36:09.546315] [INFO ] [MAIN ] SXI: Loaded 8735 existing records. [2025-09-15T20:36:09.741473] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:09.741864] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-15T20:36:09.741919] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-15T20:36:09.742264] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-15T20:36:09.742315] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-15T20:36:10.074279] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-15T20:36:10.117327] [INFO ] [REMOTE ] SXI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:10.355372] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:36:10.857888] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-15T20:36:11.548620] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:36:11.657877] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-15T20:36:11.708757] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:36:11.713296] [INFO ] [REMOTE ] SWX: Full fetch complete (33886 records). [2025-09-15T20:36:11.713476] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-15T20:36:12.108581] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-15T20:36:12.108701] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-15T20:36:12.109419] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-15T20:36:12.109461] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-15T20:36:12.110351] [DEBUG] [LOCAL ] SWX: Trimmed 33886 records to 23089 (keeping 150 days of data) [2025-09-15T20:36:12.263504] [DEBUG] [LOCAL ] SWX: Primary data saved (23089 records). [2025-09-15T20:36:12.263714] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-15T20:36:12.263841] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SWX took 24.4s. Estimated remaining: 35m 36s. Rate: 9.4 symbols/min [2025-09-15T20:36:12.472720] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-15T20:36:12.475499] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:12.500576] [DEBUG] [LOCAL ] SXT: Loaded 21970 existing records from primary storage. [2025-09-15T20:36:12.500775] [INFO ] [MAIN ] SXT: Loaded 21970 existing records. [2025-09-15T20:36:12.676725] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:12.677015] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-15T20:36:12.677061] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-15T20:36:12.677587] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-15T20:36:12.677632] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-15T20:36:13.038178] [INFO ] [REMOTE ] SXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:13.257909] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-15T20:36:13.817127] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T20:36:14.057871] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-15T20:36:14.810495] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-15T20:36:14.821366] [INFO ] [REMOTE ] SWK: Full fetch complete (56880 records). [2025-09-15T20:36:14.821583] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-15T20:36:14.859023] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-15T20:36:15.221165] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-15T20:36:15.221293] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-15T20:36:15.222452] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-15T20:36:15.222508] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-15T20:36:15.223959] [DEBUG] [LOCAL ] SWK: Trimmed 56880 records to 38859 (keeping 150 days of data) [2025-09-15T20:36:15.313493] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T20:36:15.417237] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:36:15.554441] [DEBUG] [LOCAL ] SWK: Primary data saved (38859 records). [2025-09-15T20:36:15.554621] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-15T20:36:15.555319] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SWK took 32.6s. Estimated remaining: 35m 29s. Rate: 9.4 symbols/min [2025-09-15T20:36:15.658085] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-15T20:36:15.733225] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:15.779428] [DEBUG] [LOCAL ] SYF: Loaded 40224 existing records from primary storage. [2025-09-15T20:36:15.779609] [INFO ] [MAIN ] SYF: Loaded 40224 existing records. [2025-09-15T20:36:15.957005] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T20:36:15.978845] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:15.982105] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-15T20:36:15.982172] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-15T20:36:15.983051] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-15T20:36:15.983105] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-15T20:36:16.344345] [INFO ] [REMOTE ] SYF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:16.457881] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-15T20:36:16.476361] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T20:36:17.257894] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-15T20:36:17.828364] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T20:36:18.057893] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-15T20:36:18.808146] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:36:18.857827] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-15T20:36:19.657900] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-15T20:36:19.751950] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T20:36:19.779180] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T20:36:20.457939] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-15T20:36:20.501237] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T20:36:21.257899] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-15T20:36:22.057926] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-15T20:36:22.281071] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T20:36:22.508601] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T20:36:22.857910] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-15T20:36:23.359213] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T20:36:23.657893] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-15T20:36:24.457919] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-15T20:36:24.496313] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:36:25.101654] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:36:25.257896] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-15T20:36:26.057885] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-15T20:36:26.131573] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T20:36:26.766166] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T20:36:26.771599] [INFO ] [REMOTE ] SXC: Full fetch complete (45625 records). [2025-09-15T20:36:26.771799] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-15T20:36:26.863000] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-15T20:36:27.174427] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-15T20:36:27.174510] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-15T20:36:27.175462] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-15T20:36:27.175530] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-15T20:36:27.176924] [DEBUG] [LOCAL ] SXC: Trimmed 45625 records to 30331 (keeping 150 days of data) [2025-09-15T20:36:27.378218] [DEBUG] [LOCAL ] SXC: Primary data saved (30331 records). [2025-09-15T20:36:27.378377] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-15T20:36:27.378481] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXC took 25.5s. Estimated remaining: 35m 24s. Rate: 9.4 symbols/min [2025-09-15T20:36:27.557091] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T20:36:27.593569] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:27.634030] [DEBUG] [LOCAL ] SYK: Loaded 34829 existing records from primary storage. [2025-09-15T20:36:27.634194] [INFO ] [MAIN ] SYK: Loaded 34829 existing records. [2025-09-15T20:36:27.664788] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-15T20:36:27.823493] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:27.823817] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-15T20:36:27.823866] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-15T20:36:27.824680] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-15T20:36:27.824735] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-15T20:36:28.136326] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T20:36:28.213421] [INFO ] [REMOTE ] SYK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:28.457899] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-15T20:36:28.789169] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T20:36:28.792801] [INFO ] [REMOTE ] SXT: Full fetch complete (30559 records). [2025-09-15T20:36:28.792915] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-15T20:36:29.159190] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-15T20:36:29.159324] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-15T20:36:29.159960] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-15T20:36:29.160005] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-15T20:36:29.160844] [DEBUG] [LOCAL ] SXT: Trimmed 30559 records to 21746 (keeping 150 days of data) [2025-09-15T20:36:29.259684] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-15T20:36:29.302234] [DEBUG] [LOCAL ] SXT: Primary data saved (21746 records). [2025-09-15T20:36:29.302353] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-15T20:36:29.302456] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SXT took 17.0s. Estimated remaining: 35m 17s. Rate: 9.4 symbols/min [2025-09-15T20:36:30.057875] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-15T20:36:30.083162] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T20:36:30.132523] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T20:36:30.857877] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-15T20:36:31.598214] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T20:36:31.657887] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-15T20:36:31.959103] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T20:36:32.457942] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-15T20:36:33.257929] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-15T20:36:33.464239] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T20:36:33.507868] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T20:36:34.057943] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-15T20:36:34.857983] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-15T20:36:34.987000] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T20:36:35.657853] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-15T20:36:35.733543] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:36:35.913973] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:36:36.457917] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-15T20:36:37.051874] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T20:36:37.054032] [INFO ] [REMOTE ] SXI: Full fetch complete (11952 records). [2025-09-15T20:36:37.054141] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-15T20:36:37.268078] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-15T20:36:37.437928] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T20:36:37.522101] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-15T20:36:37.522185] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-15T20:36:37.522489] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-15T20:36:37.522530] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-15T20:36:37.523062] [DEBUG] [LOCAL ] SXI: Trimmed 11952 records to 8634 (keeping 150 days of data) [2025-09-15T20:36:37.585244] [DEBUG] [LOCAL ] SXI: Primary data saved (8634 records). [2025-09-15T20:36:37.585415] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-15T20:36:37.585507] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SXI took 28.3s. Estimated remaining: 35m 10s. Rate: 9.4 symbols/min [2025-09-15T20:36:38.057926] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-15T20:36:39.339760] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T20:36:39.349731] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-15T20:36:39.555245] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:36:39.561044] [INFO ] [REMOTE ] SYF: Full fetch complete (58132 records). [2025-09-15T20:36:39.561173] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-15T20:36:39.941764] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-15T20:36:39.941846] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-15T20:36:39.942843] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-15T20:36:39.942886] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-15T20:36:39.944423] [DEBUG] [LOCAL ] SYF: Trimmed 58132 records to 39444 (keeping 150 days of data) [2025-09-15T20:36:40.197662] [DEBUG] [LOCAL ] SYF: Primary data saved (39444 records). [2025-09-15T20:36:40.197832] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-15T20:36:40.198971] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYF took 24.6s. Estimated remaining: 35m 3s. Rate: 9.4 symbols/min [2025-09-15T20:36:40.727508] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T20:36:40.738237] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-15T20:36:42.389136] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T20:36:42.399853] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-15T20:36:43.760907] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T20:36:43.770902] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-15T20:36:44.479447] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:36:44.484117] [INFO ] [REMOTE ] SYK: Full fetch complete (51048 records). [2025-09-15T20:36:44.484245] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-15T20:36:44.484963] [FATAL] [VALIDATOR ] SYK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:36:44.485043] [FATAL] [MAIN ] SYK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:36:44.485090] [WARN ] [MAIN ] SYK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:36:44.485150] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-15T20:36:44.485304] [DEBUG] [LOCAL ] SYK: No primary data file found to delete. [2025-09-15T20:36:44.485368] [INFO ] [LOCAL ] SYK: Starting deletion of derivative data. [2025-09-15T20:36:44.485851] [DEBUG] [LOCAL ] SYK: Deleted derivative data file. [2025-09-15T20:36:44.487692] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. SYK took 17.1s. Estimated remaining: 34m 57s. Rate: 9.4 symbols/min [2025-09-15T20:36:45.154869] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:45.164767] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:45.167970] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:45.191399] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:36:45.260574] [DEBUG] [LOCAL ] TAC: Loaded 31713 existing records from primary storage. [2025-09-15T20:36:45.272034] [INFO ] [MAIN ] TAC: Loaded 31713 existing records. [2025-09-15T20:36:45.301671] [DEBUG] [LOCAL ] TAK: Loaded 37882 existing records from primary storage. [2025-09-15T20:36:45.326666] [INFO ] [MAIN ] TAK: Loaded 37882 existing records. [2025-09-15T20:36:45.450993] [DEBUG] [LOCAL ] T: Loaded 40538 existing records from primary storage. [2025-09-15T20:36:45.441221] [DEBUG] [LOCAL ] SYY: Loaded 40074 existing records from primary storage. [2025-09-15T20:36:45.475683] [INFO ] [MAIN ] T: Loaded 40538 existing records. [2025-09-15T20:36:45.535401] [INFO ] [MAIN ] SYY: Loaded 40074 existing records. [2025-09-15T20:36:45.643730] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:45.790245] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-15T20:36:45.833757] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:45.844560] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-15T20:36:45.849863] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-15T20:36:45.844682] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-15T20:36:45.916930] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-15T20:36:45.951939] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-15T20:36:45.946722] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:45.983150] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-15T20:36:45.992619] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-15T20:36:46.041041] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-15T20:36:46.074595] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-15T20:36:46.090559] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:36:46.106257] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-15T20:36:46.096000] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-15T20:36:46.106420] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-15T20:36:46.116856] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-15T20:36:46.202374] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-15T20:36:46.270567] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-15T20:36:47.024712] [INFO ] [REMOTE ] TAK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:47.077202] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-15T20:36:47.284590] [INFO ] [REMOTE ] T: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:47.338623] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-15T20:36:47.401124] [INFO ] [REMOTE ] TAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:47.424959] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-15T20:36:47.476763] [INFO ] [REMOTE ] SYY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:36:47.477074] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-15T20:36:48.875609] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T20:36:48.885085] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-15T20:36:48.966428] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T20:36:48.976415] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-15T20:36:49.196323] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T20:36:49.205459] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-15T20:36:49.787443] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-15T20:36:49.798785] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-15T20:36:50.243386] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T20:36:50.253980] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-15T20:36:50.676818] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T20:36:50.695397] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-15T20:36:50.810993] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:36:50.821424] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-15T20:36:51.841600] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T20:36:51.853299] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-15T20:36:52.116989] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T20:36:52.129537] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-15T20:36:52.162055] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T20:36:52.382172] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T20:36:52.457883] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-15T20:36:53.257901] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-15T20:36:53.728238] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T20:36:53.875499] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:36:53.992910] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T20:36:54.057898] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-15T20:36:54.857879] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-15T20:36:54.912054] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:36:55.655563] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T20:36:55.664156] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-15T20:36:56.165963] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:36:56.457903] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-15T20:36:57.257860] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-15T20:36:57.335709] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T20:36:58.057922] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-15T20:36:58.662744] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T20:36:58.799996] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T20:36:58.857839] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-15T20:36:59.403949] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:36:59.657919] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-15T20:37:00.457931] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-15T20:37:01.164712] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-15T20:37:01.204355] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:37:01.257867] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-15T20:37:02.057884] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-15T20:37:02.549210] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-15T20:37:02.857876] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-15T20:37:03.527958] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-15T20:37:03.582669] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:37:03.657865] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-15T20:37:03.789217] [DEBUG] [REMOTE ] TAC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-15T20:37:03.789540] [WARN ] [REMOTE ] TAC: No data returned for month 2025-09 [2025-09-15T20:37:03.789635] [INFO ] [REMOTE ] TAC: Full fetch complete (44496 records). [2025-09-15T20:37:03.789725] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-15T20:37:03.790866] [FATAL] [VALIDATOR ] TAC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:37:03.790950] [FATAL] [MAIN ] TAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:37:03.790999] [WARN ] [MAIN ] TAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:37:03.791053] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-15T20:37:03.791129] [DEBUG] [LOCAL ] TAC: No primary data file found to delete. [2025-09-15T20:37:03.791167] [INFO ] [LOCAL ] TAC: Starting deletion of derivative data. [2025-09-15T20:37:03.791584] [DEBUG] [LOCAL ] TAC: Deleted derivative data file. [2025-09-15T20:37:03.791714] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. TAC took 19.3s. Estimated remaining: 34m 52s. Rate: 9.4 symbols/min [2025-09-15T20:37:03.992176] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:04.034963] [DEBUG] [LOCAL ] TAL: Loaded 39020 existing records from primary storage. [2025-09-15T20:37:04.035113] [INFO ] [MAIN ] TAL: Loaded 39020 existing records. [2025-09-15T20:37:04.212403] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:04.212740] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-15T20:37:04.212841] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-15T20:37:04.213670] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-15T20:37:04.213725] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-15T20:37:04.462977] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-15T20:37:04.589860] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T20:37:04.619890] [INFO ] [REMOTE ] TAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:05.257936] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-15T20:37:05.987371] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T20:37:05.993712] [INFO ] [REMOTE ] SYY: Full fetch complete (57528 records). [2025-09-15T20:37:05.993897] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-15T20:37:05.999691] [FATAL] [VALIDATOR ] SYY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:37:05.999871] [FATAL] [MAIN ] SYY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:37:05.999920] [WARN ] [MAIN ] SYY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:37:05.999966] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-15T20:37:06.000054] [DEBUG] [LOCAL ] SYY: No primary data file found to delete. [2025-09-15T20:37:06.000112] [INFO ] [LOCAL ] SYY: Starting deletion of derivative data. [2025-09-15T20:37:06.000392] [DEBUG] [LOCAL ] SYY: Deleted derivative data file. [2025-09-15T20:37:06.000536] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. SYY took 21.5s. Estimated remaining: 34m 45s. Rate: 9.4 symbols/min [2025-09-15T20:37:06.063785] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-15T20:37:06.172535] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:06.209090] [DEBUG] [LOCAL ] TALO: Loaded 38386 existing records from primary storage. [2025-09-15T20:37:06.209259] [INFO ] [MAIN ] TALO: Loaded 38386 existing records. [2025-09-15T20:37:06.384250] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:06.384617] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-15T20:37:06.384693] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-15T20:37:06.385655] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-15T20:37:06.385710] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-15T20:37:06.771958] [INFO ] [REMOTE ] TALO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:06.774086] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-15T20:37:06.857815] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-15T20:37:07.551627] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:37:07.557623] [INFO ] [REMOTE ] T: Full fetch complete (58088 records). [2025-09-15T20:37:07.557804] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-15T20:37:07.558471] [FATAL] [VALIDATOR ] T: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:37:07.558549] [FATAL] [MAIN ] T: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:37:07.558585] [WARN ] [MAIN ] T: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:37:07.558627] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-15T20:37:07.558709] [DEBUG] [LOCAL ] T: No primary data file found to delete. [2025-09-15T20:37:07.558745] [INFO ] [LOCAL ] T: Starting deletion of derivative data. [2025-09-15T20:37:07.559038] [DEBUG] [LOCAL ] T: Deleted derivative data file. [2025-09-15T20:37:07.559145] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. T took 23.1s. Estimated remaining: 34m 38s. Rate: 9.4 symbols/min [2025-09-15T20:37:07.658922] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-15T20:37:07.730875] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:07.775904] [DEBUG] [LOCAL ] TAP: Loaded 39854 existing records from primary storage. [2025-09-15T20:37:07.776076] [INFO ] [MAIN ] TAP: Loaded 39854 existing records. [2025-09-15T20:37:07.953060] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:07.953325] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-15T20:37:07.953371] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-15T20:37:07.954290] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-15T20:37:07.954351] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-15T20:37:08.308326] [INFO ] [REMOTE ] TAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:08.337086] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-15T20:37:08.457821] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-15T20:37:09.127261] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T20:37:09.132871] [INFO ] [REMOTE ] TAK: Full fetch complete (53974 records). [2025-09-15T20:37:09.132988] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-15T20:37:09.272356] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-15T20:37:09.514995] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-15T20:37:09.515088] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-15T20:37:09.516086] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-15T20:37:09.516131] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-15T20:37:09.517276] [DEBUG] [LOCAL ] TAK: Trimmed 53974 records to 37207 (keeping 150 days of data) [2025-09-15T20:37:09.753183] [DEBUG] [LOCAL ] TAK: Primary data saved (37207 records). [2025-09-15T20:37:09.753351] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-15T20:37:09.753481] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. TAK took 25.3s. Estimated remaining: 34m 31s. Rate: 9.4 symbols/min [2025-09-15T20:37:09.925267] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:09.934894] [DEBUG] [LOCAL ] TBB: Loaded 8605 existing records from primary storage. [2025-09-15T20:37:09.935024] [INFO ] [MAIN ] TBB: Loaded 8605 existing records. [2025-09-15T20:37:10.061548] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-15T20:37:10.112606] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:10.112987] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-15T20:37:10.113139] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-15T20:37:10.113534] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-15T20:37:10.113590] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-15T20:37:10.434763] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T20:37:10.534524] [INFO ] [REMOTE ] TBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:10.857885] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-15T20:37:11.093177] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T20:37:11.355216] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T20:37:11.657958] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-15T20:37:12.457882] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-15T20:37:12.599796] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:37:12.787826] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T20:37:13.257863] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-15T20:37:14.037711] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T20:37:14.062950] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-15T20:37:14.078935] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:37:14.857901] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-15T20:37:15.657885] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-15T20:37:15.804961] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T20:37:15.924254] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T20:37:16.457884] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-15T20:37:17.257928] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-15T20:37:17.677243] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T20:37:17.754148] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:37:18.057903] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-15T20:37:18.857899] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-15T20:37:19.057147] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T20:37:19.532084] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:37:19.657950] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-15T20:37:20.372865] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:37:20.457904] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-15T20:37:21.257924] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-15T20:37:21.384622] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T20:37:22.046678] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T20:37:22.057816] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-15T20:37:22.554546] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-15T20:37:22.703278] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T20:37:22.857884] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-15T20:37:23.657878] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-15T20:37:24.457903] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-15T20:37:24.499672] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:37:25.257904] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-15T20:37:25.326670] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T20:37:25.681238] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-15T20:37:26.057902] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-15T20:37:26.777348] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T20:37:26.857927] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-15T20:37:27.351695] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:37:27.657878] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-15T20:37:28.398812] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T20:37:28.457888] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-15T20:37:29.033930] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T20:37:29.040595] [INFO ] [REMOTE ] TAP: Full fetch complete (57460 records). [2025-09-15T20:37:29.040775] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-15T20:37:29.263987] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-15T20:37:29.435773] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-15T20:37:29.435927] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-15T20:37:29.437304] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-15T20:37:29.437381] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-15T20:37:29.439074] [DEBUG] [LOCAL ] TAP: Trimmed 57460 records to 39102 (keeping 150 days of data) [2025-09-15T20:37:29.690213] [DEBUG] [LOCAL ] TAP: Primary data saved (39102 records). [2025-09-15T20:37:29.690369] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-15T20:37:29.690474] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. TAP took 22.1s. Estimated remaining: 34m 27s. Rate: 9.4 symbols/min [2025-09-15T20:37:29.857590] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:29.883954] [DEBUG] [LOCAL ] TBBB: Loaded 26664 existing records from primary storage. [2025-09-15T20:37:29.884094] [INFO ] [MAIN ] TBBB: Loaded 26664 existing records. [2025-09-15T20:37:30.063709] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-15T20:37:30.070368] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:30.072014] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-15T20:37:30.072075] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-15T20:37:30.072795] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-15T20:37:30.072861] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-15T20:37:30.436572] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:30.479519] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-15T20:37:30.501516] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T20:37:30.857933] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-15T20:37:31.498932] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T20:37:31.505145] [INFO ] [REMOTE ] TAL: Full fetch complete (56878 records). [2025-09-15T20:37:31.505295] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-15T20:37:31.661854] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-15T20:37:31.899379] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-15T20:37:31.899535] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-15T20:37:31.900528] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-15T20:37:31.900573] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-15T20:37:31.901761] [DEBUG] [LOCAL ] TAL: Trimmed 56878 records to 38239 (keeping 150 days of data) [2025-09-15T20:37:32.138220] [DEBUG] [LOCAL ] TAL: Primary data saved (38239 records). [2025-09-15T20:37:32.138399] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-15T20:37:32.139540] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TAL took 28.3s. Estimated remaining: 34m 20s. Rate: 9.4 symbols/min [2025-09-15T20:37:32.315140] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:32.348482] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:37:32.371446] [DEBUG] [LOCAL ] TBI: Loaded 16675 existing records from primary storage. [2025-09-15T20:37:32.371585] [INFO ] [MAIN ] TBI: Loaded 16675 existing records. [2025-09-15T20:37:32.463052] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-15T20:37:32.557119] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:37:32.556795] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:32.559371] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-15T20:37:32.559318] [INFO ] [REMOTE ] TBB: Full fetch complete (12390 records). [2025-09-15T20:37:32.559532] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-15T20:37:32.559593] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-15T20:37:32.565259] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-15T20:37:32.604541] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-15T20:37:33.263380] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-15T20:37:33.334611] [INFO ] [REMOTE ] TBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:33.344239] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-15T20:37:33.344295] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-15T20:37:33.344904] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-15T20:37:33.345027] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-15T20:37:33.345619] [DEBUG] [LOCAL ] TBB: Trimmed 12390 records to 8488 (keeping 150 days of data) [2025-09-15T20:37:33.406806] [DEBUG] [LOCAL ] TBB: Primary data saved (8488 records). [2025-09-15T20:37:33.407007] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-15T20:37:33.407144] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TBB took 23.7s. Estimated remaining: 34m 13s. Rate: 9.4 symbols/min [2025-09-15T20:37:33.595939] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:33.596092] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-15T20:37:33.596129] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-15T20:37:33.596247] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-15T20:37:33.596286] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-15T20:37:33.596327] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-15T20:37:33.596369] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-15T20:37:33.947543] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:33.962122] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:37:33.967744] [INFO ] [REMOTE ] TALO: Full fetch complete (55177 records). [2025-09-15T20:37:33.967847] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-15T20:37:34.064727] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-15T20:37:34.351122] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-15T20:37:34.351212] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-15T20:37:34.352217] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-15T20:37:34.352271] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-15T20:37:34.353392] [DEBUG] [LOCAL ] TALO: Trimmed 55177 records to 37607 (keeping 150 days of data) [2025-09-15T20:37:34.581507] [DEBUG] [LOCAL ] TALO: Primary data saved (37607 records). [2025-09-15T20:37:34.581664] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-15T20:37:34.582442] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TALO took 28.6s. Estimated remaining: 34m 6s. Rate: 9.4 symbols/min [2025-09-15T20:37:34.751116] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:34.753104] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T20:37:34.758626] [DEBUG] [LOCAL ] TBN: Loaded 2041 existing records from primary storage. [2025-09-15T20:37:34.758758] [INFO ] [MAIN ] TBN: Loaded 2041 existing records. [2025-09-15T20:37:34.863068] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-15T20:37:34.946834] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:34.947057] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-15T20:37:34.947102] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-15T20:37:34.947432] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-15T20:37:34.947483] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-15T20:37:35.309165] [INFO ] [REMOTE ] TBN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:35.311331] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:37:35.339499] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T20:37:35.657884] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-15T20:37:36.457909] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-15T20:37:36.920562] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T20:37:37.257895] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-15T20:37:37.494240] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:37:38.057884] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-15T20:37:38.493706] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T20:37:38.857900] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-15T20:37:38.901229] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:37:39.657892] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-15T20:37:39.882599] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T20:37:40.231558] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T20:37:40.457927] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-15T20:37:40.870090] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T20:37:41.257879] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-15T20:37:41.889137] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T20:37:42.057920] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-15T20:37:42.857922] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-15T20:37:43.179450] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T20:37:43.426880] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:37:43.657928] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-15T20:37:44.457903] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-15T20:37:44.710432] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T20:37:44.859257] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T20:37:45.257974] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-15T20:37:45.729592] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T20:37:46.057911] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-15T20:37:46.427388] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T20:37:46.857935] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-15T20:37:47.340834] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T20:37:47.657888] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-15T20:37:48.457903] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-15T20:37:48.878982] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T20:37:48.879419] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T20:37:49.257872] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-15T20:37:50.057886] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-15T20:37:50.245685] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T20:37:50.440924] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:37:50.441634] [INFO ] [REMOTE ] TBLU: Full fetch complete (918 records). [2025-09-15T20:37:50.441721] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-15T20:37:50.634824] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T20:37:50.635040] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:37:50.635094] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:37:50.635146] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-15T20:37:50.635212] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-15T20:37:50.635249] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-15T20:37:50.635303] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-15T20:37:50.635418] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TBLU took 17.2s. Estimated remaining: 34m 1s. Rate: 9.4 symbols/min [2025-09-15T20:37:50.801921] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:50.802134] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-15T20:37:50.802174] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-15T20:37:50.802290] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-15T20:37:50.802328] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-15T20:37:50.802368] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-15T20:37:50.802400] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-15T20:37:50.863106] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-15T20:37:51.164753] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:51.491011] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T20:37:51.657941] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-15T20:37:52.152259] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T20:37:52.457882] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-15T20:37:53.104013] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T20:37:53.105238] [INFO ] [REMOTE ] TBN: Full fetch complete (3450 records). [2025-09-15T20:37:53.105310] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-15T20:37:53.257893] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-15T20:37:53.488355] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-15T20:37:53.488456] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-15T20:37:53.488674] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-15T20:37:53.488721] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-15T20:37:53.489134] [DEBUG] [LOCAL ] TBN: Trimmed 3450 records to 2101 (keeping 150 days of data) [2025-09-15T20:37:53.503101] [DEBUG] [LOCAL ] TBN: Primary data saved (2101 records). [2025-09-15T20:37:53.503172] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-15T20:37:53.503257] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TBN took 18.9s. Estimated remaining: 33m 54s. Rate: 9.4 symbols/min [2025-09-15T20:37:53.720409] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:37:53.723373] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:37:53.724284] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-15T20:37:53.778560] [DEBUG] [LOCAL ] TD: Loaded 39289 existing records from primary storage. [2025-09-15T20:37:53.778735] [INFO ] [MAIN ] TD: Loaded 39289 existing records. [2025-09-15T20:37:53.960564] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:37:53.960872] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-15T20:37:53.960922] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-15T20:37:53.961760] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-15T20:37:53.961813] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-15T20:37:54.060611] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-15T20:37:54.319036] [INFO ] [REMOTE ] TD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:37:54.373450] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:37:54.373803] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-15T20:37:54.857869] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-15T20:37:55.180160] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:37:55.180506] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-15T20:37:55.657883] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-15T20:37:55.925560] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:37:55.925947] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-15T20:37:56.457936] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-15T20:37:57.257885] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-15T20:37:57.356213] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T20:37:58.057903] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-15T20:37:58.328303] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T20:37:58.328826] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:37:58.336387] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-15T20:37:58.857883] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-15T20:37:59.657884] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-15T20:38:00.457878] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-15T20:38:00.705269] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T20:38:00.740251] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T20:38:01.257892] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-15T20:38:01.339989] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T20:38:01.342473] [INFO ] [REMOTE ] TBI: Full fetch complete (24732 records). [2025-09-15T20:38:01.342575] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-15T20:38:01.583033] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:38:01.626332] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-15T20:38:01.744795] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-15T20:38:01.744889] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-15T20:38:01.745498] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-15T20:38:01.745539] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-15T20:38:01.746434] [DEBUG] [LOCAL ] TBI: Trimmed 24732 records to 16211 (keeping 150 days of data) [2025-09-15T20:38:01.847494] [DEBUG] [LOCAL ] TBI: Primary data saved (16211 records). [2025-09-15T20:38:01.847680] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-15T20:38:01.847795] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBI took 29.7s. Estimated remaining: 33m 48s. Rate: 9.4 symbols/min [2025-09-15T20:38:02.023068] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:02.063089] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-15T20:38:02.066228] [DEBUG] [LOCAL ] TDC: Loaded 34553 existing records from primary storage. [2025-09-15T20:38:02.066428] [INFO ] [MAIN ] TDC: Loaded 34553 existing records. [2025-09-15T20:38:02.248621] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:02.248928] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-15T20:38:02.248977] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-15T20:38:02.249789] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-15T20:38:02.249841] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-15T20:38:02.612400] [INFO ] [REMOTE ] TDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:02.857884] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-15T20:38:03.500831] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T20:38:03.657877] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-15T20:38:04.419789] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:38:04.457940] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-15T20:38:05.257910] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-15T20:38:05.347681] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T20:38:05.522496] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:38:05.874008] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T20:38:06.057890] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-15T20:38:06.857892] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-15T20:38:07.657909] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-15T20:38:08.139567] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T20:38:08.215028] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T20:38:08.457882] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-15T20:38:08.937793] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T20:38:08.942143] [INFO ] [REMOTE ] TBBB: Full fetch complete (40176 records). [2025-09-15T20:38:08.942248] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-15T20:38:09.269691] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-15T20:38:09.316695] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-15T20:38:09.316781] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-15T20:38:09.317613] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-15T20:38:09.317684] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-15T20:38:09.318557] [DEBUG] [LOCAL ] TBBB: Trimmed 40176 records to 26022 (keeping 150 days of data) [2025-09-15T20:38:09.482424] [DEBUG] [LOCAL ] TBBB: Primary data saved (26022 records). [2025-09-15T20:38:09.482578] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-15T20:38:09.482691] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TBBB took 39.8s. Estimated remaining: 33m 42s. Rate: 9.4 symbols/min [2025-09-15T20:38:09.653756] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:09.660188] [DEBUG] [LOCAL ] TDF: Loaded 4207 existing records from primary storage. [2025-09-15T20:38:09.660319] [INFO ] [MAIN ] TDF: Loaded 4207 existing records. [2025-09-15T20:38:09.846681] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:09.847302] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-15T20:38:09.847361] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-15T20:38:09.847889] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-15T20:38:09.847965] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-15T20:38:10.063125] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T20:38:10.059161] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-15T20:38:10.281013] [INFO ] [REMOTE ] TDF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:10.532309] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T20:38:10.533450] [INFO ] [REMOTE ] TCAI: Full fetch complete (733 records). [2025-09-15T20:38:10.533577] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-15T20:38:10.716128] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 29 unique days, need 150 days [2025-09-15T20:38:10.716420] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:38:10.716473] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:38:10.716556] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-15T20:38:10.716686] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-15T20:38:10.716737] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-15T20:38:10.716789] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-15T20:38:10.716860] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCAI took 20.1s. Estimated remaining: 33m 34s. Rate: 9.4 symbols/min [2025-09-15T20:38:10.861199] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-15T20:38:10.895791] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:10.922703] [DEBUG] [LOCAL ] TDG: Loaded 16298 existing records from primary storage. [2025-09-15T20:38:10.923001] [INFO ] [MAIN ] TDG: Loaded 16298 existing records. [2025-09-15T20:38:11.147525] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T20:38:11.151484] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:11.162876] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-15T20:38:11.162940] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-15T20:38:11.164007] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-15T20:38:11.164070] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-15T20:38:11.521505] [INFO ] [REMOTE ] TDG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:11.657934] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-15T20:38:12.457917] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-15T20:38:12.585128] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T20:38:12.709999] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T20:38:13.257937] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-15T20:38:14.057879] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-15T20:38:14.237656] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T20:38:14.419360] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T20:38:14.857889] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-15T20:38:15.132759] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T20:38:15.657866] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-15T20:38:16.291589] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:38:16.457869] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-15T20:38:16.613162] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T20:38:17.257908] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-15T20:38:17.902002] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:38:18.057867] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-15T20:38:18.378838] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T20:38:18.857898] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-15T20:38:19.585541] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:38:19.591256] [INFO ] [REMOTE ] TDC: Full fetch complete (51559 records). [2025-09-15T20:38:19.591422] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-15T20:38:19.662976] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-15T20:38:19.975494] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-15T20:38:19.975582] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-15T20:38:19.976548] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-15T20:38:19.976603] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-15T20:38:19.977819] [DEBUG] [LOCAL ] TDC: Trimmed 51559 records to 33906 (keeping 150 days of data) [2025-09-15T20:38:20.193315] [DEBUG] [LOCAL ] TDC: Primary data saved (33906 records). [2025-09-15T20:38:20.193567] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-15T20:38:20.193758] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TDC took 18.3s. Estimated remaining: 33m 29s. Rate: 9.4 symbols/min [2025-09-15T20:38:20.388834] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:20.427318] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:38:20.458505] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-15T20:38:20.479466] [DEBUG] [LOCAL ] TDOC: Loaded 40156 existing records from primary storage. [2025-09-15T20:38:20.479673] [INFO ] [MAIN ] TDOC: Loaded 40156 existing records. [2025-09-15T20:38:20.675741] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:20.676089] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-15T20:38:20.676142] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-15T20:38:20.677058] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-15T20:38:20.677114] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-15T20:38:21.053694] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:21.073364] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T20:38:21.257895] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-15T20:38:21.932295] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T20:38:22.057901] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-15T20:38:22.367911] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T20:38:22.690349] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T20:38:22.857925] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-15T20:38:23.657927] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-15T20:38:24.457916] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-15T20:38:24.768003] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:38:24.910887] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T20:38:25.213238] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T20:38:25.257909] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-15T20:38:25.779262] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T20:38:26.057877] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-15T20:38:26.708558] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T20:38:26.857884] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-15T20:38:27.657898] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-15T20:38:27.786261] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T20:38:28.457886] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-15T20:38:29.257907] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-15T20:38:29.591247] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T20:38:29.893286] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T20:38:29.910986] [INFO ] [REMOTE ] TDF: Full fetch complete (7549 records). [2025-09-15T20:38:29.911689] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T20:38:29.911925] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-15T20:38:29.923440] [INFO ] [REMOTE ] TD: Full fetch complete (56871 records). [2025-09-15T20:38:29.999441] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-15T20:38:30.075392] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-15T20:38:30.637329] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-15T20:38:30.637741] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-15T20:38:30.653763] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-15T20:38:30.658979] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-15T20:38:30.688261] [DEBUG] [LOCAL ] TDF: Trimmed 7549 records to 4139 (keeping 150 days of data) [2025-09-15T20:38:30.730106] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-15T20:38:30.740957] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-15T20:38:30.744417] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-15T20:38:30.750983] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-15T20:38:30.758822] [DEBUG] [LOCAL ] TDF: Primary data saved (4139 records). [2025-09-15T20:38:30.760034] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-15T20:38:30.760200] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TDF took 21.3s. Estimated remaining: 33m 23s. Rate: 9.4 symbols/min [2025-09-15T20:38:30.836380] [DEBUG] [LOCAL ] TD: Trimmed 56871 records to 38508 (keeping 150 days of data) [2025-09-15T20:38:30.860195] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-15T20:38:31.036480] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:31.087140] [DEBUG] [LOCAL ] TDS: Loaded 32088 existing records from primary storage. [2025-09-15T20:38:31.091090] [INFO ] [MAIN ] TDS: Loaded 32088 existing records. [2025-09-15T20:38:31.376931] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:31.379341] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-15T20:38:31.380476] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-15T20:38:31.381961] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-15T20:38:31.382559] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-15T20:38:31.771235] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T20:38:31.790566] [DEBUG] [LOCAL ] TD: Primary data saved (38508 records). [2025-09-15T20:38:31.806877] [INFO ] [MAIN ] TD: Full history saved. [2025-09-15T20:38:31.808820] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TD took 38.3s. Estimated remaining: 33m 16s. Rate: 9.4 symbols/min [2025-09-15T20:38:31.815132] [INFO ] [REMOTE ] TDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:31.807915] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-15T20:38:31.987270] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:32.023371] [DEBUG] [LOCAL ] TDW: Loaded 33675 existing records from primary storage. [2025-09-15T20:38:32.023517] [INFO ] [MAIN ] TDW: Loaded 33675 existing records. [2025-09-15T20:38:32.195700] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:32.195912] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-15T20:38:32.195958] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-15T20:38:32.196687] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-15T20:38:32.196744] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-15T20:38:32.465601] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-15T20:38:32.545247] [INFO ] [REMOTE ] TDW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:32.605007] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:38:33.257950] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-15T20:38:33.299357] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:38:34.057931] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-15T20:38:34.418625] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T20:38:34.709439] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:38:34.857892] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-15T20:38:34.925537] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T20:38:34.929181] [INFO ] [REMOTE ] TDG: Full fetch complete (24068 records). [2025-09-15T20:38:34.929265] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-15T20:38:35.310117] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-15T20:38:35.310212] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-15T20:38:35.310837] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-15T20:38:35.310887] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-15T20:38:35.311611] [DEBUG] [LOCAL ] TDG: Trimmed 24068 records to 15959 (keeping 150 days of data) [2025-09-15T20:38:35.420635] [DEBUG] [LOCAL ] TDG: Primary data saved (15959 records). [2025-09-15T20:38:35.420797] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-15T20:38:35.420882] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TDG took 24.7s. Estimated remaining: 33m 9s. Rate: 9.4 symbols/min [2025-09-15T20:38:35.616024] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:35.633394] [DEBUG] [LOCAL ] TDY: Loaded 17017 existing records from primary storage. [2025-09-15T20:38:35.633548] [INFO ] [MAIN ] TDY: Loaded 17017 existing records. [2025-09-15T20:38:35.664250] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-15T20:38:35.815740] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:35.815988] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-15T20:38:35.816035] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-15T20:38:35.816474] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-15T20:38:35.816529] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-15T20:38:36.177881] [INFO ] [REMOTE ] TDY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:36.457903] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-15T20:38:36.617081] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T20:38:37.257989] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-15T20:38:37.413617] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T20:38:38.057877] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-15T20:38:38.463467] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T20:38:38.488370] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T20:38:38.857880] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-15T20:38:39.419837] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T20:38:39.657915] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-15T20:38:40.449735] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:38:40.460414] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-15T20:38:41.158709] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T20:38:41.257971] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-15T20:38:41.622018] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T20:38:42.057885] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-15T20:38:42.857894] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-15T20:38:43.357612] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:38:43.657773] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T20:38:43.657829] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-15T20:38:44.332674] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:38:44.457954] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-15T20:38:45.052275] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T20:38:45.257942] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-15T20:38:46.057977] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-15T20:38:46.357096] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T20:38:46.609583] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:38:46.857882] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-15T20:38:47.128504] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T20:38:47.657927] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-15T20:38:48.457915] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-15T20:38:48.622525] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:38:49.052539] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T20:38:49.058315] [INFO ] [REMOTE ] TDOC: Full fetch complete (58049 records). [2025-09-15T20:38:49.058434] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-15T20:38:49.266507] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-15T20:38:49.443218] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-15T20:38:49.443303] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-15T20:38:49.444378] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-15T20:38:49.444443] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-15T20:38:49.445605] [DEBUG] [LOCAL ] TDOC: Trimmed 58049 records to 39375 (keeping 150 days of data) [2025-09-15T20:38:49.679484] [DEBUG] [LOCAL ] TDOC: Primary data saved (39375 records). [2025-09-15T20:38:49.679673] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-15T20:38:49.681305] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDOC took 29.5s. Estimated remaining: 33m 4s. Rate: 9.4 symbols/min [2025-09-15T20:38:49.852461] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:49.852690] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-15T20:38:49.852740] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-15T20:38:49.852961] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-15T20:38:49.853006] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-15T20:38:49.853123] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-15T20:38:49.853231] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-15T20:38:49.980150] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:38:50.072855] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-15T20:38:50.245486] [INFO ] [REMOTE ] TE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:50.538394] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T20:38:50.857884] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-15T20:38:51.657898] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-15T20:38:51.888232] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T20:38:51.967759] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:38:51.968125] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-15T20:38:52.233779] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:38:52.457879] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-15T20:38:53.257890] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-15T20:38:53.973375] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:38:54.057884] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-15T20:38:54.857920] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-15T20:38:55.657923] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-15T20:38:56.422426] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (3.16 seconds). [2025-09-15T20:38:56.457823] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-15T20:38:56.598012] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:38:56.602449] [INFO ] [REMOTE ] TDS: Full fetch complete (46838 records). [2025-09-15T20:38:56.602529] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-15T20:38:56.786234] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-15T20:38:56.863444] [INFO ] [REMOTE ] TDY: Full fetch complete (24742 records). [2025-09-15T20:38:56.899124] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-15T20:38:57.150126] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-15T20:38:57.213121] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-15T20:38:57.254754] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-15T20:38:57.317903] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-15T20:38:57.408595] [DEBUG] [LOCAL ] TDS: Trimmed 46838 records to 31466 (keeping 150 days of data) [2025-09-15T20:38:57.456363] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-15T20:38:57.456576] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-15T20:38:57.457233] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-15T20:38:57.535995] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-15T20:38:57.617085] [DEBUG] [LOCAL ] TDY: Trimmed 24742 records to 16659 (keeping 150 days of data) [2025-09-15T20:38:57.636491] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T20:38:57.650891] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-15T20:38:57.863812] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T20:38:57.890117] [DEBUG] [LOCAL ] TDY: Primary data saved (16659 records). [2025-09-15T20:38:57.890955] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-15T20:38:57.891443] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TDY took 22.5s. Estimated remaining: 32m 58s. Rate: 9.4 symbols/min [2025-09-15T20:38:58.065374] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-15T20:38:58.183262] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:58.236310] [DEBUG] [LOCAL ] TEAF: Loaded 5161 existing records from primary storage. [2025-09-15T20:38:58.242145] [INFO ] [MAIN ] TEAF: Loaded 5161 existing records. [2025-09-15T20:38:58.489861] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:58.491259] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-15T20:38:58.491947] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-15T20:38:58.493486] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-15T20:38:58.494202] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-15T20:38:58.693573] [DEBUG] [LOCAL ] TDS: Primary data saved (31466 records). [2025-09-15T20:38:58.754203] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-15T20:38:58.780465] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDS took 28.0s. Estimated remaining: 32m 50s. Rate: 9.4 symbols/min [2025-09-15T20:38:59.029310] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:59.050175] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-15T20:38:59.082636] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:38:59.123252] [DEBUG] [LOCAL ] TECK: Loaded 40206 existing records from primary storage. [2025-09-15T20:38:59.123527] [INFO ] [MAIN ] TECK: Loaded 40206 existing records. [2025-09-15T20:38:59.332195] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:38:59.335501] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T20:38:59.335896] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-15T20:38:59.345727] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-15T20:38:59.346961] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-15T20:38:59.347026] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-15T20:38:59.659895] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-15T20:38:59.712492] [INFO ] [REMOTE ] TECK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:38:59.741242] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T20:38:59.756014] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T20:39:00.457934] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-15T20:39:01.257899] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-15T20:39:01.397042] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:39:01.401942] [INFO ] [REMOTE ] TDW: Full fetch complete (49977 records). [2025-09-15T20:39:01.402035] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-15T20:39:01.776498] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-15T20:39:01.776605] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-15T20:39:01.777624] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-15T20:39:01.777689] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-15T20:39:01.778970] [DEBUG] [LOCAL ] TDW: Trimmed 49977 records to 32873 (keeping 150 days of data) [2025-09-15T20:39:01.988207] [DEBUG] [LOCAL ] TDW: Primary data saved (32873 records). [2025-09-15T20:39:01.988376] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-15T20:39:01.988981] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDW took 30.2s. Estimated remaining: 32m 43s. Rate: 9.4 symbols/min [2025-09-15T20:39:02.065962] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-15T20:39:02.163359] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:02.193244] [DEBUG] [LOCAL ] TEF: Loaded 27245 existing records from primary storage. [2025-09-15T20:39:02.193407] [INFO ] [MAIN ] TEF: Loaded 27245 existing records. [2025-09-15T20:39:02.374471] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:02.374815] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-15T20:39:02.374863] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-15T20:39:02.375449] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-15T20:39:02.375496] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-15T20:39:02.758040] [INFO ] [REMOTE ] TEF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:02.766454] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T20:39:02.829699] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-15T20:39:02.841958] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T20:39:02.857820] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-15T20:39:03.657916] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-15T20:39:04.457872] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-15T20:39:05.257956] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-15T20:39:05.759881] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-15T20:39:06.025824] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:39:06.057827] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-15T20:39:06.751449] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T20:39:06.857946] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-15T20:39:06.943266] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (3.29 seconds). [2025-09-15T20:39:06.987106] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T20:39:07.657883] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-15T20:39:08.457922] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-15T20:39:08.768846] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T20:39:09.080287] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:39:09.257874] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-15T20:39:10.057902] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-15T20:39:10.213544] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T20:39:10.676570] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T20:39:10.683447] [INFO ] [REMOTE ] TE: Full fetch complete (44338 records). [2025-09-15T20:39:10.683537] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-15T20:39:10.847456] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:39:10.865244] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-15T20:39:10.883314] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T20:39:10.885615] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:39:10.886179] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:39:10.886298] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-15T20:39:10.886376] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-15T20:39:10.886423] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-15T20:39:10.886476] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-15T20:39:10.886572] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TE took 21.2s. Estimated remaining: 32m 37s. Rate: 9.4 symbols/min [2025-09-15T20:39:11.057617] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:11.076059] [DEBUG] [LOCAL ] TEI: Loaded 15336 existing records from primary storage. [2025-09-15T20:39:11.076188] [INFO ] [MAIN ] TEI: Loaded 15336 existing records. [2025-09-15T20:39:11.271016] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:11.271308] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-15T20:39:11.271355] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-15T20:39:11.271791] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-15T20:39:11.271857] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-15T20:39:11.619817] [INFO ] [REMOTE ] TEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:11.657872] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-15T20:39:12.457895] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-15T20:39:12.585677] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T20:39:12.980154] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T20:39:13.237768] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:39:13.257864] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-15T20:39:14.057934] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-15T20:39:14.857863] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-15T20:39:15.075240] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T20:39:15.117716] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T20:39:15.657872] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-15T20:39:16.223616] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:39:16.457830] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-15T20:39:16.629630] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T20:39:17.257953] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-15T20:39:17.971294] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:39:18.047419] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T20:39:18.057836] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-15T20:39:18.857926] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-15T20:39:19.580861] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T20:39:19.658066] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-15T20:39:20.284026] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T20:39:20.287194] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T20:39:20.289328] [INFO ] [REMOTE ] TEAF: Full fetch complete (7548 records). [2025-09-15T20:39:20.300949] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-15T20:39:20.466071] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-15T20:39:20.686485] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-15T20:39:20.686589] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-15T20:39:20.686899] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-15T20:39:20.686954] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-15T20:39:20.687433] [DEBUG] [LOCAL ] TEAF: Trimmed 7548 records to 4988 (keeping 150 days of data) [2025-09-15T20:39:20.721291] [DEBUG] [LOCAL ] TEAF: Primary data saved (4988 records). [2025-09-15T20:39:20.721446] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-15T20:39:20.721554] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TEAF took 22.8s. Estimated remaining: 32m 32s. Rate: 9.4 symbols/min [2025-09-15T20:39:20.905194] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:20.954706] [DEBUG] [LOCAL ] TEL: Loaded 38555 existing records from primary storage. [2025-09-15T20:39:20.954919] [INFO ] [MAIN ] TEL: Loaded 38555 existing records. [2025-09-15T20:39:21.136109] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:21.136464] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-15T20:39:21.136545] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-15T20:39:21.137581] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-15T20:39:21.137682] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-15T20:39:21.263108] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-15T20:39:21.498060] [INFO ] [REMOTE ] TEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:22.057897] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-15T20:39:22.283103] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T20:39:22.708730] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T20:39:22.785212] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T20:39:22.857901] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-15T20:39:23.657888] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-15T20:39:23.976178] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T20:39:24.457879] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-15T20:39:25.089473] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:39:25.096270] [INFO ] [REMOTE ] TECK: Full fetch complete (58107 records). [2025-09-15T20:39:25.096478] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-15T20:39:25.258362] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-15T20:39:25.434185] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T20:39:25.533685] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-15T20:39:25.533796] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-15T20:39:25.535296] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-15T20:39:25.535349] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-15T20:39:25.537021] [DEBUG] [LOCAL ] TECK: Trimmed 58107 records to 39427 (keeping 150 days of data) [2025-09-15T20:39:25.816578] [DEBUG] [LOCAL ] TECK: Primary data saved (39427 records). [2025-09-15T20:39:25.816851] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-15T20:39:25.817016] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TECK took 27.0s. Estimated remaining: 32m 25s. Rate: 9.4 symbols/min [2025-09-15T20:39:25.999031] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:26.025836] [DEBUG] [LOCAL ] TEN: Loaded 22644 existing records from primary storage. [2025-09-15T20:39:26.026034] [INFO ] [MAIN ] TEN: Loaded 22644 existing records. [2025-09-15T20:39:26.063119] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-15T20:39:26.212473] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:26.212844] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-15T20:39:26.212897] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-15T20:39:26.213472] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-15T20:39:26.213523] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-15T20:39:26.585247] [INFO ] [REMOTE ] TEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:26.858049] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-15T20:39:27.286144] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T20:39:27.664559] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-15T20:39:27.667497] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T20:39:27.867149] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T20:39:28.457868] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-15T20:39:28.822499] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:39:29.257907] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-15T20:39:29.754636] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T20:39:30.057919] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-15T20:39:30.857864] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-15T20:39:30.984023] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:39:31.476353] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T20:39:31.482654] [INFO ] [REMOTE ] TEF: Full fetch complete (40727 records). [2025-09-15T20:39:31.482884] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-15T20:39:31.663053] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-15T20:39:31.913706] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-15T20:39:31.913849] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-15T20:39:31.915312] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-15T20:39:31.915376] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-15T20:39:31.916797] [DEBUG] [LOCAL ] TEF: Trimmed 40727 records to 26600 (keeping 150 days of data) [2025-09-15T20:39:32.029696] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:39:32.059742] [INFO ] [REMOTE ] TEI: Full fetch complete (22261 records). [2025-09-15T20:39:32.067775] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-15T20:39:32.231796] [DEBUG] [LOCAL ] TEF: Primary data saved (26600 records). [2025-09-15T20:39:32.237756] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-15T20:39:32.243109] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TEF took 30.3s. Estimated remaining: 32m 19s. Rate: 9.4 symbols/min [2025-09-15T20:39:32.460148] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-15T20:39:32.603932] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:32.691604] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-15T20:39:32.691716] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-15T20:39:32.692270] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-15T20:39:32.692377] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-15T20:39:32.693662] [DEBUG] [LOCAL ] TEI: Trimmed 22261 records to 14972 (keeping 150 days of data) [2025-09-15T20:39:32.701052] [DEBUG] [LOCAL ] TEO: Loaded 16351 existing records from primary storage. [2025-09-15T20:39:32.701203] [INFO ] [MAIN ] TEO: Loaded 16351 existing records. [2025-09-15T20:39:32.973203] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:32.974519] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-15T20:39:32.974884] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-15T20:39:32.975920] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-15T20:39:32.976296] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-15T20:39:33.178481] [DEBUG] [LOCAL ] TEI: Primary data saved (14972 records). [2025-09-15T20:39:33.219103] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-15T20:39:33.225984] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TEI took 22.3s. Estimated remaining: 32m 11s. Rate: 9.4 symbols/min [2025-09-15T20:39:33.492784] [INFO ] [REMOTE ] TEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:33.524580] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-15T20:39:33.560020] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:33.589859] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:39:33.634891] [DEBUG] [LOCAL ] TEVA: Loaded 40377 existing records from primary storage. [2025-09-15T20:39:33.635058] [INFO ] [MAIN ] TEVA: Loaded 40377 existing records. [2025-09-15T20:39:33.811506] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:33.811817] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-15T20:39:33.811866] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-15T20:39:33.812698] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-15T20:39:33.812964] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-15T20:39:34.063968] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-15T20:39:34.176969] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:34.265427] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T20:39:34.491317] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T20:39:34.857918] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-15T20:39:35.062938] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T20:39:35.657870] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-15T20:39:36.457945] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-15T20:39:36.522781] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T20:39:36.905236] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T20:39:37.257839] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-15T20:39:37.289047] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T20:39:38.057905] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-15T20:39:38.745319] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T20:39:38.857877] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-15T20:39:39.657857] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-15T20:39:39.854387] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T20:39:39.893364] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T20:39:40.457898] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-15T20:39:41.000504] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T20:39:41.257903] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-15T20:39:41.526495] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T20:39:42.057890] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-15T20:39:42.858221] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-15T20:39:43.245985] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:39:43.250340] [INFO ] [REMOTE ] TEN: Full fetch complete (33656 records). [2025-09-15T20:39:43.250429] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-15T20:39:43.619036] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-15T20:39:43.619160] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-15T20:39:43.619973] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-15T20:39:43.620133] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-15T20:39:43.621223] [DEBUG] [LOCAL ] TEN: Trimmed 33656 records to 22238 (keeping 150 days of data) [2025-09-15T20:39:43.687123] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-15T20:39:43.753527] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-15T20:39:43.813696] [DEBUG] [LOCAL ] TEN: Primary data saved (22238 records). [2025-09-15T20:39:43.813834] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-15T20:39:43.813937] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEN took 18.0s. Estimated remaining: 32m 6s. Rate: 9.4 symbols/min [2025-09-15T20:39:43.983982] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:43.998234] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T20:39:44.034474] [DEBUG] [LOCAL ] TEX: Loaded 33110 existing records from primary storage. [2025-09-15T20:39:44.034674] [INFO ] [MAIN ] TEX: Loaded 33110 existing records. [2025-09-15T20:39:44.207066] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:44.207347] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-15T20:39:44.207393] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-15T20:39:44.208083] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-15T20:39:44.208131] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-15T20:39:44.464399] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-15T20:39:44.567081] [INFO ] [REMOTE ] TEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:45.257855] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-15T20:39:45.375059] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T20:39:46.057836] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-15T20:39:46.227905] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T20:39:46.585238] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:39:46.857836] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-15T20:39:47.172499] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:39:47.657878] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-15T20:39:48.457899] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-15T20:39:48.686812] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:39:48.764786] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T20:39:49.257887] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-15T20:39:50.057908] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-15T20:39:50.364497] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T20:39:50.486612] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T20:39:50.857947] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-15T20:39:51.657859] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-15T20:39:51.716087] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T20:39:51.989937] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T20:39:51.993899] [INFO ] [REMOTE ] TEO: Full fetch complete (23584 records). [2025-09-15T20:39:51.994030] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-15T20:39:52.364217] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-15T20:39:52.364301] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-15T20:39:52.364898] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-15T20:39:52.364949] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-15T20:39:52.365684] [DEBUG] [LOCAL ] TEO: Trimmed 23584 records to 16169 (keeping 150 days of data) [2025-09-15T20:39:52.460509] [DEBUG] [LOCAL ] TEO: Primary data saved (16169 records). [2025-09-15T20:39:52.460630] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-15T20:39:52.461941] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-15T20:39:52.462105] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEO took 20.2s. Estimated remaining: 31m 60s. Rate: 9.4 symbols/min [2025-09-15T20:39:52.635000] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:52.676754] [DEBUG] [LOCAL ] TFC: Loaded 40407 existing records from primary storage. [2025-09-15T20:39:52.676904] [INFO ] [MAIN ] TFC: Loaded 40407 existing records. [2025-09-15T20:39:52.854664] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:52.854903] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-15T20:39:52.854948] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-15T20:39:52.855871] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-15T20:39:52.855945] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-15T20:39:53.212783] [INFO ] [REMOTE ] TFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:53.257830] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-15T20:39:53.398795] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T20:39:54.046004] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:39:54.057809] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-15T20:39:54.619570] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T20:39:54.857923] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-15T20:39:55.158340] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T20:39:55.657909] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-15T20:39:56.457949] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-15T20:39:56.840988] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T20:39:56.982026] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T20:39:56.988140] [INFO ] [REMOTE ] TEL: Full fetch complete (55272 records). [2025-09-15T20:39:56.988374] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-15T20:39:56.989512] [FATAL] [VALIDATOR ] TEL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:39:56.989765] [FATAL] [MAIN ] TEL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:39:56.989867] [WARN ] [MAIN ] TEL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:39:56.990020] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-15T20:39:56.990111] [DEBUG] [LOCAL ] TEL: No primary data file found to delete. [2025-09-15T20:39:56.990233] [INFO ] [LOCAL ] TEL: Starting deletion of derivative data. [2025-09-15T20:39:56.990628] [DEBUG] [LOCAL ] TEL: Deleted derivative data file. [2025-09-15T20:39:56.992953] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEL took 36.3s. Estimated remaining: 31m 53s. Rate: 9.4 symbols/min [2025-09-15T20:39:57.178156] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:39:57.207659] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:39:57.236514] [DEBUG] [LOCAL ] TFII: Loaded 24515 existing records from primary storage. [2025-09-15T20:39:57.236693] [INFO ] [MAIN ] TFII: Loaded 24515 existing records. [2025-09-15T20:39:57.266075] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-15T20:39:57.419083] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:39:57.419371] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-15T20:39:57.419418] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-15T20:39:57.420045] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-15T20:39:57.420095] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-15T20:39:57.791242] [INFO ] [REMOTE ] TFII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:39:58.057894] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-15T20:39:58.857886] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-15T20:39:59.187471] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T20:39:59.657915] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-15T20:39:59.698957] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:40:00.457911] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-15T20:40:01.258002] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-15T20:40:01.259613] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T20:40:01.338995] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T20:40:02.057886] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-15T20:40:02.310409] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T20:40:02.496202] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T20:40:02.501045] [INFO ] [REMOTE ] TEX: Full fetch complete (49125 records). [2025-09-15T20:40:02.501198] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-15T20:40:02.872751] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-15T20:40:02.891605] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-15T20:40:02.891739] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-15T20:40:02.892794] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-15T20:40:02.892979] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-15T20:40:02.894343] [DEBUG] [LOCAL ] TEX: Trimmed 49125 records to 32427 (keeping 150 days of data) [2025-09-15T20:40:03.106157] [DEBUG] [LOCAL ] TEX: Primary data saved (32427 records). [2025-09-15T20:40:03.106324] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-15T20:40:03.106434] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEX took 19.3s. Estimated remaining: 31m 47s. Rate: 9.4 symbols/min [2025-09-15T20:40:03.272667] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:03.292760] [DEBUG] [LOCAL ] TFIN: Loaded 17488 existing records from primary storage. [2025-09-15T20:40:03.292893] [INFO ] [MAIN ] TFIN: Loaded 17488 existing records. [2025-09-15T20:40:03.466507] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:03.466798] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-15T20:40:03.466848] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-15T20:40:03.467277] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-15T20:40:03.467324] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-15T20:40:03.673048] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-15T20:40:03.817896] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:04.365110] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-15T20:40:04.457819] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-15T20:40:04.703164] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:40:05.257918] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-15T20:40:05.486108] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:40:06.057929] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-15T20:40:06.201341] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:40:06.207698] [INFO ] [REMOTE ] TEVA: Full fetch complete (58307 records). [2025-09-15T20:40:06.207870] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-15T20:40:06.303624] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T20:40:06.620231] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-15T20:40:06.620374] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-15T20:40:06.621576] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-15T20:40:06.621658] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-15T20:40:06.623145] [DEBUG] [LOCAL ] TEVA: Trimmed 58307 records to 39597 (keeping 150 days of data) [2025-09-15T20:40:06.858709] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-15T20:40:06.875143] [DEBUG] [LOCAL ] TEVA: Primary data saved (39597 records). [2025-09-15T20:40:06.875270] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-15T20:40:06.875367] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TEVA took 33.6s. Estimated remaining: 31m 40s. Rate: 9.4 symbols/min [2025-09-15T20:40:07.048961] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:07.078101] [DEBUG] [LOCAL ] TFPM: Loaded 28963 existing records from primary storage. [2025-09-15T20:40:07.078244] [INFO ] [MAIN ] TFPM: Loaded 28963 existing records. [2025-09-15T20:40:07.255530] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:07.255839] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-15T20:40:07.255901] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-15T20:40:07.256536] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-15T20:40:07.256595] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-15T20:40:07.605150] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:07.657824] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-15T20:40:07.719435] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T20:40:07.743293] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:40:08.457876] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-15T20:40:09.190285] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T20:40:09.257876] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-15T20:40:09.909077] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:40:10.057829] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-15T20:40:10.355144] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T20:40:10.857899] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-15T20:40:11.205562] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T20:40:11.657875] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-15T20:40:11.898687] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T20:40:12.457873] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-15T20:40:12.801394] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T20:40:13.257874] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-15T20:40:14.049833] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T20:40:14.060504] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-15T20:40:14.869730] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-15T20:40:14.876361] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:40:15.155313] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T20:40:15.657881] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-15T20:40:15.811427] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:40:16.457892] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-15T20:40:16.946256] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T20:40:17.257911] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-15T20:40:17.845826] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T20:40:18.057906] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-15T20:40:18.726534] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:40:18.857874] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-15T20:40:19.328089] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T20:40:19.657884] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-15T20:40:20.160619] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T20:40:20.457888] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-15T20:40:21.202481] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T20:40:21.257823] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-15T20:40:21.941623] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T20:40:22.057903] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-15T20:40:22.415961] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:40:22.857921] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-15T20:40:22.953969] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:40:22.959400] [INFO ] [REMOTE ] TFC: Full fetch complete (57954 records). [2025-09-15T20:40:22.959508] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-15T20:40:22.960266] [FATAL] [VALIDATOR ] TFC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:40:22.960350] [FATAL] [MAIN ] TFC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:40:22.960386] [WARN ] [MAIN ] TFC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:40:22.960423] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-15T20:40:22.960481] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-09-15T20:40:22.960517] [INFO ] [LOCAL ] TFC: Starting deletion of derivative data. [2025-09-15T20:40:22.960886] [DEBUG] [LOCAL ] TFC: Deleted derivative data file. [2025-09-15T20:40:22.961504] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TFC took 30.5s. Estimated remaining: 31m 35s. Rate: 9.4 symbols/min [2025-09-15T20:40:23.130586] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:23.159435] [DEBUG] [LOCAL ] TFX: Loaded 26318 existing records from primary storage. [2025-09-15T20:40:23.159579] [INFO ] [MAIN ] TFX: Loaded 26318 existing records. [2025-09-15T20:40:23.348707] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:23.349022] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-15T20:40:23.349089] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-15T20:40:23.349982] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-15T20:40:23.350059] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-15T20:40:23.662962] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-15T20:40:23.718306] [INFO ] [REMOTE ] TFX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:24.154497] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:40:24.159525] [INFO ] [REMOTE ] TFPM: Full fetch complete (39653 records). [2025-09-15T20:40:24.159657] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-15T20:40:24.463363] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-15T20:40:24.555446] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-15T20:40:24.555587] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-15T20:40:24.556540] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-15T20:40:24.556598] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-15T20:40:24.566672] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:40:24.569945] [DEBUG] [LOCAL ] TFPM: Trimmed 39653 records to 28581 (keeping 150 days of data) [2025-09-15T20:40:24.570908] [INFO ] [REMOTE ] TFII: Full fetch complete (38170 records). [2025-09-15T20:40:24.571006] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-15T20:40:25.066414] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-15T20:40:25.067716] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-15T20:40:25.071499] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-15T20:40:25.071565] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-15T20:40:25.081291] [DEBUG] [LOCAL ] TFII: Trimmed 38170 records to 23810 (keeping 150 days of data) [2025-09-15T20:40:25.228826] [DEBUG] [LOCAL ] TFPM: Primary data saved (28581 records). [2025-09-15T20:40:25.229435] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-15T20:40:25.229989] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFPM took 18.4s. Estimated remaining: 31m 28s. Rate: 9.4 symbols/min [2025-09-15T20:40:25.262222] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-15T20:40:25.416095] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:25.439005] [DEBUG] [LOCAL ] TG: Loaded 7504 existing records from primary storage. [2025-09-15T20:40:25.442795] [INFO ] [MAIN ] TG: Loaded 7504 existing records. [2025-09-15T20:40:25.645817] [DEBUG] [LOCAL ] TFII: Primary data saved (23810 records). [2025-09-15T20:40:25.646075] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-15T20:40:25.645937] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:25.646285] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TFII took 28.7s. Estimated remaining: 31m 21s. Rate: 9.4 symbols/min [2025-09-15T20:40:25.646364] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-15T20:40:25.657487] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-15T20:40:25.709627] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-15T20:40:25.720879] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-15T20:40:25.942983] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:25.988377] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-15T20:40:26.023723] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-15T20:40:26.102016] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-15T20:40:26.112921] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-15T20:40:26.146780] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-15T20:40:26.186801] [INFO ] [REMOTE ] TG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:26.181135] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-15T20:40:26.187852] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-15T20:40:26.361509] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T20:40:26.598535] [INFO ] [REMOTE ] TGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:26.734313] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T20:40:26.857830] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-15T20:40:27.039939] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T20:40:27.657880] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-15T20:40:28.336438] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T20:40:28.457869] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-15T20:40:28.729382] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T20:40:28.732496] [INFO ] [REMOTE ] TFIN: Full fetch complete (25237 records). [2025-09-15T20:40:28.732605] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-15T20:40:29.101431] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-15T20:40:29.101523] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-15T20:40:29.102493] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-15T20:40:29.102563] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-15T20:40:29.103369] [DEBUG] [LOCAL ] TFIN: Trimmed 25237 records to 17017 (keeping 150 days of data) [2025-09-15T20:40:29.211058] [DEBUG] [LOCAL ] TFIN: Primary data saved (17017 records). [2025-09-15T20:40:29.211231] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-15T20:40:29.211350] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TFIN took 26.1s. Estimated remaining: 31m 14s. Rate: 9.4 symbols/min [2025-09-15T20:40:29.263089] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-15T20:40:29.394420] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:29.415393] [DEBUG] [LOCAL ] TGLS: Loaded 20497 existing records from primary storage. [2025-09-15T20:40:29.415568] [INFO ] [MAIN ] TGLS: Loaded 20497 existing records. [2025-09-15T20:40:29.618965] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:40:29.619076] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:29.619495] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-15T20:40:29.619467] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-15T20:40:29.619619] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-15T20:40:29.620426] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-15T20:40:29.620479] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-15T20:40:29.966969] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:30.057840] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-15T20:40:30.316008] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T20:40:30.857887] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-15T20:40:31.261779] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T20:40:31.406825] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T20:40:31.657920] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-15T20:40:32.457937] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-15T20:40:33.265499] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-15T20:40:33.270228] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:40:33.407909] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T20:40:33.523202] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:40:33.523605] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-15T20:40:34.057912] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-15T20:40:34.348066] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:40:34.348460] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-15T20:40:34.857914] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-15T20:40:35.113748] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:40:35.114202] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-15T20:40:35.657892] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-15T20:40:36.457909] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-15T20:40:37.076473] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T20:40:37.257869] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-15T20:40:37.522112] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T20:40:38.057930] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-15T20:40:38.784427] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T20:40:38.857885] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-15T20:40:39.317484] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T20:40:39.657916] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-15T20:40:40.213549] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:40:40.457912] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-15T20:40:40.918974] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T20:40:41.257894] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-15T20:40:41.399185] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T20:40:42.057963] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-15T20:40:42.603980] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:40:42.649905] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T20:40:42.857883] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-15T20:40:43.657956] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-15T20:40:43.677260] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T20:40:44.457934] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-15T20:40:44.715443] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:40:45.257921] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-15T20:40:45.290563] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T20:40:46.057923] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-15T20:40:46.473209] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T20:40:46.857872] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-15T20:40:47.392815] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T20:40:47.657886] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-15T20:40:48.292006] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T20:40:48.457921] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-15T20:40:49.091868] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:40:49.097385] [INFO ] [REMOTE ] TFX: Full fetch complete (41394 records). [2025-09-15T20:40:49.097578] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-15T20:40:49.258540] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-15T20:40:49.476200] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-15T20:40:49.476299] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-15T20:40:49.477289] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-15T20:40:49.477337] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-15T20:40:49.478525] [DEBUG] [LOCAL ] TFX: Trimmed 41394 records to 25923 (keeping 150 days of data) [2025-09-15T20:40:49.618758] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T20:40:49.665772] [DEBUG] [LOCAL ] TFX: Primary data saved (25923 records). [2025-09-15T20:40:49.665924] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-15T20:40:49.666040] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TFX took 26.7s. Estimated remaining: 31m 10s. Rate: 9.4 symbols/min [2025-09-15T20:40:49.834843] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:40:49.871583] [DEBUG] [LOCAL ] TGNA: Loaded 36312 existing records from primary storage. [2025-09-15T20:40:49.871755] [INFO ] [MAIN ] TGNA: Loaded 36312 existing records. [2025-09-15T20:40:50.047035] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:40:50.047307] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-15T20:40:50.047355] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-15T20:40:50.048204] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-15T20:40:50.048260] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-15T20:40:50.068344] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-15T20:40:50.404987] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:40:50.446866] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:40:50.450209] [INFO ] [REMOTE ] TGLS: Full fetch complete (30893 records). [2025-09-15T20:40:50.450316] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-15T20:40:50.774188] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:40:50.805750] [INFO ] [REMOTE ] TGE: Full fetch complete (7485 records). [2025-09-15T20:40:50.814719] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-15T20:40:50.867819] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-15T20:40:50.864054] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-15T20:40:50.888407] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-15T20:40:50.901899] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-15T20:40:50.902118] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-15T20:40:50.953592] [DEBUG] [LOCAL ] TGLS: Trimmed 30893 records to 19996 (keeping 150 days of data) [2025-09-15T20:40:51.162738] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 70 unique days, need 150 days [2025-09-15T20:40:51.163549] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:40:51.167523] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:40:51.171754] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-15T20:40:51.175139] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-15T20:40:51.176800] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-15T20:40:51.180676] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-15T20:40:51.186951] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TGE took 25.5s. Estimated remaining: 31m 2s. Rate: 9.4 symbols/min [2025-09-15T20:40:51.200173] [DEBUG] [LOCAL ] TGLS: Primary data saved (19996 records). [2025-09-15T20:40:51.200348] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-15T20:40:51.200451] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TGLS took 22.0s. Estimated remaining: 30m 55s. Rate: 9.4 symbols/min [2025-09-15T20:40:51.657878] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-15T20:40:52.513358] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T20:40:52.515483] [INFO ] [REMOTE ] TG: Full fetch complete (11041 records). [2025-09-15T20:40:52.515583] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-15T20:40:52.769980] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T20:40:52.821149] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-15T20:40:52.933101] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-15T20:40:52.933204] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-15T20:40:52.933497] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-15T20:40:52.933560] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-15T20:40:52.934092] [DEBUG] [LOCAL ] TG: Trimmed 11041 records to 7330 (keeping 150 days of data) [2025-09-15T20:40:52.976636] [DEBUG] [LOCAL ] TG: Primary data saved (7330 records). [2025-09-15T20:40:52.976795] [INFO ] [MAIN ] TG: Full history saved. [2025-09-15T20:40:52.976887] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TG took 27.7s. Estimated remaining: 30m 48s. Rate: 9.4 symbols/min [2025-09-15T20:40:54.457365] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T20:40:54.467826] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-15T20:40:55.975446] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T20:40:55.986455] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-15T20:40:57.717021] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T20:40:57.727207] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-15T20:40:59.494560] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T20:40:59.504507] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-15T20:41:00.992184] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T20:41:01.002733] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-15T20:41:02.914608] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T20:41:02.925854] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-15T20:41:04.391206] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T20:41:04.396829] [INFO ] [REMOTE ] TGNA: Full fetch complete (52840 records). [2025-09-15T20:41:04.396966] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-15T20:41:04.788156] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-15T20:41:04.788257] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-15T20:41:04.789419] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-15T20:41:04.789487] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-15T20:41:04.790875] [DEBUG] [LOCAL ] TGNA: Trimmed 52840 records to 35556 (keeping 150 days of data) [2025-09-15T20:41:05.020006] [DEBUG] [LOCAL ] TGNA: Primary data saved (35556 records). [2025-09-15T20:41:05.020164] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-15T20:41:05.020616] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 15.4s. Estimated remaining: 30m 43s. Rate: 9.4 symbols/min [2025-09-15T20:41:05.628739] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:05.726229] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:05.722766] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:05.730119] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:05.760459] [DEBUG] [LOCAL ] THG: Loaded 16010 existing records from primary storage. [2025-09-15T20:41:05.760605] [INFO ] [MAIN ] THG: Loaded 16010 existing records. [2025-09-15T20:41:05.849708] [DEBUG] [LOCAL ] TGS: Loaded 24046 existing records from primary storage. [2025-09-15T20:41:05.849996] [INFO ] [MAIN ] TGS: Loaded 24046 existing records. [2025-09-15T20:41:05.988101] [DEBUG] [LOCAL ] THC: Loaded 36123 existing records from primary storage. [2025-09-15T20:41:05.994028] [DEBUG] [LOCAL ] TGT: Loaded 40518 existing records from primary storage. [2025-09-15T20:41:06.004612] [INFO ] [MAIN ] THC: Loaded 36123 existing records. [2025-09-15T20:41:06.025373] [INFO ] [MAIN ] TGT: Loaded 40518 existing records. [2025-09-15T20:41:06.236700] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:06.405735] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:06.411336] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-15T20:41:06.432345] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-15T20:41:06.507845] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:06.521458] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-15T20:41:06.551951] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-15T20:41:06.559375] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-15T20:41:06.559573] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:06.559436] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-15T20:41:06.551687] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-15T20:41:06.559967] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-15T20:41:06.560066] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-15T20:41:06.560162] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-15T20:41:06.566085] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-15T20:41:06.571822] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-15T20:41:06.566005] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-15T20:41:06.572146] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-15T20:41:06.571998] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-15T20:41:06.582482] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-15T20:41:07.830001] [INFO ] [REMOTE ] THC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:07.833156] [INFO ] [REMOTE ] THG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:07.833604] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-15T20:41:07.884224] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-15T20:41:07.941238] [INFO ] [REMOTE ] TGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:07.952561] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-15T20:41:08.008760] [INFO ] [REMOTE ] TGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:08.009364] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-15T20:41:09.126272] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T20:41:09.131277] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-15T20:41:09.333727] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:41:09.343499] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-15T20:41:09.457524] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T20:41:09.464091] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-15T20:41:09.502728] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T20:41:09.513260] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-15T20:41:09.949577] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T20:41:09.955159] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-15T20:41:10.971746] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:41:10.982158] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-15T20:41:11.078122] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:41:11.089255] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-15T20:41:11.111668] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T20:41:11.118477] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-15T20:41:11.586712] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-15T20:41:11.598182] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-15T20:41:11.910404] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T20:41:11.917395] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-15T20:41:12.329628] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T20:41:12.334626] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-15T20:41:12.529718] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T20:41:12.540448] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-15T20:41:12.897543] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T20:41:12.904843] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-15T20:41:13.409694] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T20:41:13.414550] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-15T20:41:13.526783] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:41:13.538120] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-15T20:41:14.059781] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T20:41:14.070919] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-15T20:41:14.251042] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:41:14.257972] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-15T20:41:14.273670] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T20:41:14.857931] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-15T20:41:15.342540] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T20:41:15.657897] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-15T20:41:15.691312] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T20:41:15.824060] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T20:41:16.014632] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T20:41:16.457958] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-15T20:41:16.651207] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:41:17.257938] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-15T20:41:18.023514] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:41:18.026055] [INFO ] [REMOTE ] THG: Full fetch complete (24045 records). [2025-09-15T20:41:18.026129] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-15T20:41:18.062996] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-15T20:41:18.398474] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-15T20:41:18.398624] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-15T20:41:18.399147] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-15T20:41:18.399252] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-15T20:41:18.400195] [DEBUG] [LOCAL ] THG: Trimmed 24045 records to 15468 (keeping 150 days of data) [2025-09-15T20:41:18.528857] [DEBUG] [LOCAL ] THG: Primary data saved (15468 records). [2025-09-15T20:41:18.529013] [INFO ] [MAIN ] THG: Full history saved. [2025-09-15T20:41:18.529268] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. THG took 13.5s. Estimated remaining: 30m 37s. Rate: 9.4 symbols/min [2025-09-15T20:41:18.530733] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T20:41:18.713291] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:18.716785] [DEBUG] [LOCAL ] THIR: Loaded 1798 existing records from primary storage. [2025-09-15T20:41:18.716862] [INFO ] [MAIN ] THIR: Loaded 1798 existing records. [2025-09-15T20:41:18.863035] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-15T20:41:18.899349] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:18.899658] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-15T20:41:18.899708] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-15T20:41:18.899942] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-15T20:41:18.899989] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-15T20:41:19.248405] [INFO ] [REMOTE ] THIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:19.657887] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-15T20:41:19.829351] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T20:41:19.898027] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T20:41:19.902778] [INFO ] [REMOTE ] TGS: Full fetch complete (35079 records). [2025-09-15T20:41:19.902869] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-15T20:41:20.284046] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-15T20:41:20.284128] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-15T20:41:20.284921] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-15T20:41:20.284969] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-15T20:41:20.285896] [DEBUG] [LOCAL ] TGS: Trimmed 35079 records to 23657 (keeping 150 days of data) [2025-09-15T20:41:20.448926] [DEBUG] [LOCAL ] TGS: Primary data saved (23657 records). [2025-09-15T20:41:20.449158] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-15T20:41:20.449280] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. TGS took 15.4s. Estimated remaining: 30m 30s. Rate: 9.4 symbols/min [2025-09-15T20:41:20.463120] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-15T20:41:20.665701] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:20.668742] [DEBUG] [LOCAL ] THLV: Loaded 1122 existing records from primary storage. [2025-09-15T20:41:20.668837] [INFO ] [MAIN ] THLV: Loaded 1122 existing records. [2025-09-15T20:41:20.884809] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:20.885106] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-15T20:41:20.885154] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-15T20:41:20.885349] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-15T20:41:20.885393] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-15T20:41:21.056761] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T20:41:21.245737] [INFO ] [REMOTE ] THLV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:21.257830] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-15T20:41:21.761988] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T20:41:21.848183] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T20:41:22.057877] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-15T20:41:22.563301] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T20:41:22.857877] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-15T20:41:23.341308] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T20:41:23.657936] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-15T20:41:24.074306] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T20:41:24.457949] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-15T20:41:25.005326] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T20:41:25.257905] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-15T20:41:26.057950] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-15T20:41:26.502476] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T20:41:26.635839] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T20:41:26.857883] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-15T20:41:27.657896] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-15T20:41:28.211231] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T20:41:28.316254] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:41:28.321505] [INFO ] [REMOTE ] THC: Full fetch complete (52932 records). [2025-09-15T20:41:28.321634] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-15T20:41:28.466439] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-15T20:41:28.718022] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-15T20:41:28.718112] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-15T20:41:28.719180] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-15T20:41:28.719248] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-15T20:41:28.721659] [DEBUG] [LOCAL ] THC: Trimmed 52932 records to 35461 (keeping 150 days of data) [2025-09-15T20:41:28.960902] [DEBUG] [LOCAL ] THC: Primary data saved (35461 records). [2025-09-15T20:41:28.961281] [INFO ] [MAIN ] THC: Full history saved. [2025-09-15T20:41:28.961401] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. THC took 23.9s. Estimated remaining: 30m 24s. Rate: 9.4 symbols/min [2025-09-15T20:41:29.067659] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T20:41:29.137231] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:29.173104] [DEBUG] [LOCAL ] THO: Loaded 30981 existing records from primary storage. [2025-09-15T20:41:29.173247] [INFO ] [MAIN ] THO: Loaded 30981 existing records. [2025-09-15T20:41:29.263068] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-15T20:41:29.352150] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:29.352495] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-15T20:41:29.352543] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-15T20:41:29.353186] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-15T20:41:29.353239] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-15T20:41:29.704770] [INFO ] [REMOTE ] THO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:30.057877] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-15T20:41:30.579401] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T20:41:30.857885] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-15T20:41:31.204332] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T20:41:31.657877] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-15T20:41:32.009148] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T20:41:32.457913] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-15T20:41:32.880095] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T20:41:33.257871] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-15T20:41:33.679094] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-15T20:41:33.686228] [INFO ] [REMOTE ] TGT: Full fetch complete (58458 records). [2025-09-15T20:41:33.686426] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-15T20:41:33.972577] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T20:41:34.069168] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-15T20:41:34.072256] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-15T20:41:34.073367] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-15T20:41:34.074367] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-15T20:41:34.074491] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-15T20:41:34.076326] [DEBUG] [LOCAL ] TGT: Trimmed 58458 records to 39738 (keeping 150 days of data) [2025-09-15T20:41:34.338913] [DEBUG] [LOCAL ] TGT: Primary data saved (39738 records). [2025-09-15T20:41:34.339126] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-15T20:41:34.339261] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. TGT took 29.3s. Estimated remaining: 30m 18s. Rate: 9.4 symbols/min [2025-09-15T20:41:34.506064] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:34.527297] [DEBUG] [LOCAL ] THQ: Loaded 19489 existing records from primary storage. [2025-09-15T20:41:34.527434] [INFO ] [MAIN ] THQ: Loaded 19489 existing records. [2025-09-15T20:41:34.612609] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T20:41:34.633624] [INFO ] [REMOTE ] THIR: Full fetch complete (2200 records). [2025-09-15T20:41:34.636488] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-15T20:41:34.842560] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:34.862573] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-15T20:41:34.897612] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-15T20:41:34.939104] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-15T20:41:34.972134] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-15T20:41:34.983558] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-15T20:41:35.240697] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-15T20:41:35.255779] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-15T20:41:35.257740] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-15T20:41:35.257853] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-15T20:41:35.283775] [DEBUG] [LOCAL ] THIR: Trimmed 2200 records to 1775 (keeping 150 days of data) [2025-09-15T20:41:35.415684] [DEBUG] [LOCAL ] THIR: Primary data saved (1775 records). [2025-09-15T20:41:35.439007] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-15T20:41:35.448797] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. THIR took 16.9s. Estimated remaining: 30m 11s. Rate: 9.4 symbols/min [2025-09-15T20:41:35.539376] [INFO ] [REMOTE ] THQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:35.663183] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-15T20:41:35.666477] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:35.685454] [DEBUG] [LOCAL ] THR: Loaded 14571 existing records from primary storage. [2025-09-15T20:41:35.685605] [INFO ] [MAIN ] THR: Loaded 14571 existing records. [2025-09-15T20:41:35.862753] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:35.863054] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-15T20:41:35.863112] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-15T20:41:35.863629] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-15T20:41:35.863728] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-15T20:41:36.153375] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T20:41:36.224702] [INFO ] [REMOTE ] THR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:36.457866] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-15T20:41:36.514211] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T20:41:37.257890] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-15T20:41:37.486098] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T20:41:38.057877] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-15T20:41:38.455167] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T20:41:38.857889] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-15T20:41:39.059990] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T20:41:39.657901] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-15T20:41:40.263946] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T20:41:40.457916] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-15T20:41:41.013176] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T20:41:41.257896] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-15T20:41:41.549394] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T20:41:42.057927] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-15T20:41:42.750897] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T20:41:42.857893] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-15T20:41:43.188370] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T20:41:43.657875] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-15T20:41:43.773369] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T20:41:44.457882] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-15T20:41:44.943725] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T20:41:45.264390] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-15T20:41:45.284450] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T20:41:46.057923] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-15T20:41:46.441438] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:41:46.442233] [INFO ] [REMOTE ] THLV: Full fetch complete (1938 records). [2025-09-15T20:41:46.442301] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-15T20:41:46.791664] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T20:41:46.836242] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-15T20:41:46.836335] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-15T20:41:46.836445] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-15T20:41:46.836491] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-15T20:41:46.836923] [DEBUG] [LOCAL ] THLV: Trimmed 1938 records to 1081 (keeping 150 days of data) [2025-09-15T20:41:46.844760] [DEBUG] [LOCAL ] THLV: Primary data saved (1081 records). [2025-09-15T20:41:46.844829] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-15T20:41:46.844907] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THLV took 26.4s. Estimated remaining: 30m 5s. Rate: 9.4 symbols/min [2025-09-15T20:41:46.863064] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-15T20:41:47.019094] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:47.053989] [DEBUG] [LOCAL ] THS: Loaded 28643 existing records from primary storage. [2025-09-15T20:41:47.054183] [INFO ] [MAIN ] THS: Loaded 28643 existing records. [2025-09-15T20:41:47.227772] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:47.228106] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-15T20:41:47.228167] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-15T20:41:47.228780] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-15T20:41:47.228831] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-15T20:41:47.576123] [INFO ] [REMOTE ] THS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:47.657887] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-15T20:41:48.457851] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-15T20:41:48.532859] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T20:41:48.553834] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T20:41:49.257868] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-15T20:41:50.043787] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:41:50.057810] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-15T20:41:50.705578] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T20:41:50.857867] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-15T20:41:51.536603] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T20:41:51.657903] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-15T20:41:52.214809] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T20:41:52.457875] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-15T20:41:52.731483] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T20:41:53.257896] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-15T20:41:53.545412] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T20:41:53.550785] [INFO ] [REMOTE ] THO: Full fetch complete (45845 records). [2025-09-15T20:41:53.550889] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-15T20:41:53.947451] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-15T20:41:53.947567] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-15T20:41:53.948517] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-15T20:41:53.948577] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-15T20:41:53.950673] [DEBUG] [LOCAL ] THO: Trimmed 45845 records to 30280 (keeping 150 days of data) [2025-09-15T20:41:54.062812] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-15T20:41:54.152256] [DEBUG] [LOCAL ] THO: Primary data saved (30280 records). [2025-09-15T20:41:54.152497] [INFO ] [MAIN ] THO: Full history saved. [2025-09-15T20:41:54.152700] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THO took 25.2s. Estimated remaining: 29m 59s. Rate: 9.4 symbols/min [2025-09-15T20:41:54.295281] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T20:41:54.348863] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:54.366327] [DEBUG] [LOCAL ] THW: Loaded 15000 existing records from primary storage. [2025-09-15T20:41:54.366471] [INFO ] [MAIN ] THW: Loaded 15000 existing records. [2025-09-15T20:41:54.547512] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:41:54.547769] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-15T20:41:54.547816] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-15T20:41:54.548207] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-15T20:41:54.548266] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-15T20:41:54.863060] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-15T20:41:54.899374] [INFO ] [REMOTE ] THW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:55.165843] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T20:41:55.657937] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-15T20:41:55.817324] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:41:56.457939] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-15T20:41:56.884618] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T20:41:57.066098] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T20:41:57.069246] [INFO ] [REMOTE ] THR: Full fetch complete (22057 records). [2025-09-15T20:41:57.069351] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-15T20:41:57.263156] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-15T20:41:57.455335] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-15T20:41:57.455453] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-15T20:41:57.456477] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-15T20:41:57.456530] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-15T20:41:57.457498] [DEBUG] [LOCAL ] THR: Trimmed 22057 records to 14372 (keeping 150 days of data) [2025-09-15T20:41:57.559385] [DEBUG] [LOCAL ] THR: Primary data saved (14372 records). [2025-09-15T20:41:57.559604] [INFO ] [MAIN ] THR: Full history saved. [2025-09-15T20:41:57.559747] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THR took 22.1s. Estimated remaining: 29m 52s. Rate: 9.4 symbols/min [2025-09-15T20:41:57.739006] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:41:57.739189] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-15T20:41:57.739228] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-15T20:41:57.739353] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-15T20:41:57.739396] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-15T20:41:57.739436] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-15T20:41:57.739469] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-15T20:41:58.063050] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-15T20:41:58.099013] [INFO ] [REMOTE ] TIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:41:58.857843] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-15T20:41:58.886454] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:41:58.935227] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T20:41:59.657875] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-15T20:42:00.045216] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:42:00.049072] [INFO ] [REMOTE ] THQ: Full fetch complete (25851 records). [2025-09-15T20:42:00.049250] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-15T20:42:00.430362] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-15T20:42:00.430438] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-15T20:42:00.430999] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-15T20:42:00.431042] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-15T20:42:00.431716] [DEBUG] [LOCAL ] THQ: Trimmed 25851 records to 19276 (keeping 150 days of data) [2025-09-15T20:42:00.486571] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-15T20:42:00.557843] [DEBUG] [LOCAL ] THQ: Primary data saved (19276 records). [2025-09-15T20:42:00.558007] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-15T20:42:00.558097] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. THQ took 26.2s. Estimated remaining: 29m 45s. Rate: 9.4 symbols/min [2025-09-15T20:42:00.735368] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:00.764082] [DEBUG] [LOCAL ] TIMB: Loaded 27077 existing records from primary storage. [2025-09-15T20:42:00.764251] [INFO ] [MAIN ] TIMB: Loaded 27077 existing records. [2025-09-15T20:42:00.939996] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:00.940516] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-15T20:42:00.940600] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-15T20:42:00.946383] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-15T20:42:00.951716] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-15T20:42:01.017816] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T20:42:01.262959] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-15T20:42:01.325983] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:01.935702] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T20:42:02.057888] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-15T20:42:02.256790] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T20:42:02.857876] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-15T20:42:03.657864] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-15T20:42:04.457892] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-15T20:42:05.257131] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-15T20:42:05.265162] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-15T20:42:05.318038] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (3.26 seconds). [2025-09-15T20:42:05.743067] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-15T20:42:06.057871] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-15T20:42:06.371957] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T20:42:06.579582] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T20:42:06.857899] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-15T20:42:06.874443] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T20:42:07.657931] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-15T20:42:08.293116] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T20:42:08.457868] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-15T20:42:09.069434] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T20:42:09.257876] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-15T20:42:09.451390] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T20:42:09.456137] [INFO ] [REMOTE ] THS: Full fetch complete (41487 records). [2025-09-15T20:42:09.456259] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-15T20:42:09.836161] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-15T20:42:09.836276] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-15T20:42:09.837150] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-15T20:42:09.837195] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-15T20:42:09.838896] [DEBUG] [LOCAL ] THS: Trimmed 41487 records to 28104 (keeping 150 days of data) [2025-09-15T20:42:10.011664] [DEBUG] [LOCAL ] THS: Primary data saved (28104 records). [2025-09-15T20:42:10.011809] [INFO ] [MAIN ] THS: Full history saved. [2025-09-15T20:42:10.011905] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. THS took 23.2s. Estimated remaining: 29m 39s. Rate: 9.4 symbols/min [2025-09-15T20:42:10.067660] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-15T20:42:10.184087] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:10.188173] [DEBUG] [LOCAL ] TISI: Loaded 2342 existing records from primary storage. [2025-09-15T20:42:10.188252] [INFO ] [MAIN ] TISI: Loaded 2342 existing records. [2025-09-15T20:42:10.372545] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:10.372823] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-15T20:42:10.372871] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-15T20:42:10.373096] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-15T20:42:10.373146] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-15T20:42:10.739950] [INFO ] [REMOTE ] TISI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:10.828237] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:42:10.857816] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-15T20:42:11.141332] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T20:42:11.657874] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-15T20:42:11.882038] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T20:42:12.042611] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T20:42:12.457871] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-15T20:42:13.257870] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-15T20:42:13.358925] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T20:42:14.057877] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-15T20:42:14.857882] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-15T20:42:15.189936] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:42:15.512297] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:42:15.657868] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-15T20:42:15.906895] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T20:42:16.457919] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-15T20:42:16.949676] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T20:42:17.257910] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-15T20:42:17.269253] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:42:17.272041] [INFO ] [REMOTE ] THW: Full fetch complete (20979 records). [2025-09-15T20:42:17.272129] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-15T20:42:17.630430] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-15T20:42:17.630508] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-15T20:42:17.630981] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-15T20:42:17.631025] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-15T20:42:17.631588] [DEBUG] [LOCAL ] THW: Trimmed 20979 records to 14788 (keeping 150 days of data) [2025-09-15T20:42:17.722156] [DEBUG] [LOCAL ] THW: Primary data saved (14788 records). [2025-09-15T20:42:17.722288] [INFO ] [MAIN ] THW: Full history saved. [2025-09-15T20:42:17.722370] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THW took 23.6s. Estimated remaining: 29m 33s. Rate: 9.4 symbols/min [2025-09-15T20:42:17.891591] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:17.913904] [DEBUG] [LOCAL ] TIXT: Loaded 24115 existing records from primary storage. [2025-09-15T20:42:17.914030] [INFO ] [MAIN ] TIXT: Loaded 24115 existing records. [2025-09-15T20:42:18.061629] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-15T20:42:18.096218] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:18.096540] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-15T20:42:18.096589] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-15T20:42:18.097174] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-15T20:42:18.097224] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-15T20:42:18.445706] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:18.473301] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T20:42:18.504441] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T20:42:18.857890] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-15T20:42:19.657894] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-15T20:42:20.136906] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T20:42:20.457881] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-15T20:42:20.722034] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T20:42:21.028441] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T20:42:21.257908] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-15T20:42:22.057843] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-15T20:42:22.362345] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T20:42:22.857883] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-15T20:42:23.464078] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T20:42:23.570626] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:42:23.657880] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-15T20:42:24.393693] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T20:42:24.457905] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-15T20:42:25.257874] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-15T20:42:26.057919] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-15T20:42:26.810686] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-15T20:42:26.857831] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-15T20:42:27.287935] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T20:42:27.657904] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-15T20:42:27.684102] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T20:42:27.818280] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T20:42:28.056420] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T20:42:28.057431] [INFO ] [REMOTE ] TISI: Full fetch complete (4046 records). [2025-09-15T20:42:28.057502] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-15T20:42:28.499355] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-15T20:42:28.510145] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-15T20:42:28.510309] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-15T20:42:28.510623] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-15T20:42:28.510726] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-15T20:42:28.511905] [DEBUG] [LOCAL ] TISI: Trimmed 4046 records to 2142 (keeping 150 days of data) [2025-09-15T20:42:28.533938] [DEBUG] [LOCAL ] TISI: Primary data saved (2142 records). [2025-09-15T20:42:28.534249] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-15T20:42:28.534424] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. TISI took 18.5s. Estimated remaining: 29m 27s. Rate: 9.4 symbols/min [2025-09-15T20:42:28.716265] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:28.766150] [DEBUG] [LOCAL ] TJX: Loaded 40417 existing records from primary storage. [2025-09-15T20:42:28.766295] [INFO ] [MAIN ] TJX: Loaded 40417 existing records. [2025-09-15T20:42:28.942006] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:28.942295] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-15T20:42:28.942342] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-15T20:42:28.943249] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-15T20:42:28.943299] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-15T20:42:29.265539] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-15T20:42:29.304504] [INFO ] [REMOTE ] TJX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:29.821686] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:42:29.827059] [INFO ] [REMOTE ] TIC: Full fetch complete (35731 records). [2025-09-15T20:42:29.827188] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-15T20:42:30.021151] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T20:42:30.021750] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:42:30.021814] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:42:30.021867] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-15T20:42:30.021962] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-15T20:42:30.022002] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-15T20:42:30.022051] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-15T20:42:30.022123] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. TIC took 32.5s. Estimated remaining: 29m 20s. Rate: 9.4 symbols/min [2025-09-15T20:42:30.067144] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-15T20:42:30.205291] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:30.234964] [DEBUG] [LOCAL ] TK: Loaded 30001 existing records from primary storage. [2025-09-15T20:42:30.235110] [INFO ] [MAIN ] TK: Loaded 30001 existing records. [2025-09-15T20:42:30.413964] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:30.414294] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-15T20:42:30.414345] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-15T20:42:30.415127] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-15T20:42:30.415181] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-15T20:42:30.778946] [INFO ] [REMOTE ] TK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:30.799833] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T20:42:30.857881] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-15T20:42:31.657952] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-15T20:42:31.967726] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T20:42:32.099141] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T20:42:32.457891] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-15T20:42:32.979274] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T20:42:33.257917] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-15T20:42:34.042275] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T20:42:34.057816] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-15T20:42:34.529079] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T20:42:34.857913] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-15T20:42:35.657899] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-15T20:42:35.825058] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T20:42:35.882584] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T20:42:36.457915] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-15T20:42:36.838572] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T20:42:37.257883] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-15T20:42:38.057873] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-15T20:42:38.271187] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T20:42:38.857918] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-15T20:42:38.890438] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T20:42:38.974046] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T20:42:38.979269] [INFO ] [REMOTE ] TIXT: Full fetch complete (33465 records). [2025-09-15T20:42:38.979351] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-15T20:42:39.347171] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-15T20:42:39.347290] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-15T20:42:39.348786] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-15T20:42:39.348865] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-15T20:42:39.350336] [DEBUG] [LOCAL ] TIXT: Trimmed 33465 records to 23961 (keeping 150 days of data) [2025-09-15T20:42:39.497218] [DEBUG] [LOCAL ] TIXT: Primary data saved (23961 records). [2025-09-15T20:42:39.497413] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-15T20:42:39.497545] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TIXT took 21.8s. Estimated remaining: 29m 14s. Rate: 9.4 symbols/min [2025-09-15T20:42:39.668503] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-15T20:42:39.689833] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:39.723750] [DEBUG] [LOCAL ] TKC: Loaded 28785 existing records from primary storage. [2025-09-15T20:42:39.724007] [INFO ] [MAIN ] TKC: Loaded 28785 existing records. [2025-09-15T20:42:39.911269] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:39.911709] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-15T20:42:39.911761] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-15T20:42:39.912483] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-15T20:42:39.912537] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-15T20:42:40.237218] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T20:42:40.295126] [INFO ] [REMOTE ] TKC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:40.295307] [INFO ] [REMOTE ] TIMB: Full fetch complete (41010 records). [2025-09-15T20:42:40.295711] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-15T20:42:40.463461] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-15T20:42:40.680370] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-15T20:42:40.680467] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-15T20:42:40.681370] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-15T20:42:40.681427] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-15T20:42:40.682498] [DEBUG] [LOCAL ] TIMB: Trimmed 41010 records to 26446 (keeping 150 days of data) [2025-09-15T20:42:40.854607] [DEBUG] [LOCAL ] TIMB: Primary data saved (26446 records). [2025-09-15T20:42:40.854793] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-15T20:42:40.854900] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIMB took 40.3s. Estimated remaining: 29m 7s. Rate: 9.4 symbols/min [2025-09-15T20:42:41.022494] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:41.054887] [DEBUG] [LOCAL ] TKO: Loaded 32011 existing records from primary storage. [2025-09-15T20:42:41.055031] [INFO ] [MAIN ] TKO: Loaded 32011 existing records. [2025-09-15T20:42:41.229303] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:41.229694] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-15T20:42:41.229774] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-15T20:42:41.230700] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-15T20:42:41.230754] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-15T20:42:41.267827] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-15T20:42:41.421103] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:42:41.642406] [INFO ] [REMOTE ] TKO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:41.717924] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T20:42:42.057935] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-15T20:42:42.862979] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-15T20:42:42.878400] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:42:43.275925] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T20:42:43.657886] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-15T20:42:44.462964] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-15T20:42:44.485529] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:42:44.828663] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T20:42:45.257935] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-15T20:42:46.057885] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-15T20:42:46.505179] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-15T20:42:46.549223] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:42:46.857912] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-15T20:42:47.637311] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T20:42:47.657826] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-15T20:42:48.019166] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T20:42:48.457874] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-15T20:42:49.261328] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-15T20:42:49.264608] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T20:42:50.057954] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-15T20:42:50.105448] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:42:50.475443] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T20:42:50.857938] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-15T20:42:51.657846] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-15T20:42:51.724083] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T20:42:52.399076] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T20:42:52.457904] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-15T20:42:52.570253] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T20:42:52.808165] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-15T20:42:52.813748] [INFO ] [REMOTE ] TJX: Full fetch complete (57960 records). [2025-09-15T20:42:52.813864] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-15T20:42:52.814742] [FATAL] [VALIDATOR ] TJX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:42:52.814820] [FATAL] [MAIN ] TJX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:42:52.814858] [WARN ] [MAIN ] TJX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:42:52.814914] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-15T20:42:52.814977] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-09-15T20:42:52.815024] [INFO ] [LOCAL ] TJX: Starting deletion of derivative data. [2025-09-15T20:42:52.815383] [DEBUG] [LOCAL ] TJX: Deleted derivative data file. [2025-09-15T20:42:52.816996] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TJX took 24.3s. Estimated remaining: 29m 1s. Rate: 9.4 symbols/min [2025-09-15T20:42:52.986333] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:53.020811] [DEBUG] [LOCAL ] TKR: Loaded 29166 existing records from primary storage. [2025-09-15T20:42:53.020966] [INFO ] [MAIN ] TKR: Loaded 29166 existing records. [2025-09-15T20:42:53.207104] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:53.207387] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-15T20:42:53.207435] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-15T20:42:53.208171] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-15T20:42:53.208225] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-15T20:42:53.263056] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-15T20:42:53.588586] [INFO ] [REMOTE ] TKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:54.057931] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-15T20:42:54.867717] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-15T20:42:54.869867] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T20:42:55.657894] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-15T20:42:55.746957] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T20:42:56.205467] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:42:56.210098] [INFO ] [REMOTE ] TK: Full fetch complete (43263 records). [2025-09-15T20:42:56.210211] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-15T20:42:56.468399] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-15T20:42:56.613986] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-15T20:42:56.614137] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-15T20:42:56.615127] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-15T20:42:56.615327] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-15T20:42:56.629718] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:42:56.635118] [DEBUG] [LOCAL ] TK: Trimmed 43263 records to 29500 (keeping 150 days of data) [2025-09-15T20:42:56.635977] [INFO ] [REMOTE ] TKC: Full fetch complete (40228 records). [2025-09-15T20:42:56.636439] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-15T20:42:57.136391] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-15T20:42:57.137093] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-15T20:42:57.142914] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-15T20:42:57.142972] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-15T20:42:57.159168] [DEBUG] [LOCAL ] TKC: Trimmed 40228 records to 28162 (keeping 150 days of data) [2025-09-15T20:42:57.260785] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-15T20:42:57.321288] [DEBUG] [LOCAL ] TK: Primary data saved (29500 records). [2025-09-15T20:42:57.322781] [INFO ] [MAIN ] TK: Full history saved. [2025-09-15T20:42:57.323690] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TK took 27.3s. Estimated remaining: 28m 55s. Rate: 9.4 symbols/min [2025-09-15T20:42:57.505002] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:57.583097] [DEBUG] [LOCAL ] TKC: Primary data saved (28162 records). [2025-09-15T20:42:57.583246] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-15T20:42:57.583772] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TKC took 18.1s. Estimated remaining: 28m 48s. Rate: 9.4 symbols/min [2025-09-15T20:42:57.583675] [DEBUG] [LOCAL ] TLK: Loaded 29077 existing records from primary storage. [2025-09-15T20:42:57.620308] [INFO ] [MAIN ] TLK: Loaded 29077 existing records. [2025-09-15T20:42:57.885217] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:42:57.935959] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:57.936602] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-15T20:42:57.936781] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-15T20:42:57.937971] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-15T20:42:57.938151] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-15T20:42:58.076593] [DEBUG] [LOCAL ] TLYS: Loaded 14208 existing records from primary storage. [2025-09-15T20:42:58.118887] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:42:58.117240] [INFO ] [MAIN ] TLYS: Loaded 14208 existing records. [2025-09-15T20:42:58.183129] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-15T20:42:58.543702] [INFO ] [REMOTE ] TLK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:58.543806] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:42:58.544295] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-15T20:42:58.544347] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-15T20:42:58.544734] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-15T20:42:58.544789] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-15T20:42:58.862916] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-15T20:42:58.899469] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:42:59.006299] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T20:42:59.657840] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-15T20:42:59.744230] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:43:00.449728] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:43:00.457803] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-15T20:43:00.786057] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T20:43:01.257902] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-15T20:43:02.045252] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T20:43:02.057814] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-15T20:43:02.252049] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T20:43:02.857876] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-15T20:43:03.522988] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:43:03.657839] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-15T20:43:03.735754] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:43:04.457931] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-15T20:43:05.120461] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T20:43:05.257884] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-15T20:43:06.057905] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-15T20:43:06.199030] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:43:06.823418] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T20:43:06.839909] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T20:43:06.857812] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-15T20:43:07.657877] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-15T20:43:08.415030] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T20:43:08.457854] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-15T20:43:08.826121] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T20:43:09.257863] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-15T20:43:09.826883] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:43:10.057837] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-15T20:43:10.717014] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:43:10.857872] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-15T20:43:11.427461] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:43:11.431899] [INFO ] [REMOTE ] TLK: Full fetch complete (43544 records). [2025-09-15T20:43:11.432004] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-15T20:43:11.666563] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-15T20:43:11.818547] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-15T20:43:11.818637] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-15T20:43:11.819517] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-15T20:43:11.819560] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-15T20:43:11.820676] [DEBUG] [LOCAL ] TLK: Trimmed 43544 records to 28585 (keeping 150 days of data) [2025-09-15T20:43:11.997044] [DEBUG] [LOCAL ] TLK: Primary data saved (28585 records). [2025-09-15T20:43:11.997186] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-15T20:43:11.997286] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TLK took 14.7s. Estimated remaining: 28m 42s. Rate: 9.4 symbols/min [2025-09-15T20:43:12.180324] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:12.209687] [DEBUG] [LOCAL ] TM: Loaded 27875 existing records from primary storage. [2025-09-15T20:43:12.209844] [INFO ] [MAIN ] TM: Loaded 27875 existing records. [2025-09-15T20:43:12.392769] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:12.393059] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-15T20:43:12.393107] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-15T20:43:12.393721] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-15T20:43:12.393781] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-15T20:43:12.464694] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-15T20:43:12.782482] [INFO ] [REMOTE ] TM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:12.808850] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T20:43:12.843153] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T20:43:13.257872] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-15T20:43:13.899416] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T20:43:14.063012] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-15T20:43:14.072558] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T20:43:14.857889] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-15T20:43:15.337052] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T20:43:15.657916] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-15T20:43:16.296582] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T20:43:16.302077] [INFO ] [REMOTE ] TKO: Full fetch complete (48794 records). [2025-09-15T20:43:16.302197] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-15T20:43:16.462793] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-15T20:43:16.704978] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-15T20:43:16.705878] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T20:43:16.705937] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-15T20:43:16.707347] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-15T20:43:16.711772] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-15T20:43:16.714596] [DEBUG] [LOCAL ] TKO: Trimmed 48794 records to 31405 (keeping 150 days of data) [2025-09-15T20:43:16.924115] [DEBUG] [LOCAL ] TKO: Primary data saved (31405 records). [2025-09-15T20:43:16.924293] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-15T20:43:16.924435] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TKO took 36.1s. Estimated remaining: 28m 36s. Rate: 9.4 symbols/min [2025-09-15T20:43:17.094522] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:17.133431] [DEBUG] [LOCAL ] TME: Loaded 40007 existing records from primary storage. [2025-09-15T20:43:17.133579] [INFO ] [MAIN ] TME: Loaded 40007 existing records. [2025-09-15T20:43:17.273227] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-15T20:43:17.314111] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:17.314406] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-15T20:43:17.314456] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-15T20:43:17.315245] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-15T20:43:17.315297] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-15T20:43:17.712815] [INFO ] [REMOTE ] TME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:18.057929] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-15T20:43:18.196043] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:43:18.219067] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:43:18.857919] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-15T20:43:19.133078] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T20:43:19.657890] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-15T20:43:19.758576] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:43:19.761220] [INFO ] [REMOTE ] TLYS: Full fetch complete (17947 records). [2025-09-15T20:43:19.761331] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-15T20:43:20.127243] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-15T20:43:20.127331] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-15T20:43:20.127772] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-15T20:43:20.127817] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-15T20:43:20.128375] [DEBUG] [LOCAL ] TLYS: Trimmed 17947 records to 14004 (keeping 150 days of data) [2025-09-15T20:43:20.214049] [DEBUG] [LOCAL ] TLYS: Primary data saved (14004 records). [2025-09-15T20:43:20.214222] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-15T20:43:20.214354] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TLYS took 22.6s. Estimated remaining: 28m 29s. Rate: 9.4 symbols/min [2025-09-15T20:43:20.384813] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:20.422148] [DEBUG] [LOCAL ] TMHC: Loaded 34007 existing records from primary storage. [2025-09-15T20:43:20.422293] [INFO ] [MAIN ] TMHC: Loaded 34007 existing records. [2025-09-15T20:43:20.465011] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-15T20:43:20.603167] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:20.603479] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-15T20:43:20.603528] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-15T20:43:20.604199] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-15T20:43:20.604250] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-15T20:43:21.004786] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:21.257879] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-15T20:43:21.360201] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:43:21.618086] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:43:21.623954] [INFO ] [REMOTE ] TKR: Full fetch complete (43552 records). [2025-09-15T20:43:21.624063] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-15T20:43:22.005779] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-15T20:43:22.005903] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-15T20:43:22.007038] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-15T20:43:22.007097] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-15T20:43:22.010049] [DEBUG] [LOCAL ] TKR: Trimmed 43552 records to 28611 (keeping 150 days of data) [2025-09-15T20:43:22.077612] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-15T20:43:22.209768] [DEBUG] [LOCAL ] TKR: Primary data saved (28611 records). [2025-09-15T20:43:22.209916] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-15T20:43:22.210026] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TKR took 29.4s. Estimated remaining: 28m 22s. Rate: 9.4 symbols/min [2025-09-15T20:43:22.379273] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:22.425606] [DEBUG] [LOCAL ] TMO: Loaded 39523 existing records from primary storage. [2025-09-15T20:43:22.425773] [INFO ] [MAIN ] TMO: Loaded 39523 existing records. [2025-09-15T20:43:22.606258] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:22.606811] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-15T20:43:22.606928] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-15T20:43:22.607932] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-15T20:43:22.608218] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-15T20:43:22.866289] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-15T20:43:22.878981] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T20:43:23.012346] [INFO ] [REMOTE ] TMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:23.588810] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:43:23.657885] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-15T20:43:24.457901] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-15T20:43:24.552749] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T20:43:25.181747] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T20:43:25.257834] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-15T20:43:26.057918] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-15T20:43:26.173228] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T20:43:26.857882] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-15T20:43:27.253227] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T20:43:27.657878] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-15T20:43:27.938860] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T20:43:28.457886] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-15T20:43:28.604611] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T20:43:29.258738] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-15T20:43:29.313416] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T20:43:29.633905] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T20:43:30.057876] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-15T20:43:30.857956] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-15T20:43:31.078787] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T20:43:31.666473] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-15T20:43:31.673865] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T20:43:32.117851] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T20:43:32.457923] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-15T20:43:33.257932] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-15T20:43:33.294881] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T20:43:34.057906] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-15T20:43:34.097030] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T20:43:34.822547] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:43:34.857842] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-15T20:43:35.265476] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T20:43:35.269281] [INFO ] [REMOTE ] TM: Full fetch complete (39921 records). [2025-09-15T20:43:35.269386] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-15T20:43:35.639368] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-15T20:43:35.639473] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-15T20:43:35.640278] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-15T20:43:35.640334] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-15T20:43:35.641313] [DEBUG] [LOCAL ] TM: Trimmed 39921 records to 27228 (keeping 150 days of data) [2025-09-15T20:43:35.701361] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-15T20:43:35.827970] [DEBUG] [LOCAL ] TM: Primary data saved (27228 records). [2025-09-15T20:43:35.828123] [INFO ] [MAIN ] TM: Full history saved. [2025-09-15T20:43:35.828234] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TM took 23.8s. Estimated remaining: 28m 16s. Rate: 9.4 symbols/min [2025-09-15T20:43:35.996600] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:36.008597] [DEBUG] [LOCAL ] TNC: Loaded 10792 existing records from primary storage. [2025-09-15T20:43:36.008751] [INFO ] [MAIN ] TNC: Loaded 10792 existing records. [2025-09-15T20:43:36.209012] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:36.209299] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-15T20:43:36.209346] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-15T20:43:36.209693] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-15T20:43:36.209754] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-15T20:43:36.472042] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-15T20:43:36.561061] [INFO ] [REMOTE ] TNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:36.598170] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T20:43:36.963823] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T20:43:37.257883] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-15T20:43:38.057878] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-15T20:43:38.395351] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-15T20:43:38.559231] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T20:43:38.857920] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-15T20:43:39.657903] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-15T20:43:40.171221] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T20:43:40.457884] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-15T20:43:40.593779] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T20:43:41.229200] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T20:43:41.255038] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T20:43:41.258865] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-15T20:43:42.057889] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-15T20:43:42.857895] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-15T20:43:43.088211] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:43:43.325256] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:43:43.332391] [INFO ] [REMOTE ] TMHC: Full fetch complete (49824 records). [2025-09-15T20:43:43.332635] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-15T20:43:43.664317] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-15T20:43:43.784377] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-15T20:43:43.784486] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-15T20:43:43.785728] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-15T20:43:43.785827] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-15T20:43:43.787287] [DEBUG] [LOCAL ] TMHC: Trimmed 49824 records to 33422 (keeping 150 days of data) [2025-09-15T20:43:44.070982] [DEBUG] [LOCAL ] TMHC: Primary data saved (33422 records). [2025-09-15T20:43:44.071173] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-15T20:43:44.071284] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TMHC took 23.9s. Estimated remaining: 28m 10s. Rate: 9.4 symbols/min [2025-09-15T20:43:44.331562] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:44.356140] [DEBUG] [LOCAL ] TNET: Loaded 21396 existing records from primary storage. [2025-09-15T20:43:44.356309] [INFO ] [MAIN ] TNET: Loaded 21396 existing records. [2025-09-15T20:43:44.458377] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-15T20:43:44.632715] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:44.633359] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-15T20:43:44.633425] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-15T20:43:44.671964] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:43:44.670162] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-15T20:43:44.676501] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-15T20:43:45.081697] [INFO ] [REMOTE ] TNET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:45.257853] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-15T20:43:45.299976] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T20:43:45.306201] [INFO ] [REMOTE ] TMO: Full fetch complete (56902 records). [2025-09-15T20:43:45.306316] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-15T20:43:45.695205] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T20:43:45.736617] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-15T20:43:45.737287] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-15T20:43:45.738284] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-15T20:43:45.738330] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-15T20:43:45.739699] [DEBUG] [LOCAL ] TMO: Trimmed 56902 records to 38749 (keeping 150 days of data) [2025-09-15T20:43:46.007082] [DEBUG] [LOCAL ] TMO: Primary data saved (38749 records). [2025-09-15T20:43:46.007259] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-15T20:43:46.008808] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TMO took 23.8s. Estimated remaining: 28m 3s. Rate: 9.4 symbols/min [2025-09-15T20:43:46.065575] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-15T20:43:46.196384] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:46.196677] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-15T20:43:46.196719] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-15T20:43:46.196859] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-15T20:43:46.196900] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-15T20:43:46.196944] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-15T20:43:46.196979] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-15T20:43:46.583253] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:46.615407] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T20:43:46.857939] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-15T20:43:47.626319] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T20:43:47.632959] [INFO ] [REMOTE ] TME: Full fetch complete (57857 records). [2025-09-15T20:43:47.633125] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-15T20:43:47.666701] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-15T20:43:48.018947] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-15T20:43:48.018746] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:43:48.019541] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-15T20:43:48.019439] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-15T20:43:48.021559] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-15T20:43:48.021670] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-15T20:43:48.035546] [DEBUG] [LOCAL ] TME: Trimmed 57857 records to 39238 (keeping 150 days of data) [2025-09-15T20:43:48.036017] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T20:43:48.324226] [DEBUG] [LOCAL ] TME: Primary data saved (39238 records). [2025-09-15T20:43:48.324422] [INFO ] [MAIN ] TME: Full history saved. [2025-09-15T20:43:48.324531] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TME took 31.4s. Estimated remaining: 27m 57s. Rate: 9.4 symbols/min [2025-09-15T20:43:48.463024] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-15T20:43:48.511317] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:43:48.542553] [DEBUG] [LOCAL ] TNK: Loaded 26640 existing records from primary storage. [2025-09-15T20:43:48.542725] [INFO ] [MAIN ] TNK: Loaded 26640 existing records. [2025-09-15T20:43:48.738477] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:43:48.738806] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-15T20:43:48.738859] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-15T20:43:48.739548] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-15T20:43:48.739610] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-15T20:43:48.817598] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:43:48.845995] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-15T20:43:49.113044] [INFO ] [REMOTE ] TNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:43:49.257903] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-15T20:43:50.057929] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-15T20:43:50.727109] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:43:50.727605] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-15T20:43:50.754149] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T20:43:50.857826] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-15T20:43:51.657934] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-15T20:43:51.886944] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T20:43:51.948333] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:43:51.948875] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-15T20:43:52.457925] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-15T20:43:53.257894] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-15T20:43:53.748508] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T20:43:53.876610] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:43:54.057898] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-15T20:43:54.857933] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-15T20:43:55.496006] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:43:55.634045] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:43:55.657865] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-15T20:43:56.457907] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-15T20:43:57.060337] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T20:43:57.128338] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T20:43:57.257912] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-15T20:43:57.916216] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T20:43:58.057923] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-15T20:43:58.857848] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-15T20:43:59.158527] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T20:43:59.657871] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-15T20:44:00.260494] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:44:00.457940] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-15T20:44:00.484194] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T20:44:01.257870] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-15T20:44:01.858853] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T20:44:01.940123] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T20:44:01.941706] [INFO ] [REMOTE ] TNGY: Full fetch complete (2913 records). [2025-09-15T20:44:01.941824] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-15T20:44:02.062996] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-15T20:44:02.126171] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 63 unique days, need 150 days [2025-09-15T20:44:02.126381] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:44:02.126429] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:44:02.126469] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-15T20:44:02.126528] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-15T20:44:02.126564] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-15T20:44:02.126855] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-15T20:44:02.127262] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TNGY took 16.1s. Estimated remaining: 27m 51s. Rate: 9.4 symbols/min [2025-09-15T20:44:02.316824] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:02.365425] [DEBUG] [LOCAL ] TNL: Loaded 31415 existing records from primary storage. [2025-09-15T20:44:02.365707] [INFO ] [MAIN ] TNL: Loaded 31415 existing records. [2025-09-15T20:44:02.554033] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:02.554347] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-15T20:44:02.554413] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-15T20:44:02.555363] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-15T20:44:02.555423] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-15T20:44:02.863056] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-15T20:44:02.934521] [INFO ] [REMOTE ] TNL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:03.363494] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T20:44:03.649904] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T20:44:03.651904] [INFO ] [REMOTE ] TNC: Full fetch complete (17544 records). [2025-09-15T20:44:03.651974] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-15T20:44:03.663053] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-15T20:44:04.031564] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-15T20:44:04.031756] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-15T20:44:04.032195] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-15T20:44:04.032236] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-15T20:44:04.032869] [DEBUG] [LOCAL ] TNC: Trimmed 17544 records to 10477 (keeping 150 days of data) [2025-09-15T20:44:04.101712] [DEBUG] [LOCAL ] TNC: Primary data saved (10477 records). [2025-09-15T20:44:04.101882] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-15T20:44:04.102010] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TNC took 28.3s. Estimated remaining: 27m 44s. Rate: 9.4 symbols/min [2025-09-15T20:44:04.278387] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:04.326213] [DEBUG] [LOCAL ] TOL: Loaded 38231 existing records from primary storage. [2025-09-15T20:44:04.326355] [INFO ] [MAIN ] TOL: Loaded 38231 existing records. [2025-09-15T20:44:04.469074] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-15T20:44:04.506932] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:04.507184] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-15T20:44:04.507232] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-15T20:44:04.508093] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-15T20:44:04.508148] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-15T20:44:04.865457] [INFO ] [REMOTE ] TOL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:05.022454] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T20:44:05.257880] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-15T20:44:05.656384] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T20:44:06.057900] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-15T20:44:06.574931] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T20:44:06.857923] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-15T20:44:07.657857] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-15T20:44:07.760201] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T20:44:07.901746] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T20:44:08.457871] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-15T20:44:09.038760] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:44:09.257875] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-15T20:44:09.943766] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T20:44:10.057827] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-15T20:44:10.626282] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:44:10.857875] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-15T20:44:11.030801] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T20:44:11.657895] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-15T20:44:12.238670] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T20:44:12.457936] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-15T20:44:12.886607] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:44:12.890787] [INFO ] [REMOTE ] TNK: Full fetch complete (38836 records). [2025-09-15T20:44:12.890905] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-15T20:44:13.259238] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-15T20:44:13.259629] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-15T20:44:13.260590] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-15T20:44:13.261464] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-15T20:44:13.261599] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-15T20:44:13.262539] [DEBUG] [LOCAL ] TNK: Trimmed 38836 records to 26122 (keeping 150 days of data) [2025-09-15T20:44:13.428984] [DEBUG] [LOCAL ] TNK: Primary data saved (26122 records). [2025-09-15T20:44:13.429284] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-15T20:44:13.429406] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TNK took 25.1s. Estimated remaining: 27m 38s. Rate: 9.4 symbols/min [2025-09-15T20:44:13.597200] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:13.635234] [DEBUG] [LOCAL ] TOST: Loaded 40430 existing records from primary storage. [2025-09-15T20:44:13.635412] [INFO ] [MAIN ] TOST: Loaded 40430 existing records. [2025-09-15T20:44:13.811265] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:13.811564] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-15T20:44:13.811612] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-15T20:44:13.812606] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-15T20:44:13.812687] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-15T20:44:14.058327] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-15T20:44:14.179063] [INFO ] [REMOTE ] TOST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:14.161376] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:44:14.183044] [INFO ] [REMOTE ] TNET: Full fetch complete (32627 records). [2025-09-15T20:44:14.183227] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-15T20:44:14.511922] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T20:44:14.606657] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-15T20:44:14.606738] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-15T20:44:14.607386] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-15T20:44:14.607425] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-15T20:44:14.608197] [DEBUG] [LOCAL ] TNET: Trimmed 32627 records to 20980 (keeping 150 days of data) [2025-09-15T20:44:14.737658] [DEBUG] [LOCAL ] TNET: Primary data saved (20980 records). [2025-09-15T20:44:14.737796] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-15T20:44:14.737891] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNET took 30.7s. Estimated remaining: 27m 31s. Rate: 9.4 symbols/min [2025-09-15T20:44:14.862998] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-15T20:44:14.910221] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:14.928745] [DEBUG] [LOCAL ] TPB: Loaded 19050 existing records from primary storage. [2025-09-15T20:44:14.928876] [INFO ] [MAIN ] TPB: Loaded 19050 existing records. [2025-09-15T20:44:15.114050] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:15.114438] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-15T20:44:15.114489] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-15T20:44:15.115111] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-15T20:44:15.115187] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-15T20:44:15.485388] [INFO ] [REMOTE ] TPB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:15.541964] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T20:44:15.657918] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-15T20:44:16.376735] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:44:16.437175] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T20:44:16.457828] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-15T20:44:17.257916] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-15T20:44:17.809357] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T20:44:18.057972] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-15T20:44:18.803169] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T20:44:18.857849] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-15T20:44:19.662955] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-15T20:44:19.680298] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:44:20.178087] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T20:44:20.457893] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-15T20:44:21.257897] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-15T20:44:21.661417] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T20:44:22.053179] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T20:44:22.057811] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-15T20:44:22.429941] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T20:44:22.857865] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-15T20:44:23.022845] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:44:23.657884] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-15T20:44:24.457923] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-15T20:44:24.874730] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T20:44:25.257885] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-15T20:44:25.414100] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T20:44:25.467210] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T20:44:26.057892] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-15T20:44:26.843241] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:44:26.857829] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-15T20:44:27.657927] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-15T20:44:27.736514] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T20:44:28.193632] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:44:28.198539] [INFO ] [REMOTE ] TNL: Full fetch complete (45675 records). [2025-09-15T20:44:28.198712] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-15T20:44:28.464267] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-15T20:44:28.586895] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-15T20:44:28.587110] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-15T20:44:28.588338] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-15T20:44:28.588471] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-15T20:44:28.590075] [DEBUG] [LOCAL ] TNL: Trimmed 45675 records to 30721 (keeping 150 days of data) [2025-09-15T20:44:28.672597] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T20:44:28.812335] [DEBUG] [LOCAL ] TNL: Primary data saved (30721 records). [2025-09-15T20:44:28.812508] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-15T20:44:28.812623] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 26.7s. Estimated remaining: 27m 26s. Rate: 9.4 symbols/min [2025-09-15T20:44:28.987325] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:29.016709] [DEBUG] [LOCAL ] TPC: Loaded 29823 existing records from primary storage. [2025-09-15T20:44:29.016863] [INFO ] [MAIN ] TPC: Loaded 29823 existing records. [2025-09-15T20:44:29.192373] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:29.192639] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-15T20:44:29.192709] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-15T20:44:29.193259] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-15T20:44:29.193315] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-15T20:44:29.267836] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-15T20:44:29.546917] [INFO ] [REMOTE ] TPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:30.057906] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-15T20:44:30.171304] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T20:44:30.558705] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:44:30.857881] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-15T20:44:31.459368] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T20:44:31.657862] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-15T20:44:31.875339] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T20:44:31.878690] [INFO ] [REMOTE ] TPB: Full fetch complete (26653 records). [2025-09-15T20:44:31.878775] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-15T20:44:32.253456] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-15T20:44:32.253549] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-15T20:44:32.254122] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-15T20:44:32.254179] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-15T20:44:32.254869] [DEBUG] [LOCAL ] TPB: Trimmed 26653 records to 18881 (keeping 150 days of data) [2025-09-15T20:44:32.372922] [DEBUG] [LOCAL ] TPB: Primary data saved (18881 records). [2025-09-15T20:44:32.373065] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-15T20:44:32.373168] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TPB took 17.6s. Estimated remaining: 27m 19s. Rate: 9.4 symbols/min [2025-09-15T20:44:32.462956] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-15T20:44:32.544112] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:32.577392] [DEBUG] [LOCAL ] TPH: Loaded 33799 existing records from primary storage. [2025-09-15T20:44:32.577571] [INFO ] [MAIN ] TPH: Loaded 33799 existing records. [2025-09-15T20:44:32.753556] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:32.753807] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-15T20:44:32.753930] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-15T20:44:32.754578] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-15T20:44:32.754630] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-15T20:44:33.107240] [INFO ] [REMOTE ] TPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:33.257888] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-15T20:44:33.460746] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T20:44:33.945110] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T20:44:34.057900] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-15T20:44:34.272703] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T20:44:34.857880] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-15T20:44:35.159411] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T20:44:35.208629] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-15T20:44:35.214035] [INFO ] [REMOTE ] TOL: Full fetch complete (55346 records). [2025-09-15T20:44:35.214143] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-15T20:44:35.215004] [FATAL] [VALIDATOR ] TOL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:44:35.215086] [FATAL] [MAIN ] TOL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:44:35.215121] [WARN ] [MAIN ] TOL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:44:35.215173] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-15T20:44:35.215242] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-15T20:44:35.215295] [INFO ] [LOCAL ] TOL: Starting deletion of derivative data. [2025-09-15T20:44:35.215687] [DEBUG] [LOCAL ] TOL: Deleted derivative data file. [2025-09-15T20:44:35.217052] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TOL took 31.1s. Estimated remaining: 27m 12s. Rate: 9.4 symbols/min [2025-09-15T20:44:35.393412] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:35.408666] [DEBUG] [LOCAL ] TPL: Loaded 9241 existing records from primary storage. [2025-09-15T20:44:35.408796] [INFO ] [MAIN ] TPL: Loaded 9241 existing records. [2025-09-15T20:44:35.591810] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:35.592082] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-15T20:44:35.592128] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-15T20:44:35.592451] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-15T20:44:35.592498] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-15T20:44:35.663025] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-15T20:44:35.943300] [INFO ] [REMOTE ] TPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:36.457931] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-15T20:44:37.142485] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T20:44:37.257957] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-15T20:44:37.369397] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T20:44:38.057944] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-15T20:44:38.620527] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:44:38.857900] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-15T20:44:39.632813] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T20:44:39.657829] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-15T20:44:40.457886] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-15T20:44:40.779822] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-15T20:44:40.929258] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T20:44:41.163269] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T20:44:41.257859] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-15T20:44:42.057889] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-15T20:44:42.850200] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:44:42.859589] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-15T20:44:43.657887] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-15T20:44:43.878442] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T20:44:43.984228] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T20:44:44.457933] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-15T20:44:44.850068] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T20:44:45.257892] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-15T20:44:46.057911] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-15T20:44:46.306071] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T20:44:46.609757] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T20:44:46.857902] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-15T20:44:47.386530] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:44:47.657884] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-15T20:44:48.342996] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:44:48.403742] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:44:48.457933] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-15T20:44:49.257891] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-15T20:44:49.525153] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T20:44:49.530017] [INFO ] [REMOTE ] TPH: Full fetch complete (49487 records). [2025-09-15T20:44:49.530128] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-15T20:44:49.915294] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-15T20:44:49.915393] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-15T20:44:49.916335] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-15T20:44:49.916382] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-15T20:44:49.917547] [DEBUG] [LOCAL ] TPH: Trimmed 49487 records to 33185 (keeping 150 days of data) [2025-09-15T20:44:50.078564] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-15T20:44:50.130034] [DEBUG] [LOCAL ] TPH: Primary data saved (33185 records). [2025-09-15T20:44:50.130169] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-15T20:44:50.130262] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TPH took 17.8s. Estimated remaining: 27m 7s. Rate: 9.4 symbols/min [2025-09-15T20:44:50.301791] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:50.340666] [DEBUG] [LOCAL ] TPR: Loaded 40259 existing records from primary storage. [2025-09-15T20:44:50.340902] [INFO ] [MAIN ] TPR: Loaded 40259 existing records. [2025-09-15T20:44:50.516425] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:50.516740] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-15T20:44:50.516791] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-15T20:44:50.517592] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-15T20:44:50.517666] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-15T20:44:50.874275] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-15T20:44:50.879379] [INFO ] [REMOTE ] TPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:50.905551] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:44:51.236806] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T20:44:51.657914] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-15T20:44:52.457919] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-15T20:44:52.522581] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T20:44:52.545261] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T20:44:52.551772] [INFO ] [REMOTE ] TOST: Full fetch complete (58360 records). [2025-09-15T20:44:52.551963] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-15T20:44:52.937021] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-15T20:44:52.937108] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-15T20:44:52.938109] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-15T20:44:52.938156] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-15T20:44:52.939450] [DEBUG] [LOCAL ] TOST: Trimmed 58360 records to 39651 (keeping 150 days of data) [2025-09-15T20:44:53.181702] [DEBUG] [LOCAL ] TOST: Primary data saved (39651 records). [2025-09-15T20:44:53.181904] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-15T20:44:53.181999] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TOST took 39.8s. Estimated remaining: 27m 0s. Rate: 9.4 symbols/min [2025-09-15T20:44:53.262972] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-15T20:44:53.353949] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:53.372507] [DEBUG] [LOCAL ] TPVG: Loaded 19289 existing records from primary storage. [2025-09-15T20:44:53.372694] [INFO ] [MAIN ] TPVG: Loaded 19289 existing records. [2025-09-15T20:44:53.555246] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:53.555530] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-15T20:44:53.555578] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-15T20:44:53.556090] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-15T20:44:53.556149] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-15T20:44:53.910868] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:53.923388] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T20:44:53.928069] [INFO ] [REMOTE ] TPC: Full fetch complete (41943 records). [2025-09-15T20:44:53.928168] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-15T20:44:54.070222] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-15T20:44:54.324382] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-15T20:44:54.324897] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-15T20:44:54.325984] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-15T20:44:54.326061] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-15T20:44:54.324808] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T20:44:54.331058] [DEBUG] [LOCAL ] TPC: Trimmed 41943 records to 29194 (keeping 150 days of data) [2025-09-15T20:44:54.512183] [DEBUG] [LOCAL ] TPC: Primary data saved (29194 records). [2025-09-15T20:44:54.512339] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-15T20:44:54.512459] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPC took 25.7s. Estimated remaining: 26m 53s. Rate: 9.4 symbols/min [2025-09-15T20:44:54.721273] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:44:54.729107] [DEBUG] [LOCAL ] TPYP: Loaded 5927 existing records from primary storage. [2025-09-15T20:44:54.729208] [INFO ] [MAIN ] TPYP: Loaded 5927 existing records. [2025-09-15T20:44:54.870608] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-15T20:44:54.910455] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:44:54.910782] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-15T20:44:54.910834] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-15T20:44:54.911181] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-15T20:44:54.911229] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-15T20:44:55.260374] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:44:55.289074] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T20:44:55.657901] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-15T20:44:55.676863] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:44:55.678602] [INFO ] [REMOTE ] TPL: Full fetch complete (13382 records). [2025-09-15T20:44:55.678696] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-15T20:44:56.044112] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-15T20:44:56.044208] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-15T20:44:56.044547] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-15T20:44:56.044587] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-15T20:44:56.045449] [DEBUG] [LOCAL ] TPL: Trimmed 13382 records to 9157 (keeping 150 days of data) [2025-09-15T20:44:56.107677] [DEBUG] [LOCAL ] TPL: Primary data saved (9157 records). [2025-09-15T20:44:56.107817] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-15T20:44:56.107905] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPL took 20.9s. Estimated remaining: 26m 46s. Rate: 9.4 symbols/min [2025-09-15T20:44:56.457879] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-15T20:44:56.476369] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T20:44:57.257943] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-15T20:44:57.843259] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T20:44:58.057870] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-15T20:44:58.857936] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-15T20:44:58.907532] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:44:59.037075] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T20:44:59.625263] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T20:44:59.657819] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-15T20:45:00.457875] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-15T20:45:00.473148] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T20:45:01.257890] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-15T20:45:01.924949] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:45:02.057906] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-15T20:45:02.398118] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T20:45:02.857899] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-15T20:45:03.657881] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-15T20:45:05.234692] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-15T20:45:05.237233] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-15T20:45:05.633560] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (3.58 seconds). [2025-09-15T20:45:05.652126] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-15T20:45:05.654012] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T20:45:05.911328] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-15T20:45:06.057873] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-15T20:45:06.857938] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-15T20:45:07.069052] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T20:45:07.619304] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T20:45:07.628085] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T20:45:07.657828] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-15T20:45:08.318801] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T20:45:08.320478] [INFO ] [REMOTE ] TPYP: Full fetch complete (8880 records). [2025-09-15T20:45:08.320567] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-15T20:45:08.468334] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-15T20:45:08.692697] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-15T20:45:08.692782] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-15T20:45:08.693054] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-15T20:45:08.693096] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-15T20:45:08.693562] [DEBUG] [LOCAL ] TPYP: Trimmed 8880 records to 5781 (keeping 150 days of data) [2025-09-15T20:45:08.730966] [DEBUG] [LOCAL ] TPYP: Primary data saved (5781 records). [2025-09-15T20:45:08.731095] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-15T20:45:08.731219] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPYP took 14.2s. Estimated remaining: 26m 40s. Rate: 9.4 symbols/min [2025-09-15T20:45:09.257938] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-15T20:45:09.755273] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T20:45:10.057975] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-15T20:45:10.810359] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T20:45:10.857840] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-15T20:45:11.244832] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T20:45:11.248403] [INFO ] [REMOTE ] TPVG: Full fetch complete (28993 records). [2025-09-15T20:45:11.248505] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-15T20:45:11.650411] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-15T20:45:11.650559] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-15T20:45:11.651536] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-15T20:45:11.651597] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-15T20:45:11.652687] [DEBUG] [LOCAL ] TPVG: Trimmed 28993 records to 18877 (keeping 150 days of data) [2025-09-15T20:45:11.792009] [DEBUG] [LOCAL ] TPVG: Primary data saved (18877 records). [2025-09-15T20:45:11.792187] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-15T20:45:11.792322] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPVG took 18.6s. Estimated remaining: 26m 34s. Rate: 9.4 symbols/min [2025-09-15T20:45:12.556754] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T20:45:12.568576] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-15T20:45:15.479759] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-15T20:45:15.491590] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-15T20:45:17.329762] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T20:45:17.341984] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-15T20:45:19.046255] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T20:45:19.053839] [INFO ] [REMOTE ] TPR: Full fetch complete (58160 records). [2025-09-15T20:45:19.053972] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-15T20:45:19.436572] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-15T20:45:19.436706] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-15T20:45:19.437717] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-15T20:45:19.437765] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-15T20:45:19.439052] [DEBUG] [LOCAL ] TPR: Trimmed 58160 records to 39482 (keeping 150 days of data) [2025-09-15T20:45:19.705361] [DEBUG] [LOCAL ] TPR: Primary data saved (39482 records). [2025-09-15T20:45:19.705530] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-15T20:45:19.705631] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPR took 29.6s. Estimated remaining: 26m 28s. Rate: 9.4 symbols/min [2025-09-15T20:45:20.336828] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:20.335432] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:20.372918] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:20.456682] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:20.469491] [DEBUG] [LOCAL ] TRAK: Loaded 6788 existing records from primary storage. [2025-09-15T20:45:20.469903] [INFO ] [MAIN ] TRAK: Loaded 6788 existing records. [2025-09-15T20:45:20.470614] [DEBUG] [LOCAL ] TPZ: Loaded 3453 existing records from primary storage. [2025-09-15T20:45:20.476670] [INFO ] [MAIN ] TPZ: Loaded 3453 existing records. [2025-09-15T20:45:20.574166] [DEBUG] [LOCAL ] TR: Loaded 14756 existing records from primary storage. [2025-09-15T20:45:20.602918] [INFO ] [MAIN ] TR: Loaded 14756 existing records. [2025-09-15T20:45:20.680735] [DEBUG] [LOCAL ] TRC: Loaded 11739 existing records from primary storage. [2025-09-15T20:45:20.733183] [INFO ] [MAIN ] TRC: Loaded 11739 existing records. [2025-09-15T20:45:20.999464] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:20.970349] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:21.005508] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-15T20:45:21.036469] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-15T20:45:21.112260] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-15T20:45:21.119181] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-15T20:45:21.118682] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:21.119146] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-15T20:45:21.124656] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-15T20:45:21.124885] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-15T20:45:21.124837] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-15T20:45:21.135298] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-15T20:45:21.140546] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-15T20:45:21.146867] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-15T20:45:21.252080] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-15T20:45:21.331072] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:21.382588] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-15T20:45:21.470996] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-15T20:45:21.508097] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-15T20:45:21.526900] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-15T20:45:22.476000] [INFO ] [REMOTE ] TR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:22.495316] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:22.508178] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-15T20:45:22.498732] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:22.507952] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-15T20:45:22.550219] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-15T20:45:22.630043] [INFO ] [REMOTE ] TRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:22.631669] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-15T20:45:23.240729] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T20:45:23.242937] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-15T20:45:23.297219] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T20:45:23.300280] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-15T20:45:23.401035] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T20:45:23.403273] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-15T20:45:23.486488] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:45:23.489983] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-15T20:45:23.937183] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T20:45:23.939911] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-15T20:45:24.006675] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T20:45:24.009513] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-15T20:45:24.113976] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T20:45:24.118405] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-15T20:45:24.128426] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T20:45:24.131984] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-15T20:45:24.463428] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T20:45:24.465706] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-15T20:45:24.543068] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T20:45:24.546005] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-15T20:45:24.917829] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T20:45:25.233905] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T20:45:25.255861] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T20:45:25.260161] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-15T20:45:25.306339] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T20:45:25.645775] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T20:45:26.057888] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-15T20:45:26.857901] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-15T20:45:27.001453] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:45:27.657880] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-15T20:45:28.457922] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-15T20:45:28.489555] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T20:45:28.805615] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T20:45:29.088207] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T20:45:29.257900] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-15T20:45:29.915823] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T20:45:30.057919] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-15T20:45:30.780719] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T20:45:30.857827] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-15T20:45:31.487495] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T20:45:31.489293] [INFO ] [REMOTE ] TRAK: Full fetch complete (10160 records). [2025-09-15T20:45:31.489364] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-15T20:45:31.670213] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-15T20:45:31.853786] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-15T20:45:31.853866] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-15T20:45:31.854136] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-15T20:45:31.854208] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-15T20:45:31.854727] [DEBUG] [LOCAL ] TRAK: Trimmed 10160 records to 6686 (keeping 150 days of data) [2025-09-15T20:45:31.896992] [DEBUG] [LOCAL ] TRAK: Primary data saved (6686 records). [2025-09-15T20:45:31.897103] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-15T20:45:31.897190] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TRAK took 12.2s. Estimated remaining: 26m 22s. Rate: 9.4 symbols/min [2025-09-15T20:45:32.065290] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:32.102814] [DEBUG] [LOCAL ] TREX: Loaded 37191 existing records from primary storage. [2025-09-15T20:45:32.102968] [INFO ] [MAIN ] TREX: Loaded 37191 existing records. [2025-09-15T20:45:32.275967] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:32.276222] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-15T20:45:32.276267] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-15T20:45:32.277064] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-15T20:45:32.277115] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-15T20:45:32.463011] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-15T20:45:32.629138] [INFO ] [REMOTE ] TREX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:32.639630] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T20:45:33.257889] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-15T20:45:33.434381] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T20:45:34.057884] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-15T20:45:34.765974] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:45:34.857833] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-15T20:45:35.012676] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T20:45:35.657887] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-15T20:45:36.458113] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-15T20:45:36.458569] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T20:45:36.626971] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T20:45:36.990910] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T20:45:37.257896] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-15T20:45:38.057885] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-15T20:45:38.512397] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-15T20:45:38.513481] [INFO ] [REMOTE ] TPZ: Full fetch complete (6075 records). [2025-09-15T20:45:38.513551] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-15T20:45:38.857869] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-15T20:45:38.882167] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-15T20:45:38.882263] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-15T20:45:38.882464] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-15T20:45:38.882514] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-15T20:45:38.883281] [DEBUG] [LOCAL ] TPZ: Trimmed 6075 records to 3245 (keeping 150 days of data) [2025-09-15T20:45:38.935208] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:45:38.933732] [DEBUG] [LOCAL ] TPZ: Primary data saved (3245 records). [2025-09-15T20:45:38.945185] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-15T20:45:38.945389] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TPZ took 19.2s. Estimated remaining: 26m 16s. Rate: 9.4 symbols/min [2025-09-15T20:45:39.119236] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:39.169499] [DEBUG] [LOCAL ] TRGP: Loaded 38197 existing records from primary storage. [2025-09-15T20:45:39.169693] [INFO ] [MAIN ] TRGP: Loaded 38197 existing records. [2025-09-15T20:45:39.355804] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:39.356078] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-15T20:45:39.356171] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-15T20:45:39.357059] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-15T20:45:39.357114] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-15T20:45:39.667534] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-15T20:45:39.668331] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:45:39.706529] [INFO ] [REMOTE ] TRC: Full fetch complete (17088 records). [2025-09-15T20:45:39.735917] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:39.736371] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-15T20:45:40.124080] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-15T20:45:40.124209] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-15T20:45:40.124973] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-15T20:45:40.125022] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-15T20:45:40.125699] [DEBUG] [LOCAL ] TRC: Trimmed 17088 records to 11356 (keeping 150 days of data) [2025-09-15T20:45:40.199623] [DEBUG] [LOCAL ] TRC: Primary data saved (11356 records). [2025-09-15T20:45:40.199845] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-15T20:45:40.199955] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TRC took 20.5s. Estimated remaining: 26m 9s. Rate: 9.4 symbols/min [2025-09-15T20:45:40.374427] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:40.404992] [DEBUG] [LOCAL ] TRN: Loaded 27878 existing records from primary storage. [2025-09-15T20:45:40.405197] [INFO ] [MAIN ] TRN: Loaded 27878 existing records. [2025-09-15T20:45:40.468583] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-15T20:45:40.592354] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:40.592696] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-15T20:45:40.592751] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-15T20:45:40.593497] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-15T20:45:40.593556] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-15T20:45:40.946980] [INFO ] [REMOTE ] TRN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:41.257887] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-15T20:45:41.425132] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:45:42.057963] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-15T20:45:42.141305] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T20:45:42.248225] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T20:45:42.857882] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-15T20:45:43.382025] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T20:45:43.657922] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-15T20:45:44.457943] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-15T20:45:44.777672] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T20:45:45.169760] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T20:45:45.193748] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T20:45:45.257872] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-15T20:45:46.057943] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-15T20:45:46.686349] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T20:45:46.857901] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-15T20:45:47.073458] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T20:45:47.657902] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-15T20:45:48.238019] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:45:48.457878] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-15T20:45:49.169083] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:45:49.257935] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-15T20:45:50.057947] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-15T20:45:50.444688] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T20:45:50.600755] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T20:45:50.857881] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-15T20:45:51.403386] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:45:51.657905] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-15T20:45:52.031802] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:45:52.037374] [INFO ] [REMOTE ] TREX: Full fetch complete (54136 records). [2025-09-15T20:45:52.037497] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-15T20:45:52.431243] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-15T20:45:52.431340] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-15T20:45:52.432438] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-15T20:45:52.432490] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-15T20:45:52.433861] [DEBUG] [LOCAL ] TREX: Trimmed 54136 records to 36482 (keeping 150 days of data) [2025-09-15T20:45:52.493478] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-15T20:45:52.674754] [DEBUG] [LOCAL ] TREX: Primary data saved (36482 records). [2025-09-15T20:45:52.674895] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-15T20:45:52.674987] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TREX took 20.8s. Estimated remaining: 26m 3s. Rate: 9.4 symbols/min [2025-09-15T20:45:52.845228] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:52.876085] [DEBUG] [LOCAL ] TRNO: Loaded 33264 existing records from primary storage. [2025-09-15T20:45:52.876253] [INFO ] [MAIN ] TRNO: Loaded 33264 existing records. [2025-09-15T20:45:53.049901] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:53.050127] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-15T20:45:53.050173] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-15T20:45:53.050893] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-15T20:45:53.050945] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-15T20:45:53.268140] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-15T20:45:53.401716] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:53.548519] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T20:45:54.058784] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-15T20:45:54.063929] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:45:54.147321] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T20:45:54.150154] [INFO ] [REMOTE ] TR: Full fetch complete (19370 records). [2025-09-15T20:45:54.150245] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-15T20:45:54.529353] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-15T20:45:54.529492] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-15T20:45:54.529980] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-15T20:45:54.530027] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-15T20:45:54.530856] [DEBUG] [LOCAL ] TR: Trimmed 19370 records to 14670 (keeping 150 days of data) [2025-09-15T20:45:54.626430] [DEBUG] [LOCAL ] TR: Primary data saved (14670 records). [2025-09-15T20:45:54.626590] [INFO ] [MAIN ] TR: Full history saved. [2025-09-15T20:45:54.626713] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TR took 34.9s. Estimated remaining: 25m 56s. Rate: 9.4 symbols/min [2025-09-15T20:45:54.799577] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:54.846127] [DEBUG] [LOCAL ] TROX: Loaded 39171 existing records from primary storage. [2025-09-15T20:45:54.846305] [INFO ] [MAIN ] TROX: Loaded 39171 existing records. [2025-09-15T20:45:54.866568] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-15T20:45:55.029117] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:55.029389] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-15T20:45:55.029440] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-15T20:45:55.030322] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-15T20:45:55.030377] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-15T20:45:55.399086] [INFO ] [REMOTE ] TROX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:55.668465] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-15T20:45:55.675353] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T20:45:56.446206] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:45:56.457806] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-15T20:45:56.991819] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T20:45:57.257889] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-15T20:45:57.510756] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T20:45:57.514995] [INFO ] [REMOTE ] TRN: Full fetch complete (40773 records). [2025-09-15T20:45:57.515132] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-15T20:45:57.914080] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-15T20:45:57.914201] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-15T20:45:57.915222] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-15T20:45:57.915271] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-15T20:45:57.916411] [DEBUG] [LOCAL ] TRN: Trimmed 40773 records to 27293 (keeping 150 days of data) [2025-09-15T20:45:58.062061] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-15T20:45:58.094509] [DEBUG] [LOCAL ] TRN: Primary data saved (27293 records). [2025-09-15T20:45:58.095136] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-15T20:45:58.095259] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TRN took 17.9s. Estimated remaining: 25m 49s. Rate: 9.4 symbols/min [2025-09-15T20:45:58.268620] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:45:58.305844] [DEBUG] [LOCAL ] TRP: Loaded 39171 existing records from primary storage. [2025-09-15T20:45:58.306033] [INFO ] [MAIN ] TRP: Loaded 39171 existing records. [2025-09-15T20:45:58.483232] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:45:58.483506] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-15T20:45:58.483553] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-15T20:45:58.484442] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-15T20:45:58.484495] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-15T20:45:58.839663] [INFO ] [REMOTE ] TRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:45:58.863004] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-15T20:45:58.889817] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:45:59.661502] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-15T20:45:59.666603] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T20:46:00.457950] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-15T20:46:00.555047] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T20:46:01.264494] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-15T20:46:01.296624] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T20:46:01.726806] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T20:46:02.057897] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-15T20:46:02.857874] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-15T20:46:03.190848] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:46:03.657873] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-15T20:46:03.808527] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T20:46:04.281348] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T20:46:04.457875] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-15T20:46:05.257867] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-15T20:46:05.291411] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:46:05.728435] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:46:05.734232] [INFO ] [REMOTE ] TRGP: Full fetch complete (55383 records). [2025-09-15T20:46:05.734353] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-15T20:46:06.062986] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-15T20:46:06.117551] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-15T20:46:06.117657] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-15T20:46:06.118751] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-15T20:46:06.118819] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-15T20:46:06.120108] [DEBUG] [LOCAL ] TRGP: Trimmed 55383 records to 37440 (keeping 150 days of data) [2025-09-15T20:46:06.367945] [DEBUG] [LOCAL ] TRGP: Primary data saved (37440 records). [2025-09-15T20:46:06.368103] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-15T20:46:06.368810] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TRGP took 27.4s. Estimated remaining: 25m 43s. Rate: 9.4 symbols/min [2025-09-15T20:46:06.543255] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:06.573393] [DEBUG] [LOCAL ] TRTX: Loaded 27077 existing records from primary storage. [2025-09-15T20:46:06.573555] [INFO ] [MAIN ] TRTX: Loaded 27077 existing records. [2025-09-15T20:46:06.749760] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:06.750017] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-15T20:46:06.750068] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-15T20:46:06.750633] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-15T20:46:06.750705] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-15T20:46:06.860987] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-15T20:46:07.106616] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:07.163345] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T20:46:07.621981] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T20:46:07.657861] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-15T20:46:08.457900] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-15T20:46:08.628579] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T20:46:09.089748] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T20:46:09.257844] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-15T20:46:10.030162] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T20:46:10.057830] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-15T20:46:10.230504] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T20:46:10.857888] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-15T20:46:11.586103] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T20:46:11.657830] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-15T20:46:12.033555] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T20:46:12.457878] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-15T20:46:13.257882] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-15T20:46:13.300214] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:46:14.028563] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:46:14.057831] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-15T20:46:14.857879] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-15T20:46:15.009016] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T20:46:15.433452] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T20:46:15.657912] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-15T20:46:16.130177] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T20:46:16.136625] [INFO ] [REMOTE ] TROX: Full fetch complete (55980 records). [2025-09-15T20:46:16.136792] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-15T20:46:16.474196] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-15T20:46:16.527099] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-15T20:46:16.527205] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-15T20:46:16.528248] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-15T20:46:16.528308] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-15T20:46:16.529792] [DEBUG] [LOCAL ] TROX: Trimmed 55980 records to 38431 (keeping 150 days of data) [2025-09-15T20:46:16.776162] [DEBUG] [LOCAL ] TROX: Primary data saved (38431 records). [2025-09-15T20:46:16.776363] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-15T20:46:16.777893] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TROX took 22.2s. Estimated remaining: 25m 37s. Rate: 9.4 symbols/min [2025-09-15T20:46:16.951584] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:16.994749] [DEBUG] [LOCAL ] TRU: Loaded 38342 existing records from primary storage. [2025-09-15T20:46:16.994930] [INFO ] [MAIN ] TRU: Loaded 38342 existing records. [2025-09-15T20:46:17.174666] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:17.174971] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-15T20:46:17.175028] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-15T20:46:17.187609] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T20:46:17.187670] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-15T20:46:17.192100] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-15T20:46:17.261628] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-15T20:46:17.256043] [INFO ] [REMOTE ] TRNO: Full fetch complete (47933 records). [2025-09-15T20:46:17.283763] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-15T20:46:17.825043] [INFO ] [REMOTE ] TRU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:17.952976] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-15T20:46:17.953096] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-15T20:46:17.954375] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-15T20:46:17.954472] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-15T20:46:17.955857] [DEBUG] [LOCAL ] TRNO: Trimmed 47933 records to 32543 (keeping 150 days of data) [2025-09-15T20:46:18.058818] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-15T20:46:18.110587] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:46:18.202544] [DEBUG] [LOCAL ] TRNO: Primary data saved (32543 records). [2025-09-15T20:46:18.202718] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-15T20:46:18.202821] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TRNO took 25.5s. Estimated remaining: 25m 30s. Rate: 9.4 symbols/min [2025-09-15T20:46:18.370634] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:18.407664] [DEBUG] [LOCAL ] TRV: Loaded 35927 existing records from primary storage. [2025-09-15T20:46:18.407808] [INFO ] [MAIN ] TRV: Loaded 35927 existing records. [2025-09-15T20:46:18.587115] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:18.587410] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-15T20:46:18.587455] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-15T20:46:18.588213] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-15T20:46:18.588262] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-15T20:46:18.865090] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-15T20:46:18.953391] [INFO ] [REMOTE ] TRV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:18.978969] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T20:46:19.663077] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-15T20:46:19.690556] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T20:46:20.457929] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-15T20:46:20.501414] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:46:21.257882] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-15T20:46:21.492571] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T20:46:21.749219] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:46:22.057941] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-15T20:46:22.857867] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-15T20:46:23.143986] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T20:46:23.657881] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-15T20:46:24.062629] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T20:46:24.104631] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T20:46:24.457870] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-15T20:46:25.122053] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T20:46:25.127771] [INFO ] [REMOTE ] TRP: Full fetch complete (56756 records). [2025-09-15T20:46:25.127868] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-15T20:46:25.268447] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-15T20:46:25.512897] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-15T20:46:25.512976] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-15T20:46:25.513950] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-15T20:46:25.513994] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-15T20:46:25.515159] [DEBUG] [LOCAL ] TRP: Trimmed 56756 records to 38418 (keeping 150 days of data) [2025-09-15T20:46:25.755930] [DEBUG] [LOCAL ] TRP: Primary data saved (38418 records). [2025-09-15T20:46:25.756086] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-15T20:46:25.756187] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TRP took 27.7s. Estimated remaining: 25m 24s. Rate: 9.4 symbols/min [2025-09-15T20:46:25.925499] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:25.960942] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T20:46:25.998403] [DEBUG] [LOCAL ] TS: Loaded 38831 existing records from primary storage. [2025-09-15T20:46:25.998563] [INFO ] [MAIN ] TS: Loaded 38831 existing records. [2025-09-15T20:46:26.063372] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-15T20:46:26.209721] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:26.210014] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-15T20:46:26.210064] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-15T20:46:26.210821] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-15T20:46:26.210875] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-15T20:46:26.568975] [INFO ] [REMOTE ] TS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:26.623216] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:46:26.857998] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-15T20:46:27.657911] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-15T20:46:28.137070] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-15T20:46:28.457879] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-15T20:46:28.652845] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:46:29.046551] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T20:46:29.257890] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-15T20:46:30.021402] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:46:30.057821] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-15T20:46:30.649255] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T20:46:30.857844] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-15T20:46:31.315838] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T20:46:31.657867] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-15T20:46:32.458956] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-15T20:46:32.458881] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T20:46:33.045218] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T20:46:33.257859] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-15T20:46:34.047514] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T20:46:34.057859] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-15T20:46:34.620748] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T20:46:34.857864] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-15T20:46:35.657964] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-15T20:46:35.732193] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T20:46:35.758058] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T20:46:35.762624] [INFO ] [REMOTE ] TRTX: Full fetch complete (40359 records). [2025-09-15T20:46:35.762740] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-15T20:46:36.180328] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-15T20:46:36.180489] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-15T20:46:36.182066] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-15T20:46:36.182115] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-15T20:46:36.183458] [DEBUG] [LOCAL ] TRTX: Trimmed 40359 records to 26411 (keeping 150 days of data) [2025-09-15T20:46:36.357395] [DEBUG] [LOCAL ] TRTX: Primary data saved (26411 records). [2025-09-15T20:46:36.357608] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-15T20:46:36.357746] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TRTX took 30.0s. Estimated remaining: 25m 18s. Rate: 9.4 symbols/min [2025-09-15T20:46:36.465965] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-15T20:46:36.545239] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:36.573823] [DEBUG] [LOCAL ] TSE: Loaded 21419 existing records from primary storage. [2025-09-15T20:46:36.574036] [INFO ] [MAIN ] TSE: Loaded 21419 existing records. [2025-09-15T20:46:36.797675] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:36.798069] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-15T20:46:36.798123] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-15T20:46:36.798796] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-15T20:46:36.798853] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-15T20:46:37.177396] [INFO ] [REMOTE ] TSE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:37.260258] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-15T20:46:37.263744] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T20:46:38.057953] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-15T20:46:38.199506] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T20:46:38.255686] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T20:46:38.857884] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-15T20:46:39.356982] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:46:39.361603] [INFO ] [REMOTE ] TRV: Full fetch complete (52439 records). [2025-09-15T20:46:39.361720] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-15T20:46:39.362369] [FATAL] [VALIDATOR ] TRV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:46:39.362455] [FATAL] [MAIN ] TRV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:46:39.362492] [WARN ] [MAIN ] TRV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:46:39.362531] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-15T20:46:39.362590] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-15T20:46:39.362661] [INFO ] [LOCAL ] TRV: Starting deletion of derivative data. [2025-09-15T20:46:39.363026] [DEBUG] [LOCAL ] TRV: Deleted derivative data file. [2025-09-15T20:46:39.363108] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRV took 21.2s. Estimated remaining: 25m 11s. Rate: 9.4 symbols/min [2025-09-15T20:46:39.538035] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:39.567400] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T20:46:39.580428] [DEBUG] [LOCAL ] TSI: Loaded 5477 existing records from primary storage. [2025-09-15T20:46:39.580822] [INFO ] [MAIN ] TSI: Loaded 5477 existing records. [2025-09-15T20:46:39.662994] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-15T20:46:39.758401] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:39.758661] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-15T20:46:39.758708] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-15T20:46:39.758938] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-15T20:46:39.758984] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-15T20:46:40.112894] [INFO ] [REMOTE ] TSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:40.457879] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-15T20:46:41.265167] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-15T20:46:41.292716] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T20:46:41.322689] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T20:46:42.057951] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-15T20:46:42.854505] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:46:42.863225] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-15T20:46:42.865602] [INFO ] [REMOTE ] TRU: Full fetch complete (55485 records). [2025-09-15T20:46:42.865863] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-15T20:46:43.336265] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-15T20:46:43.336369] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-15T20:46:43.337419] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-15T20:46:43.337474] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-15T20:46:43.338910] [DEBUG] [LOCAL ] TRU: Trimmed 55485 records to 37607 (keeping 150 days of data) [2025-09-15T20:46:43.625523] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T20:46:43.647463] [DEBUG] [LOCAL ] TRU: Primary data saved (37607 records). [2025-09-15T20:46:43.647635] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-15T20:46:43.648394] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TRU took 26.9s. Estimated remaining: 25m 5s. Rate: 9.4 symbols/min [2025-09-15T20:46:43.663007] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-15T20:46:43.824173] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:43.851858] [DEBUG] [LOCAL ] TSLX: Loaded 25877 existing records from primary storage. [2025-09-15T20:46:43.852011] [INFO ] [MAIN ] TSLX: Loaded 25877 existing records. [2025-09-15T20:46:44.034022] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:44.034309] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-15T20:46:44.034354] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-15T20:46:44.034990] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-15T20:46:44.035048] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-15T20:46:44.421315] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:46:44.444271] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:44.463882] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-15T20:46:44.466452] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T20:46:45.257884] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-15T20:46:46.057878] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-15T20:46:46.107914] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:46:46.347278] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T20:46:46.857861] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-15T20:46:47.437325] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T20:46:47.657881] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-15T20:46:48.245967] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T20:46:48.457861] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-15T20:46:49.037298] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:46:49.257895] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-15T20:46:49.829076] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:46:49.835080] [INFO ] [REMOTE ] TS: Full fetch complete (56294 records). [2025-09-15T20:46:49.835255] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-15T20:46:50.062968] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-15T20:46:50.152673] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T20:46:50.233334] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-15T20:46:50.233433] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-15T20:46:50.234492] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-15T20:46:50.234544] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-15T20:46:50.236347] [DEBUG] [LOCAL ] TS: Trimmed 56294 records to 38067 (keeping 150 days of data) [2025-09-15T20:46:50.490228] [DEBUG] [LOCAL ] TS: Primary data saved (38067 records). [2025-09-15T20:46:50.490420] [INFO ] [MAIN ] TS: Full history saved. [2025-09-15T20:46:50.490559] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TS took 24.7s. Estimated remaining: 24m 58s. Rate: 9.4 symbols/min [2025-09-15T20:46:50.661587] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:46:50.704413] [DEBUG] [LOCAL ] TSM: Loaded 40559 existing records from primary storage. [2025-09-15T20:46:50.704614] [INFO ] [MAIN ] TSM: Loaded 40559 existing records. [2025-09-15T20:46:50.877794] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-15T20:46:50.882134] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:46:50.883714] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-15T20:46:50.883804] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-15T20:46:50.884820] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-15T20:46:50.884883] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-15T20:46:51.245248] [INFO ] [REMOTE ] TSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:46:51.609367] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T20:46:51.631699] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T20:46:51.657814] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-15T20:46:52.457886] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-15T20:46:52.970779] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T20:46:53.257838] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-15T20:46:54.057925] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-15T20:46:54.771994] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-15T20:46:54.820172] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T20:46:54.857884] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-15T20:46:54.939737] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:46:55.657899] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-15T20:46:55.954924] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T20:46:56.383138] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T20:46:56.457866] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-15T20:46:57.096425] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:46:57.257886] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-15T20:46:58.057875] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-15T20:46:58.360031] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T20:46:58.857916] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-15T20:46:58.918961] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T20:46:59.657929] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-15T20:47:00.157497] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T20:47:00.457898] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-15T20:47:00.958757] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T20:47:01.257863] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-15T20:47:01.309496] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:47:01.312329] [INFO ] [REMOTE ] TSE: Full fetch complete (31612 records). [2025-09-15T20:47:01.312402] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-15T20:47:01.680949] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-15T20:47:01.681054] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-15T20:47:01.681720] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-15T20:47:01.681771] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-15T20:47:01.682728] [DEBUG] [LOCAL ] TSE: Trimmed 31612 records to 21128 (keeping 150 days of data) [2025-09-15T20:47:01.815564] [DEBUG] [LOCAL ] TSE: Primary data saved (21128 records). [2025-09-15T20:47:01.815709] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-15T20:47:01.815808] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TSE took 25.5s. Estimated remaining: 24m 53s. Rate: 9.4 symbols/min [2025-09-15T20:47:01.992321] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:02.040058] [DEBUG] [LOCAL ] TSN: Loaded 39921 existing records from primary storage. [2025-09-15T20:47:02.040237] [INFO ] [MAIN ] TSN: Loaded 39921 existing records. [2025-09-15T20:47:02.063068] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-15T20:47:02.234439] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:02.234733] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-15T20:47:02.234792] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-15T20:47:02.235583] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-15T20:47:02.235634] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-15T20:47:02.607052] [INFO ] [REMOTE ] TSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:02.627417] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T20:47:02.853132] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T20:47:02.854823] [INFO ] [REMOTE ] TSI: Full fetch complete (10208 records). [2025-09-15T20:47:02.854894] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-15T20:47:02.866081] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-15T20:47:03.209523] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-15T20:47:03.209607] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-15T20:47:03.209941] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-15T20:47:03.209983] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-15T20:47:03.210454] [DEBUG] [LOCAL ] TSI: Trimmed 10208 records to 5448 (keeping 150 days of data) [2025-09-15T20:47:03.242979] [DEBUG] [LOCAL ] TSI: Primary data saved (5448 records). [2025-09-15T20:47:03.243084] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-15T20:47:03.243178] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TSI took 23.9s. Estimated remaining: 24m 46s. Rate: 9.4 symbols/min [2025-09-15T20:47:03.414266] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:03.425221] [DEBUG] [LOCAL ] TSQ: Loaded 9524 existing records from primary storage. [2025-09-15T20:47:03.425314] [INFO ] [MAIN ] TSQ: Loaded 9524 existing records. [2025-09-15T20:47:03.597793] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:03.598072] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-15T20:47:03.598177] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-15T20:47:03.598593] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-15T20:47:03.598670] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-15T20:47:03.663097] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-15T20:47:03.950814] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:04.457907] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-15T20:47:04.635045] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T20:47:05.257848] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-15T20:47:05.426621] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:47:05.430630] [INFO ] [REMOTE ] TSLX: Full fetch complete (38512 records). [2025-09-15T20:47:05.430773] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-15T20:47:05.799793] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-15T20:47:05.799868] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-15T20:47:05.800616] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-15T20:47:05.800685] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-15T20:47:05.801520] [DEBUG] [LOCAL ] TSLX: Trimmed 38512 records to 25450 (keeping 150 days of data) [2025-09-15T20:47:05.967357] [DEBUG] [LOCAL ] TSLX: Primary data saved (25450 records). [2025-09-15T20:47:05.967489] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-15T20:47:05.967578] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSLX took 22.3s. Estimated remaining: 24m 39s. Rate: 9.4 symbols/min [2025-09-15T20:47:06.058004] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-15T20:47:06.141018] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:06.186481] [DEBUG] [LOCAL ] TT: Loaded 35423 existing records from primary storage. [2025-09-15T20:47:06.186630] [INFO ] [MAIN ] TT: Loaded 35423 existing records. [2025-09-15T20:47:06.362882] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:06.363148] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-15T20:47:06.363275] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-15T20:47:06.364132] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-15T20:47:06.364209] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-15T20:47:06.667479] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-15T20:47:06.755151] [INFO ] [REMOTE ] TT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:06.857527] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T20:47:06.860160] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-15T20:47:07.220584] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T20:47:07.615338] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:47:07.657819] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-15T20:47:08.408826] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:47:08.457828] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-15T20:47:09.257878] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-15T20:47:09.389844] [DEBUG] [REMOTE ] TSQ: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-15T20:47:09.390193] [WARN ] [REMOTE ] TSQ: No data returned for month 2025-05 [2025-09-15T20:47:10.057863] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-15T20:47:10.427977] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T20:47:10.857856] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-15T20:47:10.938254] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T20:47:11.657872] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-15T20:47:12.457898] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-15T20:47:12.612007] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T20:47:12.708879] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T20:47:13.257887] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-15T20:47:14.057912] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-15T20:47:14.404766] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T20:47:14.857870] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-15T20:47:15.039790] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T20:47:15.657873] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-15T20:47:16.171342] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:47:16.457880] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-15T20:47:16.582272] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-15T20:47:17.027846] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T20:47:17.257877] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-15T20:47:17.371981] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T20:47:18.057884] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-15T20:47:18.654877] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T20:47:18.656462] [INFO ] [REMOTE ] TSQ: Full fetch complete (10588 records). [2025-09-15T20:47:18.656533] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-15T20:47:18.833746] [WARN ] [VALIDATOR ] TSQ: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T20:47:18.834016] [FATAL] [MAIN ] TSQ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:47:18.834081] [WARN ] [MAIN ] TSQ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:47:18.834123] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-15T20:47:18.834206] [DEBUG] [LOCAL ] TSQ: No primary data file found to delete. [2025-09-15T20:47:18.834244] [INFO ] [LOCAL ] TSQ: Starting deletion of derivative data. [2025-09-15T20:47:18.834564] [DEBUG] [LOCAL ] TSQ: Deleted derivative data file. [2025-09-15T20:47:18.834680] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSQ took 15.6s. Estimated remaining: 24m 33s. Rate: 9.4 symbols/min [2025-09-15T20:47:18.863584] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-15T20:47:19.008215] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:19.044968] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T20:47:19.063464] [DEBUG] [LOCAL ] TTAM: Loaded 20642 existing records from primary storage. [2025-09-15T20:47:19.063596] [INFO ] [MAIN ] TTAM: Loaded 20642 existing records. [2025-09-15T20:47:19.240757] [WARN ] [MAIN ] TTAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:19.241022] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-15T20:47:19.241120] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-15T20:47:19.241580] [DEBUG] [LOCAL ] TTAM: Deleted primary data file. [2025-09-15T20:47:19.241623] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-15T20:47:19.583542] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:19.657891] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-15T20:47:20.457887] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-15T20:47:21.266023] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-15T20:47:21.277440] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-15T20:47:21.328790] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T20:47:21.487249] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T20:47:22.057886] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-15T20:47:22.857865] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-15T20:47:23.159446] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T20:47:23.657896] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-15T20:47:23.777207] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T20:47:24.457942] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-15T20:47:25.042932] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-15T20:47:25.213960] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T20:47:25.257876] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-15T20:47:25.673299] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T20:47:26.057886] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-15T20:47:26.857907] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-15T20:47:27.598420] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T20:47:27.657840] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-15T20:47:27.842140] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:47:27.847460] [INFO ] [REMOTE ] TT: Full fetch complete (52608 records). [2025-09-15T20:47:27.847605] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-15T20:47:28.233257] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-15T20:47:28.233408] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-15T20:47:28.234408] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-15T20:47:28.234463] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-15T20:47:28.235838] [DEBUG] [LOCAL ] TT: Trimmed 52608 records to 34651 (keeping 150 days of data) [2025-09-15T20:47:28.394798] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-15T20:47:28.462499] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-15T20:47:28.512143] [DEBUG] [LOCAL ] TT: Primary data saved (34651 records). [2025-09-15T20:47:28.512378] [INFO ] [MAIN ] TT: Full history saved. [2025-09-15T20:47:28.513674] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TT took 22.5s. Estimated remaining: 24m 27s. Rate: 9.4 symbols/min [2025-09-15T20:47:28.658217] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T20:47:28.710750] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:28.742836] [DEBUG] [LOCAL ] TTC: Loaded 31494 existing records from primary storage. [2025-09-15T20:47:28.742994] [INFO ] [MAIN ] TTC: Loaded 31494 existing records. [2025-09-15T20:47:28.923570] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:28.923949] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-15T20:47:28.924115] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-15T20:47:28.930026] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-15T20:47:28.937019] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-15T20:47:28.969331] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T20:47:29.042073] [INFO ] [REMOTE ] TSN: Full fetch complete (57044 records). [2025-09-15T20:47:29.044477] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-15T20:47:29.062041] [FATAL] [VALIDATOR ] TSN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:47:29.095879] [FATAL] [MAIN ] TSN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:47:29.104193] [WARN ] [MAIN ] TSN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:47:29.166198] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-15T20:47:29.197957] [DEBUG] [LOCAL ] TSN: No primary data file found to delete. [2025-09-15T20:47:29.214056] [INFO ] [LOCAL ] TSN: Starting deletion of derivative data. [2025-09-15T20:47:29.224734] [DEBUG] [LOCAL ] TSN: Deleted derivative data file. [2025-09-15T20:47:29.236111] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TSN took 27.4s. Estimated remaining: 24m 20s. Rate: 9.4 symbols/min [2025-09-15T20:47:29.262865] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-15T20:47:29.317876] [INFO ] [REMOTE ] TTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:29.473965] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:29.513589] [DEBUG] [LOCAL ] TTE: Loaded 38684 existing records from primary storage. [2025-09-15T20:47:29.513753] [INFO ] [MAIN ] TTE: Loaded 38684 existing records. [2025-09-15T20:47:29.701012] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:29.701449] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-15T20:47:29.701497] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-15T20:47:29.703491] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-15T20:47:29.703547] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-15T20:47:30.054057] [INFO ] [REMOTE ] TTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:30.057830] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-15T20:47:30.857870] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-15T20:47:31.657840] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-15T20:47:31.898973] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-15T20:47:31.948089] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T20:47:32.005065] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T20:47:32.457872] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-15T20:47:33.257849] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-15T20:47:33.311582] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:47:33.372526] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T20:47:34.057893] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-15T20:47:34.857916] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-15T20:47:35.185947] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T20:47:35.657939] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-15T20:47:36.352407] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T20:47:36.387895] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-15T20:47:36.397789] [INFO ] [REMOTE ] TSM: Full fetch complete (58499 records). [2025-09-15T20:47:36.398006] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-15T20:47:36.469008] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-15T20:47:36.814131] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-15T20:47:36.814491] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-15T20:47:36.815806] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-15T20:47:36.815858] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-15T20:47:36.817247] [DEBUG] [LOCAL ] TSM: Trimmed 58499 records to 39779 (keeping 150 days of data) [2025-09-15T20:47:37.076101] [DEBUG] [LOCAL ] TSM: Primary data saved (39779 records). [2025-09-15T20:47:37.076266] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-15T20:47:37.076379] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TSM took 46.6s. Estimated remaining: 24m 14s. Rate: 9.4 symbols/min [2025-09-15T20:47:37.248077] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:37.265553] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-15T20:47:37.280256] [DEBUG] [LOCAL ] TTI: Loaded 34355 existing records from primary storage. [2025-09-15T20:47:37.280395] [INFO ] [MAIN ] TTI: Loaded 34355 existing records. [2025-09-15T20:47:37.457776] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:37.458012] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-15T20:47:37.458059] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-15T20:47:37.458755] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-15T20:47:37.458811] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-15T20:47:37.851193] [INFO ] [REMOTE ] TTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:37.885602] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-15T20:47:37.927869] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T20:47:38.057905] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-15T20:47:38.375103] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T20:47:38.857878] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-15T20:47:39.572529] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T20:47:39.657842] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-15T20:47:40.447406] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T20:47:40.457837] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-15T20:47:41.136337] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:47:41.257879] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-15T20:47:41.403241] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T20:47:41.406540] [INFO ] [REMOTE ] TTAM: Full fetch complete (31406 records). [2025-09-15T20:47:41.406667] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-15T20:47:41.784023] [DEBUG] [VALIDATOR ] TTAM: All expected trading days are present. [2025-09-15T20:47:41.784147] [DEBUG] [VALIDATOR ] TTAM: Primary data validation passed. [2025-09-15T20:47:41.784838] [INFO ] [MAIN ] TTAM: Fetched primary data is valid. [2025-09-15T20:47:41.784882] [DEBUG] [LOCAL ] TTAM: Saving primary data. [2025-09-15T20:47:41.785635] [DEBUG] [LOCAL ] TTAM: Trimmed 31406 records to 20275 (keeping 150 days of data) [2025-09-15T20:47:41.911059] [DEBUG] [LOCAL ] TTAM: Primary data saved (20275 records). [2025-09-15T20:47:41.911191] [INFO ] [MAIN ] TTAM: Full history saved. [2025-09-15T20:47:41.911293] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TTAM took 23.1s. Estimated remaining: 24m 7s. Rate: 9.4 symbols/min [2025-09-15T20:47:42.077028] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-15T20:47:42.079682] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:42.118962] [DEBUG] [LOCAL ] TU: Loaded 37254 existing records from primary storage. [2025-09-15T20:47:42.119109] [INFO ] [MAIN ] TU: Loaded 37254 existing records. [2025-09-15T20:47:42.298108] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:42.298430] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-15T20:47:42.298484] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-15T20:47:42.299246] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-15T20:47:42.299294] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-15T20:47:42.649797] [INFO ] [REMOTE ] TU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:42.707877] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T20:47:42.857866] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-15T20:47:43.657884] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-15T20:47:43.782226] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T20:47:44.390285] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T20:47:44.457944] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-15T20:47:45.167500] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:47:45.257892] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-15T20:47:46.062941] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-15T20:47:46.077727] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T20:47:46.590432] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T20:47:46.857883] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-15T20:47:47.657885] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-15T20:47:47.817422] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T20:47:48.457878] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-15T20:47:48.685064] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:47:48.811466] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T20:47:49.257918] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-15T20:47:49.865532] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T20:47:49.871335] [INFO ] [REMOTE ] TTE: Full fetch complete (56170 records). [2025-09-15T20:47:49.871462] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-15T20:47:50.067104] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-15T20:47:50.263157] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-15T20:47:50.263246] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-15T20:47:50.264348] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-15T20:47:50.264398] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-15T20:47:50.265691] [DEBUG] [LOCAL ] TTE: Trimmed 56170 records to 37934 (keeping 150 days of data) [2025-09-15T20:47:50.503861] [DEBUG] [LOCAL ] TTE: Primary data saved (37934 records). [2025-09-15T20:47:50.504018] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-15T20:47:50.504658] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TTE took 21.3s. Estimated remaining: 24m 1s. Rate: 9.4 symbols/min [2025-09-15T20:47:50.683503] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:50.712832] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T20:47:50.752686] [DEBUG] [LOCAL ] TUYA: Loaded 34593 existing records from primary storage. [2025-09-15T20:47:50.752825] [INFO ] [MAIN ] TUYA: Loaded 34593 existing records. [2025-09-15T20:47:50.863205] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-15T20:47:50.936212] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:50.936506] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-15T20:47:50.936554] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-15T20:47:50.937335] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-15T20:47:50.937392] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-15T20:47:51.306912] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:51.518763] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T20:47:51.657879] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-15T20:47:52.457836] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-15T20:47:52.507755] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T20:47:53.257839] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-15T20:47:53.409537] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T20:47:54.057878] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-15T20:47:54.307199] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T20:47:54.812037] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:47:54.857823] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-15T20:47:55.606693] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:47:55.657847] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-15T20:47:56.395907] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T20:47:56.457877] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-15T20:47:56.999678] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:47:57.004559] [INFO ] [REMOTE ] TTC: Full fetch complete (47153 records). [2025-09-15T20:47:57.004677] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-15T20:47:57.266293] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-15T20:47:57.385161] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-15T20:47:57.385255] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-15T20:47:57.386228] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-15T20:47:57.386319] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-15T20:47:57.387418] [DEBUG] [LOCAL ] TTC: Trimmed 47153 records to 30907 (keeping 150 days of data) [2025-09-15T20:47:57.589464] [DEBUG] [LOCAL ] TTC: Primary data saved (30907 records). [2025-09-15T20:47:57.589614] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-15T20:47:57.589740] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTC took 29.1s. Estimated remaining: 23m 55s. Rate: 9.4 symbols/min [2025-09-15T20:47:57.760165] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:57.773335] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:47:57.778242] [INFO ] [REMOTE ] TTI: Full fetch complete (49045 records). [2025-09-15T20:47:57.778386] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-15T20:47:58.055286] [DEBUG] [LOCAL ] TV: Loaded 32076 existing records from primary storage. [2025-09-15T20:47:58.060977] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-15T20:47:58.083222] [INFO ] [MAIN ] TV: Loaded 32076 existing records. [2025-09-15T20:47:58.302608] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-15T20:47:58.321098] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-15T20:47:58.338245] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-15T20:47:58.353992] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-15T20:47:58.358496] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:58.358826] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-15T20:47:58.358960] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-15T20:47:58.359355] [DEBUG] [LOCAL ] TTI: Trimmed 49045 records to 33622 (keeping 150 days of data) [2025-09-15T20:47:58.359627] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-15T20:47:58.359706] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-15T20:47:58.815994] [INFO ] [REMOTE ] TV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:58.867633] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-15T20:47:58.917252] [DEBUG] [LOCAL ] TTI: Primary data saved (33622 records). [2025-09-15T20:47:58.917368] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-15T20:47:58.917451] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TTI took 21.8s. Estimated remaining: 23m 48s. Rate: 9.4 symbols/min [2025-09-15T20:47:59.087459] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:47:59.092035] [DEBUG] [LOCAL ] TVC: Loaded 2461 existing records from primary storage. [2025-09-15T20:47:59.107001] [INFO ] [MAIN ] TVC: Loaded 2461 existing records. [2025-09-15T20:47:59.217187] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T20:47:59.308935] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:47:59.309185] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-15T20:47:59.309235] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-15T20:47:59.309465] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-15T20:47:59.309512] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-15T20:47:59.676832] [INFO ] [REMOTE ] TVC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:47:59.676963] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-15T20:47:59.711874] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:48:00.430170] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:48:00.457822] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-15T20:48:01.252455] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:48:01.261739] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-15T20:48:01.706572] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T20:48:02.057904] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-15T20:48:02.857875] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-15T20:48:03.602562] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-15T20:48:03.657843] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-15T20:48:04.457928] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-15T20:48:04.907587] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-15T20:48:04.923354] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T20:48:05.259144] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-15T20:48:05.262860] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T20:48:05.544841] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-15T20:48:06.057885] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-15T20:48:06.857855] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-15T20:48:06.971051] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T20:48:07.485048] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T20:48:07.657897] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-15T20:48:07.746536] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T20:48:08.457921] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-15T20:48:09.053166] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T20:48:09.257972] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-15T20:48:09.688210] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:48:09.694825] [INFO ] [REMOTE ] TU: Full fetch complete (54447 records). [2025-09-15T20:48:09.695007] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-15T20:48:10.009704] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:48:10.078524] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-15T20:48:10.099108] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-15T20:48:10.099228] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-15T20:48:10.100353] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-15T20:48:10.100419] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-15T20:48:10.101829] [DEBUG] [LOCAL ] TU: Trimmed 54447 records to 36528 (keeping 150 days of data) [2025-09-15T20:48:10.343981] [DEBUG] [LOCAL ] TU: Primary data saved (36528 records). [2025-09-15T20:48:10.344188] [INFO ] [MAIN ] TU: Full history saved. [2025-09-15T20:48:10.344305] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TU took 28.4s. Estimated remaining: 23m 42s. Rate: 9.4 symbols/min [2025-09-15T20:48:10.514520] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:10.518321] [DEBUG] [LOCAL ] TVE: Loaded 1916 existing records from primary storage. [2025-09-15T20:48:10.518400] [INFO ] [MAIN ] TVE: Loaded 1916 existing records. [2025-09-15T20:48:10.693388] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:10.693731] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-15T20:48:10.693779] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-15T20:48:10.693943] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-15T20:48:10.693986] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-15T20:48:10.866455] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-15T20:48:11.061705] [INFO ] [REMOTE ] TVE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:11.657936] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-15T20:48:12.374127] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-15T20:48:12.457881] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-15T20:48:13.257875] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-15T20:48:13.428761] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T20:48:13.579697] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-15T20:48:13.657186] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T20:48:14.057882] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-15T20:48:14.286783] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:48:14.857873] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-15T20:48:15.566552] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:48:15.612754] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:48:15.657840] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-15T20:48:16.171517] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T20:48:16.457880] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-15T20:48:17.257935] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-15T20:48:17.740393] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T20:48:17.760248] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:48:17.765920] [INFO ] [REMOTE ] TUYA: Full fetch complete (51235 records). [2025-09-15T20:48:17.766077] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-15T20:48:18.063034] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-15T20:48:18.176184] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-15T20:48:18.176297] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-15T20:48:18.177596] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-15T20:48:18.177683] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-15T20:48:18.179126] [DEBUG] [LOCAL ] TUYA: Trimmed 51235 records to 33962 (keeping 150 days of data) [2025-09-15T20:48:18.385167] [DEBUG] [LOCAL ] TUYA: Primary data saved (33962 records). [2025-09-15T20:48:18.385311] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-15T20:48:18.385919] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TUYA took 27.9s. Estimated remaining: 23m 36s. Rate: 9.4 symbols/min [2025-09-15T20:48:18.562528] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:18.588094] [DEBUG] [LOCAL ] TWI: Loaded 24960 existing records from primary storage. [2025-09-15T20:48:18.588238] [INFO ] [MAIN ] TWI: Loaded 24960 existing records. [2025-09-15T20:48:18.673343] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T20:48:18.701971] [INFO ] [REMOTE ] TVC: Full fetch complete (3959 records). [2025-09-15T20:48:18.717856] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-15T20:48:18.877346] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-15T20:48:18.886759] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:18.888330] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-15T20:48:18.893789] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-15T20:48:18.938403] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-15T20:48:19.008841] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-15T20:48:19.382779] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-15T20:48:19.394257] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-15T20:48:19.411111] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-15T20:48:19.421381] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-15T20:48:19.437618] [DEBUG] [LOCAL ] TVC: Trimmed 3959 records to 2398 (keeping 150 days of data) [2025-09-15T20:48:19.512466] [INFO ] [REMOTE ] TWI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:19.517085] [DEBUG] [LOCAL ] TVC: Primary data saved (2398 records). [2025-09-15T20:48:19.517154] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-15T20:48:19.517261] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TVC took 20.6s. Estimated remaining: 23m 29s. Rate: 9.4 symbols/min [2025-09-15T20:48:19.636351] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:48:19.668293] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-15T20:48:19.713927] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:19.758841] [DEBUG] [LOCAL ] TWLO: Loaded 39700 existing records from primary storage. [2025-09-15T20:48:19.758997] [INFO ] [MAIN ] TWLO: Loaded 39700 existing records. [2025-09-15T20:48:19.940926] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:19.941223] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-15T20:48:19.941282] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-15T20:48:19.942072] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-15T20:48:19.942135] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-15T20:48:20.301261] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:20.457881] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-15T20:48:21.129159] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:48:21.257846] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-15T20:48:22.057975] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-15T20:48:22.523725] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T20:48:22.550954] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T20:48:22.556011] [INFO ] [REMOTE ] TV: Full fetch complete (46842 records). [2025-09-15T20:48:22.556137] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-15T20:48:22.669408] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T20:48:22.863140] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-15T20:48:22.996583] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-15T20:48:22.996681] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-15T20:48:22.997706] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-15T20:48:22.997839] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-15T20:48:22.999051] [DEBUG] [LOCAL ] TV: Trimmed 46842 records to 31334 (keeping 150 days of data) [2025-09-15T20:48:23.189621] [DEBUG] [LOCAL ] TV: Primary data saved (31334 records). [2025-09-15T20:48:23.189784] [INFO ] [MAIN ] TV: Full history saved. [2025-09-15T20:48:23.189869] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TV took 25.6s. Estimated remaining: 23m 22s. Rate: 9.4 symbols/min [2025-09-15T20:48:23.363493] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:23.367440] [DEBUG] [LOCAL ] TWN: Loaded 2087 existing records from primary storage. [2025-09-15T20:48:23.367522] [INFO ] [MAIN ] TWN: Loaded 2087 existing records. [2025-09-15T20:48:23.554222] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:23.554506] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-15T20:48:23.554554] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-15T20:48:23.554782] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-15T20:48:23.554847] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-15T20:48:23.662850] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-15T20:48:23.935733] [INFO ] [REMOTE ] TWN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:24.379718] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T20:48:24.406210] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T20:48:24.457819] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-15T20:48:25.257931] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-15T20:48:25.814880] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T20:48:25.877124] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T20:48:26.057917] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-15T20:48:26.857872] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-15T20:48:27.657934] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-15T20:48:28.040740] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T20:48:28.109974] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T20:48:28.265893] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T20:48:28.457959] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-15T20:48:29.257955] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-15T20:48:30.058003] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-15T20:48:30.383997] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T20:48:30.866040] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-15T20:48:30.870439] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T20:48:31.504107] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:48:31.657895] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-15T20:48:32.457892] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-15T20:48:33.195319] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T20:48:33.257881] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-15T20:48:34.001503] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-09-15T20:48:34.057934] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-15T20:48:34.107408] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:48:34.108376] [INFO ] [REMOTE ] TVE: Full fetch complete (3158 records). [2025-09-15T20:48:34.108444] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-15T20:48:34.468007] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-15T20:48:34.468096] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-15T20:48:34.468221] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-15T20:48:34.468261] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-15T20:48:34.468636] [DEBUG] [LOCAL ] TVE: Trimmed 3158 records to 1853 (keeping 150 days of data) [2025-09-15T20:48:34.481214] [DEBUG] [LOCAL ] TVE: Primary data saved (1853 records). [2025-09-15T20:48:34.481305] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-15T20:48:34.481406] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TVE took 24.1s. Estimated remaining: 23m 17s. Rate: 9.4 symbols/min [2025-09-15T20:48:34.654381] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:34.699150] [DEBUG] [LOCAL ] TWO: Loaded 36371 existing records from primary storage. [2025-09-15T20:48:34.699338] [INFO ] [MAIN ] TWO: Loaded 36371 existing records. [2025-09-15T20:48:34.836793] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T20:48:34.880560] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-15T20:48:34.886989] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:34.888870] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-15T20:48:34.888923] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-15T20:48:34.889707] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-15T20:48:34.889757] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-15T20:48:35.251373] [INFO ] [REMOTE ] TWO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:35.657879] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-15T20:48:35.906304] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T20:48:36.116222] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T20:48:36.337452] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T20:48:36.457881] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-15T20:48:37.257901] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-15T20:48:38.056779] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T20:48:38.060005] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-15T20:48:38.511071] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T20:48:38.535028] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:48:38.857890] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-15T20:48:39.292310] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T20:48:39.657921] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-15T20:48:40.457891] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-15T20:48:41.086485] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T20:48:41.257911] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-15T20:48:41.582785] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T20:48:42.057870] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-15T20:48:42.656883] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:48:42.857878] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-15T20:48:43.335736] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T20:48:43.662948] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-15T20:48:43.682599] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T20:48:44.089940] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T20:48:44.090861] [INFO ] [REMOTE ] TWN: Full fetch complete (3681 records). [2025-09-15T20:48:44.090930] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-15T20:48:44.444204] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-15T20:48:44.444284] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-15T20:48:44.444439] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-15T20:48:44.444479] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-15T20:48:44.445113] [DEBUG] [LOCAL ] TWN: Trimmed 3681 records to 2052 (keeping 150 days of data) [2025-09-15T20:48:44.458093] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-15T20:48:44.459770] [DEBUG] [LOCAL ] TWN: Primary data saved (2052 records). [2025-09-15T20:48:44.459833] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-15T20:48:44.459935] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TWN took 21.3s. Estimated remaining: 23m 11s. Rate: 9.4 symbols/min [2025-09-15T20:48:44.629464] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:44.629700] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-15T20:48:44.629745] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-15T20:48:44.629897] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-15T20:48:44.629945] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-15T20:48:44.629989] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-15T20:48:44.630024] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-15T20:48:44.982917] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:45.257881] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-15T20:48:45.781935] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T20:48:46.057891] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-15T20:48:46.338448] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:48:46.338848] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-15T20:48:46.828446] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:48:46.835192] [INFO ] [REMOTE ] TWLO: Full fetch complete (57386 records). [2025-09-15T20:48:46.835370] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-15T20:48:46.865226] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-15T20:48:47.224040] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-15T20:48:47.224137] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-15T20:48:47.225170] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-15T20:48:47.225218] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-15T20:48:47.226483] [DEBUG] [LOCAL ] TWLO: Trimmed 57386 records to 38952 (keeping 150 days of data) [2025-09-15T20:48:47.479782] [DEBUG] [LOCAL ] TWLO: Primary data saved (38952 records). [2025-09-15T20:48:47.479938] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-15T20:48:47.480054] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWLO took 28.0s. Estimated remaining: 23m 4s. Rate: 9.4 symbols/min [2025-09-15T20:48:47.650546] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:47.660302] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-15T20:48:47.669904] [DEBUG] [LOCAL ] TX: Loaded 17265 existing records from primary storage. [2025-09-15T20:48:47.670014] [INFO ] [MAIN ] TX: Loaded 17265 existing records. [2025-09-15T20:48:47.846366] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:47.846615] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-15T20:48:47.846690] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-15T20:48:47.847093] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-15T20:48:47.847139] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-15T20:48:47.952002] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:48:47.955993] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-15T20:48:48.143983] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T20:48:48.200331] [INFO ] [REMOTE ] TWI: Full fetch complete (38703 records). [2025-09-15T20:48:48.207890] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-15T20:48:48.227356] [INFO ] [REMOTE ] TX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:48.463035] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-15T20:48:48.597367] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-15T20:48:48.597455] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-15T20:48:48.598438] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-15T20:48:48.598498] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-15T20:48:48.599344] [DEBUG] [LOCAL ] TWI: Trimmed 38703 records to 24437 (keeping 150 days of data) [2025-09-15T20:48:48.750339] [DEBUG] [LOCAL ] TWI: Primary data saved (24437 records). [2025-09-15T20:48:48.750488] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-15T20:48:48.750588] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TWI took 30.4s. Estimated remaining: 22m 57s. Rate: 9.4 symbols/min [2025-09-15T20:48:48.794611] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:48:48.843055] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-15T20:48:48.922036] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:48:48.958431] [DEBUG] [LOCAL ] TXNM: Loaded 32680 existing records from primary storage. [2025-09-15T20:48:48.958568] [INFO ] [MAIN ] TXNM: Loaded 32680 existing records. [2025-09-15T20:48:49.133989] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:48:49.134343] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-15T20:48:49.134390] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-15T20:48:49.135265] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-15T20:48:49.135314] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-15T20:48:49.263058] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-15T20:48:49.504087] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:48:50.057898] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-15T20:48:50.823240] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T20:48:50.857868] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-15T20:48:51.211875] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T20:48:51.657877] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-15T20:48:51.800223] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T20:48:52.457891] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-15T20:48:53.075130] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T20:48:53.257941] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-15T20:48:53.709820] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T20:48:54.057875] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-15T20:48:54.858567] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-15T20:48:54.863918] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:48:55.168894] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T20:48:55.657875] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-15T20:48:56.188872] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:48:56.457855] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-15T20:48:56.754086] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T20:48:57.257875] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-15T20:48:57.828630] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T20:48:57.903138] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:48:58.057869] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-15T20:48:58.857868] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-15T20:48:59.657899] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-15T20:48:59.701136] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:49:00.165801] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T20:49:00.367289] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:49:00.457872] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-15T20:49:01.257883] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-15T20:49:01.953474] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T20:49:02.008989] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:49:02.057879] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-15T20:49:02.857860] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-15T20:49:03.293672] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T20:49:03.657883] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-15T20:49:04.438681] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T20:49:04.457803] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-15T20:49:04.545225] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T20:49:05.057442] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T20:49:05.058933] [INFO ] [REMOTE ] TWOD: Full fetch complete (4113 records). [2025-09-15T20:49:05.059005] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-15T20:49:05.235850] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 83 unique days, need 150 days [2025-09-15T20:49:05.236077] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:49:05.236178] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:49:05.236245] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-15T20:49:05.236350] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-15T20:49:05.236406] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-15T20:49:05.236482] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-15T20:49:05.236572] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TWOD took 20.8s. Estimated remaining: 22m 52s. Rate: 9.4 symbols/min [2025-09-15T20:49:05.265891] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-15T20:49:05.412432] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:05.432267] [DEBUG] [LOCAL ] TXO: Loaded 15084 existing records from primary storage. [2025-09-15T20:49:05.432392] [INFO ] [MAIN ] TXO: Loaded 15084 existing records. [2025-09-15T20:49:05.620318] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:05.620564] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-15T20:49:05.620610] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-15T20:49:05.621064] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-15T20:49:05.621112] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-15T20:49:05.966560] [INFO ] [REMOTE ] TXO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:06.057926] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-15T20:49:06.600231] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:49:06.719095] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T20:49:06.857882] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-15T20:49:07.657873] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-15T20:49:08.418987] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T20:49:08.424243] [INFO ] [REMOTE ] TWO: Full fetch complete (51979 records). [2025-09-15T20:49:08.424338] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-15T20:49:08.466714] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-15T20:49:08.804804] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-15T20:49:08.804900] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-15T20:49:08.805870] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-15T20:49:08.805921] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-15T20:49:08.807165] [DEBUG] [LOCAL ] TWO: Trimmed 51979 records to 35614 (keeping 150 days of data) [2025-09-15T20:49:09.030956] [DEBUG] [LOCAL ] TWO: Primary data saved (35614 records). [2025-09-15T20:49:09.031116] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-15T20:49:09.031202] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TWO took 34.5s. Estimated remaining: 22m 45s. Rate: 9.4 symbols/min [2025-09-15T20:49:09.206009] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:09.242351] [DEBUG] [LOCAL ] TXT: Loaded 37229 existing records from primary storage. [2025-09-15T20:49:09.242534] [INFO ] [MAIN ] TXT: Loaded 37229 existing records. [2025-09-15T20:49:09.274079] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-15T20:49:09.434872] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:09.435405] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-15T20:49:09.435502] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-15T20:49:09.436569] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-15T20:49:09.436633] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-15T20:49:09.588298] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T20:49:09.844266] [INFO ] [REMOTE ] TXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:09.859485] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T20:49:10.057887] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-15T20:49:10.151717] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:49:10.857879] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-15T20:49:11.620698] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:49:11.657828] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-15T20:49:12.457912] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-15T20:49:12.577475] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T20:49:13.068829] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T20:49:13.257888] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-15T20:49:13.401706] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T20:49:14.057859] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-15T20:49:14.199437] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T20:49:14.202007] [INFO ] [REMOTE ] TX: Full fetch complete (26928 records). [2025-09-15T20:49:14.202078] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-15T20:49:14.567557] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-15T20:49:14.567655] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-15T20:49:14.568272] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-15T20:49:14.568313] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-15T20:49:14.568994] [DEBUG] [LOCAL ] TX: Trimmed 26928 records to 16935 (keeping 150 days of data) [2025-09-15T20:49:14.672680] [DEBUG] [LOCAL ] TX: Primary data saved (16935 records). [2025-09-15T20:49:14.672842] [INFO ] [MAIN ] TX: Full history saved. [2025-09-15T20:49:14.672936] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TX took 27.2s. Estimated remaining: 22m 39s. Rate: 9.4 symbols/min [2025-09-15T20:49:14.846759] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:14.854388] [DEBUG] [LOCAL ] TY: Loaded 5557 existing records from primary storage. [2025-09-15T20:49:14.854493] [INFO ] [MAIN ] TY: Loaded 5557 existing records. [2025-09-15T20:49:14.865602] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-15T20:49:15.035212] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:15.035512] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-15T20:49:15.035575] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-15T20:49:15.035943] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-15T20:49:15.036017] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-15T20:49:15.397859] [INFO ] [REMOTE ] TY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:15.400841] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T20:49:15.406453] [INFO ] [REMOTE ] TXNM: Full fetch complete (47775 records). [2025-09-15T20:49:15.406711] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-15T20:49:15.664350] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-15T20:49:15.834429] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-15T20:49:15.834509] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-15T20:49:15.835451] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-15T20:49:15.835495] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-15T20:49:15.836521] [DEBUG] [LOCAL ] TXNM: Trimmed 47775 records to 32065 (keeping 150 days of data) [2025-09-15T20:49:16.037713] [DEBUG] [LOCAL ] TXNM: Primary data saved (32065 records). [2025-09-15T20:49:16.037888] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-15T20:49:16.038877] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TXNM took 27.3s. Estimated remaining: 22m 32s. Rate: 9.4 symbols/min [2025-09-15T20:49:16.400651] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T20:49:16.457836] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-15T20:49:16.896338] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T20:49:17.257917] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-15T20:49:18.057872] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-15T20:49:18.093449] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T20:49:18.109702] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T20:49:18.857954] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-15T20:49:19.096858] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T20:49:19.447675] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T20:49:19.657929] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-15T20:49:20.457894] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-15T20:49:20.827770] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T20:49:21.042328] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T20:49:21.257919] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-15T20:49:22.057936] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-15T20:49:22.299493] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T20:49:22.588915] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T20:49:22.857861] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-15T20:49:23.635500] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T20:49:23.657826] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-15T20:49:24.275964] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T20:49:24.457907] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-15T20:49:25.257942] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-15T20:49:25.869378] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T20:49:25.870615] [INFO ] [REMOTE ] TY: Full fetch complete (8508 records). [2025-09-15T20:49:25.870725] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-15T20:49:26.064174] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-15T20:49:26.242932] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-15T20:49:26.243081] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-15T20:49:26.243358] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-15T20:49:26.243435] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-15T20:49:26.244000] [DEBUG] [LOCAL ] TY: Trimmed 8508 records to 5431 (keeping 150 days of data) [2025-09-15T20:49:26.302501] [DEBUG] [LOCAL ] TY: Primary data saved (5431 records). [2025-09-15T20:49:26.303116] [INFO ] [MAIN ] TY: Full history saved. [2025-09-15T20:49:26.303215] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TY took 11.6s. Estimated remaining: 22m 26s. Rate: 9.4 symbols/min [2025-09-15T20:49:26.304178] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T20:49:26.857823] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-15T20:49:27.256182] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T20:49:27.657924] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-15T20:49:28.497261] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:49:28.508235] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-15T20:49:28.649504] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T20:49:28.651858] [INFO ] [REMOTE ] TXO: Full fetch complete (20754 records). [2025-09-15T20:49:28.651931] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-15T20:49:29.022194] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-15T20:49:29.022319] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-15T20:49:29.022821] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-15T20:49:29.022872] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-15T20:49:29.023556] [DEBUG] [LOCAL ] TXO: Trimmed 20754 records to 15063 (keeping 150 days of data) [2025-09-15T20:49:29.119328] [DEBUG] [LOCAL ] TXO: Primary data saved (15063 records). [2025-09-15T20:49:29.119469] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-15T20:49:29.119576] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TXO took 23.9s. Estimated remaining: 22m 19s. Rate: 9.4 symbols/min [2025-09-15T20:49:30.316616] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T20:49:30.327058] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-15T20:49:31.780330] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T20:49:31.785808] [INFO ] [REMOTE ] TXT: Full fetch complete (54230 records). [2025-09-15T20:49:31.785965] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-15T20:49:32.182525] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-15T20:49:32.182618] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-15T20:49:32.183582] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-15T20:49:32.183632] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-15T20:49:32.184824] [DEBUG] [LOCAL ] TXT: Trimmed 54230 records to 36537 (keeping 150 days of data) [2025-09-15T20:49:32.416778] [DEBUG] [LOCAL ] TXT: Primary data saved (36537 records). [2025-09-15T20:49:32.416918] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-15T20:49:32.417005] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TXT took 23.4s. Estimated remaining: 22m 12s. Rate: 9.4 symbols/min [2025-09-15T20:49:32.981065] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:33.079554] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:33.164309] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:33.170454] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:33.202304] [DEBUG] [LOCAL ] TYG: Loaded 10517 existing records from primary storage. [2025-09-15T20:49:33.202500] [INFO ] [MAIN ] TYG: Loaded 10517 existing records. [2025-09-15T20:49:33.311516] [DEBUG] [LOCAL ] TYL: Loaded 16551 existing records from primary storage. [2025-09-15T20:49:33.323684] [DEBUG] [LOCAL ] UA: Loaded 37590 existing records from primary storage. [2025-09-15T20:49:33.354778] [INFO ] [MAIN ] TYL: Loaded 16551 existing records. [2025-09-15T20:49:33.355826] [DEBUG] [LOCAL ] U: Loaded 40539 existing records from primary storage. [2025-09-15T20:49:33.354994] [INFO ] [MAIN ] UA: Loaded 37590 existing records. [2025-09-15T20:49:33.405125] [INFO ] [MAIN ] U: Loaded 40539 existing records. [2025-09-15T20:49:33.677952] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:33.743309] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-15T20:49:33.752685] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-15T20:49:33.790737] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-15T20:49:33.826869] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-15T20:49:33.952343] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:34.016737] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:34.057272] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-15T20:49:34.057502] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-15T20:49:34.067045] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:34.067238] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-15T20:49:34.087805] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-15T20:49:34.098345] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-15T20:49:34.098240] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-15T20:49:34.093017] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-15T20:49:34.122212] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-15T20:49:34.129041] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-15T20:49:34.138744] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-15T20:49:34.246845] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-15T20:49:34.299577] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-15T20:49:35.337937] [INFO ] [REMOTE ] TYG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:35.414437] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-15T20:49:35.413757] [INFO ] [REMOTE ] TYL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:35.453914] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-15T20:49:35.565197] [INFO ] [REMOTE ] UA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:35.582517] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-15T20:49:35.586783] [INFO ] [REMOTE ] U: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:35.588493] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-15T20:49:36.494231] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T20:49:36.498560] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-15T20:49:36.700288] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T20:49:36.703859] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-15T20:49:36.921952] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T20:49:36.931522] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-15T20:49:37.595499] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-15T20:49:37.605744] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-15T20:49:37.739533] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T20:49:37.743370] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-15T20:49:37.774559] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T20:49:37.779934] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-15T20:49:38.406451] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:49:38.417320] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-15T20:49:38.563750] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T20:49:38.857883] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-15T20:49:39.066124] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T20:49:39.564748] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T20:49:39.657925] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-15T20:49:39.865427] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:49:40.075386] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-15T20:49:40.457941] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-15T20:49:40.516841] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T20:49:41.257950] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-15T20:49:41.997447] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T20:49:42.057847] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-15T20:49:42.063456] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T20:49:42.857880] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-15T20:49:43.541318] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T20:49:43.657875] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-15T20:49:43.813207] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T20:49:44.457877] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-15T20:49:45.187363] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T20:49:45.189673] [INFO ] [REMOTE ] TYG: Full fetch complete (16088 records). [2025-09-15T20:49:45.189798] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-15T20:49:45.262291] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-15T20:49:45.565014] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-15T20:49:45.565106] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-15T20:49:45.565448] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-15T20:49:45.565585] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-15T20:49:45.584062] [DEBUG] [LOCAL ] TYG: Trimmed 16088 records to 10317 (keeping 150 days of data) [2025-09-15T20:49:45.602909] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T20:49:45.677680] [DEBUG] [LOCAL ] TYG: Primary data saved (10317 records). [2025-09-15T20:49:45.677828] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-15T20:49:45.677940] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYG took 13.3s. Estimated remaining: 22m 7s. Rate: 9.4 symbols/min [2025-09-15T20:49:45.861540] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:45.903841] [DEBUG] [LOCAL ] UAA: Loaded 40267 existing records from primary storage. [2025-09-15T20:49:45.903986] [INFO ] [MAIN ] UAA: Loaded 40267 existing records. [2025-09-15T20:49:46.084043] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-15T20:49:46.089567] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:46.089822] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-15T20:49:46.089867] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-15T20:49:46.090567] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-15T20:49:46.090689] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-15T20:49:46.453351] [INFO ] [REMOTE ] UAA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:46.857892] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-15T20:49:47.379868] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T20:49:47.633127] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-15T20:49:47.657837] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-15T20:49:48.457890] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-15T20:49:48.562024] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T20:49:48.832773] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T20:49:49.257887] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-15T20:49:50.049896] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T20:49:50.059556] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-15T20:49:50.857940] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-15T20:49:51.026277] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T20:49:51.251277] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T20:49:51.657907] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-15T20:49:52.440084] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T20:49:52.457856] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-15T20:49:53.257844] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-15T20:49:53.654997] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T20:49:53.785170] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-15T20:49:54.057869] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-15T20:49:54.857859] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-15T20:49:54.881222] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T20:49:54.883693] [INFO ] [REMOTE ] TYL: Full fetch complete (24321 records). [2025-09-15T20:49:54.883824] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-15T20:49:55.254922] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-15T20:49:55.255076] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-15T20:49:55.255767] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-15T20:49:55.255885] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-15T20:49:55.256693] [DEBUG] [LOCAL ] TYL: Trimmed 24321 records to 16329 (keeping 150 days of data) [2025-09-15T20:49:55.332481] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-15T20:49:55.403140] [DEBUG] [LOCAL ] TYL: Primary data saved (16329 records). [2025-09-15T20:49:55.403267] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-15T20:49:55.403384] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYL took 23.0s. Estimated remaining: 22m 1s. Rate: 9.4 symbols/min [2025-09-15T20:49:55.581082] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:55.587068] [DEBUG] [LOCAL ] UAN: Loaded 3947 existing records from primary storage. [2025-09-15T20:49:55.587211] [INFO ] [MAIN ] UAN: Loaded 3947 existing records. [2025-09-15T20:49:55.663663] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-15T20:49:55.769013] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:55.769256] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-15T20:49:55.769302] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-15T20:49:55.769525] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-15T20:49:55.769592] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-15T20:49:56.120783] [INFO ] [REMOTE ] UAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:56.337166] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T20:49:56.342936] [INFO ] [REMOTE ] UA: Full fetch complete (54694 records). [2025-09-15T20:49:56.343021] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-15T20:49:56.463028] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-15T20:49:56.717081] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-15T20:49:56.717162] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-15T20:49:56.718124] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-15T20:49:56.718168] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-15T20:49:56.719280] [DEBUG] [LOCAL ] UA: Trimmed 54694 records to 36851 (keeping 150 days of data) [2025-09-15T20:49:56.940073] [DEBUG] [LOCAL ] UA: Primary data saved (36851 records). [2025-09-15T20:49:56.940362] [INFO ] [MAIN ] UA: Full history saved. [2025-09-15T20:49:56.940544] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UA took 24.5s. Estimated remaining: 21m 54s. Rate: 9.4 symbols/min [2025-09-15T20:49:57.119382] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:49:57.161213] [DEBUG] [LOCAL ] UBER: Loaded 40546 existing records from primary storage. [2025-09-15T20:49:57.161453] [INFO ] [MAIN ] UBER: Loaded 40546 existing records. [2025-09-15T20:49:57.264731] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-15T20:49:57.354476] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:49:57.354956] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-15T20:49:57.355014] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-15T20:49:57.355927] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-15T20:49:57.355996] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-15T20:49:57.725603] [INFO ] [REMOTE ] UBER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:49:57.843702] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T20:49:58.057885] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-15T20:49:58.178976] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-15T20:49:58.376856] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T20:49:58.857872] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-15T20:49:59.524684] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T20:49:59.657876] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-15T20:50:00.328428] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T20:50:00.388053] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-15T20:50:00.457909] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-15T20:50:01.257881] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-15T20:50:02.057887] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-15T20:50:02.857908] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-15T20:50:02.905329] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T20:50:03.167705] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-15T20:50:03.235165] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T20:50:03.657859] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-15T20:50:04.457926] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-15T20:50:05.241191] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T20:50:05.257842] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-15T20:50:05.295493] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-15T20:50:06.057902] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-15T20:50:06.116658] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-15T20:50:06.857876] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-15T20:50:07.410166] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T20:50:07.657888] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-15T20:50:08.077567] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-15T20:50:08.083412] [INFO ] [REMOTE ] U: Full fetch complete (58479 records). [2025-09-15T20:50:08.083516] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-15T20:50:08.463417] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-15T20:50:08.507132] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-15T20:50:08.507236] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-15T20:50:08.508547] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-15T20:50:08.508683] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-15T20:50:08.510327] [DEBUG] [LOCAL ] U: Trimmed 58479 records to 39759 (keeping 150 days of data) [2025-09-15T20:50:08.782076] [DEBUG] [LOCAL ] U: Primary data saved (39759 records). [2025-09-15T20:50:08.782242] [INFO ] [MAIN ] U: Full history saved. [2025-09-15T20:50:08.782398] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 36.4s. Estimated remaining: 21m 48s. Rate: 9.4 symbols/min [2025-09-15T20:50:08.951150] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:08.989747] [DEBUG] [LOCAL ] UBS: Loaded 39338 existing records from primary storage. [2025-09-15T20:50:08.989895] [INFO ] [MAIN ] UBS: Loaded 39338 existing records. [2025-09-15T20:50:09.163693] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:09.163936] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-15T20:50:09.163982] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-15T20:50:09.164764] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-15T20:50:09.164814] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-15T20:50:09.290871] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T20:50:09.345221] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-15T20:50:09.533845] [INFO ] [REMOTE ] UBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:09.612888] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-15T20:50:09.616471] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T20:50:09.922566] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T20:50:10.057894] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-15T20:50:10.857869] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-15T20:50:11.580117] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T20:50:11.586000] [INFO ] [REMOTE ] UAA: Full fetch complete (58191 records). [2025-09-15T20:50:11.586098] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-15T20:50:11.663046] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-15T20:50:11.999599] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-15T20:50:11.999745] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-15T20:50:12.001058] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-15T20:50:12.001127] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-15T20:50:12.002564] [DEBUG] [LOCAL ] UAA: Trimmed 58191 records to 39487 (keeping 150 days of data) [2025-09-15T20:50:12.208720] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T20:50:12.212531] [INFO ] [REMOTE ] UAN: Full fetch complete (5996 records). [2025-09-15T20:50:12.213946] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-15T20:50:12.459067] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-15T20:50:12.608816] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-15T20:50:12.609184] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-15T20:50:12.609619] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-15T20:50:12.610307] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-15T20:50:12.613534] [DEBUG] [LOCAL ] UAN: Trimmed 5996 records to 3850 (keeping 150 days of data) [2025-09-15T20:50:12.638442] [DEBUG] [LOCAL ] UAA: Primary data saved (39487 records). [2025-09-15T20:50:12.649110] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-15T20:50:12.652387] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UAA took 27.0s. Estimated remaining: 21m 41s. Rate: 9.4 symbols/min [2025-09-15T20:50:12.793075] [DEBUG] [LOCAL ] UAN: Primary data saved (3850 records). [2025-09-15T20:50:12.836851] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-15T20:50:12.839582] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UAN took 17.4s. Estimated remaining: 21m 34s. Rate: 9.4 symbols/min [2025-09-15T20:50:12.841211] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:13.025994] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:13.039075] [DEBUG] [LOCAL ] UCB: Loaded 27887 existing records from primary storage. [2025-09-15T20:50:13.039347] [INFO ] [MAIN ] UCB: Loaded 27887 existing records. [2025-09-15T20:50:13.261111] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:13.261921] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-15T20:50:13.262001] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-15T20:50:13.262838] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-15T20:50:13.262920] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-15T20:50:13.361317] [DEBUG] [LOCAL ] UDR: Loaded 39067 existing records from primary storage. [2025-09-15T20:50:13.372241] [INFO ] [MAIN ] UDR: Loaded 39067 existing records. [2025-09-15T20:50:13.729726] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:13.763347] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-15T20:50:13.798208] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-15T20:50:13.838521] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-15T20:50:13.858000] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-09-15T20:50:13.858253] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-15T20:50:13.861879] [INFO ] [REMOTE ] UCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:13.905071] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-15T20:50:14.059188] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-15T20:50:14.264222] [INFO ] [REMOTE ] UDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:14.300012] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T20:50:14.857870] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-15T20:50:15.350188] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:50:15.657863] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-15T20:50:16.457928] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-15T20:50:16.606814] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T20:50:16.795089] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-15T20:50:17.185944] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T20:50:17.257844] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-15T20:50:17.680917] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T20:50:18.057882] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-15T20:50:18.862982] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-15T20:50:18.878596] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T20:50:19.631742] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T20:50:19.657818] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-15T20:50:20.457877] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-15T20:50:21.130297] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-15T20:50:21.249714] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:50:21.260145] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-15T20:50:21.821668] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:50:21.956084] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T20:50:21.961983] [INFO ] [REMOTE ] UBER: Full fetch complete (58486 records). [2025-09-15T20:50:21.962092] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-15T20:50:22.061942] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-15T20:50:22.362097] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-15T20:50:22.362201] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-15T20:50:22.363234] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-15T20:50:22.363285] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-15T20:50:22.364717] [DEBUG] [LOCAL ] UBER: Trimmed 58486 records to 39766 (keeping 150 days of data) [2025-09-15T20:50:22.620245] [DEBUG] [LOCAL ] UBER: Primary data saved (39766 records). [2025-09-15T20:50:22.620392] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-15T20:50:22.620498] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UBER took 25.7s. Estimated remaining: 21m 28s. Rate: 9.4 symbols/min [2025-09-15T20:50:22.791114] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:22.825231] [DEBUG] [LOCAL ] UE: Loaded 32294 existing records from primary storage. [2025-09-15T20:50:22.825369] [INFO ] [MAIN ] UE: Loaded 32294 existing records. [2025-09-15T20:50:22.867581] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-15T20:50:23.002081] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:23.002395] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-15T20:50:23.002444] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-15T20:50:23.003071] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-15T20:50:23.003120] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-15T20:50:23.350448] [INFO ] [REMOTE ] UE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:23.657895] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-15T20:50:23.762039] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T20:50:24.457827] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-15T20:50:24.505364] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T20:50:25.228984] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T20:50:25.257945] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-15T20:50:25.960141] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:50:26.057901] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-15T20:50:26.716943] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:50:26.857868] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-15T20:50:27.657892] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-15T20:50:27.750167] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T20:50:28.457909] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-15T20:50:28.533147] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T20:50:28.605631] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:50:29.257912] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-15T20:50:30.057879] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-15T20:50:30.277369] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T20:50:30.535724] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T20:50:30.541542] [INFO ] [REMOTE ] UCB: Full fetch complete (40991 records). [2025-09-15T20:50:30.541693] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-15T20:50:30.874482] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-15T20:50:30.920923] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-15T20:50:30.920994] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-15T20:50:30.921824] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-15T20:50:30.921869] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-15T20:50:30.922891] [DEBUG] [LOCAL ] UCB: Trimmed 40991 records to 27259 (keeping 150 days of data) [2025-09-15T20:50:31.103654] [DEBUG] [LOCAL ] UCB: Primary data saved (27259 records). [2025-09-15T20:50:31.103849] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-15T20:50:31.104022] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UCB took 18.5s. Estimated remaining: 21m 22s. Rate: 9.4 symbols/min [2025-09-15T20:50:31.271960] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:31.279589] [DEBUG] [LOCAL ] UFI: Loaded 5775 existing records from primary storage. [2025-09-15T20:50:31.279722] [INFO ] [MAIN ] UFI: Loaded 5775 existing records. [2025-09-15T20:50:31.455392] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:31.455841] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-15T20:50:31.455983] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-15T20:50:31.456285] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-15T20:50:31.456342] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-15T20:50:31.666242] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-15T20:50:31.856434] [INFO ] [REMOTE ] UFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:31.858970] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T20:50:32.278319] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T20:50:32.457907] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-15T20:50:33.161786] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:50:33.257941] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-15T20:50:33.540730] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T20:50:34.057942] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-15T20:50:34.809805] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:50:34.857864] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-15T20:50:34.932157] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T20:50:35.657887] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-15T20:50:36.457949] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-15T20:50:36.505827] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T20:50:36.512349] [INFO ] [REMOTE ] UBS: Full fetch complete (57029 records). [2025-09-15T20:50:36.512463] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-15T20:50:36.891760] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-15T20:50:36.891847] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-15T20:50:36.892838] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-15T20:50:36.892883] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-15T20:50:36.894207] [DEBUG] [LOCAL ] UBS: Trimmed 57029 records to 38554 (keeping 150 days of data) [2025-09-15T20:50:37.142056] [DEBUG] [LOCAL ] UBS: Primary data saved (38554 records). [2025-09-15T20:50:37.142214] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-15T20:50:37.143842] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UBS took 28.4s. Estimated remaining: 21m 16s. Rate: 9.4 symbols/min [2025-09-15T20:50:37.261693] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-15T20:50:37.332571] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:37.341420] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T20:50:37.371777] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T20:50:37.419114] [DEBUG] [LOCAL ] UGI: Loaded 37909 existing records from primary storage. [2025-09-15T20:50:37.419261] [INFO ] [MAIN ] UGI: Loaded 37909 existing records. [2025-09-15T20:50:37.599356] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:37.599599] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-15T20:50:37.599663] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-15T20:50:37.600407] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-15T20:50:37.600454] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-15T20:50:37.950596] [INFO ] [REMOTE ] UGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:38.057812] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-15T20:50:38.857871] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-15T20:50:38.993913] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T20:50:39.569402] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:50:39.657880] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-15T20:50:40.116627] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T20:50:40.457938] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-15T20:50:41.180572] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T20:50:41.257882] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-15T20:50:41.631535] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T20:50:42.057874] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-15T20:50:42.756130] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:50:42.761741] [INFO ] [REMOTE ] UDR: Full fetch complete (56174 records). [2025-09-15T20:50:42.761836] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-15T20:50:42.863199] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-15T20:50:43.158813] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-15T20:50:43.158931] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-15T20:50:43.159986] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-15T20:50:43.160036] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-15T20:50:43.161493] [DEBUG] [LOCAL ] UDR: Trimmed 56174 records to 38309 (keeping 150 days of data) [2025-09-15T20:50:43.422846] [DEBUG] [LOCAL ] UDR: Primary data saved (38309 records). [2025-09-15T20:50:43.423016] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-15T20:50:43.423110] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 30.6s. Estimated remaining: 21m 9s. Rate: 9.4 symbols/min [2025-09-15T20:50:43.596845] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:43.629616] [DEBUG] [LOCAL ] UGP: Loaded 32057 existing records from primary storage. [2025-09-15T20:50:43.629780] [INFO ] [MAIN ] UGP: Loaded 32057 existing records. [2025-09-15T20:50:43.662979] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-15T20:50:43.819555] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:43.820759] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T20:50:43.824481] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-15T20:50:43.824582] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-15T20:50:43.825215] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-15T20:50:43.825274] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-15T20:50:44.202366] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-15T20:50:44.235793] [INFO ] [REMOTE ] UGP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:44.457882] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-15T20:50:45.053572] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T20:50:45.058702] [INFO ] [REMOTE ] UE: Full fetch complete (46653 records). [2025-09-15T20:50:45.058840] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-15T20:50:45.266401] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-15T20:50:45.459220] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-15T20:50:45.459304] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-15T20:50:45.460263] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-15T20:50:45.460310] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-15T20:50:45.461380] [DEBUG] [LOCAL ] UE: Trimmed 46653 records to 31668 (keeping 150 days of data) [2025-09-15T20:50:45.666449] [DEBUG] [LOCAL ] UE: Primary data saved (31668 records). [2025-09-15T20:50:45.666775] [INFO ] [MAIN ] UE: Full history saved. [2025-09-15T20:50:45.666933] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UE took 23.0s. Estimated remaining: 21m 2s. Rate: 9.4 symbols/min [2025-09-15T20:50:45.836156] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T20:50:45.867604] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:45.881185] [DEBUG] [LOCAL ] UHAL: Loaded 12351 existing records from primary storage. [2025-09-15T20:50:45.881323] [INFO ] [MAIN ] UHAL: Loaded 12351 existing records. [2025-09-15T20:50:46.061139] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-15T20:50:46.061028] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:46.062388] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-15T20:50:46.062489] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-15T20:50:46.063018] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-15T20:50:46.063089] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-15T20:50:46.380312] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T20:50:46.454881] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:46.857866] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-15T20:50:47.657896] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-15T20:50:48.045447] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T20:50:48.260156] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T20:50:48.457914] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-15T20:50:48.562862] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T20:50:49.257889] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-15T20:50:50.057839] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-15T20:50:50.165055] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T20:50:50.326838] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T20:50:50.807044] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T20:50:50.857821] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-15T20:50:51.518989] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T20:50:51.657864] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-15T20:50:52.457895] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-15T20:50:53.203880] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T20:50:53.257883] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-15T20:50:53.311436] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T20:50:54.057942] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-15T20:50:54.758161] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T20:50:54.857828] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-15T20:50:55.663014] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-15T20:50:55.667882] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:50:55.770287] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T20:50:56.457883] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-15T20:50:57.115779] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T20:50:57.150426] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:50:57.151794] [INFO ] [REMOTE ] UFI: Full fetch complete (9193 records). [2025-09-15T20:50:57.151864] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-15T20:50:57.262996] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-15T20:50:57.515671] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-15T20:50:57.515757] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-15T20:50:57.515978] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-15T20:50:57.516019] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-15T20:50:57.516464] [DEBUG] [LOCAL ] UFI: Trimmed 9193 records to 5449 (keeping 150 days of data) [2025-09-15T20:50:57.548543] [DEBUG] [LOCAL ] UFI: Primary data saved (5449 records). [2025-09-15T20:50:57.548696] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-15T20:50:57.548795] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UFI took 26.4s. Estimated remaining: 20m 57s. Rate: 9.4 symbols/min [2025-09-15T20:50:57.719887] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:50:57.754812] [DEBUG] [LOCAL ] UHS: Loaded 30491 existing records from primary storage. [2025-09-15T20:50:57.754956] [INFO ] [MAIN ] UHS: Loaded 30491 existing records. [2025-09-15T20:50:57.931373] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:50:57.931659] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-15T20:50:57.931710] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-15T20:50:57.932385] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-15T20:50:57.932431] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-15T20:50:58.070871] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-15T20:50:58.289106] [INFO ] [REMOTE ] UHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:50:58.857859] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-15T20:50:59.043325] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T20:50:59.100712] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T20:50:59.657859] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-15T20:51:00.122823] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T20:51:00.457876] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-15T20:51:01.220853] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T20:51:01.257833] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-15T20:51:01.295519] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:51:02.057870] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-15T20:51:02.459879] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T20:51:02.857855] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-15T20:51:03.657901] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-15T20:51:04.457830] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-15T20:51:04.839864] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-15T20:51:04.845334] [INFO ] [REMOTE ] UGP: Full fetch complete (46399 records). [2025-09-15T20:51:04.845572] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-15T20:51:05.056090] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-09-15T20:51:05.276443] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-15T20:51:05.294590] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T20:51:05.303055] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-15T20:51:05.303523] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-15T20:51:05.305034] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-15T20:51:05.305121] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-15T20:51:05.307237] [DEBUG] [LOCAL ] UGP: Trimmed 46399 records to 31451 (keeping 150 days of data) [2025-09-15T20:51:05.498924] [DEBUG] [LOCAL ] UGP: Primary data saved (31451 records). [2025-09-15T20:51:05.499089] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-15T20:51:05.499183] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UGP took 22.1s. Estimated remaining: 20m 50s. Rate: 9.4 symbols/min [2025-09-15T20:51:05.666292] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:05.675056] [DEBUG] [LOCAL ] UHT: Loaded 7207 existing records from primary storage. [2025-09-15T20:51:05.675168] [INFO ] [MAIN ] UHT: Loaded 7207 existing records. [2025-09-15T20:51:05.859158] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:05.859406] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-15T20:51:05.859452] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-15T20:51:05.859742] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-15T20:51:05.859795] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-15T20:51:06.075570] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-15T20:51:06.245298] [INFO ] [REMOTE ] UHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:06.286369] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T20:51:06.772244] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T20:51:06.778340] [INFO ] [REMOTE ] UGI: Full fetch complete (55016 records). [2025-09-15T20:51:06.778510] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-15T20:51:06.862960] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-15T20:51:07.198502] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-15T20:51:07.198702] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-15T20:51:07.199699] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-15T20:51:07.199756] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-15T20:51:07.211113] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T20:51:07.214624] [DEBUG] [LOCAL ] UGI: Trimmed 55016 records to 37175 (keeping 150 days of data) [2025-09-15T20:51:07.452465] [DEBUG] [LOCAL ] UGI: Primary data saved (37175 records). [2025-09-15T20:51:07.452620] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-15T20:51:07.453372] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UGI took 30.3s. Estimated remaining: 20m 44s. Rate: 9.4 symbols/min [2025-09-15T20:51:07.619222] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:07.630726] [DEBUG] [LOCAL ] UI: Loaded 9559 existing records from primary storage. [2025-09-15T20:51:07.630856] [INFO ] [MAIN ] UI: Loaded 9559 existing records. [2025-09-15T20:51:07.662928] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-15T20:51:07.812704] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:07.813027] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-15T20:51:07.813083] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-15T20:51:07.813437] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-15T20:51:07.813484] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-15T20:51:08.168043] [INFO ] [REMOTE ] UI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:08.457846] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-15T20:51:08.526816] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T20:51:08.559909] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T20:51:09.257932] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-15T20:51:09.503163] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T20:51:09.507415] [INFO ] [REMOTE ] UHAL: Full fetch complete (17143 records). [2025-09-15T20:51:09.507666] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-15T20:51:09.878250] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-15T20:51:09.878327] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-15T20:51:09.878706] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-15T20:51:09.878748] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-15T20:51:09.879281] [DEBUG] [LOCAL ] UHAL: Trimmed 17143 records to 12188 (keeping 150 days of data) [2025-09-15T20:51:09.952249] [DEBUG] [LOCAL ] UHAL: Primary data saved (12188 records). [2025-09-15T20:51:09.952404] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-15T20:51:09.952519] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UHAL took 24.3s. Estimated remaining: 20m 37s. Rate: 9.4 symbols/min [2025-09-15T20:51:10.063132] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-15T20:51:10.129509] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:10.157171] [DEBUG] [LOCAL ] UIS: Loaded 27885 existing records from primary storage. [2025-09-15T20:51:10.157357] [INFO ] [MAIN ] UIS: Loaded 27885 existing records. [2025-09-15T20:51:10.330039] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:10.330412] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-15T20:51:10.330461] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-15T20:51:10.331305] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-15T20:51:10.331355] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-15T20:51:10.683375] [INFO ] [REMOTE ] UIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:10.748842] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T20:51:10.857934] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-15T20:51:11.078681] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T20:51:11.657927] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-15T20:51:12.010805] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T20:51:12.457880] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-15T20:51:13.257918] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-15T20:51:13.423883] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T20:51:13.710819] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T20:51:14.057895] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-15T20:51:14.857892] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-15T20:51:14.906947] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T20:51:15.600439] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T20:51:15.657863] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-15T20:51:15.995165] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T20:51:16.393797] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T20:51:16.457857] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-15T20:51:17.257888] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-15T20:51:17.416571] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T20:51:18.057853] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-15T20:51:18.533221] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T20:51:18.857873] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-15T20:51:18.923435] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T20:51:19.657900] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-15T20:51:20.328269] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T20:51:20.409472] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:51:20.457897] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-15T20:51:21.257891] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-15T20:51:21.679862] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T20:51:22.057909] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-15T20:51:22.554717] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:51:22.559570] [INFO ] [REMOTE ] UHS: Full fetch complete (45338 records). [2025-09-15T20:51:22.559784] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-15T20:51:22.863437] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-15T20:51:22.958194] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-15T20:51:22.958292] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-15T20:51:22.959411] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-15T20:51:22.959460] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-15T20:51:22.960560] [DEBUG] [LOCAL ] UHS: Trimmed 45338 records to 29995 (keeping 150 days of data) [2025-09-15T20:51:23.161988] [DEBUG] [LOCAL ] UHS: Primary data saved (29995 records). [2025-09-15T20:51:23.162146] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-15T20:51:23.163101] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UHS took 25.6s. Estimated remaining: 20m 31s. Rate: 9.4 symbols/min [2025-09-15T20:51:23.341887] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:23.368059] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:51:23.427798] [DEBUG] [LOCAL ] UL: Loaded 39887 existing records from primary storage. [2025-09-15T20:51:23.427952] [INFO ] [MAIN ] UL: Loaded 39887 existing records. [2025-09-15T20:51:23.616239] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:23.616528] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-15T20:51:23.616578] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-15T20:51:23.617387] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-15T20:51:23.617447] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-15T20:51:23.662972] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-15T20:51:23.909970] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T20:51:23.995332] [INFO ] [REMOTE ] UL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:24.419620] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T20:51:24.457818] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-15T20:51:25.257905] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-15T20:51:25.304836] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T20:51:26.057950] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-15T20:51:26.312685] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T20:51:26.857949] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-15T20:51:27.395614] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T20:51:27.397768] [INFO ] [REMOTE ] UI: Full fetch complete (13730 records). [2025-09-15T20:51:27.397846] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-15T20:51:27.660617] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-15T20:51:27.776991] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-15T20:51:27.777180] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-15T20:51:27.777539] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-15T20:51:27.777586] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-15T20:51:27.778291] [DEBUG] [LOCAL ] UI: Trimmed 13730 records to 9436 (keeping 150 days of data) [2025-09-15T20:51:27.874483] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T20:51:27.886878] [DEBUG] [LOCAL ] UI: Primary data saved (9436 records). [2025-09-15T20:51:27.887036] [INFO ] [MAIN ] UI: Full history saved. [2025-09-15T20:51:27.887146] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UI took 20.4s. Estimated remaining: 20m 25s. Rate: 9.4 symbols/min [2025-09-15T20:51:28.060898] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:28.094950] [DEBUG] [LOCAL ] ULS: Loaded 29571 existing records from primary storage. [2025-09-15T20:51:28.095096] [INFO ] [MAIN ] ULS: Loaded 29571 existing records. [2025-09-15T20:51:28.272996] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:28.273278] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-15T20:51:28.273328] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-15T20:51:28.273956] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-15T20:51:28.274010] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-15T20:51:28.467987] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-15T20:51:28.641825] [INFO ] [REMOTE ] ULS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:29.238565] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T20:51:29.257820] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-15T20:51:30.057927] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-15T20:51:30.503257] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T20:51:30.641259] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:51:30.857856] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-15T20:51:31.167120] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T20:51:31.657881] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-15T20:51:32.457875] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-15T20:51:32.740932] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T20:51:33.120745] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T20:51:33.141353] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T20:51:33.257887] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-15T20:51:34.057922] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-15T20:51:34.572431] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T20:51:34.578807] [INFO ] [REMOTE ] UIS: Full fetch complete (40466 records). [2025-09-15T20:51:34.578987] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-15T20:51:34.862948] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-15T20:51:34.991181] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-15T20:51:34.991261] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-15T20:51:34.992080] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-15T20:51:34.992133] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-15T20:51:34.993096] [DEBUG] [LOCAL ] UIS: Trimmed 40466 records to 27492 (keeping 150 days of data) [2025-09-15T20:51:35.147994] [DEBUG] [LOCAL ] UIS: Primary data saved (27492 records). [2025-09-15T20:51:35.148128] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-15T20:51:35.148212] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UIS took 25.2s. Estimated remaining: 20m 18s. Rate: 9.4 symbols/min [2025-09-15T20:51:35.325677] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:35.361006] [DEBUG] [LOCAL ] UMC: Loaded 39585 existing records from primary storage. [2025-09-15T20:51:35.361158] [INFO ] [MAIN ] UMC: Loaded 39585 existing records. [2025-09-15T20:51:35.547825] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:35.548065] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-15T20:51:35.548112] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-15T20:51:35.548876] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-15T20:51:35.548927] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-15T20:51:35.658276] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-15T20:51:35.776846] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T20:51:35.825475] [INFO ] [REMOTE ] UHT: Full fetch complete (10714 records). [2025-09-15T20:51:35.844368] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-15T20:51:36.037634] [INFO ] [REMOTE ] UMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:36.265376] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-15T20:51:36.340569] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-15T20:51:36.340664] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-15T20:51:36.340916] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-15T20:51:36.340978] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-15T20:51:36.341427] [DEBUG] [LOCAL ] UHT: Trimmed 10714 records to 7121 (keeping 150 days of data) [2025-09-15T20:51:36.386673] [DEBUG] [LOCAL ] UHT: Primary data saved (7121 records). [2025-09-15T20:51:36.386838] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-15T20:51:36.386945] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. UHT took 30.9s. Estimated remaining: 20m 11s. Rate: 9.4 symbols/min [2025-09-15T20:51:36.462998] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-15T20:51:36.560266] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:36.583955] [DEBUG] [LOCAL ] UMH: Loaded 24551 existing records from primary storage. [2025-09-15T20:51:36.584112] [INFO ] [MAIN ] UMH: Loaded 24551 existing records. [2025-09-15T20:51:36.770565] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:36.770859] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-15T20:51:36.770906] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-15T20:51:36.771458] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-15T20:51:36.771505] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-15T20:51:37.119148] [INFO ] [REMOTE ] UMH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:37.240834] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T20:51:37.257813] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-15T20:51:38.057950] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-15T20:51:38.214402] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T20:51:38.726873] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T20:51:38.857850] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-15T20:51:39.586402] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T20:51:39.657828] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-15T20:51:40.442724] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T20:51:40.457810] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-15T20:51:41.257846] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-15T20:51:41.495086] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T20:51:41.929631] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T20:51:42.057866] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-15T20:51:42.857881] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-15T20:51:42.945767] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T20:51:43.500244] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T20:51:43.657843] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-15T20:51:43.673188] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T20:51:44.457886] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-15T20:51:45.264738] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-15T20:51:45.269570] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T20:51:45.837589] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T20:51:46.057877] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-15T20:51:46.857913] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-15T20:51:47.054312] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T20:51:47.460706] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T20:51:47.657886] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-15T20:51:48.111273] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:51:48.116096] [INFO ] [REMOTE ] ULS: Full fetch complete (42412 records). [2025-09-15T20:51:48.116251] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-15T20:51:48.462957] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-15T20:51:48.502663] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-15T20:51:48.502800] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-15T20:51:48.503753] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-15T20:51:48.503800] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-15T20:51:48.504923] [DEBUG] [LOCAL ] ULS: Trimmed 42412 records to 28897 (keeping 150 days of data) [2025-09-15T20:51:48.694183] [DEBUG] [LOCAL ] ULS: Primary data saved (28897 records). [2025-09-15T20:51:48.694336] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-15T20:51:48.694452] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. ULS took 20.8s. Estimated remaining: 20m 6s. Rate: 9.4 symbols/min [2025-09-15T20:51:48.863949] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:48.873848] [DEBUG] [LOCAL ] UNF: Loaded 7992 existing records from primary storage. [2025-09-15T20:51:48.873972] [INFO ] [MAIN ] UNF: Loaded 7992 existing records. [2025-09-15T20:51:49.051891] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:49.052162] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-15T20:51:49.052209] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-15T20:51:49.052548] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-15T20:51:49.052633] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-15T20:51:49.263467] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-15T20:51:49.419272] [INFO ] [REMOTE ] UNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:50.057932] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-15T20:51:50.546138] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-15T20:51:50.552206] [INFO ] [REMOTE ] UL: Full fetch complete (57724 records). [2025-09-15T20:51:50.552441] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-15T20:51:50.975874] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-15T20:51:50.973992] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-15T20:51:50.986999] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-15T20:51:50.988539] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-15T20:51:50.988788] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-15T20:51:50.989524] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-15T20:51:50.996116] [DEBUG] [LOCAL ] UL: Trimmed 57724 records to 39105 (keeping 150 days of data) [2025-09-15T20:51:50.998042] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T20:51:51.257970] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T20:51:51.301878] [DEBUG] [LOCAL ] UL: Primary data saved (39105 records). [2025-09-15T20:51:51.302111] [INFO ] [MAIN ] UL: Full history saved. [2025-09-15T20:51:51.302799] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. UL took 28.1s. Estimated remaining: 19m 59s. Rate: 9.4 symbols/min [2025-09-15T20:51:51.478781] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:51:51.521909] [DEBUG] [LOCAL ] UNFI: Loaded 31533 existing records from primary storage. [2025-09-15T20:51:51.522190] [INFO ] [MAIN ] UNFI: Loaded 31533 existing records. [2025-09-15T20:51:51.663150] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-15T20:51:51.704769] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:51:51.705078] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-15T20:51:51.705128] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-15T20:51:51.705905] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-15T20:51:51.705982] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-15T20:51:52.134277] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:51:52.457902] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-15T20:51:52.652040] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T20:51:52.794126] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T20:51:53.220035] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:51:53.257857] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-15T20:51:54.057919] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-15T20:51:54.284999] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T20:51:54.857925] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-15T20:51:55.529547] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T20:51:55.544828] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T20:51:55.657874] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-15T20:51:56.457933] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-15T20:51:57.214888] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T20:51:57.257880] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-15T20:51:57.950510] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T20:51:58.057880] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-15T20:51:58.518620] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T20:51:58.857923] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-15T20:51:59.657916] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-15T20:52:00.004263] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T20:52:00.218040] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T20:52:00.407125] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T20:52:00.457898] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-15T20:52:01.257874] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-15T20:52:02.057864] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-15T20:52:02.447549] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T20:52:02.816863] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T20:52:02.847516] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:52:02.857806] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-15T20:52:03.657872] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-15T20:52:04.457879] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-15T20:52:05.024064] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-15T20:52:05.257933] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-15T20:52:05.423594] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T20:52:06.057943] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-15T20:52:06.857929] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-15T20:52:07.267879] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-15T20:52:07.273591] [INFO ] [REMOTE ] UMC: Full fetch complete (57377 records). [2025-09-15T20:52:07.273729] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-15T20:52:07.692543] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-15T20:52:07.700631] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-15T20:52:07.702411] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-15T20:52:07.702751] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-15T20:52:07.706670] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:52:07.723027] [DEBUG] [LOCAL ] UMC: Trimmed 57377 records to 38802 (keeping 150 days of data) [2025-09-15T20:52:07.722567] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-15T20:52:07.723845] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T20:52:07.881300] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-15T20:52:08.005247] [DEBUG] [LOCAL ] UMC: Primary data saved (38802 records). [2025-09-15T20:52:08.005405] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-15T20:52:08.005553] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UMC took 32.9s. Estimated remaining: 19m 53s. Rate: 9.4 symbols/min [2025-09-15T20:52:08.213166] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:08.256430] [DEBUG] [LOCAL ] UNH: Loaded 40559 existing records from primary storage. [2025-09-15T20:52:08.256582] [INFO ] [MAIN ] UNH: Loaded 40559 existing records. [2025-09-15T20:52:08.432387] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:08.432708] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-15T20:52:08.432760] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-15T20:52:08.433525] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-15T20:52:08.433571] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-15T20:52:08.463687] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-15T20:52:08.803493] [INFO ] [REMOTE ] UNH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:09.147734] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:52:09.152062] [INFO ] [REMOTE ] UMH: Full fetch complete (34987 records). [2025-09-15T20:52:09.152153] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-15T20:52:09.261263] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-15T20:52:09.279779] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T20:52:09.306175] [INFO ] [REMOTE ] UNF: Full fetch complete (12575 records). [2025-09-15T20:52:09.325227] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-15T20:52:09.712352] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-15T20:52:09.763121] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-15T20:52:09.789825] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-15T20:52:09.800837] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-15T20:52:09.832842] [DEBUG] [LOCAL ] UMH: Trimmed 34987 records to 24105 (keeping 150 days of data) [2025-09-15T20:52:09.970801] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-15T20:52:09.999258] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-15T20:52:10.001503] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-15T20:52:10.001570] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-15T20:52:10.026489] [DEBUG] [LOCAL ] UNF: Trimmed 12575 records to 7875 (keeping 150 days of data) [2025-09-15T20:52:10.059509] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-15T20:52:10.108476] [DEBUG] [LOCAL ] UMH: Primary data saved (24105 records). [2025-09-15T20:52:10.113658] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-15T20:52:10.115125] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UMH took 33.7s. Estimated remaining: 19m 47s. Rate: 9.4 symbols/min [2025-09-15T20:52:10.246977] [DEBUG] [LOCAL ] UNF: Primary data saved (7875 records). [2025-09-15T20:52:10.266576] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-15T20:52:10.273287] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UNF took 21.6s. Estimated remaining: 19m 40s. Rate: 9.4 symbols/min [2025-09-15T20:52:10.297068] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:10.467734] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:10.481384] [DEBUG] [LOCAL ] UNMA: Loaded 2618 existing records from primary storage. [2025-09-15T20:52:10.481542] [INFO ] [MAIN ] UNMA: Loaded 2618 existing records. [2025-09-15T20:52:10.594942] [DEBUG] [LOCAL ] UNM: Loaded 36281 existing records from primary storage. [2025-09-15T20:52:10.605807] [INFO ] [MAIN ] UNM: Loaded 36281 existing records. [2025-09-15T20:52:10.741921] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:10.806512] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T20:52:10.793502] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-15T20:52:10.822769] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-15T20:52:10.882598] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-15T20:52:10.883010] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:10.883406] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-15T20:52:10.888902] [INFO ] [REMOTE ] UNFI: Full fetch complete (45048 records). [2025-09-15T20:52:10.888986] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-15T20:52:10.889173] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-15T20:52:10.889110] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-15T20:52:10.912756] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-15T20:52:10.913114] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-15T20:52:12.051036] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-15T20:52:12.050892] [INFO ] [REMOTE ] UNM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:12.051672] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-15T20:52:12.068400] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-15T20:52:12.068724] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-15T20:52:12.073690] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:12.074100] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-15T20:52:12.075960] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-15T20:52:12.078682] [DEBUG] [LOCAL ] UNFI: Trimmed 45048 records to 31136 (keeping 150 days of data) [2025-09-15T20:52:12.214554] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-15T20:52:12.323821] [DEBUG] [LOCAL ] UNFI: Primary data saved (31136 records). [2025-09-15T20:52:12.323995] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-15T20:52:12.324597] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UNFI took 21.0s. Estimated remaining: 19m 33s. Rate: 9.4 symbols/min [2025-09-15T20:52:12.471292] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-15T20:52:12.503689] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:12.546217] [DEBUG] [LOCAL ] UNP: Loaded 40169 existing records from primary storage. [2025-09-15T20:52:12.546370] [INFO ] [MAIN ] UNP: Loaded 40169 existing records. [2025-09-15T20:52:12.729871] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:12.730693] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T20:52:12.731003] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-15T20:52:12.732521] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-15T20:52:12.733418] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-15T20:52:12.733468] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-15T20:52:13.081398] [INFO ] [REMOTE ] UNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:13.257871] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-15T20:52:13.623015] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T20:52:13.704971] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T20:52:14.057914] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-15T20:52:14.542381] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-15T20:52:14.857906] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-15T20:52:15.657887] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-15T20:52:15.697033] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T20:52:16.457934] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-15T20:52:16.484794] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T20:52:17.257856] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-15T20:52:17.322718] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-15T20:52:17.957508] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T20:52:18.057892] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-15T20:52:18.809567] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T20:52:18.857951] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-15T20:52:19.658000] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-15T20:52:20.463049] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-15T20:52:20.480175] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T20:52:20.592761] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-15T20:52:21.130407] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T20:52:21.257881] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-15T20:52:21.661261] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T20:52:22.057900] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-15T20:52:22.665380] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:52:22.857886] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-15T20:52:22.935889] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T20:52:23.657884] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-15T20:52:24.457913] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-15T20:52:25.039154] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-15T20:52:25.257838] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-15T20:52:25.558998] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T20:52:25.957191] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T20:52:26.057917] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-15T20:52:26.637623] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T20:52:26.857891] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-15T20:52:27.293637] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T20:52:27.657855] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-15T20:52:28.210089] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-15T20:52:28.457916] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-15T20:52:29.257916] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-15T20:52:29.391250] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T20:52:29.671872] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T20:52:29.673170] [INFO ] [REMOTE ] UNMA: Full fetch complete (4052 records). [2025-09-15T20:52:29.673254] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-15T20:52:30.047429] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-15T20:52:30.047554] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-15T20:52:30.047735] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-15T20:52:30.047803] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-15T20:52:30.048330] [DEBUG] [LOCAL ] UNMA: Trimmed 4052 records to 2590 (keeping 150 days of data) [2025-09-15T20:52:30.061653] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-15T20:52:30.095736] [DEBUG] [LOCAL ] UNMA: Primary data saved (2590 records). [2025-09-15T20:52:30.096714] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-15T20:52:30.096921] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNMA took 19.8s. Estimated remaining: 19m 28s. Rate: 9.4 symbols/min [2025-09-15T20:52:30.110745] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T20:52:30.281830] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:30.318419] [DEBUG] [LOCAL ] UP: Loaded 32128 existing records from primary storage. [2025-09-15T20:52:30.318567] [INFO ] [MAIN ] UP: Loaded 32128 existing records. [2025-09-15T20:52:30.497029] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:30.497297] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-15T20:52:30.497342] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-15T20:52:30.497987] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-15T20:52:30.498039] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-15T20:52:30.864724] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-15T20:52:30.864614] [INFO ] [REMOTE ] UP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:31.657884] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-15T20:52:32.264121] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T20:52:32.269852] [INFO ] [REMOTE ] UNM: Full fetch complete (52996 records). [2025-09-15T20:52:32.269962] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-15T20:52:32.464588] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-15T20:52:32.668675] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-15T20:52:32.668794] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-15T20:52:32.670051] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-15T20:52:32.670116] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-15T20:52:32.671598] [DEBUG] [LOCAL ] UNM: Trimmed 52996 records to 35596 (keeping 150 days of data) [2025-09-15T20:52:32.847153] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-15T20:52:32.975516] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T20:52:32.986982] [DEBUG] [LOCAL ] UNM: Primary data saved (35596 records). [2025-09-15T20:52:32.987901] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-15T20:52:32.988022] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNM took 22.9s. Estimated remaining: 19m 21s. Rate: 9.4 symbols/min [2025-09-15T20:52:33.168418] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:33.208683] [DEBUG] [LOCAL ] UPS: Loaded 40461 existing records from primary storage. [2025-09-15T20:52:33.208836] [INFO ] [MAIN ] UPS: Loaded 40461 existing records. [2025-09-15T20:52:33.265313] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-15T20:52:33.394544] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:33.394858] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-15T20:52:33.394910] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-15T20:52:33.395840] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-15T20:52:33.395895] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-15T20:52:33.764305] [INFO ] [REMOTE ] UPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:34.057850] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-15T20:52:34.247878] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T20:52:34.857869] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-15T20:52:35.445387] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-15T20:52:35.451686] [INFO ] [REMOTE ] UNH: Full fetch complete (58467 records). [2025-09-15T20:52:35.451840] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-15T20:52:35.680412] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-15T20:52:35.848084] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-15T20:52:35.848196] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-15T20:52:35.849374] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-15T20:52:35.849479] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-15T20:52:35.851018] [DEBUG] [LOCAL ] UNH: Trimmed 58467 records to 39779 (keeping 150 days of data) [2025-09-15T20:52:36.000791] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-15T20:52:36.155529] [DEBUG] [LOCAL ] UNH: Primary data saved (39779 records). [2025-09-15T20:52:36.155707] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-15T20:52:36.155817] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNH took 28.2s. Estimated remaining: 19m 14s. Rate: 9.4 symbols/min [2025-09-15T20:52:36.331144] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:36.366629] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:52:36.398806] [DEBUG] [LOCAL ] URI: Loaded 26247 existing records from primary storage. [2025-09-15T20:52:36.398986] [INFO ] [MAIN ] URI: Loaded 26247 existing records. [2025-09-15T20:52:36.462982] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-15T20:52:36.583304] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:36.583594] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-15T20:52:36.583675] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-15T20:52:36.584381] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-15T20:52:36.584441] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-15T20:52:36.931242] [INFO ] [REMOTE ] URI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:37.263141] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-15T20:52:37.275655] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T20:52:38.057940] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-15T20:52:38.784674] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-15T20:52:38.822134] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T20:52:38.857825] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-15T20:52:39.402396] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T20:52:39.657873] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-15T20:52:40.223817] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T20:52:40.457869] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-15T20:52:41.257918] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-15T20:52:42.040307] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-15T20:52:42.057819] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-15T20:52:42.409839] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T20:52:42.839569] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:52:42.858190] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-15T20:52:43.629610] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:52:43.635216] [INFO ] [REMOTE ] UNP: Full fetch complete (57426 records). [2025-09-15T20:52:43.635345] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-15T20:52:43.636177] [FATAL] [VALIDATOR ] UNP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:52:43.636290] [FATAL] [MAIN ] UNP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:52:43.636341] [WARN ] [MAIN ] UNP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:52:43.636385] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-15T20:52:43.636482] [DEBUG] [LOCAL ] UNP: No primary data file found to delete. [2025-09-15T20:52:43.636524] [INFO ] [LOCAL ] UNP: Starting deletion of derivative data. [2025-09-15T20:52:43.637064] [DEBUG] [LOCAL ] UNP: Deleted derivative data file. [2025-09-15T20:52:43.638048] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UNP took 31.3s. Estimated remaining: 19m 8s. Rate: 9.4 symbols/min [2025-09-15T20:52:43.663108] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-15T20:52:43.820177] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:43.848304] [DEBUG] [LOCAL ] USA: Loaded 26260 existing records from primary storage. [2025-09-15T20:52:43.848449] [INFO ] [MAIN ] USA: Loaded 26260 existing records. [2025-09-15T20:52:44.030487] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:44.030796] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-15T20:52:44.030845] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-15T20:52:44.031538] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-15T20:52:44.031597] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-15T20:52:44.452332] [INFO ] [REMOTE ] USA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:44.471994] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-15T20:52:44.500040] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-15T20:52:45.257869] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-15T20:52:45.408995] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:52:45.799819] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T20:52:46.057915] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-15T20:52:46.857843] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-15T20:52:47.037352] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T20:52:47.364253] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:52:47.657883] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-15T20:52:48.408716] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T20:52:48.457910] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-15T20:52:49.257902] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-15T20:52:49.973573] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T20:52:50.037507] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T20:52:50.057813] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-15T20:52:50.507070] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T20:52:50.857914] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-15T20:52:51.657884] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-15T20:52:52.298175] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T20:52:52.410544] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-15T20:52:52.457871] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-15T20:52:53.119772] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:52:53.257868] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-15T20:52:53.806146] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:52:54.057872] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-15T20:52:54.537533] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T20:52:54.857877] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-15T20:52:55.586375] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T20:52:55.657897] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-15T20:52:56.326991] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T20:52:56.457880] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-15T20:52:56.966912] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T20:52:56.972200] [INFO ] [REMOTE ] UPS: Full fetch complete (57996 records). [2025-09-15T20:52:56.972293] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-15T20:52:56.973098] [FATAL] [VALIDATOR ] UPS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:52:56.973213] [FATAL] [MAIN ] UPS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:52:56.973275] [WARN ] [MAIN ] UPS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:52:56.973339] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-15T20:52:56.973413] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-09-15T20:52:56.973452] [INFO ] [LOCAL ] UPS: Starting deletion of derivative data. [2025-09-15T20:52:56.973777] [DEBUG] [LOCAL ] UPS: Deleted derivative data file. [2025-09-15T20:52:56.973875] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UPS took 24.0s. Estimated remaining: 19m 2s. Rate: 9.4 symbols/min [2025-09-15T20:52:57.142910] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:52:57.159336] [DEBUG] [LOCAL ] USAC: Loaded 15690 existing records from primary storage. [2025-09-15T20:52:57.159469] [INFO ] [MAIN ] USAC: Loaded 15690 existing records. [2025-09-15T20:52:57.259564] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-15T20:52:57.337452] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:52:57.337744] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-15T20:52:57.337891] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-15T20:52:57.338462] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-15T20:52:57.338513] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-15T20:52:57.434540] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T20:52:57.722596] [INFO ] [REMOTE ] USAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:52:58.057933] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-15T20:52:58.857880] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-15T20:52:59.091893] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:52:59.244369] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T20:52:59.657872] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-15T20:53:00.007209] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T20:53:00.011746] [INFO ] [REMOTE ] USA: Full fetch complete (38769 records). [2025-09-15T20:53:00.011896] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-15T20:53:00.379564] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-15T20:53:00.379662] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-15T20:53:00.380462] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-15T20:53:00.380503] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-15T20:53:00.381539] [DEBUG] [LOCAL ] USA: Trimmed 38769 records to 25825 (keeping 150 days of data) [2025-09-15T20:53:00.468925] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-15T20:53:00.539697] [DEBUG] [LOCAL ] USA: Primary data saved (25825 records). [2025-09-15T20:53:00.539981] [INFO ] [MAIN ] USA: Full history saved. [2025-09-15T20:53:00.540105] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. USA took 16.9s. Estimated remaining: 18m 56s. Rate: 9.4 symbols/min [2025-09-15T20:53:00.709170] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:00.750508] [DEBUG] [LOCAL ] USB: Loaded 40428 existing records from primary storage. [2025-09-15T20:53:00.750671] [INFO ] [MAIN ] USB: Loaded 40428 existing records. [2025-09-15T20:53:00.925274] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:00.925531] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-15T20:53:00.925576] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-15T20:53:00.926598] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-15T20:53:00.926680] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-15T20:53:01.263393] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-15T20:53:01.303662] [INFO ] [REMOTE ] USB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:01.536159] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T20:53:01.542166] [INFO ] [REMOTE ] UP: Full fetch complete (45816 records). [2025-09-15T20:53:01.542313] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-15T20:53:01.946119] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-15T20:53:01.946369] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-15T20:53:01.947967] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-15T20:53:01.949294] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T20:53:01.949418] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-15T20:53:01.957704] [DEBUG] [LOCAL ] UP: Trimmed 45816 records to 31666 (keeping 150 days of data) [2025-09-15T20:53:02.058697] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-15T20:53:02.152972] [DEBUG] [LOCAL ] UP: Primary data saved (31666 records). [2025-09-15T20:53:02.153130] [INFO ] [MAIN ] UP: Full history saved. [2025-09-15T20:53:02.153221] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. UP took 32.1s. Estimated remaining: 18m 49s. Rate: 9.4 symbols/min [2025-09-15T20:53:02.323209] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:02.361150] [DEBUG] [LOCAL ] USFD: Loaded 38536 existing records from primary storage. [2025-09-15T20:53:02.361294] [INFO ] [MAIN ] USFD: Loaded 38536 existing records. [2025-09-15T20:53:02.542850] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:02.543303] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-15T20:53:02.543398] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-15T20:53:02.544136] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-15T20:53:02.544211] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-15T20:53:02.840494] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:53:02.858231] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-15T20:53:02.926734] [INFO ] [REMOTE ] USFD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:03.127449] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T20:53:03.657896] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-15T20:53:04.457865] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-15T20:53:04.619943] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T20:53:04.975000] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:53:05.257886] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-15T20:53:06.062963] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-15T20:53:06.077159] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T20:53:06.467860] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T20:53:06.857886] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-15T20:53:07.429430] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T20:53:07.433545] [INFO ] [REMOTE ] URI: Full fetch complete (40199 records). [2025-09-15T20:53:07.433632] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-15T20:53:07.663027] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-15T20:53:07.804459] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-15T20:53:07.804550] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-15T20:53:07.805475] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-15T20:53:07.805522] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-15T20:53:07.806450] [DEBUG] [LOCAL ] URI: Trimmed 40199 records to 25723 (keeping 150 days of data) [2025-09-15T20:53:07.974776] [DEBUG] [LOCAL ] URI: Primary data saved (25723 records). [2025-09-15T20:53:07.974941] [INFO ] [MAIN ] URI: Full history saved. [2025-09-15T20:53:07.975084] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. URI took 31.8s. Estimated remaining: 18m 42s. Rate: 9.4 symbols/min [2025-09-15T20:53:08.149636] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:08.163673] [DEBUG] [LOCAL ] USNA: Loaded 13115 existing records from primary storage. [2025-09-15T20:53:08.163824] [INFO ] [MAIN ] USNA: Loaded 13115 existing records. [2025-09-15T20:53:08.339830] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:08.340063] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-15T20:53:08.340108] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-15T20:53:08.340428] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-15T20:53:08.340478] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-15T20:53:08.460440] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-15T20:53:08.698663] [INFO ] [REMOTE ] USNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:08.843220] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T20:53:08.883886] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T20:53:09.257900] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-15T20:53:09.779132] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T20:53:10.057902] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-15T20:53:10.856930] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T20:53:10.867235] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-15T20:53:11.269205] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T20:53:11.657884] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-15T20:53:12.037953] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T20:53:12.457877] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-15T20:53:13.257891] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-15T20:53:13.384052] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:53:13.418064] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T20:53:14.057869] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-15T20:53:14.857891] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-15T20:53:14.949719] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T20:53:14.953221] [INFO ] [REMOTE ] USAC: Full fetch complete (25444 records). [2025-09-15T20:53:14.953393] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-15T20:53:15.369771] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-15T20:53:15.371698] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T20:53:15.371794] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-15T20:53:15.382695] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-15T20:53:15.383132] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-15T20:53:15.384303] [DEBUG] [LOCAL ] USAC: Trimmed 25444 records to 15589 (keeping 150 days of data) [2025-09-15T20:53:15.486594] [DEBUG] [LOCAL ] USAC: Primary data saved (15589 records). [2025-09-15T20:53:15.486764] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-15T20:53:15.486866] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USAC took 18.5s. Estimated remaining: 18m 36s. Rate: 9.4 symbols/min [2025-09-15T20:53:15.663003] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-15T20:53:15.664746] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:15.680850] [DEBUG] [LOCAL ] USPH: Loaded 12705 existing records from primary storage. [2025-09-15T20:53:15.681005] [INFO ] [MAIN ] USPH: Loaded 12705 existing records. [2025-09-15T20:53:15.870681] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:15.870919] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-15T20:53:15.870965] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-15T20:53:15.871341] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-15T20:53:15.871388] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-15T20:53:16.224604] [INFO ] [REMOTE ] USPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:16.457854] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-15T20:53:16.541574] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T20:53:17.011720] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T20:53:17.257870] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-15T20:53:17.387471] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:53:18.057909] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-15T20:53:18.862432] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-15T20:53:18.868731] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T20:53:18.890928] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T20:53:19.657910] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-15T20:53:20.016431] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T20:53:20.457928] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-15T20:53:21.257857] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-15T20:53:21.313172] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T20:53:22.025410] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T20:53:22.057814] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-15T20:53:22.465776] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T20:53:22.857882] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-15T20:53:23.594450] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T20:53:23.657850] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-15T20:53:23.868897] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T20:53:24.457876] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-15T20:53:24.979713] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:53:24.985519] [INFO ] [REMOTE ] USFD: Full fetch complete (55934 records). [2025-09-15T20:53:24.985638] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-15T20:53:25.263404] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-15T20:53:25.377255] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-15T20:53:25.377382] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-15T20:53:25.383898] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-15T20:53:25.389724] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-15T20:53:25.390879] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T20:53:25.396556] [DEBUG] [LOCAL ] USFD: Trimmed 55934 records to 37822 (keeping 150 days of data) [2025-09-15T20:53:25.631323] [DEBUG] [LOCAL ] USFD: Primary data saved (37822 records). [2025-09-15T20:53:25.631451] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-15T20:53:25.632633] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USFD took 23.5s. Estimated remaining: 18m 30s. Rate: 9.4 symbols/min [2025-09-15T20:53:25.803744] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:25.831932] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T20:53:25.843912] [INFO ] [REMOTE ] USB: Full fetch complete (57977 records). [2025-09-15T20:53:25.847611] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-15T20:53:25.847530] [DEBUG] [LOCAL ] UTF: Loaded 20046 existing records from primary storage. [2025-09-15T20:53:25.847773] [INFO ] [MAIN ] UTF: Loaded 20046 existing records. [2025-09-15T20:53:25.892096] [FATAL] [VALIDATOR ] USB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T20:53:25.923980] [FATAL] [MAIN ] USB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:53:25.939595] [WARN ] [MAIN ] USB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:53:25.949588] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-15T20:53:25.949710] [DEBUG] [LOCAL ] USB: No primary data file found to delete. [2025-09-15T20:53:25.950063] [INFO ] [LOCAL ] USB: Starting deletion of derivative data. [2025-09-15T20:53:25.965886] [DEBUG] [LOCAL ] USB: Deleted derivative data file. [2025-09-15T20:53:25.976623] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. USB took 25.4s. Estimated remaining: 18m 23s. Rate: 9.4 symbols/min [2025-09-15T20:53:26.062947] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-15T20:53:26.068287] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:26.110601] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-15T20:53:26.132114] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-15T20:53:26.137902] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-15T20:53:26.148203] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-15T20:53:26.301573] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:26.530098] [DEBUG] [LOCAL ] UTI: Loaded 30337 existing records from primary storage. [2025-09-15T20:53:26.556087] [INFO ] [MAIN ] UTI: Loaded 30337 existing records. [2025-09-15T20:53:26.654067] [INFO ] [REMOTE ] UTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:26.767686] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:26.767911] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-15T20:53:26.767960] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-15T20:53:26.768580] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-15T20:53:26.768631] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-15T20:53:26.863009] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-15T20:53:27.123850] [INFO ] [REMOTE ] UTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:27.289857] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T20:53:27.657903] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-15T20:53:27.932831] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T20:53:28.457905] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-15T20:53:28.881744] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T20:53:29.257871] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-15T20:53:30.064414] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-15T20:53:30.069359] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:53:30.152593] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T20:53:30.857944] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-15T20:53:30.899339] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T20:53:31.657931] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-15T20:53:31.868844] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T20:53:32.457879] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-15T20:53:33.107820] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:53:33.257857] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-15T20:53:33.290959] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T20:53:33.293087] [INFO ] [REMOTE ] USPH: Full fetch complete (17778 records). [2025-09-15T20:53:33.293158] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-15T20:53:33.659483] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-15T20:53:33.659563] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-15T20:53:33.659951] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-15T20:53:33.659994] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-15T20:53:33.660530] [DEBUG] [LOCAL ] USPH: Trimmed 17778 records to 12417 (keeping 150 days of data) [2025-09-15T20:53:33.739198] [DEBUG] [LOCAL ] USPH: Primary data saved (12417 records). [2025-09-15T20:53:33.739331] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-15T20:53:33.739416] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USPH took 18.3s. Estimated remaining: 18m 17s. Rate: 9.4 symbols/min [2025-09-15T20:53:34.057943] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-15T20:53:34.704782] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T20:53:34.857886] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-15T20:53:34.966817] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T20:53:35.657894] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-15T20:53:36.238756] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T20:53:36.457832] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-15T20:53:36.880622] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:53:37.005602] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T20:53:37.257871] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-15T20:53:38.057901] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-15T20:53:38.492367] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T20:53:38.857172] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T20:53:38.859602] [INFO ] [REMOTE ] USNA: Full fetch complete (20557 records). [2025-09-15T20:53:38.859727] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-15T20:53:38.859484] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-15T20:53:39.232567] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-15T20:53:39.232666] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-15T20:53:39.233153] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-15T20:53:39.233193] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-15T20:53:39.233797] [DEBUG] [LOCAL ] USNA: Trimmed 20557 records to 12749 (keeping 150 days of data) [2025-09-15T20:53:39.310030] [DEBUG] [LOCAL ] USNA: Primary data saved (12749 records). [2025-09-15T20:53:39.310180] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-15T20:53:39.310278] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. USNA took 31.3s. Estimated remaining: 18m 10s. Rate: 9.4 symbols/min [2025-09-15T20:53:39.657894] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-15T20:53:40.253234] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T20:53:40.457875] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-15T20:53:41.174964] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T20:53:41.257861] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-15T20:53:41.442395] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T20:53:42.057864] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-15T20:53:42.785879] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T20:53:42.857914] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-15T20:53:43.070881] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T20:53:43.657965] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-15T20:53:44.013038] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T20:53:44.019706] [INFO ] [REMOTE ] UTI: Full fetch complete (44473 records). [2025-09-15T20:53:44.019907] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-15T20:53:44.415268] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-15T20:53:44.415378] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-15T20:53:44.416429] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-15T20:53:44.416495] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-15T20:53:44.417582] [DEBUG] [LOCAL ] UTI: Trimmed 44473 records to 29753 (keeping 150 days of data) [2025-09-15T20:53:44.610195] [DEBUG] [LOCAL ] UTI: Primary data saved (29753 records). [2025-09-15T20:53:44.610349] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-15T20:53:44.610457] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. UTI took 18.6s. Estimated remaining: 18m 4s. Rate: 9.4 symbols/min [2025-09-15T20:53:44.986785] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T20:53:44.996698] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-15T20:53:46.133550] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T20:53:46.139277] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-15T20:53:47.282693] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T20:53:47.288078] [INFO ] [REMOTE ] UTF: Full fetch complete (30241 records). [2025-09-15T20:53:47.288208] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-15T20:53:47.665422] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-15T20:53:47.665518] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-15T20:53:47.666237] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-15T20:53:47.666285] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-15T20:53:47.667321] [DEBUG] [LOCAL ] UTF: Trimmed 30241 records to 19793 (keeping 150 days of data) [2025-09-15T20:53:47.792852] [DEBUG] [LOCAL ] UTF: Primary data saved (19793 records). [2025-09-15T20:53:47.792999] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-15T20:53:47.793084] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTF took 22.2s. Estimated remaining: 17m 57s. Rate: 9.4 symbols/min [2025-09-15T20:53:48.411277] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:48.543506] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:48.545580] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:48.580517] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:53:48.588680] [DEBUG] [LOCAL ] UTL: Loaded 8454 existing records from primary storage. [2025-09-15T20:53:48.588820] [INFO ] [MAIN ] UTL: Loaded 8454 existing records. [2025-09-15T20:53:48.708374] [DEBUG] [LOCAL ] UVV: Loaded 17608 existing records from primary storage. [2025-09-15T20:53:48.748149] [INFO ] [MAIN ] UVV: Loaded 17608 existing records. [2025-09-15T20:53:48.841779] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:48.854786] [DEBUG] [LOCAL ] UVE: Loaded 17083 existing records from primary storage. [2025-09-15T20:53:48.870571] [INFO ] [MAIN ] UVE: Loaded 17083 existing records. [2025-09-15T20:53:48.885547] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-15T20:53:48.928915] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-15T20:53:49.009982] [DEBUG] [LOCAL ] UTZ: Loaded 33624 existing records from primary storage. [2025-09-15T20:53:49.036330] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-15T20:53:49.025779] [INFO ] [MAIN ] UTZ: Loaded 33624 existing records. [2025-09-15T20:53:49.040354] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-15T20:53:49.359163] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:49.372421] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:49.393024] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-15T20:53:49.393745] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-15T20:53:49.449701] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-15T20:53:49.424930] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-15T20:53:49.467108] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-15T20:53:49.455118] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-15T20:53:49.598432] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-15T20:53:49.705824] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-15T20:53:49.819772] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:53:49.887293] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-15T20:53:49.916459] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-15T20:53:49.969236] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-15T20:53:49.988003] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-15T20:53:50.193535] [INFO ] [REMOTE ] UTL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:50.304552] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-15T20:53:50.704864] [INFO ] [REMOTE ] UVV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:50.755559] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-15T20:53:51.006107] [INFO ] [REMOTE ] UVE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:51.000019] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:53:51.006698] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-15T20:53:51.007057] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-15T20:53:51.243191] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T20:53:51.245722] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-15T20:53:51.645864] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T20:53:51.649345] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-15T20:53:51.757403] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T20:53:51.761531] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-15T20:53:52.038756] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:53:52.042111] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-15T20:53:52.518079] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:53:52.526945] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-15T20:53:52.625360] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T20:53:52.647940] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T20:53:52.674308] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T20:53:53.257883] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-15T20:53:54.057909] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-15T20:53:54.102182] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T20:53:54.156216] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T20:53:54.803277] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:53:54.857847] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-15T20:53:55.657871] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-15T20:53:56.457880] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-15T20:53:56.594093] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:53:56.868423] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T20:53:56.995025] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T20:53:57.257875] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-15T20:53:58.057883] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-15T20:53:58.757124] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T20:53:58.857844] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-15T20:53:58.883842] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T20:53:59.657882] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-15T20:54:00.442393] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T20:54:00.457814] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-15T20:54:00.645469] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T20:54:01.257867] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-15T20:54:02.057880] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-15T20:54:02.303455] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T20:54:02.830710] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-15T20:54:02.857819] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-15T20:54:03.657892] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-15T20:54:04.457836] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-15T20:54:04.809825] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T20:54:04.839476] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-15T20:54:05.257862] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-15T20:54:05.568994] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T20:54:05.660339] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-15T20:54:06.057898] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-15T20:54:06.068738] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T20:54:06.070815] [INFO ] [REMOTE ] UTL: Full fetch complete (11533 records). [2025-09-15T20:54:06.070893] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-15T20:54:06.450668] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-15T20:54:06.450775] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-15T20:54:06.451223] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-15T20:54:06.451269] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-15T20:54:06.451923] [DEBUG] [LOCAL ] UTL: Trimmed 11533 records to 8429 (keeping 150 days of data) [2025-09-15T20:54:06.512486] [DEBUG] [LOCAL ] UTL: Primary data saved (8429 records). [2025-09-15T20:54:06.512715] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-15T20:54:06.512911] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UTL took 18.7s. Estimated remaining: 17m 52s. Rate: 9.4 symbols/min [2025-09-15T20:54:06.685991] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:06.729067] [DEBUG] [LOCAL ] UWMC: Loaded 39753 existing records from primary storage. [2025-09-15T20:54:06.729215] [INFO ] [MAIN ] UWMC: Loaded 39753 existing records. [2025-09-15T20:54:06.872333] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-15T20:54:06.912069] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:06.912366] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-15T20:54:06.912441] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-15T20:54:06.913309] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-15T20:54:06.913361] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-15T20:54:07.274184] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:07.287122] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:54:07.291751] [INFO ] [REMOTE ] UTZ: Full fetch complete (48696 records). [2025-09-15T20:54:07.291841] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-15T20:54:07.664942] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-15T20:54:07.667551] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-15T20:54:07.668420] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-15T20:54:07.669434] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-15T20:54:07.669571] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-15T20:54:07.670778] [DEBUG] [LOCAL ] UTZ: Trimmed 48696 records to 32830 (keeping 150 days of data) [2025-09-15T20:54:07.806451] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T20:54:07.901830] [DEBUG] [LOCAL ] UTZ: Primary data saved (32830 records). [2025-09-15T20:54:07.901981] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-15T20:54:07.902068] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UTZ took 20.1s. Estimated remaining: 17m 45s. Rate: 9.4 symbols/min [2025-09-15T20:54:08.068525] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:08.074974] [DEBUG] [LOCAL ] UZD: Loaded 4769 existing records from primary storage. [2025-09-15T20:54:08.075074] [INFO ] [MAIN ] UZD: Loaded 4769 existing records. [2025-09-15T20:54:08.247597] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:08.247901] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-15T20:54:08.247947] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-15T20:54:08.248184] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-15T20:54:08.248227] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-15T20:54:08.466281] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-15T20:54:08.607250] [INFO ] [REMOTE ] UZD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:08.619270] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T20:54:09.257933] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-15T20:54:09.911920] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T20:54:09.932136] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T20:54:10.057853] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-15T20:54:10.857888] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-15T20:54:11.282863] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T20:54:11.657941] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-15T20:54:12.220215] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T20:54:12.302313] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T20:54:12.457875] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-15T20:54:12.590187] [DEBUG] [REMOTE ] UWMC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-15T20:54:12.590498] [WARN ] [REMOTE ] UWMC: No data returned for month 2025-03 [2025-09-15T20:54:13.257879] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-15T20:54:14.057923] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-15T20:54:14.573529] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T20:54:14.575859] [INFO ] [REMOTE ] UVE: Full fetch complete (23698 records). [2025-09-15T20:54:14.575934] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-15T20:54:14.867525] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-15T20:54:14.956858] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-15T20:54:14.956969] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-15T20:54:14.957744] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-15T20:54:14.957802] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-15T20:54:14.959566] [DEBUG] [LOCAL ] UVE: Trimmed 23698 records to 16792 (keeping 150 days of data) [2025-09-15T20:54:15.079176] [DEBUG] [LOCAL ] UVE: Primary data saved (16792 records). [2025-09-15T20:54:15.079340] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-15T20:54:15.079455] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UVE took 27.3s. Estimated remaining: 17m 39s. Rate: 9.4 symbols/min [2025-09-15T20:54:15.249094] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:15.256526] [DEBUG] [LOCAL ] UZE: Loaded 5661 existing records from primary storage. [2025-09-15T20:54:15.256626] [INFO ] [MAIN ] UZE: Loaded 5661 existing records. [2025-09-15T20:54:15.435088] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:15.435345] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-15T20:54:15.435391] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-15T20:54:15.435685] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-15T20:54:15.435734] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-15T20:54:15.670049] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-15T20:54:15.804258] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T20:54:15.807591] [INFO ] [REMOTE ] UZE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:15.866623] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T20:54:16.457834] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-15T20:54:16.745288] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T20:54:16.747833] [INFO ] [REMOTE ] UVV: Full fetch complete (23401 records). [2025-09-15T20:54:16.747905] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-15T20:54:17.109805] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-15T20:54:17.113776] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-15T20:54:17.114326] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-15T20:54:17.114840] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-15T20:54:17.115095] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T20:54:17.117684] [DEBUG] [LOCAL ] UVV: Trimmed 23401 records to 17329 (keeping 150 days of data) [2025-09-15T20:54:17.229310] [DEBUG] [LOCAL ] UVV: Primary data saved (17329 records). [2025-09-15T20:54:17.229464] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-15T20:54:17.229574] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UVV took 29.4s. Estimated remaining: 17m 32s. Rate: 9.4 symbols/min [2025-09-15T20:54:17.262961] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-15T20:54:17.407879] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:17.416083] [DEBUG] [LOCAL ] UZF: Loaded 4716 existing records from primary storage. [2025-09-15T20:54:17.416196] [INFO ] [MAIN ] UZF: Loaded 4716 existing records. [2025-09-15T20:54:17.589975] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:17.590253] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-15T20:54:17.590303] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-15T20:54:17.590629] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-15T20:54:17.590716] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-15T20:54:17.964953] [INFO ] [REMOTE ] UZF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:18.057851] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-15T20:54:18.671847] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:54:18.857895] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-15T20:54:19.142281] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T20:54:19.329858] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T20:54:19.657901] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-15T20:54:20.131313] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T20:54:20.457919] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-15T20:54:20.963677] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T20:54:21.257892] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-15T20:54:21.947357] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T20:54:22.057871] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-15T20:54:22.857878] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-15T20:54:23.659378] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-15T20:54:23.666674] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:54:23.782366] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T20:54:24.228774] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T20:54:24.457966] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-15T20:54:24.924465] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T20:54:25.257905] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-15T20:54:26.057910] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-15T20:54:26.218384] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T20:54:26.703445] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T20:54:26.857892] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-15T20:54:27.499955] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T20:54:27.500986] [INFO ] [REMOTE ] UZD: Full fetch complete (7004 records). [2025-09-15T20:54:27.501055] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-15T20:54:27.663312] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-15T20:54:27.888597] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-15T20:54:27.888698] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-15T20:54:27.888887] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-15T20:54:27.888928] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-15T20:54:27.889329] [DEBUG] [LOCAL ] UZD: Trimmed 7004 records to 4690 (keeping 150 days of data) [2025-09-15T20:54:27.918264] [DEBUG] [LOCAL ] UZD: Primary data saved (4690 records). [2025-09-15T20:54:27.918349] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-15T20:54:27.918431] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZD took 20.0s. Estimated remaining: 17m 26s. Rate: 9.4 symbols/min [2025-09-15T20:54:28.088116] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:28.127940] [DEBUG] [LOCAL ] V: Loaded 40504 existing records from primary storage. [2025-09-15T20:54:28.128086] [INFO ] [MAIN ] V: Loaded 40504 existing records. [2025-09-15T20:54:28.310604] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:28.311054] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-15T20:54:28.311116] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-15T20:54:28.312110] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-15T20:54:28.312172] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-15T20:54:28.460107] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-15T20:54:28.616580] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T20:54:28.686428] [INFO ] [REMOTE ] V: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:29.099605] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:54:29.257873] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-15T20:54:30.057875] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-15T20:54:30.783297] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T20:54:30.857857] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-15T20:54:31.163311] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T20:54:31.317351] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T20:54:31.657929] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-15T20:54:32.254076] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T20:54:32.457921] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-15T20:54:33.176134] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T20:54:33.257888] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-15T20:54:34.057887] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-15T20:54:34.687144] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T20:54:34.688580] [INFO ] [REMOTE ] UZF: Full fetch complete (6868 records). [2025-09-15T20:54:34.688700] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-15T20:54:34.862980] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-15T20:54:35.047853] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-15T20:54:35.047933] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-15T20:54:35.048107] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-15T20:54:35.048145] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-15T20:54:35.048539] [DEBUG] [LOCAL ] UZF: Trimmed 6868 records to 4671 (keeping 150 days of data) [2025-09-15T20:54:35.078255] [DEBUG] [LOCAL ] UZF: Primary data saved (4671 records). [2025-09-15T20:54:35.078441] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-15T20:54:35.078602] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZF took 17.8s. Estimated remaining: 17m 20s. Rate: 9.4 symbols/min [2025-09-15T20:54:35.254633] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:35.291211] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T20:54:35.324109] [DEBUG] [LOCAL ] VAC: Loaded 25513 existing records from primary storage. [2025-09-15T20:54:35.324267] [INFO ] [MAIN ] VAC: Loaded 25513 existing records. [2025-09-15T20:54:35.505298] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:35.505572] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-15T20:54:35.505620] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-15T20:54:35.506228] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-15T20:54:35.506278] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-15T20:54:35.681017] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-15T20:54:35.868982] [INFO ] [REMOTE ] VAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:36.457898] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-15T20:54:36.811978] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T20:54:37.257875] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-15T20:54:37.305530] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T20:54:37.311345] [INFO ] [REMOTE ] UWMC: Full fetch complete (49125 records). [2025-09-15T20:54:37.311444] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-15T20:54:37.503166] [WARN ] [VALIDATOR ] UWMC: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T20:54:37.503932] [FATAL] [MAIN ] UWMC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:54:37.504034] [WARN ] [MAIN ] UWMC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:54:37.504088] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-15T20:54:37.504279] [DEBUG] [LOCAL ] UWMC: No primary data file found to delete. [2025-09-15T20:54:37.504357] [INFO ] [LOCAL ] UWMC: Starting deletion of derivative data. [2025-09-15T20:54:37.504815] [DEBUG] [LOCAL ] UWMC: Deleted derivative data file. [2025-09-15T20:54:37.504909] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UWMC took 31.0s. Estimated remaining: 17m 13s. Rate: 9.4 symbols/min [2025-09-15T20:54:37.667978] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T20:54:37.698071] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:37.734767] [DEBUG] [LOCAL ] VAL: Loaded 37832 existing records from primary storage. [2025-09-15T20:54:37.734910] [INFO ] [MAIN ] VAL: Loaded 37832 existing records. [2025-09-15T20:54:37.909698] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:37.909918] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-15T20:54:37.909962] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-15T20:54:37.910639] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-15T20:54:37.910710] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-15T20:54:38.063712] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-15T20:54:38.262302] [INFO ] [REMOTE ] VAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:38.271276] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T20:54:38.857876] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-15T20:54:39.540394] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T20:54:39.541822] [INFO ] [REMOTE ] UZE: Full fetch complete (7811 records). [2025-09-15T20:54:39.541891] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-15T20:54:39.663052] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-15T20:54:39.906560] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-15T20:54:39.906637] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-15T20:54:39.906852] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-15T20:54:39.906890] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-15T20:54:39.907295] [DEBUG] [LOCAL ] UZE: Trimmed 7811 records to 5598 (keeping 150 days of data) [2025-09-15T20:54:39.941339] [DEBUG] [LOCAL ] UZE: Primary data saved (5598 records). [2025-09-15T20:54:39.941456] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-15T20:54:39.941553] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. UZE took 24.9s. Estimated remaining: 17m 6s. Rate: 9.4 symbols/min [2025-09-15T20:54:40.119975] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:40.162491] [DEBUG] [LOCAL ] VALE: Loaded 40435 existing records from primary storage. [2025-09-15T20:54:40.162684] [INFO ] [MAIN ] VALE: Loaded 40435 existing records. [2025-09-15T20:54:40.344700] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:40.344980] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-15T20:54:40.345026] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-15T20:54:40.345907] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-15T20:54:40.345958] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-15T20:54:40.462973] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-15T20:54:40.746876] [INFO ] [REMOTE ] VALE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:40.781927] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-15T20:54:41.215833] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T20:54:41.257823] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-15T20:54:41.958854] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T20:54:42.057900] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-15T20:54:42.424490] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T20:54:42.857886] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-15T20:54:43.657914] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-15T20:54:44.224235] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T20:54:44.457923] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-15T20:54:44.821324] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-15T20:54:45.103428] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T20:54:45.257850] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-15T20:54:46.057874] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-15T20:54:46.476498] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T20:54:46.523579] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T20:54:46.857900] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-15T20:54:47.657879] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-15T20:54:47.910416] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T20:54:48.301636] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T20:54:48.457898] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-15T20:54:49.257890] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-15T20:54:49.604639] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T20:54:50.063129] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-15T20:54:50.080793] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T20:54:50.432792] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T20:54:50.857907] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-15T20:54:51.657935] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-15T20:54:51.702373] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:54:52.457920] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-15T20:54:52.544206] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T20:54:53.141201] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T20:54:53.257872] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-15T20:54:53.820271] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T20:54:54.057870] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-15T20:54:54.857878] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-15T20:54:55.318377] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T20:54:55.657861] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-15T20:54:55.800286] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T20:54:55.835287] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:54:55.838866] [INFO ] [REMOTE ] VAC: Full fetch complete (38054 records). [2025-09-15T20:54:55.838951] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-15T20:54:56.221734] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-15T20:54:56.221822] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-15T20:54:56.222628] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-15T20:54:56.222692] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-15T20:54:56.223587] [DEBUG] [LOCAL ] VAC: Trimmed 38054 records to 25141 (keeping 150 days of data) [2025-09-15T20:54:56.378159] [DEBUG] [LOCAL ] VAC: Primary data saved (25141 records). [2025-09-15T20:54:56.378296] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-15T20:54:56.378387] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. VAC took 21.3s. Estimated remaining: 17m 1s. Rate: 9.4 symbols/min [2025-09-15T20:54:56.468019] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-15T20:54:56.549860] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:54:56.555299] [DEBUG] [LOCAL ] VATE: Loaded 3658 existing records from primary storage. [2025-09-15T20:54:56.555387] [INFO ] [MAIN ] VATE: Loaded 3658 existing records. [2025-09-15T20:54:56.732280] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:54:56.732541] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-15T20:54:56.732599] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-15T20:54:56.732874] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-15T20:54:56.732925] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-15T20:54:57.092594] [INFO ] [REMOTE ] VATE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:54:57.257870] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-15T20:54:57.750603] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T20:54:58.022681] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T20:54:58.058213] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-15T20:54:58.058089] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:54:58.857888] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-15T20:54:59.657890] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-15T20:54:59.912339] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T20:55:00.218722] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T20:55:00.224404] [INFO ] [REMOTE ] VAL: Full fetch complete (55200 records). [2025-09-15T20:55:00.224546] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-15T20:55:00.418912] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T20:55:00.463021] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-15T20:55:00.629862] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-15T20:55:00.629949] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-15T20:55:00.630927] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-15T20:55:00.630970] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-15T20:55:00.632155] [DEBUG] [LOCAL ] VAL: Trimmed 55200 records to 37087 (keeping 150 days of data) [2025-09-15T20:55:00.862402] [DEBUG] [LOCAL ] VAL: Primary data saved (37087 records). [2025-09-15T20:55:00.862559] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-15T20:55:00.862688] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. VAL took 23.4s. Estimated remaining: 16m 54s. Rate: 9.4 symbols/min [2025-09-15T20:55:01.034369] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:01.041513] [DEBUG] [LOCAL ] VBF: Loaded 5020 existing records from primary storage. [2025-09-15T20:55:01.041656] [INFO ] [MAIN ] VBF: Loaded 5020 existing records. [2025-09-15T20:55:01.235365] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:01.235671] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-15T20:55:01.235720] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-15T20:55:01.236027] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-15T20:55:01.236082] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-15T20:55:01.270631] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-15T20:55:01.637980] [INFO ] [REMOTE ] VBF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:02.036617] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T20:55:02.057865] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-15T20:55:02.125554] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T20:55:02.134222] [INFO ] [REMOTE ] V: Full fetch complete (58442 records). [2025-09-15T20:55:02.134384] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-15T20:55:02.527095] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-15T20:55:02.527210] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-15T20:55:02.528506] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-15T20:55:02.528557] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-15T20:55:02.530248] [DEBUG] [LOCAL ] V: Trimmed 58442 records to 39724 (keeping 150 days of data) [2025-09-15T20:55:02.677587] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T20:55:02.807168] [DEBUG] [LOCAL ] V: Primary data saved (39724 records). [2025-09-15T20:55:02.807347] [INFO ] [MAIN ] V: Full history saved. [2025-09-15T20:55:02.807450] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. V took 34.9s. Estimated remaining: 16m 48s. Rate: 9.4 symbols/min [2025-09-15T20:55:02.863138] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-15T20:55:02.981945] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:02.992783] [DEBUG] [LOCAL ] VCV: Loaded 10312 existing records from primary storage. [2025-09-15T20:55:02.992932] [INFO ] [MAIN ] VCV: Loaded 10312 existing records. [2025-09-15T20:55:03.169909] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:03.170192] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-15T20:55:03.170248] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-15T20:55:03.170581] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-15T20:55:03.170626] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-15T20:55:03.529260] [INFO ] [REMOTE ] VCV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:03.657890] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-15T20:55:03.792684] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:55:04.305607] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T20:55:04.457860] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-15T20:55:05.257868] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-15T20:55:05.287932] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T20:55:06.057866] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-15T20:55:06.190241] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:55:06.698183] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T20:55:06.857877] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-15T20:55:07.410518] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T20:55:07.657886] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-15T20:55:08.457933] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-15T20:55:09.257895] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-15T20:55:09.302454] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T20:55:09.909802] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T20:55:09.992432] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-15T20:55:10.057837] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-15T20:55:10.857904] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-15T20:55:11.273630] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T20:55:11.278731] [INFO ] [REMOTE ] VATE: Full fetch complete (6835 records). [2025-09-15T20:55:11.278838] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-15T20:55:11.643324] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-15T20:55:11.643410] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-15T20:55:11.643630] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-15T20:55:11.643708] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-15T20:55:11.644116] [DEBUG] [LOCAL ] VATE: Trimmed 6835 records to 3662 (keeping 150 days of data) [2025-09-15T20:55:11.665477] [DEBUG] [LOCAL ] VATE: Primary data saved (3662 records). [2025-09-15T20:55:11.665786] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-15T20:55:11.665916] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VATE took 15.3s. Estimated remaining: 16m 41s. Rate: 9.4 symbols/min [2025-09-15T20:55:11.665572] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-15T20:55:11.841152] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:11.881660] [DEBUG] [LOCAL ] VEEV: Loaded 35561 existing records from primary storage. [2025-09-15T20:55:11.881885] [INFO ] [MAIN ] VEEV: Loaded 35561 existing records. [2025-09-15T20:55:12.066504] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:12.066846] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-15T20:55:12.066895] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-15T20:55:12.067689] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-15T20:55:12.067746] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-15T20:55:12.363796] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T20:55:12.453048] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:12.465172] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-15T20:55:12.489227] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-15T20:55:13.257893] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-15T20:55:13.783062] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T20:55:13.925740] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T20:55:14.057876] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-15T20:55:14.852189] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T20:55:14.857811] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-15T20:55:15.651657] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T20:55:15.657818] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-15T20:55:16.332429] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T20:55:16.457918] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-15T20:55:17.188406] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T20:55:17.190584] [INFO ] [REMOTE ] VBF: Full fetch complete (8104 records). [2025-09-15T20:55:17.190733] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-15T20:55:17.263080] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-15T20:55:17.665007] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-15T20:55:17.665123] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-15T20:55:17.665380] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-15T20:55:17.665425] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-15T20:55:17.665900] [DEBUG] [LOCAL ] VBF: Trimmed 8104 records to 5005 (keeping 150 days of data) [2025-09-15T20:55:17.702452] [DEBUG] [LOCAL ] VBF: Primary data saved (5005 records). [2025-09-15T20:55:17.702685] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-15T20:55:17.702805] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VBF took 16.8s. Estimated remaining: 16m 35s. Rate: 9.4 symbols/min [2025-09-15T20:55:17.886960] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:17.898218] [DEBUG] [LOCAL ] VEL: Loaded 9000 existing records from primary storage. [2025-09-15T20:55:17.898358] [INFO ] [MAIN ] VEL: Loaded 9000 existing records. [2025-09-15T20:55:18.058209] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-15T20:55:18.077771] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:18.079712] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-15T20:55:18.079767] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-15T20:55:18.080158] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-15T20:55:18.080207] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-15T20:55:18.435183] [INFO ] [REMOTE ] VEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:18.857919] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-15T20:55:19.131568] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T20:55:19.329815] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T20:55:19.657886] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-15T20:55:19.819930] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T20:55:19.826165] [INFO ] [REMOTE ] VALE: Full fetch complete (58375 records). [2025-09-15T20:55:19.826343] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-15T20:55:20.227762] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-15T20:55:20.227909] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-15T20:55:20.228998] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-15T20:55:20.229050] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-15T20:55:20.230367] [DEBUG] [LOCAL ] VALE: Trimmed 58375 records to 39655 (keeping 150 days of data) [2025-09-15T20:55:20.457875] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-15T20:55:20.474030] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T20:55:20.508025] [DEBUG] [LOCAL ] VALE: Primary data saved (39655 records). [2025-09-15T20:55:20.508172] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-15T20:55:20.508889] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VALE took 40.6s. Estimated remaining: 16m 28s. Rate: 9.4 symbols/min [2025-09-15T20:55:20.677806] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:20.712909] [DEBUG] [LOCAL ] VET: Loaded 32812 existing records from primary storage. [2025-09-15T20:55:20.713072] [INFO ] [MAIN ] VET: Loaded 32812 existing records. [2025-09-15T20:55:20.898726] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:20.899013] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-15T20:55:20.899060] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-15T20:55:20.899749] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-15T20:55:20.899810] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-15T20:55:21.248436] [INFO ] [REMOTE ] VET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:21.257901] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-15T20:55:22.057870] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-15T20:55:22.116007] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T20:55:22.184540] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T20:55:22.857921] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-15T20:55:23.337371] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T20:55:23.657934] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-15T20:55:23.828007] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T20:55:24.457972] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-15T20:55:24.468555] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T20:55:25.217833] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T20:55:25.257932] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-15T20:55:26.057933] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-15T20:55:26.167236] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T20:55:26.857908] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-15T20:55:27.657885] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-15T20:55:27.777434] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T20:55:28.413197] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T20:55:28.457919] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-15T20:55:28.486829] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T20:55:29.257938] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-15T20:55:30.013871] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T20:55:30.057883] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-15T20:55:30.137887] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T20:55:30.857878] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-15T20:55:31.578449] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:55:31.580923] [INFO ] [REMOTE ] VEL: Full fetch complete (13549 records). [2025-09-15T20:55:31.581226] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-15T20:55:31.667612] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-15T20:55:31.955612] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-15T20:55:31.955802] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-15T20:55:31.956161] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-15T20:55:31.956222] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-15T20:55:31.957269] [DEBUG] [LOCAL ] VEL: Trimmed 13549 records to 8877 (keeping 150 days of data) [2025-09-15T20:55:32.026510] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T20:55:32.049136] [DEBUG] [LOCAL ] VEL: Primary data saved (8877 records). [2025-09-15T20:55:32.049255] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-15T20:55:32.049337] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VEL took 14.3s. Estimated remaining: 16m 22s. Rate: 9.4 symbols/min [2025-09-15T20:55:32.219480] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:32.262754] [DEBUG] [LOCAL ] VFC: Loaded 40360 existing records from primary storage. [2025-09-15T20:55:32.262926] [INFO ] [MAIN ] VFC: Loaded 40360 existing records. [2025-09-15T20:55:32.440197] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:32.440423] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-15T20:55:32.440469] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-15T20:55:32.441356] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-15T20:55:32.441407] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-15T20:55:32.463161] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-15T20:55:32.746221] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T20:55:32.834302] [INFO ] [REMOTE ] VFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:33.257911] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-15T20:55:34.057919] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-15T20:55:34.168783] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T20:55:34.305705] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T20:55:34.857879] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-15T20:55:35.635941] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:55:35.653531] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T20:55:35.657873] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-15T20:55:36.457929] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-15T20:55:37.083188] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T20:55:37.088855] [INFO ] [REMOTE ] VEEV: Full fetch complete (51585 records). [2025-09-15T20:55:37.089003] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-15T20:55:37.263101] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-15T20:55:37.519253] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-15T20:55:37.519349] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-15T20:55:37.520336] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-15T20:55:37.520384] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-15T20:55:37.521683] [DEBUG] [LOCAL ] VEEV: Trimmed 51585 records to 34937 (keeping 150 days of data) [2025-09-15T20:55:37.775514] [DEBUG] [LOCAL ] VEEV: Primary data saved (34937 records). [2025-09-15T20:55:37.775723] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-15T20:55:37.777187] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VEEV took 26.1s. Estimated remaining: 16m 16s. Rate: 9.4 symbols/min [2025-09-15T20:55:37.971791] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:38.021319] [DEBUG] [LOCAL ] VG: Loaded 40214 existing records from primary storage. [2025-09-15T20:55:38.021485] [INFO ] [MAIN ] VG: Loaded 40214 existing records. [2025-09-15T20:55:38.064057] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-15T20:55:38.142200] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T20:55:38.207853] [INFO ] [REMOTE ] VCV: Full fetch complete (14209 records). [2025-09-15T20:55:38.212489] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-15T20:55:38.212372] [WARN ] [MAIN ] VG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:38.213351] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-15T20:55:38.213461] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-15T20:55:38.234694] [DEBUG] [LOCAL ] VG: Deleted primary data file. [2025-09-15T20:55:38.250016] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-15T20:55:38.889024] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-15T20:55:38.945575] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-15T20:55:38.966108] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-15T20:55:38.976162] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-15T20:55:39.006531] [INFO ] [REMOTE ] VG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:39.002977] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-15T20:55:39.006708] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-15T20:55:39.008887] [DEBUG] [LOCAL ] VCV: Trimmed 14209 records to 10167 (keeping 150 days of data) [2025-09-15T20:55:39.075633] [DEBUG] [LOCAL ] VCV: Primary data saved (10167 records). [2025-09-15T20:55:39.075848] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-15T20:55:39.075986] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VCV took 36.3s. Estimated remaining: 16m 9s. Rate: 9.4 symbols/min [2025-09-15T20:55:39.246381] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:39.251777] [DEBUG] [LOCAL ] VGI: Loaded 3911 existing records from primary storage. [2025-09-15T20:55:39.251874] [INFO ] [MAIN ] VGI: Loaded 3911 existing records. [2025-09-15T20:55:39.425734] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:39.426026] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-15T20:55:39.426085] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-15T20:55:39.426340] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-15T20:55:39.426385] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-15T20:55:39.666316] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-15T20:55:39.775056] [INFO ] [REMOTE ] VGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:39.840612] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T20:55:40.457898] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-15T20:55:40.732128] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T20:55:41.151519] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T20:55:41.257933] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-15T20:55:41.544609] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T20:55:42.057926] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-15T20:55:42.857970] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-15T20:55:43.181724] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T20:55:43.229435] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T20:55:43.276972] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T20:55:43.657851] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-15T20:55:44.213008] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T20:55:44.457876] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-15T20:55:45.257890] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-15T20:55:45.932393] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T20:55:46.057868] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-15T20:55:46.857852] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-15T20:55:46.982006] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T20:55:47.018296] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T20:55:47.023325] [INFO ] [REMOTE ] VET: Full fetch complete (48218 records). [2025-09-15T20:55:47.023432] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-15T20:55:47.418542] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-15T20:55:47.418841] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T20:55:47.418917] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-15T20:55:47.422155] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-15T20:55:47.422221] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-15T20:55:47.423364] [DEBUG] [LOCAL ] VET: Trimmed 48218 records to 32083 (keeping 150 days of data) [2025-09-15T20:55:47.634212] [DEBUG] [LOCAL ] VET: Primary data saved (32083 records). [2025-09-15T20:55:47.634403] [INFO ] [MAIN ] VET: Full history saved. [2025-09-15T20:55:47.635011] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VET took 27.1s. Estimated remaining: 16m 3s. Rate: 9.4 symbols/min [2025-09-15T20:55:47.665359] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-15T20:55:47.810337] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:47.828523] [DEBUG] [LOCAL ] VGM: Loaded 14522 existing records from primary storage. [2025-09-15T20:55:47.828724] [INFO ] [MAIN ] VGM: Loaded 14522 existing records. [2025-09-15T20:55:48.000551] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:55:48.000832] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-15T20:55:48.000878] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-15T20:55:48.001289] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-15T20:55:48.001337] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-15T20:55:48.353473] [INFO ] [REMOTE ] VGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:48.457860] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-15T20:55:49.257893] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-15T20:55:49.440141] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T20:55:49.521214] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T20:55:49.877279] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T20:55:50.057942] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-15T20:55:50.857879] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-15T20:55:51.555510] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T20:55:51.657869] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-15T20:55:52.189419] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-15T20:55:52.378233] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T20:55:52.457884] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-15T20:55:53.210317] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T20:55:53.212062] [INFO ] [REMOTE ] VGI: Full fetch complete (5593 records). [2025-09-15T20:55:53.212133] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-15T20:55:53.266043] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-15T20:55:53.593227] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-15T20:55:53.593336] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-15T20:55:53.593566] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-15T20:55:53.593661] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-15T20:55:53.594352] [DEBUG] [LOCAL ] VGI: Trimmed 5593 records to 3870 (keeping 150 days of data) [2025-09-15T20:55:53.620226] [DEBUG] [LOCAL ] VGI: Primary data saved (3870 records). [2025-09-15T20:55:53.620385] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-15T20:55:53.620496] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VGI took 14.5s. Estimated remaining: 15m 57s. Rate: 9.4 symbols/min [2025-09-15T20:55:53.792511] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:55:53.792790] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-15T20:55:53.792830] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-15T20:55:53.792982] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-15T20:55:53.793022] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-15T20:55:53.793061] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-15T20:55:53.793094] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-15T20:55:54.067012] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-15T20:55:54.155356] [INFO ] [REMOTE ] VHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:55:54.859986] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-15T20:55:54.861956] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:55:55.502318] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T20:55:55.657903] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-15T20:55:56.457947] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-15T20:55:56.619895] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T20:55:56.807292] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T20:55:57.257922] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-15T20:55:58.057858] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-15T20:55:58.330039] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T20:55:58.428243] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-15T20:55:58.571311] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T20:55:58.857871] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-15T20:55:59.657880] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-15T20:56:00.457873] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-15T20:56:00.597595] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T20:56:01.095981] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T20:56:01.257883] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-15T20:56:02.057871] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-15T20:56:02.245044] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T20:56:02.857841] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-15T20:56:03.167095] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T20:56:03.208096] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T20:56:03.657867] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-15T20:56:04.097280] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T20:56:04.457857] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-15T20:56:04.903134] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T20:56:04.906484] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T20:56:05.257974] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-15T20:56:06.057918] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-15T20:56:06.488299] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T20:56:06.857915] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-15T20:56:07.111589] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T20:56:07.469544] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:56:07.657895] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-15T20:56:08.457881] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-15T20:56:09.232891] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:56:09.242307] [INFO ] [REMOTE ] VFC: Full fetch complete (58269 records). [2025-09-15T20:56:09.242517] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-15T20:56:09.263051] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-15T20:56:09.819120] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-15T20:56:09.819254] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-15T20:56:09.820932] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-15T20:56:09.821006] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-15T20:56:09.823172] [DEBUG] [LOCAL ] VFC: Trimmed 58269 records to 39580 (keeping 150 days of data) [2025-09-15T20:56:09.970405] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T20:56:10.113924] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-15T20:56:10.200256] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:56:10.209013] [INFO ] [REMOTE ] VG: Full fetch complete (58085 records). [2025-09-15T20:56:10.209786] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-15T20:56:10.740339] [DEBUG] [VALIDATOR ] VG: All expected trading days are present. [2025-09-15T20:56:10.743270] [DEBUG] [LOCAL ] VFC: Primary data saved (39580 records). [2025-09-15T20:56:10.743427] [DEBUG] [VALIDATOR ] VG: Primary data validation passed. [2025-09-15T20:56:10.744572] [INFO ] [MAIN ] VG: Fetched primary data is valid. [2025-09-15T20:56:10.744672] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-15T20:56:10.744740] [DEBUG] [LOCAL ] VG: Saving primary data. [2025-09-15T20:56:10.744868] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VFC took 38.7s. Estimated remaining: 15m 51s. Rate: 9.4 symbols/min [2025-09-15T20:56:10.853933] [DEBUG] [LOCAL ] VG: Trimmed 58085 records to 39436 (keeping 150 days of data) [2025-09-15T20:56:10.865663] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-15T20:56:10.990212] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:11.025363] [DEBUG] [LOCAL ] VHI: Loaded 2034 existing records from primary storage. [2025-09-15T20:56:11.027370] [INFO ] [MAIN ] VHI: Loaded 2034 existing records. [2025-09-15T20:56:11.225327] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:11.228067] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-15T20:56:11.228618] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-15T20:56:11.245294] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-15T20:56:11.246730] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-15T20:56:11.259696] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T20:56:11.414954] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T20:56:11.662483] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-15T20:56:11.730083] [INFO ] [REMOTE ] VHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:11.767250] [DEBUG] [LOCAL ] VG: Primary data saved (39436 records). [2025-09-15T20:56:11.767401] [INFO ] [MAIN ] VG: Full history saved. [2025-09-15T20:56:11.768743] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VG took 34.0s. Estimated remaining: 15m 44s. Rate: 9.4 symbols/min [2025-09-15T20:56:11.937626] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:11.937848] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-15T20:56:11.937888] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-15T20:56:11.938006] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-15T20:56:11.938044] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-15T20:56:11.938083] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-15T20:56:11.938114] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-15T20:56:12.279751] [INFO ] [REMOTE ] VIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:12.457843] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-15T20:56:12.634456] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:56:12.637474] [INFO ] [REMOTE ] VGM: Full fetch complete (19685 records). [2025-09-15T20:56:12.637548] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-15T20:56:12.756146] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:12.795439] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-15T20:56:12.999609] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-15T20:56:12.999705] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-15T20:56:13.000157] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-15T20:56:13.000198] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-15T20:56:13.000830] [DEBUG] [LOCAL ] VGM: Trimmed 19685 records to 14302 (keeping 150 days of data) [2025-09-15T20:56:13.093542] [DEBUG] [LOCAL ] VGM: Primary data saved (14302 records). [2025-09-15T20:56:13.093713] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-15T20:56:13.093818] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VGM took 25.5s. Estimated remaining: 15m 37s. Rate: 9.4 symbols/min [2025-09-15T20:56:13.265306] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-15T20:56:13.269493] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:13.316014] [DEBUG] [LOCAL ] VICI: Loaded 40397 existing records from primary storage. [2025-09-15T20:56:13.316193] [INFO ] [MAIN ] VICI: Loaded 40397 existing records. [2025-09-15T20:56:13.489835] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:13.490152] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-15T20:56:13.490218] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-15T20:56:13.491264] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-15T20:56:13.491341] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-15T20:56:13.798975] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T20:56:13.877574] [INFO ] [REMOTE ] VICI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:14.057872] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-15T20:56:14.157269] [DEBUG] [REMOTE ] VICI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T20:56:14.157553] [WARN ] [REMOTE ] VICI: No data returned for month 2025-02 [2025-09-15T20:56:14.857874] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-15T20:56:15.657914] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-15T20:56:15.939902] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:15.940269] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-15T20:56:16.457860] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-15T20:56:16.856367] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:16.856910] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-15T20:56:16.890906] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T20:56:17.257879] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-15T20:56:17.536395] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:17.536772] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-15T20:56:18.057912] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-15T20:56:18.857943] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-15T20:56:19.287499] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T20:56:19.657909] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-15T20:56:19.735164] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T20:56:19.910264] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:19.910637] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-15T20:56:20.457918] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-15T20:56:20.840168] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-15T20:56:20.841147] [INFO ] [REMOTE ] VHC: Full fetch complete (2547 records). [2025-09-15T20:56:20.841218] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-15T20:56:21.023116] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T20:56:21.023334] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:56:21.023385] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:56:21.023430] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-15T20:56:21.023500] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-15T20:56:21.023539] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-15T20:56:21.023595] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-15T20:56:21.023671] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VHC took 27.4s. Estimated remaining: 15m 31s. Rate: 9.4 symbols/min [2025-09-15T20:56:21.206170] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:21.250251] [DEBUG] [LOCAL ] VIK: Loaded 39526 existing records from primary storage. [2025-09-15T20:56:21.250448] [INFO ] [MAIN ] VIK: Loaded 39526 existing records. [2025-09-15T20:56:21.263044] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-15T20:56:21.436277] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:21.436568] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-15T20:56:21.436619] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-15T20:56:21.437554] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-15T20:56:21.437632] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-15T20:56:21.824479] [INFO ] [REMOTE ] VIK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:22.057880] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-15T20:56:22.315776] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:22.316175] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-15T20:56:22.857884] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-15T20:56:23.044196] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T20:56:23.477805] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T20:56:23.657916] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-15T20:56:24.457895] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-15T20:56:24.711406] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:56:24.712163] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-15T20:56:25.139942] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:56:25.257921] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-15T20:56:26.057929] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-15T20:56:26.518422] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T20:56:26.717794] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:56:26.857918] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-15T20:56:27.361298] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:56:27.362630] [INFO ] [REMOTE ] VIA: Full fetch complete (465 records). [2025-09-15T20:56:27.362721] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-15T20:56:27.547029] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 2 unique days, need 150 days [2025-09-15T20:56:27.547281] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:56:27.547363] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:56:27.547437] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-15T20:56:27.547508] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-15T20:56:27.547545] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-15T20:56:27.547592] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-15T20:56:27.547669] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VIA took 15.8s. Estimated remaining: 15m 25s. Rate: 9.4 symbols/min [2025-09-15T20:56:27.662950] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-15T20:56:27.719794] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:27.769004] [DEBUG] [LOCAL ] VIPS: Loaded 38450 existing records from primary storage. [2025-09-15T20:56:27.769178] [INFO ] [MAIN ] VIPS: Loaded 38450 existing records. [2025-09-15T20:56:27.952063] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:27.952786] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-15T20:56:27.952841] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-15T20:56:27.953831] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-15T20:56:27.953933] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-15T20:56:28.335203] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:28.354168] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T20:56:28.457882] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-15T20:56:29.257901] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-15T20:56:30.057882] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-15T20:56:30.246385] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T20:56:30.674893] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:56:30.857859] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-15T20:56:31.657932] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-15T20:56:31.877754] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T20:56:32.296583] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T20:56:32.440386] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T20:56:32.457818] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-15T20:56:33.257890] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-15T20:56:34.057975] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-15T20:56:34.330878] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T20:56:34.453070] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T20:56:34.857879] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-15T20:56:35.038205] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T20:56:35.354057] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T20:56:35.355008] [INFO ] [REMOTE ] VHI: Full fetch complete (3257 records). [2025-09-15T20:56:35.355078] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-15T20:56:35.662993] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-15T20:56:35.718833] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-15T20:56:35.718909] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-15T20:56:35.719028] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-15T20:56:35.719068] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-15T20:56:35.719430] [DEBUG] [LOCAL ] VHI: Trimmed 3257 records to 1997 (keeping 150 days of data) [2025-09-15T20:56:35.732630] [DEBUG] [LOCAL ] VHI: Primary data saved (1997 records). [2025-09-15T20:56:35.732720] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-15T20:56:35.732796] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VHI took 25.0s. Estimated remaining: 15m 19s. Rate: 9.4 symbols/min [2025-09-15T20:56:35.907900] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:35.942273] [DEBUG] [LOCAL ] VIRT: Loaded 35002 existing records from primary storage. [2025-09-15T20:56:35.942425] [INFO ] [MAIN ] VIRT: Loaded 35002 existing records. [2025-09-15T20:56:36.123676] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:36.123956] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-15T20:56:36.124004] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-15T20:56:36.124820] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-15T20:56:36.124875] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-15T20:56:36.462954] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-15T20:56:36.489373] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:37.257885] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-15T20:56:37.502218] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T20:56:38.057866] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-15T20:56:38.470678] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-15T20:56:38.568158] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T20:56:38.857888] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-15T20:56:39.539671] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T20:56:39.657823] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-15T20:56:40.471888] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-15T20:56:40.474627] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:56:41.088607] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T20:56:41.257842] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-15T20:56:42.057846] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-15T20:56:42.382526] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T20:56:42.858591] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-15T20:56:42.899796] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T20:56:43.493959] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T20:56:43.657863] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-15T20:56:44.457907] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-15T20:56:44.592967] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T20:56:45.122514] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T20:56:45.257816] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-15T20:56:46.057939] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-15T20:56:46.094041] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T20:56:46.099862] [INFO ] [REMOTE ] VICI: Full fetch complete (52869 records). [2025-09-15T20:56:46.099974] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-15T20:56:46.285839] [WARN ] [VALIDATOR ] VICI: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T20:56:46.286437] [FATAL] [MAIN ] VICI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:56:46.286491] [WARN ] [MAIN ] VICI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:56:46.286532] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-15T20:56:46.286597] [DEBUG] [LOCAL ] VICI: No primary data file found to delete. [2025-09-15T20:56:46.286656] [INFO ] [LOCAL ] VICI: Starting deletion of derivative data. [2025-09-15T20:56:46.287000] [DEBUG] [LOCAL ] VICI: Deleted derivative data file. [2025-09-15T20:56:46.287738] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VICI took 33.2s. Estimated remaining: 15m 12s. Rate: 9.4 symbols/min [2025-09-15T20:56:46.455142] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:46.490656] [DEBUG] [LOCAL ] VIST: Loaded 34464 existing records from primary storage. [2025-09-15T20:56:46.490815] [INFO ] [MAIN ] VIST: Loaded 34464 existing records. [2025-09-15T20:56:46.667945] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:46.668310] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-15T20:56:46.668388] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-15T20:56:46.669070] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-15T20:56:46.669120] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-15T20:56:46.844858] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:56:46.876381] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-15T20:56:47.041326] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T20:56:47.078577] [INFO ] [REMOTE ] VIST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:47.079021] [INFO ] [REMOTE ] VIK: Full fetch complete (57035 records). [2025-09-15T20:56:47.079106] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-15T20:56:47.450903] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-15T20:56:47.450995] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-15T20:56:47.451991] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-15T20:56:47.452038] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-15T20:56:47.453257] [DEBUG] [LOCAL ] VIK: Trimmed 57035 records to 38758 (keeping 150 days of data) [2025-09-15T20:56:47.660137] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-15T20:56:47.700068] [DEBUG] [LOCAL ] VIK: Primary data saved (38758 records). [2025-09-15T20:56:47.700269] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-15T20:56:47.700399] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VIK took 26.7s. Estimated remaining: 15m 6s. Rate: 9.4 symbols/min [2025-09-15T20:56:47.871169] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:47.904026] [DEBUG] [LOCAL ] VIV: Loaded 34128 existing records from primary storage. [2025-09-15T20:56:47.904191] [INFO ] [MAIN ] VIV: Loaded 34128 existing records. [2025-09-15T20:56:48.080204] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:48.080474] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-15T20:56:48.080520] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-15T20:56:48.081245] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-15T20:56:48.081295] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-15T20:56:48.431865] [INFO ] [REMOTE ] VIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:48.457847] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-15T20:56:48.702203] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T20:56:49.258023] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-15T20:56:49.359543] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T20:56:49.837597] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T20:56:50.057904] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-15T20:56:50.857851] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-15T20:56:50.909917] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T20:56:51.330406] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T20:56:51.657922] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-15T20:56:52.079131] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T20:56:52.457929] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-15T20:56:53.257957] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-15T20:56:53.334250] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T20:56:54.057878] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-15T20:56:54.165123] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T20:56:54.743278] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:56:54.857843] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-15T20:56:55.604594] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:56:55.657858] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-15T20:56:56.425999] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T20:56:56.457859] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-15T20:56:57.124035] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T20:56:57.257869] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-15T20:56:58.066142] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-15T20:56:58.069017] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:56:58.428490] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T20:56:58.433935] [INFO ] [REMOTE ] VIRT: Full fetch complete (51160 records). [2025-09-15T20:56:58.434085] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-15T20:56:58.819987] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-15T20:56:58.820081] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-15T20:56:58.821039] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-15T20:56:58.821115] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-15T20:56:58.822234] [DEBUG] [LOCAL ] VIRT: Trimmed 51160 records to 34304 (keeping 150 days of data) [2025-09-15T20:56:58.882357] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-15T20:56:59.051140] [DEBUG] [LOCAL ] VIRT: Primary data saved (34304 records). [2025-09-15T20:56:59.051319] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-15T20:56:59.051435] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VIRT took 23.3s. Estimated remaining: 14m 60s. Rate: 9.4 symbols/min [2025-09-15T20:56:59.231580] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:56:59.246311] [DEBUG] [LOCAL ] VKQ: Loaded 13602 existing records from primary storage. [2025-09-15T20:56:59.246453] [INFO ] [MAIN ] VKQ: Loaded 13602 existing records. [2025-09-15T20:56:59.426977] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:56:59.427254] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-15T20:56:59.427306] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-15T20:56:59.427709] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-15T20:56:59.427757] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-15T20:56:59.667918] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-15T20:56:59.792719] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:56:59.809369] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:56:59.815408] [INFO ] [REMOTE ] VIPS: Full fetch complete (56058 records). [2025-09-15T20:56:59.815611] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-15T20:57:00.210177] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-15T20:57:00.210266] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-15T20:57:00.211265] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-15T20:57:00.211330] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-15T20:57:00.212629] [DEBUG] [LOCAL ] VIPS: Trimmed 56058 records to 37673 (keeping 150 days of data) [2025-09-15T20:57:00.453821] [DEBUG] [LOCAL ] VIPS: Primary data saved (37673 records). [2025-09-15T20:57:00.454065] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-15T20:57:00.455235] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIPS took 32.9s. Estimated remaining: 14m 53s. Rate: 9.4 symbols/min [2025-09-15T20:57:00.466409] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-15T20:57:00.633094] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:00.663317] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T20:57:00.689687] [DEBUG] [LOCAL ] VLN: Loaded 22236 existing records from primary storage. [2025-09-15T20:57:00.689834] [INFO ] [MAIN ] VLN: Loaded 22236 existing records. [2025-09-15T20:57:00.868105] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:00.868375] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-15T20:57:00.868420] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-15T20:57:00.868898] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-15T20:57:00.868946] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-15T20:57:01.227435] [INFO ] [REMOTE ] VLN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:01.262939] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-15T20:57:01.280672] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:57:01.337657] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T20:57:02.057872] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-15T20:57:02.857875] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-15T20:57:03.657893] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-15T20:57:03.841717] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-15T20:57:04.457848] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-15T20:57:04.602880] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-15T20:57:05.025163] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-15T20:57:05.173864] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T20:57:05.257831] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-15T20:57:05.569146] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T20:57:05.574200] [INFO ] [REMOTE ] VIV: Full fetch complete (49219 records). [2025-09-15T20:57:05.574349] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-15T20:57:05.967248] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-15T20:57:05.967342] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-15T20:57:05.968271] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-15T20:57:05.968317] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-15T20:57:05.969330] [DEBUG] [LOCAL ] VIV: Trimmed 49219 records to 33492 (keeping 150 days of data) [2025-09-15T20:57:06.060178] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-15T20:57:06.112048] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T20:57:06.203517] [DEBUG] [LOCAL ] VIV: Primary data saved (33492 records). [2025-09-15T20:57:06.203704] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-15T20:57:06.203820] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VIV took 18.5s. Estimated remaining: 14m 47s. Rate: 9.4 symbols/min [2025-09-15T20:57:06.374298] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:06.417010] [DEBUG] [LOCAL ] VLO: Loaded 39975 existing records from primary storage. [2025-09-15T20:57:06.417176] [INFO ] [MAIN ] VLO: Loaded 39975 existing records. [2025-09-15T20:57:06.600254] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:06.600583] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-15T20:57:06.600634] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-15T20:57:06.601557] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-15T20:57:06.601616] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-15T20:57:06.863024] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-15T20:57:06.962375] [INFO ] [REMOTE ] VLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:07.479155] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T20:57:07.657959] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-15T20:57:07.918903] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T20:57:08.457918] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-15T20:57:08.802365] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T20:57:09.257894] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-15T20:57:10.064429] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-15T20:57:10.069616] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T20:57:10.186530] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T20:57:10.857888] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-15T20:57:11.378448] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T20:57:11.537736] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T20:57:11.657855] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-15T20:57:12.457847] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-15T20:57:12.596345] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T20:57:13.257928] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-15T20:57:13.995275] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T20:57:14.057887] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-15T20:57:14.857873] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-15T20:57:15.002407] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T20:57:15.008254] [INFO ] [REMOTE ] VIST: Full fetch complete (50112 records). [2025-09-15T20:57:15.008405] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-15T20:57:15.398296] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-15T20:57:15.398394] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-15T20:57:15.399448] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-15T20:57:15.399539] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-15T20:57:15.400986] [DEBUG] [LOCAL ] VIST: Trimmed 50112 records to 33693 (keeping 150 days of data) [2025-09-15T20:57:15.611716] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T20:57:15.633549] [DEBUG] [LOCAL ] VIST: Primary data saved (33693 records). [2025-09-15T20:57:15.633671] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-15T20:57:15.638800] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VIST took 29.4s. Estimated remaining: 14m 40s. Rate: 9.4 symbols/min [2025-09-15T20:57:15.662937] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-15T20:57:15.818314] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:15.852158] [DEBUG] [LOCAL ] VLRS: Loaded 30025 existing records from primary storage. [2025-09-15T20:57:15.852296] [INFO ] [MAIN ] VLRS: Loaded 30025 existing records. [2025-09-15T20:57:16.033236] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:16.033500] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-15T20:57:16.033579] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-15T20:57:16.034227] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-15T20:57:16.034697] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-15T20:57:16.409158] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:16.457846] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-15T20:57:16.637836] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T20:57:17.240248] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T20:57:17.257820] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-15T20:57:17.846324] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T20:57:18.057914] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-15T20:57:18.467977] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T20:57:18.471952] [INFO ] [REMOTE ] VLN: Full fetch complete (30252 records). [2025-09-15T20:57:18.472108] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-15T20:57:18.834330] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-15T20:57:18.834414] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-15T20:57:18.835028] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-15T20:57:18.835071] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-15T20:57:18.835864] [DEBUG] [LOCAL ] VLN: Trimmed 30252 records to 21776 (keeping 150 days of data) [2025-09-15T20:57:18.889543] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-15T20:57:18.971747] [DEBUG] [LOCAL ] VLN: Primary data saved (21776 records). [2025-09-15T20:57:18.971885] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-15T20:57:18.971991] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VLN took 18.5s. Estimated remaining: 14m 34s. Rate: 9.4 symbols/min [2025-09-15T20:57:19.146362] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:19.152292] [DEBUG] [LOCAL ] VLT: Loaded 3117 existing records from primary storage. [2025-09-15T20:57:19.152395] [INFO ] [MAIN ] VLT: Loaded 3117 existing records. [2025-09-15T20:57:19.327977] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:19.328288] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-15T20:57:19.328367] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-15T20:57:19.328594] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-15T20:57:19.328638] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-15T20:57:19.661618] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-15T20:57:19.681744] [INFO ] [REMOTE ] VLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:19.712492] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T20:57:20.457949] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-15T20:57:20.627897] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T20:57:20.808572] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T20:57:20.911077] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T20:57:21.257887] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-15T20:57:22.057872] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-15T20:57:22.857880] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-15T20:57:23.120932] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T20:57:23.657871] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-15T20:57:23.717272] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T20:57:23.721398] [INFO ] [REMOTE ] VKQ: Full fetch complete (18691 records). [2025-09-15T20:57:23.721590] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-15T20:57:24.104718] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-15T20:57:24.104835] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-15T20:57:24.105358] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-15T20:57:24.105417] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-15T20:57:24.132951] [DEBUG] [LOCAL ] VKQ: Trimmed 18691 records to 13311 (keeping 150 days of data) [2025-09-15T20:57:24.135341] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T20:57:24.243707] [DEBUG] [LOCAL ] VKQ: Primary data saved (13311 records). [2025-09-15T20:57:24.243870] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-15T20:57:24.244005] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VKQ took 25.2s. Estimated remaining: 14m 27s. Rate: 9.4 symbols/min [2025-09-15T20:57:24.384667] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T20:57:24.453632] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:24.457886] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-15T20:57:24.516117] [DEBUG] [LOCAL ] VLTO: Loaded 34339 existing records from primary storage. [2025-09-15T20:57:24.516319] [INFO ] [MAIN ] VLTO: Loaded 34339 existing records. [2025-09-15T20:57:24.775306] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:24.775825] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-15T20:57:24.775912] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-15T20:57:24.776764] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-15T20:57:24.776827] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-15T20:57:25.263092] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-15T20:57:25.319920] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:26.050066] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:57:26.059672] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-15T20:57:26.806980] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T20:57:26.857853] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-15T20:57:26.916321] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T20:57:27.657928] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-15T20:57:28.131686] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T20:57:28.157968] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T20:57:28.457882] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-15T20:57:29.257889] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-15T20:57:30.057913] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-15T20:57:30.179559] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T20:57:30.857937] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-15T20:57:30.879279] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T20:57:30.910396] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:57:31.657878] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-15T20:57:32.471219] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-15T20:57:32.473819] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T20:57:33.098734] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T20:57:33.257861] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-15T20:57:33.372081] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T20:57:34.057910] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-15T20:57:34.597755] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T20:57:34.857883] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-15T20:57:35.491429] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T20:57:35.582125] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T20:57:35.657822] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-15T20:57:36.216403] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T20:57:36.217628] [INFO ] [REMOTE ] VLT: Full fetch complete (5169 records). [2025-09-15T20:57:36.217729] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-15T20:57:36.463069] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-15T20:57:36.569047] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-15T20:57:36.569122] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-15T20:57:36.569264] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-15T20:57:36.569318] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-15T20:57:36.569713] [DEBUG] [LOCAL ] VLT: Trimmed 5169 records to 3151 (keeping 150 days of data) [2025-09-15T20:57:36.590658] [DEBUG] [LOCAL ] VLT: Primary data saved (3151 records). [2025-09-15T20:57:36.590731] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-15T20:57:36.590799] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLT took 17.6s. Estimated remaining: 14m 21s. Rate: 9.4 symbols/min [2025-09-15T20:57:36.756837] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:36.800519] [DEBUG] [LOCAL ] VMC: Loaded 32290 existing records from primary storage. [2025-09-15T20:57:36.800685] [INFO ] [MAIN ] VMC: Loaded 32290 existing records. [2025-09-15T20:57:36.977828] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:36.978069] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-15T20:57:36.978133] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-15T20:57:36.979154] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-15T20:57:36.979217] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-15T20:57:37.262945] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-15T20:57:37.329440] [INFO ] [REMOTE ] VMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:38.057897] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-15T20:57:38.147019] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T20:57:38.495854] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T20:57:38.500763] [INFO ] [REMOTE ] VLRS: Full fetch complete (44923 records). [2025-09-15T20:57:38.500869] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-15T20:57:38.863057] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-15T20:57:38.878865] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-15T20:57:38.878943] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-15T20:57:38.879888] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-15T20:57:38.880020] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-15T20:57:38.881158] [DEBUG] [LOCAL ] VLRS: Trimmed 44923 records to 29317 (keeping 150 days of data) [2025-09-15T20:57:39.055128] [DEBUG] [LOCAL ] VLRS: Primary data saved (29317 records). [2025-09-15T20:57:39.055274] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-15T20:57:39.055374] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLRS took 23.4s. Estimated remaining: 14m 15s. Rate: 9.4 symbols/min [2025-09-15T20:57:39.225172] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:39.238721] [DEBUG] [LOCAL ] VMI: Loaded 11398 existing records from primary storage. [2025-09-15T20:57:39.238855] [INFO ] [MAIN ] VMI: Loaded 11398 existing records. [2025-09-15T20:57:39.417596] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:39.417933] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-15T20:57:39.418012] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-15T20:57:39.418501] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-15T20:57:39.418567] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-15T20:57:39.670064] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-15T20:57:39.740289] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T20:57:39.815514] [INFO ] [REMOTE ] VMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:40.453333] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:57:40.461631] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-15T20:57:41.257849] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-15T20:57:41.415595] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T20:57:41.719072] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T20:57:42.057967] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-15T20:57:42.665416] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T20:57:42.857882] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-15T20:57:43.657883] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-15T20:57:43.972488] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T20:57:44.063832] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T20:57:44.457944] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-15T20:57:45.223004] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T20:57:45.229091] [INFO ] [REMOTE ] VLO: Full fetch complete (57729 records). [2025-09-15T20:57:45.229238] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-15T20:57:45.261847] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-15T20:57:45.611406] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-15T20:57:45.611513] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-15T20:57:45.612526] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-15T20:57:45.612581] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-15T20:57:45.624248] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T20:57:45.623909] [DEBUG] [LOCAL ] VLO: Trimmed 57729 records to 39197 (keeping 150 days of data) [2025-09-15T20:57:45.882224] [DEBUG] [LOCAL ] VLO: Primary data saved (39197 records). [2025-09-15T20:57:45.882380] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-15T20:57:45.882472] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VLO took 39.7s. Estimated remaining: 14m 8s. Rate: 9.4 symbols/min [2025-09-15T20:57:46.050007] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:57:46.060972] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-15T20:57:46.069081] [DEBUG] [LOCAL ] VMO: Loaded 15554 existing records from primary storage. [2025-09-15T20:57:46.069223] [INFO ] [MAIN ] VMO: Loaded 15554 existing records. [2025-09-15T20:57:46.244931] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:57:46.245261] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-15T20:57:46.245328] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-15T20:57:46.245887] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-15T20:57:46.245959] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-15T20:57:46.597565] [INFO ] [REMOTE ] VMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:57:46.808158] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:57:46.857825] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-15T20:57:46.986882] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T20:57:47.657875] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-15T20:57:47.944329] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T20:57:48.457880] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-15T20:57:49.266438] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-15T20:57:49.297420] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T20:57:49.993866] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T20:57:50.057889] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-15T20:57:50.357510] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T20:57:50.857909] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-15T20:57:51.119599] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T20:57:51.657868] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-15T20:57:51.959776] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T20:57:51.964986] [INFO ] [REMOTE ] VLTO: Full fetch complete (50161 records). [2025-09-15T20:57:51.965085] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-15T20:57:52.346556] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-15T20:57:52.346700] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-15T20:57:52.347788] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-15T20:57:52.347847] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-15T20:57:52.349079] [DEBUG] [LOCAL ] VLTO: Trimmed 50161 records to 33611 (keeping 150 days of data) [2025-09-15T20:57:52.460289] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-15T20:57:52.565492] [DEBUG] [LOCAL ] VLTO: Primary data saved (33611 records). [2025-09-15T20:57:52.565670] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-15T20:57:52.565773] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VLTO took 28.3s. Estimated remaining: 14m 2s. Rate: 9.4 symbols/min [2025-09-15T20:57:52.681626] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T20:57:53.257870] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-15T20:57:53.877569] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T20:57:54.057841] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-15T20:57:54.291495] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T20:57:54.857903] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-15T20:57:55.657955] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-15T20:57:55.823832] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T20:57:55.867191] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T20:57:56.344535] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T20:57:56.346853] [INFO ] [REMOTE ] VMI: Full fetch complete (16837 records). [2025-09-15T20:57:56.346927] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-15T20:57:56.462936] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-15T20:57:56.712040] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-15T20:57:56.712122] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-15T20:57:56.712479] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-15T20:57:56.712518] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-15T20:57:56.713051] [DEBUG] [LOCAL ] VMI: Trimmed 16837 records to 11216 (keeping 150 days of data) [2025-09-15T20:57:56.785509] [DEBUG] [LOCAL ] VMI: Primary data saved (11216 records). [2025-09-15T20:57:56.785675] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-15T20:57:56.785760] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VMI took 17.7s. Estimated remaining: 13m 55s. Rate: 9.4 symbols/min [2025-09-15T20:57:57.257925] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-15T20:57:57.567356] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T20:57:58.057867] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-15T20:57:58.882378] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T20:57:58.891424] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-15T20:57:58.989896] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T20:57:59.657922] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-15T20:58:00.301243] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T20:58:00.305903] [INFO ] [REMOTE ] VMC: Full fetch complete (48125 records). [2025-09-15T20:58:00.306076] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-15T20:58:00.698603] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-15T20:58:00.698729] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-15T20:58:00.699699] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-15T20:58:00.699762] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-15T20:58:00.701255] [DEBUG] [LOCAL ] VMC: Trimmed 48125 records to 31598 (keeping 150 days of data) [2025-09-15T20:58:00.714531] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T20:58:00.719764] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-15T20:58:00.929921] [DEBUG] [LOCAL ] VMC: Primary data saved (31598 records). [2025-09-15T20:58:00.930131] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-15T20:58:00.930224] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VMC took 24.3s. Estimated remaining: 13m 49s. Rate: 9.4 symbols/min [2025-09-15T20:58:01.744938] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T20:58:01.749567] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-15T20:58:02.814512] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T20:58:02.818065] [INFO ] [REMOTE ] VMO: Full fetch complete (23026 records). [2025-09-15T20:58:02.818140] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-15T20:58:03.184089] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-15T20:58:03.184188] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-15T20:58:03.184736] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-15T20:58:03.184780] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-15T20:58:03.185382] [DEBUG] [LOCAL ] VMO: Trimmed 23026 records to 15153 (keeping 150 days of data) [2025-09-15T20:58:03.277969] [DEBUG] [LOCAL ] VMO: Primary data saved (15153 records). [2025-09-15T20:58:03.278107] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-15T20:58:03.278201] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VMO took 17.4s. Estimated remaining: 13m 42s. Rate: 9.4 symbols/min [2025-09-15T20:58:04.014289] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:04.010143] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:04.070331] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:04.067443] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:04.081092] [DEBUG] [LOCAL ] VNCE: Loaded 4525 existing records from primary storage. [2025-09-15T20:58:04.081411] [INFO ] [MAIN ] VNCE: Loaded 4525 existing records. [2025-09-15T20:58:04.125129] [DEBUG] [LOCAL ] VOC: Loaded 6988 existing records from primary storage. [2025-09-15T20:58:04.148686] [INFO ] [MAIN ] VOC: Loaded 6988 existing records. [2025-09-15T20:58:04.434416] [DEBUG] [LOCAL ] VNT: Loaded 32897 existing records from primary storage. [2025-09-15T20:58:04.412205] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:04.468145] [INFO ] [MAIN ] VNT: Loaded 32897 existing records. [2025-09-15T20:58:04.490302] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-15T20:58:04.523633] [DEBUG] [LOCAL ] VNO: Loaded 36851 existing records from primary storage. [2025-09-15T20:58:04.526013] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-15T20:58:04.560075] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-15T20:58:04.560010] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:04.560316] [INFO ] [MAIN ] VNO: Loaded 36851 existing records. [2025-09-15T20:58:04.560198] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-15T20:58:04.615872] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-15T20:58:04.674957] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-15T20:58:04.789661] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-15T20:58:04.789909] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-15T20:58:05.050912] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:05.148117] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-15T20:58:05.160265] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-15T20:58:05.204285] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-15T20:58:05.227255] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-15T20:58:05.306806] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:05.487116] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-15T20:58:05.503751] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-15T20:58:05.622897] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-15T20:58:05.733332] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-15T20:58:05.744112] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:05.850007] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-15T20:58:06.103324] [INFO ] [REMOTE ] VOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:06.126025] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-15T20:58:06.374586] [INFO ] [REMOTE ] VNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:06.374931] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-15T20:58:06.452087] [INFO ] [REMOTE ] VNO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:06.452480] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-15T20:58:06.775916] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T20:58:06.778785] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-15T20:58:07.097322] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T20:58:07.099906] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-15T20:58:07.410736] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T20:58:07.412560] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-15T20:58:07.777177] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T20:58:07.779381] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-15T20:58:08.024431] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T20:58:08.090392] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T20:58:08.124731] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T20:58:08.457898] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-15T20:58:08.490670] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T20:58:09.257930] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-15T20:58:10.057941] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-15T20:58:10.205884] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T20:58:10.503514] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T20:58:10.857853] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-15T20:58:10.955435] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T20:58:11.657870] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-15T20:58:12.388867] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T20:58:12.457865] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-15T20:58:13.149082] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:58:13.257884] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-15T20:58:14.057914] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-15T20:58:14.235350] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T20:58:14.561610] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T20:58:14.590001] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T20:58:14.857901] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-15T20:58:15.657959] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-15T20:58:16.174917] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T20:58:16.334342] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T20:58:16.457917] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-15T20:58:17.081825] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T20:58:17.257906] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-15T20:58:18.035285] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T20:58:18.039515] [INFO ] [REMOTE ] VNCE: Full fetch complete (6755 records). [2025-09-15T20:58:18.039831] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-15T20:58:18.063063] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-15T20:58:18.688168] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-15T20:58:18.688302] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-15T20:58:18.688605] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-15T20:58:18.688707] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-15T20:58:18.689377] [DEBUG] [LOCAL ] VNCE: Trimmed 6755 records to 4684 (keeping 150 days of data) [2025-09-15T20:58:18.721185] [DEBUG] [LOCAL ] VNCE: Primary data saved (4684 records). [2025-09-15T20:58:18.721405] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-15T20:58:18.721567] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VNCE took 15.4s. Estimated remaining: 13m 37s. Rate: 9.4 symbols/min [2025-09-15T20:58:18.863132] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-15T20:58:18.932461] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:18.972704] [DEBUG] [LOCAL ] VOYA: Loaded 31474 existing records from primary storage. [2025-09-15T20:58:18.973012] [INFO ] [MAIN ] VOYA: Loaded 31474 existing records. [2025-09-15T20:58:19.167561] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:19.167968] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-15T20:58:19.168022] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-15T20:58:19.168731] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-15T20:58:19.168784] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-15T20:58:19.541828] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:19.574294] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T20:58:19.657925] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-15T20:58:20.357863] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T20:58:20.463065] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-15T20:58:20.477780] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T20:58:21.257963] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-15T20:58:21.974276] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T20:58:22.057890] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-15T20:58:22.739823] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T20:58:22.857914] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-15T20:58:23.427050] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T20:58:23.657927] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-15T20:58:24.419307] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T20:58:24.448143] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T20:58:24.457802] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-15T20:58:25.257897] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-15T20:58:25.528245] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T20:58:25.533340] [INFO ] [REMOTE ] VNT: Full fetch complete (48581 records). [2025-09-15T20:58:25.533467] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-15T20:58:25.909027] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-15T20:58:25.909122] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-15T20:58:25.910220] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-15T20:58:25.910274] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-15T20:58:25.911541] [DEBUG] [LOCAL ] VNT: Trimmed 48581 records to 32232 (keeping 150 days of data) [2025-09-15T20:58:26.080173] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-15T20:58:26.125923] [DEBUG] [LOCAL ] VNT: Primary data saved (32232 records). [2025-09-15T20:58:26.126117] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-15T20:58:26.126260] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VNT took 22.8s. Estimated remaining: 13m 30s. Rate: 9.4 symbols/min [2025-09-15T20:58:26.295985] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:26.296181] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-15T20:58:26.296218] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-15T20:58:26.296339] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-15T20:58:26.296377] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-15T20:58:26.296417] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-15T20:58:26.296452] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-15T20:58:26.643584] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:26.744779] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T20:58:26.857873] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-15T20:58:26.975577] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T20:58:27.135733] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:58:27.136072] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-15T20:58:27.657879] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-15T20:58:27.927112] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:58:27.927429] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-15T20:58:28.457890] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-15T20:58:28.708213] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:58:28.708520] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-15T20:58:29.257889] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-15T20:58:30.057892] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-15T20:58:30.857939] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-15T20:58:30.921683] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T20:58:31.093932] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T20:58:31.094292] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-15T20:58:31.649623] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:58:31.658132] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-15T20:58:32.457875] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-15T20:58:33.043880] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T20:58:33.049515] [INFO ] [REMOTE ] VNO: Full fetch complete (53267 records). [2025-09-15T20:58:33.049622] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-15T20:58:33.267115] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-15T20:58:33.425935] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-15T20:58:33.426019] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-15T20:58:33.426974] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-15T20:58:33.427024] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-15T20:58:33.428153] [DEBUG] [LOCAL ] VNO: Trimmed 53267 records to 36228 (keeping 150 days of data) [2025-09-15T20:58:33.656315] [DEBUG] [LOCAL ] VNO: Primary data saved (36228 records). [2025-09-15T20:58:33.656502] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-15T20:58:33.656605] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VNO took 30.4s. Estimated remaining: 13m 24s. Rate: 9.4 symbols/min [2025-09-15T20:58:33.832181] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:33.845617] [DEBUG] [LOCAL ] VPG: Loaded 12834 existing records from primary storage. [2025-09-15T20:58:33.845748] [INFO ] [MAIN ] VPG: Loaded 12834 existing records. [2025-09-15T20:58:34.029008] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:34.029366] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-15T20:58:34.029494] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-15T20:58:34.029963] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-15T20:58:34.030035] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-15T20:58:34.062805] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-15T20:58:34.210278] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T20:58:34.431663] [INFO ] [REMOTE ] VPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:34.688238] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T20:58:34.857928] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-15T20:58:35.052824] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T20:58:35.657886] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-15T20:58:36.457901] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-15T20:58:36.505452] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T20:58:36.529361] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T20:58:37.164485] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T20:58:37.166122] [INFO ] [REMOTE ] VOC: Full fetch complete (9971 records). [2025-09-15T20:58:37.166203] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-15T20:58:37.265499] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-15T20:58:37.531462] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-15T20:58:37.531564] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-15T20:58:37.531908] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-15T20:58:37.531960] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-15T20:58:37.532480] [DEBUG] [LOCAL ] VOC: Trimmed 9971 records to 6877 (keeping 150 days of data) [2025-09-15T20:58:37.582693] [DEBUG] [LOCAL ] VOC: Primary data saved (6877 records). [2025-09-15T20:58:37.582913] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-15T20:58:37.583074] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VOC took 34.3s. Estimated remaining: 13m 17s. Rate: 9.4 symbols/min [2025-09-15T20:58:37.752884] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:37.758015] [DEBUG] [LOCAL ] VPV: Loaded 3672 existing records from primary storage. [2025-09-15T20:58:37.758098] [INFO ] [MAIN ] VPV: Loaded 3672 existing records. [2025-09-15T20:58:37.932806] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:37.933074] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-15T20:58:37.933121] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-15T20:58:37.933357] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-15T20:58:37.933400] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-15T20:58:38.074261] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-15T20:58:38.293660] [INFO ] [REMOTE ] VPV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:38.863300] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-15T20:58:38.865029] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T20:58:39.095100] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T20:58:39.657868] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-15T20:58:39.700535] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T20:58:40.457942] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-15T20:58:40.916444] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T20:58:41.139508] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T20:58:41.257871] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-15T20:58:42.057841] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-15T20:58:42.206966] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T20:58:42.857921] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-15T20:58:42.870458] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T20:58:43.657899] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-15T20:58:44.272632] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T20:58:44.319547] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T20:58:44.457913] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-15T20:58:45.257941] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-15T20:58:45.762882] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T20:58:45.767971] [INFO ] [REMOTE ] VOYG: Full fetch complete (21684 records). [2025-09-15T20:58:45.768126] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-15T20:58:45.954851] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 66 unique days, need 150 days [2025-09-15T20:58:45.955216] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T20:58:45.955266] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T20:58:45.955316] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-15T20:58:45.955385] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-15T20:58:45.955428] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-15T20:58:45.955487] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-15T20:58:45.955561] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VOYG took 19.8s. Estimated remaining: 13m 11s. Rate: 9.4 symbols/min [2025-09-15T20:58:46.063459] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-15T20:58:46.129994] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:46.156554] [DEBUG] [LOCAL ] VRE: Loaded 26058 existing records from primary storage. [2025-09-15T20:58:46.156730] [INFO ] [MAIN ] VRE: Loaded 26058 existing records. [2025-09-15T20:58:46.340121] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:46.340467] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-15T20:58:46.340517] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-15T20:58:46.341216] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-15T20:58:46.341271] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-15T20:58:46.719604] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T20:58:46.718822] [INFO ] [REMOTE ] VRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:46.751464] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T20:58:46.857858] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-15T20:58:47.657922] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-15T20:58:47.955693] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T20:58:48.457900] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-15T20:58:48.714612] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T20:58:48.719414] [INFO ] [REMOTE ] VOYA: Full fetch complete (46624 records). [2025-09-15T20:58:48.719522] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-15T20:58:49.109850] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-15T20:58:49.109986] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-15T20:58:49.111283] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-15T20:58:49.111335] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-15T20:58:49.112915] [DEBUG] [LOCAL ] VOYA: Trimmed 46624 records to 30954 (keeping 150 days of data) [2025-09-15T20:58:49.280511] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-15T20:58:49.326236] [DEBUG] [LOCAL ] VOYA: Primary data saved (30954 records). [2025-09-15T20:58:49.326404] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-15T20:58:49.326724] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VOYA took 30.6s. Estimated remaining: 13m 5s. Rate: 9.4 symbols/min [2025-09-15T20:58:49.519395] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:49.568444] [DEBUG] [LOCAL ] VRT: Loaded 40495 existing records from primary storage. [2025-09-15T20:58:49.588396] [INFO ] [MAIN ] VRT: Loaded 40495 existing records. [2025-09-15T20:58:49.637623] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T20:58:49.782956] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:49.783256] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-15T20:58:49.783304] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-15T20:58:49.784317] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-15T20:58:49.784387] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-15T20:58:50.058864] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-15T20:58:50.138500] [INFO ] [REMOTE ] VRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:50.209113] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T20:58:50.857867] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-15T20:58:51.608357] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T20:58:51.662846] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-15T20:58:51.666428] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T20:58:52.246783] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T20:58:52.457879] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-15T20:58:53.152886] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T20:58:53.257872] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-15T20:58:54.057879] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-15T20:58:54.306869] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T20:58:54.857895] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-15T20:58:55.657931] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-15T20:58:56.181884] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:58:56.328582] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-15T20:58:56.425337] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T20:58:56.427334] [INFO ] [REMOTE ] VPG: Full fetch complete (18394 records). [2025-09-15T20:58:56.427536] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-15T20:58:56.463060] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-15T20:58:56.813811] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-15T20:58:56.813909] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-15T20:58:56.814638] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-15T20:58:56.814737] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-15T20:58:56.815563] [DEBUG] [LOCAL ] VPG: Trimmed 18394 records to 12585 (keeping 150 days of data) [2025-09-15T20:58:56.897026] [DEBUG] [LOCAL ] VPG: Primary data saved (12585 records). [2025-09-15T20:58:56.897186] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-15T20:58:56.897285] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VPG took 23.2s. Estimated remaining: 12m 58s. Rate: 9.4 symbols/min [2025-09-15T20:58:57.073760] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:58:57.087978] [DEBUG] [LOCAL ] VRTS: Loaded 7402 existing records from primary storage. [2025-09-15T20:58:57.088169] [INFO ] [MAIN ] VRTS: Loaded 7402 existing records. [2025-09-15T20:58:57.264110] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-15T20:58:57.269541] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:58:57.270058] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-15T20:58:57.271487] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-15T20:58:57.271874] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-15T20:58:57.271937] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-15T20:58:57.642751] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:58:57.662569] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T20:58:58.057876] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-15T20:58:58.857894] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-15T20:58:59.495280] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T20:58:59.496709] [INFO ] [REMOTE ] VPV: Full fetch complete (6025 records). [2025-09-15T20:58:59.496778] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-15T20:58:59.680087] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-15T20:58:59.869600] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-15T20:58:59.869953] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-15T20:58:59.891723] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-15T20:58:59.891939] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-15T20:58:59.894247] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T20:58:59.902214] [DEBUG] [LOCAL ] VPV: Trimmed 6025 records to 3618 (keeping 150 days of data) [2025-09-15T20:58:59.927298] [DEBUG] [LOCAL ] VPV: Primary data saved (3618 records). [2025-09-15T20:58:59.927533] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-15T20:58:59.927784] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VPV took 22.3s. Estimated remaining: 12m 52s. Rate: 9.4 symbols/min [2025-09-15T20:59:00.090412] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-15T20:59:00.153740] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:00.194573] [DEBUG] [LOCAL ] VSCO: Loaded 39691 existing records from primary storage. [2025-09-15T20:59:00.194747] [INFO ] [MAIN ] VSCO: Loaded 39691 existing records. [2025-09-15T20:59:00.375169] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:00.375412] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-15T20:59:00.375458] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-15T20:59:00.376372] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-15T20:59:00.376425] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-15T20:59:00.467706] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-15T20:59:00.616963] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T20:59:00.740266] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:01.257870] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-15T20:59:02.057911] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-15T20:59:02.758418] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T20:59:02.868425] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-15T20:59:02.896246] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-15T20:59:03.033304] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T20:59:03.386351] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T20:59:03.657907] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-15T20:59:04.457975] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-15T20:59:04.752585] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T20:59:05.257917] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-15T20:59:06.058012] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-15T20:59:06.505676] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T20:59:06.512961] [INFO ] [REMOTE ] VRE: Full fetch complete (37051 records). [2025-09-15T20:59:06.513114] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-15T20:59:06.809495] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T20:59:06.870369] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-15T20:59:06.960142] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-15T20:59:06.960291] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-15T20:59:06.961301] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-15T20:59:06.961372] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-15T20:59:06.996942] [DEBUG] [LOCAL ] VRE: Trimmed 37051 records to 25581 (keeping 150 days of data) [2025-09-15T20:59:06.999904] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-15T20:59:07.176115] [DEBUG] [LOCAL ] VRE: Primary data saved (25581 records). [2025-09-15T20:59:07.176274] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-15T20:59:07.176423] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRE took 21.2s. Estimated remaining: 12m 45s. Rate: 9.4 symbols/min [2025-09-15T20:59:07.352517] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:07.399102] [DEBUG] [LOCAL ] VSH: Loaded 36374 existing records from primary storage. [2025-09-15T20:59:07.399313] [INFO ] [MAIN ] VSH: Loaded 36374 existing records. [2025-09-15T20:59:07.585800] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:07.586203] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-15T20:59:07.586327] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-15T20:59:07.589439] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-15T20:59:07.589538] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-15T20:59:07.665088] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-15T20:59:07.947319] [INFO ] [REMOTE ] VSH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:07.976013] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T20:59:08.457915] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-15T20:59:09.193527] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T20:59:09.257912] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-15T20:59:10.053687] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-15T20:59:10.064035] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-15T20:59:10.758054] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T20:59:10.865166] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-15T20:59:10.916748] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T20:59:11.657988] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-15T20:59:12.373195] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T20:59:12.374769] [INFO ] [REMOTE ] VRTS: Full fetch complete (9498 records). [2025-09-15T20:59:12.374843] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-15T20:59:12.460159] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-15T20:59:12.766322] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-15T20:59:12.766444] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-15T20:59:12.766813] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-15T20:59:12.766878] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-15T20:59:12.767786] [DEBUG] [LOCAL ] VRTS: Trimmed 9498 records to 7327 (keeping 150 days of data) [2025-09-15T20:59:12.870188] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-15T20:59:12.870398] [DEBUG] [LOCAL ] VRTS: Primary data saved (7327 records). [2025-09-15T20:59:12.880492] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-15T20:59:12.881428] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRTS took 16.0s. Estimated remaining: 12m 39s. Rate: 9.4 symbols/min [2025-09-15T20:59:13.063830] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:13.112537] [DEBUG] [LOCAL ] VST: Loaded 40466 existing records from primary storage. [2025-09-15T20:59:13.112720] [INFO ] [MAIN ] VST: Loaded 40466 existing records. [2025-09-15T20:59:13.263054] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-15T20:59:13.291734] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:13.292017] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-15T20:59:13.292089] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-15T20:59:13.292995] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-15T20:59:13.293062] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-15T20:59:13.646143] [INFO ] [REMOTE ] VST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:14.057991] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-15T20:59:14.589429] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T20:59:14.857938] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-15T20:59:15.657951] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-15T20:59:15.787170] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T20:59:16.020143] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-15T20:59:16.457888] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-15T20:59:16.906428] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T20:59:17.251109] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T20:59:17.261616] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-15T20:59:18.057925] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-15T20:59:18.093978] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T20:59:18.857903] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-15T20:59:19.588887] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-15T20:59:19.648825] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T20:59:19.658972] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-15T20:59:20.167771] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T20:59:20.457926] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-15T20:59:21.257982] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-15T20:59:21.668947] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T20:59:22.057903] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-15T20:59:22.630794] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T20:59:22.863020] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-15T20:59:22.884859] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T20:59:23.657897] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-15T20:59:24.353248] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-15T20:59:24.457876] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-15T20:59:24.719798] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T20:59:24.725790] [INFO ] [REMOTE ] VRT: Full fetch complete (58433 records). [2025-09-15T20:59:24.725901] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-15T20:59:25.111430] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-15T20:59:25.111539] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-15T20:59:25.112534] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-15T20:59:25.112701] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-15T20:59:25.115329] [DEBUG] [LOCAL ] VRT: Trimmed 58433 records to 39714 (keeping 150 days of data) [2025-09-15T20:59:25.255761] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T20:59:25.267842] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-15T20:59:25.428342] [DEBUG] [LOCAL ] VRT: Primary data saved (39714 records). [2025-09-15T20:59:25.428518] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-15T20:59:25.429512] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VRT took 36.1s. Estimated remaining: 12m 33s. Rate: 9.4 symbols/min [2025-09-15T20:59:25.597827] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:25.637721] [DEBUG] [LOCAL ] VSTS: Loaded 36722 existing records from primary storage. [2025-09-15T20:59:25.637910] [INFO ] [MAIN ] VSTS: Loaded 36722 existing records. [2025-09-15T20:59:25.813233] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:25.813450] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-15T20:59:25.813504] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-15T20:59:25.814255] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-15T20:59:25.814316] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-15T20:59:26.062795] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-15T20:59:26.169345] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:26.202041] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T20:59:26.857882] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-15T20:59:27.414335] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-15T20:59:27.657915] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-15T20:59:27.849097] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T20:59:28.425380] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T20:59:28.457948] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-15T20:59:29.257941] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-15T20:59:29.814782] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T20:59:29.820284] [INFO ] [REMOTE ] VSH: Full fetch complete (53317 records). [2025-09-15T20:59:29.820412] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-15T20:59:30.063125] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-15T20:59:30.228601] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-15T20:59:30.228824] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-15T20:59:30.230253] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-15T20:59:30.230321] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-15T20:59:30.232161] [DEBUG] [LOCAL ] VSH: Trimmed 53317 records to 35598 (keeping 150 days of data) [2025-09-15T20:59:30.376030] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-15T20:59:30.528162] [DEBUG] [LOCAL ] VSH: Primary data saved (35598 records). [2025-09-15T20:59:30.528396] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-15T20:59:30.529764] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSH took 23.4s. Estimated remaining: 12m 26s. Rate: 9.4 symbols/min [2025-09-15T20:59:30.714984] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:30.751174] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T20:59:30.793238] [DEBUG] [LOCAL ] VTEX: Loaded 32608 existing records from primary storage. [2025-09-15T20:59:30.793486] [INFO ] [MAIN ] VTEX: Loaded 32608 existing records. [2025-09-15T20:59:30.863176] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-15T20:59:30.976337] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:30.976833] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-15T20:59:30.976918] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-15T20:59:30.977662] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-15T20:59:30.977716] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-15T20:59:31.329094] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:31.617809] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T20:59:31.657847] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-15T20:59:32.459396] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-15T20:59:32.462539] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T20:59:33.249168] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T20:59:33.255017] [INFO ] [REMOTE ] VSCO: Full fetch complete (57435 records). [2025-09-15T20:59:33.255119] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-15T20:59:33.266737] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-15T20:59:33.639017] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-15T20:59:33.639107] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-15T20:59:33.640218] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-15T20:59:33.640264] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-15T20:59:33.641449] [DEBUG] [LOCAL ] VSCO: Trimmed 57435 records to 38920 (keeping 150 days of data) [2025-09-15T20:59:33.878588] [DEBUG] [LOCAL ] VSCO: Primary data saved (38920 records). [2025-09-15T20:59:33.878763] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-15T20:59:33.878861] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VSCO took 34.0s. Estimated remaining: 12m 20s. Rate: 9.4 symbols/min [2025-09-15T20:59:34.047389] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:34.057888] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-15T20:59:34.085231] [DEBUG] [LOCAL ] VTLE: Loaded 36568 existing records from primary storage. [2025-09-15T20:59:34.085367] [INFO ] [MAIN ] VTLE: Loaded 36568 existing records. [2025-09-15T20:59:34.261486] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:34.261769] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-15T20:59:34.261818] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-15T20:59:34.262554] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-15T20:59:34.262605] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-15T20:59:34.609821] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:34.789001] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-15T20:59:34.857822] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-15T20:59:35.186032] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T20:59:35.218768] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T20:59:35.657931] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-15T20:59:36.457941] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-15T20:59:36.538978] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T20:59:36.545731] [INFO ] [REMOTE ] VST: Full fetch complete (58403 records). [2025-09-15T20:59:36.545992] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-15T20:59:36.924184] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-15T20:59:36.924289] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-15T20:59:36.925359] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-15T20:59:36.925457] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-15T20:59:36.927061] [DEBUG] [LOCAL ] VST: Trimmed 58403 records to 39685 (keeping 150 days of data) [2025-09-15T20:59:37.057318] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T20:59:37.226911] [DEBUG] [LOCAL ] VST: Primary data saved (39685 records). [2025-09-15T20:59:37.227058] [INFO ] [MAIN ] VST: Full history saved. [2025-09-15T20:59:37.228990] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VST took 24.3s. Estimated remaining: 12m 13s. Rate: 9.4 symbols/min [2025-09-15T20:59:37.263095] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-15T20:59:37.400529] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:37.418122] [DEBUG] [LOCAL ] VTMX: Loaded 13126 existing records from primary storage. [2025-09-15T20:59:37.418247] [INFO ] [MAIN ] VTMX: Loaded 13126 existing records. [2025-09-15T20:59:37.594742] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:37.595012] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-15T20:59:37.595138] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-15T20:59:37.595611] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-15T20:59:37.595717] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-15T20:59:37.909142] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T20:59:38.003600] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:38.057837] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-15T20:59:38.721830] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T20:59:38.813506] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T20:59:38.857878] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-15T20:59:39.657875] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-15T20:59:39.953755] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T20:59:40.457879] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-15T20:59:41.031461] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T20:59:41.257884] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-15T20:59:41.838044] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T20:59:42.057909] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-15T20:59:42.557787] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T20:59:42.857865] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-15T20:59:43.657876] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-15T20:59:43.774901] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T20:59:44.458449] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-15T20:59:44.462091] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T20:59:44.608575] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T20:59:45.257887] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-15T20:59:45.428005] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T20:59:45.433258] [INFO ] [REMOTE ] VSTS: Full fetch complete (52670 records). [2025-09-15T20:59:45.433404] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-15T20:59:45.814628] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-15T20:59:45.814748] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-15T20:59:45.815734] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-15T20:59:45.815788] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-15T20:59:45.816975] [DEBUG] [LOCAL ] VSTS: Trimmed 52670 records to 36017 (keeping 150 days of data) [2025-09-15T20:59:46.032243] [DEBUG] [LOCAL ] VSTS: Primary data saved (36017 records). [2025-09-15T20:59:46.032404] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-15T20:59:46.032496] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VSTS took 20.6s. Estimated remaining: 12m 7s. Rate: 9.4 symbols/min [2025-09-15T20:59:46.063627] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-15T20:59:46.210833] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:46.218144] [DEBUG] [LOCAL ] VTN: Loaded 5097 existing records from primary storage. [2025-09-15T20:59:46.218247] [INFO ] [MAIN ] VTN: Loaded 5097 existing records. [2025-09-15T20:59:46.396008] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:46.396317] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-15T20:59:46.401587] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-15T20:59:46.409073] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-15T20:59:46.409138] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-15T20:59:46.441550] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T20:59:46.791911] [INFO ] [REMOTE ] VTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:46.857821] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-15T20:59:47.642585] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T20:59:47.663034] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-15T20:59:47.683959] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T20:59:48.309824] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T20:59:48.457878] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-15T20:59:49.257917] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-15T20:59:49.918095] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T20:59:50.057894] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-15T20:59:50.686080] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T20:59:50.714427] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T20:59:50.857874] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-15T20:59:51.483567] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T20:59:51.657901] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-15T20:59:52.267297] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T20:59:52.457887] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-15T20:59:53.038300] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T20:59:53.257874] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-15T20:59:54.034044] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T20:59:54.057824] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-15T20:59:54.723110] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T20:59:54.724892] [INFO ] [REMOTE ] VTN: Full fetch complete (7703 records). [2025-09-15T20:59:54.724963] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-15T20:59:54.869272] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-15T20:59:55.085678] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-15T20:59:55.085761] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-15T20:59:55.085955] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-15T20:59:55.085995] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-15T20:59:55.086397] [DEBUG] [LOCAL ] VTN: Trimmed 7703 records to 5048 (keeping 150 days of data) [2025-09-15T20:59:55.117316] [DEBUG] [LOCAL ] VTN: Primary data saved (5048 records). [2025-09-15T20:59:55.117403] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-15T20:59:55.117497] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VTN took 9.1s. Estimated remaining: 12m 1s. Rate: 9.4 symbols/min [2025-09-15T20:59:55.283975] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T20:59:55.299512] [DEBUG] [LOCAL ] VTOL: Loaded 14897 existing records from primary storage. [2025-09-15T20:59:55.299665] [INFO ] [MAIN ] VTOL: Loaded 14897 existing records. [2025-09-15T20:59:55.478945] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T20:59:55.479260] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-15T20:59:55.479313] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-15T20:59:55.479816] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-15T20:59:55.479867] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-15T20:59:55.665503] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-15T20:59:55.838207] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T20:59:56.050238] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T20:59:56.457928] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-15T20:59:56.987751] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T20:59:57.257900] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-15T20:59:57.366202] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T20:59:58.057893] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-15T20:59:58.300855] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T20:59:58.857902] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-15T20:59:58.912331] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T20:59:59.657923] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-15T21:00:00.108109] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T21:00:00.457864] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-15T21:00:00.666111] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T21:00:01.257912] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-15T21:00:02.057896] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-15T21:00:02.230458] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T21:00:02.277849] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T21:00:02.857943] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-15T21:00:03.147928] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T21:00:03.585229] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T21:00:03.588430] [INFO ] [REMOTE ] VTMX: Full fetch complete (18993 records). [2025-09-15T21:00:03.588630] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-15T21:00:03.669869] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-15T21:00:04.150210] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-15T21:00:04.150353] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-15T21:00:04.150916] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-15T21:00:04.150967] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-15T21:00:04.151829] [DEBUG] [LOCAL ] VTMX: Trimmed 18993 records to 12979 (keeping 150 days of data) [2025-09-15T21:00:04.238287] [DEBUG] [LOCAL ] VTMX: Primary data saved (12979 records). [2025-09-15T21:00:04.238462] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-15T21:00:04.238593] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VTMX took 27.0s. Estimated remaining: 11m 55s. Rate: 9.4 symbols/min [2025-09-15T21:00:04.449107] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:04.457913] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-15T21:00:04.491795] [DEBUG] [LOCAL ] VTR: Loaded 39710 existing records from primary storage. [2025-09-15T21:00:04.491946] [INFO ] [MAIN ] VTR: Loaded 39710 existing records. [2025-09-15T21:00:04.680305] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:04.680594] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-15T21:00:04.680660] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-15T21:00:04.681581] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-15T21:00:04.681635] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-15T21:00:05.054431] [INFO ] [REMOTE ] VTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:05.068911] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T21:00:05.074093] [INFO ] [REMOTE ] VTEX: Full fetch complete (46861 records). [2025-09-15T21:00:05.074415] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-15T21:00:05.257860] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-15T21:00:05.472784] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-15T21:00:05.472905] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-15T21:00:05.474024] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-15T21:00:05.474106] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-15T21:00:05.475496] [DEBUG] [LOCAL ] VTEX: Trimmed 46861 records to 31992 (keeping 150 days of data) [2025-09-15T21:00:05.666990] [DEBUG] [LOCAL ] VTEX: Primary data saved (31992 records). [2025-09-15T21:00:05.667192] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-15T21:00:05.667297] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTEX took 35.1s. Estimated remaining: 11m 48s. Rate: 9.4 symbols/min [2025-09-15T21:00:05.837689] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:05.858775] [DEBUG] [LOCAL ] VTS: Loaded 21907 existing records from primary storage. [2025-09-15T21:00:05.858915] [INFO ] [MAIN ] VTS: Loaded 21907 existing records. [2025-09-15T21:00:06.033742] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:06.034043] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-15T21:00:06.034089] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-15T21:00:06.034637] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-15T21:00:06.034712] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-15T21:00:06.066749] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-15T21:00:06.401212] [INFO ] [REMOTE ] VTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:06.428669] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T21:00:06.540362] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T21:00:06.857877] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-15T21:00:07.538551] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T21:00:07.657860] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-15T21:00:07.986701] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T21:00:08.457919] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-15T21:00:09.258039] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-15T21:00:09.501721] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T21:00:09.615191] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T21:00:10.058000] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-15T21:00:10.731190] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T21:00:10.738458] [INFO ] [REMOTE ] VTLE: Full fetch complete (52596 records). [2025-09-15T21:00:10.738712] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-15T21:00:10.866111] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-15T21:00:11.166024] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T21:00:11.180583] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-15T21:00:11.186948] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-15T21:00:11.188332] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-15T21:00:11.188961] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-15T21:00:11.190436] [DEBUG] [LOCAL ] VTLE: Trimmed 52596 records to 35762 (keeping 150 days of data) [2025-09-15T21:00:11.408140] [DEBUG] [LOCAL ] VTLE: Primary data saved (35762 records). [2025-09-15T21:00:11.408296] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-15T21:00:11.408383] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTLE took 37.5s. Estimated remaining: 11m 42s. Rate: 9.4 symbols/min [2025-09-15T21:00:11.581795] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:11.603306] [DEBUG] [LOCAL ] VVR: Loaded 21767 existing records from primary storage. [2025-09-15T21:00:11.603474] [INFO ] [MAIN ] VVR: Loaded 21767 existing records. [2025-09-15T21:00:11.665147] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-15T21:00:11.778217] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:11.778451] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-15T21:00:11.778497] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-15T21:00:11.779048] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-15T21:00:11.779098] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-15T21:00:12.135473] [INFO ] [REMOTE ] VVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:12.147620] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T21:00:12.457883] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-15T21:00:13.257874] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-15T21:00:13.326034] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T21:00:13.446339] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T21:00:14.057900] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-15T21:00:14.151401] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T21:00:14.153907] [INFO ] [REMOTE ] VTOL: Full fetch complete (21229 records). [2025-09-15T21:00:14.153980] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-15T21:00:14.510057] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-15T21:00:14.510154] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-15T21:00:14.510607] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-15T21:00:14.510663] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-15T21:00:14.511259] [DEBUG] [LOCAL ] VTOL: Trimmed 21229 records to 14584 (keeping 150 days of data) [2025-09-15T21:00:14.599660] [DEBUG] [LOCAL ] VTOL: Primary data saved (14584 records). [2025-09-15T21:00:14.599802] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-15T21:00:14.599912] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTOL took 19.5s. Estimated remaining: 11m 35s. Rate: 9.4 symbols/min [2025-09-15T21:00:14.772841] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:14.808495] [DEBUG] [LOCAL ] VVV: Loaded 37851 existing records from primary storage. [2025-09-15T21:00:14.808683] [INFO ] [MAIN ] VVV: Loaded 37851 existing records. [2025-09-15T21:00:14.864572] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-15T21:00:15.000557] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:15.000810] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-15T21:00:15.000857] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-15T21:00:15.001669] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-15T21:00:15.001725] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-15T21:00:15.371038] [INFO ] [REMOTE ] VVV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:15.390035] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T21:00:15.657887] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-15T21:00:16.457960] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-15T21:00:17.257947] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-15T21:00:17.315488] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T21:00:18.040550] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-15T21:00:18.057825] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-15T21:00:18.862954] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-15T21:00:18.876178] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-15T21:00:19.008043] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T21:00:19.455915] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-15T21:00:19.657883] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-15T21:00:20.457862] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-15T21:00:20.706285] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T21:00:21.141146] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T21:00:21.257865] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-15T21:00:21.639040] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T21:00:22.057890] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-15T21:00:22.857908] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-15T21:00:23.011761] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T21:00:23.051448] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T21:00:23.657870] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-15T21:00:24.172770] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T21:00:24.457907] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-15T21:00:24.502286] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T21:00:25.257881] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-15T21:00:25.936545] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T21:00:26.057870] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-15T21:00:26.822399] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T21:00:26.857820] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-15T21:00:27.505162] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T21:00:27.657824] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-15T21:00:28.271874] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T21:00:28.457904] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-15T21:00:29.257938] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-15T21:00:29.430119] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T21:00:30.057928] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-15T21:00:30.732991] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-15T21:00:30.738946] [INFO ] [REMOTE ] VTR: Full fetch complete (57464 records). [2025-09-15T21:00:30.739068] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-15T21:00:30.863082] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-15T21:00:31.122028] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-15T21:00:31.122198] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-15T21:00:31.124069] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-15T21:00:31.124179] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-15T21:00:31.126015] [DEBUG] [LOCAL ] VTR: Trimmed 57464 records to 38933 (keeping 150 days of data) [2025-09-15T21:00:31.249859] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T21:00:31.401994] [DEBUG] [LOCAL ] VTR: Primary data saved (38933 records). [2025-09-15T21:00:31.402179] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-15T21:00:31.402274] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VTR took 27.2s. Estimated remaining: 11m 29s. Rate: 9.4 symbols/min [2025-09-15T21:00:31.572542] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:31.589952] [DEBUG] [LOCAL ] VVX: Loaded 17239 existing records from primary storage. [2025-09-15T21:00:31.590088] [INFO ] [MAIN ] VVX: Loaded 17239 existing records. [2025-09-15T21:00:31.664899] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-15T21:00:31.774122] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:31.774427] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-15T21:00:31.774476] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-15T21:00:31.774894] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-15T21:00:31.774945] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-15T21:00:32.166392] [INFO ] [REMOTE ] VVX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:32.168314] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T21:00:32.207310] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T21:00:32.457877] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-15T21:00:32.843619] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T21:00:33.257934] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-15T21:00:33.681241] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T21:00:34.057874] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-15T21:00:34.417579] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T21:00:34.857891] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-15T21:00:35.395884] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T21:00:35.402217] [INFO ] [REMOTE ] VVV: Full fetch complete (54458 records). [2025-09-15T21:00:35.402430] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-15T21:00:35.670522] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-15T21:00:35.812819] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-15T21:00:35.812947] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-15T21:00:35.814895] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-15T21:00:35.814954] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-15T21:00:35.816549] [DEBUG] [LOCAL ] VVV: Trimmed 54458 records to 37152 (keeping 150 days of data) [2025-09-15T21:00:36.062989] [DEBUG] [LOCAL ] VVV: Primary data saved (37152 records). [2025-09-15T21:00:36.063326] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-15T21:00:36.063538] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VVV took 21.5s. Estimated remaining: 11m 23s. Rate: 9.4 symbols/min [2025-09-15T21:00:36.182668] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T21:00:36.244222] [INFO ] [REMOTE ] VVR: Full fetch complete (33171 records). [2025-09-15T21:00:36.245679] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-15T21:00:36.297826] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:36.460502] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-15T21:00:36.611216] [DEBUG] [LOCAL ] VYX: Loaded 36678 existing records from primary storage. [2025-09-15T21:00:36.643241] [INFO ] [MAIN ] VYX: Loaded 36678 existing records. [2025-09-15T21:00:36.779602] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-15T21:00:36.787740] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-15T21:00:36.791343] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-15T21:00:36.791773] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-15T21:00:36.848928] [DEBUG] [LOCAL ] VVR: Trimmed 33171 records to 21357 (keeping 150 days of data) [2025-09-15T21:00:36.881637] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:36.882001] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-15T21:00:36.882050] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-15T21:00:36.930843] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-15T21:00:36.941412] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-15T21:00:37.144564] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T21:00:37.233325] [INFO ] [REMOTE ] VTS: Full fetch complete (31874 records). [2025-09-15T21:00:37.263529] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-15T21:00:37.506993] [INFO ] [REMOTE ] VYX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:37.520909] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-15T21:00:37.718395] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T21:00:37.728472] [DEBUG] [LOCAL ] VVR: Primary data saved (21357 records). [2025-09-15T21:00:37.743907] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-15T21:00:37.758271] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VVR took 26.3s. Estimated remaining: 11m 16s. Rate: 9.4 symbols/min [2025-09-15T21:00:38.059450] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-15T21:00:38.080467] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:38.081202] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-15T21:00:38.082834] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-15T21:00:38.083961] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-15T21:00:38.084272] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-15T21:00:38.085806] [DEBUG] [LOCAL ] VTS: Trimmed 31874 records to 21587 (keeping 150 days of data) [2025-09-15T21:00:38.236168] [DEBUG] [LOCAL ] VZ: Loaded 40531 existing records from primary storage. [2025-09-15T21:00:38.236929] [INFO ] [MAIN ] VZ: Loaded 40531 existing records. [2025-09-15T21:00:38.421174] [DEBUG] [LOCAL ] VTS: Primary data saved (21587 records). [2025-09-15T21:00:38.437138] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-15T21:00:38.440610] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VTS took 32.8s. Estimated remaining: 11m 9s. Rate: 9.4 symbols/min [2025-09-15T21:00:38.444380] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:38.530115] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-15T21:00:38.545270] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-15T21:00:38.566849] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-15T21:00:38.571125] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-15T21:00:38.779881] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:39.044221] [INFO ] [REMOTE ] VZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:39.044787] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-15T21:00:39.061732] [DEBUG] [LOCAL ] W: Loaded 40310 existing records from primary storage. [2025-09-15T21:00:39.062128] [INFO ] [MAIN ] W: Loaded 40310 existing records. [2025-09-15T21:00:39.203504] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T21:00:39.292381] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:39.292692] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-15T21:00:39.292744] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-15T21:00:39.293611] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-15T21:00:39.293696] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-15T21:00:39.619765] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T21:00:39.693216] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-15T21:00:39.699845] [INFO ] [REMOTE ] W: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:40.457879] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-15T21:00:41.002345] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T21:00:41.123514] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T21:00:41.257881] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-15T21:00:41.880966] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T21:00:42.057879] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-15T21:00:42.857884] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-15T21:00:43.275044] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-15T21:00:43.657913] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-15T21:00:43.705127] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T21:00:43.750999] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T21:00:44.457943] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-15T21:00:45.257901] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-15T21:00:45.446950] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T21:00:46.057957] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-15T21:00:46.194250] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T21:00:46.563820] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T21:00:46.857878] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-15T21:00:47.610126] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T21:00:47.657875] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-15T21:00:48.457948] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-15T21:00:49.256183] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-15T21:00:49.266685] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-15T21:00:49.797349] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T21:00:50.057881] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-15T21:00:50.088237] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T21:00:50.394908] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T21:00:50.857877] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-15T21:00:51.657909] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-15T21:00:51.834606] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T21:00:52.457940] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-15T21:00:52.657273] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T21:00:52.876187] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T21:00:53.257919] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-15T21:00:54.057888] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-15T21:00:54.453955] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-15T21:00:54.857926] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-15T21:00:55.039142] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T21:00:55.478073] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T21:00:55.657854] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-15T21:00:56.457876] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-15T21:00:57.152495] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-15T21:00:57.257881] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-15T21:00:57.295144] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T21:00:57.403175] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T21:00:57.406532] [INFO ] [REMOTE ] VVX: Full fetch complete (25405 records). [2025-09-15T21:00:57.406610] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-15T21:00:57.790911] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-15T21:00:57.791002] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-15T21:00:57.791588] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-15T21:00:57.791653] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-15T21:00:57.793991] [DEBUG] [LOCAL ] VVX: Trimmed 25405 records to 17093 (keeping 150 days of data) [2025-09-15T21:00:57.900814] [DEBUG] [LOCAL ] VVX: Primary data saved (17093 records). [2025-09-15T21:00:57.900982] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-15T21:00:57.901140] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. VVX took 26.5s. Estimated remaining: 11m 4s. Rate: 9.4 symbols/min [2025-09-15T21:00:58.063034] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-15T21:00:58.110063] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:58.147820] [DEBUG] [LOCAL ] WAB: Loaded 32859 existing records from primary storage. [2025-09-15T21:00:58.147993] [INFO ] [MAIN ] WAB: Loaded 32859 existing records. [2025-09-15T21:00:58.330162] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:00:58.330450] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-15T21:00:58.330499] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-15T21:00:58.331221] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-15T21:00:58.331271] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-15T21:00:58.689258] [INFO ] [REMOTE ] WAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:00:58.815943] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T21:00:58.822743] [INFO ] [REMOTE ] VYX: Full fetch complete (53409 records). [2025-09-15T21:00:58.822855] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-15T21:00:58.865752] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-15T21:00:59.207327] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-15T21:00:59.207428] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-15T21:00:59.208451] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-15T21:00:59.208499] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-15T21:00:59.209685] [DEBUG] [LOCAL ] VYX: Trimmed 53409 records to 35924 (keeping 150 days of data) [2025-09-15T21:00:59.430905] [DEBUG] [LOCAL ] VYX: Primary data saved (35924 records). [2025-09-15T21:00:59.431070] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-15T21:00:59.431201] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. VYX took 23.4s. Estimated remaining: 10m 57s. Rate: 9.4 symbols/min [2025-09-15T21:00:59.602314] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:00:59.621309] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T21:00:59.627980] [INFO ] [REMOTE ] W: Full fetch complete (58209 records). [2025-09-15T21:00:59.628128] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-15T21:00:59.660004] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-15T21:00:59.836104] [DEBUG] [LOCAL ] WAL: Loaded 33483 existing records from primary storage. [2025-09-15T21:00:59.853523] [INFO ] [MAIN ] WAL: Loaded 33483 existing records. [2025-09-15T21:01:00.227929] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:00.228316] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-15T21:01:00.228395] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-15T21:01:00.228494] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-15T21:01:00.228531] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-15T21:01:00.229626] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-15T21:01:00.229763] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-15T21:01:00.230733] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-15T21:01:00.230815] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-15T21:01:00.313738] [DEBUG] [LOCAL ] W: Trimmed 58209 records to 39527 (keeping 150 days of data) [2025-09-15T21:01:00.730519] [INFO ] [REMOTE ] WAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:00.734893] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-15T21:01:00.857040] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-15T21:01:00.898313] [DEBUG] [LOCAL ] W: Primary data saved (39527 records). [2025-09-15T21:01:00.898441] [INFO ] [MAIN ] W: Full history saved. [2025-09-15T21:01:00.898543] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. W took 22.5s. Estimated remaining: 10m 50s. Rate: 9.4 symbols/min [2025-09-15T21:01:01.065991] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:01.093235] [DEBUG] [LOCAL ] WAT: Loaded 26456 existing records from primary storage. [2025-09-15T21:01:01.093408] [INFO ] [MAIN ] WAT: Loaded 26456 existing records. [2025-09-15T21:01:01.266568] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-15T21:01:01.271530] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:01.271702] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-15T21:01:01.271758] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-15T21:01:01.272393] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-15T21:01:01.272441] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-15T21:01:01.625130] [INFO ] [REMOTE ] WAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:02.057905] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-15T21:01:02.132245] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T21:01:02.346560] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-15T21:01:02.857898] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-15T21:01:03.033786] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T21:01:03.150882] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T21:01:03.657898] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-15T21:01:04.298434] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T21:01:04.457911] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-15T21:01:04.877826] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T21:01:05.257922] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-15T21:01:05.961150] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T21:01:06.057816] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-15T21:01:06.354778] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T21:01:06.857881] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-15T21:01:07.465741] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T21:01:07.657903] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-15T21:01:08.457893] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-15T21:01:08.974403] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T21:01:09.013299] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-15T21:01:09.257881] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-15T21:01:09.770287] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T21:01:09.775595] [INFO ] [REMOTE ] VZ: Full fetch complete (58081 records). [2025-09-15T21:01:09.775731] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-15T21:01:09.776398] [FATAL] [VALIDATOR ] VZ: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:01:09.776476] [FATAL] [MAIN ] VZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:01:09.776514] [WARN ] [MAIN ] VZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:01:09.776552] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-15T21:01:09.776628] [DEBUG] [LOCAL ] VZ: No primary data file found to delete. [2025-09-15T21:01:09.776689] [INFO ] [LOCAL ] VZ: Starting deletion of derivative data. [2025-09-15T21:01:09.777034] [DEBUG] [LOCAL ] VZ: Deleted derivative data file. [2025-09-15T21:01:09.777129] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. VZ took 32.0s. Estimated remaining: 10m 44s. Rate: 9.4 symbols/min [2025-09-15T21:01:09.949830] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:09.987502] [DEBUG] [LOCAL ] WBS: Loaded 36429 existing records from primary storage. [2025-09-15T21:01:09.987659] [INFO ] [MAIN ] WBS: Loaded 36429 existing records. [2025-09-15T21:01:10.063049] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-15T21:01:10.163982] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:10.164271] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-15T21:01:10.164376] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-15T21:01:10.165138] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-15T21:01:10.165187] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-15T21:01:10.516244] [INFO ] [REMOTE ] WBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:10.543888] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T21:01:10.857925] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-15T21:01:11.657840] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-15T21:01:11.748209] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T21:01:12.328363] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T21:01:12.457860] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-15T21:01:12.713489] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T21:01:13.257871] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-15T21:01:14.040041] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T21:01:14.057820] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-15T21:01:14.857926] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-15T21:01:15.039548] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T21:01:15.657942] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-15T21:01:15.845079] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T21:01:16.073228] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T21:01:16.457896] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-15T21:01:17.230983] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T21:01:17.257828] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-15T21:01:17.919779] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T21:01:18.057929] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-15T21:01:18.857931] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-15T21:01:18.896520] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T21:01:19.114935] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T21:01:19.120011] [INFO ] [REMOTE ] WAB: Full fetch complete (48684 records). [2025-09-15T21:01:19.120115] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-15T21:01:19.502592] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-15T21:01:19.502696] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-15T21:01:19.503706] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-15T21:01:19.503765] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-15T21:01:19.504817] [DEBUG] [LOCAL ] WAB: Trimmed 48684 records to 32190 (keeping 150 days of data) [2025-09-15T21:01:19.676682] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-15T21:01:19.726843] [DEBUG] [LOCAL ] WAB: Primary data saved (32190 records). [2025-09-15T21:01:19.726995] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-15T21:01:19.728028] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WAB took 21.8s. Estimated remaining: 10m 38s. Rate: 9.4 symbols/min [2025-09-15T21:01:19.905486] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:19.919957] [DEBUG] [LOCAL ] WBX: Loaded 7656 existing records from primary storage. [2025-09-15T21:01:19.920136] [INFO ] [MAIN ] WBX: Loaded 7656 existing records. [2025-09-15T21:01:20.065398] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T21:01:20.137056] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:20.137322] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-15T21:01:20.137372] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-15T21:01:20.137701] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-15T21:01:20.137756] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-15T21:01:20.463074] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-15T21:01:20.500623] [INFO ] [REMOTE ] WBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:21.224998] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T21:01:21.257852] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-15T21:01:22.057883] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-15T21:01:22.100285] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T21:01:22.182795] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T21:01:22.188049] [INFO ] [REMOTE ] WAL: Full fetch complete (49515 records). [2025-09-15T21:01:22.188156] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-15T21:01:22.594800] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-15T21:01:22.594905] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-15T21:01:22.595986] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-15T21:01:22.596044] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-15T21:01:22.597380] [DEBUG] [LOCAL ] WAL: Trimmed 49515 records to 32797 (keeping 150 days of data) [2025-09-15T21:01:22.815440] [DEBUG] [LOCAL ] WAL: Primary data saved (32797 records). [2025-09-15T21:01:22.815607] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-15T21:01:22.815738] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAL took 23.4s. Estimated remaining: 10m 31s. Rate: 9.4 symbols/min [2025-09-15T21:01:22.862968] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-15T21:01:22.994582] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:23.025239] [DEBUG] [LOCAL ] WCC: Loaded 29398 existing records from primary storage. [2025-09-15T21:01:23.025381] [INFO ] [MAIN ] WCC: Loaded 29398 existing records. [2025-09-15T21:01:23.210673] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:23.210911] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-15T21:01:23.210957] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-15T21:01:23.211725] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-15T21:01:23.211778] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-15T21:01:23.586411] [INFO ] [REMOTE ] WCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:23.641916] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T21:01:23.657810] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-15T21:01:24.098581] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T21:01:24.457886] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-15T21:01:25.257889] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-15T21:01:25.445984] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T21:01:25.813609] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T21:01:26.057924] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-15T21:01:26.863695] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-15T21:01:26.891337] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T21:01:27.134959] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T21:01:27.139682] [INFO ] [REMOTE ] WAT: Full fetch complete (38234 records). [2025-09-15T21:01:27.139821] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-15T21:01:27.545857] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-15T21:01:27.545976] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-15T21:01:27.547065] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-15T21:01:27.547117] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-15T21:01:27.548505] [DEBUG] [LOCAL ] WAT: Trimmed 38234 records to 25964 (keeping 150 days of data) [2025-09-15T21:01:27.673152] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-15T21:01:27.733515] [DEBUG] [LOCAL ] WAT: Primary data saved (25964 records). [2025-09-15T21:01:27.733740] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-15T21:01:27.733855] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WAT took 26.8s. Estimated remaining: 10m 25s. Rate: 9.4 symbols/min [2025-09-15T21:01:27.907711] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:27.953563] [DEBUG] [LOCAL ] WCN: Loaded 35964 existing records from primary storage. [2025-09-15T21:01:27.953826] [INFO ] [MAIN ] WCN: Loaded 35964 existing records. [2025-09-15T21:01:28.150427] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:28.151249] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-15T21:01:28.151394] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-15T21:01:28.152826] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-15T21:01:28.152946] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-15T21:01:28.421814] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T21:01:28.461023] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-15T21:01:28.579904] [INFO ] [REMOTE ] WCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:29.094491] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T21:01:29.257872] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-15T21:01:29.805003] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T21:01:30.057891] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-15T21:01:30.857968] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-15T21:01:31.001784] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T21:01:31.044302] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T21:01:31.657876] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-15T21:01:32.196461] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T21:01:32.202014] [INFO ] [REMOTE ] WBS: Full fetch complete (52518 records). [2025-09-15T21:01:32.202128] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-15T21:01:32.466159] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-15T21:01:32.586115] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-15T21:01:32.586219] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-15T21:01:32.587248] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-15T21:01:32.587293] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-15T21:01:32.588537] [DEBUG] [LOCAL ] WBS: Trimmed 52518 records to 35768 (keeping 150 days of data) [2025-09-15T21:01:32.814628] [DEBUG] [LOCAL ] WBS: Primary data saved (35768 records). [2025-09-15T21:01:32.814799] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-15T21:01:32.814901] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WBS took 23.0s. Estimated remaining: 10m 19s. Rate: 9.4 symbols/min [2025-09-15T21:01:32.985768] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:33.002949] [DEBUG] [LOCAL ] WD: Loaded 17418 existing records from primary storage. [2025-09-15T21:01:33.003084] [INFO ] [MAIN ] WD: Loaded 17418 existing records. [2025-09-15T21:01:33.191288] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:33.206229] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-15T21:01:33.206917] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-15T21:01:33.207803] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T21:01:33.211072] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-15T21:01:33.216911] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-15T21:01:33.262989] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-15T21:01:33.600548] [INFO ] [REMOTE ] WD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:33.602294] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T21:01:34.057940] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-15T21:01:34.857882] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-15T21:01:35.069242] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T21:01:35.277486] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T21:01:35.657931] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-15T21:01:35.924817] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T21:01:36.457899] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-15T21:01:36.885488] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T21:01:37.257929] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-15T21:01:37.355879] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T21:01:38.057937] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-15T21:01:38.139720] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T21:01:38.857951] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-15T21:01:39.363377] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T21:01:39.657876] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-15T21:01:40.457905] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-15T21:01:40.546524] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T21:01:40.652268] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T21:01:41.257909] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-15T21:01:41.941327] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T21:01:42.057834] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-15T21:01:42.431514] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T21:01:42.857870] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-15T21:01:43.657908] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-15T21:01:43.922232] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T21:01:43.953101] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T21:01:43.957486] [INFO ] [REMOTE ] WCC: Full fetch complete (43949 records). [2025-09-15T21:01:43.957578] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-15T21:01:44.326388] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-15T21:01:44.326476] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-15T21:01:44.327363] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-15T21:01:44.327408] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-15T21:01:44.328531] [DEBUG] [LOCAL ] WCC: Trimmed 43949 records to 28803 (keeping 150 days of data) [2025-09-15T21:01:44.459718] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-15T21:01:44.523675] [DEBUG] [LOCAL ] WCC: Primary data saved (28803 records). [2025-09-15T21:01:44.523918] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-15T21:01:44.524038] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WCC took 21.7s. Estimated remaining: 10m 12s. Rate: 9.4 symbols/min [2025-09-15T21:01:44.703935] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:44.729434] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T21:01:44.743713] [DEBUG] [LOCAL ] WDH: Loaded 11802 existing records from primary storage. [2025-09-15T21:01:44.743892] [INFO ] [MAIN ] WDH: Loaded 11802 existing records. [2025-09-15T21:01:44.940106] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:44.940410] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-15T21:01:44.940459] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-15T21:01:44.940829] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-15T21:01:44.940878] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-15T21:01:45.271984] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-15T21:01:45.311029] [INFO ] [REMOTE ] WDH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:45.962250] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T21:01:46.057863] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-15T21:01:46.097574] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T21:01:46.857902] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-15T21:01:47.162257] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T21:01:47.657890] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-15T21:01:48.190360] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T21:01:48.457922] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-15T21:01:48.628008] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T21:01:49.257934] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-15T21:01:49.476076] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T21:01:49.480092] [INFO ] [REMOTE ] WD: Full fetch complete (25785 records). [2025-09-15T21:01:49.480220] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-15T21:01:49.666000] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T21:01:49.708281] [INFO ] [REMOTE ] WBX: Full fetch complete (15990 records). [2025-09-15T21:01:49.739956] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-15T21:01:50.016741] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-15T21:01:50.026402] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-15T21:01:50.027709] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-15T21:01:50.045377] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-15T21:01:50.064258] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-15T21:01:50.159341] [DEBUG] [LOCAL ] WD: Trimmed 25785 records to 17039 (keeping 150 days of data) [2025-09-15T21:01:50.331669] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-15T21:01:50.332196] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-15T21:01:50.333117] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-15T21:01:50.333459] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-15T21:01:50.336320] [DEBUG] [LOCAL ] WBX: Trimmed 15990 records to 7468 (keeping 150 days of data) [2025-09-15T21:01:50.393292] [DEBUG] [LOCAL ] WBX: Primary data saved (7468 records). [2025-09-15T21:01:50.395998] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-15T21:01:50.396729] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WBX took 30.7s. Estimated remaining: 10m 6s. Rate: 9.4 symbols/min [2025-09-15T21:01:50.482769] [DEBUG] [LOCAL ] WD: Primary data saved (17039 records). [2025-09-15T21:01:50.503989] [INFO ] [MAIN ] WD: Full history saved. [2025-09-15T21:01:50.504314] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WD took 17.7s. Estimated remaining: 9m 59s. Rate: 9.4 symbols/min [2025-09-15T21:01:50.692922] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:50.755072] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:50.772250] [DEBUG] [LOCAL ] WDI: Loaded 15725 existing records from primary storage. [2025-09-15T21:01:50.772387] [INFO ] [MAIN ] WDI: Loaded 15725 existing records. [2025-09-15T21:01:50.864838] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-15T21:01:50.988676] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:50.991886] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-15T21:01:50.991970] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-15T21:01:50.992092] [DEBUG] [LOCAL ] WDS: Loaded 32037 existing records from primary storage. [2025-09-15T21:01:50.992307] [INFO ] [MAIN ] WDS: Loaded 32037 existing records. [2025-09-15T21:01:50.997746] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-15T21:01:51.052267] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-15T21:01:51.335511] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:51.339095] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-15T21:01:51.339450] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-15T21:01:51.361023] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-15T21:01:51.383557] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-15T21:01:51.835426] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T21:01:51.956746] [INFO ] [REMOTE ] WDI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:51.969846] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-15T21:01:52.050369] [INFO ] [REMOTE ] WDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:52.081597] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-15T21:01:52.457875] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-15T21:01:53.063701] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T21:01:53.257869] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-15T21:01:54.057865] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-15T21:01:54.182405] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T21:01:54.857848] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-15T21:01:54.869298] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T21:01:54.909740] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T21:01:55.657888] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-15T21:01:56.176781] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T21:01:56.182215] [INFO ] [REMOTE ] WCN: Full fetch complete (52290 records). [2025-09-15T21:01:56.182337] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-15T21:01:56.461723] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-15T21:01:56.551809] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T21:01:56.588058] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-15T21:01:56.588141] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-15T21:01:56.589099] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-15T21:01:56.589145] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-15T21:01:56.590268] [DEBUG] [LOCAL ] WCN: Trimmed 52290 records to 35252 (keeping 150 days of data) [2025-09-15T21:01:56.820778] [DEBUG] [LOCAL ] WCN: Primary data saved (35252 records). [2025-09-15T21:01:56.820943] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-15T21:01:56.821927] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WCN took 29.1s. Estimated remaining: 9m 53s. Rate: 9.4 symbols/min [2025-09-15T21:01:56.996286] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:01:57.005582] [DEBUG] [LOCAL ] WEA: Loaded 6074 existing records from primary storage. [2025-09-15T21:01:57.005749] [INFO ] [MAIN ] WEA: Loaded 6074 existing records. [2025-09-15T21:01:57.196492] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:01:57.196801] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-15T21:01:57.196924] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-15T21:01:57.197221] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-15T21:01:57.197269] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-15T21:01:57.264190] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-15T21:01:57.563714] [INFO ] [REMOTE ] WEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:01:57.578078] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T21:01:58.057860] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-15T21:01:58.732301] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T21:01:58.817900] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T21:01:58.857891] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-15T21:01:59.657887] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-15T21:01:59.708772] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T21:02:00.457883] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-15T21:02:00.909328] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T21:02:01.257913] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-15T21:02:01.420137] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T21:02:02.057904] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-15T21:02:02.750150] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T21:02:02.857906] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-15T21:02:02.903062] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T21:02:03.657925] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-15T21:02:03.936583] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T21:02:04.457946] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-15T21:02:05.171874] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T21:02:05.257911] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-15T21:02:05.436839] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T21:02:06.057881] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-15T21:02:06.122692] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T21:02:06.857925] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-15T21:02:07.584157] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T21:02:07.657896] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-15T21:02:08.004215] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T21:02:08.457950] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-15T21:02:08.996542] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T21:02:09.257851] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-15T21:02:09.618051] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T21:02:10.030372] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T21:02:10.057840] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-15T21:02:10.813967] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T21:02:10.857895] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-15T21:02:11.657884] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-15T21:02:12.360563] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T21:02:12.418066] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T21:02:12.457836] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-15T21:02:13.257909] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-15T21:02:13.688594] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T21:02:13.692452] [INFO ] [REMOTE ] WDH: Full fetch complete (17091 records). [2025-09-15T21:02:13.692566] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-15T21:02:13.813346] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T21:02:14.060948] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-15T21:02:14.070666] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-15T21:02:14.070763] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-15T21:02:14.071186] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-15T21:02:14.071228] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-15T21:02:14.071872] [DEBUG] [LOCAL ] WDH: Trimmed 17091 records to 12003 (keeping 150 days of data) [2025-09-15T21:02:14.143826] [DEBUG] [LOCAL ] WDH: Primary data saved (12003 records). [2025-09-15T21:02:14.143981] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-15T21:02:14.144091] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WDH took 29.6s. Estimated remaining: 9m 47s. Rate: 9.4 symbols/min [2025-09-15T21:02:14.857887] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-15T21:02:15.210961] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T21:02:15.215529] [INFO ] [REMOTE ] WDS: Full fetch complete (47846 records). [2025-09-15T21:02:15.215628] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-15T21:02:15.506465] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T21:02:15.534157] [INFO ] [REMOTE ] WEA: Full fetch complete (7772 records). [2025-09-15T21:02:15.568741] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-15T21:02:15.659550] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-15T21:02:15.680685] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-15T21:02:15.699529] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-15T21:02:15.712230] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-15T21:02:15.712611] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-15T21:02:15.795717] [DEBUG] [LOCAL ] WDS: Trimmed 47846 records to 31271 (keeping 150 days of data) [2025-09-15T21:02:16.085795] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-15T21:02:16.088013] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-15T21:02:16.088797] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-15T21:02:16.089355] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-15T21:02:16.094421] [DEBUG] [LOCAL ] WEA: Trimmed 7772 records to 6116 (keeping 150 days of data) [2025-09-15T21:02:16.208662] [DEBUG] [LOCAL ] WEA: Primary data saved (6116 records). [2025-09-15T21:02:16.211312] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-15T21:02:16.211736] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WEA took 19.4s. Estimated remaining: 9m 41s. Rate: 9.4 symbols/min [2025-09-15T21:02:16.225235] [DEBUG] [LOCAL ] WDS: Primary data saved (31271 records). [2025-09-15T21:02:16.225337] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-15T21:02:16.225435] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WDS took 25.7s. Estimated remaining: 9m 34s. Rate: 9.4 symbols/min [2025-09-15T21:02:16.868926] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T21:02:16.873920] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-15T21:02:18.027184] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T21:02:18.033262] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-15T21:02:18.930455] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T21:02:18.932891] [INFO ] [REMOTE ] WDI: Full fetch complete (22946 records). [2025-09-15T21:02:18.932963] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-15T21:02:19.297951] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-15T21:02:19.298037] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-15T21:02:19.298580] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-15T21:02:19.298629] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-15T21:02:19.299424] [DEBUG] [LOCAL ] WDI: Trimmed 22946 records to 15260 (keeping 150 days of data) [2025-09-15T21:02:19.396023] [DEBUG] [LOCAL ] WDI: Primary data saved (15260 records). [2025-09-15T21:02:19.396183] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-15T21:02:19.396271] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WDI took 29.0s. Estimated remaining: 9m 27s. Rate: 9.4 symbols/min [2025-09-15T21:02:20.139809] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:20.157841] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:20.166316] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:20.186191] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:20.248197] [DEBUG] [LOCAL ] WEAV: Loaded 31291 existing records from primary storage. [2025-09-15T21:02:20.248483] [INFO ] [MAIN ] WEAV: Loaded 31291 existing records. [2025-09-15T21:02:20.369094] [DEBUG] [LOCAL ] WELL: Loaded 39252 existing records from primary storage. [2025-09-15T21:02:20.393066] [DEBUG] [LOCAL ] WES: Loaded 36046 existing records from primary storage. [2025-09-15T21:02:20.403869] [INFO ] [MAIN ] WELL: Loaded 39252 existing records. [2025-09-15T21:02:20.415456] [DEBUG] [LOCAL ] WEC: Loaded 39283 existing records from primary storage. [2025-09-15T21:02:20.425815] [INFO ] [MAIN ] WEC: Loaded 39283 existing records. [2025-09-15T21:02:20.425898] [INFO ] [MAIN ] WES: Loaded 36046 existing records. [2025-09-15T21:02:20.601769] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:20.732265] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-15T21:02:20.784062] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-15T21:02:20.826283] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-15T21:02:20.897428] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-15T21:02:20.972841] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:21.056985] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-15T21:02:21.062406] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:21.003778] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:21.102877] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-15T21:02:21.092290] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-15T21:02:21.103070] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-15T21:02:21.125153] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-15T21:02:21.125317] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-15T21:02:21.131280] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-15T21:02:21.125098] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-15T21:02:21.169846] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-15T21:02:21.158019] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-15T21:02:21.215175] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-15T21:02:21.304391] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-15T21:02:22.246639] [INFO ] [REMOTE ] WELL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:22.277029] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-15T21:02:22.300106] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:22.352693] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-15T21:02:22.412062] [INFO ] [REMOTE ] WEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:22.417760] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-15T21:02:22.503192] [INFO ] [REMOTE ] WES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:22.504229] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-15T21:02:23.909990] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T21:02:23.920592] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-15T21:02:23.980926] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T21:02:23.991099] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-15T21:02:24.035844] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T21:02:24.045827] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-15T21:02:24.146623] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T21:02:24.157854] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-15T21:02:25.547959] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T21:02:25.557895] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-15T21:02:25.671959] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T21:02:25.713296] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-15T21:02:25.716668] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T21:02:25.917398] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T21:02:26.057819] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-15T21:02:26.828484] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T21:02:26.857819] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-15T21:02:27.657872] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-15T21:02:27.718426] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T21:02:27.801455] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T21:02:28.116331] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T21:02:28.457893] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-15T21:02:29.196585] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T21:02:29.257844] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-15T21:02:30.057887] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-15T21:02:30.272602] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T21:02:30.572878] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T21:02:30.857915] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-15T21:02:31.580924] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T21:02:31.657897] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-15T21:02:32.048993] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T21:02:32.457919] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-15T21:02:33.257928] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-15T21:02:33.565159] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T21:02:33.795811] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T21:02:34.057884] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-15T21:02:34.517634] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T21:02:34.857883] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-15T21:02:35.657892] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-15T21:02:35.915424] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T21:02:36.461668] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-15T21:02:36.472475] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T21:02:37.119091] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T21:02:37.257848] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-15T21:02:37.908342] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T21:02:37.913613] [INFO ] [REMOTE ] WES: Full fetch complete (52279 records). [2025-09-15T21:02:37.913771] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-15T21:02:38.066948] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-15T21:02:38.296486] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-15T21:02:38.296591] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-15T21:02:38.297723] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-15T21:02:38.297783] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-15T21:02:38.299080] [DEBUG] [LOCAL ] WES: Trimmed 52279 records to 35411 (keeping 150 days of data) [2025-09-15T21:02:38.540843] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T21:02:38.573366] [DEBUG] [LOCAL ] WES: Primary data saved (35411 records). [2025-09-15T21:02:38.573555] [INFO ] [MAIN ] WES: Full history saved. [2025-09-15T21:02:38.573701] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WES took 19.2s. Estimated remaining: 9m 22s. Rate: 9.4 symbols/min [2025-09-15T21:02:38.740487] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:38.766298] [DEBUG] [LOCAL ] WEX: Loaded 24622 existing records from primary storage. [2025-09-15T21:02:38.766467] [INFO ] [MAIN ] WEX: Loaded 24622 existing records. [2025-09-15T21:02:38.863811] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-15T21:02:38.941093] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:38.941370] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-15T21:02:38.941434] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-15T21:02:38.942143] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-15T21:02:38.942224] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-15T21:02:39.303362] [INFO ] [REMOTE ] WEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:39.575004] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T21:02:39.657855] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-15T21:02:40.195806] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T21:02:40.200492] [INFO ] [REMOTE ] WEAV: Full fetch complete (45972 records). [2025-09-15T21:02:40.200587] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-15T21:02:40.463026] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-15T21:02:40.571435] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-15T21:02:40.571512] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-15T21:02:40.572415] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-15T21:02:40.572460] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-15T21:02:40.573488] [DEBUG] [LOCAL ] WEAV: Trimmed 45972 records to 30769 (keeping 150 days of data) [2025-09-15T21:02:40.755597] [DEBUG] [LOCAL ] WEAV: Primary data saved (30769 records). [2025-09-15T21:02:40.755785] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-15T21:02:40.755897] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WEAV took 21.4s. Estimated remaining: 9m 15s. Rate: 9.4 symbols/min [2025-09-15T21:02:40.933842] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:40.945191] [DEBUG] [LOCAL ] WF: Loaded 8185 existing records from primary storage. [2025-09-15T21:02:40.945344] [INFO ] [MAIN ] WF: Loaded 8185 existing records. [2025-09-15T21:02:41.124175] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:41.124418] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-15T21:02:41.124463] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-15T21:02:41.124776] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-15T21:02:41.124823] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-15T21:02:41.247169] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T21:02:41.265011] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-15T21:02:41.507373] [INFO ] [REMOTE ] WF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:42.058712] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-15T21:02:42.061145] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T21:02:42.591683] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T21:02:42.602031] [INFO ] [REMOTE ] WEC: Full fetch complete (56860 records). [2025-09-15T21:02:42.602278] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-15T21:02:42.872745] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T21:02:42.866784] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-15T21:02:43.004231] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-15T21:02:43.004305] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-15T21:02:43.005324] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-15T21:02:43.005371] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-15T21:02:43.006810] [DEBUG] [LOCAL ] WEC: Trimmed 56860 records to 38536 (keeping 150 days of data) [2025-09-15T21:02:43.256274] [DEBUG] [LOCAL ] WEC: Primary data saved (38536 records). [2025-09-15T21:02:43.256414] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-15T21:02:43.256539] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WEC took 23.9s. Estimated remaining: 9m 8s. Rate: 9.4 symbols/min [2025-09-15T21:02:43.460308] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:43.501831] [DEBUG] [LOCAL ] WFC: Loaded 40488 existing records from primary storage. [2025-09-15T21:02:43.501973] [INFO ] [MAIN ] WFC: Loaded 40488 existing records. [2025-09-15T21:02:43.662144] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-15T21:02:43.688118] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:43.688386] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-15T21:02:43.688438] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-15T21:02:43.689239] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-15T21:02:43.689293] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-15T21:02:44.039798] [INFO ] [REMOTE ] WFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:44.252384] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T21:02:44.457895] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-15T21:02:44.564815] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T21:02:45.257926] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-15T21:02:46.057858] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-15T21:02:46.239577] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T21:02:46.560451] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T21:02:46.857884] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-15T21:02:47.657862] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-15T21:02:47.838479] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T21:02:48.457882] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-15T21:02:48.620490] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T21:02:48.649363] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T21:02:49.257873] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-15T21:02:50.057847] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-15T21:02:50.194665] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T21:02:50.857883] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-15T21:02:51.086246] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T21:02:51.438317] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T21:02:51.657850] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-15T21:02:52.380215] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T21:02:52.386014] [INFO ] [REMOTE ] WELL: Full fetch complete (56960 records). [2025-09-15T21:02:52.386123] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-15T21:02:52.464112] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-15T21:02:52.784732] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-15T21:02:52.784847] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-15T21:02:52.786328] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-15T21:02:52.786377] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-15T21:02:52.787776] [DEBUG] [LOCAL ] WELL: Trimmed 56960 records to 38502 (keeping 150 days of data) [2025-09-15T21:02:53.056112] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T21:02:53.103491] [DEBUG] [LOCAL ] WELL: Primary data saved (38502 records). [2025-09-15T21:02:53.103671] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-15T21:02:53.104525] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WELL took 33.7s. Estimated remaining: 9m 2s. Rate: 9.4 symbols/min [2025-09-15T21:02:53.262996] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-15T21:02:53.293125] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:02:53.316232] [DEBUG] [LOCAL ] WFG: Loaded 18099 existing records from primary storage. [2025-09-15T21:02:53.316418] [INFO ] [MAIN ] WFG: Loaded 18099 existing records. [2025-09-15T21:02:53.502738] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:02:53.511446] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T21:02:53.511739] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-15T21:02:53.514734] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-15T21:02:53.515393] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-15T21:02:53.515452] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-15T21:02:53.892992] [INFO ] [REMOTE ] WFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:02:54.057887] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-15T21:02:54.857895] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-15T21:02:55.175444] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T21:02:55.282430] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T21:02:55.657896] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-15T21:02:55.882540] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T21:02:56.457862] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-15T21:02:56.796785] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T21:02:57.257873] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-15T21:02:57.678957] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T21:02:58.057877] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-15T21:02:58.857927] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-15T21:02:59.358943] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T21:02:59.451011] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T21:02:59.479570] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T21:02:59.657814] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-15T21:03:00.457942] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-15T21:03:01.210481] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T21:03:01.213140] [INFO ] [REMOTE ] WF: Full fetch complete (12249 records). [2025-09-15T21:03:01.213293] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-15T21:03:01.263847] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-15T21:03:01.745498] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-15T21:03:01.745694] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-15T21:03:01.746056] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-15T21:03:01.746124] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-15T21:03:01.746806] [DEBUG] [LOCAL ] WF: Trimmed 12249 records to 7987 (keeping 150 days of data) [2025-09-15T21:03:01.841858] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-15T21:03:01.854971] [DEBUG] [LOCAL ] WF: Primary data saved (7987 records). [2025-09-15T21:03:01.855171] [INFO ] [MAIN ] WF: Full history saved. [2025-09-15T21:03:01.855272] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WF took 21.1s. Estimated remaining: 8m 56s. Rate: 9.4 symbols/min [2025-09-15T21:03:02.026518] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:02.059521] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-15T21:03:02.060074] [DEBUG] [LOCAL ] WGO: Loaded 28363 existing records from primary storage. [2025-09-15T21:03:02.060227] [INFO ] [MAIN ] WGO: Loaded 28363 existing records. [2025-09-15T21:03:02.241146] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:02.241401] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-15T21:03:02.241454] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-15T21:03:02.242167] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-15T21:03:02.242239] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-15T21:03:02.596862] [INFO ] [REMOTE ] WGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:02.857843] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-15T21:03:02.888688] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T21:03:03.657927] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-15T21:03:04.457909] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-15T21:03:04.921400] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-15T21:03:04.943038] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T21:03:04.948248] [INFO ] [REMOTE ] WEX: Full fetch complete (39262 records). [2025-09-15T21:03:04.948361] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-15T21:03:05.262494] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-15T21:03:05.328775] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-15T21:03:05.328841] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-15T21:03:05.329612] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-15T21:03:05.329671] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-15T21:03:05.337879] [DEBUG] [LOCAL ] WEX: Trimmed 39262 records to 24119 (keeping 150 days of data) [2025-09-15T21:03:05.351593] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-15T21:03:05.520115] [DEBUG] [LOCAL ] WEX: Primary data saved (24119 records). [2025-09-15T21:03:05.521114] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T21:03:05.520710] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-15T21:03:05.521298] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WEX took 26.9s. Estimated remaining: 8m 49s. Rate: 9.4 symbols/min [2025-09-15T21:03:05.696504] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:05.733667] [DEBUG] [LOCAL ] WH: Loaded 34303 existing records from primary storage. [2025-09-15T21:03:05.733807] [INFO ] [MAIN ] WH: Loaded 34303 existing records. [2025-09-15T21:03:05.909981] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:05.910236] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-15T21:03:05.910281] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-15T21:03:05.911017] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-15T21:03:05.911067] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-15T21:03:06.061372] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-15T21:03:06.266974] [INFO ] [REMOTE ] WH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:06.299387] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T21:03:06.857878] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-15T21:03:07.442712] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T21:03:07.448283] [INFO ] [REMOTE ] WFC: Full fetch complete (58038 records). [2025-09-15T21:03:07.448408] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-15T21:03:07.449226] [FATAL] [VALIDATOR ] WFC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:03:07.449313] [FATAL] [MAIN ] WFC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:03:07.449351] [WARN ] [MAIN ] WFC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:03:07.449442] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-15T21:03:07.449507] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-09-15T21:03:07.449544] [INFO ] [LOCAL ] WFC: Starting deletion of derivative data. [2025-09-15T21:03:07.449898] [DEBUG] [LOCAL ] WFC: Deleted derivative data file. [2025-09-15T21:03:07.451851] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WFC took 24.2s. Estimated remaining: 8m 43s. Rate: 9.4 symbols/min [2025-09-15T21:03:07.627288] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:07.659346] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T21:03:07.658115] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-15T21:03:07.697207] [DEBUG] [LOCAL ] WHD: Loaded 29778 existing records from primary storage. [2025-09-15T21:03:07.697362] [INFO ] [MAIN ] WHD: Loaded 29778 existing records. [2025-09-15T21:03:07.875941] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:07.876285] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-15T21:03:07.876360] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-15T21:03:07.877162] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-15T21:03:07.877243] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-15T21:03:08.226398] [INFO ] [REMOTE ] WHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:08.457812] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-15T21:03:08.739863] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T21:03:09.257931] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-15T21:03:09.642816] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T21:03:10.057871] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-15T21:03:10.316389] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T21:03:10.857908] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-15T21:03:11.657922] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-15T21:03:11.738391] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T21:03:11.799207] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T21:03:12.457940] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-15T21:03:13.257926] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-15T21:03:13.310316] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T21:03:13.951354] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T21:03:14.057895] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-15T21:03:14.303427] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T21:03:14.306674] [INFO ] [REMOTE ] WFG: Full fetch complete (27398 records). [2025-09-15T21:03:14.306750] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-15T21:03:14.676131] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-15T21:03:14.676231] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-15T21:03:14.677096] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-15T21:03:14.677140] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-15T21:03:14.678259] [DEBUG] [LOCAL ] WFG: Trimmed 27398 records to 17796 (keeping 150 days of data) [2025-09-15T21:03:14.796308] [DEBUG] [LOCAL ] WFG: Primary data saved (17796 records). [2025-09-15T21:03:14.796468] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-15T21:03:14.796553] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFG took 21.7s. Estimated remaining: 8m 37s. Rate: 9.4 symbols/min [2025-09-15T21:03:14.861679] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-15T21:03:14.967899] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:14.972039] [DEBUG] [LOCAL ] WHG: Loaded 2644 existing records from primary storage. [2025-09-15T21:03:14.972111] [INFO ] [MAIN ] WHG: Loaded 2644 existing records. [2025-09-15T21:03:15.153937] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:15.154213] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-15T21:03:15.154259] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-15T21:03:15.154539] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-15T21:03:15.154586] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-15T21:03:15.531956] [INFO ] [REMOTE ] WHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:15.577704] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T21:03:15.657832] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-15T21:03:16.457925] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-15T21:03:16.675065] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T21:03:17.257906] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-15T21:03:18.057910] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-15T21:03:18.140722] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-15T21:03:18.254885] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T21:03:18.416624] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T21:03:18.857867] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-15T21:03:19.288207] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T21:03:19.657882] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-15T21:03:20.252828] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T21:03:20.397759] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T21:03:20.457833] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-15T21:03:21.082188] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T21:03:21.257885] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-15T21:03:22.057892] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-15T21:03:22.573783] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T21:03:22.857915] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-15T21:03:23.459205] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T21:03:23.534886] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T21:03:23.657909] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-15T21:03:24.457889] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-15T21:03:25.163225] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T21:03:25.257905] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-15T21:03:25.354572] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T21:03:25.358970] [INFO ] [REMOTE ] WGO: Full fetch complete (43027 records). [2025-09-15T21:03:25.359062] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-15T21:03:25.747688] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-15T21:03:25.747796] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-15T21:03:25.748779] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-15T21:03:25.748849] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-15T21:03:25.750438] [DEBUG] [LOCAL ] WGO: Trimmed 43027 records to 27817 (keeping 150 days of data) [2025-09-15T21:03:25.936329] [DEBUG] [LOCAL ] WGO: Primary data saved (27817 records). [2025-09-15T21:03:25.936538] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-15T21:03:25.936675] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WGO took 24.1s. Estimated remaining: 8m 30s. Rate: 9.4 symbols/min [2025-09-15T21:03:26.063076] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-15T21:03:26.118069] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:26.162463] [DEBUG] [LOCAL ] WHR: Loaded 36666 existing records from primary storage. [2025-09-15T21:03:26.162714] [INFO ] [MAIN ] WHR: Loaded 36666 existing records. [2025-09-15T21:03:26.351183] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:26.351500] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-15T21:03:26.351551] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-15T21:03:26.352522] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-15T21:03:26.352580] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-15T21:03:26.730398] [INFO ] [REMOTE ] WHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:26.737251] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T21:03:26.768249] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T21:03:26.857896] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-15T21:03:27.657887] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-15T21:03:28.182158] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T21:03:28.457885] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-15T21:03:28.611698] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T21:03:28.962567] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T21:03:29.257900] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-15T21:03:30.057891] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-15T21:03:30.586909] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T21:03:30.857889] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-15T21:03:31.631009] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T21:03:31.657872] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-15T21:03:32.187139] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T21:03:32.191910] [INFO ] [REMOTE ] WHD: Full fetch complete (44012 records). [2025-09-15T21:03:32.192024] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-15T21:03:32.467008] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-15T21:03:32.566497] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-15T21:03:32.566601] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-15T21:03:32.567545] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-15T21:03:32.567616] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-15T21:03:32.568848] [DEBUG] [LOCAL ] WHD: Trimmed 44012 records to 29039 (keeping 150 days of data) [2025-09-15T21:03:32.752804] [DEBUG] [LOCAL ] WHD: Primary data saved (29039 records). [2025-09-15T21:03:32.752959] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-15T21:03:32.753062] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WHD took 25.3s. Estimated remaining: 8m 24s. Rate: 9.4 symbols/min [2025-09-15T21:03:32.932965] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:32.938696] [DEBUG] [LOCAL ] WIA: Loaded 3550 existing records from primary storage. [2025-09-15T21:03:32.938822] [INFO ] [MAIN ] WIA: Loaded 3550 existing records. [2025-09-15T21:03:33.119294] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:33.119711] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-15T21:03:33.119797] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-15T21:03:33.120102] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-15T21:03:33.120217] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-15T21:03:33.268016] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-15T21:03:33.599579] [INFO ] [REMOTE ] WIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:33.603297] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T21:03:33.758235] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T21:03:33.759278] [INFO ] [REMOTE ] WHG: Full fetch complete (3739 records). [2025-09-15T21:03:33.759360] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-15T21:03:34.058798] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-15T21:03:34.134917] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-15T21:03:34.135104] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-15T21:03:34.135304] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-15T21:03:34.135400] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-15T21:03:34.135927] [DEBUG] [LOCAL ] WHG: Trimmed 3739 records to 2589 (keeping 150 days of data) [2025-09-15T21:03:34.152450] [DEBUG] [LOCAL ] WHG: Primary data saved (2589 records). [2025-09-15T21:03:34.152509] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-15T21:03:34.152581] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WHG took 19.4s. Estimated remaining: 8m 17s. Rate: 9.4 symbols/min [2025-09-15T21:03:34.320398] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:34.358219] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T21:03:34.373762] [DEBUG] [LOCAL ] WINN: Loaded 8241 existing records from primary storage. [2025-09-15T21:03:34.373904] [INFO ] [MAIN ] WINN: Loaded 8241 existing records. [2025-09-15T21:03:34.545053] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:34.545278] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-15T21:03:34.545323] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-15T21:03:34.545716] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-15T21:03:34.545768] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-15T21:03:34.862977] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-15T21:03:34.896185] [INFO ] [REMOTE ] WINN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:35.657903] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-15T21:03:35.923506] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T21:03:36.457899] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-15T21:03:36.511186] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T21:03:36.542361] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T21:03:37.257894] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-15T21:03:38.057849] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-15T21:03:38.429436] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T21:03:38.487501] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T21:03:38.520034] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T21:03:38.527057] [INFO ] [REMOTE ] WH: Full fetch complete (50090 records). [2025-09-15T21:03:38.527225] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-15T21:03:38.863371] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-15T21:03:38.938748] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-15T21:03:38.938845] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-15T21:03:38.940019] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-15T21:03:38.940084] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-15T21:03:38.941485] [DEBUG] [LOCAL ] WH: Trimmed 50090 records to 33730 (keeping 150 days of data) [2025-09-15T21:03:39.160509] [DEBUG] [LOCAL ] WH: Primary data saved (33730 records). [2025-09-15T21:03:39.160676] [INFO ] [MAIN ] WH: Full history saved. [2025-09-15T21:03:39.161685] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WH took 33.6s. Estimated remaining: 8m 11s. Rate: 9.4 symbols/min [2025-09-15T21:03:39.330924] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:39.371082] [DEBUG] [LOCAL ] WIT: Loaded 39402 existing records from primary storage. [2025-09-15T21:03:39.371238] [INFO ] [MAIN ] WIT: Loaded 39402 existing records. [2025-09-15T21:03:39.549378] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:39.549617] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-15T21:03:39.549684] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-15T21:03:39.550491] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-15T21:03:39.550540] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-15T21:03:39.663006] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-15T21:03:39.916476] [INFO ] [REMOTE ] WIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:39.917675] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T21:03:40.388518] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T21:03:40.457892] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-15T21:03:41.072869] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T21:03:41.257871] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-15T21:03:41.873040] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T21:03:42.057879] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-15T21:03:42.857890] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-15T21:03:43.657934] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-15T21:03:43.705948] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T21:03:44.447542] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T21:03:44.457820] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-15T21:03:44.558479] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T21:03:45.257901] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-15T21:03:45.324158] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T21:03:46.057887] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-15T21:03:46.769329] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T21:03:46.857852] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-15T21:03:47.016922] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T21:03:47.376551] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T21:03:47.657881] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-15T21:03:48.457904] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-15T21:03:49.262944] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-15T21:03:49.282687] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T21:03:50.057905] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-15T21:03:50.209626] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T21:03:50.247844] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T21:03:50.857870] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-15T21:03:51.657874] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-15T21:03:51.933689] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T21:03:51.965685] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T21:03:52.457869] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-15T21:03:53.113112] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T21:03:53.114832] [INFO ] [REMOTE ] WIA: Full fetch complete (5293 records). [2025-09-15T21:03:53.114916] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-15T21:03:53.263134] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-15T21:03:53.619737] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-15T21:03:53.620107] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-15T21:03:53.620701] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-15T21:03:53.620797] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-15T21:03:53.622743] [DEBUG] [LOCAL ] WIA: Trimmed 5293 records to 3584 (keeping 150 days of data) [2025-09-15T21:03:53.703179] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T21:03:53.728021] [DEBUG] [LOCAL ] WIA: Primary data saved (3584 records). [2025-09-15T21:03:53.728220] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-15T21:03:53.728610] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WIA took 21.0s. Estimated remaining: 8m 5s. Rate: 9.4 symbols/min [2025-09-15T21:03:53.979521] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:54.007465] [DEBUG] [LOCAL ] WIW: Loaded 15541 existing records from primary storage. [2025-09-15T21:03:54.007753] [INFO ] [MAIN ] WIW: Loaded 15541 existing records. [2025-09-15T21:03:54.063039] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-15T21:03:54.303155] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:54.303676] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-15T21:03:54.303755] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-15T21:03:54.304551] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-15T21:03:54.304622] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-15T21:03:54.695480] [INFO ] [REMOTE ] WIW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:54.857877] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-15T21:03:55.077226] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T21:03:55.571593] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T21:03:55.594883] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T21:03:55.657830] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-15T21:03:56.428959] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T21:03:56.457822] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-15T21:03:57.094692] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T21:03:57.096413] [INFO ] [REMOTE ] WINN: Full fetch complete (13106 records). [2025-09-15T21:03:57.096486] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-15T21:03:57.266393] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-15T21:03:57.455529] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-15T21:03:57.455612] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-15T21:03:57.456006] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-15T21:03:57.456050] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-15T21:03:57.456535] [DEBUG] [LOCAL ] WINN: Trimmed 13106 records to 7978 (keeping 150 days of data) [2025-09-15T21:03:57.507083] [DEBUG] [LOCAL ] WINN: Primary data saved (7978 records). [2025-09-15T21:03:57.507253] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-15T21:03:57.507364] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WINN took 23.4s. Estimated remaining: 7m 58s. Rate: 9.4 symbols/min [2025-09-15T21:03:57.680528] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:03:57.706834] [DEBUG] [LOCAL ] WK: Loaded 26892 existing records from primary storage. [2025-09-15T21:03:57.706986] [INFO ] [MAIN ] WK: Loaded 26892 existing records. [2025-09-15T21:03:57.882961] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:03:57.883227] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-15T21:03:57.883274] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-15T21:03:57.883887] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-15T21:03:57.883939] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-15T21:03:58.069372] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-15T21:03:58.237340] [INFO ] [REMOTE ] WK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:03:58.857927] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-15T21:03:59.271788] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T21:03:59.294233] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T21:03:59.657916] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-15T21:04:00.115871] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T21:04:00.457878] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-15T21:04:01.263284] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-15T21:04:01.270426] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T21:04:01.276268] [INFO ] [REMOTE ] WHR: Full fetch complete (52077 records). [2025-09-15T21:04:01.276413] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-15T21:04:01.661322] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-15T21:04:01.661397] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-15T21:04:01.662328] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-15T21:04:01.662373] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-15T21:04:01.663454] [DEBUG] [LOCAL ] WHR: Trimmed 52077 records to 35926 (keeping 150 days of data) [2025-09-15T21:04:01.898498] [DEBUG] [LOCAL ] WHR: Primary data saved (35926 records). [2025-09-15T21:04:01.898687] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-15T21:04:01.898826] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WHR took 36.0s. Estimated remaining: 7m 52s. Rate: 9.4 symbols/min [2025-09-15T21:04:02.069984] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-15T21:04:02.072913] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:02.099959] [DEBUG] [LOCAL ] WKC: Loaded 26041 existing records from primary storage. [2025-09-15T21:04:02.100115] [INFO ] [MAIN ] WKC: Loaded 26041 existing records. [2025-09-15T21:04:02.279988] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:02.280266] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-15T21:04:02.280477] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-15T21:04:02.281096] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-15T21:04:02.281148] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-15T21:04:02.491038] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T21:04:02.635707] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T21:04:02.699475] [INFO ] [REMOTE ] WKC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:02.857890] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-15T21:04:03.343467] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T21:04:03.657836] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-15T21:04:03.978934] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T21:04:04.457904] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-15T21:04:05.201657] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T21:04:05.257882] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-15T21:04:05.969432] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T21:04:05.975336] [INFO ] [REMOTE ] WIT: Full fetch complete (56747 records). [2025-09-15T21:04:05.975445] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-15T21:04:06.064243] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-15T21:04:06.354314] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-15T21:04:06.354400] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-15T21:04:06.355380] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-15T21:04:06.355424] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-15T21:04:06.356545] [DEBUG] [LOCAL ] WIT: Trimmed 56747 records to 38645 (keeping 150 days of data) [2025-09-15T21:04:06.588739] [DEBUG] [LOCAL ] WIT: Primary data saved (38645 records). [2025-09-15T21:04:06.588929] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-15T21:04:06.589500] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WIT took 27.4s. Estimated remaining: 7m 46s. Rate: 9.4 symbols/min [2025-09-15T21:04:06.763525] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T21:04:06.781973] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:06.825166] [DEBUG] [LOCAL ] WLK: Loaded 34554 existing records from primary storage. [2025-09-15T21:04:06.825305] [INFO ] [MAIN ] WLK: Loaded 34554 existing records. [2025-09-15T21:04:06.862956] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-15T21:04:07.009279] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:07.016120] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-15T21:04:07.020796] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-15T21:04:07.021220] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T21:04:07.025251] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-15T21:04:07.025639] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-15T21:04:07.375135] [INFO ] [REMOTE ] WLK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:07.657929] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-15T21:04:08.170509] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T21:04:08.457893] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-15T21:04:09.242149] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T21:04:09.257809] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-15T21:04:09.600763] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T21:04:10.057868] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-15T21:04:10.857847] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-15T21:04:10.928739] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T21:04:10.978170] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T21:04:11.657888] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-15T21:04:12.285979] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T21:04:12.457906] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-15T21:04:12.711322] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T21:04:13.257939] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-15T21:04:13.657600] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T21:04:14.057896] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-15T21:04:14.857900] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-15T21:04:14.915014] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T21:04:15.114086] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T21:04:15.117571] [INFO ] [REMOTE ] WIW: Full fetch complete (22496 records). [2025-09-15T21:04:15.117686] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-15T21:04:15.488353] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-15T21:04:15.488442] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-15T21:04:15.488987] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-15T21:04:15.489041] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-15T21:04:15.489712] [DEBUG] [LOCAL ] WIW: Trimmed 22496 records to 15323 (keeping 150 days of data) [2025-09-15T21:04:15.588660] [DEBUG] [LOCAL ] WIW: Primary data saved (15323 records). [2025-09-15T21:04:15.588828] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-15T21:04:15.588944] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WIW took 21.9s. Estimated remaining: 7m 39s. Rate: 9.4 symbols/min [2025-09-15T21:04:15.663077] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-15T21:04:15.778576] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:15.787039] [DEBUG] [LOCAL ] WLKP: Loaded 4996 existing records from primary storage. [2025-09-15T21:04:15.787223] [INFO ] [MAIN ] WLKP: Loaded 4996 existing records. [2025-09-15T21:04:15.975875] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:15.976153] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-15T21:04:15.976204] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-15T21:04:15.976467] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-15T21:04:15.976512] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-15T21:04:16.344805] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:16.370153] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T21:04:16.457868] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-15T21:04:17.075894] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T21:04:17.159187] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T21:04:17.257912] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-15T21:04:18.057887] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-15T21:04:18.445577] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T21:04:18.450096] [INFO ] [REMOTE ] WK: Full fetch complete (39713 records). [2025-09-15T21:04:18.450218] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-15T21:04:18.850679] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-15T21:04:18.850838] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-15T21:04:18.852670] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-15T21:04:18.852731] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-15T21:04:18.854109] [DEBUG] [LOCAL ] WK: Trimmed 39713 records to 26500 (keeping 150 days of data) [2025-09-15T21:04:18.907456] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-15T21:04:19.033714] [DEBUG] [LOCAL ] WK: Primary data saved (26500 records). [2025-09-15T21:04:19.033937] [INFO ] [MAIN ] WK: Full history saved. [2025-09-15T21:04:19.034152] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WK took 21.5s. Estimated remaining: 7m 33s. Rate: 9.4 symbols/min [2025-09-15T21:04:19.216278] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:19.219917] [DEBUG] [LOCAL ] WLTG: Loaded 898 existing records from primary storage. [2025-09-15T21:04:19.220071] [INFO ] [MAIN ] WLTG: Loaded 898 existing records. [2025-09-15T21:04:19.453720] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T21:04:19.484636] [WARN ] [MAIN ] WLTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:19.485306] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-15T21:04:19.485428] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-15T21:04:19.485692] [DEBUG] [LOCAL ] WLTG: Deleted primary data file. [2025-09-15T21:04:19.485740] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-15T21:04:19.661088] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-15T21:04:19.845951] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:20.408086] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T21:04:20.457884] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-15T21:04:20.746610] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T21:04:20.835424] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T21:04:21.257867] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-15T21:04:21.649613] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T21:04:22.057882] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-15T21:04:22.857885] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-15T21:04:23.657898] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-15T21:04:23.849702] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T21:04:24.045583] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T21:04:24.047373] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T21:04:24.457880] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-15T21:04:25.257879] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-15T21:04:25.913854] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T21:04:26.057875] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-15T21:04:26.122470] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T21:04:26.857869] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-15T21:04:26.922339] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T21:04:27.237892] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T21:04:27.657898] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-15T21:04:28.457913] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-15T21:04:28.976090] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T21:04:29.257879] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-15T21:04:29.896199] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T21:04:30.057911] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-15T21:04:30.114104] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T21:04:30.399526] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T21:04:30.857897] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-15T21:04:31.626867] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T21:04:31.657818] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-15T21:04:32.457892] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-15T21:04:32.584832] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T21:04:32.983915] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T21:04:33.257871] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-15T21:04:33.944688] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T21:04:33.946212] [INFO ] [REMOTE ] WLKP: Full fetch complete (7154 records). [2025-09-15T21:04:33.946284] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-15T21:04:34.062974] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-15T21:04:34.319443] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-15T21:04:34.319545] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-15T21:04:34.319815] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-15T21:04:34.319862] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-15T21:04:34.320372] [DEBUG] [LOCAL ] WLKP: Trimmed 7154 records to 4933 (keeping 150 days of data) [2025-09-15T21:04:34.354451] [DEBUG] [LOCAL ] WLKP: Primary data saved (4933 records). [2025-09-15T21:04:34.354684] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-15T21:04:34.354836] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WLKP took 18.8s. Estimated remaining: 7m 27s. Rate: 9.4 symbols/min [2025-09-15T21:04:34.533542] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:34.557691] [DEBUG] [LOCAL ] WLY: Loaded 22672 existing records from primary storage. [2025-09-15T21:04:34.557885] [INFO ] [MAIN ] WLY: Loaded 22672 existing records. [2025-09-15T21:04:34.632262] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T21:04:34.746967] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:34.747351] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-15T21:04:34.747403] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-15T21:04:34.748094] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-15T21:04:34.748157] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-15T21:04:34.863030] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-15T21:04:35.120583] [INFO ] [REMOTE ] WLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:35.304665] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T21:04:35.305430] [INFO ] [REMOTE ] WLTG: Full fetch complete (1299 records). [2025-09-15T21:04:35.305532] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-15T21:04:35.657926] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-15T21:04:35.658331] [DEBUG] [VALIDATOR ] WLTG: All expected trading days are present. [2025-09-15T21:04:35.659191] [DEBUG] [VALIDATOR ] WLTG: Primary data validation passed. [2025-09-15T21:04:35.659291] [INFO ] [MAIN ] WLTG: Fetched primary data is valid. [2025-09-15T21:04:35.659332] [DEBUG] [LOCAL ] WLTG: Saving primary data. [2025-09-15T21:04:35.659750] [DEBUG] [LOCAL ] WLTG: Trimmed 1299 records to 885 (keeping 150 days of data) [2025-09-15T21:04:35.666263] [DEBUG] [LOCAL ] WLTG: Primary data saved (885 records). [2025-09-15T21:04:35.666326] [INFO ] [MAIN ] WLTG: Full history saved. [2025-09-15T21:04:35.666399] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WLTG took 16.6s. Estimated remaining: 7m 20s. Rate: 9.4 symbols/min [2025-09-15T21:04:35.835718] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:35.875503] [DEBUG] [LOCAL ] WM: Loaded 38369 existing records from primary storage. [2025-09-15T21:04:35.875694] [INFO ] [MAIN ] WM: Loaded 38369 existing records. [2025-09-15T21:04:36.051123] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:36.051386] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-15T21:04:36.051431] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-15T21:04:36.052317] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-15T21:04:36.052378] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-15T21:04:36.404058] [INFO ] [REMOTE ] WM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:36.457896] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-15T21:04:37.138036] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T21:04:37.257903] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-15T21:04:38.057842] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-15T21:04:38.155307] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T21:04:38.535143] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T21:04:38.857908] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-15T21:04:39.520221] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T21:04:39.525309] [INFO ] [REMOTE ] WLK: Full fetch complete (48898 records). [2025-09-15T21:04:39.525417] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-15T21:04:39.664252] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-15T21:04:39.905384] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-15T21:04:39.905483] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-15T21:04:39.906480] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-15T21:04:39.906544] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-15T21:04:39.909328] [DEBUG] [LOCAL ] WLK: Trimmed 48898 records to 34071 (keeping 150 days of data) [2025-09-15T21:04:40.052893] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T21:04:40.149902] [DEBUG] [LOCAL ] WLK: Primary data saved (34071 records). [2025-09-15T21:04:40.150052] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-15T21:04:40.150530] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLK took 33.6s. Estimated remaining: 7m 14s. Rate: 9.4 symbols/min [2025-09-15T21:04:40.321466] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:40.364830] [DEBUG] [LOCAL ] WMB: Loaded 40413 existing records from primary storage. [2025-09-15T21:04:40.365004] [INFO ] [MAIN ] WMB: Loaded 40413 existing records. [2025-09-15T21:04:40.463035] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-15T21:04:40.545133] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:40.545426] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-15T21:04:40.545473] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-15T21:04:40.546251] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-15T21:04:40.546302] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-15T21:04:40.903446] [INFO ] [REMOTE ] WMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:41.257861] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-15T21:04:41.771703] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-15T21:04:41.802082] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T21:04:42.057932] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-15T21:04:42.857897] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-15T21:04:42.992659] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T21:04:43.657894] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-15T21:04:43.961157] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T21:04:44.209184] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-15T21:04:44.457893] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-15T21:04:45.257876] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-15T21:04:45.412521] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T21:04:46.057905] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-15T21:04:46.196458] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T21:04:46.684482] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T21:04:46.857876] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-15T21:04:47.657907] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-15T21:04:48.083965] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T21:04:48.116398] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T21:04:48.457973] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-15T21:04:48.735225] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T21:04:48.741749] [INFO ] [REMOTE ] WKC: Full fetch complete (38623 records). [2025-09-15T21:04:48.741864] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-15T21:04:49.118923] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-15T21:04:49.119010] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-15T21:04:49.119802] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-15T21:04:49.119848] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-15T21:04:49.120792] [DEBUG] [LOCAL ] WKC: Trimmed 38623 records to 25611 (keeping 150 days of data) [2025-09-15T21:04:49.265695] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-15T21:04:49.285662] [DEBUG] [LOCAL ] WKC: Primary data saved (25611 records). [2025-09-15T21:04:49.285747] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-15T21:04:49.285876] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WKC took 47.4s. Estimated remaining: 7m 7s. Rate: 9.4 symbols/min [2025-09-15T21:04:49.462379] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:49.477446] [DEBUG] [LOCAL ] WMK: Loaded 10865 existing records from primary storage. [2025-09-15T21:04:49.477694] [INFO ] [MAIN ] WMK: Loaded 10865 existing records. [2025-09-15T21:04:49.673492] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:49.673855] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-15T21:04:49.673906] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-15T21:04:49.674306] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-15T21:04:49.674360] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-15T21:04:50.049476] [INFO ] [REMOTE ] WMK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:50.057836] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-15T21:04:50.143676] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T21:04:50.478466] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T21:04:50.857872] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-15T21:04:50.963315] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T21:04:51.657877] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-15T21:04:51.720546] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T21:04:52.457933] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-15T21:04:53.258125] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-15T21:04:53.261114] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T21:04:53.607220] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T21:04:53.611715] [INFO ] [REMOTE ] WLY: Full fetch complete (32941 records). [2025-09-15T21:04:53.611825] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-15T21:04:53.997003] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-15T21:04:53.997082] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-15T21:04:53.997777] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-15T21:04:53.997827] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-15T21:04:53.998623] [DEBUG] [LOCAL ] WLY: Trimmed 32941 records to 22301 (keeping 150 days of data) [2025-09-15T21:04:54.060083] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-15T21:04:54.145104] [DEBUG] [LOCAL ] WLY: Primary data saved (22301 records). [2025-09-15T21:04:54.145236] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-15T21:04:54.145344] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 19.8s. Estimated remaining: 7m 1s. Rate: 9.4 symbols/min [2025-09-15T21:04:54.317930] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:04:54.352409] [DEBUG] [LOCAL ] WMS: Loaded 29750 existing records from primary storage. [2025-09-15T21:04:54.352547] [INFO ] [MAIN ] WMS: Loaded 29750 existing records. [2025-09-15T21:04:54.526831] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:04:54.527072] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-15T21:04:54.527133] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-15T21:04:54.527933] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-15T21:04:54.527984] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-15T21:04:54.871917] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-15T21:04:54.876802] [INFO ] [REMOTE ] WMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:04:55.131155] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T21:04:55.197975] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T21:04:55.657883] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-15T21:04:56.457889] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-15T21:04:57.257892] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-15T21:04:57.383103] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-15T21:04:57.653870] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T21:04:58.057905] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-15T21:04:58.674819] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-15T21:04:58.857893] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-15T21:04:58.955594] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T21:04:59.321815] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-15T21:04:59.657931] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-15T21:05:00.069089] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T21:05:00.074736] [INFO ] [REMOTE ] WM: Full fetch complete (55030 records). [2025-09-15T21:05:00.074940] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-15T21:05:00.075886] [FATAL] [VALIDATOR ] WM: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:05:00.076005] [FATAL] [MAIN ] WM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:05:00.076069] [WARN ] [MAIN ] WM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:05:00.076154] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-15T21:05:00.076223] [DEBUG] [LOCAL ] WM: No primary data file found to delete. [2025-09-15T21:05:00.076262] [INFO ] [LOCAL ] WM: Starting deletion of derivative data. [2025-09-15T21:05:00.076674] [DEBUG] [LOCAL ] WM: Deleted derivative data file. [2025-09-15T21:05:00.076775] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WM took 24.4s. Estimated remaining: 6m 55s. Rate: 9.4 symbols/min [2025-09-15T21:05:00.254749] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:00.299498] [DEBUG] [LOCAL ] WMT: Loaded 40540 existing records from primary storage. [2025-09-15T21:05:00.299729] [INFO ] [MAIN ] WMT: Loaded 40540 existing records. [2025-09-15T21:05:00.470613] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-15T21:05:00.475165] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:00.476288] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-15T21:05:00.476343] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-15T21:05:00.477478] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-15T21:05:00.477539] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-15T21:05:00.840571] [INFO ] [REMOTE ] WMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:00.947031] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-15T21:05:01.257869] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-15T21:05:01.960808] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T21:05:02.057914] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-15T21:05:02.857859] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-15T21:05:02.912002] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T21:05:03.663537] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-15T21:05:03.680750] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T21:05:03.741201] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T21:05:04.431267] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T21:05:04.437741] [INFO ] [REMOTE ] WMB: Full fetch complete (57962 records). [2025-09-15T21:05:04.437846] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-15T21:05:04.438556] [FATAL] [VALIDATOR ] WMB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:05:04.438660] [FATAL] [MAIN ] WMB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:05:04.438727] [WARN ] [MAIN ] WMB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:05:04.438781] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-15T21:05:04.438877] [DEBUG] [LOCAL ] WMB: No primary data file found to delete. [2025-09-15T21:05:04.438915] [INFO ] [LOCAL ] WMB: Starting deletion of derivative data. [2025-09-15T21:05:04.439178] [DEBUG] [LOCAL ] WMB: Deleted derivative data file. [2025-09-15T21:05:04.439774] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WMB took 24.3s. Estimated remaining: 6m 48s. Rate: 9.4 symbols/min [2025-09-15T21:05:04.462975] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-15T21:05:04.614098] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:04.654586] [DEBUG] [LOCAL ] WNC: Loaded 29515 existing records from primary storage. [2025-09-15T21:05:04.654768] [INFO ] [MAIN ] WNC: Loaded 29515 existing records. [2025-09-15T21:05:04.828756] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:04.829010] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-15T21:05:04.829055] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-15T21:05:04.829722] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-15T21:05:04.829772] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-15T21:05:05.187992] [INFO ] [REMOTE ] WNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:05.257973] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-15T21:05:06.057942] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-15T21:05:06.837902] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T21:05:06.860147] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-15T21:05:06.865172] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T21:05:06.901666] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-15T21:05:07.657879] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-15T21:05:07.937929] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T21:05:08.457912] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-15T21:05:09.257905] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-15T21:05:09.841449] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T21:05:10.057880] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-15T21:05:10.338861] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-15T21:05:10.573482] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T21:05:10.857898] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-15T21:05:11.657909] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-15T21:05:12.356001] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-15T21:05:12.457900] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-15T21:05:12.689088] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T21:05:12.691189] [INFO ] [REMOTE ] WMK: Full fetch complete (15409 records). [2025-09-15T21:05:12.691261] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-15T21:05:13.061300] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-15T21:05:13.061391] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-15T21:05:13.061752] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-15T21:05:13.061809] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-15T21:05:13.062439] [DEBUG] [LOCAL ] WMK: Trimmed 15409 records to 10738 (keeping 150 days of data) [2025-09-15T21:05:13.128384] [DEBUG] [LOCAL ] WMK: Primary data saved (10738 records). [2025-09-15T21:05:13.128501] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-15T21:05:13.128584] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMK took 23.8s. Estimated remaining: 6m 42s. Rate: 9.4 symbols/min [2025-09-15T21:05:13.272817] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-15T21:05:13.304617] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:13.340890] [DEBUG] [LOCAL ] WNS: Loaded 30428 existing records from primary storage. [2025-09-15T21:05:13.341045] [INFO ] [MAIN ] WNS: Loaded 30428 existing records. [2025-09-15T21:05:13.518813] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:13.519102] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-15T21:05:13.519157] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-15T21:05:13.519877] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-15T21:05:13.519928] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-15T21:05:13.883930] [INFO ] [REMOTE ] WNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:13.981557] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-15T21:05:14.057888] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-15T21:05:14.098153] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T21:05:14.857875] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-15T21:05:15.095169] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T21:05:15.657957] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-15T21:05:16.215986] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T21:05:16.342320] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T21:05:16.457884] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-15T21:05:17.095810] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T21:05:17.100684] [INFO ] [REMOTE ] WMS: Full fetch complete (42955 records). [2025-09-15T21:05:17.100777] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-15T21:05:17.259136] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-15T21:05:17.480891] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-15T21:05:17.480992] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-15T21:05:17.481976] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-15T21:05:17.482025] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-15T21:05:17.483601] [DEBUG] [LOCAL ] WMS: Trimmed 42955 records to 29380 (keeping 150 days of data) [2025-09-15T21:05:17.682301] [DEBUG] [LOCAL ] WMS: Primary data saved (29380 records). [2025-09-15T21:05:17.682466] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-15T21:05:17.682572] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WMS took 23.5s. Estimated remaining: 6m 35s. Rate: 9.4 symbols/min [2025-09-15T21:05:17.867765] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:17.908728] [DEBUG] [LOCAL ] WOLF: Loaded 40278 existing records from primary storage. [2025-09-15T21:05:17.908889] [INFO ] [MAIN ] WOLF: Loaded 40278 existing records. [2025-09-15T21:05:18.059719] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-15T21:05:18.117311] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:18.119930] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-15T21:05:18.120060] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-15T21:05:18.121398] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T21:05:18.128712] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-15T21:05:18.128927] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-15T21:05:18.485031] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:18.857893] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-15T21:05:19.651618] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T21:05:19.661176] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-15T21:05:19.785236] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-15T21:05:20.457900] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-15T21:05:20.982857] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T21:05:21.257928] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-15T21:05:21.259182] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T21:05:22.057943] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-15T21:05:22.857993] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-15T21:05:23.024599] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-15T21:05:23.403590] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-15T21:05:23.462770] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T21:05:23.657866] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-15T21:05:24.437499] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T21:05:24.457821] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-15T21:05:25.111288] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T21:05:25.257878] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-15T21:05:25.937600] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T21:05:26.057881] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-15T21:05:26.857944] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-15T21:05:26.903076] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T21:05:27.657901] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-15T21:05:27.757271] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T21:05:28.330300] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-15T21:05:28.457880] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-15T21:05:28.790192] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T21:05:29.257874] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-15T21:05:29.954453] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T21:05:29.959805] [INFO ] [REMOTE ] WMT: Full fetch complete (58090 records). [2025-09-15T21:05:29.959923] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-15T21:05:29.960801] [FATAL] [VALIDATOR ] WMT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:05:29.960899] [FATAL] [MAIN ] WMT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:05:29.960949] [WARN ] [MAIN ] WMT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:05:29.961050] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-15T21:05:29.961135] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-15T21:05:29.961183] [INFO ] [LOCAL ] WMT: Starting deletion of derivative data. [2025-09-15T21:05:29.961585] [DEBUG] [LOCAL ] WMT: Deleted derivative data file. [2025-09-15T21:05:29.961704] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WMT took 29.9s. Estimated remaining: 6m 29s. Rate: 9.4 symbols/min [2025-09-15T21:05:30.063164] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-15T21:05:30.151458] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:30.168944] [DEBUG] [LOCAL ] WOR: Loaded 16996 existing records from primary storage. [2025-09-15T21:05:30.169086] [INFO ] [MAIN ] WOR: Loaded 16996 existing records. [2025-09-15T21:05:30.345023] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:30.345270] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-15T21:05:30.345317] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-15T21:05:30.345888] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-15T21:05:30.345939] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-15T21:05:30.698992] [INFO ] [REMOTE ] WOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:30.857875] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-15T21:05:30.967995] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-15T21:05:31.657886] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-15T21:05:31.824118] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T21:05:32.007981] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T21:05:32.457898] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-15T21:05:33.257900] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-15T21:05:33.730719] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T21:05:33.734738] [INFO ] [REMOTE ] WNC: Full fetch complete (44600 records). [2025-09-15T21:05:33.734859] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-15T21:05:34.065442] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-15T21:05:34.113388] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-15T21:05:34.113484] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-15T21:05:34.114620] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-15T21:05:34.114710] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-15T21:05:34.116066] [DEBUG] [LOCAL ] WNC: Trimmed 44600 records to 28633 (keeping 150 days of data) [2025-09-15T21:05:34.242929] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-15T21:05:34.336015] [DEBUG] [LOCAL ] WNC: Primary data saved (28633 records). [2025-09-15T21:05:34.336440] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-15T21:05:34.336624] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WNC took 29.9s. Estimated remaining: 6m 23s. Rate: 9.4 symbols/min [2025-09-15T21:05:34.514140] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:34.535851] [DEBUG] [LOCAL ] WOW: Loaded 21967 existing records from primary storage. [2025-09-15T21:05:34.536017] [INFO ] [MAIN ] WOW: Loaded 21967 existing records. [2025-09-15T21:05:34.763580] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:34.763932] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-15T21:05:34.763984] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-15T21:05:34.764595] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-15T21:05:34.764668] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-15T21:05:34.861754] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-15T21:05:34.991883] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T21:05:35.163246] [INFO ] [REMOTE ] WOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:35.327209] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T21:05:35.657886] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-15T21:05:36.457903] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-15T21:05:36.588328] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T21:05:37.257929] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-15T21:05:37.437834] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-15T21:05:37.816383] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T21:05:38.057878] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-15T21:05:38.226106] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T21:05:38.230365] [INFO ] [REMOTE ] WNS: Full fetch complete (42294 records). [2025-09-15T21:05:38.230447] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-15T21:05:38.617423] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-15T21:05:38.617624] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-15T21:05:38.618565] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-15T21:05:38.618613] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-15T21:05:38.619614] [DEBUG] [LOCAL ] WNS: Trimmed 42294 records to 29830 (keeping 150 days of data) [2025-09-15T21:05:38.807513] [DEBUG] [LOCAL ] WNS: Primary data saved (29830 records). [2025-09-15T21:05:38.807674] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-15T21:05:38.807796] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WNS took 25.7s. Estimated remaining: 6m 16s. Rate: 9.4 symbols/min [2025-09-15T21:05:38.865518] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-15T21:05:38.989145] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:39.025441] [DEBUG] [LOCAL ] WPC: Loaded 36364 existing records from primary storage. [2025-09-15T21:05:39.025585] [INFO ] [MAIN ] WPC: Loaded 36364 existing records. [2025-09-15T21:05:39.208631] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:39.209097] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-15T21:05:39.209151] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-15T21:05:39.210520] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-15T21:05:39.210577] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-15T21:05:39.573320] [INFO ] [REMOTE ] WPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:39.657926] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-15T21:05:40.070662] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T21:05:40.159078] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-15T21:05:40.457874] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-15T21:05:40.976635] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T21:05:41.257864] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-15T21:05:41.828872] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T21:05:42.057900] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-15T21:05:42.384419] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T21:05:42.857889] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-15T21:05:43.636859] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T21:05:43.657831] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-15T21:05:44.457877] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-15T21:05:44.874862] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-15T21:05:44.883743] [INFO ] [REMOTE ] WOLF: Full fetch complete (58210 records). [2025-09-15T21:05:44.883955] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-15T21:05:45.261178] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-15T21:05:45.276463] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-15T21:05:45.276537] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-15T21:05:45.277751] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-15T21:05:45.277881] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-15T21:05:45.279270] [DEBUG] [LOCAL ] WOLF: Trimmed 58210 records to 39499 (keeping 150 days of data) [2025-09-15T21:05:45.522746] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T21:05:45.562143] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T21:05:45.595669] [DEBUG] [LOCAL ] WOLF: Primary data saved (39499 records). [2025-09-15T21:05:45.595857] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-15T21:05:45.597707] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WOLF took 27.9s. Estimated remaining: 6m 10s. Rate: 9.4 symbols/min [2025-09-15T21:05:45.774776] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:45.819026] [DEBUG] [LOCAL ] WPM: Loaded 39617 existing records from primary storage. [2025-09-15T21:05:45.819198] [INFO ] [MAIN ] WPM: Loaded 39617 existing records. [2025-09-15T21:05:45.998464] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:45.998801] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-15T21:05:45.998866] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-15T21:05:45.999878] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-15T21:05:45.999946] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-15T21:05:46.069527] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-15T21:05:46.408007] [INFO ] [REMOTE ] WPM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:46.432881] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T21:05:46.857913] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-15T21:05:47.657942] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-15T21:05:47.818028] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T21:05:47.868097] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T21:05:48.457844] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-15T21:05:48.829537] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T21:05:49.257880] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-15T21:05:50.057865] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-15T21:05:50.242979] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T21:05:50.857834] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-15T21:05:50.955532] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T21:05:50.980945] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T21:05:51.523370] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T21:05:51.526034] [INFO ] [REMOTE ] WOR: Full fetch complete (27177 records). [2025-09-15T21:05:51.526191] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-15T21:05:51.664558] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-15T21:05:51.890429] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-15T21:05:51.890546] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-15T21:05:51.891536] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-15T21:05:51.891583] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-15T21:05:51.892657] [DEBUG] [LOCAL ] WOR: Trimmed 27177 records to 16653 (keeping 150 days of data) [2025-09-15T21:05:52.002777] [DEBUG] [LOCAL ] WOR: Primary data saved (16653 records). [2025-09-15T21:05:52.002972] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-15T21:05:52.003077] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOR took 22.0s. Estimated remaining: 6m 4s. Rate: 9.4 symbols/min [2025-09-15T21:05:52.176732] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:05:52.205430] [DEBUG] [LOCAL ] WPP: Loaded 24946 existing records from primary storage. [2025-09-15T21:05:52.205653] [INFO ] [MAIN ] WPP: Loaded 24946 existing records. [2025-09-15T21:05:52.387539] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:05:52.387861] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-15T21:05:52.387933] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-15T21:05:52.388534] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-15T21:05:52.388604] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-15T21:05:52.463067] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-15T21:05:52.759626] [INFO ] [REMOTE ] WPP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:05:53.257882] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-15T21:05:53.428953] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T21:05:53.808178] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T21:05:54.057865] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-15T21:05:54.249321] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T21:05:54.857869] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-15T21:05:55.657855] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-15T21:05:55.874176] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T21:05:55.933439] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T21:05:56.457871] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-15T21:05:57.257878] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-15T21:05:57.336738] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T21:05:58.057869] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-15T21:05:58.372334] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T21:05:58.825410] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T21:05:58.857903] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-15T21:05:59.334754] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T21:05:59.341421] [INFO ] [REMOTE ] WOW: Full fetch complete (31604 records). [2025-09-15T21:05:59.341597] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-15T21:05:59.663109] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-15T21:05:59.831357] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-15T21:05:59.831443] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-15T21:05:59.832199] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-15T21:05:59.832253] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-15T21:05:59.833144] [DEBUG] [LOCAL ] WOW: Trimmed 31604 records to 21693 (keeping 150 days of data) [2025-09-15T21:05:59.964554] [DEBUG] [LOCAL ] WOW: Primary data saved (21693 records). [2025-09-15T21:05:59.964707] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-15T21:05:59.964816] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WOW took 25.6s. Estimated remaining: 5m 57s. Rate: 9.4 symbols/min [2025-09-15T21:06:00.173814] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:00.209774] [DEBUG] [LOCAL ] WRB: Loaded 37918 existing records from primary storage. [2025-09-15T21:06:00.209941] [INFO ] [MAIN ] WRB: Loaded 37918 existing records. [2025-09-15T21:06:00.390067] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:00.390395] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-15T21:06:00.390630] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-15T21:06:00.396782] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-15T21:06:00.405454] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-15T21:06:00.438050] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T21:06:00.469334] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-15T21:06:00.510452] [INFO ] [REMOTE ] WPC: Full fetch complete (53232 records). [2025-09-15T21:06:00.524922] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-15T21:06:01.086268] [INFO ] [REMOTE ] WRB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:01.187296] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-15T21:06:01.187387] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-15T21:06:01.188374] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-15T21:06:01.188431] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-15T21:06:01.189596] [DEBUG] [LOCAL ] WPC: Trimmed 53232 records to 35651 (keeping 150 days of data) [2025-09-15T21:06:01.286696] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-15T21:06:01.436964] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T21:06:01.466876] [DEBUG] [LOCAL ] WPC: Primary data saved (35651 records). [2025-09-15T21:06:01.467012] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-15T21:06:01.467093] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WPC took 22.7s. Estimated remaining: 5m 51s. Rate: 9.4 symbols/min [2025-09-15T21:06:01.642307] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:01.679341] [DEBUG] [LOCAL ] WRBY: Loaded 38047 existing records from primary storage. [2025-09-15T21:06:01.679535] [INFO ] [MAIN ] WRBY: Loaded 38047 existing records. [2025-09-15T21:06:01.868305] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:01.868690] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-15T21:06:01.868756] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-15T21:06:01.869702] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-15T21:06:01.869771] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-15T21:06:02.089966] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-15T21:06:02.242055] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:02.857934] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-15T21:06:03.234005] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-15T21:06:03.657933] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-15T21:06:03.969145] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-15T21:06:04.457929] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-15T21:06:05.366772] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (3.28 seconds). [2025-09-15T21:06:05.373219] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-15T21:06:06.027818] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-09-15T21:06:06.057833] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-15T21:06:06.139789] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-15T21:06:06.204847] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T21:06:06.820185] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T21:06:06.857869] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-15T21:06:07.556156] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T21:06:07.657896] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-15T21:06:08.398339] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T21:06:08.457889] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-15T21:06:09.257893] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-15T21:06:09.485673] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T21:06:10.057885] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-15T21:06:10.115150] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T21:06:10.857916] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-15T21:06:11.098809] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T21:06:11.657894] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-15T21:06:11.851835] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T21:06:11.873176] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T21:06:11.877060] [INFO ] [REMOTE ] WPP: Full fetch complete (35420 records). [2025-09-15T21:06:11.877178] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-15T21:06:12.254728] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-15T21:06:12.254827] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-15T21:06:12.255537] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-15T21:06:12.255632] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-15T21:06:12.256592] [DEBUG] [LOCAL ] WPP: Trimmed 35420 records to 24616 (keeping 150 days of data) [2025-09-15T21:06:12.407944] [DEBUG] [LOCAL ] WPP: Primary data saved (24616 records). [2025-09-15T21:06:12.408090] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-15T21:06:12.408179] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPP took 20.4s. Estimated remaining: 5m 45s. Rate: 9.4 symbols/min [2025-09-15T21:06:12.470212] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-15T21:06:12.580801] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:12.596793] [DEBUG] [LOCAL ] WS: Loaded 16988 existing records from primary storage. [2025-09-15T21:06:12.596919] [INFO ] [MAIN ] WS: Loaded 16988 existing records. [2025-09-15T21:06:12.780221] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:12.780511] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-15T21:06:12.780561] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-15T21:06:12.781105] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-15T21:06:12.781158] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-15T21:06:13.163867] [INFO ] [REMOTE ] WS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:13.257893] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-15T21:06:13.777936] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-15T21:06:14.057923] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-15T21:06:14.857930] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-15T21:06:15.173458] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T21:06:15.657912] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-15T21:06:15.929980] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (3.46 seconds). [2025-09-15T21:06:16.303943] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-15T21:06:16.457889] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-15T21:06:16.992661] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-15T21:06:17.021351] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T21:06:17.257898] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-15T21:06:18.057885] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-15T21:06:18.122163] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T21:06:18.877313] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-15T21:06:18.906811] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T21:06:19.517984] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T21:06:19.657864] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-15T21:06:19.812299] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T21:06:20.457939] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-15T21:06:21.257950] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-15T21:06:21.505168] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T21:06:22.057880] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-15T21:06:22.097196] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T21:06:22.103782] [INFO ] [REMOTE ] WPM: Full fetch complete (57305 records). [2025-09-15T21:06:22.104023] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-15T21:06:22.453127] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T21:06:22.534944] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-15T21:06:22.535099] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-15T21:06:22.537803] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-15T21:06:22.537892] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-15T21:06:22.540040] [DEBUG] [LOCAL ] WPM: Trimmed 57305 records to 38840 (keeping 150 days of data) [2025-09-15T21:06:22.808928] [DEBUG] [LOCAL ] WPM: Primary data saved (38840 records). [2025-09-15T21:06:22.809112] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-15T21:06:22.810101] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPM took 37.2s. Estimated remaining: 5m 38s. Rate: 9.4 symbols/min [2025-09-15T21:06:22.865008] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-15T21:06:22.985369] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:23.028517] [DEBUG] [LOCAL ] WSM: Loaded 37328 existing records from primary storage. [2025-09-15T21:06:23.028689] [INFO ] [MAIN ] WSM: Loaded 37328 existing records. [2025-09-15T21:06:23.235872] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:23.236145] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-15T21:06:23.236191] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-15T21:06:23.237046] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-15T21:06:23.237096] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-15T21:06:23.597912] [INFO ] [REMOTE ] WSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:23.657861] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-15T21:06:23.755207] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T21:06:23.885525] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T21:06:24.457880] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-15T21:06:24.766113] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T21:06:24.771805] [INFO ] [REMOTE ] WRBY: Full fetch complete (55247 records). [2025-09-15T21:06:24.771932] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-15T21:06:25.177434] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-15T21:06:25.177568] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-15T21:06:25.180921] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-15T21:06:25.181039] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-15T21:06:25.183351] [DEBUG] [LOCAL ] WRBY: Trimmed 55247 records to 37252 (keeping 150 days of data) [2025-09-15T21:06:25.280756] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-15T21:06:25.437054] [DEBUG] [LOCAL ] WRBY: Primary data saved (37252 records). [2025-09-15T21:06:25.437299] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-15T21:06:25.437482] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WRBY took 24.0s. Estimated remaining: 5m 32s. Rate: 9.4 symbols/min [2025-09-15T21:06:25.878884] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T21:06:26.057881] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-15T21:06:26.679563] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T21:06:26.686853] [INFO ] [REMOTE ] WRB: Full fetch complete (54995 records). [2025-09-15T21:06:26.687040] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-15T21:06:26.870394] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-15T21:06:27.098600] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-15T21:06:27.098709] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-15T21:06:27.099698] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-15T21:06:27.099744] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-15T21:06:27.102221] [DEBUG] [LOCAL ] WRB: Trimmed 54995 records to 37168 (keeping 150 days of data) [2025-09-15T21:06:27.255959] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T21:06:27.367686] [DEBUG] [LOCAL ] WRB: Primary data saved (37168 records). [2025-09-15T21:06:27.367857] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-15T21:06:27.368477] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WRB took 27.4s. Estimated remaining: 5m 25s. Rate: 9.4 symbols/min [2025-09-15T21:06:27.657848] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-15T21:06:28.791023] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T21:06:28.796003] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-15T21:06:28.932225] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T21:06:29.257966] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-15T21:06:29.740938] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T21:06:29.743707] [INFO ] [REMOTE ] WS: Full fetch complete (26334 records). [2025-09-15T21:06:29.743797] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-15T21:06:30.132131] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-15T21:06:30.132237] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-15T21:06:30.133133] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-15T21:06:30.133189] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-15T21:06:30.134224] [DEBUG] [LOCAL ] WS: Trimmed 26334 records to 16722 (keeping 150 days of data) [2025-09-15T21:06:30.251982] [DEBUG] [LOCAL ] WS: Primary data saved (16722 records). [2025-09-15T21:06:30.252209] [INFO ] [MAIN ] WS: Full history saved. [2025-09-15T21:06:30.252343] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WS took 17.8s. Estimated remaining: 5m 19s. Rate: 9.4 symbols/min [2025-09-15T21:06:31.200193] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T21:06:31.212453] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-15T21:06:33.026698] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T21:06:33.038892] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-15T21:06:34.880485] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T21:06:34.891889] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-15T21:06:36.822294] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T21:06:36.834119] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-15T21:06:38.397955] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T21:06:38.408969] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-15T21:06:39.946402] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T21:06:39.952973] [INFO ] [REMOTE ] WSM: Full fetch complete (54306 records). [2025-09-15T21:06:39.953222] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-15T21:06:40.415191] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-15T21:06:40.415405] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-15T21:06:40.416854] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-15T21:06:40.416934] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-15T21:06:40.420156] [DEBUG] [LOCAL ] WSM: Trimmed 54306 records to 36548 (keeping 150 days of data) [2025-09-15T21:06:40.678216] [DEBUG] [LOCAL ] WSM: Primary data saved (36548 records). [2025-09-15T21:06:40.678438] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-15T21:06:40.679857] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 17.9s. Estimated remaining: 5m 13s. Rate: 9.4 symbols/min [2025-09-15T21:06:41.448208] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:41.388879] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:41.474706] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:41.581821] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:41.607484] [DEBUG] [LOCAL ] WSR: Loaded 16972 existing records from primary storage. [2025-09-15T21:06:41.608251] [INFO ] [MAIN ] WSR: Loaded 16972 existing records. [2025-09-15T21:06:41.744526] [DEBUG] [LOCAL ] WST: Loaded 27474 existing records from primary storage. [2025-09-15T21:06:41.777574] [INFO ] [MAIN ] WST: Loaded 27474 existing records. [2025-09-15T21:06:41.807070] [DEBUG] [LOCAL ] WT: Loaded 35535 existing records from primary storage. [2025-09-15T21:06:41.824450] [INFO ] [MAIN ] WT: Loaded 35535 existing records. [2025-09-15T21:06:41.813871] [DEBUG] [LOCAL ] WSO: Loaded 18603 existing records from primary storage. [2025-09-15T21:06:41.935527] [INFO ] [MAIN ] WSO: Loaded 18603 existing records. [2025-09-15T21:06:42.014216] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:42.167764] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-15T21:06:42.280397] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-15T21:06:42.364290] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-15T21:06:42.510873] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-15T21:06:42.510417] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:42.510660] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:42.510778] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:42.516664] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-15T21:06:42.552468] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-15T21:06:42.581379] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-15T21:06:42.552378] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-15T21:06:42.597232] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-15T21:06:42.591997] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-15T21:06:42.602540] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-15T21:06:42.592086] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-15T21:06:42.654543] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-15T21:06:42.654605] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-15T21:06:42.670814] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-15T21:06:42.693176] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-15T21:06:43.649616] [INFO ] [REMOTE ] WSR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:43.693022] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-15T21:06:43.880531] [INFO ] [REMOTE ] WT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:43.903480] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-15T21:06:44.107753] [INFO ] [REMOTE ] WST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:44.111727] [INFO ] [REMOTE ] WSO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:44.112270] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-15T21:06:44.112080] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-15T21:06:44.995153] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T21:06:44.999482] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-15T21:06:45.406106] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T21:06:45.411259] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-15T21:06:45.454847] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T21:06:45.463094] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-15T21:06:45.598942] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T21:06:45.607827] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-15T21:06:45.845144] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T21:06:45.851084] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-15T21:06:46.561444] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T21:06:46.568147] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-15T21:06:46.750364] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T21:06:46.756215] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-15T21:06:46.932433] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T21:06:46.941895] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-15T21:06:46.970761] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T21:06:46.981188] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-15T21:06:47.772417] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T21:06:47.778466] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-15T21:06:48.037011] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T21:06:48.043033] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-15T21:06:48.352530] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T21:06:48.362832] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-15T21:06:48.440447] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T21:06:48.450022] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-15T21:06:49.039445] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T21:06:49.045426] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-15T21:06:49.109519] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T21:06:49.115012] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-15T21:06:49.708080] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T21:06:49.716376] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-15T21:06:49.742159] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T21:06:50.046608] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T21:06:50.057805] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-15T21:06:50.260464] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T21:06:50.857895] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-15T21:06:50.957459] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T21:06:51.287829] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T21:06:51.657888] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-15T21:06:52.365718] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T21:06:52.457900] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-15T21:06:52.590941] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T21:06:52.594701] [INFO ] [REMOTE ] WSR: Full fetch complete (25105 records). [2025-09-15T21:06:52.594876] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-15T21:06:53.086324] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-15T21:06:53.086430] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-15T21:06:53.087053] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-15T21:06:53.087112] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-15T21:06:53.088049] [DEBUG] [LOCAL ] WSR: Trimmed 25105 records to 16664 (keeping 150 days of data) [2025-09-15T21:06:53.201486] [DEBUG] [LOCAL ] WSR: Primary data saved (16664 records). [2025-09-15T21:06:53.201687] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-15T21:06:53.201829] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WSR took 12.5s. Estimated remaining: 5m 6s. Rate: 9.4 symbols/min [2025-09-15T21:06:53.265791] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-15T21:06:53.376548] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:53.410720] [DEBUG] [LOCAL ] WTI: Loaded 33126 existing records from primary storage. [2025-09-15T21:06:53.410873] [INFO ] [MAIN ] WTI: Loaded 33126 existing records. [2025-09-15T21:06:53.588202] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:06:53.588456] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-15T21:06:53.588501] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-15T21:06:53.589253] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-15T21:06:53.589305] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-15T21:06:53.943605] [INFO ] [REMOTE ] WTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:54.057869] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-15T21:06:54.233176] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T21:06:54.857901] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-15T21:06:55.008384] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T21:06:55.249775] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T21:06:55.657885] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-15T21:06:55.798249] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T21:06:56.457885] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-15T21:06:56.815697] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T21:06:57.257853] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-15T21:06:57.936622] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T21:06:58.057868] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-15T21:06:58.331737] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T21:06:58.335779] [INFO ] [REMOTE ] WST: Full fetch complete (42325 records). [2025-09-15T21:06:58.335879] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-15T21:06:58.726472] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-15T21:06:58.726569] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-15T21:06:58.727435] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-15T21:06:58.727487] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-15T21:06:58.728587] [DEBUG] [LOCAL ] WST: Trimmed 42325 records to 26781 (keeping 150 days of data) [2025-09-15T21:06:58.874631] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-15T21:06:58.901846] [DEBUG] [LOCAL ] WST: Primary data saved (26781 records). [2025-09-15T21:06:58.902019] [INFO ] [MAIN ] WST: Full history saved. [2025-09-15T21:06:58.902138] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WST took 18.2s. Estimated remaining: 4m 60s. Rate: 9.4 symbols/min [2025-09-15T21:06:59.080544] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:06:59.080782] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-15T21:06:59.080823] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-15T21:06:59.080949] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-15T21:06:59.080989] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-15T21:06:59.081029] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-15T21:06:59.081061] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-15T21:06:59.436844] [INFO ] [REMOTE ] WTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:06:59.465719] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T21:06:59.657921] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-15T21:07:00.457938] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-15T21:07:00.595502] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T21:07:00.664377] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T21:07:00.946510] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T21:07:01.257895] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-15T21:07:02.057939] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-15T21:07:02.483149] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T21:07:02.716125] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T21:07:02.721824] [INFO ] [REMOTE ] WT: Full fetch complete (51497 records). [2025-09-15T21:07:02.721982] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-15T21:07:02.862964] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-15T21:07:03.103879] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-15T21:07:03.104005] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-15T21:07:03.105085] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-15T21:07:03.105143] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-15T21:07:03.106279] [DEBUG] [LOCAL ] WT: Trimmed 51497 records to 34911 (keeping 150 days of data) [2025-09-15T21:07:03.330742] [DEBUG] [LOCAL ] WT: Primary data saved (34911 records). [2025-09-15T21:07:03.330895] [INFO ] [MAIN ] WT: Full history saved. [2025-09-15T21:07:03.330982] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WT took 22.6s. Estimated remaining: 4m 53s. Rate: 9.4 symbols/min [2025-09-15T21:07:03.497944] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:03.534999] [DEBUG] [LOCAL ] WTRG: Loaded 38237 existing records from primary storage. [2025-09-15T21:07:03.535144] [INFO ] [MAIN ] WTRG: Loaded 38237 existing records. [2025-09-15T21:07:03.673471] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-15T21:07:03.710031] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:03.710241] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-15T21:07:03.710292] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-15T21:07:03.711060] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-15T21:07:03.711110] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-15T21:07:04.106056] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:04.281377] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T21:07:04.457942] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-15T21:07:04.788149] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T21:07:04.912384] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T21:07:05.257907] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-15T21:07:06.057924] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-15T21:07:06.535704] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T21:07:06.863035] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-15T21:07:06.878718] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T21:07:07.456298] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T21:07:07.657901] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-15T21:07:08.458019] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-15T21:07:08.924062] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T21:07:09.148609] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T21:07:09.257894] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-15T21:07:09.790982] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T21:07:09.792130] [INFO ] [REMOTE ] WTM: Full fetch complete (1732 records). [2025-09-15T21:07:09.792209] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-15T21:07:09.971737] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T21:07:09.971933] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:07:09.971981] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:07:09.972028] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-15T21:07:09.972106] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-15T21:07:09.972144] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-15T21:07:09.972197] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-15T21:07:09.972299] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WTM took 11.1s. Estimated remaining: 4m 47s. Rate: 9.4 symbols/min [2025-09-15T21:07:10.063090] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-15T21:07:10.156392] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:10.173053] [DEBUG] [LOCAL ] WTS: Loaded 13781 existing records from primary storage. [2025-09-15T21:07:10.173238] [INFO ] [MAIN ] WTS: Loaded 13781 existing records. [2025-09-15T21:07:10.354991] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:10.355339] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-15T21:07:10.355393] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-15T21:07:10.355954] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-15T21:07:10.356009] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-15T21:07:10.706955] [INFO ] [REMOTE ] WTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:10.857930] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-15T21:07:11.658217] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-15T21:07:12.044004] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T21:07:12.065819] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T21:07:12.069949] [INFO ] [REMOTE ] WSO: Full fetch complete (26876 records). [2025-09-15T21:07:12.070038] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-15T21:07:12.452300] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-15T21:07:12.452400] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-15T21:07:12.453551] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-15T21:07:12.453612] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-15T21:07:12.454502] [DEBUG] [LOCAL ] WSO: Trimmed 26876 records to 18371 (keeping 150 days of data) [2025-09-15T21:07:12.506824] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-15T21:07:12.583705] [DEBUG] [LOCAL ] WSO: Primary data saved (18371 records). [2025-09-15T21:07:12.584630] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-15T21:07:12.584782] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WSO took 31.9s. Estimated remaining: 4m 41s. Rate: 9.4 symbols/min [2025-09-15T21:07:12.760171] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:12.798282] [DEBUG] [LOCAL ] WTTR: Loaded 32906 existing records from primary storage. [2025-09-15T21:07:12.798506] [INFO ] [MAIN ] WTTR: Loaded 32906 existing records. [2025-09-15T21:07:12.982674] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:12.983053] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-15T21:07:12.983113] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-15T21:07:12.983957] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-15T21:07:12.984015] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-15T21:07:13.263219] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-15T21:07:13.349840] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:13.400065] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T21:07:13.754928] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T21:07:14.057889] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-15T21:07:14.857904] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-15T21:07:15.090782] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T21:07:15.121786] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T21:07:15.657911] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-15T21:07:16.457929] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-15T21:07:16.506184] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T21:07:16.882433] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T21:07:17.257940] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-15T21:07:18.057875] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-15T21:07:18.181212] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T21:07:18.606393] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T21:07:18.612666] [INFO ] [REMOTE ] WTI: Full fetch complete (47099 records). [2025-09-15T21:07:18.612800] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-15T21:07:18.866398] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-15T21:07:19.000882] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-15T21:07:19.001015] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-15T21:07:19.001995] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-15T21:07:19.002041] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-15T21:07:19.003159] [DEBUG] [LOCAL ] WTI: Trimmed 47099 records to 32570 (keeping 150 days of data) [2025-09-15T21:07:19.203239] [DEBUG] [LOCAL ] WTI: Primary data saved (32570 records). [2025-09-15T21:07:19.203412] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-15T21:07:19.204271] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTI took 26.0s. Estimated remaining: 4m 34s. Rate: 9.4 symbols/min [2025-09-15T21:07:19.379852] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:19.425973] [DEBUG] [LOCAL ] WU: Loaded 40254 existing records from primary storage. [2025-09-15T21:07:19.426182] [INFO ] [MAIN ] WU: Loaded 40254 existing records. [2025-09-15T21:07:19.607800] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:19.608736] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-15T21:07:19.608993] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-15T21:07:19.609988] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-15T21:07:19.610056] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-15T21:07:19.669087] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-15T21:07:19.957577] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T21:07:20.079624] [INFO ] [REMOTE ] WU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:20.096824] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T21:07:20.457902] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-15T21:07:21.257934] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-15T21:07:21.383589] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T21:07:21.513308] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T21:07:22.057903] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-15T21:07:22.577976] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T21:07:22.857919] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-15T21:07:23.641126] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T21:07:23.657830] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-15T21:07:24.447298] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T21:07:24.457820] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-15T21:07:25.159729] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T21:07:25.257852] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-15T21:07:26.052552] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T21:07:26.060548] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-15T21:07:26.857847] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-15T21:07:26.929628] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T21:07:27.183990] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T21:07:27.657907] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-15T21:07:28.342890] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T21:07:28.457856] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-15T21:07:29.257947] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-15T21:07:29.561843] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T21:07:30.027783] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T21:07:30.052611] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T21:07:30.057807] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-15T21:07:30.857905] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-15T21:07:31.011061] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T21:07:31.657932] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-15T21:07:32.212689] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T21:07:32.217840] [INFO ] [REMOTE ] WTTR: Full fetch complete (49168 records). [2025-09-15T21:07:32.217956] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-15T21:07:32.465758] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-15T21:07:32.525109] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T21:07:32.603346] [INFO ] [REMOTE ] WTS: Full fetch complete (20500 records). [2025-09-15T21:07:32.607782] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-15T21:07:32.619870] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-15T21:07:32.620061] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-15T21:07:32.621104] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-15T21:07:32.663771] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-15T21:07:32.747924] [DEBUG] [LOCAL ] WTTR: Trimmed 49168 records to 32214 (keeping 150 days of data) [2025-09-15T21:07:33.111405] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-15T21:07:33.111509] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-15T21:07:33.112028] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-15T21:07:33.141679] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-15T21:07:33.169871] [DEBUG] [LOCAL ] WTS: Trimmed 20500 records to 13393 (keeping 150 days of data) [2025-09-15T21:07:33.268541] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-15T21:07:33.278254] [DEBUG] [LOCAL ] WTTR: Primary data saved (32214 records). [2025-09-15T21:07:33.279441] [DEBUG] [LOCAL ] WTS: Primary data saved (13393 records). [2025-09-15T21:07:33.279656] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-15T21:07:33.279757] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-15T21:07:33.279946] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTTR took 20.7s. Estimated remaining: 4m 28s. Rate: 9.4 symbols/min [2025-09-15T21:07:33.280237] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTS took 23.3s. Estimated remaining: 4m 22s. Rate: 9.4 symbols/min [2025-09-15T21:07:33.630310] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:33.638850] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:33.683104] [DEBUG] [LOCAL ] WWW: Loaded 36903 existing records from primary storage. [2025-09-15T21:07:33.683311] [INFO ] [MAIN ] WWW: Loaded 36903 existing records. [2025-09-15T21:07:33.796407] [DEBUG] [LOCAL ] WY: Loaded 40009 existing records from primary storage. [2025-09-15T21:07:33.812628] [INFO ] [MAIN ] WY: Loaded 40009 existing records. [2025-09-15T21:07:33.944679] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:33.977628] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-15T21:07:33.977727] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-15T21:07:33.983686] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-15T21:07:33.999028] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-15T21:07:34.139221] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:34.174535] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-15T21:07:34.174740] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-15T21:07:34.191695] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-15T21:07:34.251814] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-15T21:07:34.663880] [INFO ] [REMOTE ] WWW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:34.731391] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-15T21:07:34.818210] [INFO ] [REMOTE ] WY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:34.848732] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T21:07:34.859922] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-15T21:07:35.221520] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T21:07:35.657888] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-15T21:07:36.170944] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T21:07:36.350447] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T21:07:36.457866] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-15T21:07:37.257883] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-15T21:07:37.666111] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T21:07:38.057869] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-15T21:07:38.398235] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T21:07:38.604751] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T21:07:38.857885] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-15T21:07:39.636001] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T21:07:39.657824] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-15T21:07:40.457831] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-15T21:07:40.562211] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T21:07:41.215410] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T21:07:41.221113] [INFO ] [REMOTE ] WTRG: Full fetch complete (55379 records). [2025-09-15T21:07:41.221219] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-15T21:07:41.264001] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-15T21:07:41.595131] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-15T21:07:41.595213] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-15T21:07:41.596269] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-15T21:07:41.596317] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-15T21:07:41.597530] [DEBUG] [LOCAL ] WTRG: Trimmed 55379 records to 37524 (keeping 150 days of data) [2025-09-15T21:07:41.836174] [DEBUG] [LOCAL ] WTRG: Primary data saved (37524 records). [2025-09-15T21:07:41.836330] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-15T21:07:41.838132] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTRG took 38.5s. Estimated remaining: 4m 15s. Rate: 9.4 symbols/min [2025-09-15T21:07:42.008553] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:42.030135] [DEBUG] [LOCAL ] XFLT: Loaded 21846 existing records from primary storage. [2025-09-15T21:07:42.030295] [INFO ] [MAIN ] XFLT: Loaded 21846 existing records. [2025-09-15T21:07:42.061792] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-15T21:07:42.233266] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:42.236406] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-15T21:07:42.236735] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-15T21:07:42.237699] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T21:07:42.247493] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-15T21:07:42.247682] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-15T21:07:42.611117] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:42.857870] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-15T21:07:43.229071] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T21:07:43.657878] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-15T21:07:43.921988] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T21:07:44.195705] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T21:07:44.457892] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-15T21:07:45.125512] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T21:07:45.257957] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-15T21:07:45.530627] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T21:07:46.057870] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-15T21:07:46.593550] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T21:07:46.599408] [INFO ] [REMOTE ] WU: Full fetch complete (58099 records). [2025-09-15T21:07:46.599508] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-15T21:07:46.863041] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-15T21:07:46.978849] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-15T21:07:46.978930] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-15T21:07:46.979916] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-15T21:07:46.979961] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-15T21:07:46.981149] [DEBUG] [LOCAL ] WU: Trimmed 58099 records to 39483 (keeping 150 days of data) [2025-09-15T21:07:47.227105] [DEBUG] [LOCAL ] WU: Primary data saved (39483 records). [2025-09-15T21:07:47.227259] [INFO ] [MAIN ] WU: Full history saved. [2025-09-15T21:07:47.228211] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WU took 28.0s. Estimated remaining: 4m 9s. Rate: 9.4 symbols/min [2025-09-15T21:07:47.397312] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:47.432411] [DEBUG] [LOCAL ] XHR: Loaded 33041 existing records from primary storage. [2025-09-15T21:07:47.432581] [INFO ] [MAIN ] XHR: Loaded 33041 existing records. [2025-09-15T21:07:47.609130] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:47.609413] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-15T21:07:47.609464] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-15T21:07:47.610192] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-15T21:07:47.610245] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-15T21:07:47.664563] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-15T21:07:47.929552] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T21:07:48.015768] [INFO ] [REMOTE ] XHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:48.457894] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-15T21:07:48.866360] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T21:07:49.098903] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T21:07:49.257818] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-15T21:07:49.721912] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T21:07:50.057918] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-15T21:07:50.251414] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T21:07:50.857878] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-15T21:07:51.455353] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T21:07:51.657843] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-15T21:07:52.057756] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T21:07:52.457915] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-15T21:07:53.263151] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-15T21:07:53.278692] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T21:07:53.923277] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T21:07:54.057849] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-15T21:07:54.722673] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T21:07:54.857874] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-15T21:07:55.520555] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T21:07:55.657864] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-15T21:07:56.457874] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-15T21:07:56.533412] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T21:07:56.663623] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T21:07:57.153464] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T21:07:57.158894] [INFO ] [REMOTE ] WY: Full fetch complete (57303 records). [2025-09-15T21:07:57.158998] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-15T21:07:57.159790] [FATAL] [VALIDATOR ] WY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:07:57.159869] [FATAL] [MAIN ] WY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:07:57.159906] [WARN ] [MAIN ] WY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:07:57.159944] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-15T21:07:57.160012] [DEBUG] [LOCAL ] WY: No primary data file found to delete. [2025-09-15T21:07:57.160049] [INFO ] [LOCAL ] WY: Starting deletion of derivative data. [2025-09-15T21:07:57.160496] [DEBUG] [LOCAL ] WY: Deleted derivative data file. [2025-09-15T21:07:57.160589] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WY took 23.9s. Estimated remaining: 4m 2s. Rate: 9.4 symbols/min [2025-09-15T21:07:57.263286] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-15T21:07:57.336813] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:07:57.368670] [DEBUG] [LOCAL ] XIFR: Loaded 33416 existing records from primary storage. [2025-09-15T21:07:57.368825] [INFO ] [MAIN ] XIFR: Loaded 33416 existing records. [2025-09-15T21:07:57.553864] [WARN ] [MAIN ] XIFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:07:57.554220] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-15T21:07:57.554285] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-15T21:07:57.555121] [DEBUG] [LOCAL ] XIFR: Deleted primary data file. [2025-09-15T21:07:57.555198] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-15T21:07:57.927069] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:07:58.057843] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-15T21:07:58.857869] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-15T21:07:59.059722] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T21:07:59.458619] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T21:07:59.657844] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-15T21:07:59.937748] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T21:07:59.941087] [INFO ] [REMOTE ] XFLT: Full fetch complete (32346 records). [2025-09-15T21:07:59.941166] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-15T21:08:00.304481] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-15T21:08:00.304563] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-15T21:08:00.305273] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-15T21:08:00.305348] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-15T21:08:00.306134] [DEBUG] [LOCAL ] XFLT: Trimmed 32346 records to 21402 (keeping 150 days of data) [2025-09-15T21:08:00.446959] [DEBUG] [LOCAL ] XFLT: Primary data saved (21402 records). [2025-09-15T21:08:00.447111] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-15T21:08:00.447199] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. XFLT took 18.6s. Estimated remaining: 3m 56s. Rate: 9.4 symbols/min [2025-09-15T21:08:00.462263] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-15T21:08:00.663133] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:00.705884] [DEBUG] [LOCAL ] XOM: Loaded 40533 existing records from primary storage. [2025-09-15T21:08:00.706065] [INFO ] [MAIN ] XOM: Loaded 40533 existing records. [2025-09-15T21:08:00.884442] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:00.884765] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-15T21:08:00.884816] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-15T21:08:00.885783] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-15T21:08:00.885835] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-15T21:08:01.254453] [INFO ] [REMOTE ] XOM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:01.257818] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-15T21:08:01.557027] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T21:08:01.981340] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T21:08:02.057827] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-15T21:08:02.857912] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-15T21:08:03.572079] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-15T21:08:03.657894] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-15T21:08:03.709235] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T21:08:04.176899] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T21:08:04.182444] [INFO ] [REMOTE ] WWW: Full fetch complete (53428 records). [2025-09-15T21:08:04.182555] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-15T21:08:04.463010] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-15T21:08:04.576283] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-15T21:08:04.576381] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-15T21:08:04.577542] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-15T21:08:04.577593] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-15T21:08:04.578971] [DEBUG] [LOCAL ] WWW: Trimmed 53428 records to 36204 (keeping 150 days of data) [2025-09-15T21:08:04.801220] [DEBUG] [LOCAL ] WWW: Primary data saved (36204 records). [2025-09-15T21:08:04.801372] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-15T21:08:04.801458] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. WWW took 31.5s. Estimated remaining: 3m 50s. Rate: 9.4 symbols/min [2025-09-15T21:08:04.980090] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:05.001049] [DEBUG] [LOCAL ] XPER: Loaded 22174 existing records from primary storage. [2025-09-15T21:08:05.001214] [INFO ] [MAIN ] XPER: Loaded 22174 existing records. [2025-09-15T21:08:05.178564] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:05.178852] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-15T21:08:05.178898] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-15T21:08:05.179396] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-15T21:08:05.179444] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-15T21:08:05.267638] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-15T21:08:05.528210] [INFO ] [REMOTE ] XPER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:06.057947] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-15T21:08:06.106701] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-15T21:08:06.147947] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T21:08:06.857885] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-15T21:08:07.078177] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T21:08:07.205883] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T21:08:07.657940] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-15T21:08:08.434421] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T21:08:08.457840] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-15T21:08:09.257936] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-15T21:08:09.647307] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T21:08:09.652047] [INFO ] [REMOTE ] XHR: Full fetch complete (48014 records). [2025-09-15T21:08:09.652136] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-15T21:08:10.029337] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-15T21:08:10.029431] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-15T21:08:10.030513] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-15T21:08:10.030616] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-15T21:08:10.031810] [DEBUG] [LOCAL ] XHR: Trimmed 48014 records to 32506 (keeping 150 days of data) [2025-09-15T21:08:10.103921] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-15T21:08:10.277072] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T21:08:10.325097] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-15T21:08:10.352070] [DEBUG] [LOCAL ] XHR: Primary data saved (32506 records). [2025-09-15T21:08:10.352211] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-15T21:08:10.352868] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. XHR took 23.1s. Estimated remaining: 3m 43s. Rate: 9.4 symbols/min [2025-09-15T21:08:10.523721] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:10.566636] [DEBUG] [LOCAL ] XPEV: Loaded 40389 existing records from primary storage. [2025-09-15T21:08:10.566817] [INFO ] [MAIN ] XPEV: Loaded 40389 existing records. [2025-09-15T21:08:10.750856] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:10.751165] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-15T21:08:10.751212] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-15T21:08:10.751956] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-15T21:08:10.752012] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-15T21:08:10.862937] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-15T21:08:11.125457] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:11.657878] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-15T21:08:11.843232] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T21:08:12.457897] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-15T21:08:13.260093] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-15T21:08:13.268167] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-15T21:08:13.602259] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T21:08:13.712260] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T21:08:14.057866] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-15T21:08:14.678899] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T21:08:14.857873] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-15T21:08:15.261854] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T21:08:15.657887] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-15T21:08:16.457890] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-15T21:08:16.613989] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T21:08:17.257934] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-15T21:08:18.057885] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-15T21:08:18.222728] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-15T21:08:18.703629] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-15T21:08:18.857864] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-15T21:08:19.025965] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T21:08:19.325438] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T21:08:19.657893] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-15T21:08:20.457898] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-15T21:08:20.748098] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T21:08:21.107523] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-15T21:08:21.257864] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-15T21:08:21.431094] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T21:08:21.436731] [INFO ] [REMOTE ] XIFR: Full fetch complete (50382 records). [2025-09-15T21:08:21.436872] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-15T21:08:21.807315] [DEBUG] [VALIDATOR ] XIFR: All expected trading days are present. [2025-09-15T21:08:21.807413] [DEBUG] [VALIDATOR ] XIFR: Primary data validation passed. [2025-09-15T21:08:21.808411] [INFO ] [MAIN ] XIFR: Fetched primary data is valid. [2025-09-15T21:08:21.808470] [DEBUG] [LOCAL ] XIFR: Saving primary data. [2025-09-15T21:08:21.809707] [DEBUG] [LOCAL ] XIFR: Trimmed 50382 records to 32769 (keeping 150 days of data) [2025-09-15T21:08:22.013529] [DEBUG] [LOCAL ] XIFR: Primary data saved (32769 records). [2025-09-15T21:08:22.013738] [INFO ] [MAIN ] XIFR: Full history saved. [2025-09-15T21:08:22.013906] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XIFR took 24.9s. Estimated remaining: 3m 37s. Rate: 9.4 symbols/min [2025-09-15T21:08:22.068837] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-15T21:08:22.185764] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:22.222144] [DEBUG] [LOCAL ] XPO: Loaded 35942 existing records from primary storage. [2025-09-15T21:08:22.222299] [INFO ] [MAIN ] XPO: Loaded 35942 existing records. [2025-09-15T21:08:22.397876] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:22.398261] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-15T21:08:22.398391] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-15T21:08:22.406131] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-15T21:08:22.417899] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-15T21:08:22.442356] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T21:08:22.782581] [INFO ] [REMOTE ] XPO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:22.857885] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-15T21:08:23.657861] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-15T21:08:23.901899] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T21:08:23.905997] [INFO ] [REMOTE ] XPER: Full fetch complete (32383 records). [2025-09-15T21:08:23.906114] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-15T21:08:24.281634] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-15T21:08:24.281749] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-15T21:08:24.282453] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-15T21:08:24.282504] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-15T21:08:24.283655] [DEBUG] [LOCAL ] XPER: Trimmed 32383 records to 21716 (keeping 150 days of data) [2025-09-15T21:08:24.415395] [DEBUG] [LOCAL ] XPER: Primary data saved (21716 records). [2025-09-15T21:08:24.415527] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-15T21:08:24.415669] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XPER took 19.6s. Estimated remaining: 3m 31s. Rate: 9.4 symbols/min [2025-09-15T21:08:24.477659] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-15T21:08:24.587883] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:24.621928] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-15T21:08:24.655040] [DEBUG] [LOCAL ] XPOF: Loaded 28475 existing records from primary storage. [2025-09-15T21:08:24.655179] [INFO ] [MAIN ] XPOF: Loaded 28475 existing records. [2025-09-15T21:08:24.833326] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:24.833612] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-15T21:08:24.833679] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-15T21:08:24.834333] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-15T21:08:24.834383] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-15T21:08:25.187979] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:25.257878] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-15T21:08:25.336579] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T21:08:26.057871] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-15T21:08:26.442306] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T21:08:26.857910] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-15T21:08:27.004806] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T21:08:27.092205] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-15T21:08:27.657883] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-15T21:08:28.130160] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T21:08:28.136651] [INFO ] [REMOTE ] XOM: Full fetch complete (58083 records). [2025-09-15T21:08:28.136793] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-15T21:08:28.138157] [FATAL] [VALIDATOR ] XOM: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:08:28.138313] [FATAL] [MAIN ] XOM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:08:28.138401] [WARN ] [MAIN ] XOM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:08:28.138467] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-15T21:08:28.138557] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-15T21:08:28.138611] [INFO ] [LOCAL ] XOM: Starting deletion of derivative data. [2025-09-15T21:08:28.139016] [DEBUG] [LOCAL ] XOM: Deleted derivative data file. [2025-09-15T21:08:28.139760] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XOM took 27.7s. Estimated remaining: 3m 24s. Rate: 9.4 symbols/min [2025-09-15T21:08:28.308798] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:28.352842] [DEBUG] [LOCAL ] XPRO: Loaded 34357 existing records from primary storage. [2025-09-15T21:08:28.352986] [INFO ] [MAIN ] XPRO: Loaded 34357 existing records. [2025-09-15T21:08:28.462610] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-15T21:08:28.532828] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:28.533319] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-15T21:08:28.533557] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-15T21:08:28.534473] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-15T21:08:28.534539] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-15T21:08:28.873098] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-15T21:08:28.946493] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:29.257915] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-15T21:08:30.057877] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-15T21:08:30.203314] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T21:08:30.289861] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T21:08:30.857891] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-15T21:08:31.657936] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-15T21:08:32.088930] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T21:08:32.283053] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-15T21:08:32.457880] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-15T21:08:33.105611] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T21:08:33.257907] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-15T21:08:34.057941] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-15T21:08:34.863400] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-15T21:08:34.866185] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T21:08:34.910704] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T21:08:35.657882] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-15T21:08:35.897733] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T21:08:36.457900] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-15T21:08:36.558161] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T21:08:36.915418] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T21:08:37.257886] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-15T21:08:38.057907] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-15T21:08:38.642708] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T21:08:38.823382] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T21:08:38.857879] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-15T21:08:39.657895] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-15T21:08:39.697187] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T21:08:40.320981] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T21:08:40.457824] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-15T21:08:41.257897] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-15T21:08:41.881067] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-15T21:08:41.892049] [INFO ] [REMOTE ] XPEV: Full fetch complete (58323 records). [2025-09-15T21:08:41.892272] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-15T21:08:42.070479] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-15T21:08:42.280529] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-15T21:08:42.280669] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-15T21:08:42.281672] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-15T21:08:42.281728] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-15T21:08:42.309029] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T21:08:42.307958] [DEBUG] [LOCAL ] XPEV: Trimmed 58323 records to 39608 (keeping 150 days of data) [2025-09-15T21:08:42.575477] [DEBUG] [LOCAL ] XPEV: Primary data saved (39608 records). [2025-09-15T21:08:42.575746] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-15T21:08:42.576304] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XPEV took 32.2s. Estimated remaining: 3m 18s. Rate: 9.4 symbols/min [2025-09-15T21:08:42.751965] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:42.776253] [DEBUG] [LOCAL ] XYF: Loaded 21847 existing records from primary storage. [2025-09-15T21:08:42.776387] [INFO ] [MAIN ] XYF: Loaded 21847 existing records. [2025-09-15T21:08:42.867789] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-15T21:08:42.988490] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T21:08:42.988711] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:42.997957] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-15T21:08:42.998393] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-15T21:08:42.999090] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-15T21:08:42.999150] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-15T21:08:43.357628] [INFO ] [REMOTE ] XYF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:43.613299] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T21:08:43.657903] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-15T21:08:44.457883] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-15T21:08:44.710569] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T21:08:45.026141] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T21:08:45.030356] [INFO ] [REMOTE ] XPOF: Full fetch complete (41736 records). [2025-09-15T21:08:45.030506] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-15T21:08:45.263049] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-15T21:08:45.319050] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T21:08:45.434395] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-15T21:08:45.434488] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-15T21:08:45.435431] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-15T21:08:45.435477] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-15T21:08:45.436515] [DEBUG] [LOCAL ] XPOF: Trimmed 41736 records to 28011 (keeping 150 days of data) [2025-09-15T21:08:45.600798] [DEBUG] [LOCAL ] XPOF: Primary data saved (28011 records). [2025-09-15T21:08:45.600960] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-15T21:08:45.601079] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPOF took 21.2s. Estimated remaining: 3m 11s. Rate: 9.4 symbols/min [2025-09-15T21:08:45.768548] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:45.808536] [DEBUG] [LOCAL ] XYL: Loaded 35621 existing records from primary storage. [2025-09-15T21:08:45.808713] [INFO ] [MAIN ] XYL: Loaded 35621 existing records. [2025-09-15T21:08:45.983784] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:45.984103] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-15T21:08:45.984187] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-15T21:08:45.985042] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-15T21:08:45.985106] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-15T21:08:46.063037] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-15T21:08:46.339910] [INFO ] [REMOTE ] XYL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:46.859709] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-15T21:08:46.870688] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T21:08:46.925465] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T21:08:46.930723] [INFO ] [REMOTE ] XPO: Full fetch complete (52190 records). [2025-09-15T21:08:46.930837] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-15T21:08:46.931500] [FATAL] [VALIDATOR ] XPO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:08:46.931582] [FATAL] [MAIN ] XPO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:08:46.931620] [WARN ] [MAIN ] XPO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:08:46.931687] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-15T21:08:46.931768] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-15T21:08:46.931807] [INFO ] [LOCAL ] XPO: Starting deletion of derivative data. [2025-09-15T21:08:46.932189] [DEBUG] [LOCAL ] XPO: Deleted derivative data file. [2025-09-15T21:08:46.932283] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPO took 24.9s. Estimated remaining: 3m 5s. Rate: 9.4 symbols/min [2025-09-15T21:08:47.109198] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:47.150519] [DEBUG] [LOCAL ] XYZ: Loaded 40494 existing records from primary storage. [2025-09-15T21:08:47.150721] [INFO ] [MAIN ] XYZ: Loaded 40494 existing records. [2025-09-15T21:08:47.337290] [WARN ] [MAIN ] XYZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:47.337705] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-15T21:08:47.337761] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-15T21:08:47.338578] [DEBUG] [LOCAL ] XYZ: Deleted primary data file. [2025-09-15T21:08:47.338637] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-15T21:08:47.663124] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-15T21:08:47.704304] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:48.416101] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T21:08:48.457820] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-15T21:08:49.257896] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-15T21:08:49.398420] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T21:08:50.057876] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-15T21:08:50.191562] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T21:08:50.857893] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-15T21:08:51.073394] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T21:08:51.657875] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-15T21:08:51.759828] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T21:08:52.457879] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-15T21:08:52.517535] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T21:08:53.257959] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-15T21:08:53.790110] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-15T21:08:53.910823] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T21:08:53.916146] [INFO ] [REMOTE ] XPRO: Full fetch complete (49838 records). [2025-09-15T21:08:53.916257] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-15T21:08:54.060475] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-15T21:08:54.314503] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-15T21:08:54.315231] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T21:08:54.319888] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-15T21:08:54.321226] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-15T21:08:54.321281] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-15T21:08:54.322348] [DEBUG] [LOCAL ] XPRO: Trimmed 49838 records to 33658 (keeping 150 days of data) [2025-09-15T21:08:54.522204] [DEBUG] [LOCAL ] XPRO: Primary data saved (33658 records). [2025-09-15T21:08:54.522366] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-15T21:08:54.522467] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XPRO took 26.4s. Estimated remaining: 2m 59s. Rate: 9.4 symbols/min [2025-09-15T21:08:54.702340] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:08:54.730782] [DEBUG] [LOCAL ] YALA: Loaded 29139 existing records from primary storage. [2025-09-15T21:08:54.730959] [INFO ] [MAIN ] YALA: Loaded 29139 existing records. [2025-09-15T21:08:54.872908] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-15T21:08:54.911479] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:08:54.911764] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-15T21:08:54.911841] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-15T21:08:54.912533] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-15T21:08:54.912586] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-15T21:08:55.267381] [INFO ] [REMOTE ] YALA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:08:55.657897] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-15T21:08:56.130197] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-15T21:08:56.197146] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T21:08:56.457908] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-15T21:08:57.257849] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-15T21:08:57.355398] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T21:08:57.946946] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T21:08:58.057964] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-15T21:08:58.857941] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-15T21:08:58.904149] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T21:08:59.657873] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-15T21:08:59.735601] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T21:08:59.993479] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T21:09:00.457945] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-15T21:09:01.257930] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-15T21:09:01.620240] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T21:09:02.057907] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-15T21:09:02.658823] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T21:09:02.703407] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-15T21:09:02.857879] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-15T21:09:03.657880] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-15T21:09:04.457887] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-15T21:09:04.581508] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-15T21:09:05.257887] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-15T21:09:05.949384] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-09-15T21:09:06.015807] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T21:09:06.057840] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-15T21:09:06.121535] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-15T21:09:06.750880] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T21:09:06.857916] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-15T21:09:07.319481] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T21:09:07.657891] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-15T21:09:08.457893] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-15T21:09:09.007094] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T21:09:09.066042] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T21:09:09.257876] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-15T21:09:09.684512] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T21:09:09.988471] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T21:09:09.993427] [INFO ] [REMOTE ] XYL: Full fetch complete (52129 records). [2025-09-15T21:09:09.993544] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-15T21:09:09.994231] [FATAL] [VALIDATOR ] XYL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:09:09.994325] [FATAL] [MAIN ] XYL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:09:09.994378] [WARN ] [MAIN ] XYL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:09:09.994447] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-15T21:09:09.994541] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-15T21:09:09.994581] [INFO ] [LOCAL ] XYL: Starting deletion of derivative data. [2025-09-15T21:09:09.994891] [DEBUG] [LOCAL ] XYL: Deleted derivative data file. [2025-09-15T21:09:09.996306] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XYL took 24.4s. Estimated remaining: 2m 52s. Rate: 9.4 symbols/min [2025-09-15T21:09:10.063047] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-15T21:09:10.166389] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:10.203071] [DEBUG] [LOCAL ] YELP: Loaded 33791 existing records from primary storage. [2025-09-15T21:09:10.203210] [INFO ] [MAIN ] YELP: Loaded 33791 existing records. [2025-09-15T21:09:10.376536] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:10.376898] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-15T21:09:10.376952] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-15T21:09:10.377632] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-15T21:09:10.377718] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-15T21:09:10.723290] [INFO ] [REMOTE ] YELP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:10.857819] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-15T21:09:11.272194] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T21:09:11.657935] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-15T21:09:12.284933] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T21:09:12.457896] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-15T21:09:13.257924] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-15T21:09:13.516371] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T21:09:13.519369] [INFO ] [REMOTE ] XYF: Full fetch complete (28750 records). [2025-09-15T21:09:13.519457] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-15T21:09:13.880583] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-15T21:09:13.880692] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-15T21:09:13.881363] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-15T21:09:13.881445] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-15T21:09:13.882352] [DEBUG] [LOCAL ] XYF: Trimmed 28750 records to 21687 (keeping 150 days of data) [2025-09-15T21:09:13.991735] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-15T21:09:14.001838] [INFO ] [REMOTE ] XYZ: Full fetch complete (58431 records). [2025-09-15T21:09:14.004775] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-15T21:09:14.071773] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-15T21:09:14.167932] [DEBUG] [LOCAL ] XYF: Primary data saved (21687 records). [2025-09-15T21:09:14.217542] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-15T21:09:14.238146] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. XYF took 31.7s. Estimated remaining: 2m 46s. Rate: 9.4 symbols/min [2025-09-15T21:09:14.587484] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:14.607796] [DEBUG] [VALIDATOR ] XYZ: All expected trading days are present. [2025-09-15T21:09:14.608068] [DEBUG] [VALIDATOR ] XYZ: Primary data validation passed. [2025-09-15T21:09:14.609286] [INFO ] [MAIN ] XYZ: Fetched primary data is valid. [2025-09-15T21:09:14.609365] [DEBUG] [LOCAL ] XYZ: Saving primary data. [2025-09-15T21:09:14.612085] [DEBUG] [LOCAL ] XYZ: Trimmed 58431 records to 39714 (keeping 150 days of data) [2025-09-15T21:09:14.760275] [DEBUG] [LOCAL ] YETI: Loaded 39768 existing records from primary storage. [2025-09-15T21:09:14.767972] [INFO ] [MAIN ] YETI: Loaded 39768 existing records. [2025-09-15T21:09:15.044040] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:15.044875] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-15T21:09:15.045221] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-15T21:09:15.046682] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-15T21:09:15.047251] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-15T21:09:15.421906] [DEBUG] [LOCAL ] XYZ: Primary data saved (39714 records). [2025-09-15T21:09:15.443736] [INFO ] [MAIN ] XYZ: Full history saved. [2025-09-15T21:09:15.442676] [INFO ] [REMOTE ] YETI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:15.443998] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. XYZ took 28.5s. Estimated remaining: 2m 39s. Rate: 9.4 symbols/min [2025-09-15T21:09:15.444299] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-15T21:09:15.621638] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:15.649364] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-15T21:09:15.661201] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-15T21:09:15.690961] [DEBUG] [LOCAL ] YEXT: Loaded 31890 existing records from primary storage. [2025-09-15T21:09:15.691213] [INFO ] [MAIN ] YEXT: Loaded 31890 existing records. [2025-09-15T21:09:15.807573] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T21:09:15.899395] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:15.899636] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-15T21:09:15.899703] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-15T21:09:15.900294] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-15T21:09:15.900342] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-15T21:09:16.241695] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:16.457812] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-15T21:09:17.167149] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T21:09:17.257833] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-15T21:09:17.429965] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T21:09:17.468851] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T21:09:18.057876] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-15T21:09:18.863000] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-15T21:09:18.868808] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T21:09:19.463040] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T21:09:19.657893] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-15T21:09:20.052601] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T21:09:20.056278] [INFO ] [REMOTE ] YALA: Full fetch complete (39169 records). [2025-09-15T21:09:20.056360] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-15T21:09:20.443088] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-15T21:09:20.443212] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-15T21:09:20.444135] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-15T21:09:20.444191] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-15T21:09:20.445095] [DEBUG] [LOCAL ] YALA: Trimmed 39169 records to 28375 (keeping 150 days of data) [2025-09-15T21:09:20.491666] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-15T21:09:20.607155] [DEBUG] [LOCAL ] YALA: Primary data saved (28375 records). [2025-09-15T21:09:20.607283] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-15T21:09:20.607368] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. YALA took 26.1s. Estimated remaining: 2m 33s. Rate: 9.4 symbols/min [2025-09-15T21:09:20.778412] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:20.823865] [DEBUG] [LOCAL ] YMM: Loaded 39592 existing records from primary storage. [2025-09-15T21:09:20.824138] [INFO ] [MAIN ] YMM: Loaded 39592 existing records. [2025-09-15T21:09:21.018496] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:21.019236] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-15T21:09:21.019292] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-15T21:09:21.020279] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-15T21:09:21.020334] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-15T21:09:21.269310] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-15T21:09:21.413132] [INFO ] [REMOTE ] YMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:21.494504] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T21:09:21.808028] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T21:09:22.057903] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-15T21:09:22.850118] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T21:09:22.859043] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-15T21:09:23.496517] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T21:09:23.657899] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-15T21:09:24.360192] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T21:09:24.457827] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-15T21:09:25.257903] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-15T21:09:25.303626] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T21:09:26.057900] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-15T21:09:26.140275] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T21:09:26.705389] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T21:09:26.857869] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-15T21:09:27.445636] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T21:09:27.657921] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-15T21:09:28.414627] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T21:09:28.457901] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-15T21:09:29.257951] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-15T21:09:29.551011] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T21:09:29.668474] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T21:09:30.057896] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-15T21:09:30.857893] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-15T21:09:30.914934] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T21:09:31.091791] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T21:09:31.096989] [INFO ] [REMOTE ] YEXT: Full fetch complete (47015 records). [2025-09-15T21:09:31.097117] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-15T21:09:31.475236] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-15T21:09:31.475453] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-15T21:09:31.476517] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-15T21:09:31.476571] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-15T21:09:31.477672] [DEBUG] [LOCAL ] YEXT: Trimmed 47015 records to 31323 (keeping 150 days of data) [2025-09-15T21:09:31.657883] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-15T21:09:31.662360] [DEBUG] [LOCAL ] YEXT: Primary data saved (31323 records). [2025-09-15T21:09:31.662478] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-15T21:09:31.663839] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. YEXT took 16.2s. Estimated remaining: 2m 27s. Rate: 9.4 symbols/min [2025-09-15T21:09:31.847403] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:31.886722] [DEBUG] [LOCAL ] YOU: Loaded 37275 existing records from primary storage. [2025-09-15T21:09:31.886902] [INFO ] [MAIN ] YOU: Loaded 37275 existing records. [2025-09-15T21:09:32.063536] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:32.063880] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-15T21:09:32.063931] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-15T21:09:32.064968] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-15T21:09:32.065036] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-15T21:09:32.430382] [INFO ] [REMOTE ] YOU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:32.457906] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-15T21:09:32.810674] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T21:09:33.137894] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T21:09:33.143122] [INFO ] [REMOTE ] YELP: Full fetch complete (49040 records). [2025-09-15T21:09:33.143227] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-15T21:09:33.262970] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-15T21:09:33.520277] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-15T21:09:33.520363] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-15T21:09:33.521386] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-15T21:09:33.521435] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-15T21:09:33.522473] [DEBUG] [LOCAL ] YELP: Trimmed 49040 records to 33170 (keeping 150 days of data) [2025-09-15T21:09:33.723726] [DEBUG] [LOCAL ] YELP: Primary data saved (33170 records). [2025-09-15T21:09:33.723896] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-15T21:09:33.724004] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YELP took 23.7s. Estimated remaining: 2m 20s. Rate: 9.4 symbols/min [2025-09-15T21:09:33.897406] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:33.934440] [DEBUG] [LOCAL ] YPF: Loaded 37780 existing records from primary storage. [2025-09-15T21:09:33.934611] [INFO ] [MAIN ] YPF: Loaded 37780 existing records. [2025-09-15T21:09:34.061639] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-15T21:09:34.113015] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:34.113219] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-15T21:09:34.113266] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-15T21:09:34.114002] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-15T21:09:34.114143] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-15T21:09:34.530575] [INFO ] [REMOTE ] YPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:34.532911] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-15T21:09:34.846605] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T21:09:34.857810] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-15T21:09:35.665295] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-15T21:09:35.668277] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T21:09:36.457882] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-15T21:09:36.672413] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T21:09:37.257883] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-15T21:09:37.439264] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T21:09:37.940705] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T21:09:38.057898] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-15T21:09:38.857900] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-15T21:09:39.069921] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T21:09:39.657888] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-15T21:09:39.726113] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T21:09:40.357677] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T21:09:40.457856] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-15T21:09:41.144514] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T21:09:41.257893] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-15T21:09:42.057910] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-15T21:09:42.246843] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T21:09:42.857921] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-15T21:09:43.067535] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T21:09:43.657907] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-15T21:09:43.826677] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T21:09:44.209053] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T21:09:44.457904] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-15T21:09:45.257883] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-15T21:09:45.562603] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T21:09:46.057879] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-15T21:09:46.302870] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T21:09:46.857881] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-15T21:09:47.081280] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T21:09:47.475228] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T21:09:47.481113] [INFO ] [REMOTE ] YETI: Full fetch complete (57055 records). [2025-09-15T21:09:47.481215] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-15T21:09:47.672717] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-15T21:09:47.870365] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-15T21:09:47.870465] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-15T21:09:47.871471] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-15T21:09:47.871520] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-15T21:09:47.872864] [DEBUG] [LOCAL ] YETI: Trimmed 57055 records to 39025 (keeping 150 days of data) [2025-09-15T21:09:48.110824] [DEBUG] [LOCAL ] YETI: Primary data saved (39025 records). [2025-09-15T21:09:48.111012] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-15T21:09:48.111118] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YETI took 33.8s. Estimated remaining: 2m 14s. Rate: 9.4 symbols/min [2025-09-15T21:09:48.288043] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:48.323146] [DEBUG] [LOCAL ] YRD: Loaded 8071 existing records from primary storage. [2025-09-15T21:09:48.326275] [INFO ] [MAIN ] YRD: Loaded 8071 existing records. [2025-09-15T21:09:48.396480] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T21:09:48.462927] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-15T21:09:48.529965] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:48.530242] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-15T21:09:48.530293] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-15T21:09:48.530614] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-15T21:09:48.530687] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-15T21:09:48.889814] [INFO ] [REMOTE ] YRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:49.257891] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-15T21:09:49.411392] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T21:09:49.417543] [INFO ] [REMOTE ] YMM: Full fetch complete (57378 records). [2025-09-15T21:09:49.417724] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-15T21:09:49.797040] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-15T21:09:49.797132] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-15T21:09:49.798153] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-15T21:09:49.798203] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-15T21:09:49.799591] [DEBUG] [LOCAL ] YMM: Trimmed 57378 records to 38810 (keeping 150 days of data) [2025-09-15T21:09:50.040610] [DEBUG] [LOCAL ] YMM: Primary data saved (38810 records). [2025-09-15T21:09:50.040881] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-15T21:09:50.041949] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YMM took 29.4s. Estimated remaining: 2m 8s. Rate: 9.4 symbols/min [2025-09-15T21:09:50.074234] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-15T21:09:50.222305] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:50.242978] [DEBUG] [LOCAL ] YSG: Loaded 19819 existing records from primary storage. [2025-09-15T21:09:50.243148] [INFO ] [MAIN ] YSG: Loaded 19819 existing records. [2025-09-15T21:09:50.441781] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:50.442254] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-15T21:09:50.442326] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-15T21:09:50.442903] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-15T21:09:50.442962] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-15T21:09:50.789298] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-15T21:09:50.861575] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-15T21:09:50.955750] [INFO ] [REMOTE ] YSG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:50.999209] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T21:09:51.229915] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T21:09:51.657902] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-15T21:09:52.304095] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T21:09:52.318517] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T21:09:52.318681] [INFO ] [REMOTE ] YOU: Full fetch complete (54394 records). [2025-09-15T21:09:52.318884] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-15T21:09:52.462974] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-15T21:09:52.734427] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-15T21:09:52.734518] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-15T21:09:52.735613] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-15T21:09:52.735675] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-15T21:09:52.736802] [DEBUG] [LOCAL ] YOU: Trimmed 54394 records to 36560 (keeping 150 days of data) [2025-09-15T21:09:52.970002] [DEBUG] [LOCAL ] YOU: Primary data saved (36560 records). [2025-09-15T21:09:52.970175] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-15T21:09:52.970275] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YOU took 21.3s. Estimated remaining: 2m 1s. Rate: 9.4 symbols/min [2025-09-15T21:09:53.149383] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:09:53.192897] [DEBUG] [LOCAL ] YUM: Loaded 38411 existing records from primary storage. [2025-09-15T21:09:53.193085] [INFO ] [MAIN ] YUM: Loaded 38411 existing records. [2025-09-15T21:09:53.263077] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-15T21:09:53.374752] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:09:53.375100] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-15T21:09:53.375150] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-15T21:09:53.376080] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-15T21:09:53.376133] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-15T21:09:53.729617] [INFO ] [REMOTE ] YUM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:09:54.057902] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-15T21:09:54.311831] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T21:09:54.335323] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T21:09:54.819065] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T21:09:54.857939] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-15T21:09:55.657889] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-15T21:09:55.798326] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T21:09:56.457927] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-15T21:09:56.739514] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T21:09:57.050306] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T21:09:57.257864] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-15T21:09:58.057889] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-15T21:09:58.080840] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T21:09:58.857916] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-15T21:09:59.412401] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T21:09:59.418368] [INFO ] [REMOTE ] YPF: Full fetch complete (54898 records). [2025-09-15T21:09:59.418545] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-15T21:09:59.666940] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-15T21:09:59.809331] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-15T21:09:59.809423] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-15T21:09:59.810720] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-15T21:09:59.810775] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-15T21:09:59.814387] [DEBUG] [LOCAL ] YPF: Trimmed 54898 records to 37011 (keeping 150 days of data) [2025-09-15T21:10:00.039860] [DEBUG] [LOCAL ] YPF: Primary data saved (37011 records). [2025-09-15T21:10:00.040035] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-15T21:10:00.040128] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YPF took 26.3s. Estimated remaining: 1m 55s. Rate: 9.4 symbols/min [2025-09-15T21:10:00.215348] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:00.254504] [DEBUG] [LOCAL ] YUMC: Loaded 39581 existing records from primary storage. [2025-09-15T21:10:00.254714] [INFO ] [MAIN ] YUMC: Loaded 39581 existing records. [2025-09-15T21:10:00.433849] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T21:10:00.461505] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-15T21:10:00.467786] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:00.468413] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-15T21:10:00.468477] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-15T21:10:00.469309] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-15T21:10:00.469360] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-15T21:10:00.830898] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:01.257855] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-15T21:10:01.501765] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T21:10:01.636546] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T21:10:02.057919] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-15T21:10:02.857891] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-15T21:10:03.657990] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-15T21:10:03.761673] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-15T21:10:04.443166] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T21:10:04.457815] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-15T21:10:05.218093] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-15T21:10:05.259965] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-15T21:10:05.263288] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T21:10:05.309268] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (3.25 seconds). [2025-09-15T21:10:06.057910] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-15T21:10:06.601818] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T21:10:06.602375] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T21:10:06.609812] [INFO ] [REMOTE ] YRD: Full fetch complete (14484 records). [2025-09-15T21:10:06.609964] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-15T21:10:06.862958] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-15T21:10:06.967886] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-15T21:10:06.967971] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-15T21:10:06.968289] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-15T21:10:06.968337] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-15T21:10:06.968835] [DEBUG] [LOCAL ] YRD: Trimmed 14484 records to 7931 (keeping 150 days of data) [2025-09-15T21:10:07.019917] [DEBUG] [LOCAL ] YRD: Primary data saved (7931 records). [2025-09-15T21:10:07.020092] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-15T21:10:07.020230] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YRD took 18.9s. Estimated remaining: 1m 48s. Rate: 9.4 symbols/min [2025-09-15T21:10:07.196321] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:07.250085] [DEBUG] [LOCAL ] ZBH: Loaded 38460 existing records from primary storage. [2025-09-15T21:10:07.250285] [INFO ] [MAIN ] ZBH: Loaded 38460 existing records. [2025-09-15T21:10:07.429801] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:07.430127] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-15T21:10:07.430175] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-15T21:10:07.431175] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-15T21:10:07.431240] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-15T21:10:07.666172] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-15T21:10:07.803320] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:08.457886] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-15T21:10:08.767135] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T21:10:09.257924] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-15T21:10:09.396911] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T21:10:09.402190] [INFO ] [REMOTE ] YSG: Full fetch complete (25576 records). [2025-09-15T21:10:09.402446] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-15T21:10:09.581004] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T21:10:09.857528] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-15T21:10:09.857618] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-15T21:10:09.858218] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-15T21:10:09.858265] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-15T21:10:09.859486] [DEBUG] [LOCAL ] YSG: Trimmed 25576 records to 19604 (keeping 150 days of data) [2025-09-15T21:10:09.982448] [DEBUG] [LOCAL ] YSG: Primary data saved (19604 records). [2025-09-15T21:10:09.982622] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-15T21:10:09.982762] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YSG took 19.9s. Estimated remaining: 1m 42s. Rate: 9.4 symbols/min [2025-09-15T21:10:10.063037] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-15T21:10:10.153461] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:10.171842] [DEBUG] [LOCAL ] ZEPP: Loaded 14319 existing records from primary storage. [2025-09-15T21:10:10.171971] [INFO ] [MAIN ] ZEPP: Loaded 14319 existing records. [2025-09-15T21:10:10.348382] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:10.348719] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-15T21:10:10.348767] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-15T21:10:10.349145] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-15T21:10:10.349190] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-15T21:10:10.712255] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:10.857899] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-15T21:10:10.955338] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T21:10:11.657962] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-15T21:10:11.774277] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T21:10:12.190964] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T21:10:12.457962] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-15T21:10:12.966917] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T21:10:13.005518] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T21:10:13.257897] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-15T21:10:14.057949] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-15T21:10:14.857894] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-15T21:10:15.426066] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-15T21:10:15.657903] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-15T21:10:16.376715] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T21:10:16.452570] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-15T21:10:16.462182] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-15T21:10:17.252680] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-15T21:10:17.263287] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-15T21:10:17.984100] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T21:10:18.057949] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-15T21:10:18.194825] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T21:10:18.745119] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T21:10:18.857952] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-15T21:10:19.657889] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-15T21:10:20.403174] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T21:10:20.457807] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-15T21:10:21.257885] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-15T21:10:21.475835] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T21:10:22.061170] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-15T21:10:22.066471] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T21:10:22.857930] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-15T21:10:22.919575] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T21:10:23.657959] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-15T21:10:23.913927] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T21:10:24.343201] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T21:10:24.347834] [INFO ] [REMOTE ] ZEPP: Full fetch complete (15939 records). [2025-09-15T21:10:24.348268] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-15T21:10:24.459713] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-15T21:10:24.739877] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-15T21:10:24.739987] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-15T21:10:24.740356] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-15T21:10:24.740398] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-15T21:10:24.741345] [DEBUG] [LOCAL ] ZEPP: Trimmed 15939 records to 14555 (keeping 150 days of data) [2025-09-15T21:10:24.830635] [DEBUG] [LOCAL ] ZEPP: Primary data saved (14555 records). [2025-09-15T21:10:24.830831] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-15T21:10:24.830942] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. ZEPP took 14.8s. Estimated remaining: 1m 36s. Rate: 9.4 symbols/min [2025-09-15T21:10:25.006609] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:25.055701] [DEBUG] [LOCAL ] ZETA: Loaded 40363 existing records from primary storage. [2025-09-15T21:10:25.055873] [INFO ] [MAIN ] ZETA: Loaded 40363 existing records. [2025-09-15T21:10:25.238898] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:25.239524] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-15T21:10:25.239823] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-15T21:10:25.245791] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-15T21:10:25.254053] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-15T21:10:25.267012] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-15T21:10:25.267922] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T21:10:25.340230] [INFO ] [REMOTE ] YUM: Full fetch complete (55473 records). [2025-09-15T21:10:25.345833] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-15T21:10:25.370328] [FATAL] [VALIDATOR ] YUM: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:10:25.370664] [FATAL] [MAIN ] YUM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:10:25.370885] [WARN ] [MAIN ] YUM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:10:25.381725] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-15T21:10:25.381954] [DEBUG] [LOCAL ] YUM: No primary data file found to delete. [2025-09-15T21:10:25.392357] [INFO ] [LOCAL ] YUM: Starting deletion of derivative data. [2025-09-15T21:10:25.505530] [DEBUG] [LOCAL ] YUM: Deleted derivative data file. [2025-09-15T21:10:25.557864] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. YUM took 32.6s. Estimated remaining: 1m 29s. Rate: 9.4 symbols/min [2025-09-15T21:10:25.589516] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T21:10:25.806790] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:25.870311] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:25.915822] [DEBUG] [LOCAL ] ZGN: Loaded 30541 existing records from primary storage. [2025-09-15T21:10:25.916055] [INFO ] [MAIN ] ZGN: Loaded 30541 existing records. [2025-09-15T21:10:26.063116] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-15T21:10:26.100590] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:26.100878] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-15T21:10:26.100929] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-15T21:10:26.101615] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-15T21:10:26.101690] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-15T21:10:26.451748] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:26.857887] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-15T21:10:27.480303] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T21:10:27.657950] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-15T21:10:28.067011] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T21:10:28.457939] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-15T21:10:28.494876] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T21:10:29.257853] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-15T21:10:29.307609] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T21:10:30.048856] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T21:10:30.057810] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-15T21:10:30.676837] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T21:10:30.682479] [INFO ] [REMOTE ] YUMC: Full fetch complete (57372 records). [2025-09-15T21:10:30.682571] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-15T21:10:30.858408] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-15T21:10:31.061368] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-15T21:10:31.061458] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-15T21:10:31.062472] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-15T21:10:31.062532] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-15T21:10:31.064079] [DEBUG] [LOCAL ] YUMC: Trimmed 57372 records to 38787 (keeping 150 days of data) [2025-09-15T21:10:31.309978] [DEBUG] [LOCAL ] YUMC: Primary data saved (38787 records). [2025-09-15T21:10:31.310140] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-15T21:10:31.310247] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. YUMC took 31.3s. Estimated remaining: 1m 23s. Rate: 9.4 symbols/min [2025-09-15T21:10:31.478171] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:31.478428] [DEBUG] [LOCAL ] ZH: No existing data file found in primary storage. [2025-09-15T21:10:31.478466] [WARN ] [MAIN ] ZH: No existing data found, performing full refresh instead. [2025-09-15T21:10:31.478596] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-15T21:10:31.478633] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-15T21:10:31.478694] [DEBUG] [LOCAL ] ZH: No primary data file found to delete. [2025-09-15T21:10:31.478728] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-15T21:10:31.673475] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-15T21:10:31.832960] [INFO ] [REMOTE ] ZH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:31.857094] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T21:10:32.457848] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-15T21:10:32.958250] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-15T21:10:33.257893] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-15T21:10:33.491802] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T21:10:33.642532] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T21:10:34.057896] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-15T21:10:34.857970] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-15T21:10:35.419540] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T21:10:35.471620] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T21:10:35.657875] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-15T21:10:36.222344] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T21:10:36.457879] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-15T21:10:36.816540] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T21:10:37.257915] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-15T21:10:37.776107] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T21:10:38.057901] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-15T21:10:38.857863] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-15T21:10:39.007672] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T21:10:39.105804] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T21:10:39.657898] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-15T21:10:40.457943] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-15T21:10:41.107175] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T21:10:41.257931] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-15T21:10:41.367095] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T21:10:41.392749] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T21:10:42.057884] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-15T21:10:42.857947] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-15T21:10:43.188019] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T21:10:43.342394] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-15T21:10:43.657917] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-15T21:10:44.348106] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T21:10:44.360758] [INFO ] [REMOTE ] ZBH: Full fetch complete (55726 records). [2025-09-15T21:10:44.361012] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-15T21:10:44.464078] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-15T21:10:44.943925] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-15T21:10:44.947956] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-15T21:10:44.950662] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-15T21:10:44.953491] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-15T21:10:44.953304] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T21:10:44.962268] [DEBUG] [LOCAL ] ZBH: Trimmed 55726 records to 37687 (keeping 150 days of data) [2025-09-15T21:10:45.211529] [DEBUG] [LOCAL ] ZBH: Primary data saved (37687 records). [2025-09-15T21:10:45.211740] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-15T21:10:45.213081] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. ZBH took 38.2s. Estimated remaining: 1m 17s. Rate: 9.4 symbols/min [2025-09-15T21:10:45.257909] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-15T21:10:46.057891] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-15T21:10:46.147416] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T21:10:46.857908] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-15T21:10:46.992531] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T21:10:46.996079] [INFO ] [REMOTE ] ZH: Full fetch complete (31601 records). [2025-09-15T21:10:46.996158] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-15T21:10:47.364622] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-15T21:10:47.364724] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-15T21:10:47.365368] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-15T21:10:47.365409] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-15T21:10:47.366151] [DEBUG] [LOCAL ] ZH: Trimmed 31601 records to 17838 (keeping 150 days of data) [2025-09-15T21:10:47.465266] [DEBUG] [LOCAL ] ZH: Primary data saved (17838 records). [2025-09-15T21:10:47.465428] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-15T21:10:47.465525] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZH took 16.2s. Estimated remaining: 1m 10s. Rate: 9.4 symbols/min [2025-09-15T21:10:47.775760] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-15T21:10:47.787530] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-15T21:10:47.943476] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T21:10:48.457941] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-15T21:10:49.660268] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T21:10:49.665356] [INFO ] [REMOTE ] ZGN: Full fetch complete (44075 records). [2025-09-15T21:10:49.665502] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-15T21:10:50.068331] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-15T21:10:50.068494] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-15T21:10:50.070259] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-15T21:10:50.070336] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-15T21:10:50.072064] [DEBUG] [LOCAL ] ZGN: Trimmed 44075 records to 30033 (keeping 150 days of data) [2025-09-15T21:10:50.275865] [DEBUG] [LOCAL ] ZGN: Primary data saved (30033 records). [2025-09-15T21:10:50.276075] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-15T21:10:50.276218] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZGN took 24.7s. Estimated remaining: 1m 4s. Rate: 9.4 symbols/min [2025-09-15T21:10:50.342000] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-15T21:10:50.354072] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-15T21:10:52.296142] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T21:10:52.302492] [INFO ] [REMOTE ] ZETA: Full fetch complete (58274 records). [2025-09-15T21:10:52.302611] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-15T21:10:52.688992] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-15T21:10:52.689078] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-15T21:10:52.690068] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-15T21:10:52.690112] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-15T21:10:52.691311] [DEBUG] [LOCAL ] ZETA: Trimmed 58274 records to 39592 (keeping 150 days of data) [2025-09-15T21:10:52.928288] [DEBUG] [LOCAL ] ZETA: Primary data saved (39592 records). [2025-09-15T21:10:52.928449] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-15T21:10:52.929414] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZETA took 28.1s. Estimated remaining: 57.4s. Rate: 9.4 symbols/min [2025-09-15T21:10:53.546318] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:53.640793] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:53.647508] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:53.650227] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:10:53.661376] [DEBUG] [LOCAL ] ZKH: Loaded 5850 existing records from primary storage. [2025-09-15T21:10:53.661601] [INFO ] [MAIN ] ZKH: Loaded 5850 existing records. [2025-09-15T21:10:53.821858] [DEBUG] [LOCAL ] ZK: Loaded 28834 existing records from primary storage. [2025-09-15T21:10:53.838373] [DEBUG] [LOCAL ] ZIP: Loaded 32834 existing records from primary storage. [2025-09-15T21:10:53.838478] [INFO ] [MAIN ] ZK: Loaded 28834 existing records. [2025-09-15T21:10:53.863341] [INFO ] [MAIN ] ZIP: Loaded 32834 existing records. [2025-09-15T21:10:53.987854] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:54.070019] [DEBUG] [LOCAL ] ZIM: Loaded 40307 existing records from primary storage. [2025-09-15T21:10:54.094854] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-15T21:10:54.136521] [INFO ] [MAIN ] ZIM: Loaded 40307 existing records. [2025-09-15T21:10:54.163774] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-15T21:10:54.301441] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-15T21:10:54.359154] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-15T21:10:54.369312] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:54.374634] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:54.385299] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-15T21:10:54.429077] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-15T21:10:54.429155] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-15T21:10:54.462095] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-15T21:10:54.494315] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-15T21:10:54.499602] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-15T21:10:54.499552] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-15T21:10:54.569946] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-15T21:10:54.655223] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:10:54.753863] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-15T21:10:54.797360] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-15T21:10:54.898043] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-15T21:10:54.914216] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-15T21:10:55.424961] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:55.451152] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-15T21:10:55.794173] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:55.830735] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-15T21:10:55.840756] [INFO ] [REMOTE ] ZK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:55.852098] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-15T21:10:55.951686] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:10:55.952003] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-15T21:10:56.563761] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T21:10:56.566778] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-15T21:10:57.231415] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T21:10:57.239213] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-15T21:10:57.305668] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T21:10:57.312756] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-15T21:10:57.359103] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T21:10:57.361974] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-15T21:10:57.877162] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T21:10:57.887318] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-15T21:10:57.999321] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T21:10:58.001278] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-15T21:10:58.942924] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T21:10:58.953026] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-15T21:10:58.969793] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T21:10:58.971550] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-15T21:10:59.026850] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T21:10:59.495972] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T21:10:59.657895] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-15T21:11:00.186486] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-15T21:11:00.364825] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T21:11:00.457889] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-15T21:11:00.737328] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T21:11:01.157334] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T21:11:01.257871] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-15T21:11:01.764575] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T21:11:01.766014] [INFO ] [REMOTE ] ZKH: Full fetch complete (9304 records). [2025-09-15T21:11:01.766090] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-15T21:11:02.064274] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-15T21:11:02.151811] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-15T21:11:02.151912] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-15T21:11:02.152214] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-15T21:11:02.152254] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-15T21:11:02.152782] [DEBUG] [LOCAL ] ZKH: Trimmed 9304 records to 5780 (keeping 150 days of data) [2025-09-15T21:11:02.185857] [DEBUG] [LOCAL ] ZKH: Primary data saved (5780 records). [2025-09-15T21:11:02.186028] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-15T21:11:02.186137] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZKH took 9.3s. Estimated remaining: 51.0s. Rate: 9.4 symbols/min [2025-09-15T21:11:02.367196] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:11:02.411691] [DEBUG] [LOCAL ] ZTO: Loaded 37359 existing records from primary storage. [2025-09-15T21:11:02.411888] [INFO ] [MAIN ] ZTO: Loaded 37359 existing records. [2025-09-15T21:11:02.595397] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:11:02.595763] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-15T21:11:02.595814] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-15T21:11:02.596692] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-15T21:11:02.596753] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-15T21:11:02.863107] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-15T21:11:02.967146] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:11:03.657904] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-15T21:11:03.920628] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T21:11:04.457906] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-15T21:11:04.587622] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T21:11:05.257936] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-15T21:11:05.881303] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T21:11:05.950694] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T21:11:06.057918] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-15T21:11:06.857904] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-15T21:11:07.040885] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T21:11:07.380312] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T21:11:07.657931] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-15T21:11:08.457914] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-15T21:11:08.519098] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T21:11:09.257947] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-15T21:11:10.057867] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-15T21:11:10.127404] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-15T21:11:10.412791] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T21:11:10.827843] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T21:11:10.857822] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-15T21:11:11.340601] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T21:11:11.657900] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-15T21:11:12.188030] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T21:11:12.457951] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-15T21:11:12.763615] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T21:11:13.257908] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-15T21:11:14.057899] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-15T21:11:14.708874] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-15T21:11:14.857835] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-15T21:11:15.042069] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T21:11:15.083844] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T21:11:15.088733] [INFO ] [REMOTE ] ZK: Full fetch complete (43637 records). [2025-09-15T21:11:15.088826] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-15T21:11:15.461698] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-15T21:11:15.461818] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-15T21:11:15.462658] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-15T21:11:15.462700] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-15T21:11:15.463563] [DEBUG] [LOCAL ] ZK: Trimmed 43637 records to 28129 (keeping 150 days of data) [2025-09-15T21:11:15.625705] [DEBUG] [LOCAL ] ZK: Primary data saved (28129 records). [2025-09-15T21:11:15.625850] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-15T21:11:15.625938] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZK took 22.7s. Estimated remaining: 44.7s. Rate: 9.4 symbols/min [2025-09-15T21:11:15.663066] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-15T21:11:15.796419] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:11:15.808295] [DEBUG] [LOCAL ] ZTR: Loaded 12420 existing records from primary storage. [2025-09-15T21:11:15.808388] [INFO ] [MAIN ] ZTR: Loaded 12420 existing records. [2025-09-15T21:11:15.983460] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:11:15.983861] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-15T21:11:15.983946] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-15T21:11:15.989502] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-15T21:11:15.996108] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-15T21:11:16.061092] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T21:11:16.103080] [INFO ] [REMOTE ] ZIP: Full fetch complete (47523 records). [2025-09-15T21:11:16.103262] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-15T21:11:16.472762] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-15T21:11:16.610993] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:11:16.729085] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-15T21:11:16.729169] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-15T21:11:16.730070] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-15T21:11:16.730113] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-15T21:11:16.731084] [DEBUG] [LOCAL ] ZIP: Trimmed 47523 records to 32069 (keeping 150 days of data) [2025-09-15T21:11:16.926653] [DEBUG] [LOCAL ] ZIP: Primary data saved (32069 records). [2025-09-15T21:11:16.926843] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-15T21:11:16.926949] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZIP took 24.0s. Estimated remaining: 38.3s. Rate: 9.4 symbols/min [2025-09-15T21:11:17.096020] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:11:17.135048] [DEBUG] [LOCAL ] ZTS: Loaded 39998 existing records from primary storage. [2025-09-15T21:11:17.135218] [INFO ] [MAIN ] ZTS: Loaded 39998 existing records. [2025-09-15T21:11:17.263166] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-15T21:11:17.319284] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:11:17.319525] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-15T21:11:17.319573] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-15T21:11:17.320389] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-15T21:11:17.320439] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-15T21:11:17.682158] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:11:17.712745] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-15T21:11:18.057870] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-15T21:11:18.284282] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T21:11:18.521759] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T21:11:18.857939] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-15T21:11:19.493775] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T21:11:19.657944] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-15T21:11:20.457912] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-15T21:11:20.843390] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-15T21:11:21.257970] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-15T21:11:21.921953] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-15T21:11:22.057887] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-15T21:11:22.246172] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T21:11:22.826918] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T21:11:22.830398] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T21:11:22.857815] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-15T21:11:23.657908] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-15T21:11:24.457889] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-15T21:11:24.708239] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T21:11:25.257883] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-15T21:11:25.372261] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T21:11:25.387165] [INFO ] [REMOTE ] ZIM: Full fetch complete (58218 records). [2025-09-15T21:11:25.389395] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-15T21:11:25.389794] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T21:11:25.771497] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-15T21:11:25.771586] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-15T21:11:25.772712] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-15T21:11:25.772779] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-15T21:11:25.774148] [DEBUG] [LOCAL ] ZIM: Trimmed 58218 records to 39530 (keeping 150 days of data) [2025-09-15T21:11:26.028881] [DEBUG] [LOCAL ] ZIM: Primary data saved (39530 records). [2025-09-15T21:11:26.029077] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-15T21:11:26.029204] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIM took 33.1s. Estimated remaining: 31.9s. Rate: 9.4 symbols/min [2025-09-15T21:11:26.062997] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-15T21:11:26.203935] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:11:26.232401] [DEBUG] [LOCAL ] ZVIA: Loaded 27034 existing records from primary storage. [2025-09-15T21:11:26.232550] [INFO ] [MAIN ] ZVIA: Loaded 27034 existing records. [2025-09-15T21:11:26.410150] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:11:26.410394] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-15T21:11:26.410439] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-15T21:11:26.411118] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-15T21:11:26.411174] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-15T21:11:26.771608] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:11:26.823565] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T21:11:26.855874] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T21:11:26.866083] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-15T21:11:27.657886] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-15T21:11:28.333189] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T21:11:28.457868] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-15T21:11:29.008858] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T21:11:29.257868] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-15T21:11:29.735111] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T21:11:30.057919] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-15T21:11:30.720234] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T21:11:30.725684] [INFO ] [REMOTE ] ZTO: Full fetch complete (54827 records). [2025-09-15T21:11:30.725790] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-15T21:11:30.866538] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-15T21:11:31.111401] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-15T21:11:31.111508] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-15T21:11:31.112541] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-15T21:11:31.121040] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-15T21:11:31.122158] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T21:11:31.126377] [DEBUG] [LOCAL ] ZTO: Trimmed 54827 records to 36526 (keeping 150 days of data) [2025-09-15T21:11:31.346070] [DEBUG] [LOCAL ] ZTO: Primary data saved (36526 records). [2025-09-15T21:11:31.346242] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-15T21:11:31.347411] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZTO took 29.2s. Estimated remaining: 25.5s. Rate: 9.4 symbols/min [2025-09-15T21:11:31.519195] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T21:11:31.552065] [DEBUG] [LOCAL ] ZWS: Loaded 31369 existing records from primary storage. [2025-09-15T21:11:31.552243] [INFO ] [MAIN ] ZWS: Loaded 31369 existing records. [2025-09-15T21:11:31.659998] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-15T21:11:31.741383] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T21:11:31.741670] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-15T21:11:31.741723] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-15T21:11:31.742400] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-15T21:11:31.742449] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-15T21:11:32.115338] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T21:11:32.172158] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T21:11:32.457932] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-15T21:11:33.257922] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-15T21:11:33.511195] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T21:11:34.058135] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-15T21:11:34.060990] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T21:11:34.508943] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T21:11:34.857974] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-15T21:11:35.177109] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T21:11:35.657918] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-15T21:11:36.343575] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T21:11:36.410677] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T21:11:36.457875] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-15T21:11:37.258020] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-15T21:11:37.277617] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T21:11:37.281542] [INFO ] [REMOTE ] ZTR: Full fetch complete (19135 records). [2025-09-15T21:11:37.281740] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-15T21:11:37.834960] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-15T21:11:37.835077] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-15T21:11:37.835726] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-15T21:11:37.835786] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-15T21:11:37.836741] [DEBUG] [LOCAL ] ZTR: Trimmed 19135 records to 12151 (keeping 150 days of data) [2025-09-15T21:11:37.920511] [DEBUG] [LOCAL ] ZTR: Primary data saved (12151 records). [2025-09-15T21:11:37.920736] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-15T21:11:37.920883] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTR took 22.3s. Estimated remaining: 19.1s. Rate: 9.4 symbols/min [2025-09-15T21:11:38.057934] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-15T21:11:38.857979] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-15T21:11:38.893410] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T21:11:39.650875] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T21:11:39.658698] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-15T21:11:40.457901] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-15T21:11:40.709303] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T21:11:41.237056] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T21:11:41.257824] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-15T21:11:42.057938] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-15T21:11:42.122758] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T21:11:42.734434] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T21:11:42.844080] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T21:11:42.857812] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-15T21:11:43.599581] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T21:11:43.605182] [INFO ] [REMOTE ] ZTS: Full fetch complete (57283 records). [2025-09-15T21:11:43.605328] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-15T21:11:43.606015] [FATAL] [VALIDATOR ] ZTS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T21:11:43.606117] [FATAL] [MAIN ] ZTS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T21:11:43.606170] [WARN ] [MAIN ] ZTS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T21:11:43.606210] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-15T21:11:43.606274] [DEBUG] [LOCAL ] ZTS: No primary data file found to delete. [2025-09-15T21:11:43.606336] [INFO ] [LOCAL ] ZTS: Starting deletion of derivative data. [2025-09-15T21:11:43.606749] [DEBUG] [LOCAL ] ZTS: Deleted derivative data file. [2025-09-15T21:11:43.606853] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZTS took 26.7s. Estimated remaining: 12.8s. Rate: 9.4 symbols/min [2025-09-15T21:11:43.657835] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-15T21:11:44.457884] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-15T21:11:44.956876] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T21:11:44.961215] [INFO ] [REMOTE ] ZVIA: Full fetch complete (38612 records). [2025-09-15T21:11:44.961329] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-15T21:11:45.350102] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-15T21:11:45.350203] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-15T21:11:45.351093] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-15T21:11:45.351145] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-15T21:11:45.352348] [DEBUG] [LOCAL ] ZVIA: Trimmed 38612 records to 26800 (keeping 150 days of data) [2025-09-15T21:11:45.504438] [DEBUG] [LOCAL ] ZVIA: Primary data saved (26800 records). [2025-09-15T21:11:45.504600] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-15T21:11:45.504720] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZVIA took 19.5s. Estimated remaining: 6.4s. Rate: 9.4 symbols/min [2025-09-15T21:11:45.866419] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T21:11:45.874668] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-15T21:11:47.275030] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T21:11:47.285251] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-15T21:11:48.862173] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T21:11:48.871703] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-15T21:11:50.097292] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T21:11:50.104425] [INFO ] [REMOTE ] ZWS: Full fetch complete (46499 records). [2025-09-15T21:11:50.104584] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-15T21:11:50.518880] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-15T21:11:50.518980] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-15T21:11:50.520255] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-15T21:11:50.520306] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-15T21:11:50.521880] [DEBUG] [LOCAL ] ZWS: Trimmed 46499 records to 30695 (keeping 150 days of data) [2025-09-15T21:11:50.738347] [DEBUG] [LOCAL ] ZWS: Primary data saved (30695 records). [2025-09-15T21:11:50.738537] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-15T21:11:50.738670] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZWS took 19.4s. Estimated remaining: 0.0s. Rate: 9.4 symbols/min [2025-09-15T21:11:50.741731] [INFO ] [MAIN ] Parallel update completed in 4h 11m 47s [2025-09-15T21:11:50.742002] [WARN ] [MAIN ] Failed symbols (286): AAM, AAMI, A, AA, AAUC, AAP, AAT, ACEL, ACI, ACN... [2025-09-15T21:11:50.742069] [INFO ] [MAIN ] Update success rate: 87.9% (2083/2369 symbols) [2025-09-15T21:11:51.455733] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2083/2369 @ 87.93%)' [2025-09-15T21:11:51.456844] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-15T21:11:51.457113] [INFO ] [STATE ] Last completion updated: 2025-09-15T21:11:51.456923 [2025-09-15T21:11:51.457862] [WARN ] [STATE ] State set to: RUNNING [2025-09-15T21:11:51.458084] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-15T21:11:51.458234] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-15T21:11:51.458285] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-15T21:11:51.460087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-15T21:11:51.460370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-15T21:11:51.460561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-15T21:11:51.460894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-15T21:11:51.461190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-15T21:11:51.461444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-15T21:11:51.461674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-15T21:11:51.461907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-15T21:11:51.462169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-15T21:11:51.462412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-15T21:11:51.462602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-15T21:11:51.462892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-15T21:11:51.463137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-15T21:11:51.463362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-15T21:11:51.463622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-15T21:11:51.463884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-15T21:11:51.464082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-15T21:11:51.464277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-15T21:11:51.464459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-15T21:11:51.464614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-15T21:11:51.464822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-15T21:11:51.465002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-15T21:11:51.465174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-15T21:11:51.465420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-15T21:11:51.465601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-15T21:11:51.465780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-15T21:11:51.465968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-15T21:11:51.466132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-15T21:11:51.466321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-15T21:11:51.466469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-15T21:11:51.466636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-15T21:11:51.466789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-15T21:11:51.466944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-15T21:11:51.467107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-15T21:11:51.467284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-15T21:11:51.467470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-15T21:11:51.467629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-15T21:11:51.467853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-15T21:11:51.468007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-15T21:11:51.468142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-15T21:11:51.468293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-15T21:11:51.468442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-15T21:11:51.468564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-15T21:11:51.468696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-15T21:11:51.468853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-15T21:11:51.469018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-15T21:11:51.469143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-15T21:11:51.469276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-15T21:11:51.469427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-15T21:11:51.469628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-15T21:11:51.469843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-15T21:11:51.470005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-15T21:11:51.470193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-15T21:11:51.470311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-15T21:11:51.470499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-15T21:11:51.470671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-15T21:11:51.470841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-15T21:11:51.470944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-15T21:11:51.471084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-15T21:11:51.471236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-15T21:11:51.471354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-15T21:11:51.471554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-15T21:11:51.471768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-15T21:11:51.471949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-15T21:11:51.472104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-15T21:11:51.472219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-15T21:11:51.472432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-15T21:11:51.472604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-15T21:11:51.472748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-15T21:11:51.472902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-15T21:11:51.473072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-15T21:11:51.473247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-15T21:11:51.473405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-15T21:11:51.473535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-15T21:11:51.473733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-15T21:11:51.473904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-15T21:11:51.474100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-15T21:11:51.474270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-15T21:11:51.474471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-15T21:11:51.474685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-15T21:11:51.474833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-15T21:11:51.475006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-15T21:11:51.475158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-15T21:11:51.475317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-15T21:11:51.475482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-15T21:11:51.475669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-15T21:11:51.475816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-15T21:11:51.475954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-15T21:11:51.476081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-15T21:11:51.476219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-15T21:11:51.476350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-15T21:11:51.476526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-15T21:11:51.476765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-15T21:11:51.476884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-15T21:11:51.477012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-15T21:11:51.477129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-15T21:11:51.477304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-15T21:11:51.477448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-15T21:11:51.477660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-15T21:11:51.477772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-15T21:11:51.477900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-15T21:11:51.478033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-15T21:11:51.478185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-15T21:11:51.478299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-15T21:11:51.478456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-15T21:11:51.478733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-15T21:11:51.478848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-15T21:11:51.478955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-15T21:11:51.479093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-15T21:11:51.479218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-15T21:11:51.479350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-15T21:11:51.479480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-15T21:11:51.479615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-15T21:11:51.479768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-15T21:11:51.479939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-15T21:11:51.480069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-15T21:11:51.480192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-15T21:11:51.480324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-15T21:11:51.480483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-15T21:11:51.480625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-15T21:11:51.480785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-15T21:11:51.480919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-15T21:11:51.481067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-15T21:11:51.481247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-15T21:11:51.481404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-15T21:11:51.481542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-15T21:11:51.481707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-15T21:11:51.481844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-15T21:11:51.481964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-15T21:11:51.482104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-15T21:11:51.482258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-15T21:11:51.482369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-15T21:11:51.482490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-15T21:11:51.482603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-15T21:11:51.482747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-15T21:11:51.482868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-15T21:11:51.483006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-15T21:11:51.483130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-09-15T21:11:51.483233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-15T21:11:51.483371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-15T21:11:51.483601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-15T21:11:51.483760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-15T21:11:51.483883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-15T21:11:51.484012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-15T21:11:51.484147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-15T21:11:51.484318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-15T21:11:51.484448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-15T21:11:51.484579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-15T21:11:51.484911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-15T21:11:51.485063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-15T21:11:51.485203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-15T21:11:51.485328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-15T21:11:51.485457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-15T21:11:51.485599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-15T21:11:51.485882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-15T21:11:51.486054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-15T21:11:51.486200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-15T21:11:51.486331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-15T21:11:51.486490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-15T21:11:51.486626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-15T21:11:51.486795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-15T21:11:51.486912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-15T21:11:51.487039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-15T21:11:51.487148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-15T21:11:51.487267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-15T21:11:51.487382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-15T21:11:51.487486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-15T21:11:51.487639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-15T21:11:51.487802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-15T21:11:51.487950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-15T21:11:51.488075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-15T21:11:51.488233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-15T21:11:51.488360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-15T21:11:51.488533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-15T21:11:51.488639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-15T21:11:51.488778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-15T21:11:51.488878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-15T21:11:51.489002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-15T21:11:51.489117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-15T21:11:51.489263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-15T21:11:51.489487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-15T21:11:51.489607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-15T21:11:51.489743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-15T21:11:51.489873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-15T21:11:51.490024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-15T21:11:51.490158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-15T21:11:51.490272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-15T21:11:51.490366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-15T21:11:51.490478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-15T21:11:51.490605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-15T21:11:51.490745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-15T21:11:51.490855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-15T21:11:51.490999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-15T21:11:51.491107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-15T21:11:51.491218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-15T21:11:51.491327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-15T21:11:51.491443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-15T21:11:51.491561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-15T21:11:51.491697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-15T21:11:51.491811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-15T21:11:51.491923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-15T21:11:51.492058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-15T21:11:51.492186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-15T21:11:51.492311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-15T21:11:51.492428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-15T21:11:51.492536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-15T21:11:51.492721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-15T21:11:51.492860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-15T21:11:51.492978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-15T21:11:51.493091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-15T21:11:51.493238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-15T21:11:51.493375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-15T21:11:51.493486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-15T21:11:51.493662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-09-15T21:11:51.493808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-15T21:11:51.493991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-15T21:11:51.494111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-15T21:11:51.494255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-15T21:11:51.494372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRP.csv [2025-09-15T21:11:51.494509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-15T21:11:51.494671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-15T21:11:51.494793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-15T21:11:51.494903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-15T21:11:51.495011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-15T21:11:51.495159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-15T21:11:51.495276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-15T21:11:51.495387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-15T21:11:51.495509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-15T21:11:51.495660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-15T21:11:51.495819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-15T21:11:51.495958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-15T21:11:51.496058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-15T21:11:51.496186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-15T21:11:51.496362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-15T21:11:51.496486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-15T21:11:51.496885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-15T21:11:51.497051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-15T21:11:51.497171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-15T21:11:51.497321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-15T21:11:51.497432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-15T21:11:51.497544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-15T21:11:51.497689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-15T21:11:51.497835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-15T21:11:51.497961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-15T21:11:51.498060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-15T21:11:51.498211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-15T21:11:51.498350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-15T21:11:51.498487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-15T21:11:51.498589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-15T21:11:51.498734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-15T21:11:51.498870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-15T21:11:51.499001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-15T21:11:51.499114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-15T21:11:51.499222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-15T21:11:51.499350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-15T21:11:51.499458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-15T21:11:51.499577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-15T21:11:51.499710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-15T21:11:51.499830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-15T21:11:51.499940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-15T21:11:51.500052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-15T21:11:51.500150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-15T21:11:51.500263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-15T21:11:51.500388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-15T21:11:51.500503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-15T21:11:51.500632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-15T21:11:51.500758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-15T21:11:51.500871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-15T21:11:51.501005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-15T21:11:51.501121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-15T21:11:51.501232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-15T21:11:51.501366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-15T21:11:51.501553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-15T21:11:51.501726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-15T21:11:51.501851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-15T21:11:51.501977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-15T21:11:51.502259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-15T21:11:51.502377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-15T21:11:51.502484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-15T21:11:51.502596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-15T21:11:51.502728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-15T21:11:51.502846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-15T21:11:51.502948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-15T21:11:51.503109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-15T21:11:51.503226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-15T21:11:51.503367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-15T21:11:51.503504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-15T21:11:51.503626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-15T21:11:51.503767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-15T21:11:51.503882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-15T21:11:51.503999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-15T21:11:51.504322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-15T21:11:51.505264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-15T21:11:51.505414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-15T21:11:51.505571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-15T21:11:51.505721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-09-15T21:11:51.505876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-15T21:11:51.506043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-15T21:11:51.506174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-15T21:11:51.506343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-15T21:11:51.506475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-15T21:11:51.506602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-15T21:11:51.506743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-15T21:11:51.506886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-15T21:11:51.507060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-15T21:11:51.507204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-15T21:11:51.507347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-15T21:11:51.507486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-15T21:11:51.507722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-15T21:11:51.507854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-15T21:11:51.507986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-15T21:11:51.508116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-15T21:11:51.508270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-15T21:11:51.508437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-15T21:11:51.508606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XIFR.csv [2025-09-15T21:11:51.508763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-15T21:11:51.508896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-15T21:11:51.509023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-15T21:11:51.509187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-15T21:11:51.509345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-15T21:11:51.509510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-15T21:11:51.509699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-15T21:11:51.509844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-15T21:11:51.510025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-15T21:11:51.510222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-15T21:11:51.510396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-15T21:11:51.510526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-15T21:11:51.510674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-15T21:11:51.510803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-15T21:11:51.511194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-15T21:11:51.511344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-15T21:11:51.511469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-15T21:11:51.511616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-15T21:11:51.512052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INR.csv [2025-09-15T21:11:51.512175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-15T21:11:51.512381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-15T21:11:51.512554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-15T21:11:51.512912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-15T21:11:51.513060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-15T21:11:51.513195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-15T21:11:51.513348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-15T21:11:51.513485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-15T21:11:51.513618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-15T21:11:51.513824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-15T21:11:51.514007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-15T21:11:51.518053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-15T21:11:51.518624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-15T21:11:51.518849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-15T21:11:51.519016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-15T21:11:51.519182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-15T21:11:51.519330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-15T21:11:51.519482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-15T21:11:51.519610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-15T21:11:51.519820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-15T21:11:51.519984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-15T21:11:51.520103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-15T21:11:51.520306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-15T21:11:51.520455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-15T21:11:51.520592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-15T21:11:51.520747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-15T21:11:51.520949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-15T21:11:51.521120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-15T21:11:51.521261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-15T21:11:51.521465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-15T21:11:51.521635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-15T21:11:51.521806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-15T21:11:51.521938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-15T21:11:51.522082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-15T21:11:51.522199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-15T21:11:51.522334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-15T21:11:51.522509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-15T21:11:51.523009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-15T21:11:51.523379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-15T21:11:51.523532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-15T21:11:51.523667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-15T21:11:51.523803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-15T21:11:51.523905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-09-15T21:11:51.524087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-15T21:11:51.524238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-15T21:11:51.524393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-15T21:11:51.524586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-15T21:11:51.524824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-15T21:11:51.524952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-15T21:11:51.525084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-15T21:11:51.525207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-15T21:11:51.525324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-15T21:11:51.525457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-15T21:11:51.525618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-15T21:11:51.525807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-15T21:11:51.525929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-15T21:11:51.526033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-15T21:11:51.526145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-15T21:11:51.526243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-15T21:11:51.526361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-15T21:11:51.526455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-15T21:11:51.526570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-15T21:11:51.526729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-15T21:11:51.526855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-15T21:11:51.527008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-15T21:11:51.527132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-15T21:11:51.527246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-15T21:11:51.527384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-15T21:11:51.527685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-15T21:11:51.527810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-15T21:11:51.527929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-15T21:11:51.528041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-15T21:11:51.528146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-15T21:11:51.528249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-15T21:11:51.528419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-15T21:11:51.528548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-15T21:11:51.528751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-15T21:11:51.528874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-15T21:11:51.529018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-15T21:11:51.529162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-15T21:11:51.529272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-15T21:11:51.529366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-15T21:11:51.529463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-15T21:11:51.529591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRSU.csv [2025-09-15T21:11:51.529737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-15T21:11:51.529880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-15T21:11:51.529988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-15T21:11:51.530114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-15T21:11:51.530222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-15T21:11:51.530333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-15T21:11:51.530467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-15T21:11:51.530582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-15T21:11:51.530934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-15T21:11:51.531102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-15T21:11:51.531228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-15T21:11:51.531351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-15T21:11:51.531454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-15T21:11:51.531591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-15T21:11:51.531737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-15T21:11:51.531861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-15T21:11:51.532143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-15T21:11:51.532304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-15T21:11:51.532445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-15T21:11:51.532548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-15T21:11:51.532678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-15T21:11:51.532791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-15T21:11:51.532925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-15T21:11:51.533033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-15T21:11:51.533168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-15T21:11:51.533305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-15T21:11:51.533444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-15T21:11:51.533560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-15T21:11:51.533800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-15T21:11:51.533937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-15T21:11:51.534047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-15T21:11:51.534179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-15T21:11:51.534314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-15T21:11:51.534476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-15T21:11:51.534590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-15T21:11:51.534720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-15T21:11:51.534845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-15T21:11:51.534969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-15T21:11:51.535084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-15T21:11:51.535203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-15T21:11:51.535349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-15T21:11:51.535499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-15T21:11:51.535635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-15T21:11:51.535789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-15T21:11:51.535911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-15T21:11:51.536024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-15T21:11:51.536150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-15T21:11:51.536262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-15T21:11:51.536382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-15T21:11:51.536522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-15T21:11:51.536675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-15T21:11:51.536787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-15T21:11:51.536904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-15T21:11:51.537011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-15T21:11:51.537121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-15T21:11:51.537232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-15T21:11:51.537375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-15T21:11:51.537510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-15T21:11:51.537632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-15T21:11:51.537795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-15T21:11:51.537923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-15T21:11:51.538047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-15T21:11:51.538153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-15T21:11:51.538343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-15T21:11:51.538815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-15T21:11:51.538944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-15T21:11:51.539054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-15T21:11:51.539201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-15T21:11:51.539318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-15T21:11:51.539437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-15T21:11:51.539558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-15T21:11:51.539679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-15T21:11:51.539804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-15T21:11:51.539929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-15T21:11:51.540043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-15T21:11:51.540185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-15T21:11:51.540300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-15T21:11:51.540411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-15T21:11:51.540531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-15T21:11:51.540660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-15T21:11:51.540791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-15T21:11:51.540899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLOC.csv [2025-09-15T21:11:51.541005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-15T21:11:51.541128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-15T21:11:51.541260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-15T21:11:51.541370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-15T21:11:51.541525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-15T21:11:51.541704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-15T21:11:51.541834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-15T21:11:51.541967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-15T21:11:51.542068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-15T21:11:51.542173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-15T21:11:51.542315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-15T21:11:51.542435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-15T21:11:51.542579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-15T21:11:51.542759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-15T21:11:51.542890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-15T21:11:51.543013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-15T21:11:51.543141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-15T21:11:51.543263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-15T21:11:51.543569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-15T21:11:51.543902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-15T21:11:51.544036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-15T21:11:51.544178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-15T21:11:51.544302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-15T21:11:51.544447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-15T21:11:51.544570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-15T21:11:51.544694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-15T21:11:51.544888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-15T21:11:51.544996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-15T21:11:51.545124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-15T21:11:51.545235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-15T21:11:51.545352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-15T21:11:51.545463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-15T21:11:51.545588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-15T21:11:51.545724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-15T21:11:51.545846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-15T21:11:51.545951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-15T21:11:51.546046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-15T21:11:51.546150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-15T21:11:51.546275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-15T21:11:51.546397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-15T21:11:51.546522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-15T21:11:51.546627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-15T21:11:51.546762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-15T21:11:51.546868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-15T21:11:51.546986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-15T21:11:51.547329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-15T21:11:51.547443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-15T21:11:51.547554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-15T21:11:51.547683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-15T21:11:51.547793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-15T21:11:51.547911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-15T21:11:51.548074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-15T21:11:51.548191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-15T21:11:51.548315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-15T21:11:51.548427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-15T21:11:51.548573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-15T21:11:51.548741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-15T21:11:51.548862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-15T21:11:51.548985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-15T21:11:51.549116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-15T21:11:51.549270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-15T21:11:51.549388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-15T21:11:51.549517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-15T21:11:51.549659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-15T21:11:51.549772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-15T21:11:51.549873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-15T21:11:51.550012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-15T21:11:51.550139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYZ.csv [2025-09-15T21:11:51.550234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-15T21:11:51.550394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-15T21:11:51.550535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-15T21:11:51.550666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-15T21:11:51.550774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-15T21:11:51.550899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-15T21:11:51.551054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-15T21:11:51.551215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-15T21:11:51.551360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-15T21:11:51.551480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-15T21:11:51.551619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-15T21:11:51.552013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-15T21:11:51.552126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-15T21:11:51.552229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-15T21:11:51.552343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-15T21:11:51.552456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-15T21:11:51.552580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-15T21:11:51.552757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-15T21:11:51.552891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-15T21:11:51.553052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-15T21:11:51.553178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-15T21:11:51.553307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-15T21:11:51.553426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-15T21:11:51.553546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-15T21:11:51.553691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-15T21:11:51.553805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-15T21:11:51.553908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-15T21:11:51.554018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-15T21:11:51.554159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-15T21:11:51.554271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-15T21:11:51.554377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-15T21:11:51.554716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-15T21:11:51.554848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-15T21:11:51.555003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-15T21:11:51.555126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-15T21:11:51.555238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-15T21:11:51.555352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-09-15T21:11:51.555469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-15T21:11:51.555600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-15T21:11:51.555740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-15T21:11:51.555844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-15T21:11:51.555967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-15T21:11:51.556151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-15T21:11:51.556272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-15T21:11:51.556374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-15T21:11:51.556493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-15T21:11:51.556610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-15T21:11:51.556742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-15T21:11:51.556851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNR.csv [2025-09-15T21:11:51.556978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-15T21:11:51.557089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-15T21:11:51.557225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-15T21:11:51.557368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-15T21:11:51.557565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-15T21:11:51.557728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-15T21:11:51.557859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-09-15T21:11:51.557989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-15T21:11:51.558112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-15T21:11:51.558228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-15T21:11:51.558348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-15T21:11:51.558466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-15T21:11:51.558603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-15T21:11:51.558792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-15T21:11:51.558930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-15T21:11:51.559045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-15T21:11:51.559372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-15T21:11:51.559482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-15T21:11:51.559610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-15T21:11:51.559803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-15T21:11:51.559917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-15T21:11:51.560023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-15T21:11:51.560131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-09-15T21:11:51.560273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-15T21:11:51.560387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-15T21:11:51.560505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-15T21:11:51.560600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-15T21:11:51.560731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-15T21:11:51.560846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-15T21:11:51.561026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-15T21:11:51.561137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-15T21:11:51.561243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-15T21:11:51.561369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-15T21:11:51.561495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-15T21:11:51.561602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-15T21:11:51.561733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-15T21:11:51.561850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-15T21:11:51.561958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-15T21:11:51.562108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-15T21:11:51.562233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-15T21:11:51.562365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-15T21:11:51.562526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-15T21:11:51.562670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-15T21:11:51.562782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-15T21:11:51.562894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-15T21:11:51.563039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-15T21:11:51.563138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-15T21:11:51.563244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-15T21:11:51.563359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-15T21:11:51.563463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-15T21:11:51.563569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-15T21:11:51.563722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-15T21:11:51.563969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-15T21:11:51.564078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-15T21:11:51.564205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-15T21:11:51.564317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-15T21:11:51.564420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-15T21:11:51.564534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-15T21:11:51.564928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-15T21:11:51.565051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-15T21:11:51.565162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-15T21:11:51.565264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-15T21:11:51.565362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWTP.csv [2025-09-15T21:11:51.565476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-15T21:11:51.565575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-15T21:11:51.565729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-15T21:11:51.565876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-15T21:11:51.565997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-15T21:11:51.566114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-15T21:11:51.566249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-15T21:11:51.566410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-15T21:11:51.566527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-15T21:11:51.566672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-15T21:11:51.566784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-15T21:11:51.566885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-15T21:11:51.566983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-15T21:11:51.567103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-15T21:11:51.567218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-15T21:11:51.567330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-15T21:11:51.567437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-15T21:11:51.567858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-15T21:11:51.567985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-15T21:11:51.568113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-15T21:11:51.568239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-15T21:11:51.568348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-15T21:11:51.568456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-15T21:11:51.568585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-15T21:11:51.568705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-09-15T21:11:51.568851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-15T21:11:51.568959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-15T21:11:51.569092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-15T21:11:51.569204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-15T21:11:51.569299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-15T21:11:51.569417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-15T21:11:51.569536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-15T21:11:51.569674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-15T21:11:51.569780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-15T21:11:51.569888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-15T21:11:51.569993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-15T21:11:51.570092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-15T21:11:51.570202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-15T21:11:51.570303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-15T21:11:51.570422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-15T21:11:51.570527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-15T21:11:51.570853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-15T21:11:51.570958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-15T21:11:51.571068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-15T21:11:51.571171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-15T21:11:51.571270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-15T21:11:51.571381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-15T21:11:51.571482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-15T21:11:51.571659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-15T21:11:51.571798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-15T21:11:51.571900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-15T21:11:51.572007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-15T21:11:51.572118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-15T21:11:51.572225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-15T21:11:51.572329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-15T21:11:51.572454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-15T21:11:51.572558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-15T21:11:51.572688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-15T21:11:51.572797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-15T21:11:51.572914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-15T21:11:51.573013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-15T21:11:51.573122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-15T21:11:51.573249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-15T21:11:51.573358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-15T21:11:51.573449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-15T21:11:51.573568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-15T21:11:51.573734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-15T21:11:51.573864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-15T21:11:51.573979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-15T21:11:51.574084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-15T21:11:51.574217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-15T21:11:51.574327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-15T21:11:51.574436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-15T21:11:51.574772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-15T21:11:51.574883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-15T21:11:51.574996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-09-15T21:11:51.575112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-15T21:11:51.575235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-15T21:11:51.575345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-15T21:11:51.575458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-15T21:11:51.575560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-15T21:11:51.575678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-15T21:11:51.575796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-15T21:11:51.575932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-15T21:11:51.576050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-15T21:11:51.576156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-15T21:11:51.576279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-15T21:11:51.576390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-15T21:11:51.576499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-15T21:11:51.576603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-15T21:11:51.576882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-15T21:11:51.577016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-15T21:11:51.577134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-15T21:11:51.577255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-15T21:11:51.577390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-15T21:11:51.577577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-15T21:11:51.577745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-15T21:11:51.577893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-15T21:11:51.577999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-15T21:11:51.578094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-15T21:11:51.578227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-15T21:11:51.578329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-15T21:11:51.578466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-15T21:11:51.578582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-15T21:11:51.578821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-15T21:11:51.578950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-15T21:11:51.579052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-15T21:11:51.579148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-15T21:11:51.579236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-15T21:11:51.579456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-15T21:11:51.579561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-15T21:11:51.579695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-15T21:11:51.579808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-15T21:11:51.579910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-15T21:11:51.580038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-15T21:11:51.580174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-15T21:11:51.580287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-15T21:11:51.580440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-15T21:11:51.580543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-15T21:11:51.580707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-15T21:11:51.580837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-15T21:11:51.580981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-15T21:11:51.581089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-15T21:11:51.581249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-15T21:11:51.581360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-15T21:11:51.581480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-15T21:11:51.581617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-15T21:11:51.581783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-15T21:11:51.581913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-15T21:11:51.582016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-15T21:11:51.582124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-15T21:11:51.582267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-15T21:11:51.582388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-15T21:11:51.582495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-15T21:11:51.582875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-15T21:11:51.582990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-15T21:11:51.583093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-15T21:11:51.583239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-15T21:11:51.583418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-15T21:11:51.583530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-15T21:11:51.583652] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-15T21:11:51.583765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-15T21:11:51.583878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-15T21:11:51.583993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-15T21:11:51.584106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-15T21:11:51.584240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-15T21:11:51.584357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-15T21:11:51.584457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-15T21:11:51.584573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-15T21:11:51.584695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-15T21:11:51.584806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-15T21:11:51.584909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-15T21:11:51.585012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-15T21:11:51.585111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VG.csv [2025-09-15T21:11:51.585215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-15T21:11:51.585359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-15T21:11:51.585468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-15T21:11:51.585571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-15T21:11:51.585740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-15T21:11:51.585866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-15T21:11:51.585995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-15T21:11:51.586092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-15T21:11:51.586203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-15T21:11:51.586319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-15T21:11:51.586430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-15T21:11:51.586539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-15T21:11:51.586854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-15T21:11:51.586964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-15T21:11:51.587069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-15T21:11:51.587168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-15T21:11:51.587268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-15T21:11:51.587373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-15T21:11:51.587466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-15T21:11:51.587600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-15T21:11:51.587724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-15T21:11:51.587837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-15T21:11:51.587965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-09-15T21:11:51.588073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-15T21:11:51.588178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-15T21:11:51.588285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-15T21:11:51.588441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AACT.csv [2025-09-15T21:11:51.588555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-15T21:11:51.588847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-15T21:11:51.588962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-15T21:11:51.589067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-15T21:11:51.589203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-15T21:11:51.589309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-15T21:11:51.589407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-15T21:11:51.589551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-15T21:11:51.589708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-15T21:11:51.589825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-15T21:11:51.589936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-15T21:11:51.590039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-15T21:11:51.590154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-15T21:11:51.590264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-15T21:11:51.590392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-15T21:11:51.590517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-15T21:11:51.590623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-15T21:11:51.590744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-15T21:11:51.590840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-15T21:11:51.590941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-15T21:11:51.591074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-15T21:11:51.591196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-15T21:11:51.591317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-15T21:11:51.591414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-15T21:11:51.591794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-15T21:11:51.591903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-15T21:11:51.592021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-15T21:11:51.592132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-15T21:11:51.592231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-15T21:11:51.592350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-15T21:11:51.592459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-15T21:11:51.592555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-15T21:11:51.592673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-15T21:11:51.592806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-15T21:11:51.592918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-15T21:11:51.593018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-15T21:11:51.593130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-15T21:11:51.593238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-15T21:11:51.593352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-15T21:11:51.593458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-15T21:11:51.593573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-15T21:11:51.593702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-15T21:11:51.593804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-15T21:11:51.593910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-15T21:11:51.594015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-15T21:11:51.594194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-15T21:11:51.594318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-15T21:11:51.594432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-15T21:11:51.594547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-15T21:11:51.594951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-15T21:11:51.595084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-15T21:11:51.595200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-15T21:11:51.595308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-15T21:11:51.595410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-15T21:11:51.595504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-15T21:11:51.595609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-15T21:11:51.595727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-15T21:11:51.595828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-15T21:11:51.595933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-15T21:11:51.596030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-15T21:11:51.596135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-15T21:11:51.596233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-15T21:11:51.596345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-15T21:11:51.596487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-15T21:11:51.596585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-15T21:11:51.596713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-15T21:11:51.596811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-15T21:11:51.596905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-15T21:11:51.597023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-15T21:11:51.597124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-15T21:11:51.597222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-15T21:11:51.597554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-15T21:11:51.597709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-15T21:11:51.597815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-15T21:11:51.597910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMO.csv [2025-09-15T21:11:51.598016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-15T21:11:51.598127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-15T21:11:51.598253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-15T21:11:51.598382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-15T21:11:51.598480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-15T21:11:51.598574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-15T21:11:51.598873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-15T21:11:51.598989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-15T21:11:51.599101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-15T21:11:51.599205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-15T21:11:51.599314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-15T21:11:51.599423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-15T21:11:51.599553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-15T21:11:51.599683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-15T21:11:51.599794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-15T21:11:51.599909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-15T21:11:51.600002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-15T21:11:51.600126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-15T21:11:51.600233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-15T21:11:51.600335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-15T21:11:51.600437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-15T21:11:51.600552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-15T21:11:51.600697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-15T21:11:51.600809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-15T21:11:51.600906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-15T21:11:51.601041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-15T21:11:51.601186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-15T21:11:51.601316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-15T21:11:51.601420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-15T21:11:51.601515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-15T21:11:51.601612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-15T21:11:51.601750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-15T21:11:51.601857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-15T21:11:51.602140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-15T21:11:51.602250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-15T21:11:51.602384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-15T21:11:51.602490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-15T21:11:51.602600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-15T21:11:51.602726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-15T21:11:51.602834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-15T21:11:51.602936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-15T21:11:51.603050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-15T21:11:51.603153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-15T21:11:51.603262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-15T21:11:51.603363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-15T21:11:51.603475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-15T21:11:51.603568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-15T21:11:51.603689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-15T21:11:51.603798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-15T21:11:51.603934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-15T21:11:51.604072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-15T21:11:51.604244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-15T21:11:51.604359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-15T21:11:51.604472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-15T21:11:51.604563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-15T21:11:51.604717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-15T21:11:51.604859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-15T21:11:51.604991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-15T21:11:51.605145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-15T21:11:51.605319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-15T21:11:51.605437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-15T21:11:51.605540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-15T21:11:51.605685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-15T21:11:51.605800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-15T21:11:51.605910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-15T21:11:51.606017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-15T21:11:51.606183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-15T21:11:51.606300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-15T21:11:51.606406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-15T21:11:51.607012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-15T21:11:51.607167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-15T21:11:51.607309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-15T21:11:51.607428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-15T21:11:51.607589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-15T21:11:51.607780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-15T21:11:51.607912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-15T21:11:51.608017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-15T21:11:51.608143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-15T21:11:51.608268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-15T21:11:51.608384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-15T21:11:51.608490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-15T21:11:51.608605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-15T21:11:51.608736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-15T21:11:51.608837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-15T21:11:51.608940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-15T21:11:51.609040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-15T21:11:51.609148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-15T21:11:51.609262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-15T21:11:51.609378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-15T21:11:51.609482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-15T21:11:51.609604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-15T21:11:51.609745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-15T21:11:51.609845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-15T21:11:51.609964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-15T21:11:51.610073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-15T21:11:51.610181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-15T21:11:51.610333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-15T21:11:51.610442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-15T21:11:51.610544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-15T21:11:51.610692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-15T21:11:51.611022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-15T21:11:51.611127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-15T21:11:51.611251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-15T21:11:51.611374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-15T21:11:51.611481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-15T21:11:51.611589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-15T21:11:51.611705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-15T21:11:51.611815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-15T21:11:51.611932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-15T21:11:51.612037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-15T21:11:51.612135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-15T21:11:51.612252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-15T21:11:51.612365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-15T21:11:51.612482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-15T21:11:51.612587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-15T21:11:51.612708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-15T21:11:51.612801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-15T21:11:51.612901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-15T21:11:51.613020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-15T21:11:51.613173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-15T21:11:51.613290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-15T21:11:51.613390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-15T21:11:51.613500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-15T21:11:51.613608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-15T21:11:51.613734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-15T21:11:51.613830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-15T21:11:51.613925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-15T21:11:51.614021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-15T21:11:51.614144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-15T21:11:51.614265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-15T21:11:51.614388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-15T21:11:51.614486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-15T21:11:51.614597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-15T21:11:51.614811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-15T21:11:51.614907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-15T21:11:51.615015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-15T21:11:51.615116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-15T21:11:51.615231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-15T21:11:51.615373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-15T21:11:51.615468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-15T21:11:51.615596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-15T21:11:51.615756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-15T21:11:51.615906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-15T21:11:51.616015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-15T21:11:51.616112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-15T21:11:51.616460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-15T21:11:51.616575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-15T21:11:51.616724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-15T21:11:51.616874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-15T21:11:51.616991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-15T21:11:51.617095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-15T21:11:51.617197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-15T21:11:51.617315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-15T21:11:51.617419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-15T21:11:51.617525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-15T21:11:51.617633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-15T21:11:51.617776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-15T21:11:51.617876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-15T21:11:51.617976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-15T21:11:51.618076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-15T21:11:51.618186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-15T21:11:51.618288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-15T21:11:51.618390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-15T21:11:51.618498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-15T21:11:51.618600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-15T21:11:51.618885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-15T21:11:51.618997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-15T21:11:51.619098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-15T21:11:51.619191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-15T21:11:51.619294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-15T21:11:51.619446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-15T21:11:51.619602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-15T21:11:51.619732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-15T21:11:51.619887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-15T21:11:51.619981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-15T21:11:51.620123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-15T21:11:51.620246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-15T21:11:51.620367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-15T21:11:51.620508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-15T21:11:51.620681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-15T21:11:51.620787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-15T21:11:51.620917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-15T21:11:51.621019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-15T21:11:51.621119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-15T21:11:51.621231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-15T21:11:51.621624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-15T21:11:51.621764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-15T21:11:51.621877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-15T21:11:51.622025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-15T21:11:51.622265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-15T21:11:51.622389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-15T21:11:51.622504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-15T21:11:51.622608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-15T21:11:51.622726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-15T21:11:51.622836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-15T21:11:51.622954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-15T21:11:51.623083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-15T21:11:51.623185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-15T21:11:51.623293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-15T21:11:51.623400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-15T21:11:51.623512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-15T21:11:51.623676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-15T21:11:51.623790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-15T21:11:51.623904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-15T21:11:51.624027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-15T21:11:51.624223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-15T21:11:51.624376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-15T21:11:51.624482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-15T21:11:51.624593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-15T21:11:51.624716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-15T21:11:51.624834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-15T21:11:51.624951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-15T21:11:51.625053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-15T21:11:51.625153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-15T21:11:51.625267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-15T21:11:51.625379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-15T21:11:51.625477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-15T21:11:51.625575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-15T21:11:51.625926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-15T21:11:51.626059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-15T21:11:51.626161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-15T21:11:51.626271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-15T21:11:51.626366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-15T21:11:51.626464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-15T21:11:51.626561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-15T21:11:51.626722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-15T21:11:51.626868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-15T21:11:51.626985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-09-15T21:11:51.627100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-15T21:11:51.627202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-15T21:11:51.627302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-15T21:11:51.627396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-15T21:11:51.627495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-15T21:11:51.627589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-15T21:11:51.627715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-15T21:11:51.627830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-15T21:11:51.628002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-15T21:11:51.628115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-15T21:11:51.628213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-15T21:11:51.628318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-15T21:11:51.628449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-15T21:11:51.628551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-15T21:11:51.628948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-15T21:11:51.629071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-15T21:11:51.629185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-15T21:11:51.629278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-15T21:11:51.629374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-15T21:11:51.629470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-15T21:11:51.629567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-15T21:11:51.629689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-15T21:11:51.629807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-15T21:11:51.629908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-15T21:11:51.630000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-15T21:11:51.630100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-15T21:11:51.630215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCL.csv [2025-09-15T21:11:51.630323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-15T21:11:51.630426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-15T21:11:51.630518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-15T21:11:51.630617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-15T21:11:51.630739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-15T21:11:51.630891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-15T21:11:51.630996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-15T21:11:51.631088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-15T21:11:51.631228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-15T21:11:51.631371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-15T21:11:51.631478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-15T21:11:51.631579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-15T21:11:51.631687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-15T21:11:51.631817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-15T21:11:51.631944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-15T21:11:51.632050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-15T21:11:51.632150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-15T21:11:51.632288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-15T21:11:51.632409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-15T21:11:51.632512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-15T21:11:51.632609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-15T21:11:51.632754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-15T21:11:51.632869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-15T21:11:51.632981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-15T21:11:51.633101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-15T21:11:51.633204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-09-15T21:11:51.633311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-15T21:11:51.633630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-15T21:11:51.633819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-15T21:11:51.633933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-15T21:11:51.634045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-15T21:11:51.634235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-15T21:11:51.634392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-09-15T21:11:51.634557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-15T21:11:51.634793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-15T21:11:51.634922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-09-15T21:11:51.635024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-15T21:11:51.635134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-15T21:11:51.635269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-15T21:11:51.635421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-15T21:11:51.635580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-15T21:11:51.635711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-15T21:11:51.635830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-15T21:11:51.635936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-15T21:11:51.636040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-15T21:11:51.636137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTR.csv [2025-09-15T21:11:51.636236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-15T21:11:51.636374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-15T21:11:51.636485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-15T21:11:51.636594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-15T21:11:51.636732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-15T21:11:51.636854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-15T21:11:51.636955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-15T21:11:51.637071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-15T21:11:51.637178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-15T21:11:51.637276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-15T21:11:51.637396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-15T21:11:51.637832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-15T21:11:51.637990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-15T21:11:51.638194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-15T21:11:51.638330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-15T21:11:51.638455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-15T21:11:51.638566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-15T21:11:51.638688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-15T21:11:51.638811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-15T21:11:51.638954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-15T21:11:51.639058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-15T21:11:51.639152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-15T21:11:51.639277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-15T21:11:51.639396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-15T21:11:51.639505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-15T21:11:51.639611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-15T21:11:51.639746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-15T21:11:51.639901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-15T21:11:51.640042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-15T21:11:51.640149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-15T21:11:51.640290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-15T21:11:51.640468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-15T21:11:51.640626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-15T21:11:51.640789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-15T21:11:51.640939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-15T21:11:51.641089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-15T21:11:51.641388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-15T21:11:51.641524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-15T21:11:51.641897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-15T21:11:51.642049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-15T21:11:51.642158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-15T21:11:51.642284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-15T21:11:51.642451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-15T21:11:51.642582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-15T21:11:51.642766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-15T21:11:51.642909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-15T21:11:51.643037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-15T21:11:51.643366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-15T21:11:51.643508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-15T21:11:51.643671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-15T21:11:51.643829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-15T21:11:51.643958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-15T21:11:51.644080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-15T21:11:51.644242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-15T21:11:51.644394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-15T21:11:51.644506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-15T21:11:51.644608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-15T21:11:51.644774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-15T21:11:51.644915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-15T21:11:51.645060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-15T21:11:51.645228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-15T21:11:51.645346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-15T21:11:51.645446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-15T21:11:51.645557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-15T21:11:51.645719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-15T21:11:51.645860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-15T21:11:51.645977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-15T21:11:51.646078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-15T21:11:51.646192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-15T21:11:51.646579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-15T21:11:51.646712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-15T21:11:51.646824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-15T21:11:51.646928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-15T21:11:51.647027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-15T21:11:51.647140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-15T21:11:51.647252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-15T21:11:51.647348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-15T21:11:51.647450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-15T21:11:51.647560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-15T21:11:51.647690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-15T21:11:51.647796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-15T21:11:51.647887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-15T21:11:51.647991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-15T21:11:51.648090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-15T21:11:51.648191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-15T21:11:51.648292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-15T21:11:51.648380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-15T21:11:51.648487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-15T21:11:51.648587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-15T21:11:51.648718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-15T21:11:51.648825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-15T21:11:51.648927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-15T21:11:51.649033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-15T21:11:51.649140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-15T21:11:51.649232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-09-15T21:11:51.649330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-15T21:11:51.649428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-15T21:11:51.649536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-15T21:11:51.649630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-15T21:11:51.649962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-15T21:11:51.650059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-15T21:11:51.650192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-15T21:11:51.650303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-15T21:11:51.650428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-15T21:11:51.650561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-15T21:11:51.650733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-15T21:11:51.650854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-15T21:11:51.650975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-15T21:11:51.651170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-15T21:11:51.651366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-15T21:11:51.651507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-15T21:11:51.651720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-15T21:11:51.651875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-15T21:11:51.652093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-15T21:11:51.652463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-09-15T21:11:51.652583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-15T21:11:51.652774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-15T21:11:51.652912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-15T21:11:51.653053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-15T21:11:51.653230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-15T21:11:51.653393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-15T21:11:51.653544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-15T21:11:51.653671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-15T21:11:51.653818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-15T21:11:51.653932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-15T21:11:51.654035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-15T21:11:51.654180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-15T21:11:51.654286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-15T21:11:51.654401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-15T21:11:51.654521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-15T21:11:51.654676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-15T21:11:51.654830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-15T21:11:51.654934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-15T21:11:51.655043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-15T21:11:51.655163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-15T21:11:51.655561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-15T21:11:51.655734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-15T21:11:51.655865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-15T21:11:51.655987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-15T21:11:51.656119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-15T21:11:51.656259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-15T21:11:51.656403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-15T21:11:51.656553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-15T21:11:51.656762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-15T21:11:51.656925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-15T21:11:51.657050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-15T21:11:51.657180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-15T21:11:51.657299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-15T21:11:51.657411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-15T21:11:51.657510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-15T21:11:51.657610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-15T21:11:51.657953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-15T21:11:51.658055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-15T21:11:51.658145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-15T21:11:51.658281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-15T21:11:51.658406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-15T21:11:51.658507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-15T21:11:51.658603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-15T21:11:51.658728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-15T21:11:51.658863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-15T21:11:51.658967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-15T21:11:51.659065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-15T21:11:51.659200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-15T21:11:51.659328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-15T21:11:51.659441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-15T21:11:51.659537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-15T21:11:51.659897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-15T21:11:51.660007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-15T21:11:51.660110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-15T21:11:51.660212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-15T21:11:51.660304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-15T21:11:51.660437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-15T21:11:51.660562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-15T21:11:51.660731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-15T21:11:51.660871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-15T21:11:51.660986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-15T21:11:51.661095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-15T21:11:51.661212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-15T21:11:51.661334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-15T21:11:51.661438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-15T21:11:51.661586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-15T21:11:51.661742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-15T21:11:51.661859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-15T21:11:51.661980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-15T21:11:51.662182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-15T21:11:51.662327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-15T21:11:51.662487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-15T21:11:51.662685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-15T21:11:51.662854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-15T21:11:51.663002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-15T21:11:51.663136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-15T21:11:51.663301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-15T21:11:51.663477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-15T21:11:51.663665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-15T21:11:51.663821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-15T21:11:51.663984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-15T21:11:51.664141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-15T21:11:51.664256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-15T21:11:51.664374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-15T21:11:51.664488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-15T21:11:51.664600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-15T21:11:51.664758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-15T21:11:51.664879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-15T21:11:51.665252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-15T21:11:51.665390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-15T21:11:51.665507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-15T21:11:51.665927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-15T21:11:51.666077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-15T21:11:51.666227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-15T21:11:51.666368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-15T21:11:51.666520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-15T21:11:51.666715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-15T21:11:51.666904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-15T21:11:51.667126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-15T21:11:51.667321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-15T21:11:51.667540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-15T21:11:51.667788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-15T21:11:51.668026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-15T21:11:51.668215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-15T21:11:51.668378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-15T21:11:51.668546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-15T21:11:51.668748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-15T21:11:51.668912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-15T21:11:51.669115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-15T21:11:51.669258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-15T21:11:51.669398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-15T21:11:51.669528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-15T21:11:51.669703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-15T21:11:51.669867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-15T21:11:51.670024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-15T21:11:51.670165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-15T21:11:51.670335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-15T21:11:51.670672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-15T21:11:51.670773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-15T21:11:51.670874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-15T21:11:51.670978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-15T21:11:51.671076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-15T21:11:51.671169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-15T21:11:51.671273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-15T21:11:51.671372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-15T21:11:51.671468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-15T21:11:51.671570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-15T21:11:51.671693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-15T21:11:51.671793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-15T21:11:51.671895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-15T21:11:51.672000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-15T21:11:51.672099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-15T21:11:51.672194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-15T21:11:51.672302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-09-15T21:11:51.672429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-15T21:11:51.672537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-15T21:11:51.672634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-09-15T21:11:51.672775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-15T21:11:51.672881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-15T21:11:51.672973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-15T21:11:51.673104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-15T21:11:51.673200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-15T21:11:51.673330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-15T21:11:51.673455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-15T21:11:51.673594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-15T21:11:51.673923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-15T21:11:51.674027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-15T21:11:51.674387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-15T21:11:51.674500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-15T21:11:51.674602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-15T21:11:51.674723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-15T21:11:51.674837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-15T21:11:51.674941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-15T21:11:51.675052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-15T21:11:51.675181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-15T21:11:51.675276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-15T21:11:51.675370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-15T21:11:51.675461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-15T21:11:51.675551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-15T21:11:51.675663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTAM.csv [2025-09-15T21:11:51.675770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-15T21:11:51.675874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-15T21:11:51.675970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-15T21:11:51.676057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-15T21:11:51.676149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-15T21:11:51.676251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-15T21:11:51.676366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-15T21:11:51.676475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-15T21:11:51.676587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-15T21:11:51.676720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-15T21:11:51.676830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-15T21:11:51.676919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-15T21:11:51.677017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-15T21:11:51.677124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-15T21:11:51.677224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-15T21:11:51.677321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-15T21:11:51.677409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-15T21:11:51.677510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-15T21:11:51.677605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-15T21:11:51.677733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-15T21:11:51.678148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-15T21:11:51.678254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-15T21:11:51.678367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-15T21:11:51.678485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-15T21:11:51.678576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-15T21:11:51.678685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-15T21:11:51.678793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-15T21:11:51.678891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-15T21:11:51.678985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-15T21:11:51.679085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-15T21:11:51.679178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-15T21:11:51.679271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-15T21:11:51.679389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-15T21:11:51.679482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-15T21:11:51.679574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-15T21:11:51.679699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-15T21:11:51.679824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-15T21:11:51.679922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-15T21:11:51.680020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-15T21:11:51.680118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-15T21:11:51.680224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-15T21:11:51.680342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-15T21:11:51.680466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-15T21:11:51.680568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-15T21:11:51.680751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-15T21:11:51.680854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-15T21:11:51.680951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-15T21:11:51.681051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-15T21:11:51.681159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MO.csv [2025-09-15T21:11:51.681254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-15T21:11:51.681354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-15T21:11:51.681481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-15T21:11:51.681630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-15T21:11:51.681972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-15T21:11:51.682117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-15T21:11:51.682211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-15T21:11:51.682311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-15T21:11:51.682412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-15T21:11:51.682569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-15T21:11:51.682701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-15T21:11:51.682797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-15T21:11:51.682888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-15T21:11:51.682985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-15T21:11:51.683133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-15T21:11:51.683241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-15T21:11:51.683337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-15T21:11:51.683446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-15T21:11:51.683865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-15T21:11:51.683974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-15T21:11:51.684074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-15T21:11:51.684216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-15T21:11:51.684320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-15T21:11:51.684436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-15T21:11:51.684549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-15T21:11:51.684680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-15T21:11:51.684819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-15T21:11:51.684921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-15T21:11:51.685015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-15T21:11:51.685112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-15T21:11:51.685205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-15T21:11:51.685321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-15T21:11:51.685437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-15T21:11:51.685541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-15T21:11:51.685808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-15T21:11:51.685912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-15T21:11:51.686020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-15T21:11:51.686107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-15T21:11:51.686206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-15T21:11:51.686302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-15T21:11:51.686396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-15T21:11:51.686496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-15T21:11:51.686589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-15T21:11:51.686703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-15T21:11:51.686856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-15T21:11:51.686962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSIF.csv [2025-09-15T21:11:51.687063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-15T21:11:51.687209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-15T21:11:51.687313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-15T21:11:51.687410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-15T21:11:51.687513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-15T21:11:51.687605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-15T21:11:51.687733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-15T21:11:51.687834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-15T21:11:51.687930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-15T21:11:51.688022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-15T21:11:51.688115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-15T21:11:51.688206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-15T21:11:51.688693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-15T21:11:51.688818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-15T21:11:51.688922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-15T21:11:51.689015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-15T21:11:51.689107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-15T21:11:51.689205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-15T21:11:51.689303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-15T21:11:51.689399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-15T21:11:51.689487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAR.csv [2025-09-15T21:11:51.689597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-15T21:11:51.689758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-15T21:11:51.689874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-15T21:11:51.689980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-15T21:11:51.690077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-15T21:11:51.690190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-15T21:11:51.690315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-15T21:11:51.690416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-15T21:11:51.690533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-15T21:11:51.690675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-15T21:11:51.690813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-15T21:11:51.690932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-15T21:11:51.691063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-15T21:11:51.691181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-15T21:11:51.691298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-15T21:11:51.691404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-15T21:11:51.691519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-15T21:11:51.691673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-15T21:11:51.691834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-15T21:11:51.691963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-15T21:11:51.692098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-15T21:11:51.692216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-15T21:11:51.692403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-15T21:11:51.692550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-15T21:11:51.692697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-15T21:11:51.692805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-15T21:11:51.692894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-15T21:11:51.693011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-15T21:11:51.693122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-15T21:11:51.693227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-15T21:11:51.693333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-15T21:11:51.693490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-15T21:11:51.693607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-15T21:11:51.693934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-15T21:11:51.694028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-15T21:11:51.694151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-15T21:11:51.694275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-15T21:11:51.694379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-15T21:11:51.694491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-15T21:11:51.694607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-15T21:11:51.694758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-15T21:11:51.694854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-15T21:11:51.694951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-15T21:11:51.695076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-15T21:11:51.695182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-15T21:11:51.695271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-15T21:11:51.695377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-15T21:11:51.695485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-15T21:11:51.695608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-15T21:11:51.695998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-15T21:11:51.696108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-15T21:11:51.696209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-15T21:11:51.696311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-15T21:11:51.696411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-15T21:11:51.696528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-15T21:11:51.696673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-15T21:11:51.696785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-15T21:11:51.696872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-15T21:11:51.696993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-15T21:11:51.697108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-15T21:11:51.697212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-15T21:11:51.697320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-15T21:11:51.697415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-15T21:11:51.697506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-15T21:11:51.697611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-15T21:11:51.697761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-15T21:11:51.697864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-15T21:11:51.697959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-15T21:11:51.698060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-15T21:11:51.698174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-15T21:11:51.698281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-15T21:11:51.698379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-15T21:11:51.698472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-15T21:11:51.698584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-15T21:11:51.698697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-15T21:11:51.698806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-15T21:11:51.698909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-15T21:11:51.699134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-15T21:11:51.699263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-15T21:11:51.699362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-15T21:11:51.699454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-15T21:11:51.699559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-15T21:11:51.699706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-15T21:11:51.699819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-15T21:11:51.699922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-15T21:11:51.700013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-15T21:11:51.700107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-15T21:11:51.700197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-15T21:11:51.700293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-15T21:11:51.700418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-15T21:11:51.700527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-15T21:11:51.700626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-15T21:11:51.701059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-15T21:11:51.701177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-15T21:11:51.701283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-15T21:11:51.701387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-15T21:11:51.701510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-15T21:11:51.701627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-15T21:11:51.701887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-15T21:11:51.701993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-15T21:11:51.702085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-15T21:11:51.702191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-15T21:11:51.702288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-15T21:11:51.702382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-15T21:11:51.702468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-15T21:11:51.702565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-15T21:11:51.702697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-15T21:11:51.702829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-09-15T21:11:51.702933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-15T21:11:51.703029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-15T21:11:51.703122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-15T21:11:51.703223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-15T21:11:51.703329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-15T21:11:51.703423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-15T21:11:51.703508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-15T21:11:51.703613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-15T21:11:51.703733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-15T21:11:51.703831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCD.csv [2025-09-15T21:11:51.703928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-15T21:11:51.704025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-15T21:11:51.704145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-15T21:11:51.704245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-15T21:11:51.704345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-15T21:11:51.704451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-15T21:11:51.704543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-15T21:11:51.704634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-15T21:11:51.704762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-15T21:11:51.704854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-15T21:11:51.705255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-15T21:11:51.705364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-15T21:11:51.705457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-15T21:11:51.705552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-15T21:11:51.705682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-15T21:11:51.705776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-15T21:11:51.705883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-15T21:11:51.705987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-15T21:11:51.706083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-15T21:11:51.706204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-15T21:11:51.706299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-15T21:11:51.706390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGSN.csv [2025-09-15T21:11:51.706482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-15T21:11:51.706574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-15T21:11:51.706691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-15T21:11:51.706826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-15T21:11:51.706926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-15T21:11:51.707031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-15T21:11:51.707124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-15T21:11:51.707215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-15T21:11:51.707331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-15T21:11:51.707431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-15T21:11:51.707524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-15T21:11:51.707635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-15T21:11:51.707757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-15T21:11:51.707864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-15T21:11:51.707954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-15T21:11:51.708057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-15T21:11:51.708185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-15T21:11:51.708284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-15T21:11:51.708399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-15T21:11:51.708511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-15T21:11:51.708613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-15T21:11:51.708742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-15T21:11:51.708858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-15T21:11:51.708954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-15T21:11:51.709052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-15T21:11:51.709153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-15T21:11:51.709254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-15T21:11:51.709360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-15T21:11:51.709455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-15T21:11:51.709556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-15T21:11:51.709860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-15T21:11:51.709985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-15T21:11:51.710092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-15T21:11:51.710197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-15T21:11:51.710616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-15T21:11:51.710773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-15T21:11:51.710900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QBTS.csv [2025-09-15T21:11:51.710999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-15T21:11:51.711095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-15T21:11:51.711198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-15T21:11:51.711329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-15T21:11:51.711435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-15T21:11:51.711559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-15T21:11:51.711708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-15T21:11:51.711806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-15T21:11:51.711905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-15T21:11:51.712027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-15T21:11:51.712179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-15T21:11:51.712358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-15T21:11:51.712585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-15T21:11:51.712850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-15T21:11:51.713133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-15T21:11:51.713275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-15T21:11:51.713412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-15T21:11:51.713549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-15T21:11:51.713710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-15T21:11:51.713843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-15T21:11:51.714251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-15T21:11:51.714402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-15T21:11:51.714528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-15T21:11:51.714670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-15T21:11:51.714820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-15T21:11:51.714959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-15T21:11:51.715102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-15T21:11:51.715235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-15T21:11:51.715387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-15T21:11:51.715594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-15T21:11:51.715837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-15T21:11:51.716061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-15T21:11:51.716230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJF.csv [2025-09-15T21:11:51.716380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-15T21:11:51.716487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-15T21:11:51.716634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-15T21:11:51.716818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-15T21:11:51.716936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-15T21:11:51.717059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-15T21:11:51.717166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-15T21:11:51.717261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-15T21:11:51.718092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-15T21:11:51.718399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-15T21:11:51.718622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-15T21:11:51.718770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-15T21:11:51.718901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-15T21:11:51.719015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-15T21:11:51.719130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-15T21:11:51.719237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-15T21:11:51.719336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-15T21:11:51.719428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-15T21:11:51.719527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-15T21:11:51.719624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-15T21:11:51.719756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-15T21:11:51.719894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-15T21:11:51.720043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-15T21:11:51.720151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-15T21:11:51.720252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-15T21:11:51.720364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-15T21:11:51.720477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-15T21:11:51.720582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-15T21:11:51.720739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-15T21:11:51.720856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-15T21:11:51.720970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-15T21:11:51.721073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-15T21:11:51.721170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-15T21:11:51.721266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-15T21:11:51.721359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLTG.csv [2025-09-15T21:11:51.721465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-15T21:11:51.721615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-15T21:11:51.721774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-15T21:11:51.721880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-15T21:11:51.722020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-15T21:11:51.722156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-15T21:11:51.722258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-15T21:11:51.722378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-15T21:11:51.722479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-15T21:11:51.722568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-15T21:11:51.722713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-15T21:11:51.722820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-15T21:11:51.722916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-15T21:11:51.723007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-15T21:11:51.723137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-15T21:11:51.723306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-15T21:11:51.723455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-15T21:11:51.723593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-15T21:11:51.723754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-15T21:11:51.723896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-15T21:11:51.724047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-15T21:11:51.724206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-15T21:11:51.724322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-15T21:11:51.724467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-15T21:11:51.724590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-15T21:11:51.724750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-15T21:11:51.724892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-15T21:11:51.724988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-15T21:11:51.725092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-15T21:11:51.725183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-15T21:11:51.725284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-15T21:11:51.725379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-15T21:11:51.725485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-15T21:11:51.725581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-15T21:11:51.726331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-15T21:11:51.726448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-15T21:11:51.726542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-15T21:11:51.726636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-15T21:11:51.726751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-15T21:11:51.726842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-15T21:11:51.726957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-15T21:11:51.727108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-15T21:11:51.727237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-15T21:11:51.727333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-15T21:11:51.727427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-15T21:11:51.727583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-15T21:11:51.727700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-15T21:11:51.727809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-15T21:11:51.727903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-15T21:11:51.727997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-15T21:11:51.728096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-15T21:11:51.728185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-15T21:11:51.728274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-15T21:11:51.728415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-15T21:11:51.728538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-15T21:11:51.728636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-15T21:11:51.728765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-15T21:11:51.728873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-15T21:11:51.728976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-15T21:11:51.729091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-15T21:11:51.729183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-15T21:11:51.729274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-15T21:11:51.729365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-15T21:11:51.729454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-15T21:11:51.729555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-15T21:11:51.729817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-15T21:11:51.729926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-15T21:11:51.730054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-15T21:11:51.730150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-15T21:11:51.730249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-15T21:11:51.730352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-15T21:11:51.730448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-15T21:11:51.730549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-15T21:11:51.730659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-15T21:11:51.730768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-15T21:11:51.730937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-15T21:11:51.731056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-15T21:11:51.731159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-15T21:11:51.731257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-15T21:11:51.731369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-15T21:11:51.731487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-15T21:11:51.731587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-15T21:11:51.731709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-15T21:11:51.732298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-15T21:11:51.732414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-15T21:11:51.732510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-15T21:11:51.732611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-15T21:11:51.732741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-15T21:11:51.732840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-15T21:11:51.732930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-15T21:11:51.733029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-15T21:11:51.733140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-15T21:11:51.733234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-15T21:11:51.733371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-15T21:11:51.733481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-15T21:11:51.733572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-15T21:11:51.733699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-15T21:11:51.733813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-15T21:11:51.733913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-15T21:11:51.734016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-15T21:11:51.734136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-15T21:11:51.734265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-15T21:11:51.734362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-15T21:11:51.734469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-15T21:11:51.734566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-15T21:11:51.734680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-15T21:11:51.734783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-15T21:11:51.734883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-15T21:11:51.734989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-15T21:11:51.735090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-15T21:11:51.735184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-15T21:11:51.735275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-15T21:11:51.735416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-15T21:11:51.735527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-15T21:11:51.735623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-15T21:11:51.735737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-15T21:11:51.735876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-15T21:11:51.735978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-15T21:11:51.736074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-15T21:11:51.736196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-15T21:11:51.736326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-15T21:11:51.736463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-15T21:11:51.736572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-15T21:11:51.736761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-15T21:11:51.736894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-15T21:11:51.737057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-15T21:11:51.737237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-15T21:11:51.737373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-15T21:11:51.737509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-15T21:11:51.737638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-15T21:11:51.738312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-15T21:11:51.738467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-15T21:11:51.738623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-15T21:11:51.738807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-15T21:11:51.738946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-15T21:11:51.739082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-15T21:11:51.739203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-15T21:11:51.739300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-15T21:11:51.739425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-15T21:11:51.739534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-15T21:11:51.739630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-15T21:11:51.739800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-15T21:11:51.739906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-15T21:11:51.739998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-15T21:11:51.740100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-15T21:11:51.740190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-15T21:11:51.740305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-15T21:11:51.740404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-15T21:11:51.740505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-15T21:11:51.740602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-15T21:11:51.740722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-15T21:11:51.740835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-15T21:11:51.741429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-15T21:11:51.741555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-15T21:11:51.741679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-15T21:11:51.741790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-15T21:11:51.741883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-15T21:11:51.741984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-15T21:11:51.742086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-15T21:11:51.742189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-15T21:11:51.742286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-15T21:11:51.742379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-15T21:11:51.742473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-15T21:11:51.742570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-15T21:11:51.742680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-15T21:11:51.742781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-15T21:11:51.742868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-15T21:11:51.742980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-15T21:11:51.743120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-15T21:11:51.743216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-15T21:11:51.743314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-15T21:11:51.743432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-15T21:11:51.743536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-15T21:11:51.743637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-15T21:11:51.743749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-15T21:11:51.743842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-15T21:11:51.743931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-15T21:11:51.744023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-15T21:11:51.744110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-15T21:11:51.744225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-15T21:11:51.744318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-15T21:11:51.744423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-15T21:11:51.744533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-15T21:11:51.744632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-15T21:11:51.744771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-15T21:11:51.744881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-15T21:11:51.744988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-15T21:11:51.745105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-15T21:11:51.745198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-15T21:11:51.745305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-15T21:11:51.745411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-15T21:11:51.745603] [INFO ] [LOCAL ] Deleted 2064 derivative data files. [2025-09-15T21:11:51.745787] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-15T21:11:51.747981] [INFO ] [LOCAL ] Found 2083 symbols with primary data. [2025-09-15T21:11:51.748398] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2083 symbols [2025-09-15T21:11:51.750677] [INFO ] [MAIN ] AACT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:51.751652] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:51.751401] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:51.767150] [DEBUG] [LOCAL ] AACT: Loaded 7894 existing records from primary storage. [2025-09-15T21:11:51.772914] [INFO ] [MAIN ] AACT: Loaded 7894 primary data records. [2025-09-15T21:11:51.900162] [DEBUG] [LOCAL ] AB: Loaded 17717 existing records from primary storage. [2025-09-15T21:11:51.911114] [INFO ] [MAIN ] AB: Loaded 17717 primary data records. [2025-09-15T21:11:52.211279] [DEBUG] [LOCAL ] ABBV: Loaded 39654 existing records from primary storage. [2025-09-15T21:11:52.222064] [INFO ] [MAIN ] ABBV: Loaded 39654 primary data records. [2025-09-15T21:11:52.676275] [DEBUG] [MAIN ] AACT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:52.677263] [INFO ] [MAIN ] AACT: Generated 1326 derivative records from 7894 primary records. [2025-09-15T21:11:52.677389] [DEBUG] [LOCAL ] AACT: Saving derivative data. [2025-09-15T21:11:52.694924] [DEBUG] [LOCAL ] AACT: Derivative data saved (1326 records). [2025-09-15T21:11:52.701458] [INFO ] [MAIN ] AACT: Successfully saved derivative data. [2025-09-15T21:11:52.707029] [INFO ] [MAIN ] Derivative Progress: 1/2083 symbols completed. AACT took 1.0s. Estimated remaining: 33m 17s. Rate: 62.6 symbols/min [2025-09-15T21:11:52.707498] [DEBUG] [MAIN ] AB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:52.708890] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:52.708571] [INFO ] [MAIN ] AB: Generated 1326 derivative records from 17717 primary records. [2025-09-15T21:11:52.709278] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-15T21:11:52.735804] [DEBUG] [LOCAL ] AB: Derivative data saved (1326 records). [2025-09-15T21:11:52.741531] [DEBUG] [MAIN ] ABBV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:52.741183] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-15T21:11:52.744274] [INFO ] [MAIN ] Derivative Progress: 2/2083 symbols completed. AB took 1.0s. Estimated remaining: 17m 17s. Rate: 120.5 symbols/min [2025-09-15T21:11:52.742428] [INFO ] [MAIN ] ABBV: Generated 1326 derivative records from 39654 primary records. [2025-09-15T21:11:52.744760] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:52.744518] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-15T21:11:52.762760] [DEBUG] [LOCAL ] ABCB: Loaded 21569 existing records from primary storage. [2025-09-15T21:11:52.763452] [INFO ] [MAIN ] ABCB: Loaded 21569 primary data records. [2025-09-15T21:11:52.866242] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1326 records). [2025-09-15T21:11:52.889815] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-15T21:11:52.953494] [INFO ] [MAIN ] Derivative Progress: 3/2083 symbols completed. ABBV took 1.2s. Estimated remaining: 13m 56s. Rate: 149.3 symbols/min [2025-09-15T21:11:53.041084] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:53.054719] [DEBUG] [LOCAL ] ABEV: Loaded 39288 existing records from primary storage. [2025-09-15T21:11:53.055169] [INFO ] [MAIN ] ABEV: Loaded 39288 primary data records. [2025-09-15T21:11:53.213384] [DEBUG] [LOCAL ] ABG: Loaded 12853 existing records from primary storage. [2025-09-15T21:11:53.231977] [INFO ] [MAIN ] ABG: Loaded 12853 primary data records. [2025-09-15T21:11:53.483832] [DEBUG] [MAIN ] ABCB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:53.530018] [INFO ] [MAIN ] ABCB: Generated 1326 derivative records from 21569 primary records. [2025-09-15T21:11:53.660871] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-15T21:11:53.690362] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1326 records). [2025-09-15T21:11:53.690667] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-15T21:11:53.693930] [INFO ] [MAIN ] Derivative Progress: 4/2083 symbols completed. ABCB took 1.0s. Estimated remaining: 16m 51s. Rate: 123.3 symbols/min [2025-09-15T21:11:53.695336] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:53.711590] [DEBUG] [MAIN ] ABEV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:53.712612] [INFO ] [MAIN ] ABEV: Generated 1326 derivative records from 39288 primary records. [2025-09-15T21:11:53.712990] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-15T21:11:53.730950] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1326 records). [2025-09-15T21:11:53.738403] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-15T21:11:53.739850] [INFO ] [MAIN ] Derivative Progress: 5/2083 symbols completed. ABEV took 1.0s. Estimated remaining: 13m 48s. Rate: 150.6 symbols/min [2025-09-15T21:11:53.751970] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:53.751923] [DEBUG] [MAIN ] ABG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:53.752841] [INFO ] [MAIN ] ABG: Generated 1326 derivative records from 12853 primary records. [2025-09-15T21:11:53.753183] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-15T21:11:53.774287] [DEBUG] [LOCAL ] ABM: Loaded 23119 existing records from primary storage. [2025-09-15T21:11:53.775223] [INFO ] [MAIN ] ABM: Loaded 23119 primary data records. [2025-09-15T21:11:53.820086] [DEBUG] [LOCAL ] ABG: Derivative data saved (1326 records). [2025-09-15T21:11:53.852840] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-15T21:11:53.870623] [INFO ] [MAIN ] Derivative Progress: 6/2083 symbols completed. ABG took 0.8s. Estimated remaining: 12m 15s. Rate: 169.6 symbols/min [2025-09-15T21:11:53.886000] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:54.080201] [DEBUG] [LOCAL ] ABR: Loaded 38398 existing records from primary storage. [2025-09-15T21:11:54.080409] [INFO ] [MAIN ] ABR: Loaded 38398 primary data records. [2025-09-15T21:11:54.285143] [DEBUG] [LOCAL ] ABT: Loaded 39593 existing records from primary storage. [2025-09-15T21:11:54.382426] [INFO ] [MAIN ] ABT: Loaded 39593 primary data records. [2025-09-15T21:11:54.675629] [DEBUG] [MAIN ] ABM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:54.676825] [INFO ] [MAIN ] ABM: Generated 1326 derivative records from 23119 primary records. [2025-09-15T21:11:54.677087] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-15T21:11:54.694575] [DEBUG] [LOCAL ] ABM: Derivative data saved (1326 records). [2025-09-15T21:11:54.695633] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-15T21:11:54.697510] [INFO ] [MAIN ] Derivative Progress: 7/2083 symbols completed. ABM took 1.0s. Estimated remaining: 14m 35s. Rate: 142.4 symbols/min [2025-09-15T21:11:54.697959] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:54.709200] [DEBUG] [MAIN ] ABR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:54.710189] [INFO ] [MAIN ] ABR: Generated 1326 derivative records from 38398 primary records. [2025-09-15T21:11:54.710298] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-15T21:11:54.722571] [DEBUG] [LOCAL ] ABR: Derivative data saved (1326 records). [2025-09-15T21:11:54.726976] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-15T21:11:54.729315] [INFO ] [MAIN ] Derivative Progress: 8/2083 symbols completed. ABR took 1.0s. Estimated remaining: 12m 53s. Rate: 161.0 symbols/min [2025-09-15T21:11:54.729701] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:54.737565] [DEBUG] [LOCAL ] ACA: Loaded 16627 existing records from primary storage. [2025-09-15T21:11:54.738322] [INFO ] [MAIN ] ACA: Loaded 16627 primary data records. [2025-09-15T21:11:54.862294] [DEBUG] [MAIN ] ABT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:54.863033] [INFO ] [MAIN ] ABT: Generated 1326 derivative records from 39593 primary records. [2025-09-15T21:11:54.879390] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-15T21:11:54.950235] [DEBUG] [LOCAL ] ACCO: Loaded 27389 existing records from primary storage. [2025-09-15T21:11:55.024406] [INFO ] [MAIN ] ACCO: Loaded 27389 primary data records. [2025-09-15T21:11:55.146568] [DEBUG] [LOCAL ] ABT: Derivative data saved (1326 records). [2025-09-15T21:11:55.164766] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-15T21:11:55.166756] [INFO ] [MAIN ] Derivative Progress: 9/2083 symbols completed. ABT took 1.3s. Estimated remaining: 13m 8s. Rate: 158.0 symbols/min [2025-09-15T21:11:55.243185] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:55.356731] [DEBUG] [MAIN ] ACA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:55.358414] [INFO ] [MAIN ] ACA: Generated 1326 derivative records from 16627 primary records. [2025-09-15T21:11:55.359972] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-15T21:11:55.383032] [DEBUG] [LOCAL ] ACA: Derivative data saved (1326 records). [2025-09-15T21:11:55.383521] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-15T21:11:55.385452] [INFO ] [MAIN ] Derivative Progress: 10/2083 symbols completed. ACA took 0.7s. Estimated remaining: 12m 34s. Rate: 165.0 symbols/min [2025-09-15T21:11:55.386120] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:55.411881] [DEBUG] [LOCAL ] ACHR: Loaded 39778 existing records from primary storage. [2025-09-15T21:11:55.412182] [DEBUG] [MAIN ] ACCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:55.412377] [INFO ] [MAIN ] ACHR: Loaded 39778 primary data records. [2025-09-15T21:11:55.413236] [INFO ] [MAIN ] ACCO: Generated 1326 derivative records from 27389 primary records. [2025-09-15T21:11:55.413413] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-15T21:11:55.498722] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1326 records). [2025-09-15T21:11:55.533591] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-15T21:11:55.536223] [INFO ] [MAIN ] Derivative Progress: 11/2083 symbols completed. ACCO took 0.8s. Estimated remaining: 11m 54s. Rate: 174.2 symbols/min [2025-09-15T21:11:55.545228] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:55.582105] [DEBUG] [LOCAL ] ACM: Loaded 31167 existing records from primary storage. [2025-09-15T21:11:55.609260] [INFO ] [MAIN ] ACM: Loaded 31167 primary data records. [2025-09-15T21:11:55.859407] [DEBUG] [LOCAL ] ACP: Loaded 22894 existing records from primary storage. [2025-09-15T21:11:55.892343] [INFO ] [MAIN ] ACP: Loaded 22894 primary data records. [2025-09-15T21:11:56.330489] [DEBUG] [MAIN ] ACHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:56.332855] [INFO ] [MAIN ] ACHR: Generated 1326 derivative records from 39778 primary records. [2025-09-15T21:11:56.334342] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-15T21:11:56.358307] [DEBUG] [MAIN ] ACM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:56.360013] [INFO ] [MAIN ] ACM: Generated 1326 derivative records from 31167 primary records. [2025-09-15T21:11:56.360653] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-15T21:11:56.360752] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1326 records). [2025-09-15T21:11:56.361945] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-15T21:11:56.363615] [INFO ] [MAIN ] Derivative Progress: 12/2083 symbols completed. ACHR took 1.1s. Estimated remaining: 13m 17s. Rate: 156.0 symbols/min [2025-09-15T21:11:56.364184] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:56.383737] [DEBUG] [LOCAL ] ACV: Loaded 4587 existing records from primary storage. [2025-09-15T21:11:56.383847] [INFO ] [MAIN ] ACV: Loaded 4587 primary data records. [2025-09-15T21:11:56.384687] [DEBUG] [LOCAL ] ACM: Derivative data saved (1326 records). [2025-09-15T21:11:56.390073] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-15T21:11:56.391682] [INFO ] [MAIN ] Derivative Progress: 13/2083 symbols completed. ACM took 1.0s. Estimated remaining: 12m 19s. Rate: 168.0 symbols/min [2025-09-15T21:11:56.461374] [DEBUG] [MAIN ] ACP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:56.477332] [INFO ] [MAIN ] ACP: Generated 1326 derivative records from 22894 primary records. [2025-09-15T21:11:56.488309] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-15T21:11:56.528143] [DEBUG] [LOCAL ] ACP: Derivative data saved (1326 records). [2025-09-15T21:11:56.538441] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-15T21:11:56.545567] [INFO ] [MAIN ] Derivative Progress: 14/2083 symbols completed. ACP took 1.0s. Estimated remaining: 11m 49s. Rate: 175.1 symbols/min [2025-09-15T21:11:56.697825] [DEBUG] [MAIN ] ACV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:56.698473] [INFO ] [MAIN ] ACV: Generated 1326 derivative records from 4587 primary records. [2025-09-15T21:11:56.698540] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-15T21:11:56.709912] [DEBUG] [LOCAL ] ACV: Derivative data saved (1326 records). [2025-09-15T21:11:56.709970] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-15T21:11:56.711609] [INFO ] [MAIN ] Derivative Progress: 15/2083 symbols completed. ACV took 0.3s. Estimated remaining: 11m 24s. Rate: 181.3 symbols/min [2025-09-15T21:11:56.712313] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:56.712515] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:56.713152] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:56.758129] [DEBUG] [LOCAL ] ADCT: Loaded 25686 existing records from primary storage. [2025-09-15T21:11:56.758385] [INFO ] [MAIN ] ADCT: Loaded 25686 primary data records. [2025-09-15T21:11:56.886678] [DEBUG] [LOCAL ] ACVA: Loaded 35821 existing records from primary storage. [2025-09-15T21:11:56.885914] [DEBUG] [LOCAL ] ADC: Loaded 34268 existing records from primary storage. [2025-09-15T21:11:56.902679] [INFO ] [MAIN ] ACVA: Loaded 35821 primary data records. [2025-09-15T21:11:56.913021] [INFO ] [MAIN ] ADC: Loaded 34268 primary data records. [2025-09-15T21:11:57.600635] [DEBUG] [MAIN ] ADCT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:57.601393] [INFO ] [MAIN ] ADCT: Generated 1326 derivative records from 25686 primary records. [2025-09-15T21:11:57.601693] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-15T21:11:57.614859] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1326 records). [2025-09-15T21:11:57.615232] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-15T21:11:57.616670] [INFO ] [MAIN ] Derivative Progress: 16/2083 symbols completed. ADCT took 0.9s. Estimated remaining: 12m 38s. Rate: 163.6 symbols/min [2025-09-15T21:11:57.616968] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:57.631503] [DEBUG] [MAIN ] ACVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:57.641109] [INFO ] [MAIN ] ACVA: Generated 1326 derivative records from 35821 primary records. [2025-09-15T21:11:57.641306] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-15T21:11:57.641437] [DEBUG] [MAIN ] ADC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:57.642555] [INFO ] [MAIN ] ADC: Generated 1326 derivative records from 34268 primary records. [2025-09-15T21:11:57.651390] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-15T21:11:57.663180] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1326 records). [2025-09-15T21:11:57.663307] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-15T21:11:57.665331] [INFO ] [MAIN ] Derivative Progress: 17/2083 symbols completed. ACVA took 1.0s. Estimated remaining: 11m 59s. Rate: 172.4 symbols/min [2025-09-15T21:11:57.666814] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:57.668574] [DEBUG] [LOCAL ] ADC: Derivative data saved (1326 records). [2025-09-15T21:11:57.668927] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-15T21:11:57.670541] [INFO ] [MAIN ] Derivative Progress: 18/2083 symbols completed. ADC took 1.0s. Estimated remaining: 11m 19s. Rate: 182.4 symbols/min [2025-09-15T21:11:57.680204] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:57.696692] [DEBUG] [LOCAL ] ADM: Loaded 39393 existing records from primary storage. [2025-09-15T21:11:57.696905] [INFO ] [MAIN ] ADM: Loaded 39393 primary data records. [2025-09-15T21:11:57.822451] [DEBUG] [LOCAL ] ADX: Loaded 20404 existing records from primary storage. [2025-09-15T21:11:57.844162] [INFO ] [MAIN ] ADX: Loaded 20404 primary data records. [2025-09-15T21:11:57.979841] [DEBUG] [LOCAL ] ADT: Loaded 39482 existing records from primary storage. [2025-09-15T21:11:58.071371] [INFO ] [MAIN ] ADT: Loaded 39482 primary data records. [2025-09-15T21:11:58.605314] [DEBUG] [MAIN ] ADM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:58.607360] [INFO ] [MAIN ] ADM: Generated 1326 derivative records from 39393 primary records. [2025-09-15T21:11:58.607585] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-15T21:11:58.623615] [DEBUG] [LOCAL ] ADM: Derivative data saved (1326 records). [2025-09-15T21:11:58.623854] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-15T21:11:58.625732] [INFO ] [MAIN ] Derivative Progress: 19/2083 symbols completed. ADM took 1.0s. Estimated remaining: 12m 27s. Rate: 165.8 symbols/min [2025-09-15T21:11:58.626321] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:58.643666] [DEBUG] [MAIN ] ADX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:58.656774] [DEBUG] [LOCAL ] AEFC: Loaded 5866 existing records from primary storage. [2025-09-15T21:11:58.656384] [INFO ] [MAIN ] ADX: Generated 1326 derivative records from 20404 primary records. [2025-09-15T21:11:58.656596] [DEBUG] [MAIN ] ADT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:58.656956] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-15T21:11:58.657015] [INFO ] [MAIN ] AEFC: Loaded 5866 primary data records. [2025-09-15T21:11:58.678591] [INFO ] [MAIN ] ADT: Generated 1326 derivative records from 39482 primary records. [2025-09-15T21:11:58.707269] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-15T21:11:58.783583] [DEBUG] [LOCAL ] ADX: Derivative data saved (1326 records). [2025-09-15T21:11:58.789460] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-15T21:11:58.796419] [INFO ] [MAIN ] Derivative Progress: 20/2083 symbols completed. ADX took 1.1s. Estimated remaining: 12m 7s. Rate: 170.3 symbols/min [2025-09-15T21:11:58.802567] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:58.864356] [DEBUG] [LOCAL ] ADT: Derivative data saved (1326 records). [2025-09-15T21:11:58.959367] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-15T21:11:58.962574] [INFO ] [MAIN ] Derivative Progress: 21/2083 symbols completed. ADT took 1.3s. Estimated remaining: 11m 48s. Rate: 174.6 symbols/min [2025-09-15T21:11:58.963145] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:59.000246] [DEBUG] [LOCAL ] AEG: Loaded 36681 existing records from primary storage. [2025-09-15T21:11:59.006789] [INFO ] [MAIN ] AEG: Loaded 36681 primary data records. [2025-09-15T21:11:59.011370] [DEBUG] [MAIN ] AEFC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:59.065686] [INFO ] [MAIN ] AEFC: Generated 1326 derivative records from 5866 primary records. [2025-09-15T21:11:59.104690] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-15T21:11:59.142383] [DEBUG] [LOCAL ] AEM: Loaded 39467 existing records from primary storage. [2025-09-15T21:11:59.193455] [INFO ] [MAIN ] AEM: Loaded 39467 primary data records. [2025-09-15T21:11:59.245775] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1326 records). [2025-09-15T21:11:59.375244] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-15T21:11:59.410013] [INFO ] [MAIN ] Derivative Progress: 22/2083 symbols completed. AEFC took 0.8s. Estimated remaining: 11m 58s. Rate: 172.3 symbols/min [2025-09-15T21:11:59.427886] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:59.649097] [DEBUG] [MAIN ] AEG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:59.649923] [INFO ] [MAIN ] AEG: Generated 1326 derivative records from 36681 primary records. [2025-09-15T21:11:59.650608] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-15T21:11:59.675013] [DEBUG] [LOCAL ] AEG: Derivative data saved (1326 records). [2025-09-15T21:11:59.675289] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-15T21:11:59.677198] [INFO ] [MAIN ] Derivative Progress: 23/2083 symbols completed. AEG took 0.9s. Estimated remaining: 11m 50s. Rate: 174.0 symbols/min [2025-09-15T21:11:59.678784] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:11:59.678507] [DEBUG] [LOCAL ] AEO: Loaded 39531 existing records from primary storage. [2025-09-15T21:11:59.679205] [INFO ] [MAIN ] AEO: Loaded 39531 primary data records. [2025-09-15T21:11:59.855230] [DEBUG] [MAIN ] AEM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:11:59.864318] [INFO ] [MAIN ] AEM: Generated 1326 derivative records from 39467 primary records. [2025-09-15T21:11:59.885152] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-15T21:11:59.994582] [DEBUG] [LOCAL ] AEM: Derivative data saved (1326 records). [2025-09-15T21:11:59.995343] [DEBUG] [LOCAL ] AER: Loaded 35563 existing records from primary storage. [2025-09-15T21:11:59.995977] [INFO ] [MAIN ] AER: Loaded 35563 primary data records. [2025-09-15T21:11:59.995475] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-15T21:12:00.019623] [INFO ] [MAIN ] Derivative Progress: 24/2083 symbols completed. AEM took 1.1s. Estimated remaining: 11m 50s. Rate: 174.1 symbols/min [2025-09-15T21:12:00.036790] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:00.300213] [DEBUG] [MAIN ] AEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:00.301579] [INFO ] [MAIN ] AEO: Generated 1326 derivative records from 39531 primary records. [2025-09-15T21:12:00.301743] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-15T21:12:00.324760] [DEBUG] [LOCAL ] AES: Loaded 39635 existing records from primary storage. [2025-09-15T21:12:00.326587] [INFO ] [MAIN ] AES: Loaded 39635 primary data records. [2025-09-15T21:12:00.328913] [DEBUG] [LOCAL ] AEO: Derivative data saved (1326 records). [2025-09-15T21:12:00.365149] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-15T21:12:00.395527] [INFO ] [MAIN ] Derivative Progress: 25/2083 symbols completed. AEO took 1.0s. Estimated remaining: 11m 52s. Rate: 173.5 symbols/min [2025-09-15T21:12:00.413192] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:00.647903] [DEBUG] [MAIN ] AER: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:00.648826] [INFO ] [MAIN ] AER: Generated 1326 derivative records from 35563 primary records. [2025-09-15T21:12:00.648975] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-15T21:12:00.673685] [DEBUG] [LOCAL ] AER: Derivative data saved (1326 records). [2025-09-15T21:12:00.674011] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-15T21:12:00.676298] [INFO ] [MAIN ] Derivative Progress: 26/2083 symbols completed. AER took 1.0s. Estimated remaining: 11m 46s. Rate: 174.7 symbols/min [2025-09-15T21:12:00.676569] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:00.693914] [DEBUG] [LOCAL ] AESI: Loaded 36439 existing records from primary storage. [2025-09-15T21:12:00.694325] [INFO ] [MAIN ] AESI: Loaded 36439 primary data records. [2025-09-15T21:12:00.753362] [DEBUG] [LOCAL ] AFB: Loaded 7849 existing records from primary storage. [2025-09-15T21:12:00.779061] [INFO ] [MAIN ] AFB: Loaded 7849 primary data records. [2025-09-15T21:12:00.991227] [DEBUG] [MAIN ] AES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:00.995607] [INFO ] [MAIN ] AES: Generated 1326 derivative records from 39635 primary records. [2025-09-15T21:12:01.104824] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-15T21:12:01.274885] [DEBUG] [LOCAL ] AES: Derivative data saved (1326 records). [2025-09-15T21:12:01.276542] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-15T21:12:01.279474] [INFO ] [MAIN ] Derivative Progress: 27/2083 symbols completed. AES took 1.2s. Estimated remaining: 12m 6s. Rate: 170.0 symbols/min [2025-09-15T21:12:01.280181] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:01.300505] [DEBUG] [MAIN ] AESI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:01.301459] [INFO ] [MAIN ] AESI: Generated 1326 derivative records from 36439 primary records. [2025-09-15T21:12:01.301878] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-15T21:12:01.330529] [DEBUG] [LOCAL ] AESI: Derivative data saved (1326 records). [2025-09-15T21:12:01.331123] [DEBUG] [LOCAL ] AFG: Loaded 23462 existing records from primary storage. [2025-09-15T21:12:01.330724] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-15T21:12:01.341857] [INFO ] [MAIN ] AFG: Loaded 23462 primary data records. [2025-09-15T21:12:01.344003] [INFO ] [MAIN ] Derivative Progress: 28/2083 symbols completed. AESI took 0.9s. Estimated remaining: 11m 44s. Rate: 175.1 symbols/min [2025-09-15T21:12:01.345063] [DEBUG] [MAIN ] AFB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:01.410589] [INFO ] [MAIN ] AFB: Generated 1326 derivative records from 7849 primary records. [2025-09-15T21:12:01.422034] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-15T21:12:01.544869] [DEBUG] [LOCAL ] AFB: Derivative data saved (1326 records). [2025-09-15T21:12:01.554818] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-15T21:12:01.606028] [INFO ] [MAIN ] Derivative Progress: 29/2083 symbols completed. AFB took 0.9s. Estimated remaining: 11m 38s. Rate: 176.5 symbols/min [2025-09-15T21:12:01.660096] [DEBUG] [MAIN ] AFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:01.660844] [INFO ] [MAIN ] AFG: Generated 1326 derivative records from 23462 primary records. [2025-09-15T21:12:01.660909] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-15T21:12:01.672791] [DEBUG] [LOCAL ] AFG: Derivative data saved (1326 records). [2025-09-15T21:12:01.672906] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-15T21:12:01.674967] [INFO ] [MAIN ] Derivative Progress: 30/2083 symbols completed. AFG took 0.4s. Estimated remaining: 11m 19s. Rate: 181.3 symbols/min [2025-09-15T21:12:01.675541] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:01.675632] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:01.676241] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:01.680489] [DEBUG] [LOCAL ] AFGE: Loaded 1879 existing records from primary storage. [2025-09-15T21:12:01.681811] [INFO ] [MAIN ] AFGE: Loaded 1879 primary data records. [2025-09-15T21:12:01.724284] [DEBUG] [LOCAL ] AFGB: Loaded 1640 existing records from primary storage. [2025-09-15T21:12:01.724083] [DEBUG] [LOCAL ] AFGC: Loaded 2025 existing records from primary storage. [2025-09-15T21:12:01.753106] [INFO ] [MAIN ] AFGB: Loaded 1640 primary data records. [2025-09-15T21:12:01.753469] [INFO ] [MAIN ] AFGC: Loaded 2025 primary data records. [2025-09-15T21:12:02.534741] [DEBUG] [MAIN ] AFGE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:02.536033] [INFO ] [MAIN ] AFGE: Generated 1326 derivative records from 1879 primary records. [2025-09-15T21:12:02.536215] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-15T21:12:02.551744] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1326 records). [2025-09-15T21:12:02.561832] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-15T21:12:02.563796] [INFO ] [MAIN ] Derivative Progress: 31/2083 symbols completed. AFGE took 0.9s. Estimated remaining: 11m 56s. Rate: 172.0 symbols/min [2025-09-15T21:12:02.564108] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:02.564475] [DEBUG] [MAIN ] AFGB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:02.575152] [INFO ] [MAIN ] AFGB: Generated 1326 derivative records from 1640 primary records. [2025-09-15T21:12:02.575983] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-15T21:12:02.575838] [DEBUG] [MAIN ] AFGC: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:12:02.577387] [INFO ] [MAIN ] AFGC: Generated 1325 derivative records from 2025 primary records. [2025-09-15T21:12:02.577485] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-15T21:12:02.594701] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1326 records). [2025-09-15T21:12:02.597860] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-15T21:12:02.599682] [INFO ] [MAIN ] Derivative Progress: 32/2083 symbols completed. AFGB took 0.9s. Estimated remaining: 11m 36s. Rate: 176.9 symbols/min [2025-09-15T21:12:02.600390] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:02.601924] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1325 records). [2025-09-15T21:12:02.602351] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-15T21:12:02.604277] [INFO ] [MAIN ] Derivative Progress: 33/2083 symbols completed. AFGC took 0.9s. Estimated remaining: 11m 14s. Rate: 182.4 symbols/min [2025-09-15T21:12:02.604634] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:02.668011] [DEBUG] [LOCAL ] AFL: Loaded 39216 existing records from primary storage. [2025-09-15T21:12:02.678122] [DEBUG] [LOCAL ] AG: Loaded 39606 existing records from primary storage. [2025-09-15T21:12:02.678388] [INFO ] [MAIN ] AG: Loaded 39606 primary data records. [2025-09-15T21:12:02.678497] [INFO ] [MAIN ] AFL: Loaded 39216 primary data records. [2025-09-15T21:12:02.711263] [DEBUG] [LOCAL ] AGCO: Loaded 31094 existing records from primary storage. [2025-09-15T21:12:02.753194] [INFO ] [MAIN ] AGCO: Loaded 31094 primary data records. [2025-09-15T21:12:03.544671] [DEBUG] [MAIN ] AG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:03.545595] [DEBUG] [MAIN ] AFL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:03.546302] [INFO ] [MAIN ] AG: Generated 1326 derivative records from 39606 primary records. [2025-09-15T21:12:03.546405] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-15T21:12:03.547113] [INFO ] [MAIN ] AFL: Generated 1326 derivative records from 39216 primary records. [2025-09-15T21:12:03.548047] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-15T21:12:03.580483] [DEBUG] [MAIN ] AGCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:03.582433] [INFO ] [MAIN ] AGCO: Generated 1326 derivative records from 31094 primary records. [2025-09-15T21:12:03.583378] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-15T21:12:03.585179] [DEBUG] [LOCAL ] AFL: Derivative data saved (1326 records). [2025-09-15T21:12:03.591442] [DEBUG] [LOCAL ] AG: Derivative data saved (1326 records). [2025-09-15T21:12:03.591541] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-15T21:12:03.592236] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-15T21:12:03.594907] [INFO ] [MAIN ] Derivative Progress: 34/2083 symbols completed. AG took 1.0s. Estimated remaining: 11m 54s. Rate: 172.2 symbols/min [2025-09-15T21:12:03.596869] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:03.596976] [INFO ] [MAIN ] Derivative Progress: 35/2083 symbols completed. AFL took 1.0s. Estimated remaining: 11m 33s. Rate: 177.2 symbols/min [2025-09-15T21:12:03.599535] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:03.603474] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1326 records). [2025-09-15T21:12:03.603815] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-15T21:12:03.606487] [INFO ] [MAIN ] Derivative Progress: 36/2083 symbols completed. AGCO took 1.0s. Estimated remaining: 11m 14s. Rate: 182.1 symbols/min [2025-09-15T21:12:03.606956] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:03.622395] [DEBUG] [LOCAL ] AGD: Loaded 13602 existing records from primary storage. [2025-09-15T21:12:03.622624] [INFO ] [MAIN ] AGD: Loaded 13602 primary data records. [2025-09-15T21:12:03.939756] [DEBUG] [LOCAL ] AGI: Loaded 39404 existing records from primary storage. [2025-09-15T21:12:03.940396] [INFO ] [MAIN ] AGI: Loaded 39404 primary data records. [2025-09-15T21:12:03.940325] [DEBUG] [LOCAL ] AGL: Loaded 38685 existing records from primary storage. [2025-09-15T21:12:03.941118] [INFO ] [MAIN ] AGL: Loaded 38685 primary data records. [2025-09-15T21:12:04.494903] [DEBUG] [MAIN ] AGD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:04.496085] [INFO ] [MAIN ] AGD: Generated 1326 derivative records from 13602 primary records. [2025-09-15T21:12:04.496387] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-15T21:12:04.511331] [DEBUG] [LOCAL ] AGD: Derivative data saved (1326 records). [2025-09-15T21:12:04.511609] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-15T21:12:04.514378] [INFO ] [MAIN ] Derivative Progress: 37/2083 symbols completed. AGD took 0.9s. Estimated remaining: 11m 46s. Rate: 173.9 symbols/min [2025-09-15T21:12:04.516405] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:04.528624] [DEBUG] [MAIN ] AGL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:04.529442] [INFO ] [MAIN ] AGL: Generated 1326 derivative records from 38685 primary records. [2025-09-15T21:12:04.529665] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-15T21:12:04.549658] [DEBUG] [LOCAL ] AGM: Loaded 7961 existing records from primary storage. [2025-09-15T21:12:04.550235] [INFO ] [MAIN ] AGM: Loaded 7961 primary data records. [2025-09-15T21:12:04.549439] [DEBUG] [LOCAL ] AGL: Derivative data saved (1326 records). [2025-09-15T21:12:04.570755] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-15T21:12:04.594749] [INFO ] [MAIN ] Derivative Progress: 38/2083 symbols completed. AGL took 1.0s. Estimated remaining: 11m 31s. Rate: 177.5 symbols/min [2025-09-15T21:12:04.641436] [DEBUG] [MAIN ] AGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:04.659879] [INFO ] [MAIN ] AGI: Generated 1326 derivative records from 39404 primary records. [2025-09-15T21:12:04.662879] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-15T21:12:04.659251] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:04.849354] [DEBUG] [LOCAL ] AGI: Derivative data saved (1326 records). [2025-09-15T21:12:04.850398] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-15T21:12:04.852392] [INFO ] [MAIN ] Derivative Progress: 39/2083 symbols completed. AGI took 1.3s. Estimated remaining: 11m 27s. Rate: 178.6 symbols/min [2025-09-15T21:12:04.852690] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:04.862482] [DEBUG] [LOCAL ] AGO: Loaded 20242 existing records from primary storage. [2025-09-15T21:12:04.862786] [INFO ] [MAIN ] AGO: Loaded 20242 primary data records. [2025-09-15T21:12:05.067186] [DEBUG] [LOCAL ] AGRO: Loaded 23968 existing records from primary storage. [2025-09-15T21:12:05.073616] [INFO ] [MAIN ] AGRO: Loaded 23968 primary data records. [2025-09-15T21:12:05.343531] [DEBUG] [MAIN ] AGM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:05.392843] [INFO ] [MAIN ] AGM: Generated 1326 derivative records from 7961 primary records. [2025-09-15T21:12:05.475778] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-15T21:12:05.493331] [DEBUG] [LOCAL ] AGM: Derivative data saved (1326 records). [2025-09-15T21:12:05.493667] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-15T21:12:05.495280] [INFO ] [MAIN ] Derivative Progress: 40/2083 symbols completed. AGM took 1.0s. Estimated remaining: 11m 42s. Rate: 174.6 symbols/min [2025-09-15T21:12:05.496001] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:05.510811] [DEBUG] [MAIN ] AGO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:05.511680] [INFO ] [MAIN ] AGO: Generated 1326 derivative records from 20242 primary records. [2025-09-15T21:12:05.511933] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-15T21:12:05.543241] [DEBUG] [MAIN ] AGRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:05.543766] [DEBUG] [LOCAL ] AGO: Derivative data saved (1326 records). [2025-09-15T21:12:05.544472] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-15T21:12:05.544414] [INFO ] [MAIN ] AGRO: Generated 1326 derivative records from 23968 primary records. [2025-09-15T21:12:05.546422] [INFO ] [MAIN ] Derivative Progress: 41/2083 symbols completed. AGO took 0.9s. Estimated remaining: 11m 27s. Rate: 178.3 symbols/min [2025-09-15T21:12:05.546810] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-15T21:12:05.546773] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:05.560163] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1326 records). [2025-09-15T21:12:05.567527] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-15T21:12:05.569545] [INFO ] [MAIN ] Derivative Progress: 42/2083 symbols completed. AGRO took 0.7s. Estimated remaining: 11m 12s. Rate: 182.3 symbols/min [2025-09-15T21:12:05.570957] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:05.571569] [DEBUG] [LOCAL ] AGX: Loaded 24492 existing records from primary storage. [2025-09-15T21:12:05.571903] [INFO ] [MAIN ] AGX: Loaded 24492 primary data records. [2025-09-15T21:12:05.863633] [DEBUG] [LOCAL ] AHH: Loaded 29529 existing records from primary storage. [2025-09-15T21:12:05.869917] [INFO ] [MAIN ] AHH: Loaded 29529 primary data records. [2025-09-15T21:12:05.987516] [DEBUG] [LOCAL ] AHR: Loaded 36372 existing records from primary storage. [2025-09-15T21:12:05.987895] [INFO ] [MAIN ] AHR: Loaded 36372 primary data records. [2025-09-15T21:12:06.442786] [DEBUG] [MAIN ] AGX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:06.443605] [INFO ] [MAIN ] AGX: Generated 1326 derivative records from 24492 primary records. [2025-09-15T21:12:06.443753] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-15T21:12:06.459587] [DEBUG] [LOCAL ] AGX: Derivative data saved (1326 records). [2025-09-15T21:12:06.460091] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-15T21:12:06.462045] [INFO ] [MAIN ] Derivative Progress: 43/2083 symbols completed. AGX took 1.0s. Estimated remaining: 11m 38s. Rate: 175.3 symbols/min [2025-09-15T21:12:06.478939] [DEBUG] [MAIN ] AHH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:06.479954] [INFO ] [MAIN ] AHH: Generated 1326 derivative records from 29529 primary records. [2025-09-15T21:12:06.480061] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-15T21:12:06.504714] [DEBUG] [MAIN ] AHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:06.505064] [DEBUG] [LOCAL ] AHH: Derivative data saved (1326 records). [2025-09-15T21:12:06.505862] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-15T21:12:06.507633] [INFO ] [MAIN ] AHR: Generated 1326 derivative records from 36372 primary records. [2025-09-15T21:12:06.507538] [INFO ] [MAIN ] Derivative Progress: 44/2083 symbols completed. AHH took 1.0s. Estimated remaining: 11m 24s. Rate: 178.9 symbols/min [2025-09-15T21:12:06.507884] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-15T21:12:06.519732] [DEBUG] [LOCAL ] AHR: Derivative data saved (1326 records). [2025-09-15T21:12:06.519793] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-15T21:12:06.521924] [INFO ] [MAIN ] Derivative Progress: 45/2083 symbols completed. AHR took 1.0s. Estimated remaining: 11m 9s. Rate: 182.8 symbols/min [2025-09-15T21:12:06.522574] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:06.522675] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:06.522510] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:06.530814] [DEBUG] [LOCAL ] AHT: Loaded 4581 existing records from primary storage. [2025-09-15T21:12:06.531014] [INFO ] [MAIN ] AHT: Loaded 4581 primary data records. [2025-09-15T21:12:06.836004] [DEBUG] [LOCAL ] AIG: Loaded 39454 existing records from primary storage. [2025-09-15T21:12:06.836124] [INFO ] [MAIN ] AIG: Loaded 39454 primary data records. [2025-09-15T21:12:06.835358] [DEBUG] [LOCAL ] AI: Loaded 39727 existing records from primary storage. [2025-09-15T21:12:06.868714] [INFO ] [MAIN ] AI: Loaded 39727 primary data records. [2025-09-15T21:12:07.458635] [DEBUG] [MAIN ] AHT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:07.460051] [INFO ] [MAIN ] AHT: Generated 1326 derivative records from 4581 primary records. [2025-09-15T21:12:07.460419] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-15T21:12:07.474412] [DEBUG] [LOCAL ] AHT: Derivative data saved (1326 records). [2025-09-15T21:12:07.474844] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-15T21:12:07.476665] [INFO ] [MAIN ] Derivative Progress: 46/2083 symbols completed. AHT took 1.0s. Estimated remaining: 11m 37s. Rate: 175.5 symbols/min [2025-09-15T21:12:07.476913] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:07.497349] [DEBUG] [MAIN ] AIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:07.507236] [INFO ] [MAIN ] AIG: Generated 1326 derivative records from 39454 primary records. [2025-09-15T21:12:07.506573] [DEBUG] [MAIN ] AI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:07.507358] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-15T21:12:07.507864] [INFO ] [MAIN ] AI: Generated 1326 derivative records from 39727 primary records. [2025-09-15T21:12:07.514147] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-15T21:12:07.523710] [DEBUG] [LOCAL ] AIN: Loaded 17889 existing records from primary storage. [2025-09-15T21:12:07.530310] [INFO ] [MAIN ] AIN: Loaded 17889 primary data records. [2025-09-15T21:12:07.578925] [DEBUG] [LOCAL ] AIG: Derivative data saved (1326 records). [2025-09-15T21:12:07.612968] [DEBUG] [LOCAL ] AI: Derivative data saved (1326 records). [2025-09-15T21:12:07.618140] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-15T21:12:07.605620] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-15T21:12:07.630602] [INFO ] [MAIN ] Derivative Progress: 47/2083 symbols completed. AI took 1.1s. Estimated remaining: 11m 28s. Rate: 177.6 symbols/min [2025-09-15T21:12:07.644356] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:07.644286] [INFO ] [MAIN ] Derivative Progress: 48/2083 symbols completed. AIG took 1.1s. Estimated remaining: 11m 14s. Rate: 181.2 symbols/min [2025-09-15T21:12:07.671524] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:07.811760] [DEBUG] [LOCAL ] AIO: Loaded 9165 existing records from primary storage. [2025-09-15T21:12:07.811936] [INFO ] [MAIN ] AIO: Loaded 9165 primary data records. [2025-09-15T21:12:07.967799] [DEBUG] [LOCAL ] AIR: Loaded 19182 existing records from primary storage. [2025-09-15T21:12:08.003957] [INFO ] [MAIN ] AIR: Loaded 19182 primary data records. [2025-09-15T21:12:08.358190] [DEBUG] [MAIN ] AIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:08.369777] [INFO ] [MAIN ] AIN: Generated 1326 derivative records from 17889 primary records. [2025-09-15T21:12:08.370150] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-15T21:12:08.386145] [DEBUG] [LOCAL ] AIN: Derivative data saved (1326 records). [2025-09-15T21:12:08.386858] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-15T21:12:08.388697] [INFO ] [MAIN ] Derivative Progress: 49/2083 symbols completed. AIN took 0.9s. Estimated remaining: 11m 31s. Rate: 176.7 symbols/min [2025-09-15T21:12:08.389361] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:08.399884] [DEBUG] [MAIN ] AIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:08.400680] [INFO ] [MAIN ] AIO: Generated 1326 derivative records from 9165 primary records. [2025-09-15T21:12:08.401612] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-15T21:12:08.419984] [DEBUG] [LOCAL ] AIO: Derivative data saved (1326 records). [2025-09-15T21:12:08.420268] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-15T21:12:08.422163] [INFO ] [MAIN ] Derivative Progress: 50/2083 symbols completed. AIO took 0.8s. Estimated remaining: 11m 18s. Rate: 179.9 symbols/min [2025-09-15T21:12:08.422389] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:08.432977] [DEBUG] [LOCAL ] AIT: Loaded 20259 existing records from primary storage. [2025-09-15T21:12:08.433211] [INFO ] [MAIN ] AIT: Loaded 20259 primary data records. [2025-09-15T21:12:08.442911] [DEBUG] [MAIN ] AIR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:08.463993] [INFO ] [MAIN ] AIR: Generated 1326 derivative records from 19182 primary records. [2025-09-15T21:12:08.497681] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-15T21:12:08.655225] [DEBUG] [LOCAL ] AIR: Derivative data saved (1326 records). [2025-09-15T21:12:08.655429] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-15T21:12:08.657382] [INFO ] [MAIN ] Derivative Progress: 51/2083 symbols completed. AIR took 1.0s. Estimated remaining: 11m 14s. Rate: 181.0 symbols/min [2025-09-15T21:12:08.739864] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:08.740020] [DEBUG] [LOCAL ] AIV: Loaded 29479 existing records from primary storage. [2025-09-15T21:12:08.740713] [INFO ] [MAIN ] AIV: Loaded 29479 primary data records. [2025-09-15T21:12:08.959198] [DEBUG] [LOCAL ] AIZ: Loaded 22213 existing records from primary storage. [2025-09-15T21:12:09.047395] [INFO ] [MAIN ] AIZ: Loaded 22213 primary data records. [2025-09-15T21:12:09.210087] [DEBUG] [MAIN ] AIT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:09.331773] [INFO ] [MAIN ] AIT: Generated 1326 derivative records from 20259 primary records. [2025-09-15T21:12:09.333130] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-15T21:12:09.349014] [DEBUG] [LOCAL ] AIT: Derivative data saved (1326 records). [2025-09-15T21:12:09.350702] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-15T21:12:09.352990] [INFO ] [MAIN ] Derivative Progress: 52/2083 symbols completed. AIT took 1.0s. Estimated remaining: 11m 28s. Rate: 177.2 symbols/min [2025-09-15T21:12:09.355164] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:09.368104] [DEBUG] [MAIN ] AIV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:09.368850] [INFO ] [MAIN ] AIV: Generated 1326 derivative records from 29479 primary records. [2025-09-15T21:12:09.371425] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-15T21:12:09.372074] [DEBUG] [LOCAL ] AIZN: Loaded 2612 existing records from primary storage. [2025-09-15T21:12:09.372468] [INFO ] [MAIN ] AIZN: Loaded 2612 primary data records. [2025-09-15T21:12:09.502316] [DEBUG] [LOCAL ] AIV: Derivative data saved (1326 records). [2025-09-15T21:12:09.526742] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-15T21:12:09.558637] [INFO ] [MAIN ] Derivative Progress: 53/2083 symbols completed. AIV took 1.1s. Estimated remaining: 11m 22s. Rate: 178.5 symbols/min [2025-09-15T21:12:09.532384] [DEBUG] [MAIN ] AIZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:09.563063] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:09.564154] [INFO ] [MAIN ] AIZ: Generated 1326 derivative records from 22213 primary records. [2025-09-15T21:12:09.592483] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-15T21:12:09.733475] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1326 records). [2025-09-15T21:12:09.734268] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-15T21:12:09.736736] [INFO ] [MAIN ] Derivative Progress: 54/2083 symbols completed. AIZ took 1.0s. Estimated remaining: 11m 16s. Rate: 180.1 symbols/min [2025-09-15T21:12:09.737189] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:09.767266] [DEBUG] [MAIN ] AIZN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:09.767970] [INFO ] [MAIN ] AIZN: Generated 1326 derivative records from 2612 primary records. [2025-09-15T21:12:09.773315] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-15T21:12:09.785126] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1326 records). [2025-09-15T21:12:09.785210] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-15T21:12:09.787340] [INFO ] [MAIN ] Derivative Progress: 55/2083 symbols completed. AIZN took 0.4s. Estimated remaining: 11m 5s. Rate: 182.9 symbols/min [2025-09-15T21:12:09.805337] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:09.809523] [DEBUG] [LOCAL ] AJG: Loaded 34227 existing records from primary storage. [2025-09-15T21:12:09.809854] [INFO ] [MAIN ] AJG: Loaded 34227 primary data records. [2025-09-15T21:12:09.927383] [DEBUG] [LOCAL ] AKR: Loaded 33836 existing records from primary storage. [2025-09-15T21:12:09.957558] [INFO ] [MAIN ] AKR: Loaded 33836 primary data records. [2025-09-15T21:12:10.170603] [DEBUG] [LOCAL ] AL: Loaded 32168 existing records from primary storage. [2025-09-15T21:12:10.219785] [INFO ] [MAIN ] AL: Loaded 32168 primary data records. [2025-09-15T21:12:10.684989] [DEBUG] [MAIN ] AJG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:10.686239] [INFO ] [MAIN ] AJG: Generated 1326 derivative records from 34227 primary records. [2025-09-15T21:12:10.686563] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-15T21:12:10.703062] [DEBUG] [LOCAL ] AJG: Derivative data saved (1326 records). [2025-09-15T21:12:10.703258] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-15T21:12:10.714017] [INFO ] [MAIN ] Derivative Progress: 56/2083 symbols completed. AJG took 1.2s. Estimated remaining: 11m 26s. Rate: 177.2 symbols/min [2025-09-15T21:12:10.714823] [DEBUG] [MAIN ] AKR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:10.715282] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:10.716207] [INFO ] [MAIN ] AKR: Generated 1326 derivative records from 33836 primary records. [2025-09-15T21:12:10.716796] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-15T21:12:10.742381] [DEBUG] [LOCAL ] AKR: Derivative data saved (1326 records). [2025-09-15T21:12:10.741965] [DEBUG] [MAIN ] AL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:10.742596] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-15T21:12:10.744821] [INFO ] [MAIN ] Derivative Progress: 57/2083 symbols completed. AKR took 1.0s. Estimated remaining: 11m 15s. Rate: 180.0 symbols/min [2025-09-15T21:12:10.745570] [INFO ] [MAIN ] AL: Generated 1326 derivative records from 32168 primary records. [2025-09-15T21:12:10.745893] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-15T21:12:10.746685] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:10.758883] [DEBUG] [LOCAL ] AL: Derivative data saved (1326 records). [2025-09-15T21:12:10.758994] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-15T21:12:10.762116] [INFO ] [MAIN ] Derivative Progress: 58/2083 symbols completed. AL took 1.0s. Estimated remaining: 11m 4s. Rate: 183.0 symbols/min [2025-09-15T21:12:10.791175] [DEBUG] [LOCAL ] ALB: Loaded 39419 existing records from primary storage. [2025-09-15T21:12:10.801097] [INFO ] [MAIN ] ALB: Loaded 39419 primary data records. [2025-09-15T21:12:10.958823] [DEBUG] [LOCAL ] ALC: Loaded 37480 existing records from primary storage. [2025-09-15T21:12:10.974477] [INFO ] [MAIN ] ALC: Loaded 37480 primary data records. [2025-09-15T21:12:11.371465] [DEBUG] [MAIN ] ALB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:11.372366] [INFO ] [MAIN ] ALB: Generated 1326 derivative records from 39419 primary records. [2025-09-15T21:12:11.372585] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-15T21:12:11.387931] [DEBUG] [LOCAL ] ALB: Derivative data saved (1326 records). [2025-09-15T21:12:11.388151] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-15T21:12:11.390160] [INFO ] [MAIN ] Derivative Progress: 59/2083 symbols completed. ALB took 0.7s. Estimated remaining: 11m 14s. Rate: 180.2 symbols/min [2025-09-15T21:12:11.399977] [DEBUG] [MAIN ] ALC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:11.400589] [INFO ] [MAIN ] ALC: Generated 1326 derivative records from 37480 primary records. [2025-09-15T21:12:11.400673] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-15T21:12:11.412438] [DEBUG] [LOCAL ] ALC: Derivative data saved (1326 records). [2025-09-15T21:12:11.412519] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-15T21:12:11.414625] [INFO ] [MAIN ] Derivative Progress: 60/2083 symbols completed. ALC took 0.7s. Estimated remaining: 11m 3s. Rate: 183.1 symbols/min [2025-09-15T21:12:11.415295] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:11.415441] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:11.415529] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:11.425974] [DEBUG] [LOCAL ] ALG: Loaded 7302 existing records from primary storage. [2025-09-15T21:12:11.426119] [INFO ] [MAIN ] ALG: Loaded 7302 primary data records. [2025-09-15T21:12:11.643000] [DEBUG] [LOCAL ] ALEX: Loaded 21778 existing records from primary storage. [2025-09-15T21:12:11.643122] [DEBUG] [LOCAL ] ALE: Loaded 22355 existing records from primary storage. [2025-09-15T21:12:11.647738] [INFO ] [MAIN ] ALEX: Loaded 21778 primary data records. [2025-09-15T21:12:11.647940] [INFO ] [MAIN ] ALE: Loaded 22355 primary data records. [2025-09-15T21:12:12.335207] [DEBUG] [MAIN ] ALG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:12.336431] [INFO ] [MAIN ] ALG: Generated 1326 derivative records from 7302 primary records. [2025-09-15T21:12:12.336559] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-15T21:12:12.353428] [DEBUG] [LOCAL ] ALG: Derivative data saved (1326 records). [2025-09-15T21:12:12.353578] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-15T21:12:12.355268] [INFO ] [MAIN ] Derivative Progress: 61/2083 symbols completed. ALG took 0.9s. Estimated remaining: 11m 23s. Rate: 177.6 symbols/min [2025-09-15T21:12:12.355704] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:12.380735] [DEBUG] [MAIN ] ALEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:12.381086] [DEBUG] [MAIN ] ALE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:12.382272] [INFO ] [MAIN ] ALE: Generated 1326 derivative records from 22355 primary records. [2025-09-15T21:12:12.381805] [INFO ] [MAIN ] ALEX: Generated 1326 derivative records from 21778 primary records. [2025-09-15T21:12:12.382382] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-15T21:12:12.383013] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-15T21:12:12.404433] [DEBUG] [LOCAL ] ALE: Derivative data saved (1326 records). [2025-09-15T21:12:12.404977] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-15T21:12:12.407250] [INFO ] [MAIN ] Derivative Progress: 62/2083 symbols completed. ALE took 1.0s. Estimated remaining: 11m 13s. Rate: 180.1 symbols/min [2025-09-15T21:12:12.408367] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:12.418747] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1326 records). [2025-09-15T21:12:12.418821] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-15T21:12:12.421710] [INFO ] [MAIN ] Derivative Progress: 63/2083 symbols completed. ALEX took 1.0s. Estimated remaining: 11m 3s. Rate: 182.8 symbols/min [2025-09-15T21:12:12.422007] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:12.436670] [DEBUG] [LOCAL ] ALIT: Loaded 38839 existing records from primary storage. [2025-09-15T21:12:12.436840] [INFO ] [MAIN ] ALIT: Loaded 38839 primary data records. [2025-09-15T21:12:12.734166] [DEBUG] [LOCAL ] ALK: Loaded 39100 existing records from primary storage. [2025-09-15T21:12:12.755226] [INFO ] [MAIN ] ALK: Loaded 39100 primary data records. [2025-09-15T21:12:12.755883] [DEBUG] [LOCAL ] ALL: Loaded 36718 existing records from primary storage. [2025-09-15T21:12:12.786757] [INFO ] [MAIN ] ALL: Loaded 36718 primary data records. [2025-09-15T21:12:13.317084] [DEBUG] [MAIN ] ALIT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:13.318912] [INFO ] [MAIN ] ALIT: Generated 1326 derivative records from 38839 primary records. [2025-09-15T21:12:13.319199] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-15T21:12:13.334211] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1326 records). [2025-09-15T21:12:13.334451] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-15T21:12:13.336780] [INFO ] [MAIN ] Derivative Progress: 64/2083 symbols completed. ALIT took 1.0s. Estimated remaining: 11m 21s. Rate: 177.9 symbols/min [2025-09-15T21:12:13.337250] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:13.364794] [DEBUG] [MAIN ] ALK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:13.365331] [DEBUG] [MAIN ] ALL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:13.366028] [INFO ] [MAIN ] ALK: Generated 1326 derivative records from 39100 primary records. [2025-09-15T21:12:13.366919] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-15T21:12:13.366858] [INFO ] [MAIN ] ALL: Generated 1326 derivative records from 36718 primary records. [2025-09-15T21:12:13.367098] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-15T21:12:13.398793] [DEBUG] [LOCAL ] ALK: Derivative data saved (1326 records). [2025-09-15T21:12:13.399516] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-15T21:12:13.403618] [INFO ] [MAIN ] Derivative Progress: 65/2083 symbols completed. ALK took 1.0s. Estimated remaining: 11m 12s. Rate: 180.1 symbols/min [2025-09-15T21:12:13.404024] [DEBUG] [LOCAL ] ALL: Derivative data saved (1326 records). [2025-09-15T21:12:13.404630] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:13.404395] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-15T21:12:13.407919] [INFO ] [MAIN ] Derivative Progress: 66/2083 symbols completed. ALL took 1.0s. Estimated remaining: 11m 2s. Rate: 182.8 symbols/min [2025-09-15T21:12:13.408386] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:13.422183] [DEBUG] [LOCAL ] ALLE: Loaded 32812 existing records from primary storage. [2025-09-15T21:12:13.422398] [INFO ] [MAIN ] ALLE: Loaded 32812 primary data records. [2025-09-15T21:12:13.643095] [DEBUG] [LOCAL ] ALLY: Loaded 39217 existing records from primary storage. [2025-09-15T21:12:13.644048] [INFO ] [MAIN ] ALLY: Loaded 39217 primary data records. [2025-09-15T21:12:13.643946] [DEBUG] [LOCAL ] ALSN: Loaded 31418 existing records from primary storage. [2025-09-15T21:12:13.741551] [INFO ] [MAIN ] ALSN: Loaded 31418 primary data records. [2025-09-15T21:12:14.341421] [DEBUG] [MAIN ] ALLE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:14.342406] [INFO ] [MAIN ] ALLE: Generated 1326 derivative records from 32812 primary records. [2025-09-15T21:12:14.343146] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-15T21:12:14.358331] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1326 records). [2025-09-15T21:12:14.358541] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-15T21:12:14.360281] [INFO ] [MAIN ] Derivative Progress: 67/2083 symbols completed. ALLE took 1.0s. Estimated remaining: 11m 20s. Rate: 177.8 symbols/min [2025-09-15T21:12:14.360575] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:14.387684] [DEBUG] [MAIN ] ALLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:14.387996] [DEBUG] [MAIN ] ALSN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:14.392289] [INFO ] [MAIN ] ALLY: Generated 1326 derivative records from 39217 primary records. [2025-09-15T21:12:14.392585] [DEBUG] [LOCAL ] ALUR: Loaded 7335 existing records from primary storage. [2025-09-15T21:12:14.393305] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-15T21:12:14.393246] [INFO ] [MAIN ] ALSN: Generated 1326 derivative records from 31418 primary records. [2025-09-15T21:12:14.394264] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-15T21:12:14.393514] [INFO ] [MAIN ] ALUR: Loaded 7335 primary data records. [2025-09-15T21:12:14.480116] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1326 records). [2025-09-15T21:12:14.494410] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-15T21:12:14.509155] [INFO ] [MAIN ] Derivative Progress: 68/2083 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 14s. Rate: 179.3 symbols/min [2025-09-15T21:12:14.509614] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:14.531097] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1326 records). [2025-09-15T21:12:14.541806] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-15T21:12:14.554249] [INFO ] [MAIN ] Derivative Progress: 69/2083 symbols completed. ALSN took 1.1s. Estimated remaining: 11m 6s. Rate: 181.5 symbols/min [2025-09-15T21:12:14.559836] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:14.713428] [DEBUG] [LOCAL ] ALX: Loaded 5174 existing records from primary storage. [2025-09-15T21:12:14.713625] [INFO ] [MAIN ] ALX: Loaded 5174 primary data records. [2025-09-15T21:12:14.831520] [DEBUG] [LOCAL ] ALV: Loaded 30747 existing records from primary storage. [2025-09-15T21:12:14.837826] [INFO ] [MAIN ] ALV: Loaded 30747 primary data records. [2025-09-15T21:12:15.276477] [DEBUG] [MAIN ] ALUR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:15.278065] [INFO ] [MAIN ] ALUR: Generated 1326 derivative records from 7335 primary records. [2025-09-15T21:12:15.278294] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-15T21:12:15.291702] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1326 records). [2025-09-15T21:12:15.292119] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-15T21:12:15.294029] [INFO ] [MAIN ] Derivative Progress: 70/2083 symbols completed. ALUR took 0.9s. Estimated remaining: 11m 17s. Rate: 178.4 symbols/min [2025-09-15T21:12:15.294415] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:15.310471] [DEBUG] [MAIN ] ALX: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:12:15.311420] [INFO ] [MAIN ] ALX: Generated 1325 derivative records from 5174 primary records. [2025-09-15T21:12:15.311604] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-15T21:12:15.326122] [DEBUG] [LOCAL ] ALX: Derivative data saved (1325 records). [2025-09-15T21:12:15.326318] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-15T21:12:15.328392] [INFO ] [MAIN ] Derivative Progress: 71/2083 symbols completed. ALX took 0.8s. Estimated remaining: 11m 8s. Rate: 180.7 symbols/min [2025-09-15T21:12:15.334869] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:15.338758] [DEBUG] [MAIN ] ALV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:15.339797] [INFO ] [MAIN ] ALV: Generated 1326 derivative records from 30747 primary records. [2025-09-15T21:12:15.340054] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-15T21:12:15.361738] [DEBUG] [LOCAL ] ALV: Derivative data saved (1326 records). [2025-09-15T21:12:15.361893] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-15T21:12:15.364255] [INFO ] [MAIN ] Derivative Progress: 72/2083 symbols completed. ALV took 0.9s. Estimated remaining: 10m 60s. Rate: 182.9 symbols/min [2025-09-15T21:12:15.365190] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:15.377600] [DEBUG] [LOCAL ] AM: Loaded 38259 existing records from primary storage. [2025-09-15T21:12:15.377803] [INFO ] [MAIN ] AM: Loaded 38259 primary data records. [2025-09-15T21:12:15.578416] [DEBUG] [LOCAL ] AMBC: Loaded 26441 existing records from primary storage. [2025-09-15T21:12:15.583168] [INFO ] [MAIN ] AMBC: Loaded 26441 primary data records. [2025-09-15T21:12:15.742512] [DEBUG] [LOCAL ] AMBP: Loaded 33476 existing records from primary storage. [2025-09-15T21:12:15.755022] [INFO ] [MAIN ] AMBP: Loaded 33476 primary data records. [2025-09-15T21:12:16.225081] [DEBUG] [MAIN ] AM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:16.226275] [INFO ] [MAIN ] AM: Generated 1326 derivative records from 38259 primary records. [2025-09-15T21:12:16.226840] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-15T21:12:16.241496] [DEBUG] [LOCAL ] AM: Derivative data saved (1326 records). [2025-09-15T21:12:16.241908] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-15T21:12:16.243777] [INFO ] [MAIN ] Derivative Progress: 73/2083 symbols completed. AM took 0.9s. Estimated remaining: 11m 14s. Rate: 178.8 symbols/min [2025-09-15T21:12:16.267929] [DEBUG] [MAIN ] AMBC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:16.268120] [DEBUG] [MAIN ] AMBP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:16.268740] [INFO ] [MAIN ] AMBC: Generated 1326 derivative records from 26441 primary records. [2025-09-15T21:12:16.269229] [INFO ] [MAIN ] AMBP: Generated 1326 derivative records from 33476 primary records. [2025-09-15T21:12:16.269308] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-15T21:12:16.269370] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-15T21:12:16.290865] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1326 records). [2025-09-15T21:12:16.291314] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-15T21:12:16.293523] [INFO ] [MAIN ] Derivative Progress: 74/2083 symbols completed. AMBC took 1.0s. Estimated remaining: 11m 6s. Rate: 180.9 symbols/min [2025-09-15T21:12:16.293873] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1326 records). [2025-09-15T21:12:16.294054] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-15T21:12:16.297756] [INFO ] [MAIN ] Derivative Progress: 75/2083 symbols completed. AMBP took 0.9s. Estimated remaining: 10m 57s. Rate: 183.3 symbols/min [2025-09-15T21:12:16.298315] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:16.298277] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:16.298150] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:16.368033] [DEBUG] [LOCAL ] AMC: Loaded 39733 existing records from primary storage. [2025-09-15T21:12:16.378734] [INFO ] [MAIN ] AMC: Loaded 39733 primary data records. [2025-09-15T21:12:16.400469] [DEBUG] [LOCAL ] AME: Loaded 35658 existing records from primary storage. [2025-09-15T21:12:16.411679] [DEBUG] [LOCAL ] AMCR: Loaded 39632 existing records from primary storage. [2025-09-15T21:12:16.416887] [INFO ] [MAIN ] AMCR: Loaded 39632 primary data records. [2025-09-15T21:12:16.417028] [INFO ] [MAIN ] AME: Loaded 35658 primary data records. [2025-09-15T21:12:17.217462] [DEBUG] [MAIN ] AMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:17.218249] [INFO ] [MAIN ] AMC: Generated 1326 derivative records from 39733 primary records. [2025-09-15T21:12:17.231740] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-15T21:12:17.232594] [DEBUG] [MAIN ] AMCR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:17.239811] [INFO ] [MAIN ] AMCR: Generated 1326 derivative records from 39632 primary records. [2025-09-15T21:12:17.241147] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-15T21:12:17.246932] [DEBUG] [LOCAL ] AMC: Derivative data saved (1326 records). [2025-09-15T21:12:17.247242] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-15T21:12:17.249589] [INFO ] [MAIN ] Derivative Progress: 76/2083 symbols completed. AMC took 1.0s. Estimated remaining: 11m 13s. Rate: 178.8 symbols/min [2025-09-15T21:12:17.273030] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:17.273267] [DEBUG] [MAIN ] AME: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:17.274942] [INFO ] [MAIN ] AME: Generated 1326 derivative records from 35658 primary records. [2025-09-15T21:12:17.276076] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-15T21:12:17.277538] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1326 records). [2025-09-15T21:12:17.278525] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-15T21:12:17.286408] [INFO ] [MAIN ] Derivative Progress: 77/2083 symbols completed. AMCR took 1.0s. Estimated remaining: 11m 5s. Rate: 180.9 symbols/min [2025-09-15T21:12:17.289856] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:17.292436] [DEBUG] [LOCAL ] AME: Derivative data saved (1326 records). [2025-09-15T21:12:17.296364] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-15T21:12:17.298384] [INFO ] [MAIN ] Derivative Progress: 78/2083 symbols completed. AME took 1.0s. Estimated remaining: 10m 57s. Rate: 183.2 symbols/min [2025-09-15T21:12:17.298896] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:17.305668] [DEBUG] [LOCAL ] AMG: Loaded 14410 existing records from primary storage. [2025-09-15T21:12:17.305816] [INFO ] [MAIN ] AMG: Loaded 14410 primary data records. [2025-09-15T21:12:17.616422] [DEBUG] [LOCAL ] AMN: Loaded 31022 existing records from primary storage. [2025-09-15T21:12:17.617195] [DEBUG] [LOCAL ] AMH: Loaded 38075 existing records from primary storage. [2025-09-15T21:12:17.617448] [INFO ] [MAIN ] AMN: Loaded 31022 primary data records. [2025-09-15T21:12:17.617592] [INFO ] [MAIN ] AMH: Loaded 38075 primary data records. [2025-09-15T21:12:18.172777] [DEBUG] [MAIN ] AMG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:18.174545] [INFO ] [MAIN ] AMG: Generated 1326 derivative records from 14410 primary records. [2025-09-15T21:12:18.176145] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-15T21:12:18.191079] [DEBUG] [LOCAL ] AMG: Derivative data saved (1326 records). [2025-09-15T21:12:18.191881] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-15T21:12:18.193772] [INFO ] [MAIN ] Derivative Progress: 79/2083 symbols completed. AMG took 0.9s. Estimated remaining: 11m 11s. Rate: 179.2 symbols/min [2025-09-15T21:12:18.193967] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:18.205780] [DEBUG] [MAIN ] AMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:18.206707] [INFO ] [MAIN ] AMN: Generated 1326 derivative records from 31022 primary records. [2025-09-15T21:12:18.206890] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-15T21:12:18.222801] [DEBUG] [LOCAL ] AMN: Derivative data saved (1326 records). [2025-09-15T21:12:18.238660] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-15T21:12:18.241583] [INFO ] [MAIN ] Derivative Progress: 80/2083 symbols completed. AMN took 0.9s. Estimated remaining: 11m 3s. Rate: 181.2 symbols/min [2025-09-15T21:12:18.239104] [DEBUG] [MAIN ] AMH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:18.242041] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:18.243053] [INFO ] [MAIN ] AMH: Generated 1326 derivative records from 38075 primary records. [2025-09-15T21:12:18.243592] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-15T21:12:18.263846] [DEBUG] [LOCAL ] AMP: Loaded 23065 existing records from primary storage. [2025-09-15T21:12:18.265732] [INFO ] [MAIN ] AMP: Loaded 23065 primary data records. [2025-09-15T21:12:18.267004] [DEBUG] [LOCAL ] AMH: Derivative data saved (1326 records). [2025-09-15T21:12:18.303790] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-15T21:12:18.325466] [INFO ] [MAIN ] Derivative Progress: 81/2083 symbols completed. AMH took 1.0s. Estimated remaining: 10m 57s. Rate: 182.9 symbols/min [2025-09-15T21:12:18.334575] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:18.474807] [DEBUG] [LOCAL ] AMPX: Loaded 38648 existing records from primary storage. [2025-09-15T21:12:18.474966] [INFO ] [MAIN ] AMPX: Loaded 38648 primary data records. [2025-09-15T21:12:18.723297] [DEBUG] [LOCAL ] AMPY: Loaded 27646 existing records from primary storage. [2025-09-15T21:12:18.753525] [INFO ] [MAIN ] AMPY: Loaded 27646 primary data records. [2025-09-15T21:12:19.222749] [DEBUG] [MAIN ] AMP: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:12:19.223756] [INFO ] [MAIN ] AMP: Generated 1325 derivative records from 23065 primary records. [2025-09-15T21:12:19.224672] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-15T21:12:19.244689] [DEBUG] [LOCAL ] AMP: Derivative data saved (1325 records). [2025-09-15T21:12:19.245195] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-15T21:12:19.247000] [INFO ] [MAIN ] Derivative Progress: 82/2083 symbols completed. AMP took 1.1s. Estimated remaining: 11m 11s. Rate: 178.9 symbols/min [2025-09-15T21:12:19.257824] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:19.258539] [DEBUG] [MAIN ] AMPX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:19.259699] [INFO ] [MAIN ] AMPX: Generated 1326 derivative records from 38648 primary records. [2025-09-15T21:12:19.260028] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-15T21:12:19.272554] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1326 records). [2025-09-15T21:12:19.272759] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-15T21:12:19.275365] [INFO ] [MAIN ] Derivative Progress: 83/2083 symbols completed. AMPX took 1.0s. Estimated remaining: 11m 3s. Rate: 180.9 symbols/min [2025-09-15T21:12:19.275737] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:19.295446] [DEBUG] [MAIN ] AMPY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:19.296264] [INFO ] [MAIN ] AMPY: Generated 1326 derivative records from 27646 primary records. [2025-09-15T21:12:19.296376] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-15T21:12:19.315113] [DEBUG] [LOCAL ] AMR: Loaded 21277 existing records from primary storage. [2025-09-15T21:12:19.325396] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1326 records). [2025-09-15T21:12:19.324927] [INFO ] [MAIN ] AMR: Loaded 21277 primary data records. [2025-09-15T21:12:19.325725] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-15T21:12:19.348621] [INFO ] [MAIN ] Derivative Progress: 84/2083 symbols completed. AMPY took 1.0s. Estimated remaining: 10m 57s. Rate: 182.6 symbols/min [2025-09-15T21:12:19.359104] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:19.444568] [DEBUG] [LOCAL ] AMRC: Loaded 27480 existing records from primary storage. [2025-09-15T21:12:19.444850] [INFO ] [MAIN ] AMRC: Loaded 27480 primary data records. [2025-09-15T21:12:19.827734] [DEBUG] [LOCAL ] AMT: Loaded 38572 existing records from primary storage. [2025-09-15T21:12:19.912922] [INFO ] [MAIN ] AMT: Loaded 38572 primary data records. [2025-09-15T21:12:20.218114] [DEBUG] [MAIN ] AMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:20.220132] [INFO ] [MAIN ] AMR: Generated 1326 derivative records from 21277 primary records. [2025-09-15T21:12:20.231513] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-15T21:12:20.231426] [DEBUG] [MAIN ] AMRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:20.234614] [INFO ] [MAIN ] AMRC: Generated 1326 derivative records from 27480 primary records. [2025-09-15T21:12:20.240767] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-15T21:12:20.257745] [DEBUG] [LOCAL ] AMR: Derivative data saved (1326 records). [2025-09-15T21:12:20.259924] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-15T21:12:20.262166] [INFO ] [MAIN ] Derivative Progress: 85/2083 symbols completed. AMR took 1.0s. Estimated remaining: 11m 10s. Rate: 178.9 symbols/min [2025-09-15T21:12:20.263820] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:20.266412] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1326 records). [2025-09-15T21:12:20.266956] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-15T21:12:20.269210] [INFO ] [MAIN ] Derivative Progress: 86/2083 symbols completed. AMRC took 1.0s. Estimated remaining: 11m 2s. Rate: 180.9 symbols/min [2025-09-15T21:12:20.270066] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:20.285090] [DEBUG] [MAIN ] AMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:20.285999] [INFO ] [MAIN ] AMT: Generated 1326 derivative records from 38572 primary records. [2025-09-15T21:12:20.286107] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-15T21:12:20.302833] [DEBUG] [LOCAL ] AMTD: Loaded 2875 existing records from primary storage. [2025-09-15T21:12:20.303583] [INFO ] [MAIN ] AMTD: Loaded 2875 primary data records. [2025-09-15T21:12:20.347762] [DEBUG] [LOCAL ] AMTB: Loaded 15250 existing records from primary storage. [2025-09-15T21:12:20.355770] [INFO ] [MAIN ] AMTB: Loaded 15250 primary data records. [2025-09-15T21:12:20.409063] [DEBUG] [LOCAL ] AMT: Derivative data saved (1326 records). [2025-09-15T21:12:20.441175] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-15T21:12:20.492611] [INFO ] [MAIN ] Derivative Progress: 87/2083 symbols completed. AMT took 1.1s. Estimated remaining: 10m 59s. Rate: 181.6 symbols/min [2025-09-15T21:12:20.575994] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:20.853880] [DEBUG] [LOCAL ] AMWL: Loaded 6494 existing records from primary storage. [2025-09-15T21:12:20.854495] [INFO ] [MAIN ] AMWL: Loaded 6494 primary data records. [2025-09-15T21:12:21.197708] [DEBUG] [MAIN ] AMTD: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:12:21.199083] [INFO ] [MAIN ] AMTD: Generated 1325 derivative records from 2875 primary records. [2025-09-15T21:12:21.198148] [DEBUG] [MAIN ] AMTB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:21.199727] [INFO ] [MAIN ] AMTB: Generated 1326 derivative records from 15250 primary records. [2025-09-15T21:12:21.199209] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-15T21:12:21.200152] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-15T21:12:21.218100] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1325 records). [2025-09-15T21:12:21.220823] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-15T21:12:21.222973] [INFO ] [MAIN ] Derivative Progress: 88/2083 symbols completed. AMTD took 1.0s. Estimated remaining: 11m 8s. Rate: 179.1 symbols/min [2025-09-15T21:12:21.225989] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1326 records). [2025-09-15T21:12:21.226087] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-15T21:12:21.227999] [INFO ] [MAIN ] Derivative Progress: 89/2083 symbols completed. AMTB took 1.0s. Estimated remaining: 11m 0s. Rate: 181.1 symbols/min [2025-09-15T21:12:21.240565] [DEBUG] [MAIN ] AMWL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:21.241222] [INFO ] [MAIN ] AMWL: Generated 1326 derivative records from 6494 primary records. [2025-09-15T21:12:21.241284] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-15T21:12:21.252462] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1326 records). [2025-09-15T21:12:21.252523] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-15T21:12:21.254796] [INFO ] [MAIN ] Derivative Progress: 90/2083 symbols completed. AMWL took 0.7s. Estimated remaining: 10m 53s. Rate: 183.0 symbols/min [2025-09-15T21:12:21.255264] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:21.255459] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:21.255624] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:21.281712] [DEBUG] [LOCAL ] AN: Loaded 23001 existing records from primary storage. [2025-09-15T21:12:21.289607] [INFO ] [MAIN ] AN: Loaded 23001 primary data records. [2025-09-15T21:12:21.424393] [DEBUG] [LOCAL ] AMX: Loaded 36088 existing records from primary storage. [2025-09-15T21:12:21.428579] [DEBUG] [LOCAL ] ANET: Loaded 39726 existing records from primary storage. [2025-09-15T21:12:21.439148] [INFO ] [MAIN ] ANET: Loaded 39726 primary data records. [2025-09-15T21:12:21.439241] [INFO ] [MAIN ] AMX: Loaded 36088 primary data records. [2025-09-15T21:12:22.171146] [DEBUG] [MAIN ] AN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:22.172156] [INFO ] [MAIN ] AN: Generated 1326 derivative records from 23001 primary records. [2025-09-15T21:12:22.172609] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-15T21:12:22.189192] [DEBUG] [LOCAL ] AN: Derivative data saved (1326 records). [2025-09-15T21:12:22.189393] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-15T21:12:22.191183] [INFO ] [MAIN ] Derivative Progress: 91/2083 symbols completed. AN took 0.9s. Estimated remaining: 11m 6s. Rate: 179.4 symbols/min [2025-09-15T21:12:22.210684] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:22.211263] [DEBUG] [MAIN ] ANET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:22.210933] [DEBUG] [MAIN ] AMX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:22.212327] [INFO ] [MAIN ] ANET: Generated 1326 derivative records from 39726 primary records. [2025-09-15T21:12:22.213271] [INFO ] [MAIN ] AMX: Generated 1326 derivative records from 36088 primary records. [2025-09-15T21:12:22.213360] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-15T21:12:22.213613] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-15T21:12:22.232629] [DEBUG] [LOCAL ] ANET: Derivative data saved (1326 records). [2025-09-15T21:12:22.236539] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-15T21:12:22.239762] [INFO ] [MAIN ] Derivative Progress: 92/2083 symbols completed. ANET took 1.0s. Estimated remaining: 10m 60s. Rate: 181.0 symbols/min [2025-09-15T21:12:22.240469] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:22.245267] [DEBUG] [LOCAL ] AMX: Derivative data saved (1326 records). [2025-09-15T21:12:22.245452] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-15T21:12:22.248437] [INFO ] [MAIN ] Derivative Progress: 93/2083 symbols completed. AMX took 1.0s. Estimated remaining: 10m 53s. Rate: 182.9 symbols/min [2025-09-15T21:12:22.249009] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:22.270053] [DEBUG] [LOCAL ] ANRO: Loaded 13456 existing records from primary storage. [2025-09-15T21:12:22.270217] [INFO ] [MAIN ] ANRO: Loaded 13456 primary data records. [2025-09-15T21:12:22.395129] [DEBUG] [LOCAL ] ANVS: Loaded 17585 existing records from primary storage. [2025-09-15T21:12:22.415686] [INFO ] [MAIN ] ANVS: Loaded 17585 primary data records. [2025-09-15T21:12:22.410431] [DEBUG] [LOCAL ] ANF: Loaded 38417 existing records from primary storage. [2025-09-15T21:12:22.440439] [INFO ] [MAIN ] ANF: Loaded 38417 primary data records. [2025-09-15T21:12:23.128855] [DEBUG] [MAIN ] ANRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:23.129889] [INFO ] [MAIN ] ANRO: Generated 1326 derivative records from 13456 primary records. [2025-09-15T21:12:23.130015] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-15T21:12:23.142393] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1326 records). [2025-09-15T21:12:23.142656] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-15T21:12:23.146591] [INFO ] [MAIN ] Derivative Progress: 94/2083 symbols completed. ANRO took 0.9s. Estimated remaining: 11m 4s. Rate: 179.6 symbols/min [2025-09-15T21:12:23.148054] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:23.161554] [DEBUG] [MAIN ] ANVS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:23.172355] [INFO ] [MAIN ] ANVS: Generated 1326 derivative records from 17585 primary records. [2025-09-15T21:12:23.172741] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-15T21:12:23.173093] [DEBUG] [MAIN ] ANF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:23.179388] [INFO ] [MAIN ] ANF: Generated 1326 derivative records from 38417 primary records. [2025-09-15T21:12:23.179913] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-15T21:12:23.203694] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1326 records). [2025-09-15T21:12:23.206905] [DEBUG] [LOCAL ] AOMR: Loaded 12648 existing records from primary storage. [2025-09-15T21:12:23.207066] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-15T21:12:23.208727] [INFO ] [MAIN ] AOMR: Loaded 12648 primary data records. [2025-09-15T21:12:23.211849] [DEBUG] [LOCAL ] ANF: Derivative data saved (1326 records). [2025-09-15T21:12:23.211281] [INFO ] [MAIN ] Derivative Progress: 95/2083 symbols completed. ANVS took 1.0s. Estimated remaining: 10m 58s. Rate: 181.2 symbols/min [2025-09-15T21:12:23.212004] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-15T21:12:23.223492] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:23.238434] [INFO ] [MAIN ] Derivative Progress: 96/2083 symbols completed. ANF took 1.0s. Estimated remaining: 10m 52s. Rate: 182.9 symbols/min [2025-09-15T21:12:23.254766] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:23.558844] [DEBUG] [LOCAL ] AORT: Loaded 21502 existing records from primary storage. [2025-09-15T21:12:23.559060] [INFO ] [MAIN ] AORT: Loaded 21502 primary data records. [2025-09-15T21:12:23.559714] [DEBUG] [LOCAL ] AON: Loaded 33409 existing records from primary storage. [2025-09-15T21:12:23.559967] [INFO ] [MAIN ] AON: Loaded 33409 primary data records. [2025-09-15T21:12:24.190030] [DEBUG] [MAIN ] AOMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:24.191716] [INFO ] [MAIN ] AOMR: Generated 1326 derivative records from 12648 primary records. [2025-09-15T21:12:24.192910] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-15T21:12:24.207821] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1326 records). [2025-09-15T21:12:24.208385] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-15T21:12:24.210689] [INFO ] [MAIN ] Derivative Progress: 97/2083 symbols completed. AOMR took 1.1s. Estimated remaining: 11m 5s. Rate: 179.3 symbols/min [2025-09-15T21:12:24.212597] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:24.227393] [DEBUG] [MAIN ] AORT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:24.230231] [INFO ] [MAIN ] AORT: Generated 1326 derivative records from 21502 primary records. [2025-09-15T21:12:24.230408] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-15T21:12:24.253120] [DEBUG] [LOCAL ] AORT: Derivative data saved (1326 records). [2025-09-15T21:12:24.254443] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-15T21:12:24.256403] [INFO ] [MAIN ] Derivative Progress: 98/2083 symbols completed. AORT took 1.0s. Estimated remaining: 10m 58s. Rate: 180.9 symbols/min [2025-09-15T21:12:24.256669] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:24.254309] [DEBUG] [MAIN ] AON: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:24.257761] [INFO ] [MAIN ] AON: Generated 1326 derivative records from 33409 primary records. [2025-09-15T21:12:24.258216] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-15T21:12:24.273362] [DEBUG] [LOCAL ] AON: Derivative data saved (1326 records). [2025-09-15T21:12:24.273587] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-15T21:12:24.276983] [INFO ] [MAIN ] Derivative Progress: 99/2083 symbols completed. AON took 1.1s. Estimated remaining: 10m 52s. Rate: 182.6 symbols/min [2025-09-15T21:12:24.277505] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:24.292037] [DEBUG] [LOCAL ] AP: Loaded 5760 existing records from primary storage. [2025-09-15T21:12:24.292772] [INFO ] [MAIN ] AP: Loaded 5760 primary data records. [2025-09-15T21:12:24.415964] [DEBUG] [LOCAL ] AOS: Loaded 36309 existing records from primary storage. [2025-09-15T21:12:24.424605] [INFO ] [MAIN ] AOS: Loaded 36309 primary data records. [2025-09-15T21:12:24.586098] [DEBUG] [LOCAL ] APAM: Loaded 26710 existing records from primary storage. [2025-09-15T21:12:24.629573] [INFO ] [MAIN ] APAM: Loaded 26710 primary data records. [2025-09-15T21:12:25.176928] [DEBUG] [MAIN ] AP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:25.177893] [INFO ] [MAIN ] AP: Generated 1326 derivative records from 5760 primary records. [2025-09-15T21:12:25.178673] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-15T21:12:25.193579] [DEBUG] [LOCAL ] AP: Derivative data saved (1326 records). [2025-09-15T21:12:25.202860] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-15T21:12:25.205109] [INFO ] [MAIN ] Derivative Progress: 100/2083 symbols completed. AP took 0.9s. Estimated remaining: 11m 3s. Rate: 179.3 symbols/min [2025-09-15T21:12:25.203471] [DEBUG] [MAIN ] AOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:25.205330] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:25.206000] [INFO ] [MAIN ] AOS: Generated 1326 derivative records from 36309 primary records. [2025-09-15T21:12:25.206488] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-15T21:12:25.221520] [DEBUG] [LOCAL ] AOS: Derivative data saved (1326 records). [2025-09-15T21:12:25.222856] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-15T21:12:25.225763] [INFO ] [MAIN ] Derivative Progress: 101/2083 symbols completed. AOS took 1.0s. Estimated remaining: 10m 57s. Rate: 181.0 symbols/min [2025-09-15T21:12:25.226183] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:25.236351] [DEBUG] [MAIN ] APAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:25.237225] [INFO ] [MAIN ] APAM: Generated 1326 derivative records from 26710 primary records. [2025-09-15T21:12:25.237377] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-15T21:12:25.250825] [DEBUG] [LOCAL ] APAM: Derivative data saved (1326 records). [2025-09-15T21:12:25.258964] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-15T21:12:25.261167] [INFO ] [MAIN ] Derivative Progress: 102/2083 symbols completed. APAM took 1.0s. Estimated remaining: 10m 51s. Rate: 182.6 symbols/min [2025-09-15T21:12:25.261538] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:25.279518] [DEBUG] [LOCAL ] APD: Loaded 33036 existing records from primary storage. [2025-09-15T21:12:25.279815] [INFO ] [MAIN ] APD: Loaded 33036 primary data records. [2025-09-15T21:12:25.438396] [DEBUG] [LOCAL ] APG: Loaded 37503 existing records from primary storage. [2025-09-15T21:12:25.485920] [INFO ] [MAIN ] APG: Loaded 37503 primary data records. [2025-09-15T21:12:25.668959] [DEBUG] [LOCAL ] APH: Loaded 39651 existing records from primary storage. [2025-09-15T21:12:25.688579] [INFO ] [MAIN ] APH: Loaded 39651 primary data records. [2025-09-15T21:12:26.186925] [DEBUG] [MAIN ] APD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:26.188842] [INFO ] [MAIN ] APD: Generated 1326 derivative records from 33036 primary records. [2025-09-15T21:12:26.189495] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-15T21:12:26.206107] [DEBUG] [LOCAL ] APD: Derivative data saved (1326 records). [2025-09-15T21:12:26.215587] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-15T21:12:26.217925] [INFO ] [MAIN ] Derivative Progress: 103/2083 symbols completed. APD took 1.0s. Estimated remaining: 11m 3s. Rate: 179.3 symbols/min [2025-09-15T21:12:26.215983] [DEBUG] [MAIN ] APG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:26.219046] [INFO ] [MAIN ] APG: Generated 1326 derivative records from 37503 primary records. [2025-09-15T21:12:26.219242] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-15T21:12:26.232474] [DEBUG] [LOCAL ] APG: Derivative data saved (1326 records). [2025-09-15T21:12:26.233091] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-15T21:12:26.234924] [INFO ] [MAIN ] Derivative Progress: 104/2083 symbols completed. APG took 1.0s. Estimated remaining: 10m 56s. Rate: 180.9 symbols/min [2025-09-15T21:12:26.244508] [DEBUG] [MAIN ] APH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:26.245102] [INFO ] [MAIN ] APH: Generated 1326 derivative records from 39651 primary records. [2025-09-15T21:12:26.245163] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-15T21:12:26.256671] [DEBUG] [LOCAL ] APH: Derivative data saved (1326 records). [2025-09-15T21:12:26.256728] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-15T21:12:26.259916] [INFO ] [MAIN ] Derivative Progress: 105/2083 symbols completed. APH took 1.0s. Estimated remaining: 10m 50s. Rate: 182.5 symbols/min [2025-09-15T21:12:26.260509] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:26.260710] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:26.260746] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:26.270824] [DEBUG] [LOCAL ] APOS: Loaded 5181 existing records from primary storage. [2025-09-15T21:12:26.270986] [INFO ] [MAIN ] APOS: Loaded 5181 primary data records. [2025-09-15T21:12:26.589781] [DEBUG] [LOCAL ] APLE: Loaded 38334 existing records from primary storage. [2025-09-15T21:12:26.590454] [DEBUG] [LOCAL ] APO: Loaded 39369 existing records from primary storage. [2025-09-15T21:12:26.590788] [INFO ] [MAIN ] APLE: Loaded 38334 primary data records. [2025-09-15T21:12:26.590849] [INFO ] [MAIN ] APO: Loaded 39369 primary data records. [2025-09-15T21:12:27.153762] [DEBUG] [MAIN ] APOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:27.154903] [INFO ] [MAIN ] APOS: Generated 1326 derivative records from 5181 primary records. [2025-09-15T21:12:27.155235] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-15T21:12:27.169277] [DEBUG] [LOCAL ] APOS: Derivative data saved (1326 records). [2025-09-15T21:12:27.169544] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-15T21:12:27.171735] [INFO ] [MAIN ] Derivative Progress: 106/2083 symbols completed. APOS took 0.9s. Estimated remaining: 11m 1s. Rate: 179.5 symbols/min [2025-09-15T21:12:27.172099] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:27.197992] [DEBUG] [MAIN ] APO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:27.198273] [DEBUG] [MAIN ] APLE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:27.199664] [INFO ] [MAIN ] APLE: Generated 1326 derivative records from 38334 primary records. [2025-09-15T21:12:27.199142] [INFO ] [MAIN ] APO: Generated 1326 derivative records from 39369 primary records. [2025-09-15T21:12:27.199805] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-15T21:12:27.200407] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-15T21:12:27.232883] [DEBUG] [LOCAL ] APLE: Derivative data saved (1326 records). [2025-09-15T21:12:27.233903] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-15T21:12:27.234727] [DEBUG] [LOCAL ] APO: Derivative data saved (1326 records). [2025-09-15T21:12:27.236279] [INFO ] [MAIN ] Derivative Progress: 107/2083 symbols completed. APLE took 1.0s. Estimated remaining: 10m 55s. Rate: 180.9 symbols/min [2025-09-15T21:12:27.236514] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-15T21:12:27.239226] [INFO ] [MAIN ] Derivative Progress: 108/2083 symbols completed. APO took 1.0s. Estimated remaining: 10m 49s. Rate: 182.6 symbols/min [2025-09-15T21:12:27.239539] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:27.236690] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:27.245320] [DEBUG] [LOCAL ] AQNB: Loaded 2896 existing records from primary storage. [2025-09-15T21:12:27.246049] [INFO ] [MAIN ] AQNB: Loaded 2896 primary data records. [2025-09-15T21:12:27.346424] [DEBUG] [LOCAL ] APTV: Loaded 38330 existing records from primary storage. [2025-09-15T21:12:27.353397] [INFO ] [MAIN ] APTV: Loaded 38330 primary data records. [2025-09-15T21:12:27.586561] [DEBUG] [LOCAL ] AQN: Loaded 38142 existing records from primary storage. [2025-09-15T21:12:27.602421] [INFO ] [MAIN ] AQN: Loaded 38142 primary data records. [2025-09-15T21:12:28.150497] [DEBUG] [MAIN ] AQNB: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:12:28.151474] [INFO ] [MAIN ] AQNB: Generated 1325 derivative records from 2896 primary records. [2025-09-15T21:12:28.152455] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-15T21:12:28.165528] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1325 records). [2025-09-15T21:12:28.175066] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-15T21:12:28.177012] [INFO ] [MAIN ] Derivative Progress: 109/2083 symbols completed. AQNB took 0.9s. Estimated remaining: 10m 60s. Rate: 179.5 symbols/min [2025-09-15T21:12:28.177490] [DEBUG] [MAIN ] APTV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:28.178257] [INFO ] [MAIN ] APTV: Generated 1326 derivative records from 38330 primary records. [2025-09-15T21:12:28.178768] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-15T21:12:28.178587] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:28.202784] [DEBUG] [LOCAL ] APTV: Derivative data saved (1326 records). [2025-09-15T21:12:28.203166] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-15T21:12:28.203129] [DEBUG] [MAIN ] AQN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:28.205156] [INFO ] [MAIN ] Derivative Progress: 110/2083 symbols completed. APTV took 1.0s. Estimated remaining: 10m 54s. Rate: 181.0 symbols/min [2025-09-15T21:12:28.206059] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:28.205867] [INFO ] [MAIN ] AQN: Generated 1326 derivative records from 38142 primary records. [2025-09-15T21:12:28.206554] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-15T21:12:28.220098] [DEBUG] [LOCAL ] AQN: Derivative data saved (1326 records). [2025-09-15T21:12:28.220296] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-15T21:12:28.222827] [INFO ] [MAIN ] Derivative Progress: 111/2083 symbols completed. AQN took 1.0s. Estimated remaining: 10m 48s. Rate: 182.6 symbols/min [2025-09-15T21:12:28.223133] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:28.254589] [DEBUG] [LOCAL ] ARDC: Loaded 10313 existing records from primary storage. [2025-09-15T21:12:28.266253] [INFO ] [MAIN ] ARDC: Loaded 10313 primary data records. [2025-09-15T21:12:28.297626] [DEBUG] [LOCAL ] AR: Loaded 39562 existing records from primary storage. [2025-09-15T21:12:28.344533] [INFO ] [MAIN ] AR: Loaded 39562 primary data records. [2025-09-15T21:12:28.379336] [DEBUG] [LOCAL ] ARCO: Loaded 32872 existing records from primary storage. [2025-09-15T21:12:28.433394] [INFO ] [MAIN ] ARCO: Loaded 32872 primary data records. [2025-09-15T21:12:29.125335] [DEBUG] [MAIN ] AR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:29.126660] [DEBUG] [MAIN ] ARDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:29.127381] [INFO ] [MAIN ] AR: Generated 1326 derivative records from 39562 primary records. [2025-09-15T21:12:29.127675] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-15T21:12:29.129396] [INFO ] [MAIN ] ARDC: Generated 1326 derivative records from 10313 primary records. [2025-09-15T21:12:29.152970] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-15T21:12:29.157615] [DEBUG] [LOCAL ] AR: Derivative data saved (1326 records). [2025-09-15T21:12:29.158445] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-15T21:12:29.166289] [INFO ] [MAIN ] Derivative Progress: 112/2083 symbols completed. AR took 1.0s. Estimated remaining: 10m 58s. Rate: 179.6 symbols/min [2025-09-15T21:12:29.158384] [DEBUG] [MAIN ] ARCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:29.168690] [INFO ] [MAIN ] ARCO: Generated 1326 derivative records from 32872 primary records. [2025-09-15T21:12:29.171791] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-15T21:12:29.171864] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:29.175366] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1326 records). [2025-09-15T21:12:29.184847] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-15T21:12:29.186838] [INFO ] [MAIN ] Derivative Progress: 113/2083 symbols completed. ARDC took 1.0s. Estimated remaining: 10m 53s. Rate: 181.1 symbols/min [2025-09-15T21:12:29.188017] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:29.191139] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1326 records). [2025-09-15T21:12:29.191594] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-15T21:12:29.195118] [INFO ] [MAIN ] Derivative Progress: 114/2083 symbols completed. ARCO took 1.0s. Estimated remaining: 10m 47s. Rate: 182.7 symbols/min [2025-09-15T21:12:29.195516] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:29.213072] [DEBUG] [LOCAL ] ARDT: Loaded 19778 existing records from primary storage. [2025-09-15T21:12:29.213338] [INFO ] [MAIN ] ARDT: Loaded 19778 primary data records. [2025-09-15T21:12:29.520131] [DEBUG] [LOCAL ] ARE: Loaded 37553 existing records from primary storage. [2025-09-15T21:12:29.521028] [INFO ] [MAIN ] ARE: Loaded 37553 primary data records. [2025-09-15T21:12:29.527628] [DEBUG] [LOCAL ] ARES: Loaded 36190 existing records from primary storage. [2025-09-15T21:12:29.568119] [INFO ] [MAIN ] ARES: Loaded 36190 primary data records. [2025-09-15T21:12:30.096286] [DEBUG] [MAIN ] ARDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:30.098000] [INFO ] [MAIN ] ARDT: Generated 1326 derivative records from 19778 primary records. [2025-09-15T21:12:30.098363] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-15T21:12:30.115103] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1326 records). [2025-09-15T21:12:30.116070] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-15T21:12:30.118495] [INFO ] [MAIN ] Derivative Progress: 115/2083 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 57s. Rate: 179.8 symbols/min [2025-09-15T21:12:30.119366] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:30.136721] [DEBUG] [MAIN ] ARE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:30.141161] [INFO ] [MAIN ] ARE: Generated 1326 derivative records from 37553 primary records. [2025-09-15T21:12:30.141364] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-15T21:12:30.158107] [DEBUG] [MAIN ] ARES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:30.162364] [INFO ] [MAIN ] ARES: Generated 1326 derivative records from 36190 primary records. [2025-09-15T21:12:30.162658] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-15T21:12:30.178553] [DEBUG] [LOCAL ] ARE: Derivative data saved (1326 records). [2025-09-15T21:12:30.179170] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-15T21:12:30.182042] [INFO ] [MAIN ] Derivative Progress: 116/2083 symbols completed. ARE took 1.0s. Estimated remaining: 10m 52s. Rate: 181.1 symbols/min [2025-09-15T21:12:30.182407] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:30.196081] [DEBUG] [LOCAL ] ARES: Derivative data saved (1326 records). [2025-09-15T21:12:30.196248] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-15T21:12:30.198616] [INFO ] [MAIN ] Derivative Progress: 117/2083 symbols completed. ARES took 1.0s. Estimated remaining: 10m 46s. Rate: 182.6 symbols/min [2025-09-15T21:12:30.209321] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:30.209110] [DEBUG] [LOCAL ] ARI: Loaded 31741 existing records from primary storage. [2025-09-15T21:12:30.209724] [INFO ] [MAIN ] ARI: Loaded 31741 primary data records. [2025-09-15T21:12:30.372838] [DEBUG] [LOCAL ] ARIS: Loaded 30434 existing records from primary storage. [2025-09-15T21:12:30.388359] [INFO ] [MAIN ] ARIS: Loaded 30434 primary data records. [2025-09-15T21:12:30.650702] [DEBUG] [LOCAL ] ARLO: Loaded 32320 existing records from primary storage. [2025-09-15T21:12:30.666687] [INFO ] [MAIN ] ARLO: Loaded 32320 primary data records. [2025-09-15T21:12:31.094950] [DEBUG] [MAIN ] ARI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:31.096411] [INFO ] [MAIN ] ARI: Generated 1326 derivative records from 31741 primary records. [2025-09-15T21:12:31.096558] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-15T21:12:31.110221] [DEBUG] [LOCAL ] ARI: Derivative data saved (1326 records). [2025-09-15T21:12:31.110475] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-15T21:12:31.113150] [INFO ] [MAIN ] Derivative Progress: 118/2083 symbols completed. ARI took 1.0s. Estimated remaining: 10m 56s. Rate: 179.9 symbols/min [2025-09-15T21:12:31.126467] [DEBUG] [MAIN ] ARIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:31.128287] [INFO ] [MAIN ] ARIS: Generated 1326 derivative records from 30434 primary records. [2025-09-15T21:12:31.128568] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-15T21:12:31.153247] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1326 records). [2025-09-15T21:12:31.153386] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-15T21:12:31.151793] [DEBUG] [MAIN ] ARLO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:31.156371] [INFO ] [MAIN ] Derivative Progress: 119/2083 symbols completed. ARIS took 1.0s. Estimated remaining: 10m 50s. Rate: 181.2 symbols/min [2025-09-15T21:12:31.157149] [INFO ] [MAIN ] ARLO: Generated 1326 derivative records from 32320 primary records. [2025-09-15T21:12:31.157406] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-15T21:12:31.169465] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1326 records). [2025-09-15T21:12:31.169523] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-15T21:12:31.172161] [INFO ] [MAIN ] Derivative Progress: 120/2083 symbols completed. ARLO took 1.0s. Estimated remaining: 10m 45s. Rate: 182.6 symbols/min [2025-09-15T21:12:31.172682] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:31.172897] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:31.173039] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:31.231706] [DEBUG] [LOCAL ] AROC: Loaded 35804 existing records from primary storage. [2025-09-15T21:12:31.231864] [INFO ] [MAIN ] AROC: Loaded 35804 primary data records. [2025-09-15T21:12:31.357295] [DEBUG] [LOCAL ] ARR: Loaded 38305 existing records from primary storage. [2025-09-15T21:12:31.358227] [INFO ] [MAIN ] ARR: Loaded 38305 primary data records. [2025-09-15T21:12:31.358141] [DEBUG] [LOCAL ] ARMK: Loaded 37030 existing records from primary storage. [2025-09-15T21:12:31.374393] [INFO ] [MAIN ] ARMK: Loaded 37030 primary data records. [2025-09-15T21:12:32.097616] [DEBUG] [MAIN ] AROC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:32.098597] [INFO ] [MAIN ] AROC: Generated 1326 derivative records from 35804 primary records. [2025-09-15T21:12:32.098923] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-15T21:12:32.115282] [DEBUG] [LOCAL ] AROC: Derivative data saved (1326 records). [2025-09-15T21:12:32.116435] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-15T21:12:32.127687] [INFO ] [MAIN ] Derivative Progress: 121/2083 symbols completed. AROC took 1.0s. Estimated remaining: 10m 55s. Rate: 179.8 symbols/min [2025-09-15T21:12:32.128056] [DEBUG] [MAIN ] ARMK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:32.128754] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:32.129474] [INFO ] [MAIN ] ARMK: Generated 1326 derivative records from 37030 primary records. [2025-09-15T21:12:32.135519] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-15T21:12:32.140346] [DEBUG] [MAIN ] ARR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:32.147785] [INFO ] [MAIN ] ARR: Generated 1326 derivative records from 38305 primary records. [2025-09-15T21:12:32.150077] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-15T21:12:32.160873] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1326 records). [2025-09-15T21:12:32.163085] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-15T21:12:32.165983] [INFO ] [MAIN ] Derivative Progress: 122/2083 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 50s. Rate: 181.1 symbols/min [2025-09-15T21:12:32.166254] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:32.168280] [DEBUG] [LOCAL ] ARR: Derivative data saved (1326 records). [2025-09-15T21:12:32.168513] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-15T21:12:32.171573] [INFO ] [MAIN ] Derivative Progress: 123/2083 symbols completed. ARR took 1.0s. Estimated remaining: 10m 44s. Rate: 182.6 symbols/min [2025-09-15T21:12:32.171985] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:32.197624] [DEBUG] [LOCAL ] ASA: Loaded 10287 existing records from primary storage. [2025-09-15T21:12:32.197850] [INFO ] [MAIN ] ASA: Loaded 10287 primary data records. [2025-09-15T21:12:32.209874] [DEBUG] [LOCAL ] ARW: Loaded 23693 existing records from primary storage. [2025-09-15T21:12:32.243030] [INFO ] [MAIN ] ARW: Loaded 23693 primary data records. [2025-09-15T21:12:32.532598] [DEBUG] [LOCAL ] AS: Loaded 39205 existing records from primary storage. [2025-09-15T21:12:32.643750] [INFO ] [MAIN ] AS: Loaded 39205 primary data records. [2025-09-15T21:12:33.110837] [DEBUG] [MAIN ] ARW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:33.116503] [INFO ] [MAIN ] ARW: Generated 1326 derivative records from 23693 primary records. [2025-09-15T21:12:33.117206] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-15T21:12:33.117032] [DEBUG] [MAIN ] ASA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:33.119183] [INFO ] [MAIN ] ASA: Generated 1326 derivative records from 10287 primary records. [2025-09-15T21:12:33.119688] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-15T21:12:33.132142] [DEBUG] [LOCAL ] ARW: Derivative data saved (1326 records). [2025-09-15T21:12:33.132375] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-15T21:12:33.143629] [INFO ] [MAIN ] Derivative Progress: 124/2083 symbols completed. ARW took 1.0s. Estimated remaining: 10m 54s. Rate: 179.7 symbols/min [2025-09-15T21:12:33.145377] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:33.151067] [DEBUG] [LOCAL ] ASA: Derivative data saved (1326 records). [2025-09-15T21:12:33.151791] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-15T21:12:33.153782] [INFO ] [MAIN ] Derivative Progress: 125/2083 symbols completed. ASA took 1.0s. Estimated remaining: 10m 49s. Rate: 181.1 symbols/min [2025-09-15T21:12:33.154159] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:33.164816] [DEBUG] [MAIN ] AS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:33.165503] [INFO ] [MAIN ] AS: Generated 1326 derivative records from 39205 primary records. [2025-09-15T21:12:33.165627] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-15T21:12:33.178277] [DEBUG] [LOCAL ] AS: Derivative data saved (1326 records). [2025-09-15T21:12:33.178407] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-15T21:12:33.181049] [INFO ] [MAIN ] Derivative Progress: 126/2083 symbols completed. AS took 1.0s. Estimated remaining: 10m 44s. Rate: 182.5 symbols/min [2025-09-15T21:12:33.181384] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:33.196142] [DEBUG] [LOCAL ] ASBA: Loaded 2512 existing records from primary storage. [2025-09-15T21:12:33.196221] [INFO ] [MAIN ] ASBA: Loaded 2512 primary data records. [2025-09-15T21:12:33.329457] [DEBUG] [LOCAL ] ASAN: Loaded 38828 existing records from primary storage. [2025-09-15T21:12:33.330688] [INFO ] [MAIN ] ASAN: Loaded 38828 primary data records. [2025-09-15T21:12:33.331132] [DEBUG] [LOCAL ] ASB: Loaded 36181 existing records from primary storage. [2025-09-15T21:12:33.331227] [INFO ] [MAIN ] ASB: Loaded 36181 primary data records. [2025-09-15T21:12:34.056605] [DEBUG] [MAIN ] ASBA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:34.057678] [INFO ] [MAIN ] ASBA: Generated 1326 derivative records from 2512 primary records. [2025-09-15T21:12:34.057877] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-15T21:12:34.070662] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1326 records). [2025-09-15T21:12:34.072325] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-15T21:12:34.074206] [INFO ] [MAIN ] Derivative Progress: 127/2083 symbols completed. ASBA took 0.9s. Estimated remaining: 10m 52s. Rate: 180.0 symbols/min [2025-09-15T21:12:34.075310] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:34.086598] [DEBUG] [MAIN ] ASAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:34.087954] [INFO ] [MAIN ] ASAN: Generated 1326 derivative records from 38828 primary records. [2025-09-15T21:12:34.088109] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-15T21:12:34.106770] [DEBUG] [MAIN ] ASB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:34.107561] [INFO ] [MAIN ] ASB: Generated 1326 derivative records from 36181 primary records. [2025-09-15T21:12:34.109735] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-15T21:12:34.110538] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1326 records). [2025-09-15T21:12:34.110873] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-15T21:12:34.112948] [INFO ] [MAIN ] Derivative Progress: 128/2083 symbols completed. ASAN took 1.0s. Estimated remaining: 10m 47s. Rate: 181.3 symbols/min [2025-09-15T21:12:34.113394] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:34.134486] [DEBUG] [LOCAL ] ASB: Derivative data saved (1326 records). [2025-09-15T21:12:34.145420] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-15T21:12:34.148753] [INFO ] [MAIN ] Derivative Progress: 129/2083 symbols completed. ASB took 1.0s. Estimated remaining: 10m 42s. Rate: 182.5 symbols/min [2025-09-15T21:12:34.149064] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:34.149670] [DEBUG] [LOCAL ] ASC: Loaded 27506 existing records from primary storage. [2025-09-15T21:12:34.155184] [INFO ] [MAIN ] ASC: Loaded 27506 primary data records. [2025-09-15T21:12:34.155506] [DEBUG] [LOCAL ] ASG: Loaded 14252 existing records from primary storage. [2025-09-15T21:12:34.155881] [INFO ] [MAIN ] ASG: Loaded 14252 primary data records. [2025-09-15T21:12:34.595428] [DEBUG] [LOCAL ] ASGN: Loaded 26147 existing records from primary storage. [2025-09-15T21:12:34.603793] [INFO ] [MAIN ] ASGN: Loaded 26147 primary data records. [2025-09-15T21:12:35.052611] [DEBUG] [MAIN ] ASG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:35.056996] [INFO ] [MAIN ] ASG: Generated 1326 derivative records from 14252 primary records. [2025-09-15T21:12:35.057239] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-15T21:12:35.075972] [DEBUG] [MAIN ] ASC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:35.081375] [INFO ] [MAIN ] ASC: Generated 1326 derivative records from 27506 primary records. [2025-09-15T21:12:35.081748] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-15T21:12:35.096372] [DEBUG] [LOCAL ] ASG: Derivative data saved (1326 records). [2025-09-15T21:12:35.100278] [DEBUG] [LOCAL ] ASC: Derivative data saved (1326 records). [2025-09-15T21:12:35.101605] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-15T21:12:35.105632] [INFO ] [MAIN ] Derivative Progress: 130/2083 symbols completed. ASC took 1.0s. Estimated remaining: 10m 51s. Rate: 179.9 symbols/min [2025-09-15T21:12:35.102608] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-15T21:12:35.118715] [INFO ] [MAIN ] Derivative Progress: 131/2083 symbols completed. ASG took 1.0s. Estimated remaining: 10m 46s. Rate: 181.2 symbols/min [2025-09-15T21:12:35.119568] [DEBUG] [MAIN ] ASGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:35.119826] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:35.121234] [INFO ] [MAIN ] ASGN: Generated 1326 derivative records from 26147 primary records. [2025-09-15T21:12:35.119113] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:35.121512] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-15T21:12:35.138050] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1326 records). [2025-09-15T21:12:35.138289] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-15T21:12:35.140402] [INFO ] [MAIN ] Derivative Progress: 132/2083 symbols completed. ASGN took 1.0s. Estimated remaining: 10m 41s. Rate: 182.5 symbols/min [2025-09-15T21:12:35.140917] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:35.163600] [DEBUG] [LOCAL ] ASIX: Loaded 16877 existing records from primary storage. [2025-09-15T21:12:35.163851] [INFO ] [MAIN ] ASIX: Loaded 16877 primary data records. [2025-09-15T21:12:35.280589] [DEBUG] [LOCAL ] ATEN: Loaded 28427 existing records from primary storage. [2025-09-15T21:12:35.284731] [INFO ] [MAIN ] ATEN: Loaded 28427 primary data records. [2025-09-15T21:12:35.457897] [DEBUG] [LOCAL ] ATGE: Loaded 22888 existing records from primary storage. [2025-09-15T21:12:35.480395] [INFO ] [MAIN ] ATGE: Loaded 22888 primary data records. [2025-09-15T21:12:36.044920] [DEBUG] [MAIN ] ASIX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:36.046063] [INFO ] [MAIN ] ASIX: Generated 1326 derivative records from 16877 primary records. [2025-09-15T21:12:36.046863] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-15T21:12:36.068562] [DEBUG] [MAIN ] ATEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:36.071474] [INFO ] [MAIN ] ATEN: Generated 1326 derivative records from 28427 primary records. [2025-09-15T21:12:36.071561] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-15T21:12:36.072251] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1326 records). [2025-09-15T21:12:36.072569] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-15T21:12:36.079841] [INFO ] [MAIN ] Derivative Progress: 133/2083 symbols completed. ASIX took 1.0s. Estimated remaining: 10m 50s. Rate: 180.0 symbols/min [2025-09-15T21:12:36.087346] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1326 records). [2025-09-15T21:12:36.088749] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-15T21:12:36.091417] [INFO ] [MAIN ] Derivative Progress: 134/2083 symbols completed. ATEN took 1.0s. Estimated remaining: 10m 45s. Rate: 181.3 symbols/min [2025-09-15T21:12:36.101729] [DEBUG] [MAIN ] ATGE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:36.102321] [INFO ] [MAIN ] ATGE: Generated 1326 derivative records from 22888 primary records. [2025-09-15T21:12:36.102382] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-15T21:12:36.114063] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1326 records). [2025-09-15T21:12:36.114137] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-15T21:12:36.116131] [INFO ] [MAIN ] Derivative Progress: 135/2083 symbols completed. ATGE took 1.0s. Estimated remaining: 10m 40s. Rate: 182.6 symbols/min [2025-09-15T21:12:36.116657] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:36.116705] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:36.116841] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:36.146975] [DEBUG] [LOCAL ] ATHM: Loaded 22614 existing records from primary storage. [2025-09-15T21:12:36.154615] [INFO ] [MAIN ] ATHM: Loaded 22614 primary data records. [2025-09-15T21:12:36.275769] [DEBUG] [LOCAL ] ATKR: Loaded 25276 existing records from primary storage. [2025-09-15T21:12:36.276813] [DEBUG] [LOCAL ] ATI: Loaded 38269 existing records from primary storage. [2025-09-15T21:12:36.275941] [INFO ] [MAIN ] ATKR: Loaded 25276 primary data records. [2025-09-15T21:12:36.287279] [INFO ] [MAIN ] ATI: Loaded 38269 primary data records. [2025-09-15T21:12:36.992517] [DEBUG] [MAIN ] ATHM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:36.995101] [INFO ] [MAIN ] ATHM: Generated 1326 derivative records from 22614 primary records. [2025-09-15T21:12:36.995532] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-15T21:12:37.017968] [DEBUG] [MAIN ] ATI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:37.020998] [INFO ] [MAIN ] ATI: Generated 1326 derivative records from 38269 primary records. [2025-09-15T21:12:37.021179] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-15T21:12:37.021093] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1326 records). [2025-09-15T21:12:37.021509] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-15T21:12:37.023790] [INFO ] [MAIN ] Derivative Progress: 136/2083 symbols completed. ATHM took 0.9s. Estimated remaining: 10m 48s. Rate: 180.2 symbols/min [2025-09-15T21:12:37.025557] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:37.046928] [DEBUG] [MAIN ] ATKR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:37.048861] [INFO ] [MAIN ] ATKR: Generated 1326 derivative records from 25276 primary records. [2025-09-15T21:12:37.049223] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-15T21:12:37.058063] [DEBUG] [LOCAL ] ATI: Derivative data saved (1326 records). [2025-09-15T21:12:37.062082] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-15T21:12:37.064505] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1326 records). [2025-09-15T21:12:37.067673] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-15T21:12:37.067493] [INFO ] [MAIN ] Derivative Progress: 137/2083 symbols completed. ATI took 1.0s. Estimated remaining: 10m 44s. Rate: 181.4 symbols/min [2025-09-15T21:12:37.068041] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:37.071249] [INFO ] [MAIN ] Derivative Progress: 138/2083 symbols completed. ATKR took 1.0s. Estimated remaining: 10m 39s. Rate: 182.7 symbols/min [2025-09-15T21:12:37.080737] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:37.105504] [DEBUG] [LOCAL ] ATO: Loaded 30687 existing records from primary storage. [2025-09-15T21:12:37.105774] [INFO ] [MAIN ] ATO: Loaded 30687 primary data records. [2025-09-15T21:12:37.122739] [DEBUG] [LOCAL ] ATS: Loaded 12990 existing records from primary storage. [2025-09-15T21:12:37.140532] [INFO ] [MAIN ] ATS: Loaded 12990 primary data records. [2025-09-15T21:12:37.184430] [DEBUG] [LOCAL ] ATR: Loaded 22944 existing records from primary storage. [2025-09-15T21:12:37.206659] [INFO ] [MAIN ] ATR: Loaded 22944 primary data records. [2025-09-15T21:12:37.987189] [DEBUG] [MAIN ] ATO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:37.988884] [INFO ] [MAIN ] ATO: Generated 1326 derivative records from 30687 primary records. [2025-09-15T21:12:37.994844] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-15T21:12:37.999538] [DEBUG] [MAIN ] ATS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:38.001516] [INFO ] [MAIN ] ATS: Generated 1326 derivative records from 12990 primary records. [2025-09-15T21:12:38.011664] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-15T21:12:38.037703] [DEBUG] [LOCAL ] ATS: Derivative data saved (1326 records). [2025-09-15T21:12:38.036428] [DEBUG] [LOCAL ] ATO: Derivative data saved (1326 records). [2025-09-15T21:12:38.037898] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-15T21:12:38.040444] [INFO ] [MAIN ] Derivative Progress: 139/2083 symbols completed. ATS took 1.0s. Estimated remaining: 10m 47s. Rate: 180.2 symbols/min [2025-09-15T21:12:38.038211] [DEBUG] [MAIN ] ATR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:38.038266] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-15T21:12:38.040703] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:38.043605] [INFO ] [MAIN ] Derivative Progress: 140/2083 symbols completed. ATO took 1.0s. Estimated remaining: 10m 43s. Rate: 181.4 symbols/min [2025-09-15T21:12:38.041609] [INFO ] [MAIN ] ATR: Generated 1326 derivative records from 22944 primary records. [2025-09-15T21:12:38.044148] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-15T21:12:38.044347] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:38.058012] [DEBUG] [LOCAL ] ATR: Derivative data saved (1326 records). [2025-09-15T21:12:38.058210] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-15T21:12:38.060367] [INFO ] [MAIN ] Derivative Progress: 141/2083 symbols completed. ATR took 1.0s. Estimated remaining: 10m 38s. Rate: 182.7 symbols/min [2025-09-15T21:12:38.060702] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:38.098443] [DEBUG] [LOCAL ] ATUS: Loaded 37048 existing records from primary storage. [2025-09-15T21:12:38.108418] [INFO ] [MAIN ] ATUS: Loaded 37048 primary data records. [2025-09-15T21:12:38.232855] [DEBUG] [LOCAL ] AU: Loaded 39087 existing records from primary storage. [2025-09-15T21:12:38.249683] [DEBUG] [LOCAL ] AUB: Loaded 33612 existing records from primary storage. [2025-09-15T21:12:38.243735] [INFO ] [MAIN ] AU: Loaded 39087 primary data records. [2025-09-15T21:12:38.260016] [INFO ] [MAIN ] AUB: Loaded 33612 primary data records. [2025-09-15T21:12:38.959763] [DEBUG] [MAIN ] ATUS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:38.960880] [INFO ] [MAIN ] ATUS: Generated 1326 derivative records from 37048 primary records. [2025-09-15T21:12:38.961173] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-15T21:12:38.999941] [DEBUG] [MAIN ] AU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:39.000479] [DEBUG] [MAIN ] AUB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:39.001311] [INFO ] [MAIN ] AU: Generated 1326 derivative records from 39087 primary records. [2025-09-15T21:12:39.002756] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-15T21:12:39.002145] [INFO ] [MAIN ] AUB: Generated 1326 derivative records from 33612 primary records. [2025-09-15T21:12:39.002693] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1326 records). [2025-09-15T21:12:39.003720] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-15T21:12:39.004081] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-15T21:12:39.013035] [INFO ] [MAIN ] Derivative Progress: 142/2083 symbols completed. ATUS took 1.0s. Estimated remaining: 10m 46s. Rate: 180.3 symbols/min [2025-09-15T21:12:39.016798] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:39.029327] [DEBUG] [LOCAL ] AU: Derivative data saved (1326 records). [2025-09-15T21:12:39.030472] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-15T21:12:39.035053] [INFO ] [MAIN ] Derivative Progress: 143/2083 symbols completed. AU took 1.0s. Estimated remaining: 10m 42s. Rate: 181.4 symbols/min [2025-09-15T21:12:39.035974] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:39.037180] [DEBUG] [LOCAL ] AUB: Derivative data saved (1326 records). [2025-09-15T21:12:39.037716] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-15T21:12:39.039892] [INFO ] [MAIN ] Derivative Progress: 144/2083 symbols completed. AUB took 1.0s. Estimated remaining: 10m 37s. Rate: 182.7 symbols/min [2025-09-15T21:12:39.040184] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:39.044061] [DEBUG] [LOCAL ] AUNA: Loaded 3616 existing records from primary storage. [2025-09-15T21:12:39.044413] [INFO ] [MAIN ] AUNA: Loaded 3616 primary data records. [2025-09-15T21:12:39.162821] [DEBUG] [LOCAL ] AVAL: Loaded 5769 existing records from primary storage. [2025-09-15T21:12:39.178887] [INFO ] [MAIN ] AVAL: Loaded 5769 primary data records. [2025-09-15T21:12:39.434754] [DEBUG] [LOCAL ] AVA: Loaded 28643 existing records from primary storage. [2025-09-15T21:12:39.511206] [INFO ] [MAIN ] AVA: Loaded 28643 primary data records. [2025-09-15T21:12:39.914404] [DEBUG] [MAIN ] AUNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:39.915370] [INFO ] [MAIN ] AUNA: Generated 1326 derivative records from 3616 primary records. [2025-09-15T21:12:39.915686] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-15T21:12:39.939757] [DEBUG] [MAIN ] AVAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:39.941049] [INFO ] [MAIN ] AVAL: Generated 1326 derivative records from 5769 primary records. [2025-09-15T21:12:39.942087] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-15T21:12:39.943246] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1326 records). [2025-09-15T21:12:39.943572] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-15T21:12:39.945431] [INFO ] [MAIN ] Derivative Progress: 145/2083 symbols completed. AUNA took 0.9s. Estimated remaining: 10m 44s. Rate: 180.5 symbols/min [2025-09-15T21:12:39.953723] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:39.957454] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1326 records). [2025-09-15T21:12:39.958878] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-15T21:12:39.961423] [INFO ] [MAIN ] Derivative Progress: 146/2083 symbols completed. AVAL took 0.9s. Estimated remaining: 10m 40s. Rate: 181.7 symbols/min [2025-09-15T21:12:39.961883] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:39.973550] [DEBUG] [MAIN ] AVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:39.974381] [INFO ] [MAIN ] AVA: Generated 1326 derivative records from 28643 primary records. [2025-09-15T21:12:39.974507] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-15T21:12:39.991630] [DEBUG] [LOCAL ] AVA: Derivative data saved (1326 records). [2025-09-15T21:12:39.991788] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-15T21:12:39.994813] [INFO ] [MAIN ] Derivative Progress: 147/2083 symbols completed. AVA took 1.0s. Estimated remaining: 10m 35s. Rate: 182.8 symbols/min [2025-09-15T21:12:39.995297] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:40.008684] [DEBUG] [LOCAL ] AVD: Loaded 16275 existing records from primary storage. [2025-09-15T21:12:40.008861] [INFO ] [MAIN ] AVD: Loaded 16275 primary data records. [2025-09-15T21:12:40.108602] [DEBUG] [LOCAL ] AVK: Loaded 13357 existing records from primary storage. [2025-09-15T21:12:40.120172] [INFO ] [MAIN ] AVK: Loaded 13357 primary data records. [2025-09-15T21:12:40.196208] [DEBUG] [LOCAL ] AVB: Loaded 30819 existing records from primary storage. [2025-09-15T21:12:40.232200] [INFO ] [MAIN ] AVB: Loaded 30819 primary data records. [2025-09-15T21:12:40.896010] [DEBUG] [MAIN ] AVD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:40.897433] [INFO ] [MAIN ] AVD: Generated 1326 derivative records from 16275 primary records. [2025-09-15T21:12:40.898093] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-15T21:12:40.914519] [DEBUG] [LOCAL ] AVD: Derivative data saved (1326 records). [2025-09-15T21:12:40.914817] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-15T21:12:40.922431] [INFO ] [MAIN ] Derivative Progress: 148/2083 symbols completed. AVD took 1.0s. Estimated remaining: 10m 43s. Rate: 180.6 symbols/min [2025-09-15T21:12:40.927070] [DEBUG] [MAIN ] AVK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:40.928060] [INFO ] [MAIN ] AVK: Generated 1326 derivative records from 13357 primary records. [2025-09-15T21:12:40.928450] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-15T21:12:40.952072] [DEBUG] [MAIN ] AVB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:40.953211] [INFO ] [MAIN ] AVB: Generated 1326 derivative records from 30819 primary records. [2025-09-15T21:12:40.953674] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-15T21:12:40.953616] [DEBUG] [LOCAL ] AVK: Derivative data saved (1326 records). [2025-09-15T21:12:40.954778] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-15T21:12:40.957653] [INFO ] [MAIN ] Derivative Progress: 149/2083 symbols completed. AVK took 1.0s. Estimated remaining: 10m 39s. Rate: 181.7 symbols/min [2025-09-15T21:12:40.969665] [DEBUG] [LOCAL ] AVB: Derivative data saved (1326 records). [2025-09-15T21:12:40.969791] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-15T21:12:40.973041] [INFO ] [MAIN ] Derivative Progress: 150/2083 symbols completed. AVB took 1.0s. Estimated remaining: 10m 34s. Rate: 182.8 symbols/min [2025-09-15T21:12:40.974574] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:40.974468] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:40.974763] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:41.021151] [DEBUG] [LOCAL ] AVNS: Loaded 24755 existing records from primary storage. [2025-09-15T21:12:41.021512] [INFO ] [MAIN ] AVNS: Loaded 24755 primary data records. [2025-09-15T21:12:41.093187] [DEBUG] [LOCAL ] AVNT: Loaded 28547 existing records from primary storage. [2025-09-15T21:12:41.116034] [INFO ] [MAIN ] AVNT: Loaded 28547 primary data records. [2025-09-15T21:12:41.242402] [DEBUG] [LOCAL ] AVTR: Loaded 39554 existing records from primary storage. [2025-09-15T21:12:41.300687] [INFO ] [MAIN ] AVTR: Loaded 39554 primary data records. [2025-09-15T21:12:41.963011] [DEBUG] [MAIN ] AVNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:41.972688] [DEBUG] [MAIN ] AVNS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:41.973466] [INFO ] [MAIN ] AVNS: Generated 1326 derivative records from 24755 primary records. [2025-09-15T21:12:41.974200] [INFO ] [MAIN ] AVNT: Generated 1326 derivative records from 28547 primary records. [2025-09-15T21:12:41.974330] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-15T21:12:41.974369] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-15T21:12:41.998695] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1326 records). [2025-09-15T21:12:41.999059] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-15T21:12:42.007189] [INFO ] [MAIN ] Derivative Progress: 151/2083 symbols completed. AVNT took 1.0s. Estimated remaining: 10m 43s. Rate: 180.3 symbols/min [2025-09-15T21:12:42.012673] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:42.012121] [DEBUG] [MAIN ] AVTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:42.012731] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1326 records). [2025-09-15T21:12:42.013899] [INFO ] [MAIN ] AVTR: Generated 1326 derivative records from 39554 primary records. [2025-09-15T21:12:42.013231] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-15T21:12:42.014019] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-15T21:12:42.015603] [INFO ] [MAIN ] Derivative Progress: 152/2083 symbols completed. AVNS took 1.0s. Estimated remaining: 10m 39s. Rate: 181.4 symbols/min [2025-09-15T21:12:42.016861] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:42.030477] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1326 records). [2025-09-15T21:12:42.030697] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-15T21:12:42.032741] [INFO ] [MAIN ] Derivative Progress: 153/2083 symbols completed. AVTR took 1.1s. Estimated remaining: 10m 34s. Rate: 182.6 symbols/min [2025-09-15T21:12:42.033059] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:42.048190] [DEBUG] [LOCAL ] AWI: Loaded 18971 existing records from primary storage. [2025-09-15T21:12:42.051859] [INFO ] [MAIN ] AWI: Loaded 18971 primary data records. [2025-09-15T21:12:42.149009] [DEBUG] [LOCAL ] AWP: Loaded 16615 existing records from primary storage. [2025-09-15T21:12:42.174426] [INFO ] [MAIN ] AWP: Loaded 16615 primary data records. [2025-09-15T21:12:42.287674] [DEBUG] [LOCAL ] AWK: Loaded 35633 existing records from primary storage. [2025-09-15T21:12:42.394312] [INFO ] [MAIN ] AWK: Loaded 35633 primary data records. [2025-09-15T21:12:42.937441] [DEBUG] [MAIN ] AWI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:42.939453] [INFO ] [MAIN ] AWI: Generated 1326 derivative records from 18971 primary records. [2025-09-15T21:12:42.939841] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-15T21:12:42.955154] [DEBUG] [LOCAL ] AWI: Derivative data saved (1326 records). [2025-09-15T21:12:42.955322] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-15T21:12:42.957038] [INFO ] [MAIN ] Derivative Progress: 154/2083 symbols completed. AWI took 0.9s. Estimated remaining: 10m 41s. Rate: 180.4 symbols/min [2025-09-15T21:12:42.957592] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:42.976666] [DEBUG] [MAIN ] AWP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:42.977553] [INFO ] [MAIN ] AWP: Generated 1326 derivative records from 16615 primary records. [2025-09-15T21:12:42.983588] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-15T21:12:43.007292] [DEBUG] [LOCAL ] AWP: Derivative data saved (1326 records). [2025-09-15T21:12:43.013611] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-15T21:12:43.022894] [INFO ] [MAIN ] Derivative Progress: 155/2083 symbols completed. AWP took 1.0s. Estimated remaining: 10m 38s. Rate: 181.4 symbols/min [2025-09-15T21:12:43.018873] [DEBUG] [MAIN ] AWK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:43.018467] [DEBUG] [LOCAL ] AWR: Loaded 16093 existing records from primary storage. [2025-09-15T21:12:43.023285] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:43.024910] [INFO ] [MAIN ] AWK: Generated 1326 derivative records from 35633 primary records. [2025-09-15T21:12:43.023987] [INFO ] [MAIN ] AWR: Loaded 16093 primary data records. [2025-09-15T21:12:43.025266] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-15T21:12:43.126683] [DEBUG] [LOCAL ] AWK: Derivative data saved (1326 records). [2025-09-15T21:12:43.137751] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-15T21:12:43.153219] [INFO ] [MAIN ] Derivative Progress: 156/2083 symbols completed. AWK took 1.1s. Estimated remaining: 10m 35s. Rate: 182.1 symbols/min [2025-09-15T21:12:43.157511] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:43.182689] [DEBUG] [LOCAL ] AX: Loaded 20149 existing records from primary storage. [2025-09-15T21:12:43.188224] [INFO ] [MAIN ] AX: Loaded 20149 primary data records. [2025-09-15T21:12:43.638414] [DEBUG] [LOCAL ] AXL: Loaded 37150 existing records from primary storage. [2025-09-15T21:12:43.640067] [INFO ] [MAIN ] AXL: Loaded 37150 primary data records. [2025-09-15T21:12:43.969347] [DEBUG] [MAIN ] AWR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:43.970669] [INFO ] [MAIN ] AWR: Generated 1326 derivative records from 16093 primary records. [2025-09-15T21:12:43.971154] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-15T21:12:43.986091] [DEBUG] [LOCAL ] AWR: Derivative data saved (1326 records). [2025-09-15T21:12:43.986200] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-15T21:12:43.987963] [INFO ] [MAIN ] Derivative Progress: 157/2083 symbols completed. AWR took 1.0s. Estimated remaining: 10m 41s. Rate: 180.3 symbols/min [2025-09-15T21:12:43.988281] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:43.999487] [DEBUG] [MAIN ] AX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:44.000902] [INFO ] [MAIN ] AX: Generated 1326 derivative records from 20149 primary records. [2025-09-15T21:12:44.001010] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-15T21:12:44.003688] [DEBUG] [LOCAL ] AXR: Loaded 2129 existing records from primary storage. [2025-09-15T21:12:44.004037] [INFO ] [MAIN ] AXR: Loaded 2129 primary data records. [2025-09-15T21:12:44.118110] [DEBUG] [LOCAL ] AX: Derivative data saved (1326 records). [2025-09-15T21:12:44.121419] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-15T21:12:44.129660] [INFO ] [MAIN ] Derivative Progress: 158/2083 symbols completed. AX took 1.1s. Estimated remaining: 10m 38s. Rate: 181.0 symbols/min [2025-09-15T21:12:44.159465] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:44.149063] [DEBUG] [MAIN ] AXL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:44.181808] [INFO ] [MAIN ] AXL: Generated 1326 derivative records from 37150 primary records. [2025-09-15T21:12:44.205998] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-15T21:12:44.309515] [DEBUG] [LOCAL ] AXL: Derivative data saved (1326 records). [2025-09-15T21:12:44.309974] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-15T21:12:44.319089] [INFO ] [MAIN ] Derivative Progress: 159/2083 symbols completed. AXL took 1.2s. Estimated remaining: 10m 36s. Rate: 181.5 symbols/min [2025-09-15T21:12:44.319412] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:44.335276] [DEBUG] [LOCAL ] AXS: Loaded 28095 existing records from primary storage. [2025-09-15T21:12:44.335682] [INFO ] [MAIN ] AXS: Loaded 28095 primary data records. [2025-09-15T21:12:44.451423] [DEBUG] [MAIN ] AXR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:44.469442] [INFO ] [MAIN ] AXR: Generated 1326 derivative records from 2129 primary records. [2025-09-15T21:12:44.491399] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-15T21:12:44.605682] [DEBUG] [LOCAL ] AXTA: Loaded 38451 existing records from primary storage. [2025-09-15T21:12:44.662857] [INFO ] [MAIN ] AXTA: Loaded 38451 primary data records. [2025-09-15T21:12:44.667111] [DEBUG] [LOCAL ] AXR: Derivative data saved (1326 records). [2025-09-15T21:12:44.704099] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-15T21:12:44.733961] [INFO ] [MAIN ] Derivative Progress: 160/2083 symbols completed. AXR took 0.7s. Estimated remaining: 10m 37s. Rate: 181.2 symbols/min [2025-09-15T21:12:44.757024] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:44.948667] [DEBUG] [LOCAL ] AYI: Loaded 17494 existing records from primary storage. [2025-09-15T21:12:44.949313] [INFO ] [MAIN ] AYI: Loaded 17494 primary data records. [2025-09-15T21:12:45.073014] [DEBUG] [MAIN ] AXS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:45.084516] [INFO ] [MAIN ] AXS: Generated 1326 derivative records from 28095 primary records. [2025-09-15T21:12:45.099952] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-15T21:12:45.238742] [DEBUG] [LOCAL ] AXS: Derivative data saved (1326 records). [2025-09-15T21:12:45.249883] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-15T21:12:45.252083] [INFO ] [MAIN ] Derivative Progress: 161/2083 symbols completed. AXS took 1.1s. Estimated remaining: 10m 39s. Rate: 180.5 symbols/min [2025-09-15T21:12:45.252472] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:45.270221] [DEBUG] [MAIN ] AXTA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:45.271120] [INFO ] [MAIN ] AXTA: Generated 1326 derivative records from 38451 primary records. [2025-09-15T21:12:45.271811] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-15T21:12:45.281593] [DEBUG] [LOCAL ] AZO: Loaded 7801 existing records from primary storage. [2025-09-15T21:12:45.285859] [INFO ] [MAIN ] AZO: Loaded 7801 primary data records. [2025-09-15T21:12:45.353564] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1326 records). [2025-09-15T21:12:45.388804] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-15T21:12:45.393789] [INFO ] [MAIN ] Derivative Progress: 162/2083 symbols completed. AXTA took 1.1s. Estimated remaining: 10m 36s. Rate: 181.2 symbols/min [2025-09-15T21:12:45.415841] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:45.586902] [DEBUG] [MAIN ] AYI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:45.588575] [INFO ] [MAIN ] AYI: Generated 1326 derivative records from 17494 primary records. [2025-09-15T21:12:45.588874] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-15T21:12:45.608492] [DEBUG] [LOCAL ] AZZ: Loaded 16542 existing records from primary storage. [2025-09-15T21:12:45.609583] [INFO ] [MAIN ] AZZ: Loaded 16542 primary data records. [2025-09-15T21:12:45.610135] [DEBUG] [LOCAL ] AYI: Derivative data saved (1326 records). [2025-09-15T21:12:45.610231] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-15T21:12:45.623442] [INFO ] [MAIN ] Derivative Progress: 163/2083 symbols completed. AYI took 0.9s. Estimated remaining: 10m 35s. Rate: 181.5 symbols/min [2025-09-15T21:12:45.899559] [DEBUG] [MAIN ] AZO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:45.900354] [INFO ] [MAIN ] AZO: Generated 1326 derivative records from 7801 primary records. [2025-09-15T21:12:45.900853] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-15T21:12:45.914602] [DEBUG] [LOCAL ] AZO: Derivative data saved (1326 records). [2025-09-15T21:12:45.914719] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-15T21:12:45.916541] [INFO ] [MAIN ] Derivative Progress: 164/2083 symbols completed. AZO took 0.7s. Estimated remaining: 10m 34s. Rate: 181.7 symbols/min [2025-09-15T21:12:45.931480] [DEBUG] [MAIN ] AZZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:45.932036] [INFO ] [MAIN ] AZZ: Generated 1326 derivative records from 16542 primary records. [2025-09-15T21:12:45.932096] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-15T21:12:45.943670] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1326 records). [2025-09-15T21:12:45.943726] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-15T21:12:45.945548] [INFO ] [MAIN ] Derivative Progress: 165/2083 symbols completed. AZZ took 0.5s. Estimated remaining: 10m 30s. Rate: 182.7 symbols/min [2025-09-15T21:12:45.946168] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:45.946221] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:45.946316] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:46.026004] [DEBUG] [LOCAL ] BA: Loaded 39751 existing records from primary storage. [2025-09-15T21:12:46.026230] [INFO ] [MAIN ] BA: Loaded 39751 primary data records. [2025-09-15T21:12:46.027322] [DEBUG] [LOCAL ] BABA: Loaded 39780 existing records from primary storage. [2025-09-15T21:12:46.027419] [INFO ] [MAIN ] BABA: Loaded 39780 primary data records. [2025-09-15T21:12:46.028028] [DEBUG] [LOCAL ] BAC: Loaded 39768 existing records from primary storage. [2025-09-15T21:12:46.079803] [INFO ] [MAIN ] BAC: Loaded 39768 primary data records. [2025-09-15T21:12:46.916182] [DEBUG] [MAIN ] BA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:46.917174] [INFO ] [MAIN ] BA: Generated 1326 derivative records from 39751 primary records. [2025-09-15T21:12:46.917533] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-15T21:12:46.946599] [DEBUG] [LOCAL ] BA: Derivative data saved (1326 records). [2025-09-15T21:12:46.947117] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-15T21:12:46.954433] [INFO ] [MAIN ] Derivative Progress: 166/2083 symbols completed. BA took 1.0s. Estimated remaining: 10m 38s. Rate: 180.4 symbols/min [2025-09-15T21:12:46.952955] [DEBUG] [MAIN ] BABA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:46.959271] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:46.959186] [DEBUG] [MAIN ] BAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:46.960141] [INFO ] [MAIN ] BABA: Generated 1326 derivative records from 39780 primary records. [2025-09-15T21:12:46.961336] [INFO ] [MAIN ] BAC: Generated 1326 derivative records from 39768 primary records. [2025-09-15T21:12:46.961896] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-15T21:12:46.961530] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-15T21:12:46.985544] [DEBUG] [LOCAL ] BAC: Derivative data saved (1326 records). [2025-09-15T21:12:46.985659] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-15T21:12:46.990032] [DEBUG] [LOCAL ] BABA: Derivative data saved (1326 records). [2025-09-15T21:12:46.988337] [INFO ] [MAIN ] Derivative Progress: 167/2083 symbols completed. BAC took 1.0s. Estimated remaining: 10m 34s. Rate: 181.4 symbols/min [2025-09-15T21:12:46.990213] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-15T21:12:46.992854] [INFO ] [MAIN ] Derivative Progress: 168/2083 symbols completed. BABA took 1.0s. Estimated remaining: 10m 30s. Rate: 182.5 symbols/min [2025-09-15T21:12:46.992802] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:46.993113] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:47.056679] [DEBUG] [LOCAL ] BAK: Loaded 28792 existing records from primary storage. [2025-09-15T21:12:47.056860] [INFO ] [MAIN ] BAK: Loaded 28792 primary data records. [2025-09-15T21:12:47.069070] [DEBUG] [LOCAL ] BAH: Loaded 38077 existing records from primary storage. [2025-09-15T21:12:47.098711] [INFO ] [MAIN ] BAH: Loaded 38077 primary data records. [2025-09-15T21:12:47.194900] [DEBUG] [LOCAL ] BALL: Loaded 38150 existing records from primary storage. [2025-09-15T21:12:47.208918] [INFO ] [MAIN ] BALL: Loaded 38150 primary data records. [2025-09-15T21:12:47.933843] [DEBUG] [MAIN ] BAK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:47.934908] [INFO ] [MAIN ] BAK: Generated 1326 derivative records from 28792 primary records. [2025-09-15T21:12:47.935153] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-15T21:12:47.945990] [DEBUG] [MAIN ] BAH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:47.948296] [INFO ] [MAIN ] BAH: Generated 1326 derivative records from 38077 primary records. [2025-09-15T21:12:47.948918] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-15T21:12:47.976863] [DEBUG] [MAIN ] BALL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:47.981394] [DEBUG] [LOCAL ] BAK: Derivative data saved (1326 records). [2025-09-15T21:12:47.984686] [INFO ] [MAIN ] BALL: Generated 1326 derivative records from 38150 primary records. [2025-09-15T21:12:47.985418] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-15T21:12:47.985343] [DEBUG] [LOCAL ] BAH: Derivative data saved (1326 records). [2025-09-15T21:12:47.985586] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-15T21:12:47.985696] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-15T21:12:47.987140] [INFO ] [MAIN ] Derivative Progress: 169/2083 symbols completed. BAK took 1.0s. Estimated remaining: 10m 37s. Rate: 180.3 symbols/min [2025-09-15T21:12:47.990669] [INFO ] [MAIN ] Derivative Progress: 170/2083 symbols completed. BAH took 1.0s. Estimated remaining: 10m 33s. Rate: 181.4 symbols/min [2025-09-15T21:12:47.990595] [INFO ] [MAIN ] BALY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:47.991381] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:48.004882] [DEBUG] [LOCAL ] BALL: Derivative data saved (1326 records). [2025-09-15T21:12:48.007018] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-15T21:12:48.009610] [INFO ] [MAIN ] Derivative Progress: 171/2083 symbols completed. BALL took 1.0s. Estimated remaining: 10m 29s. Rate: 182.4 symbols/min [2025-09-15T21:12:48.009921] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:48.015160] [DEBUG] [LOCAL ] BALY: Loaded 7145 existing records from primary storage. [2025-09-15T21:12:48.015374] [INFO ] [MAIN ] BALY: Loaded 7145 primary data records. [2025-09-15T21:12:48.244334] [DEBUG] [LOCAL ] BAM: Loaded 38250 existing records from primary storage. [2025-09-15T21:12:48.331532] [INFO ] [MAIN ] BAM: Loaded 38250 primary data records. [2025-09-15T21:12:48.332242] [DEBUG] [LOCAL ] BANC: Loaded 37542 existing records from primary storage. [2025-09-15T21:12:48.345057] [INFO ] [MAIN ] BANC: Loaded 37542 primary data records. [2025-09-15T21:12:48.970390] [DEBUG] [MAIN ] BALY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:48.972673] [INFO ] [MAIN ] BALY: Generated 1326 derivative records from 7145 primary records. [2025-09-15T21:12:48.973553] [DEBUG] [LOCAL ] BALY: Saving derivative data. [2025-09-15T21:12:48.998687] [DEBUG] [LOCAL ] BALY: Derivative data saved (1326 records). [2025-09-15T21:12:48.999035] [INFO ] [MAIN ] BALY: Successfully saved derivative data. [2025-09-15T21:12:49.001899] [INFO ] [MAIN ] Derivative Progress: 172/2083 symbols completed. BALY took 1.0s. Estimated remaining: 10m 36s. Rate: 180.2 symbols/min [2025-09-15T21:12:49.002913] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:49.038628] [DEBUG] [MAIN ] BAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:49.039325] [DEBUG] [MAIN ] BANC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:49.040128] [INFO ] [MAIN ] BAM: Generated 1326 derivative records from 38250 primary records. [2025-09-15T21:12:49.041252] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-15T21:12:49.041065] [INFO ] [MAIN ] BANC: Generated 1326 derivative records from 37542 primary records. [2025-09-15T21:12:49.048908] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-15T21:12:49.086426] [DEBUG] [LOCAL ] BAP: Loaded 18874 existing records from primary storage. [2025-09-15T21:12:49.088029] [INFO ] [MAIN ] BAP: Loaded 18874 primary data records. [2025-09-15T21:12:49.087960] [DEBUG] [LOCAL ] BAM: Derivative data saved (1326 records). [2025-09-15T21:12:49.089281] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-15T21:12:49.094838] [DEBUG] [LOCAL ] BANC: Derivative data saved (1326 records). [2025-09-15T21:12:49.097069] [INFO ] [MAIN ] Derivative Progress: 173/2083 symbols completed. BAM took 1.1s. Estimated remaining: 10m 33s. Rate: 181.0 symbols/min [2025-09-15T21:12:49.105930] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:49.123703] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-15T21:12:49.145442] [INFO ] [MAIN ] Derivative Progress: 174/2083 symbols completed. BANC took 1.1s. Estimated remaining: 10m 30s. Rate: 181.9 symbols/min [2025-09-15T21:12:49.156267] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:49.383172] [DEBUG] [LOCAL ] BB: Loaded 38976 existing records from primary storage. [2025-09-15T21:12:49.412218] [INFO ] [MAIN ] BB: Loaded 38976 primary data records. [2025-09-15T21:12:49.598813] [DEBUG] [LOCAL ] BBAI: Loaded 39780 existing records from primary storage. [2025-09-15T21:12:49.604766] [INFO ] [MAIN ] BBAI: Loaded 39780 primary data records. [2025-09-15T21:12:50.298393] [DEBUG] [MAIN ] BAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:50.299550] [INFO ] [MAIN ] BAP: Generated 1326 derivative records from 18874 primary records. [2025-09-15T21:12:50.300341] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-15T21:12:50.317541] [DEBUG] [LOCAL ] BAP: Derivative data saved (1326 records). [2025-09-15T21:12:50.317931] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-15T21:12:50.319753] [INFO ] [MAIN ] Derivative Progress: 175/2083 symbols completed. BAP took 1.3s. Estimated remaining: 10m 39s. Rate: 179.3 symbols/min [2025-09-15T21:12:50.320098] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:50.333058] [DEBUG] [MAIN ] BBAI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:50.334500] [INFO ] [MAIN ] BBAI: Generated 1326 derivative records from 39780 primary records. [2025-09-15T21:12:50.335818] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-15T21:12:50.354225] [DEBUG] [MAIN ] BB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:50.355477] [INFO ] [MAIN ] BB: Generated 1326 derivative records from 38976 primary records. [2025-09-15T21:12:50.362740] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-15T21:12:50.365231] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1326 records). [2025-09-15T21:12:50.365492] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-15T21:12:50.373026] [INFO ] [MAIN ] Derivative Progress: 176/2083 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 35s. Rate: 180.1 symbols/min [2025-09-15T21:12:50.373236] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:50.387992] [DEBUG] [LOCAL ] BB: Derivative data saved (1326 records). [2025-09-15T21:12:50.388170] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-15T21:12:50.398522] [INFO ] [MAIN ] Derivative Progress: 177/2083 symbols completed. BB took 1.3s. Estimated remaining: 10m 32s. Rate: 181.1 symbols/min [2025-09-15T21:12:50.399804] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:50.400930] [DEBUG] [LOCAL ] BBAR: Loaded 30538 existing records from primary storage. [2025-09-15T21:12:50.401090] [INFO ] [MAIN ] BBAR: Loaded 30538 primary data records. [2025-09-15T21:12:50.695683] [DEBUG] [LOCAL ] BBDC: Loaded 23228 existing records from primary storage. [2025-09-15T21:12:50.697938] [DEBUG] [LOCAL ] BBD: Loaded 39316 existing records from primary storage. [2025-09-15T21:12:50.696058] [INFO ] [MAIN ] BBDC: Loaded 23228 primary data records. [2025-09-15T21:12:50.703578] [INFO ] [MAIN ] BBD: Loaded 39316 primary data records. [2025-09-15T21:12:51.319258] [DEBUG] [MAIN ] BBAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:51.321621] [INFO ] [MAIN ] BBAR: Generated 1326 derivative records from 30538 primary records. [2025-09-15T21:12:51.323467] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-15T21:12:51.340173] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1326 records). [2025-09-15T21:12:51.340773] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-15T21:12:51.343025] [INFO ] [MAIN ] Derivative Progress: 178/2083 symbols completed. BBAR took 1.0s. Estimated remaining: 10m 38s. Rate: 179.2 symbols/min [2025-09-15T21:12:51.372356] [DEBUG] [MAIN ] BBD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:51.372700] [DEBUG] [MAIN ] BBDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:51.373669] [INFO ] [MAIN ] BBD: Generated 1326 derivative records from 39316 primary records. [2025-09-15T21:12:51.373781] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-15T21:12:51.374802] [INFO ] [MAIN ] BBDC: Generated 1326 derivative records from 23228 primary records. [2025-09-15T21:12:51.375498] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-15T21:12:51.400549] [DEBUG] [LOCAL ] BBD: Derivative data saved (1326 records). [2025-09-15T21:12:51.400658] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1326 records). [2025-09-15T21:12:51.400875] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-15T21:12:51.400975] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-15T21:12:51.403385] [INFO ] [MAIN ] Derivative Progress: 179/2083 symbols completed. BBDC took 1.0s. Estimated remaining: 10m 35s. Rate: 180.0 symbols/min [2025-09-15T21:12:51.406247] [INFO ] [MAIN ] Derivative Progress: 180/2083 symbols completed. BBD took 1.0s. Estimated remaining: 10m 31s. Rate: 181.0 symbols/min [2025-09-15T21:12:51.407216] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:51.406892] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:51.407131] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:51.415022] [DEBUG] [LOCAL ] BBDO: Loaded 3549 existing records from primary storage. [2025-09-15T21:12:51.415311] [INFO ] [MAIN ] BBDO: Loaded 3549 primary data records. [2025-09-15T21:12:51.521845] [DEBUG] [LOCAL ] BBUC: Loaded 9248 existing records from primary storage. [2025-09-15T21:12:51.548202] [INFO ] [MAIN ] BBUC: Loaded 9248 primary data records. [2025-09-15T21:12:51.639815] [DEBUG] [LOCAL ] BBN: Loaded 13404 existing records from primary storage. [2025-09-15T21:12:51.695629] [INFO ] [MAIN ] BBN: Loaded 13404 primary data records. [2025-09-15T21:12:52.388174] [DEBUG] [MAIN ] BBDO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:52.389251] [INFO ] [MAIN ] BBDO: Generated 1326 derivative records from 3549 primary records. [2025-09-15T21:12:52.389621] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-15T21:12:52.404810] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1326 records). [2025-09-15T21:12:52.415115] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-15T21:12:52.417127] [INFO ] [MAIN ] Derivative Progress: 181/2083 symbols completed. BBDO took 1.0s. Estimated remaining: 10m 38s. Rate: 179.0 symbols/min [2025-09-15T21:12:52.417478] [DEBUG] [MAIN ] BBUC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:52.418737] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:52.420002] [INFO ] [MAIN ] BBUC: Generated 1326 derivative records from 9248 primary records. [2025-09-15T21:12:52.420442] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-15T21:12:52.438220] [DEBUG] [MAIN ] BBN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:52.443854] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1326 records). [2025-09-15T21:12:52.441061] [INFO ] [MAIN ] BBN: Generated 1326 derivative records from 13404 primary records. [2025-09-15T21:12:52.444010] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-15T21:12:52.444090] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-15T21:12:52.446743] [INFO ] [MAIN ] Derivative Progress: 182/2083 symbols completed. BBUC took 1.0s. Estimated remaining: 10m 34s. Rate: 179.9 symbols/min [2025-09-15T21:12:52.448074] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:52.459981] [DEBUG] [LOCAL ] BBN: Derivative data saved (1326 records). [2025-09-15T21:12:52.460184] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-15T21:12:52.462425] [INFO ] [MAIN ] Derivative Progress: 183/2083 symbols completed. BBN took 1.1s. Estimated remaining: 10m 30s. Rate: 180.8 symbols/min [2025-09-15T21:12:52.462728] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:52.493587] [DEBUG] [LOCAL ] BBW: Loaded 18611 existing records from primary storage. [2025-09-15T21:12:52.505184] [INFO ] [MAIN ] BBW: Loaded 18611 primary data records. [2025-09-15T21:12:52.539365] [DEBUG] [LOCAL ] BBVA: Loaded 36011 existing records from primary storage. [2025-09-15T21:12:52.552173] [INFO ] [MAIN ] BBVA: Loaded 36011 primary data records. [2025-09-15T21:12:52.917938] [DEBUG] [LOCAL ] BBWI: Loaded 39551 existing records from primary storage. [2025-09-15T21:12:52.928266] [INFO ] [MAIN ] BBWI: Loaded 39551 primary data records. [2025-09-15T21:12:53.415594] [DEBUG] [MAIN ] BBW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:53.418490] [INFO ] [MAIN ] BBW: Generated 1326 derivative records from 18611 primary records. [2025-09-15T21:12:53.419176] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-15T21:12:53.436107] [DEBUG] [MAIN ] BBVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:53.440262] [INFO ] [MAIN ] BBVA: Generated 1326 derivative records from 36011 primary records. [2025-09-15T21:12:53.441400] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-15T21:12:53.443396] [DEBUG] [LOCAL ] BBW: Derivative data saved (1326 records). [2025-09-15T21:12:53.443565] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-15T21:12:53.445564] [INFO ] [MAIN ] Derivative Progress: 184/2083 symbols completed. BBW took 1.0s. Estimated remaining: 10m 37s. Rate: 178.9 symbols/min [2025-09-15T21:12:53.446202] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:53.459457] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1326 records). [2025-09-15T21:12:53.459818] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-15T21:12:53.463500] [INFO ] [MAIN ] Derivative Progress: 185/2083 symbols completed. BBVA took 1.0s. Estimated remaining: 10m 33s. Rate: 179.9 symbols/min [2025-09-15T21:12:53.463818] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:53.478950] [DEBUG] [MAIN ] BBWI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:53.479910] [INFO ] [MAIN ] BBWI: Generated 1326 derivative records from 39551 primary records. [2025-09-15T21:12:53.480052] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-15T21:12:53.508487] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1326 records). [2025-09-15T21:12:53.518966] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-15T21:12:53.521052] [INFO ] [MAIN ] Derivative Progress: 186/2083 symbols completed. BBWI took 1.1s. Estimated remaining: 10m 30s. Rate: 180.7 symbols/min [2025-09-15T21:12:53.523161] [DEBUG] [LOCAL ] BC: Loaded 32606 existing records from primary storage. [2025-09-15T21:12:53.521805] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:53.523355] [INFO ] [MAIN ] BC: Loaded 32606 primary data records. [2025-09-15T21:12:53.564774] [DEBUG] [LOCAL ] BCAT: Loaded 25058 existing records from primary storage. [2025-09-15T21:12:53.577522] [INFO ] [MAIN ] BCAT: Loaded 25058 primary data records. [2025-09-15T21:12:53.890960] [DEBUG] [LOCAL ] BCC: Loaded 20178 existing records from primary storage. [2025-09-15T21:12:53.908923] [INFO ] [MAIN ] BCC: Loaded 20178 primary data records. [2025-09-15T21:12:54.443984] [DEBUG] [MAIN ] BC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:54.450243] [INFO ] [MAIN ] BC: Generated 1326 derivative records from 32606 primary records. [2025-09-15T21:12:54.450922] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-15T21:12:54.467822] [DEBUG] [LOCAL ] BC: Derivative data saved (1326 records). [2025-09-15T21:12:54.469450] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-15T21:12:54.471755] [INFO ] [MAIN ] Derivative Progress: 187/2083 symbols completed. BC took 1.0s. Estimated remaining: 10m 36s. Rate: 178.9 symbols/min [2025-09-15T21:12:54.472339] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:54.483741] [DEBUG] [MAIN ] BCAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:54.485002] [INFO ] [MAIN ] BCAT: Generated 1326 derivative records from 25058 primary records. [2025-09-15T21:12:54.485073] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-15T21:12:54.499889] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1326 records). [2025-09-15T21:12:54.500700] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-15T21:12:54.503409] [INFO ] [MAIN ] Derivative Progress: 188/2083 symbols completed. BCAT took 1.0s. Estimated remaining: 10m 33s. Rate: 179.7 symbols/min [2025-09-15T21:12:54.503870] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:54.514504] [DEBUG] [MAIN ] BCC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:54.515235] [INFO ] [MAIN ] BCC: Generated 1326 derivative records from 20178 primary records. [2025-09-15T21:12:54.515407] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-15T21:12:54.528786] [DEBUG] [LOCAL ] BCC: Derivative data saved (1326 records). [2025-09-15T21:12:54.529015] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-15T21:12:54.532019] [INFO ] [MAIN ] Derivative Progress: 189/2083 symbols completed. BCC took 1.0s. Estimated remaining: 10m 29s. Rate: 180.6 symbols/min [2025-09-15T21:12:54.532421] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:54.573338] [DEBUG] [LOCAL ] BCH: Loaded 21393 existing records from primary storage. [2025-09-15T21:12:54.577565] [INFO ] [MAIN ] BCH: Loaded 21393 primary data records. [2025-09-15T21:12:54.599534] [DEBUG] [LOCAL ] BCE: Loaded 38550 existing records from primary storage. [2025-09-15T21:12:54.615536] [INFO ] [MAIN ] BCE: Loaded 38550 primary data records. [2025-09-15T21:12:54.745818] [DEBUG] [LOCAL ] BCO: Loaded 19118 existing records from primary storage. [2025-09-15T21:12:54.777718] [INFO ] [MAIN ] BCO: Loaded 19118 primary data records. [2025-09-15T21:12:55.439067] [DEBUG] [MAIN ] BCH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:55.440512] [INFO ] [MAIN ] BCH: Generated 1326 derivative records from 21393 primary records. [2025-09-15T21:12:55.450457] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-15T21:12:55.452194] [DEBUG] [MAIN ] BCE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:55.462453] [INFO ] [MAIN ] BCE: Generated 1326 derivative records from 38550 primary records. [2025-09-15T21:12:55.463288] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-15T21:12:55.465851] [DEBUG] [LOCAL ] BCH: Derivative data saved (1326 records). [2025-09-15T21:12:55.466087] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-15T21:12:55.469286] [INFO ] [MAIN ] Derivative Progress: 190/2083 symbols completed. BCH took 1.0s. Estimated remaining: 10m 35s. Rate: 178.9 symbols/min [2025-09-15T21:12:55.469674] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:55.485369] [DEBUG] [LOCAL ] BCE: Derivative data saved (1326 records). [2025-09-15T21:12:55.486363] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-15T21:12:55.489530] [INFO ] [MAIN ] Derivative Progress: 191/2083 symbols completed. BCE took 1.0s. Estimated remaining: 10m 31s. Rate: 179.8 symbols/min [2025-09-15T21:12:55.490066] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:55.503404] [DEBUG] [MAIN ] BCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:55.504229] [INFO ] [MAIN ] BCO: Generated 1326 derivative records from 19118 primary records. [2025-09-15T21:12:55.504508] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-15T21:12:55.527540] [DEBUG] [LOCAL ] BCO: Derivative data saved (1326 records). [2025-09-15T21:12:55.533465] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-15T21:12:55.536335] [INFO ] [MAIN ] Derivative Progress: 192/2083 symbols completed. BCO took 1.0s. Estimated remaining: 10m 28s. Rate: 180.6 symbols/min [2025-09-15T21:12:55.537263] [DEBUG] [LOCAL ] BCSF: Loaded 19270 existing records from primary storage. [2025-09-15T21:12:55.537664] [INFO ] [MAIN ] BCSF: Loaded 19270 primary data records. [2025-09-15T21:12:55.536749] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:55.577463] [DEBUG] [LOCAL ] BCX: Loaded 15307 existing records from primary storage. [2025-09-15T21:12:55.591282] [INFO ] [MAIN ] BCX: Loaded 15307 primary data records. [2025-09-15T21:12:55.848068] [DEBUG] [LOCAL ] BDC: Loaded 17657 existing records from primary storage. [2025-09-15T21:12:56.026352] [INFO ] [MAIN ] BDC: Loaded 17657 primary data records. [2025-09-15T21:12:56.438483] [DEBUG] [MAIN ] BCSF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:56.439479] [INFO ] [MAIN ] BCSF: Generated 1326 derivative records from 19270 primary records. [2025-09-15T21:12:56.449385] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-15T21:12:56.449833] [DEBUG] [MAIN ] BCX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:56.451165] [INFO ] [MAIN ] BCX: Generated 1326 derivative records from 15307 primary records. [2025-09-15T21:12:56.457177] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-15T21:12:56.475636] [DEBUG] [LOCAL ] BCX: Derivative data saved (1326 records). [2025-09-15T21:12:56.474980] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1326 records). [2025-09-15T21:12:56.476460] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-15T21:12:56.479837] [INFO ] [MAIN ] Derivative Progress: 193/2083 symbols completed. BCX took 1.0s. Estimated remaining: 10m 34s. Rate: 178.9 symbols/min [2025-09-15T21:12:56.480164] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-15T21:12:56.481948] [INFO ] [MAIN ] Derivative Progress: 194/2083 symbols completed. BCSF took 1.0s. Estimated remaining: 10m 30s. Rate: 179.8 symbols/min [2025-09-15T21:12:56.491585] [DEBUG] [MAIN ] BDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:56.492172] [INFO ] [MAIN ] BDC: Generated 1326 derivative records from 17657 primary records. [2025-09-15T21:12:56.492246] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-15T21:12:56.503999] [DEBUG] [LOCAL ] BDC: Derivative data saved (1326 records). [2025-09-15T21:12:56.504055] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-15T21:12:56.506600] [INFO ] [MAIN ] Derivative Progress: 195/2083 symbols completed. BDC took 1.0s. Estimated remaining: 10m 27s. Rate: 180.7 symbols/min [2025-09-15T21:12:56.507230] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:56.507185] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:56.507344] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:56.535443] [DEBUG] [LOCAL ] BDJ: Loaded 21245 existing records from primary storage. [2025-09-15T21:12:56.535779] [INFO ] [MAIN ] BDJ: Loaded 21245 primary data records. [2025-09-15T21:12:56.664615] [DEBUG] [LOCAL ] BDN: Loaded 34811 existing records from primary storage. [2025-09-15T21:12:56.685685] [INFO ] [MAIN ] BDN: Loaded 34811 primary data records. [2025-09-15T21:12:56.828353] [DEBUG] [LOCAL ] BDX: Loaded 38949 existing records from primary storage. [2025-09-15T21:12:56.924339] [INFO ] [MAIN ] BDX: Loaded 38949 primary data records. [2025-09-15T21:12:57.385319] [DEBUG] [MAIN ] BDJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:57.386810] [INFO ] [MAIN ] BDJ: Generated 1326 derivative records from 21245 primary records. [2025-09-15T21:12:57.387213] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-15T21:12:57.412176] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1326 records). [2025-09-15T21:12:57.412426] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-15T21:12:57.412696] [DEBUG] [MAIN ] BDN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:57.415093] [INFO ] [MAIN ] Derivative Progress: 196/2083 symbols completed. BDJ took 0.9s. Estimated remaining: 10m 32s. Rate: 179.1 symbols/min [2025-09-15T21:12:57.415512] [INFO ] [MAIN ] BDN: Generated 1326 derivative records from 34811 primary records. [2025-09-15T21:12:57.416294] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:57.416450] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-15T21:12:57.432401] [DEBUG] [MAIN ] BDX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:57.437203] [INFO ] [MAIN ] BDX: Generated 1326 derivative records from 38949 primary records. [2025-09-15T21:12:57.439005] [DEBUG] [LOCAL ] BDN: Derivative data saved (1326 records). [2025-09-15T21:12:57.438522] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-15T21:12:57.439156] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-15T21:12:57.441998] [INFO ] [MAIN ] Derivative Progress: 197/2083 symbols completed. BDN took 0.9s. Estimated remaining: 10m 29s. Rate: 179.9 symbols/min [2025-09-15T21:12:57.448004] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:57.454787] [DEBUG] [LOCAL ] BDX: Derivative data saved (1326 records). [2025-09-15T21:12:57.454930] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-15T21:12:57.457058] [INFO ] [MAIN ] Derivative Progress: 198/2083 symbols completed. BDX took 0.9s. Estimated remaining: 10m 26s. Rate: 180.8 symbols/min [2025-09-15T21:12:57.457292] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:57.489617] [DEBUG] [LOCAL ] BE: Loaded 39622 existing records from primary storage. [2025-09-15T21:12:57.489831] [INFO ] [MAIN ] BE: Loaded 39622 primary data records. [2025-09-15T21:12:57.670957] [DEBUG] [LOCAL ] BEN: Loaded 39192 existing records from primary storage. [2025-09-15T21:12:57.709154] [DEBUG] [LOCAL ] BEKE: Loaded 39242 existing records from primary storage. [2025-09-15T21:12:57.708091] [INFO ] [MAIN ] BEN: Loaded 39192 primary data records. [2025-09-15T21:12:57.800036] [INFO ] [MAIN ] BEKE: Loaded 39242 primary data records. [2025-09-15T21:12:58.408994] [DEBUG] [MAIN ] BE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:58.410056] [INFO ] [MAIN ] BE: Generated 1326 derivative records from 39622 primary records. [2025-09-15T21:12:58.410264] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-15T21:12:58.426409] [DEBUG] [LOCAL ] BE: Derivative data saved (1326 records). [2025-09-15T21:12:58.427072] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-15T21:12:58.428766] [INFO ] [MAIN ] Derivative Progress: 199/2083 symbols completed. BE took 1.0s. Estimated remaining: 10m 31s. Rate: 179.1 symbols/min [2025-09-15T21:12:58.429184] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:58.457967] [DEBUG] [MAIN ] BEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:58.464776] [INFO ] [MAIN ] BEN: Generated 1326 derivative records from 39192 primary records. [2025-09-15T21:12:58.463905] [DEBUG] [MAIN ] BEKE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:58.465706] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-15T21:12:58.465634] [INFO ] [MAIN ] BEKE: Generated 1326 derivative records from 39242 primary records. [2025-09-15T21:12:58.466559] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-15T21:12:58.497745] [DEBUG] [LOCAL ] BEN: Derivative data saved (1326 records). [2025-09-15T21:12:58.498393] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-15T21:12:58.501698] [INFO ] [MAIN ] Derivative Progress: 200/2083 symbols completed. BEN took 1.0s. Estimated remaining: 10m 28s. Rate: 179.8 symbols/min [2025-09-15T21:12:58.499239] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1326 records). [2025-09-15T21:12:58.502079] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:58.502163] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-15T21:12:58.504195] [INFO ] [MAIN ] Derivative Progress: 201/2083 symbols completed. BEKE took 1.1s. Estimated remaining: 10m 25s. Rate: 180.7 symbols/min [2025-09-15T21:12:58.505219] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:58.515011] [DEBUG] [LOCAL ] BEP: Loaded 27576 existing records from primary storage. [2025-09-15T21:12:58.516076] [INFO ] [MAIN ] BEP: Loaded 27576 primary data records. [2025-09-15T21:12:58.561460] [DEBUG] [LOCAL ] BEPH: Loaded 3476 existing records from primary storage. [2025-09-15T21:12:58.587897] [INFO ] [MAIN ] BEPH: Loaded 3476 primary data records. [2025-09-15T21:12:59.063345] [DEBUG] [LOCAL ] BEPC: Loaded 33680 existing records from primary storage. [2025-09-15T21:12:59.065104] [INFO ] [MAIN ] BEPC: Loaded 33680 primary data records. [2025-09-15T21:12:59.357670] [DEBUG] [MAIN ] BEP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:59.359999] [INFO ] [MAIN ] BEP: Generated 1326 derivative records from 27576 primary records. [2025-09-15T21:12:59.360328] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-15T21:12:59.384607] [DEBUG] [MAIN ] BEPH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:59.388231] [DEBUG] [LOCAL ] BEP: Derivative data saved (1326 records). [2025-09-15T21:12:59.388917] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-15T21:12:59.388136] [INFO ] [MAIN ] BEPH: Generated 1326 derivative records from 3476 primary records. [2025-09-15T21:12:59.390490] [INFO ] [MAIN ] Derivative Progress: 202/2083 symbols completed. BEP took 1.0s. Estimated remaining: 10m 30s. Rate: 179.2 symbols/min [2025-09-15T21:12:59.390723] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-15T21:12:59.391179] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:59.405605] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1326 records). [2025-09-15T21:12:59.405856] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-15T21:12:59.408345] [INFO ] [MAIN ] Derivative Progress: 203/2083 symbols completed. BEPH took 0.9s. Estimated remaining: 10m 27s. Rate: 180.0 symbols/min [2025-09-15T21:12:59.408779] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:12:59.411687] [DEBUG] [LOCAL ] BEPI: Loaded 2662 existing records from primary storage. [2025-09-15T21:12:59.412195] [INFO ] [MAIN ] BEPI: Loaded 2662 primary data records. [2025-09-15T21:12:59.496891] [DEBUG] [LOCAL ] BEPJ: Loaded 2575 existing records from primary storage. [2025-09-15T21:12:59.507619] [INFO ] [MAIN ] BEPJ: Loaded 2575 primary data records. [2025-09-15T21:12:59.612565] [DEBUG] [MAIN ] BEPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:12:59.640473] [INFO ] [MAIN ] BEPC: Generated 1326 derivative records from 33680 primary records. [2025-09-15T21:12:59.659352] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-15T21:12:59.893915] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1326 records). [2025-09-15T21:12:59.967180] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-15T21:12:59.979446] [INFO ] [MAIN ] Derivative Progress: 204/2083 symbols completed. BEPC took 1.5s. Estimated remaining: 10m 28s. Rate: 179.4 symbols/min [2025-09-15T21:12:59.979857] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:00.026400] [DEBUG] [MAIN ] BEPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:00.030316] [DEBUG] [LOCAL ] BFAM: Loaded 24414 existing records from primary storage. [2025-09-15T21:13:00.031500] [INFO ] [MAIN ] BEPI: Generated 1326 derivative records from 2662 primary records. [2025-09-15T21:13:00.031629] [INFO ] [MAIN ] BFAM: Loaded 24414 primary data records. [2025-09-15T21:13:00.031826] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-15T21:13:00.032202] [DEBUG] [MAIN ] BEPJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:00.044928] [INFO ] [MAIN ] BEPJ: Generated 1326 derivative records from 2575 primary records. [2025-09-15T21:13:00.070108] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-15T21:13:00.154466] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1326 records). [2025-09-15T21:13:00.166517] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-15T21:13:00.198940] [INFO ] [MAIN ] Derivative Progress: 205/2083 symbols completed. BEPI took 0.8s. Estimated remaining: 10m 27s. Rate: 179.7 symbols/min [2025-09-15T21:13:00.237474] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:00.231378] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1326 records). [2025-09-15T21:13:00.237933] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-15T21:13:00.315257] [INFO ] [MAIN ] Derivative Progress: 206/2083 symbols completed. BEPJ took 0.9s. Estimated remaining: 10m 25s. Rate: 180.3 symbols/min [2025-09-15T21:13:00.327332] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:00.341381] [DEBUG] [LOCAL ] BFK: Loaded 9574 existing records from primary storage. [2025-09-15T21:13:00.341697] [INFO ] [MAIN ] BFK: Loaded 9574 primary data records. [2025-09-15T21:13:00.543176] [DEBUG] [LOCAL ] BFH: Loaded 30069 existing records from primary storage. [2025-09-15T21:13:00.549723] [INFO ] [MAIN ] BFH: Loaded 30069 primary data records. [2025-09-15T21:13:00.748942] [DEBUG] [MAIN ] BFAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:00.777577] [INFO ] [MAIN ] BFAM: Generated 1326 derivative records from 24414 primary records. [2025-09-15T21:13:00.802709] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-15T21:13:00.895751] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1326 records). [2025-09-15T21:13:00.981382] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-15T21:13:00.983788] [INFO ] [MAIN ] Derivative Progress: 207/2083 symbols completed. BFAM took 1.0s. Estimated remaining: 10m 27s. Rate: 179.4 symbols/min [2025-09-15T21:13:00.984479] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:01.007967] [DEBUG] [MAIN ] BFK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:01.009156] [INFO ] [MAIN ] BFK: Generated 1326 derivative records from 9574 primary records. [2025-09-15T21:13:01.010579] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-15T21:13:01.024293] [DEBUG] [LOCAL ] BFK: Derivative data saved (1326 records). [2025-09-15T21:13:01.024834] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-15T21:13:01.027282] [INFO ] [MAIN ] Derivative Progress: 208/2083 symbols completed. BFK took 0.7s. Estimated remaining: 10m 25s. Rate: 180.1 symbols/min [2025-09-15T21:13:01.051665] [DEBUG] [MAIN ] BFH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:01.052485] [INFO ] [MAIN ] BFH: Generated 1326 derivative records from 30069 primary records. [2025-09-15T21:13:01.052563] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-15T21:13:01.075511] [DEBUG] [LOCAL ] BFH: Derivative data saved (1326 records). [2025-09-15T21:13:01.076752] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-15T21:13:01.078941] [INFO ] [MAIN ] Derivative Progress: 209/2083 symbols completed. BFH took 0.8s. Estimated remaining: 10m 22s. Rate: 180.9 symbols/min [2025-09-15T21:13:01.079919] [DEBUG] [LOCAL ] BFLY: Loaded 38151 existing records from primary storage. [2025-09-15T21:13:01.080237] [INFO ] [MAIN ] BFLY: Loaded 38151 primary data records. [2025-09-15T21:13:01.355027] [DEBUG] [MAIN ] BFLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:01.355710] [INFO ] [MAIN ] BFLY: Generated 1326 derivative records from 38151 primary records. [2025-09-15T21:13:01.355773] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-15T21:13:01.367249] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1326 records). [2025-09-15T21:13:01.367317] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-15T21:13:01.369064] [INFO ] [MAIN ] Derivative Progress: 210/2083 symbols completed. BFLY took 0.4s. Estimated remaining: 10m 21s. Rate: 181.0 symbols/min [2025-09-15T21:13:01.369816] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:01.369992] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:01.370552] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:01.379960] [DEBUG] [LOCAL ] BFS: Loaded 6716 existing records from primary storage. [2025-09-15T21:13:01.380135] [INFO ] [MAIN ] BFS: Loaded 6716 primary data records. [2025-09-15T21:13:01.488865] [DEBUG] [LOCAL ] BFZ: Loaded 8249 existing records from primary storage. [2025-09-15T21:13:01.504936] [INFO ] [MAIN ] BFZ: Loaded 8249 primary data records. [2025-09-15T21:13:01.788563] [DEBUG] [LOCAL ] BG: Loaded 37332 existing records from primary storage. [2025-09-15T21:13:01.804095] [INFO ] [MAIN ] BG: Loaded 37332 primary data records. [2025-09-15T21:13:02.264079] [DEBUG] [MAIN ] BFS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:02.265395] [INFO ] [MAIN ] BFS: Generated 1326 derivative records from 6716 primary records. [2025-09-15T21:13:02.265813] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-15T21:13:02.280356] [DEBUG] [LOCAL ] BFS: Derivative data saved (1326 records). [2025-09-15T21:13:02.281094] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-15T21:13:02.283256] [INFO ] [MAIN ] Derivative Progress: 211/2083 symbols completed. BFS took 0.9s. Estimated remaining: 10m 26s. Rate: 179.5 symbols/min [2025-09-15T21:13:02.284057] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:02.301431] [DEBUG] [MAIN ] BFZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:02.302889] [INFO ] [MAIN ] BFZ: Generated 1326 derivative records from 8249 primary records. [2025-09-15T21:13:02.303040] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-15T21:13:02.320723] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1326 records). [2025-09-15T21:13:02.322845] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-15T21:13:02.325575] [INFO ] [MAIN ] Derivative Progress: 212/2083 symbols completed. BFZ took 1.0s. Estimated remaining: 10m 23s. Rate: 180.2 symbols/min [2025-09-15T21:13:02.326052] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:02.338107] [DEBUG] [LOCAL ] BGB: Loaded 12257 existing records from primary storage. [2025-09-15T21:13:02.342953] [INFO ] [MAIN ] BGB: Loaded 12257 primary data records. [2025-09-15T21:13:02.343244] [DEBUG] [MAIN ] BG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:02.356003] [INFO ] [MAIN ] BG: Generated 1326 derivative records from 37332 primary records. [2025-09-15T21:13:02.365715] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-15T21:13:02.469909] [DEBUG] [LOCAL ] BGH: Loaded 12045 existing records from primary storage. [2025-09-15T21:13:02.469571] [DEBUG] [LOCAL ] BG: Derivative data saved (1326 records). [2025-09-15T21:13:02.470162] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-15T21:13:02.470090] [INFO ] [MAIN ] BGH: Loaded 12045 primary data records. [2025-09-15T21:13:02.473723] [INFO ] [MAIN ] Derivative Progress: 213/2083 symbols completed. BG took 1.1s. Estimated remaining: 10m 21s. Rate: 180.7 symbols/min [2025-09-15T21:13:02.484393] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:02.765501] [DEBUG] [LOCAL ] BGR: Loaded 9621 existing records from primary storage. [2025-09-15T21:13:02.776521] [INFO ] [MAIN ] BGR: Loaded 9621 primary data records. [2025-09-15T21:13:03.270870] [DEBUG] [MAIN ] BGB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:03.272395] [INFO ] [MAIN ] BGB: Generated 1326 derivative records from 12257 primary records. [2025-09-15T21:13:03.272548] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-15T21:13:03.288626] [DEBUG] [LOCAL ] BGB: Derivative data saved (1326 records). [2025-09-15T21:13:03.289460] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-15T21:13:03.291909] [INFO ] [MAIN ] Derivative Progress: 214/2083 symbols completed. BGB took 1.0s. Estimated remaining: 10m 25s. Rate: 179.5 symbols/min [2025-09-15T21:13:03.294709] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:03.308814] [DEBUG] [MAIN ] BGH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:03.310134] [INFO ] [MAIN ] BGH: Generated 1326 derivative records from 12045 primary records. [2025-09-15T21:13:03.310285] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-15T21:13:03.327798] [DEBUG] [LOCAL ] BGH: Derivative data saved (1326 records). [2025-09-15T21:13:03.328222] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-15T21:13:03.341484] [INFO ] [MAIN ] Derivative Progress: 215/2083 symbols completed. BGH took 1.0s. Estimated remaining: 10m 22s. Rate: 180.2 symbols/min [2025-09-15T21:13:03.342824] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:03.342339] [DEBUG] [MAIN ] BGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:03.344335] [INFO ] [MAIN ] BGR: Generated 1326 derivative records from 9621 primary records. [2025-09-15T21:13:03.344740] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-15T21:13:03.360256] [DEBUG] [LOCAL ] BGR: Derivative data saved (1326 records). [2025-09-15T21:13:03.360504] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-15T21:13:03.364826] [DEBUG] [LOCAL ] BGSF: Loaded 4578 existing records from primary storage. [2025-09-15T21:13:03.367670] [INFO ] [MAIN ] BGSF: Loaded 4578 primary data records. [2025-09-15T21:13:03.367533] [INFO ] [MAIN ] Derivative Progress: 216/2083 symbols completed. BGR took 0.9s. Estimated remaining: 10m 19s. Rate: 181.0 symbols/min [2025-09-15T21:13:03.400680] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:03.521162] [DEBUG] [LOCAL ] BGS: Loaded 37320 existing records from primary storage. [2025-09-15T21:13:03.546738] [INFO ] [MAIN ] BGS: Loaded 37320 primary data records. [2025-09-15T21:13:03.632248] [DEBUG] [LOCAL ] BGT: Loaded 12264 existing records from primary storage. [2025-09-15T21:13:03.755445] [INFO ] [MAIN ] BGT: Loaded 12264 primary data records. [2025-09-15T21:13:04.240144] [DEBUG] [MAIN ] BGSF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:04.241567] [INFO ] [MAIN ] BGSF: Generated 1326 derivative records from 4578 primary records. [2025-09-15T21:13:04.241800] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-15T21:13:04.253084] [DEBUG] [MAIN ] BGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:04.258558] [INFO ] [MAIN ] BGS: Generated 1326 derivative records from 37320 primary records. [2025-09-15T21:13:04.261837] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-15T21:13:04.266112] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1326 records). [2025-09-15T21:13:04.266890] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-15T21:13:04.274570] [INFO ] [MAIN ] Derivative Progress: 217/2083 symbols completed. BGSF took 0.9s. Estimated remaining: 10m 24s. Rate: 179.5 symbols/min [2025-09-15T21:13:04.276816] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:04.288723] [DEBUG] [MAIN ] BGT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:04.290500] [INFO ] [MAIN ] BGT: Generated 1326 derivative records from 12264 primary records. [2025-09-15T21:13:04.290594] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-15T21:13:04.291100] [DEBUG] [LOCAL ] BGS: Derivative data saved (1326 records). [2025-09-15T21:13:04.292111] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-15T21:13:04.294290] [INFO ] [MAIN ] Derivative Progress: 218/2083 symbols completed. BGS took 1.0s. Estimated remaining: 10m 21s. Rate: 180.3 symbols/min [2025-09-15T21:13:04.294485] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:04.310037] [DEBUG] [LOCAL ] BGT: Derivative data saved (1326 records). [2025-09-15T21:13:04.315443] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-15T21:13:04.317915] [INFO ] [MAIN ] Derivative Progress: 219/2083 symbols completed. BGT took 0.9s. Estimated remaining: 10m 18s. Rate: 181.1 symbols/min [2025-09-15T21:13:04.318218] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:04.315539] [DEBUG] [LOCAL ] BGX: Loaded 7699 existing records from primary storage. [2025-09-15T21:13:04.318977] [INFO ] [MAIN ] BGX: Loaded 7699 primary data records. [2025-09-15T21:13:04.459190] [DEBUG] [LOCAL ] BGY: Loaded 16276 existing records from primary storage. [2025-09-15T21:13:04.478714] [INFO ] [MAIN ] BGY: Loaded 16276 primary data records. [2025-09-15T21:13:04.588512] [DEBUG] [LOCAL ] BHC: Loaded 34175 existing records from primary storage. [2025-09-15T21:13:04.647868] [INFO ] [MAIN ] BHC: Loaded 34175 primary data records. [2025-09-15T21:13:05.269859] [DEBUG] [MAIN ] BGX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:05.272183] [INFO ] [MAIN ] BGX: Generated 1326 derivative records from 7699 primary records. [2025-09-15T21:13:05.273662] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-15T21:13:05.291034] [DEBUG] [MAIN ] BGY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:05.298091] [DEBUG] [LOCAL ] BGX: Derivative data saved (1326 records). [2025-09-15T21:13:05.298927] [INFO ] [MAIN ] BGY: Generated 1326 derivative records from 16276 primary records. [2025-09-15T21:13:05.299174] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-15T21:13:05.299261] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-15T21:13:05.302539] [INFO ] [MAIN ] Derivative Progress: 220/2083 symbols completed. BGX took 1.0s. Estimated remaining: 10m 23s. Rate: 179.5 symbols/min [2025-09-15T21:13:05.313335] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:05.316455] [DEBUG] [LOCAL ] BGY: Derivative data saved (1326 records). [2025-09-15T21:13:05.317156] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-15T21:13:05.329110] [INFO ] [MAIN ] Derivative Progress: 221/2083 symbols completed. BGY took 1.0s. Estimated remaining: 10m 20s. Rate: 180.2 symbols/min [2025-09-15T21:13:05.329734] [DEBUG] [MAIN ] BHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:05.330599] [INFO ] [MAIN ] BHC: Generated 1326 derivative records from 34175 primary records. [2025-09-15T21:13:05.329908] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:05.330754] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-15T21:13:05.343874] [DEBUG] [LOCAL ] BHC: Derivative data saved (1326 records). [2025-09-15T21:13:05.343971] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-15T21:13:05.346320] [INFO ] [MAIN ] Derivative Progress: 222/2083 symbols completed. BHC took 1.0s. Estimated remaining: 10m 17s. Rate: 181.0 symbols/min [2025-09-15T21:13:05.346713] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:05.372778] [DEBUG] [LOCAL ] BHE: Loaded 17441 existing records from primary storage. [2025-09-15T21:13:05.372965] [INFO ] [MAIN ] BHE: Loaded 17441 primary data records. [2025-09-15T21:13:05.373273] [DEBUG] [LOCAL ] BHK: Loaded 18311 existing records from primary storage. [2025-09-15T21:13:05.373441] [INFO ] [MAIN ] BHK: Loaded 18311 primary data records. [2025-09-15T21:13:05.689009] [DEBUG] [LOCAL ] BHP: Loaded 39376 existing records from primary storage. [2025-09-15T21:13:05.733096] [INFO ] [MAIN ] BHP: Loaded 39376 primary data records. [2025-09-15T21:13:06.271560] [DEBUG] [MAIN ] BHK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:06.273713] [INFO ] [MAIN ] BHK: Generated 1326 derivative records from 18311 primary records. [2025-09-15T21:13:06.274284] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-15T21:13:06.290745] [DEBUG] [LOCAL ] BHK: Derivative data saved (1326 records). [2025-09-15T21:13:06.291233] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-15T21:13:06.303341] [INFO ] [MAIN ] Derivative Progress: 223/2083 symbols completed. BHK took 1.0s. Estimated remaining: 10m 22s. Rate: 179.5 symbols/min [2025-09-15T21:13:06.303941] [DEBUG] [MAIN ] BHE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:06.307636] [INFO ] [MAIN ] BHE: Generated 1326 derivative records from 17441 primary records. [2025-09-15T21:13:06.307936] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-15T21:13:06.318854] [DEBUG] [MAIN ] BHP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:06.325086] [INFO ] [MAIN ] BHP: Generated 1326 derivative records from 39376 primary records. [2025-09-15T21:13:06.326522] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-15T21:13:06.342425] [DEBUG] [LOCAL ] BHE: Derivative data saved (1326 records). [2025-09-15T21:13:06.343096] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-15T21:13:06.346555] [INFO ] [MAIN ] Derivative Progress: 224/2083 symbols completed. BHE took 1.0s. Estimated remaining: 10m 19s. Rate: 180.2 symbols/min [2025-09-15T21:13:06.348587] [DEBUG] [LOCAL ] BHP: Derivative data saved (1326 records). [2025-09-15T21:13:06.348724] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-15T21:13:06.350824] [INFO ] [MAIN ] Derivative Progress: 225/2083 symbols completed. BHP took 1.0s. Estimated remaining: 10m 16s. Rate: 181.0 symbols/min [2025-09-15T21:13:06.351364] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:06.351522] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:06.351271] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:06.377909] [DEBUG] [LOCAL ] BHR: Loaded 15154 existing records from primary storage. [2025-09-15T21:13:06.388321] [INFO ] [MAIN ] BHR: Loaded 15154 primary data records. [2025-09-15T21:13:06.531959] [DEBUG] [LOCAL ] BILL: Loaded 38625 existing records from primary storage. [2025-09-15T21:13:06.532145] [INFO ] [MAIN ] BILL: Loaded 38625 primary data records. [2025-09-15T21:13:06.530722] [DEBUG] [LOCAL ] BHVN: Loaded 37135 existing records from primary storage. [2025-09-15T21:13:06.543213] [INFO ] [MAIN ] BHVN: Loaded 37135 primary data records. [2025-09-15T21:13:07.298175] [DEBUG] [MAIN ] BHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:07.310206] [INFO ] [MAIN ] BHR: Generated 1326 derivative records from 15154 primary records. [2025-09-15T21:13:07.311337] [DEBUG] [MAIN ] BHVN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:07.311560] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-15T21:13:07.318294] [INFO ] [MAIN ] BHVN: Generated 1326 derivative records from 37135 primary records. [2025-09-15T21:13:07.322580] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-15T21:13:07.324138] [DEBUG] [MAIN ] BILL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:07.326543] [INFO ] [MAIN ] BILL: Generated 1326 derivative records from 38625 primary records. [2025-09-15T21:13:07.332100] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-15T21:13:07.338841] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1326 records). [2025-09-15T21:13:07.339930] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-15T21:13:07.348920] [INFO ] [MAIN ] Derivative Progress: 226/2083 symbols completed. BHVN took 1.0s. Estimated remaining: 10m 21s. Rate: 179.4 symbols/min [2025-09-15T21:13:07.360444] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:07.369024] [DEBUG] [LOCAL ] BHR: Derivative data saved (1326 records). [2025-09-15T21:13:07.370350] [DEBUG] [LOCAL ] BILL: Derivative data saved (1326 records). [2025-09-15T21:13:07.370490] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-15T21:13:07.370745] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-15T21:13:07.373221] [INFO ] [MAIN ] Derivative Progress: 227/2083 symbols completed. BHR took 1.0s. Estimated remaining: 10m 18s. Rate: 180.1 symbols/min [2025-09-15T21:13:07.378680] [INFO ] [MAIN ] Derivative Progress: 228/2083 symbols completed. BILL took 1.0s. Estimated remaining: 10m 15s. Rate: 180.9 symbols/min [2025-09-15T21:13:07.379138] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:07.379672] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:07.398925] [DEBUG] [LOCAL ] BIO: Loaded 18273 existing records from primary storage. [2025-09-15T21:13:07.399096] [INFO ] [MAIN ] BIO: Loaded 18273 primary data records. [2025-09-15T21:13:07.595435] [DEBUG] [LOCAL ] BIP: Loaded 27810 existing records from primary storage. [2025-09-15T21:13:07.613623] [INFO ] [MAIN ] BIP: Loaded 27810 primary data records. [2025-09-15T21:13:07.685163] [DEBUG] [LOCAL ] BIPC: Loaded 29926 existing records from primary storage. [2025-09-15T21:13:07.826065] [INFO ] [MAIN ] BIPC: Loaded 29926 primary data records. [2025-09-15T21:13:08.317474] [DEBUG] [MAIN ] BIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:08.319172] [INFO ] [MAIN ] BIO: Generated 1326 derivative records from 18273 primary records. [2025-09-15T21:13:08.319758] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-15T21:13:08.333659] [DEBUG] [LOCAL ] BIO: Derivative data saved (1326 records). [2025-09-15T21:13:08.333747] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-15T21:13:08.335475] [INFO ] [MAIN ] Derivative Progress: 229/2083 symbols completed. BIO took 1.0s. Estimated remaining: 10m 20s. Rate: 179.4 symbols/min [2025-09-15T21:13:08.335853] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:08.347354] [DEBUG] [LOCAL ] BIPH: Loaded 1566 existing records from primary storage. [2025-09-15T21:13:08.347577] [INFO ] [MAIN ] BIPH: Loaded 1566 primary data records. [2025-09-15T21:13:08.414889] [DEBUG] [MAIN ] BIP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:08.451112] [INFO ] [MAIN ] BIP: Generated 1326 derivative records from 27810 primary records. [2025-09-15T21:13:08.456128] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-15T21:13:08.551731] [DEBUG] [LOCAL ] BIP: Derivative data saved (1326 records). [2025-09-15T21:13:08.552707] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-15T21:13:08.552624] [DEBUG] [MAIN ] BIPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:08.555234] [INFO ] [MAIN ] Derivative Progress: 230/2083 symbols completed. BIP took 1.2s. Estimated remaining: 10m 19s. Rate: 179.7 symbols/min [2025-09-15T21:13:08.558412] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:08.642400] [INFO ] [MAIN ] BIPC: Generated 1326 derivative records from 29926 primary records. [2025-09-15T21:13:08.643044] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-15T21:13:08.656450] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1326 records). [2025-09-15T21:13:08.656763] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-15T21:13:08.658883] [INFO ] [MAIN ] Derivative Progress: 231/2083 symbols completed. BIPC took 1.3s. Estimated remaining: 10m 17s. Rate: 180.2 symbols/min [2025-09-15T21:13:08.661172] [DEBUG] [LOCAL ] BIPI: Loaded 2045 existing records from primary storage. [2025-09-15T21:13:08.661346] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:08.662484] [INFO ] [MAIN ] BIPI: Loaded 2045 primary data records. [2025-09-15T21:13:08.758502] [DEBUG] [LOCAL ] BIPJ: Loaded 2114 existing records from primary storage. [2025-09-15T21:13:08.766713] [INFO ] [MAIN ] BIPJ: Loaded 2114 primary data records. [2025-09-15T21:13:09.129286] [DEBUG] [MAIN ] BIPH: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:13:09.204672] [INFO ] [MAIN ] BIPH: Generated 1325 derivative records from 1566 primary records. [2025-09-15T21:13:09.212571] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-15T21:13:09.232403] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1325 records). [2025-09-15T21:13:09.232803] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-15T21:13:09.235318] [INFO ] [MAIN ] Derivative Progress: 232/2083 symbols completed. BIPH took 0.9s. Estimated remaining: 10m 18s. Rate: 179.6 symbols/min [2025-09-15T21:13:09.236062] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:09.259603] [DEBUG] [MAIN ] BIPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:09.271225] [INFO ] [MAIN ] BIPI: Generated 1326 derivative records from 2045 primary records. [2025-09-15T21:13:09.271735] [DEBUG] [MAIN ] BIPJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:09.271940] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-15T21:13:09.272622] [INFO ] [MAIN ] BIPJ: Generated 1326 derivative records from 2114 primary records. [2025-09-15T21:13:09.282795] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-15T21:13:09.295602] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1326 records). [2025-09-15T21:13:09.306354] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-15T21:13:09.306195] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1326 records). [2025-09-15T21:13:09.319314] [INFO ] [MAIN ] Derivative Progress: 233/2083 symbols completed. BIPI took 0.8s. Estimated remaining: 10m 16s. Rate: 180.2 symbols/min [2025-09-15T21:13:09.319880] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:09.319817] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-15T21:13:09.325191] [INFO ] [MAIN ] Derivative Progress: 234/2083 symbols completed. BIPJ took 0.7s. Estimated remaining: 10m 13s. Rate: 181.0 symbols/min [2025-09-15T21:13:09.322343] [DEBUG] [LOCAL ] BIRK: Loaded 37594 existing records from primary storage. [2025-09-15T21:13:09.325849] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:09.325956] [INFO ] [MAIN ] BIRK: Loaded 37594 primary data records. [2025-09-15T21:13:09.457792] [DEBUG] [LOCAL ] BIT: Loaded 16393 existing records from primary storage. [2025-09-15T21:13:09.480374] [INFO ] [MAIN ] BIT: Loaded 16393 primary data records. [2025-09-15T21:13:09.756812] [DEBUG] [LOCAL ] BJ: Loaded 37884 existing records from primary storage. [2025-09-15T21:13:09.777722] [INFO ] [MAIN ] BJ: Loaded 37884 primary data records. [2025-09-15T21:13:10.253483] [DEBUG] [MAIN ] BIRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:10.254358] [INFO ] [MAIN ] BIRK: Generated 1326 derivative records from 37594 primary records. [2025-09-15T21:13:10.254584] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-15T21:13:10.269323] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1326 records). [2025-09-15T21:13:10.269688] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-15T21:13:10.271749] [INFO ] [MAIN ] Derivative Progress: 235/2083 symbols completed. BIRK took 1.0s. Estimated remaining: 10m 17s. Rate: 179.6 symbols/min [2025-09-15T21:13:10.272066] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:10.290180] [DEBUG] [MAIN ] BIT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:10.290949] [INFO ] [MAIN ] BIT: Generated 1326 derivative records from 16393 primary records. [2025-09-15T21:13:10.291056] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-15T21:13:10.307461] [DEBUG] [LOCAL ] BIT: Derivative data saved (1326 records). [2025-09-15T21:13:10.307713] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-15T21:13:10.309840] [INFO ] [MAIN ] Derivative Progress: 236/2083 symbols completed. BIT took 1.0s. Estimated remaining: 10m 15s. Rate: 180.2 symbols/min [2025-09-15T21:13:10.310122] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:10.321033] [DEBUG] [MAIN ] BJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:10.321932] [INFO ] [MAIN ] BJ: Generated 1326 derivative records from 37884 primary records. [2025-09-15T21:13:10.332310] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-15T21:13:10.352018] [DEBUG] [LOCAL ] BJ: Derivative data saved (1326 records). [2025-09-15T21:13:10.352323] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-15T21:13:10.354345] [INFO ] [MAIN ] Derivative Progress: 237/2083 symbols completed. BJ took 1.0s. Estimated remaining: 10m 12s. Rate: 180.9 symbols/min [2025-09-15T21:13:10.354830] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:10.379335] [DEBUG] [LOCAL ] BK: Loaded 39555 existing records from primary storage. [2025-09-15T21:13:10.379878] [INFO ] [MAIN ] BK: Loaded 39555 primary data records. [2025-09-15T21:13:10.504351] [DEBUG] [LOCAL ] BKD: Loaded 37053 existing records from primary storage. [2025-09-15T21:13:10.515568] [INFO ] [MAIN ] BKD: Loaded 37053 primary data records. [2025-09-15T21:13:10.644804] [DEBUG] [LOCAL ] BKE: Loaded 24727 existing records from primary storage. [2025-09-15T21:13:10.673903] [INFO ] [MAIN ] BKE: Loaded 24727 primary data records. [2025-09-15T21:13:11.239837] [DEBUG] [MAIN ] BK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:11.240874] [INFO ] [MAIN ] BK: Generated 1326 derivative records from 39555 primary records. [2025-09-15T21:13:11.241053] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-15T21:13:11.255504] [DEBUG] [LOCAL ] BK: Derivative data saved (1326 records). [2025-09-15T21:13:11.255666] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-15T21:13:11.257592] [INFO ] [MAIN ] Derivative Progress: 238/2083 symbols completed. BK took 1.0s. Estimated remaining: 10m 16s. Rate: 179.6 symbols/min [2025-09-15T21:13:11.269115] [DEBUG] [MAIN ] BKD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:11.269812] [INFO ] [MAIN ] BKD: Generated 1326 derivative records from 37053 primary records. [2025-09-15T21:13:11.269966] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-15T21:13:11.279502] [DEBUG] [MAIN ] BKE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:11.280172] [INFO ] [MAIN ] BKE: Generated 1326 derivative records from 24727 primary records. [2025-09-15T21:13:11.286243] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-15T21:13:11.299915] [DEBUG] [LOCAL ] BKD: Derivative data saved (1326 records). [2025-09-15T21:13:11.301289] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-15T21:13:11.305535] [INFO ] [MAIN ] Derivative Progress: 239/2083 symbols completed. BKD took 1.0s. Estimated remaining: 10m 14s. Rate: 180.2 symbols/min [2025-09-15T21:13:11.302432] [DEBUG] [LOCAL ] BKE: Derivative data saved (1326 records). [2025-09-15T21:13:11.305820] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-15T21:13:11.307862] [INFO ] [MAIN ] Derivative Progress: 240/2083 symbols completed. BKE took 1.0s. Estimated remaining: 10m 11s. Rate: 181.0 symbols/min [2025-09-15T21:13:11.308508] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:11.308415] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:11.308333] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:11.317670] [DEBUG] [LOCAL ] BKN: Loaded 5415 existing records from primary storage. [2025-09-15T21:13:11.317789] [INFO ] [MAIN ] BKN: Loaded 5415 primary data records. [2025-09-15T21:13:11.464166] [DEBUG] [LOCAL ] BKKT: Loaded 25845 existing records from primary storage. [2025-09-15T21:13:11.526490] [INFO ] [MAIN ] BKKT: Loaded 25845 primary data records. [2025-09-15T21:13:11.610050] [DEBUG] [LOCAL ] BKH: Loaded 27296 existing records from primary storage. [2025-09-15T21:13:11.630584] [INFO ] [MAIN ] BKH: Loaded 27296 primary data records. [2025-09-15T21:13:12.219185] [DEBUG] [MAIN ] BKN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:12.221242] [INFO ] [MAIN ] BKN: Generated 1326 derivative records from 5415 primary records. [2025-09-15T21:13:12.221622] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-15T21:13:12.239919] [DEBUG] [LOCAL ] BKN: Derivative data saved (1326 records). [2025-09-15T21:13:12.249737] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-15T21:13:12.252083] [INFO ] [MAIN ] Derivative Progress: 241/2083 symbols completed. BKN took 0.9s. Estimated remaining: 10m 15s. Rate: 179.6 symbols/min [2025-09-15T21:13:12.252779] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:12.252716] [DEBUG] [MAIN ] BKH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:12.262862] [DEBUG] [MAIN ] BKKT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:12.263366] [INFO ] [MAIN ] BKH: Generated 1326 derivative records from 27296 primary records. [2025-09-15T21:13:12.264231] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-15T21:13:12.264049] [INFO ] [MAIN ] BKKT: Generated 1326 derivative records from 25845 primary records. [2025-09-15T21:13:12.265010] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-15T21:13:12.286966] [DEBUG] [LOCAL ] BKH: Derivative data saved (1326 records). [2025-09-15T21:13:12.287813] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-15T21:13:12.289741] [INFO ] [MAIN ] Derivative Progress: 242/2083 symbols completed. BKH took 1.0s. Estimated remaining: 10m 13s. Rate: 180.3 symbols/min [2025-09-15T21:13:12.290539] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:12.291919] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1326 records). [2025-09-15T21:13:12.292026] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-15T21:13:12.294328] [INFO ] [MAIN ] Derivative Progress: 243/2083 symbols completed. BKKT took 1.0s. Estimated remaining: 10m 10s. Rate: 181.0 symbols/min [2025-09-15T21:13:12.294866] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:12.313680] [DEBUG] [LOCAL ] BKT: Loaded 7700 existing records from primary storage. [2025-09-15T21:13:12.313880] [INFO ] [MAIN ] BKT: Loaded 7700 primary data records. [2025-09-15T21:13:12.446525] [DEBUG] [LOCAL ] BKSY: Loaded 35899 existing records from primary storage. [2025-09-15T21:13:12.446741] [INFO ] [MAIN ] BKSY: Loaded 35899 primary data records. [2025-09-15T21:13:12.656120] [DEBUG] [LOCAL ] BKU: Loaded 30685 existing records from primary storage. [2025-09-15T21:13:12.669497] [INFO ] [MAIN ] BKU: Loaded 30685 primary data records. [2025-09-15T21:13:13.200947] [DEBUG] [MAIN ] BKT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:13.201949] [INFO ] [MAIN ] BKT: Generated 1326 derivative records from 7700 primary records. [2025-09-15T21:13:13.202099] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-15T21:13:13.216061] [DEBUG] [LOCAL ] BKT: Derivative data saved (1326 records). [2025-09-15T21:13:13.226194] [DEBUG] [MAIN ] BKSY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:13.227542] [INFO ] [MAIN ] BKSY: Generated 1326 derivative records from 35899 primary records. [2025-09-15T21:13:13.228036] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-15T21:13:13.225310] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-15T21:13:13.230308] [INFO ] [MAIN ] Derivative Progress: 244/2083 symbols completed. BKT took 0.9s. Estimated remaining: 10m 14s. Rate: 179.7 symbols/min [2025-09-15T21:13:13.236213] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:13.250222] [DEBUG] [MAIN ] BKU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:13.252049] [INFO ] [MAIN ] BKU: Generated 1326 derivative records from 30685 primary records. [2025-09-15T21:13:13.252836] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-15T21:13:13.253795] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1326 records). [2025-09-15T21:13:13.254047] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-15T21:13:13.265986] [INFO ] [MAIN ] Derivative Progress: 245/2083 symbols completed. BKSY took 1.0s. Estimated remaining: 10m 12s. Rate: 180.3 symbols/min [2025-09-15T21:13:13.267925] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:13.269933] [DEBUG] [LOCAL ] BKU: Derivative data saved (1326 records). [2025-09-15T21:13:13.270247] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-15T21:13:13.274073] [INFO ] [MAIN ] Derivative Progress: 246/2083 symbols completed. BKU took 1.0s. Estimated remaining: 10m 9s. Rate: 181.0 symbols/min [2025-09-15T21:13:13.279905] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:13.292815] [DEBUG] [LOCAL ] BKV: Loaded 20925 existing records from primary storage. [2025-09-15T21:13:13.293040] [INFO ] [MAIN ] BKV: Loaded 20925 primary data records. [2025-09-15T21:13:13.404102] [DEBUG] [LOCAL ] BLE: Loaded 10139 existing records from primary storage. [2025-09-15T21:13:13.410702] [INFO ] [MAIN ] BLE: Loaded 10139 primary data records. [2025-09-15T21:13:13.411319] [DEBUG] [LOCAL ] BLD: Loaded 20372 existing records from primary storage. [2025-09-15T21:13:13.473472] [INFO ] [MAIN ] BLD: Loaded 20372 primary data records. [2025-09-15T21:13:14.157186] [DEBUG] [MAIN ] BKV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:14.161369] [INFO ] [MAIN ] BKV: Generated 1326 derivative records from 20925 primary records. [2025-09-15T21:13:14.161880] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-15T21:13:14.172570] [DEBUG] [MAIN ] BLE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:14.180161] [INFO ] [MAIN ] BLE: Generated 1326 derivative records from 10139 primary records. [2025-09-15T21:13:14.180251] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-15T21:13:14.186233] [DEBUG] [LOCAL ] BKV: Derivative data saved (1326 records). [2025-09-15T21:13:14.186691] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-15T21:13:14.188580] [INFO ] [MAIN ] Derivative Progress: 247/2083 symbols completed. BKV took 1.0s. Estimated remaining: 10m 13s. Rate: 179.8 symbols/min [2025-09-15T21:13:14.195124] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:14.203304] [DEBUG] [LOCAL ] BLE: Derivative data saved (1326 records). [2025-09-15T21:13:14.203491] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-15T21:13:14.205910] [INFO ] [MAIN ] Derivative Progress: 248/2083 symbols completed. BLE took 0.9s. Estimated remaining: 10m 10s. Rate: 180.5 symbols/min [2025-09-15T21:13:14.215698] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:14.216105] [DEBUG] [MAIN ] BLD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:14.217463] [INFO ] [MAIN ] BLD: Generated 1326 derivative records from 20372 primary records. [2025-09-15T21:13:14.217627] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-15T21:13:14.236450] [DEBUG] [LOCAL ] BLD: Derivative data saved (1326 records). [2025-09-15T21:13:14.236804] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-15T21:13:14.239180] [INFO ] [MAIN ] Derivative Progress: 249/2083 symbols completed. BLD took 1.0s. Estimated remaining: 10m 8s. Rate: 181.1 symbols/min [2025-09-15T21:13:14.239518] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:14.250382] [DEBUG] [LOCAL ] BLK: Loaded 24344 existing records from primary storage. [2025-09-15T21:13:14.250552] [INFO ] [MAIN ] BLK: Loaded 24344 primary data records. [2025-09-15T21:13:14.369427] [DEBUG] [LOCAL ] BLW: Loaded 8953 existing records from primary storage. [2025-09-15T21:13:14.399765] [INFO ] [MAIN ] BLW: Loaded 8953 primary data records. [2025-09-15T21:13:14.498084] [DEBUG] [LOCAL ] BLND: Loaded 36059 existing records from primary storage. [2025-09-15T21:13:14.648424] [INFO ] [MAIN ] BLND: Loaded 36059 primary data records. [2025-09-15T21:13:15.141253] [DEBUG] [MAIN ] BLK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:15.142409] [INFO ] [MAIN ] BLK: Generated 1326 derivative records from 24344 primary records. [2025-09-15T21:13:15.143243] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-15T21:13:15.156317] [DEBUG] [LOCAL ] BLK: Derivative data saved (1326 records). [2025-09-15T21:13:15.157095] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-15T21:13:15.158827] [INFO ] [MAIN ] Derivative Progress: 250/2083 symbols completed. BLK took 1.0s. Estimated remaining: 10m 12s. Rate: 179.8 symbols/min [2025-09-15T21:13:15.160255] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:15.173750] [DEBUG] [MAIN ] BLW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:15.184859] [INFO ] [MAIN ] BLW: Generated 1326 derivative records from 8953 primary records. [2025-09-15T21:13:15.185562] [DEBUG] [MAIN ] BLND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:15.185694] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-15T21:13:15.187511] [INFO ] [MAIN ] BLND: Generated 1326 derivative records from 36059 primary records. [2025-09-15T21:13:15.195517] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-15T21:13:15.217445] [DEBUG] [LOCAL ] BLW: Derivative data saved (1326 records). [2025-09-15T21:13:15.220701] [DEBUG] [LOCAL ] BLND: Derivative data saved (1326 records). [2025-09-15T21:13:15.221056] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-15T21:13:15.221166] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-15T21:13:15.223689] [INFO ] [MAIN ] Derivative Progress: 251/2083 symbols completed. BLND took 1.0s. Estimated remaining: 10m 9s. Rate: 180.4 symbols/min [2025-09-15T21:13:15.227141] [INFO ] [MAIN ] Derivative Progress: 252/2083 symbols completed. BLW took 1.0s. Estimated remaining: 10m 7s. Rate: 181.1 symbols/min [2025-09-15T21:13:15.227234] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:15.228392] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:15.238062] [DEBUG] [LOCAL ] BMA: Loaded 25268 existing records from primary storage. [2025-09-15T21:13:15.238334] [INFO ] [MAIN ] BMA: Loaded 25268 primary data records. [2025-09-15T21:13:15.379297] [DEBUG] [LOCAL ] BMEZ: Loaded 17633 existing records from primary storage. [2025-09-15T21:13:15.417872] [INFO ] [MAIN ] BMEZ: Loaded 17633 primary data records. [2025-09-15T21:13:15.417717] [DEBUG] [LOCAL ] BMI: Loaded 17207 existing records from primary storage. [2025-09-15T21:13:15.453308] [INFO ] [MAIN ] BMI: Loaded 17207 primary data records. [2025-09-15T21:13:16.127064] [DEBUG] [MAIN ] BMA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:16.128946] [INFO ] [MAIN ] BMA: Generated 1326 derivative records from 25268 primary records. [2025-09-15T21:13:16.129224] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-15T21:13:16.146937] [DEBUG] [LOCAL ] BMA: Derivative data saved (1326 records). [2025-09-15T21:13:16.147175] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-15T21:13:16.149262] [INFO ] [MAIN ] Derivative Progress: 253/2083 symbols completed. BMA took 1.0s. Estimated remaining: 10m 10s. Rate: 179.9 symbols/min [2025-09-15T21:13:16.166520] [DEBUG] [MAIN ] BMEZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:16.167536] [INFO ] [MAIN ] BMEZ: Generated 1326 derivative records from 17633 primary records. [2025-09-15T21:13:16.167624] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-15T21:13:16.183736] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1326 records). [2025-09-15T21:13:16.183893] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-15T21:13:16.196503] [INFO ] [MAIN ] Derivative Progress: 254/2083 symbols completed. BMEZ took 1.0s. Estimated remaining: 10m 8s. Rate: 180.5 symbols/min [2025-09-15T21:13:16.194130] [DEBUG] [MAIN ] BMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:16.198314] [INFO ] [MAIN ] BMI: Generated 1326 derivative records from 17207 primary records. [2025-09-15T21:13:16.198480] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-15T21:13:16.213107] [DEBUG] [LOCAL ] BMI: Derivative data saved (1326 records). [2025-09-15T21:13:16.213311] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-15T21:13:16.215632] [INFO ] [MAIN ] Derivative Progress: 255/2083 symbols completed. BMI took 1.0s. Estimated remaining: 10m 6s. Rate: 181.1 symbols/min [2025-09-15T21:13:16.217069] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:16.216535] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:16.216859] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:16.245726] [DEBUG] [LOCAL ] BNED: Loaded 21697 existing records from primary storage. [2025-09-15T21:13:16.246034] [INFO ] [MAIN ] BNED: Loaded 21697 primary data records. [2025-09-15T21:13:16.429843] [DEBUG] [LOCAL ] BMY: Loaded 39717 existing records from primary storage. [2025-09-15T21:13:16.481929] [DEBUG] [LOCAL ] BN: Loaded 39006 existing records from primary storage. [2025-09-15T21:13:16.482194] [INFO ] [MAIN ] BMY: Loaded 39717 primary data records. [2025-09-15T21:13:16.482428] [INFO ] [MAIN ] BN: Loaded 39006 primary data records. [2025-09-15T21:13:17.251204] [DEBUG] [MAIN ] BNED: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:17.254583] [INFO ] [MAIN ] BNED: Generated 1326 derivative records from 21697 primary records. [2025-09-15T21:13:17.255124] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-15T21:13:17.273490] [DEBUG] [LOCAL ] BNED: Derivative data saved (1326 records). [2025-09-15T21:13:17.274585] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-15T21:13:17.276770] [INFO ] [MAIN ] Derivative Progress: 256/2083 symbols completed. BNED took 1.1s. Estimated remaining: 10m 10s. Rate: 179.6 symbols/min [2025-09-15T21:13:17.277286] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:17.288510] [DEBUG] [MAIN ] BN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:17.289468] [INFO ] [MAIN ] BN: Generated 1326 derivative records from 39006 primary records. [2025-09-15T21:13:17.289794] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-15T21:13:17.304623] [DEBUG] [LOCAL ] BNJ: Loaded 1727 existing records from primary storage. [2025-09-15T21:13:17.318525] [INFO ] [MAIN ] BNJ: Loaded 1727 primary data records. [2025-09-15T21:13:17.320415] [DEBUG] [MAIN ] BMY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:17.333787] [DEBUG] [LOCAL ] BN: Derivative data saved (1326 records). [2025-09-15T21:13:17.360801] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-15T21:13:17.355523] [INFO ] [MAIN ] BMY: Generated 1326 derivative records from 39717 primary records. [2025-09-15T21:13:17.375762] [INFO ] [MAIN ] Derivative Progress: 257/2083 symbols completed. BN took 1.2s. Estimated remaining: 10m 8s. Rate: 180.1 symbols/min [2025-09-15T21:13:17.375915] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-15T21:13:17.396105] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:17.626994] [DEBUG] [LOCAL ] BMY: Derivative data saved (1326 records). [2025-09-15T21:13:17.627271] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-15T21:13:17.629479] [INFO ] [MAIN ] Derivative Progress: 258/2083 symbols completed. BMY took 1.4s. Estimated remaining: 10m 7s. Rate: 180.2 symbols/min [2025-09-15T21:13:17.630867] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:17.665234] [DEBUG] [LOCAL ] BNL: Loaded 34424 existing records from primary storage. [2025-09-15T21:13:17.665854] [INFO ] [MAIN ] BNL: Loaded 34424 primary data records. [2025-09-15T21:13:17.786898] [DEBUG] [MAIN ] BNJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:17.799179] [INFO ] [MAIN ] BNJ: Generated 1326 derivative records from 1727 primary records. [2025-09-15T21:13:17.812074] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-15T21:13:17.836802] [DEBUG] [LOCAL ] BNS: Loaded 37795 existing records from primary storage. [2025-09-15T21:13:17.895040] [INFO ] [MAIN ] BNS: Loaded 37795 primary data records. [2025-09-15T21:13:18.047571] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1326 records). [2025-09-15T21:13:18.057178] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-15T21:13:18.072939] [INFO ] [MAIN ] Derivative Progress: 259/2083 symbols completed. BNJ took 0.8s. Estimated remaining: 10m 8s. Rate: 180.0 symbols/min [2025-09-15T21:13:18.083021] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:18.133037] [DEBUG] [LOCAL ] BNT: Loaded 2060 existing records from primary storage. [2025-09-15T21:13:18.133977] [INFO ] [MAIN ] BNT: Loaded 2060 primary data records. [2025-09-15T21:13:18.618052] [DEBUG] [MAIN ] BNL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:18.619812] [INFO ] [MAIN ] BNL: Generated 1326 derivative records from 34424 primary records. [2025-09-15T21:13:18.620632] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-15T21:13:18.636779] [DEBUG] [LOCAL ] BNL: Derivative data saved (1326 records). [2025-09-15T21:13:18.637287] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-15T21:13:18.640115] [INFO ] [MAIN ] Derivative Progress: 260/2083 symbols completed. BNL took 1.3s. Estimated remaining: 10m 9s. Rate: 179.5 symbols/min [2025-09-15T21:13:18.640523] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:18.659684] [DEBUG] [MAIN ] BNS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:18.660728] [INFO ] [MAIN ] BNS: Generated 1326 derivative records from 37795 primary records. [2025-09-15T21:13:18.674422] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-15T21:13:18.675248] [DEBUG] [LOCAL ] BNY: Loaded 5301 existing records from primary storage. [2025-09-15T21:13:18.676499] [INFO ] [MAIN ] BNY: Loaded 5301 primary data records. [2025-09-15T21:13:18.675872] [DEBUG] [MAIN ] BNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:18.677786] [INFO ] [MAIN ] BNT: Generated 1326 derivative records from 2060 primary records. [2025-09-15T21:13:18.728161] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-15T21:13:18.765519] [DEBUG] [LOCAL ] BNS: Derivative data saved (1326 records). [2025-09-15T21:13:18.786874] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-15T21:13:18.800325] [INFO ] [MAIN ] Derivative Progress: 261/2083 symbols completed. BNS took 1.2s. Estimated remaining: 10m 8s. Rate: 179.9 symbols/min [2025-09-15T21:13:18.808519] [DEBUG] [LOCAL ] BNT: Derivative data saved (1326 records). [2025-09-15T21:13:18.820047] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-15T21:13:18.823067] [INFO ] [MAIN ] Derivative Progress: 262/2083 symbols completed. BNT took 0.7s. Estimated remaining: 10m 5s. Rate: 180.5 symbols/min [2025-09-15T21:13:18.823803] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:18.820484] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:19.016838] [DEBUG] [LOCAL ] BOH: Loaded 21842 existing records from primary storage. [2025-09-15T21:13:19.022784] [DEBUG] [LOCAL ] BOE: Loaded 11861 existing records from primary storage. [2025-09-15T21:13:19.023449] [INFO ] [MAIN ] BOH: Loaded 21842 primary data records. [2025-09-15T21:13:19.023822] [INFO ] [MAIN ] BOE: Loaded 11861 primary data records. [2025-09-15T21:13:19.668321] [DEBUG] [MAIN ] BNY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:19.671689] [INFO ] [MAIN ] BNY: Generated 1326 derivative records from 5301 primary records. [2025-09-15T21:13:19.672151] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-15T21:13:19.690167] [DEBUG] [LOCAL ] BNY: Derivative data saved (1326 records). [2025-09-15T21:13:19.691539] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-15T21:13:19.694706] [INFO ] [MAIN ] Derivative Progress: 263/2083 symbols completed. BNY took 1.1s. Estimated remaining: 10m 9s. Rate: 179.4 symbols/min [2025-09-15T21:13:19.697816] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:19.717933] [DEBUG] [MAIN ] BOH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:19.722534] [DEBUG] [MAIN ] BOE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:19.723698] [INFO ] [MAIN ] BOH: Generated 1326 derivative records from 21842 primary records. [2025-09-15T21:13:19.723876] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-15T21:13:19.724937] [INFO ] [MAIN ] BOE: Generated 1326 derivative records from 11861 primary records. [2025-09-15T21:13:19.726150] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-15T21:13:19.756740] [DEBUG] [LOCAL ] BOE: Derivative data saved (1326 records). [2025-09-15T21:13:19.758525] [DEBUG] [LOCAL ] BOH: Derivative data saved (1326 records). [2025-09-15T21:13:19.758621] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-15T21:13:19.769493] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-15T21:13:19.770202] [DEBUG] [LOCAL ] BOND: Loaded 23537 existing records from primary storage. [2025-09-15T21:13:19.769351] [INFO ] [MAIN ] Derivative Progress: 264/2083 symbols completed. BOE took 0.9s. Estimated remaining: 10m 6s. Rate: 180.0 symbols/min [2025-09-15T21:13:19.772754] [INFO ] [MAIN ] BOND: Loaded 23537 primary data records. [2025-09-15T21:13:19.773365] [INFO ] [MAIN ] Derivative Progress: 265/2083 symbols completed. BOH took 0.9s. Estimated remaining: 10m 4s. Rate: 180.6 symbols/min [2025-09-15T21:13:19.773536] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:19.785719] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:20.083860] [DEBUG] [LOCAL ] BOOT: Loaded 29291 existing records from primary storage. [2025-09-15T21:13:20.085434] [INFO ] [MAIN ] BOOT: Loaded 29291 primary data records. [2025-09-15T21:13:20.171745] [DEBUG] [LOCAL ] BORR: Loaded 37699 existing records from primary storage. [2025-09-15T21:13:20.208551] [INFO ] [MAIN ] BORR: Loaded 37699 primary data records. [2025-09-15T21:13:20.693590] [DEBUG] [MAIN ] BOND: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:13:20.694806] [INFO ] [MAIN ] BOND: Generated 1325 derivative records from 23537 primary records. [2025-09-15T21:13:20.695005] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-15T21:13:20.711447] [DEBUG] [LOCAL ] BOND: Derivative data saved (1325 records). [2025-09-15T21:13:20.711837] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-15T21:13:20.714308] [INFO ] [MAIN ] Derivative Progress: 266/2083 symbols completed. BOND took 1.0s. Estimated remaining: 10m 8s. Rate: 179.4 symbols/min [2025-09-15T21:13:20.714699] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:20.739329] [DEBUG] [MAIN ] BOOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:20.740300] [INFO ] [MAIN ] BOOT: Generated 1326 derivative records from 29291 primary records. [2025-09-15T21:13:20.741535] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-15T21:13:20.756049] [DEBUG] [LOCAL ] BOW: Loaded 16164 existing records from primary storage. [2025-09-15T21:13:20.762330] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1326 records). [2025-09-15T21:13:20.762752] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-15T21:13:20.762469] [INFO ] [MAIN ] BOW: Loaded 16164 primary data records. [2025-09-15T21:13:20.766227] [INFO ] [MAIN ] Derivative Progress: 267/2083 symbols completed. BOOT took 1.0s. Estimated remaining: 10m 5s. Rate: 180.0 symbols/min [2025-09-15T21:13:20.798581] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:20.798274] [DEBUG] [MAIN ] BORR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:20.839098] [INFO ] [MAIN ] BORR: Generated 1326 derivative records from 37699 primary records. [2025-09-15T21:13:20.854308] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-15T21:13:20.935223] [DEBUG] [LOCAL ] BORR: Derivative data saved (1326 records). [2025-09-15T21:13:20.966028] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-15T21:13:20.968387] [INFO ] [MAIN ] Derivative Progress: 268/2083 symbols completed. BORR took 1.2s. Estimated remaining: 10m 4s. Rate: 180.2 symbols/min [2025-09-15T21:13:21.135170] [DEBUG] [LOCAL ] BOX: Loaded 37029 existing records from primary storage. [2025-09-15T21:13:21.135779] [INFO ] [MAIN ] BOX: Loaded 37029 primary data records. [2025-09-15T21:13:21.420814] [DEBUG] [MAIN ] BOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:21.422484] [INFO ] [MAIN ] BOW: Generated 1326 derivative records from 16164 primary records. [2025-09-15T21:13:21.422700] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-15T21:13:21.436501] [DEBUG] [LOCAL ] BOW: Derivative data saved (1326 records). [2025-09-15T21:13:21.436599] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-15T21:13:21.438935] [INFO ] [MAIN ] Derivative Progress: 269/2083 symbols completed. BOW took 0.7s. Estimated remaining: 10m 5s. Rate: 180.0 symbols/min [2025-09-15T21:13:21.459716] [DEBUG] [MAIN ] BOX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:21.460449] [INFO ] [MAIN ] BOX: Generated 1326 derivative records from 37029 primary records. [2025-09-15T21:13:21.460545] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-15T21:13:21.472554] [DEBUG] [LOCAL ] BOX: Derivative data saved (1326 records). [2025-09-15T21:13:21.472610] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-15T21:13:21.474916] [INFO ] [MAIN ] Derivative Progress: 270/2083 symbols completed. BOX took 0.7s. Estimated remaining: 10m 2s. Rate: 180.5 symbols/min [2025-09-15T21:13:21.475764] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:21.475904] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:21.475845] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:21.527276] [DEBUG] [LOCAL ] BR: Loaded 25002 existing records from primary storage. [2025-09-15T21:13:21.528078] [INFO ] [MAIN ] BR: Loaded 25002 primary data records. [2025-09-15T21:13:21.581569] [DEBUG] [LOCAL ] BRBR: Loaded 38487 existing records from primary storage. [2025-09-15T21:13:21.624337] [INFO ] [MAIN ] BRBR: Loaded 38487 primary data records. [2025-09-15T21:13:21.683429] [DEBUG] [LOCAL ] BP: Loaded 39671 existing records from primary storage. [2025-09-15T21:13:21.715697] [INFO ] [MAIN ] BP: Loaded 39671 primary data records. [2025-09-15T21:13:22.527242] [DEBUG] [MAIN ] BRBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:22.530176] [INFO ] [MAIN ] BRBR: Generated 1326 derivative records from 38487 primary records. [2025-09-15T21:13:22.530861] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-15T21:13:22.560928] [DEBUG] [MAIN ] BP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:22.561236] [DEBUG] [MAIN ] BR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:22.562887] [INFO ] [MAIN ] BR: Generated 1326 derivative records from 25002 primary records. [2025-09-15T21:13:22.564273] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1326 records). [2025-09-15T21:13:22.564354] [INFO ] [MAIN ] BP: Generated 1326 derivative records from 39671 primary records. [2025-09-15T21:13:22.564535] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-15T21:13:22.564487] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-15T21:13:22.567264] [INFO ] [MAIN ] Derivative Progress: 271/2083 symbols completed. BRBR took 1.1s. Estimated remaining: 10m 7s. Rate: 179.0 symbols/min [2025-09-15T21:13:22.564573] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-15T21:13:22.567510] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:22.589953] [DEBUG] [LOCAL ] BR: Derivative data saved (1326 records). [2025-09-15T21:13:22.590495] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-15T21:13:22.595569] [INFO ] [MAIN ] Derivative Progress: 272/2083 symbols completed. BR took 1.1s. Estimated remaining: 10m 5s. Rate: 179.6 symbols/min [2025-09-15T21:13:22.596098] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:22.599329] [DEBUG] [LOCAL ] BP: Derivative data saved (1326 records). [2025-09-15T21:13:22.604514] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-15T21:13:22.607102] [INFO ] [MAIN ] Derivative Progress: 273/2083 symbols completed. BP took 1.1s. Estimated remaining: 10m 2s. Rate: 180.3 symbols/min [2025-09-15T21:13:22.607314] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:22.604815] [DEBUG] [LOCAL ] BRC: Loaded 13268 existing records from primary storage. [2025-09-15T21:13:22.607508] [INFO ] [MAIN ] BRC: Loaded 13268 primary data records. [2025-09-15T21:13:22.794171] [DEBUG] [LOCAL ] BRW: Loaded 14142 existing records from primary storage. [2025-09-15T21:13:22.813628] [INFO ] [MAIN ] BRW: Loaded 14142 primary data records. [2025-09-15T21:13:22.926500] [DEBUG] [LOCAL ] BRCC: Loaded 30061 existing records from primary storage. [2025-09-15T21:13:22.937421] [INFO ] [MAIN ] BRCC: Loaded 30061 primary data records. [2025-09-15T21:13:23.465087] [DEBUG] [MAIN ] BRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:23.466137] [INFO ] [MAIN ] BRC: Generated 1326 derivative records from 13268 primary records. [2025-09-15T21:13:23.466237] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-15T21:13:23.482162] [DEBUG] [LOCAL ] BRC: Derivative data saved (1326 records). [2025-09-15T21:13:23.482511] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-15T21:13:23.484480] [INFO ] [MAIN ] Derivative Progress: 274/2083 symbols completed. BRC took 0.9s. Estimated remaining: 10m 6s. Rate: 179.2 symbols/min [2025-09-15T21:13:23.485111] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:23.511806] [DEBUG] [MAIN ] BRCC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:23.513082] [INFO ] [MAIN ] BRCC: Generated 1326 derivative records from 30061 primary records. [2025-09-15T21:13:23.513325] [DEBUG] [MAIN ] BRW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:23.513513] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-15T21:13:23.514586] [INFO ] [MAIN ] BRW: Generated 1326 derivative records from 14142 primary records. [2025-09-15T21:13:23.514736] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-15T21:13:23.536940] [DEBUG] [LOCAL ] BRW: Derivative data saved (1326 records). [2025-09-15T21:13:23.537309] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-15T21:13:23.539509] [INFO ] [MAIN ] Derivative Progress: 275/2083 symbols completed. BRW took 0.9s. Estimated remaining: 10m 3s. Rate: 179.8 symbols/min [2025-09-15T21:13:23.540903] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:23.543288] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1326 records). [2025-09-15T21:13:23.552660] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-15T21:13:23.554611] [INFO ] [MAIN ] Derivative Progress: 276/2083 symbols completed. BRCC took 1.0s. Estimated remaining: 10m 1s. Rate: 180.4 symbols/min [2025-09-15T21:13:23.555055] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:23.571710] [DEBUG] [LOCAL ] BRX: Loaded 38344 existing records from primary storage. [2025-09-15T21:13:23.572031] [INFO ] [MAIN ] BRX: Loaded 38344 primary data records. [2025-09-15T21:13:23.698016] [DEBUG] [LOCAL ] BSAC: Loaded 24120 existing records from primary storage. [2025-09-15T21:13:23.698809] [INFO ] [MAIN ] BSAC: Loaded 24120 primary data records. [2025-09-15T21:13:23.847877] [DEBUG] [LOCAL ] BSBR: Loaded 26500 existing records from primary storage. [2025-09-15T21:13:23.946471] [INFO ] [MAIN ] BSBR: Loaded 26500 primary data records. [2025-09-15T21:13:24.484927] [DEBUG] [MAIN ] BRX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:24.485999] [INFO ] [MAIN ] BRX: Generated 1326 derivative records from 38344 primary records. [2025-09-15T21:13:24.486399] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-15T21:13:24.501562] [DEBUG] [LOCAL ] BRX: Derivative data saved (1326 records). [2025-09-15T21:13:24.501820] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-15T21:13:24.514378] [INFO ] [MAIN ] Derivative Progress: 277/2083 symbols completed. BRX took 1.0s. Estimated remaining: 10m 5s. Rate: 179.2 symbols/min [2025-09-15T21:13:24.514838] [DEBUG] [MAIN ] BSAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:24.517033] [INFO ] [MAIN ] BSAC: Generated 1326 derivative records from 24120 primary records. [2025-09-15T21:13:24.516398] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:24.517291] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-15T21:13:24.528735] [DEBUG] [MAIN ] BSBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:24.538354] [INFO ] [MAIN ] BSBR: Generated 1326 derivative records from 26500 primary records. [2025-09-15T21:13:24.541857] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-15T21:13:24.542840] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1326 records). [2025-09-15T21:13:24.543153] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-15T21:13:24.545603] [INFO ] [MAIN ] Derivative Progress: 278/2083 symbols completed. BSAC took 1.0s. Estimated remaining: 10m 3s. Rate: 179.7 symbols/min [2025-09-15T21:13:24.556750] [DEBUG] [LOCAL ] BSL: Loaded 5094 existing records from primary storage. [2025-09-15T21:13:24.559505] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1326 records). [2025-09-15T21:13:24.559756] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:24.559868] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-15T21:13:24.559583] [INFO ] [MAIN ] BSL: Loaded 5094 primary data records. [2025-09-15T21:13:24.562101] [INFO ] [MAIN ] Derivative Progress: 279/2083 symbols completed. BSBR took 1.0s. Estimated remaining: 10m 0s. Rate: 180.4 symbols/min [2025-09-15T21:13:24.583686] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:24.844238] [DEBUG] [LOCAL ] BSM: Loaded 23991 existing records from primary storage. [2025-09-15T21:13:24.844728] [DEBUG] [LOCAL ] BSTZ: Loaded 18005 existing records from primary storage. [2025-09-15T21:13:24.854970] [INFO ] [MAIN ] BSTZ: Loaded 18005 primary data records. [2025-09-15T21:13:24.854901] [INFO ] [MAIN ] BSM: Loaded 23991 primary data records. [2025-09-15T21:13:25.413128] [DEBUG] [MAIN ] BSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:25.414497] [INFO ] [MAIN ] BSL: Generated 1326 derivative records from 5094 primary records. [2025-09-15T21:13:25.414615] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-15T21:13:25.428185] [DEBUG] [LOCAL ] BSL: Derivative data saved (1326 records). [2025-09-15T21:13:25.428573] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-15T21:13:25.430186] [INFO ] [MAIN ] Derivative Progress: 280/2083 symbols completed. BSL took 0.9s. Estimated remaining: 10m 3s. Rate: 179.3 symbols/min [2025-09-15T21:13:25.430473] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:25.455160] [DEBUG] [MAIN ] BSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:25.456061] [INFO ] [MAIN ] BSM: Generated 1326 derivative records from 23991 primary records. [2025-09-15T21:13:25.456306] [DEBUG] [MAIN ] BSTZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:25.456423] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-15T21:13:25.457509] [INFO ] [MAIN ] BSTZ: Generated 1326 derivative records from 18005 primary records. [2025-09-15T21:13:25.457599] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-15T21:13:25.482629] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1326 records). [2025-09-15T21:13:25.483243] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-15T21:13:25.485336] [INFO ] [MAIN ] Derivative Progress: 281/2083 symbols completed. BSTZ took 0.9s. Estimated remaining: 10m 1s. Rate: 179.9 symbols/min [2025-09-15T21:13:25.483371] [DEBUG] [LOCAL ] BSM: Derivative data saved (1326 records). [2025-09-15T21:13:25.485669] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-15T21:13:25.485831] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:25.488317] [INFO ] [MAIN ] Derivative Progress: 282/2083 symbols completed. BSM took 0.9s. Estimated remaining: 9m 59s. Rate: 180.5 symbols/min [2025-09-15T21:13:25.497583] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:25.504162] [DEBUG] [LOCAL ] BTA: Loaded 4014 existing records from primary storage. [2025-09-15T21:13:25.504341] [INFO ] [MAIN ] BTA: Loaded 4014 primary data records. [2025-09-15T21:13:25.600668] [DEBUG] [LOCAL ] BTCM: Loaded 12784 existing records from primary storage. [2025-09-15T21:13:25.624886] [INFO ] [MAIN ] BTCM: Loaded 12784 primary data records. [2025-09-15T21:13:25.629460] [DEBUG] [LOCAL ] BSX: Loaded 39648 existing records from primary storage. [2025-09-15T21:13:25.682575] [INFO ] [MAIN ] BSX: Loaded 39648 primary data records. [2025-09-15T21:13:26.373568] [DEBUG] [MAIN ] BTA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:26.383309] [INFO ] [MAIN ] BTA: Generated 1326 derivative records from 4014 primary records. [2025-09-15T21:13:26.384202] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-15T21:13:26.384091] [DEBUG] [MAIN ] BTCM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:26.385734] [INFO ] [MAIN ] BTCM: Generated 1326 derivative records from 12784 primary records. [2025-09-15T21:13:26.392380] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-15T21:13:26.415170] [DEBUG] [LOCAL ] BTA: Derivative data saved (1326 records). [2025-09-15T21:13:26.415990] [DEBUG] [MAIN ] BSX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:26.417319] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-15T21:13:26.418131] [INFO ] [MAIN ] BSX: Generated 1326 derivative records from 39648 primary records. [2025-09-15T21:13:26.419697] [INFO ] [MAIN ] Derivative Progress: 283/2083 symbols completed. BTA took 0.9s. Estimated remaining: 10m 2s. Rate: 179.4 symbols/min [2025-09-15T21:13:26.420279] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1326 records). [2025-09-15T21:13:26.420361] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-15T21:13:26.420869] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-15T21:13:26.423010] [INFO ] [MAIN ] Derivative Progress: 284/2083 symbols completed. BTCM took 0.9s. Estimated remaining: 9m 60s. Rate: 180.0 symbols/min [2025-09-15T21:13:26.434566] [DEBUG] [LOCAL ] BSX: Derivative data saved (1326 records). [2025-09-15T21:13:26.434667] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-15T21:13:26.436813] [INFO ] [MAIN ] Derivative Progress: 285/2083 symbols completed. BSX took 1.0s. Estimated remaining: 9m 57s. Rate: 180.6 symbols/min [2025-09-15T21:13:26.437379] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:26.437330] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:26.437594] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:26.449129] [DEBUG] [LOCAL ] BTO: Loaded 6142 existing records from primary storage. [2025-09-15T21:13:26.449312] [INFO ] [MAIN ] BTO: Loaded 6142 primary data records. [2025-09-15T21:13:26.781443] [DEBUG] [LOCAL ] BTE: Loaded 38887 existing records from primary storage. [2025-09-15T21:13:26.781751] [INFO ] [MAIN ] BTE: Loaded 38887 primary data records. [2025-09-15T21:13:26.788356] [DEBUG] [LOCAL ] BTI: Loaded 39570 existing records from primary storage. [2025-09-15T21:13:26.818117] [INFO ] [MAIN ] BTI: Loaded 39570 primary data records. [2025-09-15T21:13:27.360273] [DEBUG] [MAIN ] BTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:27.362093] [INFO ] [MAIN ] BTO: Generated 1326 derivative records from 6142 primary records. [2025-09-15T21:13:27.362316] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-15T21:13:27.375755] [DEBUG] [LOCAL ] BTO: Derivative data saved (1326 records). [2025-09-15T21:13:27.377391] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-15T21:13:27.380058] [INFO ] [MAIN ] Derivative Progress: 286/2083 symbols completed. BTO took 0.9s. Estimated remaining: 10m 1s. Rate: 179.4 symbols/min [2025-09-15T21:13:27.380673] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:27.395801] [DEBUG] [MAIN ] BTE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:27.396811] [INFO ] [MAIN ] BTE: Generated 1326 derivative records from 38887 primary records. [2025-09-15T21:13:27.399680] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-15T21:13:27.423606] [DEBUG] [LOCAL ] BTE: Derivative data saved (1326 records). [2025-09-15T21:13:27.424264] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-15T21:13:27.426278] [INFO ] [MAIN ] Derivative Progress: 287/2083 symbols completed. BTE took 1.0s. Estimated remaining: 9m 59s. Rate: 180.0 symbols/min [2025-09-15T21:13:27.424161] [DEBUG] [MAIN ] BTI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:27.426723] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:27.427512] [INFO ] [MAIN ] BTI: Generated 1326 derivative records from 39570 primary records. [2025-09-15T21:13:27.428222] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-15T21:13:27.451306] [DEBUG] [LOCAL ] BTI: Derivative data saved (1326 records). [2025-09-15T21:13:27.451442] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-15T21:13:27.453793] [INFO ] [MAIN ] Derivative Progress: 288/2083 symbols completed. BTI took 1.0s. Estimated remaining: 9m 56s. Rate: 180.6 symbols/min [2025-09-15T21:13:27.454338] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:27.475304] [DEBUG] [LOCAL ] BTU: Loaded 39314 existing records from primary storage. [2025-09-15T21:13:27.475633] [INFO ] [MAIN ] BTU: Loaded 39314 primary data records. [2025-09-15T21:13:27.529207] [DEBUG] [LOCAL ] BTZ: Loaded 16047 existing records from primary storage. [2025-09-15T21:13:27.562460] [INFO ] [MAIN ] BTZ: Loaded 16047 primary data records. [2025-09-15T21:13:27.847112] [DEBUG] [LOCAL ] BUD: Loaded 38809 existing records from primary storage. [2025-09-15T21:13:27.983582] [INFO ] [MAIN ] BUD: Loaded 38809 primary data records. [2025-09-15T21:13:28.366409] [DEBUG] [MAIN ] BTU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:28.368070] [INFO ] [MAIN ] BTU: Generated 1326 derivative records from 39314 primary records. [2025-09-15T21:13:28.368735] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-15T21:13:28.390906] [DEBUG] [MAIN ] BTZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:28.392661] [DEBUG] [LOCAL ] BTU: Derivative data saved (1326 records). [2025-09-15T21:13:28.392392] [INFO ] [MAIN ] BTZ: Generated 1326 derivative records from 16047 primary records. [2025-09-15T21:13:28.392912] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-15T21:13:28.393002] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-15T21:13:28.395124] [INFO ] [MAIN ] Derivative Progress: 289/2083 symbols completed. BTU took 1.0s. Estimated remaining: 9m 60s. Rate: 179.4 symbols/min [2025-09-15T21:13:28.396331] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:28.426096] [DEBUG] [MAIN ] BUD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:28.427910] [INFO ] [MAIN ] BUD: Generated 1326 derivative records from 38809 primary records. [2025-09-15T21:13:28.427108] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1326 records). [2025-09-15T21:13:28.428252] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-15T21:13:28.431476] [INFO ] [MAIN ] Derivative Progress: 290/2083 symbols completed. BTZ took 1.0s. Estimated remaining: 9m 58s. Rate: 180.0 symbols/min [2025-09-15T21:13:28.435334] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:28.428109] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-15T21:13:28.436663] [DEBUG] [LOCAL ] BUI: Loaded 8539 existing records from primary storage. [2025-09-15T21:13:28.437107] [INFO ] [MAIN ] BUI: Loaded 8539 primary data records. [2025-09-15T21:13:28.512018] [DEBUG] [LOCAL ] BUD: Derivative data saved (1326 records). [2025-09-15T21:13:28.523826] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-15T21:13:28.548876] [INFO ] [MAIN ] Derivative Progress: 291/2083 symbols completed. BUD took 1.1s. Estimated remaining: 9m 56s. Rate: 180.4 symbols/min [2025-09-15T21:13:28.552906] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:28.767436] [DEBUG] [LOCAL ] BUR: Loaded 33462 existing records from primary storage. [2025-09-15T21:13:28.767617] [INFO ] [MAIN ] BUR: Loaded 33462 primary data records. [2025-09-15T21:13:28.946185] [DEBUG] [LOCAL ] BURL: Loaded 33645 existing records from primary storage. [2025-09-15T21:13:28.978481] [INFO ] [MAIN ] BURL: Loaded 33645 primary data records. [2025-09-15T21:13:29.229854] [DEBUG] [MAIN ] BUI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:29.250483] [INFO ] [MAIN ] BUI: Generated 1326 derivative records from 8539 primary records. [2025-09-15T21:13:29.259233] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-15T21:13:29.405117] [DEBUG] [LOCAL ] BUI: Derivative data saved (1326 records). [2025-09-15T21:13:29.406631] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-15T21:13:29.411084] [INFO ] [MAIN ] Derivative Progress: 292/2083 symbols completed. BUI took 1.0s. Estimated remaining: 9m 59s. Rate: 179.4 symbols/min [2025-09-15T21:13:29.411821] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:29.426230] [DEBUG] [MAIN ] BUR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:29.427461] [INFO ] [MAIN ] BUR: Generated 1326 derivative records from 33462 primary records. [2025-09-15T21:13:29.427681] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-15T21:13:29.446387] [DEBUG] [LOCAL ] BUR: Derivative data saved (1326 records). [2025-09-15T21:13:29.446560] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-15T21:13:29.449895] [INFO ] [MAIN ] Derivative Progress: 293/2083 symbols completed. BUR took 1.0s. Estimated remaining: 9m 57s. Rate: 179.9 symbols/min [2025-09-15T21:13:29.455689] [DEBUG] [LOCAL ] BUXX: Loaded 11375 existing records from primary storage. [2025-09-15T21:13:29.456198] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:29.456277] [INFO ] [MAIN ] BUXX: Loaded 11375 primary data records. [2025-09-15T21:13:29.581547] [DEBUG] [MAIN ] BURL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:29.613504] [INFO ] [MAIN ] BURL: Generated 1326 derivative records from 33645 primary records. [2025-09-15T21:13:29.638617] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-15T21:13:29.778346] [DEBUG] [LOCAL ] BV: Loaded 28319 existing records from primary storage. [2025-09-15T21:13:29.779319] [INFO ] [MAIN ] BV: Loaded 28319 primary data records. [2025-09-15T21:13:29.779419] [DEBUG] [LOCAL ] BURL: Derivative data saved (1326 records). [2025-09-15T21:13:29.780921] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-15T21:13:29.784242] [INFO ] [MAIN ] Derivative Progress: 294/2083 symbols completed. BURL took 1.2s. Estimated remaining: 9m 57s. Rate: 179.9 symbols/min [2025-09-15T21:13:29.797370] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:30.090874] [DEBUG] [MAIN ] BUXX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:30.101403] [INFO ] [MAIN ] BUXX: Generated 1326 derivative records from 11375 primary records. [2025-09-15T21:13:30.103473] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-15T21:13:30.112616] [DEBUG] [LOCAL ] BVN: Loaded 31889 existing records from primary storage. [2025-09-15T21:13:30.121004] [INFO ] [MAIN ] BVN: Loaded 31889 primary data records. [2025-09-15T21:13:30.120848] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1326 records). [2025-09-15T21:13:30.126565] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-15T21:13:30.135376] [INFO ] [MAIN ] Derivative Progress: 295/2083 symbols completed. BUXX took 0.7s. Estimated remaining: 9m 56s. Rate: 179.9 symbols/min [2025-09-15T21:13:30.172755] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:30.345388] [DEBUG] [MAIN ] BV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:30.435950] [INFO ] [MAIN ] BV: Generated 1326 derivative records from 28319 primary records. [2025-09-15T21:13:30.436395] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-15T21:13:30.459084] [DEBUG] [LOCAL ] BV: Derivative data saved (1326 records). [2025-09-15T21:13:30.460998] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-15T21:13:30.464398] [INFO ] [MAIN ] Derivative Progress: 296/2083 symbols completed. BV took 1.0s. Estimated remaining: 9m 56s. Rate: 179.9 symbols/min [2025-09-15T21:13:30.466019] [DEBUG] [LOCAL ] BW: Loaded 28077 existing records from primary storage. [2025-09-15T21:13:30.466713] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:30.466508] [INFO ] [MAIN ] BW: Loaded 28077 primary data records. [2025-09-15T21:13:30.768512] [DEBUG] [LOCAL ] BWA: Loaded 38415 existing records from primary storage. [2025-09-15T21:13:30.770504] [INFO ] [MAIN ] BWA: Loaded 38415 primary data records. [2025-09-15T21:13:30.811915] [DEBUG] [MAIN ] BVN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:30.847338] [INFO ] [MAIN ] BVN: Generated 1326 derivative records from 31889 primary records. [2025-09-15T21:13:30.859880] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-15T21:13:30.977959] [DEBUG] [LOCAL ] BVN: Derivative data saved (1326 records). [2025-09-15T21:13:30.981122] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-15T21:13:30.983530] [INFO ] [MAIN ] Derivative Progress: 297/2083 symbols completed. BVN took 1.2s. Estimated remaining: 9m 57s. Rate: 179.6 symbols/min [2025-09-15T21:13:31.107837] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:31.123465] [DEBUG] [MAIN ] BW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:31.125053] [INFO ] [MAIN ] BW: Generated 1326 derivative records from 28077 primary records. [2025-09-15T21:13:31.125391] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-15T21:13:31.142034] [DEBUG] [LOCAL ] BW: Derivative data saved (1326 records). [2025-09-15T21:13:31.142624] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-15T21:13:31.146115] [INFO ] [MAIN ] Derivative Progress: 298/2083 symbols completed. BW took 1.0s. Estimated remaining: 9m 55s. Rate: 179.9 symbols/min [2025-09-15T21:13:31.151355] [DEBUG] [LOCAL ] BWG: Loaded 9569 existing records from primary storage. [2025-09-15T21:13:31.151674] [INFO ] [MAIN ] BWG: Loaded 9569 primary data records. [2025-09-15T21:13:31.345578] [DEBUG] [MAIN ] BWA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:31.400411] [INFO ] [MAIN ] BWA: Generated 1326 derivative records from 38415 primary records. [2025-09-15T21:13:31.446378] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-15T21:13:31.461740] [DEBUG] [LOCAL ] BWA: Derivative data saved (1326 records). [2025-09-15T21:13:31.462259] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-15T21:13:31.465791] [INFO ] [MAIN ] Derivative Progress: 299/2083 symbols completed. BWA took 1.0s. Estimated remaining: 9m 55s. Rate: 179.9 symbols/min [2025-09-15T21:13:31.480992] [DEBUG] [MAIN ] BWG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:31.481668] [INFO ] [MAIN ] BWG: Generated 1326 derivative records from 9569 primary records. [2025-09-15T21:13:31.481739] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-15T21:13:31.493029] [DEBUG] [LOCAL ] BWG: Derivative data saved (1326 records). [2025-09-15T21:13:31.493086] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-15T21:13:31.495484] [INFO ] [MAIN ] Derivative Progress: 300/2083 symbols completed. BWG took 0.5s. Estimated remaining: 9m 53s. Rate: 180.5 symbols/min [2025-09-15T21:13:31.496272] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:31.496441] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:31.496561] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:31.507315] [DEBUG] [LOCAL ] BWSN: Loaded 4084 existing records from primary storage. [2025-09-15T21:13:31.510627] [INFO ] [MAIN ] BWSN: Loaded 4084 primary data records. [2025-09-15T21:13:31.510459] [DEBUG] [LOCAL ] BWNB: Loaded 3439 existing records from primary storage. [2025-09-15T21:13:31.522122] [INFO ] [MAIN ] BWNB: Loaded 3439 primary data records. [2025-09-15T21:13:31.801366] [DEBUG] [LOCAL ] BWLP: Loaded 23730 existing records from primary storage. [2025-09-15T21:13:31.856041] [INFO ] [MAIN ] BWLP: Loaded 23730 primary data records. [2025-09-15T21:13:32.363857] [DEBUG] [MAIN ] BWSN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:32.365122] [INFO ] [MAIN ] BWSN: Generated 1326 derivative records from 4084 primary records. [2025-09-15T21:13:32.365980] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-15T21:13:32.380114] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1326 records). [2025-09-15T21:13:32.389823] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-15T21:13:32.390159] [DEBUG] [MAIN ] BWNB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:32.392239] [INFO ] [MAIN ] Derivative Progress: 301/2083 symbols completed. BWSN took 0.9s. Estimated remaining: 9m 56s. Rate: 179.4 symbols/min [2025-09-15T21:13:32.393354] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:32.393128] [INFO ] [MAIN ] BWNB: Generated 1326 derivative records from 3439 primary records. [2025-09-15T21:13:32.394150] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-15T21:13:32.417754] [DEBUG] [MAIN ] BWLP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:32.418067] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1326 records). [2025-09-15T21:13:32.419056] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-15T21:13:32.421877] [INFO ] [MAIN ] Derivative Progress: 302/2083 symbols completed. BWNB took 0.9s. Estimated remaining: 9m 54s. Rate: 180.0 symbols/min [2025-09-15T21:13:32.418903] [INFO ] [MAIN ] BWLP: Generated 1326 derivative records from 23730 primary records. [2025-09-15T21:13:32.422310] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-15T21:13:32.422266] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:32.439366] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1326 records). [2025-09-15T21:13:32.439634] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-15T21:13:32.442134] [INFO ] [MAIN ] Derivative Progress: 303/2083 symbols completed. BWLP took 0.9s. Estimated remaining: 9m 52s. Rate: 180.5 symbols/min [2025-09-15T21:13:32.450514] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:32.474274] [DEBUG] [LOCAL ] BXC: Loaded 10082 existing records from primary storage. [2025-09-15T21:13:32.474535] [INFO ] [MAIN ] BXC: Loaded 10082 primary data records. [2025-09-15T21:13:32.486505] [DEBUG] [LOCAL ] BWXT: Loaded 34580 existing records from primary storage. [2025-09-15T21:13:32.486634] [INFO ] [MAIN ] BWXT: Loaded 34580 primary data records. [2025-09-15T21:13:32.711155] [DEBUG] [LOCAL ] BX: Loaded 39477 existing records from primary storage. [2025-09-15T21:13:32.731885] [INFO ] [MAIN ] BX: Loaded 39477 primary data records. [2025-09-15T21:13:33.375334] [DEBUG] [MAIN ] BWXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:33.376309] [INFO ] [MAIN ] BWXT: Generated 1326 derivative records from 34580 primary records. [2025-09-15T21:13:33.385953] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-15T21:13:33.386452] [DEBUG] [MAIN ] BXC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:33.388301] [INFO ] [MAIN ] BXC: Generated 1326 derivative records from 10082 primary records. [2025-09-15T21:13:33.397090] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-15T21:13:33.408080] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1326 records). [2025-09-15T21:13:33.412780] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-15T21:13:33.415600] [INFO ] [MAIN ] Derivative Progress: 304/2083 symbols completed. BWXT took 1.0s. Estimated remaining: 9m 55s. Rate: 179.4 symbols/min [2025-09-15T21:13:33.417282] [DEBUG] [LOCAL ] BXC: Derivative data saved (1326 records). [2025-09-15T21:13:33.417565] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-15T21:13:33.428968] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:33.428798] [INFO ] [MAIN ] Derivative Progress: 305/2083 symbols completed. BXC took 1.0s. Estimated remaining: 9m 53s. Rate: 180.0 symbols/min [2025-09-15T21:13:33.429525] [DEBUG] [MAIN ] BX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:33.430040] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:33.431259] [INFO ] [MAIN ] BX: Generated 1326 derivative records from 39477 primary records. [2025-09-15T21:13:33.431481] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-15T21:13:33.446584] [DEBUG] [LOCAL ] BX: Derivative data saved (1326 records). [2025-09-15T21:13:33.446716] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-15T21:13:33.452282] [INFO ] [MAIN ] Derivative Progress: 306/2083 symbols completed. BX took 1.0s. Estimated remaining: 9m 51s. Rate: 180.5 symbols/min [2025-09-15T21:13:33.452668] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:33.459522] [DEBUG] [LOCAL ] BXMX: Loaded 13325 existing records from primary storage. [2025-09-15T21:13:33.459723] [INFO ] [MAIN ] BXMX: Loaded 13325 primary data records. [2025-09-15T21:13:33.672205] [DEBUG] [LOCAL ] BXMT: Loaded 33962 existing records from primary storage. [2025-09-15T21:13:33.672535] [INFO ] [MAIN ] BXMT: Loaded 33962 primary data records. [2025-09-15T21:13:33.876092] [DEBUG] [LOCAL ] BXP: Loaded 36565 existing records from primary storage. [2025-09-15T21:13:33.897446] [INFO ] [MAIN ] BXP: Loaded 36565 primary data records. [2025-09-15T21:13:34.225887] [DEBUG] [MAIN ] BXMX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:34.227832] [INFO ] [MAIN ] BXMX: Generated 1326 derivative records from 13325 primary records. [2025-09-15T21:13:34.301889] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-15T21:13:34.327185] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1326 records). [2025-09-15T21:13:34.327511] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-15T21:13:34.329543] [INFO ] [MAIN ] Derivative Progress: 307/2083 symbols completed. BXMX took 0.9s. Estimated remaining: 9m 53s. Rate: 179.6 symbols/min [2025-09-15T21:13:34.330125] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:34.349192] [DEBUG] [MAIN ] BXMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:34.349934] [INFO ] [MAIN ] BXMT: Generated 1326 derivative records from 33962 primary records. [2025-09-15T21:13:34.350388] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-15T21:13:34.363321] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1326 records). [2025-09-15T21:13:34.363486] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-15T21:13:34.365626] [INFO ] [MAIN ] Derivative Progress: 308/2083 symbols completed. BXMT took 0.9s. Estimated remaining: 9m 51s. Rate: 180.1 symbols/min [2025-09-15T21:13:34.365974] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:34.380802] [DEBUG] [MAIN ] BXP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:34.390136] [INFO ] [MAIN ] BXP: Generated 1326 derivative records from 36565 primary records. [2025-09-15T21:13:34.390457] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-15T21:13:34.416394] [DEBUG] [LOCAL ] BXSL: Loaded 34368 existing records from primary storage. [2025-09-15T21:13:34.416776] [DEBUG] [LOCAL ] BXP: Derivative data saved (1326 records). [2025-09-15T21:13:34.417103] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-15T21:13:34.416863] [INFO ] [MAIN ] BXSL: Loaded 34368 primary data records. [2025-09-15T21:13:34.425921] [INFO ] [MAIN ] Derivative Progress: 309/2083 symbols completed. BXP took 1.0s. Estimated remaining: 9m 49s. Rate: 180.6 symbols/min [2025-09-15T21:13:34.431864] [DEBUG] [LOCAL ] BY: Loaded 15598 existing records from primary storage. [2025-09-15T21:13:34.438605] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:34.459108] [INFO ] [MAIN ] BY: Loaded 15598 primary data records. [2025-09-15T21:13:34.981749] [DEBUG] [LOCAL ] BYD: Loaded 33316 existing records from primary storage. [2025-09-15T21:13:34.982708] [INFO ] [MAIN ] BYD: Loaded 33316 primary data records. [2025-09-15T21:13:35.271266] [DEBUG] [MAIN ] BXSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:35.274321] [INFO ] [MAIN ] BXSL: Generated 1326 derivative records from 34368 primary records. [2025-09-15T21:13:35.276074] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-15T21:13:35.286306] [DEBUG] [MAIN ] BY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:35.287687] [INFO ] [MAIN ] BY: Generated 1326 derivative records from 15598 primary records. [2025-09-15T21:13:35.288173] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-15T21:13:35.305985] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1326 records). [2025-09-15T21:13:35.308745] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-15T21:13:35.313119] [INFO ] [MAIN ] Derivative Progress: 310/2083 symbols completed. BXSL took 1.0s. Estimated remaining: 9m 52s. Rate: 179.6 symbols/min [2025-09-15T21:13:35.313463] [DEBUG] [LOCAL ] BY: Derivative data saved (1326 records). [2025-09-15T21:13:35.314538] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:35.314598] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-15T21:13:35.318288] [INFO ] [MAIN ] Derivative Progress: 311/2083 symbols completed. BY took 1.0s. Estimated remaining: 9m 50s. Rate: 180.2 symbols/min [2025-09-15T21:13:35.318656] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:35.329294] [DEBUG] [MAIN ] BYD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:35.330044] [INFO ] [MAIN ] BYD: Generated 1326 derivative records from 33316 primary records. [2025-09-15T21:13:35.330152] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-15T21:13:35.348037] [DEBUG] [LOCAL ] BYM: Loaded 8410 existing records from primary storage. [2025-09-15T21:13:35.349204] [DEBUG] [LOCAL ] BYD: Derivative data saved (1326 records). [2025-09-15T21:13:35.349358] [INFO ] [MAIN ] BYM: Loaded 8410 primary data records. [2025-09-15T21:13:35.349407] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-15T21:13:35.351553] [INFO ] [MAIN ] Derivative Progress: 312/2083 symbols completed. BYD took 0.9s. Estimated remaining: 9m 48s. Rate: 180.7 symbols/min [2025-09-15T21:13:35.356959] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:35.510434] [DEBUG] [LOCAL ] BZH: Loaded 24078 existing records from primary storage. [2025-09-15T21:13:35.550998] [INFO ] [MAIN ] BZH: Loaded 24078 primary data records. [2025-09-15T21:13:35.786481] [DEBUG] [LOCAL ] C: Loaded 39702 existing records from primary storage. [2025-09-15T21:13:35.803335] [INFO ] [MAIN ] C: Loaded 39702 primary data records. [2025-09-15T21:13:36.234348] [DEBUG] [MAIN ] BYM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:36.235982] [INFO ] [MAIN ] BYM: Generated 1326 derivative records from 8410 primary records. [2025-09-15T21:13:36.236324] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-15T21:13:36.251178] [DEBUG] [LOCAL ] BYM: Derivative data saved (1326 records). [2025-09-15T21:13:36.251612] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-15T21:13:36.262939] [INFO ] [MAIN ] Derivative Progress: 313/2083 symbols completed. BYM took 0.9s. Estimated remaining: 9m 51s. Rate: 179.7 symbols/min [2025-09-15T21:13:36.263967] [DEBUG] [MAIN ] BZH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:36.264942] [INFO ] [MAIN ] BZH: Generated 1326 derivative records from 24078 primary records. [2025-09-15T21:13:36.265869] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-15T21:13:36.278501] [DEBUG] [LOCAL ] BZH: Derivative data saved (1326 records). [2025-09-15T21:13:36.278703] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-15T21:13:36.280979] [INFO ] [MAIN ] Derivative Progress: 314/2083 symbols completed. BZH took 1.0s. Estimated remaining: 9m 49s. Rate: 180.2 symbols/min [2025-09-15T21:13:36.293512] [DEBUG] [MAIN ] C: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:36.294168] [INFO ] [MAIN ] C: Generated 1326 derivative records from 39702 primary records. [2025-09-15T21:13:36.294271] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-15T21:13:36.306149] [DEBUG] [LOCAL ] C: Derivative data saved (1326 records). [2025-09-15T21:13:36.306206] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-15T21:13:36.308185] [INFO ] [MAIN ] Derivative Progress: 315/2083 symbols completed. C took 1.0s. Estimated remaining: 9m 47s. Rate: 180.8 symbols/min [2025-09-15T21:13:36.308863] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:36.309017] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:36.308738] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:36.334473] [DEBUG] [LOCAL ] CACI: Loaded 16695 existing records from primary storage. [2025-09-15T21:13:36.334597] [INFO ] [MAIN ] CACI: Loaded 16695 primary data records. [2025-09-15T21:13:36.392954] [DEBUG] [LOCAL ] CABO: Loaded 13796 existing records from primary storage. [2025-09-15T21:13:36.408911] [DEBUG] [LOCAL ] CAAP: Loaded 13239 existing records from primary storage. [2025-09-15T21:13:36.409073] [INFO ] [MAIN ] CABO: Loaded 13796 primary data records. [2025-09-15T21:13:36.409156] [INFO ] [MAIN ] CAAP: Loaded 13239 primary data records. [2025-09-15T21:13:37.171368] [DEBUG] [MAIN ] CACI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:37.172261] [INFO ] [MAIN ] CACI: Generated 1326 derivative records from 16695 primary records. [2025-09-15T21:13:37.172623] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-15T21:13:37.186017] [DEBUG] [LOCAL ] CACI: Derivative data saved (1326 records). [2025-09-15T21:13:37.186253] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-15T21:13:37.188042] [INFO ] [MAIN ] Derivative Progress: 316/2083 symbols completed. CACI took 0.9s. Estimated remaining: 9m 50s. Rate: 179.8 symbols/min [2025-09-15T21:13:37.188794] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:37.213854] [DEBUG] [MAIN ] CABO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:37.214960] [INFO ] [MAIN ] CABO: Generated 1326 derivative records from 13796 primary records. [2025-09-15T21:13:37.215280] [DEBUG] [MAIN ] CAAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:37.215389] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-15T21:13:37.216075] [INFO ] [MAIN ] CAAP: Generated 1326 derivative records from 13239 primary records. [2025-09-15T21:13:37.216913] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-15T21:13:37.248432] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1326 records). [2025-09-15T21:13:37.250447] [DEBUG] [LOCAL ] CABO: Derivative data saved (1326 records). [2025-09-15T21:13:37.250658] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-15T21:13:37.250722] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-15T21:13:37.253013] [INFO ] [MAIN ] Derivative Progress: 317/2083 symbols completed. CAAP took 0.9s. Estimated remaining: 9m 48s. Rate: 180.3 symbols/min [2025-09-15T21:13:37.255919] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:37.255985] [INFO ] [MAIN ] Derivative Progress: 318/2083 symbols completed. CABO took 0.9s. Estimated remaining: 9m 46s. Rate: 180.8 symbols/min [2025-09-15T21:13:37.266671] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:37.267818] [DEBUG] [LOCAL ] CADE: Loaded 36349 existing records from primary storage. [2025-09-15T21:13:37.268049] [INFO ] [MAIN ] CADE: Loaded 36349 primary data records. [2025-09-15T21:13:37.340988] [DEBUG] [LOCAL ] CAF: Loaded 2269 existing records from primary storage. [2025-09-15T21:13:37.375395] [INFO ] [MAIN ] CAF: Loaded 2269 primary data records. [2025-09-15T21:13:37.734493] [DEBUG] [LOCAL ] CAE: Loaded 28270 existing records from primary storage. [2025-09-15T21:13:37.850601] [INFO ] [MAIN ] CAE: Loaded 28270 primary data records. [2025-09-15T21:13:38.145322] [DEBUG] [MAIN ] CADE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:38.147268] [INFO ] [MAIN ] CADE: Generated 1326 derivative records from 36349 primary records. [2025-09-15T21:13:38.148305] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-15T21:13:38.170466] [DEBUG] [MAIN ] CAF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:38.173563] [DEBUG] [LOCAL ] CADE: Derivative data saved (1326 records). [2025-09-15T21:13:38.173738] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-15T21:13:38.176429] [INFO ] [MAIN ] Derivative Progress: 319/2083 symbols completed. CADE took 1.0s. Estimated remaining: 9m 49s. Rate: 179.8 symbols/min [2025-09-15T21:13:38.173271] [INFO ] [MAIN ] CAF: Generated 1326 derivative records from 2269 primary records. [2025-09-15T21:13:38.176905] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:38.176851] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-15T21:13:38.189023] [DEBUG] [LOCAL ] CAF: Derivative data saved (1326 records). [2025-09-15T21:13:38.189281] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-15T21:13:38.191569] [INFO ] [MAIN ] Derivative Progress: 320/2083 symbols completed. CAF took 0.9s. Estimated remaining: 9m 46s. Rate: 180.4 symbols/min [2025-09-15T21:13:38.191887] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:38.205171] [DEBUG] [MAIN ] CAE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:38.206077] [INFO ] [MAIN ] CAE: Generated 1326 derivative records from 28270 primary records. [2025-09-15T21:13:38.206223] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-15T21:13:38.219680] [DEBUG] [LOCAL ] CAE: Derivative data saved (1326 records). [2025-09-15T21:13:38.219843] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-15T21:13:38.221927] [INFO ] [MAIN ] Derivative Progress: 321/2083 symbols completed. CAE took 1.0s. Estimated remaining: 9m 44s. Rate: 180.9 symbols/min [2025-09-15T21:13:38.230935] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:38.256493] [DEBUG] [LOCAL ] CAG: Loaded 39628 existing records from primary storage. [2025-09-15T21:13:38.256725] [INFO ] [MAIN ] CAG: Loaded 39628 primary data records. [2025-09-15T21:13:38.353531] [DEBUG] [LOCAL ] CAH: Loaded 37932 existing records from primary storage. [2025-09-15T21:13:38.377702] [INFO ] [MAIN ] CAH: Loaded 37932 primary data records. [2025-09-15T21:13:38.659476] [DEBUG] [LOCAL ] CAL: Loaded 31389 existing records from primary storage. [2025-09-15T21:13:38.665404] [INFO ] [MAIN ] CAL: Loaded 31389 primary data records. [2025-09-15T21:13:39.122255] [DEBUG] [MAIN ] CAG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:39.123458] [INFO ] [MAIN ] CAG: Generated 1326 derivative records from 39628 primary records. [2025-09-15T21:13:39.123887] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-15T21:13:39.146759] [DEBUG] [MAIN ] CAH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:39.149484] [INFO ] [MAIN ] CAH: Generated 1326 derivative records from 37932 primary records. [2025-09-15T21:13:39.150832] [DEBUG] [LOCAL ] CAG: Derivative data saved (1326 records). [2025-09-15T21:13:39.150389] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-15T21:13:39.151960] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-15T21:13:39.163222] [INFO ] [MAIN ] Derivative Progress: 322/2083 symbols completed. CAG took 1.0s. Estimated remaining: 9m 47s. Rate: 179.9 symbols/min [2025-09-15T21:13:39.173877] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:39.174498] [DEBUG] [MAIN ] CAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:39.176922] [INFO ] [MAIN ] CAL: Generated 1326 derivative records from 31389 primary records. [2025-09-15T21:13:39.177998] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-15T21:13:39.178760] [DEBUG] [LOCAL ] CAH: Derivative data saved (1326 records). [2025-09-15T21:13:39.179500] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-15T21:13:39.188242] [INFO ] [MAIN ] Derivative Progress: 323/2083 symbols completed. CAH took 1.0s. Estimated remaining: 9m 45s. Rate: 180.4 symbols/min [2025-09-15T21:13:39.190544] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:39.194702] [DEBUG] [LOCAL ] CAL: Derivative data saved (1326 records). [2025-09-15T21:13:39.194787] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-15T21:13:39.198270] [INFO ] [MAIN ] Derivative Progress: 324/2083 symbols completed. CAL took 1.0s. Estimated remaining: 9m 43s. Rate: 180.9 symbols/min [2025-09-15T21:13:39.198636] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:39.207102] [DEBUG] [LOCAL ] CAPL: Loaded 3877 existing records from primary storage. [2025-09-15T21:13:39.219330] [INFO ] [MAIN ] CAPL: Loaded 3877 primary data records. [2025-09-15T21:13:39.340127] [DEBUG] [LOCAL ] CALX: Loaded 28396 existing records from primary storage. [2025-09-15T21:13:39.339223] [DEBUG] [LOCAL ] CANG: Loaded 20242 existing records from primary storage. [2025-09-15T21:13:39.340364] [INFO ] [MAIN ] CALX: Loaded 28396 primary data records. [2025-09-15T21:13:39.340292] [INFO ] [MAIN ] CANG: Loaded 20242 primary data records. [2025-09-15T21:13:40.111252] [DEBUG] [MAIN ] CAPL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:40.112680] [INFO ] [MAIN ] CAPL: Generated 1326 derivative records from 3877 primary records. [2025-09-15T21:13:40.112886] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-15T21:13:40.134151] [DEBUG] [MAIN ] CANG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:40.136919] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1326 records). [2025-09-15T21:13:40.137169] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-15T21:13:40.137887] [INFO ] [MAIN ] CANG: Generated 1326 derivative records from 20242 primary records. [2025-09-15T21:13:40.149034] [DEBUG] [MAIN ] CALX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:40.149204] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-15T21:13:40.148751] [INFO ] [MAIN ] Derivative Progress: 325/2083 symbols completed. CAPL took 1.0s. Estimated remaining: 9m 46s. Rate: 179.9 symbols/min [2025-09-15T21:13:40.150943] [INFO ] [MAIN ] CALX: Generated 1326 derivative records from 28396 primary records. [2025-09-15T21:13:40.151016] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:40.151394] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-15T21:13:40.172464] [DEBUG] [LOCAL ] CANG: Derivative data saved (1326 records). [2025-09-15T21:13:40.173409] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-15T21:13:40.175261] [DEBUG] [LOCAL ] CALX: Derivative data saved (1326 records). [2025-09-15T21:13:40.177851] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-15T21:13:40.177717] [INFO ] [MAIN ] Derivative Progress: 326/2083 symbols completed. CANG took 1.0s. Estimated remaining: 9m 44s. Rate: 180.4 symbols/min [2025-09-15T21:13:40.180575] [INFO ] [MAIN ] Derivative Progress: 327/2083 symbols completed. CALX took 1.0s. Estimated remaining: 9m 42s. Rate: 180.9 symbols/min [2025-09-15T21:13:40.180424] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:40.180903] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:40.243668] [DEBUG] [LOCAL ] CARS: Loaded 28899 existing records from primary storage. [2025-09-15T21:13:40.254063] [INFO ] [MAIN ] CARS: Loaded 28899 primary data records. [2025-09-15T21:13:40.291812] [DEBUG] [LOCAL ] CARR: Loaded 39576 existing records from primary storage. [2025-09-15T21:13:40.325300] [INFO ] [MAIN ] CARR: Loaded 39576 primary data records. [2025-09-15T21:13:40.299091] [DEBUG] [LOCAL ] CAT: Loaded 39023 existing records from primary storage. [2025-09-15T21:13:40.332951] [INFO ] [MAIN ] CAT: Loaded 39023 primary data records. [2025-09-15T21:13:41.097208] [DEBUG] [MAIN ] CARS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:41.100349] [INFO ] [MAIN ] CARS: Generated 1326 derivative records from 28899 primary records. [2025-09-15T21:13:41.102409] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-15T21:13:41.134126] [DEBUG] [MAIN ] CAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:41.134210] [DEBUG] [LOCAL ] CARS: Derivative data saved (1326 records). [2025-09-15T21:13:41.134583] [DEBUG] [MAIN ] CARR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:41.134831] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-15T21:13:41.136307] [INFO ] [MAIN ] CAT: Generated 1326 derivative records from 39023 primary records. [2025-09-15T21:13:41.137886] [INFO ] [MAIN ] Derivative Progress: 328/2083 symbols completed. CARS took 1.0s. Estimated remaining: 9m 45s. Rate: 179.9 symbols/min [2025-09-15T21:13:41.135619] [INFO ] [MAIN ] CARR: Generated 1326 derivative records from 39576 primary records. [2025-09-15T21:13:41.138079] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-15T21:13:41.138144] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-15T21:13:41.160698] [DEBUG] [LOCAL ] CARR: Derivative data saved (1326 records). [2025-09-15T21:13:41.161795] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-15T21:13:41.164442] [INFO ] [MAIN ] Derivative Progress: 329/2083 symbols completed. CARR took 1.0s. Estimated remaining: 9m 43s. Rate: 180.4 symbols/min [2025-09-15T21:13:41.165980] [DEBUG] [LOCAL ] CAT: Derivative data saved (1326 records). [2025-09-15T21:13:41.166053] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-15T21:13:41.167780] [INFO ] [MAIN ] Derivative Progress: 330/2083 symbols completed. CAT took 1.0s. Estimated remaining: 9m 41s. Rate: 181.0 symbols/min [2025-09-15T21:13:41.168606] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:41.168980] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:41.168780] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:41.180197] [DEBUG] [LOCAL ] CATO: Loaded 5040 existing records from primary storage. [2025-09-15T21:13:41.180425] [INFO ] [MAIN ] CATO: Loaded 5040 primary data records. [2025-09-15T21:13:41.234000] [DEBUG] [LOCAL ] CBAN: Loaded 7399 existing records from primary storage. [2025-09-15T21:13:41.251384] [DEBUG] [LOCAL ] CBL: Loaded 11888 existing records from primary storage. [2025-09-15T21:13:41.251063] [INFO ] [MAIN ] CBAN: Loaded 7399 primary data records. [2025-09-15T21:13:41.265367] [INFO ] [MAIN ] CBL: Loaded 11888 primary data records. [2025-09-15T21:13:42.152046] [DEBUG] [MAIN ] CATO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:42.156000] [INFO ] [MAIN ] CATO: Generated 1326 derivative records from 5040 primary records. [2025-09-15T21:13:42.156272] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-15T21:13:42.181251] [DEBUG] [LOCAL ] CATO: Derivative data saved (1326 records). [2025-09-15T21:13:42.181783] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-15T21:13:42.184029] [INFO ] [MAIN ] Derivative Progress: 331/2083 symbols completed. CATO took 1.0s. Estimated remaining: 9m 45s. Rate: 179.8 symbols/min [2025-09-15T21:13:42.184884] [DEBUG] [MAIN ] CBL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:42.200409] [DEBUG] [MAIN ] CBAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:42.202007] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:42.201609] [INFO ] [MAIN ] CBAN: Generated 1326 derivative records from 7399 primary records. [2025-09-15T21:13:42.202807] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-15T21:13:42.204076] [INFO ] [MAIN ] CBL: Generated 1326 derivative records from 11888 primary records. [2025-09-15T21:13:42.205409] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-15T21:13:42.238532] [DEBUG] [LOCAL ] CBL: Derivative data saved (1326 records). [2025-09-15T21:13:42.244763] [DEBUG] [LOCAL ] CBNA: Loaded 2270 existing records from primary storage. [2025-09-15T21:13:42.240988] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-15T21:13:42.247634] [INFO ] [MAIN ] Derivative Progress: 332/2083 symbols completed. CBL took 1.1s. Estimated remaining: 9m 43s. Rate: 180.3 symbols/min [2025-09-15T21:13:42.248199] [INFO ] [MAIN ] CBNA: Loaded 2270 primary data records. [2025-09-15T21:13:42.247976] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:42.250518] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1326 records). [2025-09-15T21:13:42.268496] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-15T21:13:42.294542] [INFO ] [MAIN ] Derivative Progress: 333/2083 symbols completed. CBAN took 1.1s. Estimated remaining: 9m 41s. Rate: 180.7 symbols/min [2025-09-15T21:13:42.348062] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:42.510831] [DEBUG] [LOCAL ] CBRE: Loaded 37044 existing records from primary storage. [2025-09-15T21:13:42.547535] [INFO ] [MAIN ] CBRE: Loaded 37044 primary data records. [2025-09-15T21:13:42.907963] [DEBUG] [LOCAL ] CBT: Loaded 22706 existing records from primary storage. [2025-09-15T21:13:42.914908] [INFO ] [MAIN ] CBT: Loaded 22706 primary data records. [2025-09-15T21:13:43.470397] [DEBUG] [MAIN ] CBNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:43.471988] [INFO ] [MAIN ] CBNA: Generated 1326 derivative records from 2270 primary records. [2025-09-15T21:13:43.472793] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-15T21:13:43.487753] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1326 records). [2025-09-15T21:13:43.488804] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-15T21:13:43.490910] [INFO ] [MAIN ] Derivative Progress: 334/2083 symbols completed. CBNA took 1.3s. Estimated remaining: 9m 45s. Rate: 179.3 symbols/min [2025-09-15T21:13:43.491632] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:43.509177] [DEBUG] [MAIN ] CBRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:43.514359] [INFO ] [MAIN ] CBRE: Generated 1326 derivative records from 37044 primary records. [2025-09-15T21:13:43.514581] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-15T21:13:43.541393] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1326 records). [2025-09-15T21:13:43.547032] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-15T21:13:43.546532] [DEBUG] [LOCAL ] CBU: Loaded 16204 existing records from primary storage. [2025-09-15T21:13:43.549893] [INFO ] [MAIN ] Derivative Progress: 335/2083 symbols completed. CBRE took 1.3s. Estimated remaining: 9m 43s. Rate: 179.8 symbols/min [2025-09-15T21:13:43.547388] [DEBUG] [MAIN ] CBT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:43.550275] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:43.551417] [INFO ] [MAIN ] CBT: Generated 1326 derivative records from 22706 primary records. [2025-09-15T21:13:43.552084] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-15T21:13:43.552006] [INFO ] [MAIN ] CBU: Loaded 16204 primary data records. [2025-09-15T21:13:43.679142] [DEBUG] [LOCAL ] CBT: Derivative data saved (1326 records). [2025-09-15T21:13:43.700193] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-15T21:13:43.721741] [INFO ] [MAIN ] Derivative Progress: 336/2083 symbols completed. CBT took 1.4s. Estimated remaining: 9m 42s. Rate: 180.0 symbols/min [2025-09-15T21:13:43.744550] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:43.854023] [DEBUG] [LOCAL ] CBZ: Loaded 24586 existing records from primary storage. [2025-09-15T21:13:43.854805] [INFO ] [MAIN ] CBZ: Loaded 24586 primary data records. [2025-09-15T21:13:44.145183] [DEBUG] [LOCAL ] CC: Loaded 39175 existing records from primary storage. [2025-09-15T21:13:44.145691] [INFO ] [MAIN ] CC: Loaded 39175 primary data records. [2025-09-15T21:13:44.441360] [DEBUG] [MAIN ] CBU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:44.443037] [INFO ] [MAIN ] CBU: Generated 1326 derivative records from 16204 primary records. [2025-09-15T21:13:44.443296] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-15T21:13:44.462205] [DEBUG] [LOCAL ] CBU: Derivative data saved (1326 records). [2025-09-15T21:13:44.462971] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-15T21:13:44.464953] [INFO ] [MAIN ] Derivative Progress: 337/2083 symbols completed. CBU took 1.0s. Estimated remaining: 9m 44s. Rate: 179.4 symbols/min [2025-09-15T21:13:44.475971] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:44.475690] [DEBUG] [MAIN ] CBZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:44.478696] [INFO ] [MAIN ] CBZ: Generated 1326 derivative records from 24586 primary records. [2025-09-15T21:13:44.479255] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-15T21:13:44.498069] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1326 records). [2025-09-15T21:13:44.498912] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-15T21:13:44.501505] [INFO ] [MAIN ] Derivative Progress: 338/2083 symbols completed. CBZ took 1.0s. Estimated remaining: 9m 42s. Rate: 179.9 symbols/min [2025-09-15T21:13:44.501921] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:44.514092] [DEBUG] [MAIN ] CC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:44.515067] [INFO ] [MAIN ] CC: Generated 1326 derivative records from 39175 primary records. [2025-09-15T21:13:44.515195] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-15T21:13:44.541836] [DEBUG] [LOCAL ] CC: Derivative data saved (1326 records). [2025-09-15T21:13:44.542063] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-15T21:13:44.544140] [INFO ] [MAIN ] Derivative Progress: 339/2083 symbols completed. CC took 0.8s. Estimated remaining: 9m 40s. Rate: 180.3 symbols/min [2025-09-15T21:13:44.544623] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:44.550744] [DEBUG] [LOCAL ] CCIF: Loaded 11217 existing records from primary storage. [2025-09-15T21:13:44.551010] [INFO ] [MAIN ] CCIF: Loaded 11217 primary data records. [2025-09-15T21:13:44.678505] [DEBUG] [LOCAL ] CCI: Loaded 39172 existing records from primary storage. [2025-09-15T21:13:44.679107] [INFO ] [MAIN ] CCI: Loaded 39172 primary data records. [2025-09-15T21:13:45.004993] [DEBUG] [LOCAL ] CCJ: Loaded 39663 existing records from primary storage. [2025-09-15T21:13:45.011794] [INFO ] [MAIN ] CCJ: Loaded 39663 primary data records. [2025-09-15T21:13:45.493389] [DEBUG] [MAIN ] CCIF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:45.494952] [INFO ] [MAIN ] CCIF: Generated 1326 derivative records from 11217 primary records. [2025-09-15T21:13:45.495139] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-15T21:13:45.509653] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1326 records). [2025-09-15T21:13:45.509800] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-15T21:13:45.511704] [INFO ] [MAIN ] Derivative Progress: 340/2083 symbols completed. CCIF took 1.0s. Estimated remaining: 9m 43s. Rate: 179.3 symbols/min [2025-09-15T21:13:45.513123] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:45.527963] [DEBUG] [MAIN ] CCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:45.528964] [INFO ] [MAIN ] CCI: Generated 1326 derivative records from 39172 primary records. [2025-09-15T21:13:45.529185] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-15T21:13:45.546952] [DEBUG] [LOCAL ] CCI: Derivative data saved (1326 records). [2025-09-15T21:13:45.552903] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-15T21:13:45.560144] [DEBUG] [MAIN ] CCJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:45.559426] [INFO ] [MAIN ] Derivative Progress: 341/2083 symbols completed. CCI took 1.1s. Estimated remaining: 9m 41s. Rate: 179.8 symbols/min [2025-09-15T21:13:45.561255] [INFO ] [MAIN ] CCJ: Generated 1326 derivative records from 39663 primary records. [2025-09-15T21:13:45.561544] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-15T21:13:45.561716] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:45.584004] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1326 records). [2025-09-15T21:13:45.584214] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-15T21:13:45.596799] [INFO ] [MAIN ] Derivative Progress: 342/2083 symbols completed. CCJ took 1.1s. Estimated remaining: 9m 40s. Rate: 180.2 symbols/min [2025-09-15T21:13:45.597112] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:45.598866] [DEBUG] [LOCAL ] CCK: Loaded 34145 existing records from primary storage. [2025-09-15T21:13:45.599107] [INFO ] [MAIN ] CCK: Loaded 34145 primary data records. [2025-09-15T21:13:45.815295] [DEBUG] [LOCAL ] CCL: Loaded 39760 existing records from primary storage. [2025-09-15T21:13:45.902395] [INFO ] [MAIN ] CCL: Loaded 39760 primary data records. [2025-09-15T21:13:46.007098] [DEBUG] [LOCAL ] CCO: Loaded 35835 existing records from primary storage. [2025-09-15T21:13:46.022694] [INFO ] [MAIN ] CCO: Loaded 35835 primary data records. [2025-09-15T21:13:46.467766] [DEBUG] [MAIN ] CCK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:46.469258] [INFO ] [MAIN ] CCK: Generated 1326 derivative records from 34145 primary records. [2025-09-15T21:13:46.469584] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-15T21:13:46.483443] [DEBUG] [LOCAL ] CCK: Derivative data saved (1326 records). [2025-09-15T21:13:46.483923] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-15T21:13:46.486095] [INFO ] [MAIN ] Derivative Progress: 343/2083 symbols completed. CCK took 1.0s. Estimated remaining: 9m 42s. Rate: 179.4 symbols/min [2025-09-15T21:13:46.499530] [DEBUG] [MAIN ] CCL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:46.500341] [INFO ] [MAIN ] CCL: Generated 1326 derivative records from 39760 primary records. [2025-09-15T21:13:46.500490] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-15T21:13:46.512869] [DEBUG] [LOCAL ] CCL: Derivative data saved (1326 records). [2025-09-15T21:13:46.512931] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-15T21:13:46.515086] [INFO ] [MAIN ] Derivative Progress: 344/2083 symbols completed. CCL took 1.0s. Estimated remaining: 9m 40s. Rate: 179.8 symbols/min [2025-09-15T21:13:46.526985] [DEBUG] [MAIN ] CCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:46.527564] [INFO ] [MAIN ] CCO: Generated 1326 derivative records from 35835 primary records. [2025-09-15T21:13:46.527624] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-15T21:13:46.539228] [DEBUG] [LOCAL ] CCO: Derivative data saved (1326 records). [2025-09-15T21:13:46.539285] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-15T21:13:46.541858] [INFO ] [MAIN ] Derivative Progress: 345/2083 symbols completed. CCO took 0.9s. Estimated remaining: 9m 38s. Rate: 180.3 symbols/min [2025-09-15T21:13:46.542412] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:46.542533] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:46.542635] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:46.553542] [DEBUG] [LOCAL ] CCRD: Loaded 7738 existing records from primary storage. [2025-09-15T21:13:46.553725] [INFO ] [MAIN ] CCRD: Loaded 7738 primary data records. [2025-09-15T21:13:46.730896] [DEBUG] [LOCAL ] CCU: Loaded 16315 existing records from primary storage. [2025-09-15T21:13:46.755959] [INFO ] [MAIN ] CCU: Loaded 16315 primary data records. [2025-09-15T21:13:46.755800] [DEBUG] [LOCAL ] CCS: Loaded 22400 existing records from primary storage. [2025-09-15T21:13:46.839343] [INFO ] [MAIN ] CCS: Loaded 22400 primary data records. [2025-09-15T21:13:47.508122] [DEBUG] [MAIN ] CCRD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:47.510753] [INFO ] [MAIN ] CCRD: Generated 1326 derivative records from 7738 primary records. [2025-09-15T21:13:47.511096] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-15T21:13:47.526901] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1326 records). [2025-09-15T21:13:47.529099] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-15T21:13:47.530968] [INFO ] [MAIN ] Derivative Progress: 346/2083 symbols completed. CCRD took 1.0s. Estimated remaining: 9m 41s. Rate: 179.3 symbols/min [2025-09-15T21:13:47.531423] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:47.547177] [DEBUG] [MAIN ] CCU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:47.559546] [INFO ] [MAIN ] CCU: Generated 1326 derivative records from 16315 primary records. [2025-09-15T21:13:47.559859] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-15T21:13:47.560128] [DEBUG] [MAIN ] CCS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:47.562051] [INFO ] [MAIN ] CCS: Generated 1326 derivative records from 22400 primary records. [2025-09-15T21:13:47.562144] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-15T21:13:47.585492] [DEBUG] [LOCAL ] CCU: Derivative data saved (1326 records). [2025-09-15T21:13:47.591862] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-15T21:13:47.594456] [INFO ] [MAIN ] Derivative Progress: 347/2083 symbols completed. CCU took 1.1s. Estimated remaining: 9m 40s. Rate: 179.7 symbols/min [2025-09-15T21:13:47.591750] [DEBUG] [LOCAL ] CCS: Derivative data saved (1326 records). [2025-09-15T21:13:47.594916] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:47.595081] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-15T21:13:47.597255] [INFO ] [MAIN ] Derivative Progress: 348/2083 symbols completed. CCS took 1.1s. Estimated remaining: 9m 38s. Rate: 180.2 symbols/min [2025-09-15T21:13:47.607456] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:47.617089] [DEBUG] [LOCAL ] CDLR: Loaded 6990 existing records from primary storage. [2025-09-15T21:13:47.617290] [INFO ] [MAIN ] CDLR: Loaded 6990 primary data records. [2025-09-15T21:13:47.687413] [DEBUG] [LOCAL ] CDE: Loaded 39604 existing records from primary storage. [2025-09-15T21:13:47.712951] [INFO ] [MAIN ] CDE: Loaded 39604 primary data records. [2025-09-15T21:13:47.913713] [DEBUG] [LOCAL ] CDP: Loaded 31021 existing records from primary storage. [2025-09-15T21:13:47.945464] [INFO ] [MAIN ] CDP: Loaded 31021 primary data records. [2025-09-15T21:13:48.513431] [DEBUG] [MAIN ] CDLR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:48.514382] [INFO ] [MAIN ] CDLR: Generated 1326 derivative records from 6990 primary records. [2025-09-15T21:13:48.524666] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-15T21:13:48.524939] [DEBUG] [MAIN ] CDE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:48.534518] [INFO ] [MAIN ] CDE: Generated 1326 derivative records from 39604 primary records. [2025-09-15T21:13:48.538133] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-15T21:13:48.539909] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1326 records). [2025-09-15T21:13:48.540020] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-15T21:13:48.542332] [INFO ] [MAIN ] Derivative Progress: 349/2083 symbols completed. CDLR took 0.9s. Estimated remaining: 9m 40s. Rate: 179.3 symbols/min [2025-09-15T21:13:48.558982] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:48.561783] [DEBUG] [MAIN ] CDP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:48.565493] [DEBUG] [LOCAL ] CDE: Derivative data saved (1326 records). [2025-09-15T21:13:48.564576] [INFO ] [MAIN ] CDP: Generated 1326 derivative records from 31021 primary records. [2025-09-15T21:13:48.565662] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-15T21:13:48.567859] [INFO ] [MAIN ] Derivative Progress: 350/2083 symbols completed. CDE took 1.0s. Estimated remaining: 9m 38s. Rate: 179.8 symbols/min [2025-09-15T21:13:48.568039] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:48.568227] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-15T21:13:48.586796] [DEBUG] [LOCAL ] CDP: Derivative data saved (1326 records). [2025-09-15T21:13:48.586947] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-15T21:13:48.589148] [INFO ] [MAIN ] Derivative Progress: 351/2083 symbols completed. CDP took 1.0s. Estimated remaining: 9m 37s. Rate: 180.2 symbols/min [2025-09-15T21:13:48.589415] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:48.599003] [DEBUG] [LOCAL ] CDRE: Loaded 18482 existing records from primary storage. [2025-09-15T21:13:48.600200] [INFO ] [MAIN ] CDRE: Loaded 18482 primary data records. [2025-09-15T21:13:48.634893] [DEBUG] [LOCAL ] CEE: Loaded 3994 existing records from primary storage. [2025-09-15T21:13:48.646910] [INFO ] [MAIN ] CEE: Loaded 3994 primary data records. [2025-09-15T21:13:48.873947] [DEBUG] [LOCAL ] CE: Loaded 37804 existing records from primary storage. [2025-09-15T21:13:48.981880] [INFO ] [MAIN ] CE: Loaded 37804 primary data records. [2025-09-15T21:13:49.453485] [DEBUG] [MAIN ] CEE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:49.454909] [INFO ] [MAIN ] CEE: Generated 1326 derivative records from 3994 primary records. [2025-09-15T21:13:49.455088] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-15T21:13:49.476313] [DEBUG] [LOCAL ] CEE: Derivative data saved (1326 records). [2025-09-15T21:13:49.476741] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-15T21:13:49.478366] [INFO ] [MAIN ] Derivative Progress: 352/2083 symbols completed. CEE took 0.9s. Estimated remaining: 9m 39s. Rate: 179.4 symbols/min [2025-09-15T21:13:49.478726] [DEBUG] [MAIN ] CDRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:49.479031] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:49.480196] [INFO ] [MAIN ] CDRE: Generated 1326 derivative records from 18482 primary records. [2025-09-15T21:13:49.480561] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-15T21:13:49.494768] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1326 records). [2025-09-15T21:13:49.495114] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-15T21:13:49.497405] [INFO ] [MAIN ] Derivative Progress: 353/2083 symbols completed. CDRE took 0.9s. Estimated remaining: 9m 37s. Rate: 179.9 symbols/min [2025-09-15T21:13:49.497714] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:49.517321] [DEBUG] [MAIN ] CE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:49.518322] [INFO ] [MAIN ] CE: Generated 1326 derivative records from 37804 primary records. [2025-09-15T21:13:49.518748] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-15T21:13:49.526061] [DEBUG] [LOCAL ] CEPU: Loaded 18551 existing records from primary storage. [2025-09-15T21:13:49.526473] [INFO ] [MAIN ] CEPU: Loaded 18551 primary data records. [2025-09-15T21:13:49.659848] [DEBUG] [LOCAL ] CE: Derivative data saved (1326 records). [2025-09-15T21:13:49.659978] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-15T21:13:49.661777] [INFO ] [MAIN ] Derivative Progress: 354/2083 symbols completed. CE took 1.1s. Estimated remaining: 9m 36s. Rate: 180.1 symbols/min [2025-09-15T21:13:49.673544] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:49.752957] [DEBUG] [LOCAL ] CF: Loaded 38590 existing records from primary storage. [2025-09-15T21:13:49.850543] [INFO ] [MAIN ] CF: Loaded 38590 primary data records. [2025-09-15T21:13:50.148529] [DEBUG] [LOCAL ] CFG: Loaded 39585 existing records from primary storage. [2025-09-15T21:13:50.160443] [INFO ] [MAIN ] CFG: Loaded 39585 primary data records. [2025-09-15T21:13:50.329301] [DEBUG] [MAIN ] CEPU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:50.353933] [INFO ] [MAIN ] CEPU: Generated 1326 derivative records from 18551 primary records. [2025-09-15T21:13:50.359398] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-15T21:13:50.466772] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1326 records). [2025-09-15T21:13:50.467025] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-15T21:13:50.469045] [INFO ] [MAIN ] Derivative Progress: 355/2083 symbols completed. CEPU took 1.0s. Estimated remaining: 9m 38s. Rate: 179.4 symbols/min [2025-09-15T21:13:50.469378] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:50.485155] [DEBUG] [MAIN ] CF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:50.486240] [INFO ] [MAIN ] CF: Generated 1326 derivative records from 38590 primary records. [2025-09-15T21:13:50.486441] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-15T21:13:50.500338] [DEBUG] [LOCAL ] CF: Derivative data saved (1326 records). [2025-09-15T21:13:50.500785] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-15T21:13:50.503413] [INFO ] [MAIN ] Derivative Progress: 356/2083 symbols completed. CF took 1.0s. Estimated remaining: 9m 36s. Rate: 179.9 symbols/min [2025-09-15T21:13:50.503806] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:50.507904] [DEBUG] [LOCAL ] CGV: Loaded 943 existing records from primary storage. [2025-09-15T21:13:50.508187] [INFO ] [MAIN ] CGV: Loaded 943 primary data records. [2025-09-15T21:13:50.634150] [DEBUG] [MAIN ] CFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:50.647860] [DEBUG] [LOCAL ] CGAU: Loaded 31020 existing records from primary storage. [2025-09-15T21:13:50.646199] [INFO ] [MAIN ] CFG: Generated 1326 derivative records from 39585 primary records. [2025-09-15T21:13:50.663490] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-15T21:13:50.663605] [INFO ] [MAIN ] CGAU: Loaded 31020 primary data records. [2025-09-15T21:13:50.929251] [DEBUG] [LOCAL ] CFG: Derivative data saved (1326 records). [2025-09-15T21:13:50.940571] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-15T21:13:50.953564] [INFO ] [MAIN ] Derivative Progress: 357/2083 symbols completed. CFG took 1.3s. Estimated remaining: 9m 36s. Rate: 179.7 symbols/min [2025-09-15T21:13:51.004036] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:51.125997] [DEBUG] [MAIN ] CGV: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:13:51.127509] [DEBUG] [LOCAL ] CHCT: Loaded 17753 existing records from primary storage. [2025-09-15T21:13:51.126991] [INFO ] [MAIN ] CGV: Generated 1324 derivative records from 943 primary records. [2025-09-15T21:13:51.127687] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-15T21:13:51.127842] [INFO ] [MAIN ] CHCT: Loaded 17753 primary data records. [2025-09-15T21:13:51.235191] [DEBUG] [LOCAL ] CGV: Derivative data saved (1324 records). [2025-09-15T21:13:51.251978] [DEBUG] [MAIN ] CGAU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:51.252564] [INFO ] [MAIN ] CGAU: Generated 1326 derivative records from 31020 primary records. [2025-09-15T21:13:51.252688] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-15T21:13:51.251682] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-15T21:13:51.255542] [INFO ] [MAIN ] Derivative Progress: 358/2083 symbols completed. CGV took 0.8s. Estimated remaining: 9m 36s. Rate: 179.7 symbols/min [2025-09-15T21:13:51.340236] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1326 records). [2025-09-15T21:13:51.422970] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-15T21:13:51.425177] [INFO ] [MAIN ] Derivative Progress: 359/2083 symbols completed. CGAU took 1.0s. Estimated remaining: 9m 35s. Rate: 180.0 symbols/min [2025-09-15T21:13:51.444436] [DEBUG] [MAIN ] CHCT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:51.445069] [INFO ] [MAIN ] CHCT: Generated 1326 derivative records from 17753 primary records. [2025-09-15T21:13:51.445131] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-15T21:13:51.456532] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1326 records). [2025-09-15T21:13:51.456590] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-15T21:13:51.458498] [INFO ] [MAIN ] Derivative Progress: 360/2083 symbols completed. CHCT took 0.5s. Estimated remaining: 9m 33s. Rate: 180.4 symbols/min [2025-09-15T21:13:51.459154] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:51.459071] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:51.458969] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:51.472923] [DEBUG] [LOCAL ] CHE: Loaded 11150 existing records from primary storage. [2025-09-15T21:13:51.473113] [INFO ] [MAIN ] CHE: Loaded 11150 primary data records. [2025-09-15T21:13:51.644973] [DEBUG] [LOCAL ] CHGG: Loaded 35278 existing records from primary storage. [2025-09-15T21:13:51.762328] [INFO ] [MAIN ] CHGG: Loaded 35278 primary data records. [2025-09-15T21:13:51.784572] [DEBUG] [LOCAL ] CHD: Loaded 38809 existing records from primary storage. [2025-09-15T21:13:51.817804] [INFO ] [MAIN ] CHD: Loaded 38809 primary data records. [2025-09-15T21:13:52.379342] [DEBUG] [MAIN ] CHE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:52.380774] [INFO ] [MAIN ] CHE: Generated 1326 derivative records from 11150 primary records. [2025-09-15T21:13:52.380885] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-15T21:13:52.396182] [DEBUG] [LOCAL ] CHE: Derivative data saved (1326 records). [2025-09-15T21:13:52.396603] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-15T21:13:52.398851] [INFO ] [MAIN ] Derivative Progress: 361/2083 symbols completed. CHE took 0.9s. Estimated remaining: 9m 36s. Rate: 179.5 symbols/min [2025-09-15T21:13:52.399416] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:52.413804] [DEBUG] [MAIN ] CHGG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:52.414699] [INFO ] [MAIN ] CHGG: Generated 1326 derivative records from 35278 primary records. [2025-09-15T21:13:52.415628] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-15T21:13:52.439087] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1326 records). [2025-09-15T21:13:52.446971] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-15T21:13:52.449724] [DEBUG] [MAIN ] CHD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:52.449481] [INFO ] [MAIN ] Derivative Progress: 362/2083 symbols completed. CHGG took 1.0s. Estimated remaining: 9m 34s. Rate: 179.9 symbols/min [2025-09-15T21:13:52.450967] [INFO ] [MAIN ] CHD: Generated 1326 derivative records from 38809 primary records. [2025-09-15T21:13:52.451188] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:52.451498] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-15T21:13:52.473120] [DEBUG] [LOCAL ] CHD: Derivative data saved (1326 records). [2025-09-15T21:13:52.476228] [DEBUG] [LOCAL ] CHH: Loaded 23316 existing records from primary storage. [2025-09-15T21:13:52.475186] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-15T21:13:52.478929] [INFO ] [MAIN ] CHH: Loaded 23316 primary data records. [2025-09-15T21:13:52.478803] [INFO ] [MAIN ] Derivative Progress: 363/2083 symbols completed. CHD took 1.0s. Estimated remaining: 9m 32s. Rate: 180.4 symbols/min [2025-09-15T21:13:52.500833] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:52.703359] [DEBUG] [LOCAL ] CHT: Loaded 14218 existing records from primary storage. [2025-09-15T21:13:52.776244] [INFO ] [MAIN ] CHT: Loaded 14218 primary data records. [2025-09-15T21:13:52.810064] [DEBUG] [LOCAL ] CHPT: Loaded 36128 existing records from primary storage. [2025-09-15T21:13:52.833142] [INFO ] [MAIN ] CHPT: Loaded 36128 primary data records. [2025-09-15T21:13:53.352080] [DEBUG] [MAIN ] CHH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:53.353108] [INFO ] [MAIN ] CHH: Generated 1326 derivative records from 23316 primary records. [2025-09-15T21:13:53.353412] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-15T21:13:53.367382] [DEBUG] [LOCAL ] CHH: Derivative data saved (1326 records). [2025-09-15T21:13:53.367626] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-15T21:13:53.369405] [INFO ] [MAIN ] Derivative Progress: 364/2083 symbols completed. CHH took 1.0s. Estimated remaining: 9m 34s. Rate: 179.6 symbols/min [2025-09-15T21:13:53.369771] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:53.384100] [DEBUG] [MAIN ] CHT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:53.384831] [INFO ] [MAIN ] CHT: Generated 1326 derivative records from 14218 primary records. [2025-09-15T21:13:53.384975] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-15T21:13:53.399819] [DEBUG] [LOCAL ] CHT: Derivative data saved (1326 records). [2025-09-15T21:13:53.400038] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-15T21:13:53.402217] [INFO ] [MAIN ] Derivative Progress: 365/2083 symbols completed. CHT took 0.9s. Estimated remaining: 9m 33s. Rate: 180.0 symbols/min [2025-09-15T21:13:53.402657] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:53.415437] [DEBUG] [MAIN ] CHPT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:53.416500] [INFO ] [MAIN ] CHPT: Generated 1326 derivative records from 36128 primary records. [2025-09-15T21:13:53.426001] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-15T21:13:53.449881] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1326 records). [2025-09-15T21:13:53.451969] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-15T21:13:53.455134] [DEBUG] [LOCAL ] CHWY: Loaded 39622 existing records from primary storage. [2025-09-15T21:13:53.454461] [INFO ] [MAIN ] Derivative Progress: 366/2083 symbols completed. CHPT took 1.0s. Estimated remaining: 9m 31s. Rate: 180.4 symbols/min [2025-09-15T21:13:53.455500] [INFO ] [MAIN ] CHWY: Loaded 39622 primary data records. [2025-09-15T21:13:53.466590] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:53.649893] [DEBUG] [LOCAL ] CI: Loaded 36930 existing records from primary storage. [2025-09-15T21:13:53.650303] [DEBUG] [LOCAL ] CIA: Loaded 12731 existing records from primary storage. [2025-09-15T21:13:53.650600] [INFO ] [MAIN ] CIA: Loaded 12731 primary data records. [2025-09-15T21:13:53.667239] [INFO ] [MAIN ] CI: Loaded 36930 primary data records. [2025-09-15T21:13:54.386165] [DEBUG] [MAIN ] CHWY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:54.387437] [INFO ] [MAIN ] CHWY: Generated 1326 derivative records from 39622 primary records. [2025-09-15T21:13:54.388677] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-15T21:13:54.403899] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1326 records). [2025-09-15T21:13:54.404278] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-15T21:13:54.406285] [INFO ] [MAIN ] Derivative Progress: 367/2083 symbols completed. CHWY took 1.0s. Estimated remaining: 9m 34s. Rate: 179.5 symbols/min [2025-09-15T21:13:54.406858] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:54.431999] [DEBUG] [MAIN ] CI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:54.431766] [DEBUG] [MAIN ] CIA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:54.432941] [INFO ] [MAIN ] CIA: Generated 1326 derivative records from 12731 primary records. [2025-09-15T21:13:54.433404] [INFO ] [MAIN ] CI: Generated 1326 derivative records from 36930 primary records. [2025-09-15T21:13:54.433509] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-15T21:13:54.433574] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-15T21:13:54.456286] [DEBUG] [LOCAL ] CIA: Derivative data saved (1326 records). [2025-09-15T21:13:54.463392] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-15T21:13:54.466195] [INFO ] [MAIN ] Derivative Progress: 368/2083 symbols completed. CIA took 1.0s. Estimated remaining: 9m 32s. Rate: 179.9 symbols/min [2025-09-15T21:13:54.466692] [DEBUG] [LOCAL ] CI: Derivative data saved (1326 records). [2025-09-15T21:13:54.466891] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:54.467103] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-15T21:13:54.469430] [INFO ] [MAIN ] Derivative Progress: 369/2083 symbols completed. CI took 1.1s. Estimated remaining: 9m 30s. Rate: 180.4 symbols/min [2025-09-15T21:13:54.469773] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:54.485945] [DEBUG] [LOCAL ] CIF: Loaded 2943 existing records from primary storage. [2025-09-15T21:13:54.486149] [INFO ] [MAIN ] CIF: Loaded 2943 primary data records. [2025-09-15T21:13:54.486600] [DEBUG] [LOCAL ] CIB: Loaded 21773 existing records from primary storage. [2025-09-15T21:13:54.540804] [INFO ] [MAIN ] CIB: Loaded 21773 primary data records. [2025-09-15T21:13:54.767514] [DEBUG] [LOCAL ] CIEN: Loaded 38272 existing records from primary storage. [2025-09-15T21:13:54.905260] [INFO ] [MAIN ] CIEN: Loaded 38272 primary data records. [2025-09-15T21:13:55.341270] [DEBUG] [MAIN ] CIF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:55.343624] [INFO ] [MAIN ] CIF: Generated 1326 derivative records from 2943 primary records. [2025-09-15T21:13:55.344198] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-15T21:13:55.357039] [DEBUG] [MAIN ] CIB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:55.367038] [INFO ] [MAIN ] CIB: Generated 1326 derivative records from 21773 primary records. [2025-09-15T21:13:55.369569] [DEBUG] [LOCAL ] CIF: Derivative data saved (1326 records). [2025-09-15T21:13:55.369728] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-15T21:13:55.369814] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-15T21:13:55.371962] [INFO ] [MAIN ] Derivative Progress: 370/2083 symbols completed. CIF took 0.9s. Estimated remaining: 9m 32s. Rate: 179.6 symbols/min [2025-09-15T21:13:55.372564] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:55.394812] [DEBUG] [LOCAL ] CIB: Derivative data saved (1326 records). [2025-09-15T21:13:55.405720] [DEBUG] [MAIN ] CIEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:55.405885] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-15T21:13:55.410433] [INFO ] [MAIN ] CIEN: Generated 1326 derivative records from 38272 primary records. [2025-09-15T21:13:55.410604] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-15T21:13:55.409431] [INFO ] [MAIN ] Derivative Progress: 371/2083 symbols completed. CIB took 1.0s. Estimated remaining: 9m 31s. Rate: 180.0 symbols/min [2025-09-15T21:13:55.411189] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:55.433617] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1326 records). [2025-09-15T21:13:55.434590] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-15T21:13:55.446320] [INFO ] [MAIN ] Derivative Progress: 372/2083 symbols completed. CIEN took 1.0s. Estimated remaining: 9m 29s. Rate: 180.4 symbols/min [2025-09-15T21:13:55.448127] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:55.449332] [DEBUG] [LOCAL ] CIG: Loaded 32541 existing records from primary storage. [2025-09-15T21:13:55.449711] [INFO ] [MAIN ] CIG: Loaded 32541 primary data records. [2025-09-15T21:13:55.553299] [DEBUG] [LOCAL ] CII: Loaded 10090 existing records from primary storage. [2025-09-15T21:13:55.564773] [INFO ] [MAIN ] CII: Loaded 10090 primary data records. [2025-09-15T21:13:55.862184] [DEBUG] [LOCAL ] CIM: Loaded 26357 existing records from primary storage. [2025-09-15T21:13:55.879009] [INFO ] [MAIN ] CIM: Loaded 26357 primary data records. [2025-09-15T21:13:56.351288] [DEBUG] [MAIN ] CIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:56.354096] [INFO ] [MAIN ] CIG: Generated 1326 derivative records from 32541 primary records. [2025-09-15T21:13:56.354996] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-15T21:13:56.372728] [DEBUG] [LOCAL ] CIG: Derivative data saved (1326 records). [2025-09-15T21:13:56.373344] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-15T21:13:56.376116] [INFO ] [MAIN ] Derivative Progress: 373/2083 symbols completed. CIG took 1.0s. Estimated remaining: 9m 31s. Rate: 179.6 symbols/min [2025-09-15T21:13:56.389618] [DEBUG] [MAIN ] CII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:56.390707] [INFO ] [MAIN ] CII: Generated 1326 derivative records from 10090 primary records. [2025-09-15T21:13:56.400269] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-15T21:13:56.400199] [DEBUG] [MAIN ] CIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:56.401375] [INFO ] [MAIN ] CIM: Generated 1326 derivative records from 26357 primary records. [2025-09-15T21:13:56.401895] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-15T21:13:56.423451] [DEBUG] [LOCAL ] CIM: Derivative data saved (1326 records). [2025-09-15T21:13:56.423981] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-15T21:13:56.426419] [INFO ] [MAIN ] Derivative Progress: 374/2083 symbols completed. CIM took 1.0s. Estimated remaining: 9m 30s. Rate: 180.0 symbols/min [2025-09-15T21:13:56.428618] [DEBUG] [LOCAL ] CII: Derivative data saved (1326 records). [2025-09-15T21:13:56.428737] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-15T21:13:56.431078] [INFO ] [MAIN ] Derivative Progress: 375/2083 symbols completed. CII took 1.0s. Estimated remaining: 9m 28s. Rate: 180.5 symbols/min [2025-09-15T21:13:56.431693] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:56.431521] [INFO ] [MAIN ] CIMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:56.432426] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:56.437871] [DEBUG] [LOCAL ] CIMN: Loaded 1932 existing records from primary storage. [2025-09-15T21:13:56.438947] [INFO ] [MAIN ] CIMN: Loaded 1932 primary data records. [2025-09-15T21:13:56.510436] [DEBUG] [LOCAL ] CIMO: Loaded 2027 existing records from primary storage. [2025-09-15T21:13:56.533224] [INFO ] [MAIN ] CIMO: Loaded 2027 primary data records. [2025-09-15T21:13:56.559667] [DEBUG] [LOCAL ] CINT: Loaded 13303 existing records from primary storage. [2025-09-15T21:13:56.584228] [INFO ] [MAIN ] CINT: Loaded 13303 primary data records. [2025-09-15T21:13:57.363249] [DEBUG] [MAIN ] CIMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:57.364747] [INFO ] [MAIN ] CIMN: Generated 1326 derivative records from 1932 primary records. [2025-09-15T21:13:57.364941] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-15T21:13:57.385609] [DEBUG] [MAIN ] CIMO: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:13:57.390926] [INFO ] [MAIN ] CIMO: Generated 1325 derivative records from 2027 primary records. [2025-09-15T21:13:57.390011] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1326 records). [2025-09-15T21:13:57.391267] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-15T21:13:57.394020] [INFO ] [MAIN ] Derivative Progress: 376/2083 symbols completed. CIMN took 1.0s. Estimated remaining: 9m 30s. Rate: 179.6 symbols/min [2025-09-15T21:13:57.400383] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:57.404552] [DEBUG] [MAIN ] CINT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:57.405377] [INFO ] [MAIN ] CINT: Generated 1326 derivative records from 13303 primary records. [2025-09-15T21:13:57.404767] [DEBUG] [LOCAL ] CIMO: Saving derivative data. [2025-09-15T21:13:57.407455] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-15T21:13:57.424834] [DEBUG] [LOCAL ] CIMO: Derivative data saved (1325 records). [2025-09-15T21:13:57.430750] [INFO ] [MAIN ] CIMO: Successfully saved derivative data. [2025-09-15T21:13:57.438578] [INFO ] [MAIN ] Derivative Progress: 377/2083 symbols completed. CIMO took 1.0s. Estimated remaining: 9m 29s. Rate: 180.0 symbols/min [2025-09-15T21:13:57.436164] [DEBUG] [LOCAL ] CINT: Derivative data saved (1326 records). [2025-09-15T21:13:57.438858] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:57.439213] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-15T21:13:57.441815] [INFO ] [MAIN ] Derivative Progress: 378/2083 symbols completed. CINT took 1.0s. Estimated remaining: 9m 27s. Rate: 180.4 symbols/min [2025-09-15T21:13:57.442579] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:57.450706] [DEBUG] [LOCAL ] CIO: Loaded 14449 existing records from primary storage. [2025-09-15T21:13:57.450965] [INFO ] [MAIN ] CIO: Loaded 14449 primary data records. [2025-09-15T21:13:57.666137] [DEBUG] [LOCAL ] CION: Loaded 20264 existing records from primary storage. [2025-09-15T21:13:57.750418] [INFO ] [MAIN ] CION: Loaded 20264 primary data records. [2025-09-15T21:13:57.805377] [DEBUG] [LOCAL ] CIVI: Loaded 38791 existing records from primary storage. [2025-09-15T21:13:57.831632] [INFO ] [MAIN ] CIVI: Loaded 38791 primary data records. [2025-09-15T21:13:58.326368] [DEBUG] [MAIN ] CIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:58.328141] [INFO ] [MAIN ] CIO: Generated 1326 derivative records from 14449 primary records. [2025-09-15T21:13:58.328378] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-15T21:13:58.342406] [DEBUG] [LOCAL ] CIO: Derivative data saved (1326 records). [2025-09-15T21:13:58.344057] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-15T21:13:58.346237] [INFO ] [MAIN ] Derivative Progress: 379/2083 symbols completed. CIO took 1.0s. Estimated remaining: 9m 29s. Rate: 179.6 symbols/min [2025-09-15T21:13:58.346757] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:58.357671] [DEBUG] [MAIN ] CION: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:58.358892] [INFO ] [MAIN ] CION: Generated 1326 derivative records from 20264 primary records. [2025-09-15T21:13:58.359256] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-15T21:13:58.372873] [DEBUG] [LOCAL ] CION: Derivative data saved (1326 records). [2025-09-15T21:13:58.373032] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-15T21:13:58.375322] [INFO ] [MAIN ] Derivative Progress: 380/2083 symbols completed. CION took 0.9s. Estimated remaining: 9m 27s. Rate: 180.1 symbols/min [2025-09-15T21:13:58.376624] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:58.389574] [DEBUG] [MAIN ] CIVI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:58.390437] [INFO ] [MAIN ] CIVI: Generated 1326 derivative records from 38791 primary records. [2025-09-15T21:13:58.390560] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-15T21:13:58.404808] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1326 records). [2025-09-15T21:13:58.404994] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-15T21:13:58.407090] [INFO ] [MAIN ] Derivative Progress: 381/2083 symbols completed. CIVI took 1.0s. Estimated remaining: 9m 26s. Rate: 180.5 symbols/min [2025-09-15T21:13:58.407315] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:58.449066] [DEBUG] [LOCAL ] CL: Loaded 39609 existing records from primary storage. [2025-09-15T21:13:58.449296] [DEBUG] [LOCAL ] CLCO: Loaded 7925 existing records from primary storage. [2025-09-15T21:13:58.448287] [DEBUG] [LOCAL ] CLB: Loaded 24105 existing records from primary storage. [2025-09-15T21:13:58.449436] [INFO ] [MAIN ] CLB: Loaded 24105 primary data records. [2025-09-15T21:13:58.449494] [INFO ] [MAIN ] CLCO: Loaded 7925 primary data records. [2025-09-15T21:13:58.465669] [INFO ] [MAIN ] CL: Loaded 39609 primary data records. [2025-09-15T21:13:59.338952] [DEBUG] [MAIN ] CLB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:59.350285] [INFO ] [MAIN ] CLB: Generated 1326 derivative records from 24105 primary records. [2025-09-15T21:13:59.350551] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-15T21:13:59.350955] [DEBUG] [MAIN ] CLCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:59.352408] [INFO ] [MAIN ] CLCO: Generated 1326 derivative records from 7925 primary records. [2025-09-15T21:13:59.359149] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-15T21:13:59.374337] [DEBUG] [LOCAL ] CLB: Derivative data saved (1326 records). [2025-09-15T21:13:59.375229] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-15T21:13:59.374173] [DEBUG] [MAIN ] CL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:13:59.377132] [INFO ] [MAIN ] Derivative Progress: 382/2083 symbols completed. CLB took 1.0s. Estimated remaining: 9m 28s. Rate: 179.6 symbols/min [2025-09-15T21:13:59.384605] [INFO ] [MAIN ] CL: Generated 1326 derivative records from 39609 primary records. [2025-09-15T21:13:59.386937] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:59.390167] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1326 records). [2025-09-15T21:13:59.390322] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-15T21:13:59.390252] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-15T21:13:59.393628] [INFO ] [MAIN ] Derivative Progress: 383/2083 symbols completed. CLCO took 1.0s. Estimated remaining: 9m 27s. Rate: 180.0 symbols/min [2025-09-15T21:13:59.403164] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:59.406402] [DEBUG] [LOCAL ] CL: Derivative data saved (1326 records). [2025-09-15T21:13:59.406496] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-15T21:13:59.409147] [INFO ] [MAIN ] Derivative Progress: 384/2083 symbols completed. CL took 1.1s. Estimated remaining: 9m 25s. Rate: 180.5 symbols/min [2025-09-15T21:13:59.409619] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:13:59.425265] [DEBUG] [LOCAL ] CLDT: Loaded 17486 existing records from primary storage. [2025-09-15T21:13:59.425633] [INFO ] [MAIN ] CLDT: Loaded 17486 primary data records. [2025-09-15T21:13:59.555634] [DEBUG] [LOCAL ] CLH: Loaded 19570 existing records from primary storage. [2025-09-15T21:13:59.598376] [INFO ] [MAIN ] CLH: Loaded 19570 primary data records. [2025-09-15T21:13:59.756666] [DEBUG] [LOCAL ] CLF: Loaded 39702 existing records from primary storage. [2025-09-15T21:13:59.794214] [INFO ] [MAIN ] CLF: Loaded 39702 primary data records. [2025-09-15T21:14:00.277877] [DEBUG] [MAIN ] CLDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:00.279174] [INFO ] [MAIN ] CLDT: Generated 1326 derivative records from 17486 primary records. [2025-09-15T21:14:00.279357] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-15T21:14:00.292964] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1326 records). [2025-09-15T21:14:00.293156] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-15T21:14:00.295431] [INFO ] [MAIN ] Derivative Progress: 385/2083 symbols completed. CLDT took 0.9s. Estimated remaining: 9m 27s. Rate: 179.7 symbols/min [2025-09-15T21:14:00.295979] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:00.311370] [DEBUG] [MAIN ] CLH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:00.312760] [INFO ] [MAIN ] CLH: Generated 1326 derivative records from 19570 primary records. [2025-09-15T21:14:00.313850] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-15T21:14:00.317898] [DEBUG] [LOCAL ] CLPR: Loaded 7760 existing records from primary storage. [2025-09-15T21:14:00.318472] [INFO ] [MAIN ] CLPR: Loaded 7760 primary data records. [2025-09-15T21:14:00.401225] [DEBUG] [MAIN ] CLF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:00.410138] [INFO ] [MAIN ] CLF: Generated 1326 derivative records from 39702 primary records. [2025-09-15T21:14:00.416805] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-15T21:14:00.409360] [DEBUG] [LOCAL ] CLH: Derivative data saved (1326 records). [2025-09-15T21:14:00.422373] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-15T21:14:00.429305] [INFO ] [MAIN ] Derivative Progress: 386/2083 symbols completed. CLH took 1.0s. Estimated remaining: 9m 26s. Rate: 180.0 symbols/min [2025-09-15T21:14:00.445979] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:00.537922] [DEBUG] [LOCAL ] CLF: Derivative data saved (1326 records). [2025-09-15T21:14:00.616828] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-15T21:14:00.626767] [INFO ] [MAIN ] Derivative Progress: 387/2083 symbols completed. CLF took 1.2s. Estimated remaining: 9m 25s. Rate: 180.2 symbols/min [2025-09-15T21:14:00.627196] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:00.663321] [DEBUG] [LOCAL ] CLS: Loaded 39616 existing records from primary storage. [2025-09-15T21:14:00.672483] [INFO ] [MAIN ] CLS: Loaded 39616 primary data records. [2025-09-15T21:14:00.673190] [DEBUG] [MAIN ] CLPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:00.704680] [INFO ] [MAIN ] CLPR: Generated 1326 derivative records from 7760 primary records. [2025-09-15T21:14:00.727545] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-15T21:14:00.834828] [DEBUG] [LOCAL ] CLVT: Loaded 38400 existing records from primary storage. [2025-09-15T21:14:00.841317] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1326 records). [2025-09-15T21:14:00.856424] [INFO ] [MAIN ] CLVT: Loaded 38400 primary data records. [2025-09-15T21:14:00.856320] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-15T21:14:00.866149] [INFO ] [MAIN ] Derivative Progress: 388/2083 symbols completed. CLPR took 0.6s. Estimated remaining: 9m 24s. Rate: 180.3 symbols/min [2025-09-15T21:14:01.330264] [DEBUG] [MAIN ] CLS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:01.331165] [INFO ] [MAIN ] CLS: Generated 1326 derivative records from 39616 primary records. [2025-09-15T21:14:01.331457] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-15T21:14:01.344990] [DEBUG] [LOCAL ] CLS: Derivative data saved (1326 records). [2025-09-15T21:14:01.345134] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-15T21:14:01.346860] [INFO ] [MAIN ] Derivative Progress: 389/2083 symbols completed. CLS took 0.9s. Estimated remaining: 9m 24s. Rate: 180.1 symbols/min [2025-09-15T21:14:01.358761] [DEBUG] [MAIN ] CLVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:01.359405] [INFO ] [MAIN ] CLVT: Generated 1326 derivative records from 38400 primary records. [2025-09-15T21:14:01.359466] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-15T21:14:01.371136] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1326 records). [2025-09-15T21:14:01.371202] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-15T21:14:01.373440] [INFO ] [MAIN ] Derivative Progress: 390/2083 symbols completed. CLVT took 0.7s. Estimated remaining: 9m 23s. Rate: 180.5 symbols/min [2025-09-15T21:14:01.374245] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:01.374548] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:01.375098] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:01.396794] [DEBUG] [LOCAL ] CLW: Loaded 15618 existing records from primary storage. [2025-09-15T21:14:01.396968] [INFO ] [MAIN ] CLW: Loaded 15618 primary data records. [2025-09-15T21:14:01.587129] [DEBUG] [LOCAL ] CMA: Loaded 36840 existing records from primary storage. [2025-09-15T21:14:01.617669] [INFO ] [MAIN ] CMA: Loaded 36840 primary data records. [2025-09-15T21:14:01.587737] [DEBUG] [LOCAL ] CLX: Loaded 38387 existing records from primary storage. [2025-09-15T21:14:01.651553] [INFO ] [MAIN ] CLX: Loaded 38387 primary data records. [2025-09-15T21:14:02.296741] [DEBUG] [MAIN ] CLW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:02.297584] [INFO ] [MAIN ] CLW: Generated 1326 derivative records from 15618 primary records. [2025-09-15T21:14:02.298225] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-15T21:14:02.312170] [DEBUG] [LOCAL ] CLW: Derivative data saved (1326 records). [2025-09-15T21:14:02.312393] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-15T21:14:02.314516] [INFO ] [MAIN ] Derivative Progress: 391/2083 symbols completed. CLW took 0.9s. Estimated remaining: 9m 25s. Rate: 179.7 symbols/min [2025-09-15T21:14:02.315551] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:02.327181] [DEBUG] [MAIN ] CMA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:02.327882] [INFO ] [MAIN ] CMA: Generated 1326 derivative records from 36840 primary records. [2025-09-15T21:14:02.327994] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-15T21:14:02.356767] [DEBUG] [LOCAL ] CMA: Derivative data saved (1326 records). [2025-09-15T21:14:02.357189] [DEBUG] [MAIN ] CLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:02.357943] [INFO ] [MAIN ] CLX: Generated 1326 derivative records from 38387 primary records. [2025-09-15T21:14:02.357308] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-15T21:14:02.360452] [INFO ] [MAIN ] Derivative Progress: 392/2083 symbols completed. CMA took 1.0s. Estimated remaining: 9m 23s. Rate: 180.1 symbols/min [2025-09-15T21:14:02.358317] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-15T21:14:02.360687] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:02.376702] [DEBUG] [LOCAL ] CMBT: Loaded 16946 existing records from primary storage. [2025-09-15T21:14:02.377430] [INFO ] [MAIN ] CMBT: Loaded 16946 primary data records. [2025-09-15T21:14:02.467384] [DEBUG] [LOCAL ] CLX: Derivative data saved (1326 records). [2025-09-15T21:14:02.489096] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-15T21:14:02.495345] [INFO ] [MAIN ] Derivative Progress: 393/2083 symbols completed. CLX took 1.1s. Estimated remaining: 9m 22s. Rate: 180.3 symbols/min [2025-09-15T21:14:02.495634] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:02.586198] [DEBUG] [LOCAL ] CMCM: Loaded 3391 existing records from primary storage. [2025-09-15T21:14:02.587186] [DEBUG] [LOCAL ] CMC: Loaded 32872 existing records from primary storage. [2025-09-15T21:14:02.590336] [INFO ] [MAIN ] CMC: Loaded 32872 primary data records. [2025-09-15T21:14:02.590455] [INFO ] [MAIN ] CMCM: Loaded 3391 primary data records. [2025-09-15T21:14:03.246983] [DEBUG] [MAIN ] CMBT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:03.248069] [INFO ] [MAIN ] CMBT: Generated 1326 derivative records from 16946 primary records. [2025-09-15T21:14:03.248456] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-15T21:14:03.260989] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1326 records). [2025-09-15T21:14:03.261211] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-15T21:14:03.262971] [INFO ] [MAIN ] Derivative Progress: 394/2083 symbols completed. CMBT took 0.9s. Estimated remaining: 9m 24s. Rate: 179.8 symbols/min [2025-09-15T21:14:03.263227] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:03.286311] [DEBUG] [MAIN ] CMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:03.286808] [DEBUG] [MAIN ] CMCM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:03.287454] [INFO ] [MAIN ] CMC: Generated 1326 derivative records from 32872 primary records. [2025-09-15T21:14:03.288059] [INFO ] [MAIN ] CMCM: Generated 1326 derivative records from 3391 primary records. [2025-09-15T21:14:03.288136] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-15T21:14:03.288217] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-15T21:14:03.308540] [DEBUG] [LOCAL ] CMC: Derivative data saved (1326 records). [2025-09-15T21:14:03.309257] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-15T21:14:03.313911] [INFO ] [MAIN ] Derivative Progress: 395/2083 symbols completed. CMC took 1.0s. Estimated remaining: 9m 22s. Rate: 180.1 symbols/min [2025-09-15T21:14:03.314694] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:03.315585] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1326 records). [2025-09-15T21:14:03.315986] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-15T21:14:03.318234] [INFO ] [MAIN ] Derivative Progress: 396/2083 symbols completed. CMCM took 0.8s. Estimated remaining: 9m 21s. Rate: 180.6 symbols/min [2025-09-15T21:14:03.318489] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:03.347944] [DEBUG] [LOCAL ] CMG: Loaded 39687 existing records from primary storage. [2025-09-15T21:14:03.354501] [INFO ] [MAIN ] CMG: Loaded 39687 primary data records. [2025-09-15T21:14:03.484178] [DEBUG] [LOCAL ] CMP: Loaded 27389 existing records from primary storage. [2025-09-15T21:14:03.511297] [INFO ] [MAIN ] CMP: Loaded 27389 primary data records. [2025-09-15T21:14:03.539069] [DEBUG] [LOCAL ] CMI: Loaded 30182 existing records from primary storage. [2025-09-15T21:14:03.625883] [INFO ] [MAIN ] CMI: Loaded 30182 primary data records. [2025-09-15T21:14:04.245410] [DEBUG] [MAIN ] CMG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:04.246514] [INFO ] [MAIN ] CMG: Generated 1326 derivative records from 39687 primary records. [2025-09-15T21:14:04.246901] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-15T21:14:04.261049] [DEBUG] [LOCAL ] CMG: Derivative data saved (1326 records). [2025-09-15T21:14:04.261450] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-15T21:14:04.263771] [INFO ] [MAIN ] Derivative Progress: 397/2083 symbols completed. CMG took 1.0s. Estimated remaining: 9m 23s. Rate: 179.8 symbols/min [2025-09-15T21:14:04.264243] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:04.290422] [DEBUG] [MAIN ] CMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:04.292083] [INFO ] [MAIN ] CMI: Generated 1326 derivative records from 30182 primary records. [2025-09-15T21:14:04.292253] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-15T21:14:04.291027] [DEBUG] [MAIN ] CMP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:04.293138] [INFO ] [MAIN ] CMP: Generated 1326 derivative records from 27389 primary records. [2025-09-15T21:14:04.294020] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-15T21:14:04.327414] [DEBUG] [LOCAL ] CMI: Derivative data saved (1326 records). [2025-09-15T21:14:04.329553] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-15T21:14:04.332791] [INFO ] [MAIN ] Derivative Progress: 398/2083 symbols completed. CMI took 1.0s. Estimated remaining: 9m 21s. Rate: 180.1 symbols/min [2025-09-15T21:14:04.333502] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:04.333738] [DEBUG] [LOCAL ] CMP: Derivative data saved (1326 records). [2025-09-15T21:14:04.334306] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-15T21:14:04.337195] [INFO ] [MAIN ] Derivative Progress: 399/2083 symbols completed. CMP took 1.0s. Estimated remaining: 9m 20s. Rate: 180.6 symbols/min [2025-09-15T21:14:04.337882] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:04.347347] [DEBUG] [LOCAL ] CMRE: Loaded 26054 existing records from primary storage. [2025-09-15T21:14:04.347663] [INFO ] [MAIN ] CMRE: Loaded 26054 primary data records. [2025-09-15T21:14:04.419661] [DEBUG] [LOCAL ] CMSA: Loaded 2500 existing records from primary storage. [2025-09-15T21:14:04.448972] [INFO ] [MAIN ] CMSA: Loaded 2500 primary data records. [2025-09-15T21:14:04.760703] [DEBUG] [LOCAL ] CMS: Loaded 38924 existing records from primary storage. [2025-09-15T21:14:04.792140] [INFO ] [MAIN ] CMS: Loaded 38924 primary data records. [2025-09-15T21:14:05.194754] [DEBUG] [MAIN ] CMRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:05.196193] [INFO ] [MAIN ] CMRE: Generated 1326 derivative records from 26054 primary records. [2025-09-15T21:14:05.198057] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-15T21:14:05.222293] [DEBUG] [MAIN ] CMSA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:05.224802] [INFO ] [MAIN ] CMSA: Generated 1326 derivative records from 2500 primary records. [2025-09-15T21:14:05.224063] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1326 records). [2025-09-15T21:14:05.225268] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-15T21:14:05.225565] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-15T21:14:05.228384] [INFO ] [MAIN ] Derivative Progress: 400/2083 symbols completed. CMRE took 1.0s. Estimated remaining: 9m 22s. Rate: 179.8 symbols/min [2025-09-15T21:14:05.228973] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:05.241365] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1326 records). [2025-09-15T21:14:05.241777] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-15T21:14:05.246049] [INFO ] [MAIN ] Derivative Progress: 401/2083 symbols completed. CMSA took 0.9s. Estimated remaining: 9m 20s. Rate: 180.2 symbols/min [2025-09-15T21:14:05.246355] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:05.257524] [DEBUG] [LOCAL ] CMSC: Loaded 3425 existing records from primary storage. [2025-09-15T21:14:05.261273] [INFO ] [MAIN ] CMSC: Loaded 3425 primary data records. [2025-09-15T21:14:05.263176] [DEBUG] [MAIN ] CMS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:05.293958] [INFO ] [MAIN ] CMS: Generated 1326 derivative records from 38924 primary records. [2025-09-15T21:14:05.331362] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-15T21:14:05.347076] [DEBUG] [LOCAL ] CMSD: Loaded 5630 existing records from primary storage. [2025-09-15T21:14:05.390484] [INFO ] [MAIN ] CMSD: Loaded 5630 primary data records. [2025-09-15T21:14:05.420795] [DEBUG] [LOCAL ] CMS: Derivative data saved (1326 records). [2025-09-15T21:14:05.467479] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-15T21:14:05.480186] [INFO ] [MAIN ] Derivative Progress: 402/2083 symbols completed. CMS took 1.1s. Estimated remaining: 9m 19s. Rate: 180.4 symbols/min [2025-09-15T21:14:05.510102] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:05.945045] [DEBUG] [LOCAL ] CMTG: Loaded 26381 existing records from primary storage. [2025-09-15T21:14:05.945752] [INFO ] [MAIN ] CMTG: Loaded 26381 primary data records. [2025-09-15T21:14:06.085266] [DEBUG] [MAIN ] CMSC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:06.107524] [INFO ] [MAIN ] CMSC: Generated 1326 derivative records from 3425 primary records. [2025-09-15T21:14:06.130900] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-15T21:14:06.263386] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1326 records). [2025-09-15T21:14:06.266240] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-15T21:14:06.268771] [INFO ] [MAIN ] Derivative Progress: 403/2083 symbols completed. CMSC took 1.0s. Estimated remaining: 9m 21s. Rate: 179.7 symbols/min [2025-09-15T21:14:06.281449] [DEBUG] [MAIN ] CMSD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:06.282470] [INFO ] [MAIN ] CMSD: Generated 1326 derivative records from 5630 primary records. [2025-09-15T21:14:06.282909] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-15T21:14:06.297151] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1326 records). [2025-09-15T21:14:06.297319] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-15T21:14:06.299604] [INFO ] [MAIN ] Derivative Progress: 404/2083 symbols completed. CMSD took 1.1s. Estimated remaining: 9m 19s. Rate: 180.2 symbols/min [2025-09-15T21:14:06.313428] [DEBUG] [MAIN ] CMTG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:06.314098] [INFO ] [MAIN ] CMTG: Generated 1326 derivative records from 26381 primary records. [2025-09-15T21:14:06.314192] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-15T21:14:06.325927] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1326 records). [2025-09-15T21:14:06.325985] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-15T21:14:06.328273] [INFO ] [MAIN ] Derivative Progress: 405/2083 symbols completed. CMTG took 0.8s. Estimated remaining: 9m 18s. Rate: 180.6 symbols/min [2025-09-15T21:14:06.328938] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:06.329515] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:06.329668] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:06.336618] [DEBUG] [LOCAL ] CMU: Loaded 4387 existing records from primary storage. [2025-09-15T21:14:06.336895] [INFO ] [MAIN ] CMU: Loaded 4387 primary data records. [2025-09-15T21:14:06.641931] [DEBUG] [LOCAL ] CNA: Loaded 24485 existing records from primary storage. [2025-09-15T21:14:06.642362] [INFO ] [MAIN ] CNA: Loaded 24485 primary data records. [2025-09-15T21:14:06.643522] [DEBUG] [LOCAL ] CNC: Loaded 39748 existing records from primary storage. [2025-09-15T21:14:06.684243] [INFO ] [MAIN ] CNC: Loaded 39748 primary data records. [2025-09-15T21:14:07.235035] [DEBUG] [MAIN ] CMU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:07.236567] [INFO ] [MAIN ] CMU: Generated 1326 derivative records from 4387 primary records. [2025-09-15T21:14:07.238040] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-15T21:14:07.251613] [DEBUG] [LOCAL ] CMU: Derivative data saved (1326 records). [2025-09-15T21:14:07.252611] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-15T21:14:07.255377] [INFO ] [MAIN ] Derivative Progress: 406/2083 symbols completed. CMU took 0.9s. Estimated remaining: 9m 20s. Rate: 179.8 symbols/min [2025-09-15T21:14:07.257183] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:07.269813] [DEBUG] [LOCAL ] CNF: Loaded 8697 existing records from primary storage. [2025-09-15T21:14:07.271281] [INFO ] [MAIN ] CNF: Loaded 8697 primary data records. [2025-09-15T21:14:07.366930] [DEBUG] [MAIN ] CNC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:07.382894] [INFO ] [MAIN ] CNC: Generated 1326 derivative records from 39748 primary records. [2025-09-15T21:14:07.399728] [DEBUG] [MAIN ] CNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:07.401230] [INFO ] [MAIN ] CNA: Generated 1326 derivative records from 24485 primary records. [2025-09-15T21:14:07.399891] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-15T21:14:07.434634] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-15T21:14:07.578487] [DEBUG] [LOCAL ] CNC: Derivative data saved (1326 records). [2025-09-15T21:14:07.589950] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-15T21:14:07.592750] [INFO ] [MAIN ] Derivative Progress: 407/2083 symbols completed. CNC took 1.3s. Estimated remaining: 9m 19s. Rate: 179.8 symbols/min [2025-09-15T21:14:07.593957] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:07.597570] [DEBUG] [LOCAL ] CNA: Derivative data saved (1326 records). [2025-09-15T21:14:07.598276] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-15T21:14:07.601001] [INFO ] [MAIN ] Derivative Progress: 408/2083 symbols completed. CNA took 1.3s. Estimated remaining: 9m 18s. Rate: 180.2 symbols/min [2025-09-15T21:14:07.601513] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:07.619399] [DEBUG] [MAIN ] CNF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:07.620229] [INFO ] [MAIN ] CNF: Generated 1326 derivative records from 8697 primary records. [2025-09-15T21:14:07.620294] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-15T21:14:07.641838] [DEBUG] [LOCAL ] CNF: Derivative data saved (1326 records). [2025-09-15T21:14:07.642056] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-15T21:14:07.644177] [INFO ] [MAIN ] Derivative Progress: 409/2083 symbols completed. CNF took 0.4s. Estimated remaining: 9m 16s. Rate: 180.6 symbols/min [2025-09-15T21:14:07.652120] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:07.668728] [DEBUG] [LOCAL ] CNH: Loaded 39528 existing records from primary storage. [2025-09-15T21:14:07.679834] [INFO ] [MAIN ] CNH: Loaded 39528 primary data records. [2025-09-15T21:14:07.692121] [DEBUG] [LOCAL ] CNI: Loaded 38141 existing records from primary storage. [2025-09-15T21:14:07.737033] [INFO ] [MAIN ] CNI: Loaded 38141 primary data records. [2025-09-15T21:14:07.993617] [DEBUG] [LOCAL ] CNK: Loaded 38995 existing records from primary storage. [2025-09-15T21:14:08.014585] [INFO ] [MAIN ] CNK: Loaded 38995 primary data records. [2025-09-15T21:14:08.577128] [DEBUG] [MAIN ] CNH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:08.578607] [INFO ] [MAIN ] CNH: Generated 1326 derivative records from 39528 primary records. [2025-09-15T21:14:08.578801] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-15T21:14:08.599690] [DEBUG] [LOCAL ] CNH: Derivative data saved (1326 records). [2025-09-15T21:14:08.603585] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-15T21:14:08.605393] [INFO ] [MAIN ] Derivative Progress: 410/2083 symbols completed. CNH took 1.0s. Estimated remaining: 9m 18s. Rate: 179.7 symbols/min [2025-09-15T21:14:08.605792] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:08.606249] [DEBUG] [MAIN ] CNI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:08.607849] [INFO ] [MAIN ] CNI: Generated 1326 derivative records from 38141 primary records. [2025-09-15T21:14:08.608206] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-15T21:14:08.631499] [DEBUG] [MAIN ] CNK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:08.633107] [DEBUG] [LOCAL ] CNI: Derivative data saved (1326 records). [2025-09-15T21:14:08.633173] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-15T21:14:08.632715] [INFO ] [MAIN ] CNK: Generated 1326 derivative records from 38995 primary records. [2025-09-15T21:14:08.635830] [INFO ] [MAIN ] Derivative Progress: 411/2083 symbols completed. CNI took 1.0s. Estimated remaining: 9m 17s. Rate: 180.1 symbols/min [2025-09-15T21:14:08.636181] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-15T21:14:08.636899] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:08.659265] [DEBUG] [LOCAL ] CNK: Derivative data saved (1326 records). [2025-09-15T21:14:08.659493] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-15T21:14:08.662058] [INFO ] [MAIN ] Derivative Progress: 412/2083 symbols completed. CNK took 1.0s. Estimated remaining: 9m 15s. Rate: 180.6 symbols/min [2025-09-15T21:14:08.662551] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:08.676447] [DEBUG] [LOCAL ] CNM: Loaded 37287 existing records from primary storage. [2025-09-15T21:14:08.681229] [INFO ] [MAIN ] CNM: Loaded 37287 primary data records. [2025-09-15T21:14:08.805913] [DEBUG] [LOCAL ] CNMD: Loaded 23436 existing records from primary storage. [2025-09-15T21:14:08.850633] [INFO ] [MAIN ] CNMD: Loaded 23436 primary data records. [2025-09-15T21:14:08.878383] [DEBUG] [LOCAL ] CNNE: Loaded 26310 existing records from primary storage. [2025-09-15T21:14:08.955881] [INFO ] [MAIN ] CNNE: Loaded 26310 primary data records. [2025-09-15T21:14:09.530985] [DEBUG] [MAIN ] CNM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:09.532054] [INFO ] [MAIN ] CNM: Generated 1326 derivative records from 37287 primary records. [2025-09-15T21:14:09.532699] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-15T21:14:09.546946] [DEBUG] [LOCAL ] CNM: Derivative data saved (1326 records). [2025-09-15T21:14:09.547482] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-15T21:14:09.549856] [INFO ] [MAIN ] Derivative Progress: 413/2083 symbols completed. CNM took 0.9s. Estimated remaining: 9m 17s. Rate: 179.8 symbols/min [2025-09-15T21:14:09.550181] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:09.564851] [DEBUG] [MAIN ] CNMD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:09.565928] [INFO ] [MAIN ] CNMD: Generated 1326 derivative records from 23436 primary records. [2025-09-15T21:14:09.566843] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-15T21:14:09.591064] [DEBUG] [MAIN ] CNNE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:09.591592] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1326 records). [2025-09-15T21:14:09.592400] [INFO ] [MAIN ] CNNE: Generated 1326 derivative records from 26310 primary records. [2025-09-15T21:14:09.592478] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-15T21:14:09.594918] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-15T21:14:09.594832] [INFO ] [MAIN ] Derivative Progress: 414/2083 symbols completed. CNMD took 1.0s. Estimated remaining: 9m 16s. Rate: 180.2 symbols/min [2025-09-15T21:14:09.603502] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:09.626616] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1326 records). [2025-09-15T21:14:09.627364] [DEBUG] [LOCAL ] CNO: Loaded 29693 existing records from primary storage. [2025-09-15T21:14:09.626836] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-15T21:14:09.630061] [INFO ] [MAIN ] Derivative Progress: 415/2083 symbols completed. CNNE took 1.0s. Estimated remaining: 9m 14s. Rate: 180.6 symbols/min [2025-09-15T21:14:09.627569] [INFO ] [MAIN ] CNO: Loaded 29693 primary data records. [2025-09-15T21:14:09.630530] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:09.928232] [DEBUG] [LOCAL ] CNP: Loaded 39456 existing records from primary storage. [2025-09-15T21:14:09.928505] [INFO ] [MAIN ] CNP: Loaded 39456 primary data records. [2025-09-15T21:14:10.045936] [DEBUG] [LOCAL ] CNQ: Loaded 39551 existing records from primary storage. [2025-09-15T21:14:10.046556] [INFO ] [MAIN ] CNQ: Loaded 39551 primary data records. [2025-09-15T21:14:10.521089] [DEBUG] [MAIN ] CNO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:10.522147] [INFO ] [MAIN ] CNO: Generated 1326 derivative records from 29693 primary records. [2025-09-15T21:14:10.522947] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-15T21:14:10.536661] [DEBUG] [LOCAL ] CNO: Derivative data saved (1326 records). [2025-09-15T21:14:10.537253] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-15T21:14:10.539209] [INFO ] [MAIN ] Derivative Progress: 416/2083 symbols completed. CNO took 1.0s. Estimated remaining: 9m 16s. Rate: 179.8 symbols/min [2025-09-15T21:14:10.539416] [INFO ] [MAIN ] CNR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:10.553617] [DEBUG] [MAIN ] CNP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:10.554343] [INFO ] [MAIN ] CNP: Generated 1326 derivative records from 39456 primary records. [2025-09-15T21:14:10.554446] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-15T21:14:10.567404] [DEBUG] [LOCAL ] CNP: Derivative data saved (1326 records). [2025-09-15T21:14:10.568450] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-15T21:14:10.570745] [INFO ] [MAIN ] Derivative Progress: 417/2083 symbols completed. CNP took 1.0s. Estimated remaining: 9m 15s. Rate: 180.2 symbols/min [2025-09-15T21:14:10.572695] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:10.583319] [DEBUG] [MAIN ] CNQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:10.592254] [INFO ] [MAIN ] CNQ: Generated 1326 derivative records from 39551 primary records. [2025-09-15T21:14:10.592455] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-15T21:14:10.608277] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1326 records). [2025-09-15T21:14:10.616766] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-15T21:14:10.620734] [INFO ] [MAIN ] Derivative Progress: 418/2083 symbols completed. CNQ took 1.0s. Estimated remaining: 9m 13s. Rate: 180.6 symbols/min [2025-09-15T21:14:10.627025] [DEBUG] [LOCAL ] CNS: Loaded 14550 existing records from primary storage. [2025-09-15T21:14:10.621831] [DEBUG] [LOCAL ] CNR: Loaded 32097 existing records from primary storage. [2025-09-15T21:14:10.627256] [INFO ] [MAIN ] CNR: Loaded 32097 primary data records. [2025-09-15T21:14:10.627298] [INFO ] [MAIN ] CNS: Loaded 14550 primary data records. [2025-09-15T21:14:11.153365] [DEBUG] [MAIN ] CNS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:11.154093] [INFO ] [MAIN ] CNS: Generated 1326 derivative records from 14550 primary records. [2025-09-15T21:14:11.154278] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-15T21:14:11.163412] [DEBUG] [MAIN ] CNR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:11.164292] [INFO ] [MAIN ] CNR: Generated 1326 derivative records from 32097 primary records. [2025-09-15T21:14:11.164524] [DEBUG] [LOCAL ] CNR: Saving derivative data. [2025-09-15T21:14:11.185562] [DEBUG] [LOCAL ] CNS: Derivative data saved (1326 records). [2025-09-15T21:14:11.186170] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-15T21:14:11.188166] [INFO ] [MAIN ] Derivative Progress: 419/2083 symbols completed. CNS took 0.6s. Estimated remaining: 9m 14s. Rate: 180.3 symbols/min [2025-09-15T21:14:11.188518] [DEBUG] [LOCAL ] CNR: Derivative data saved (1326 records). [2025-09-15T21:14:11.188626] [INFO ] [MAIN ] CNR: Successfully saved derivative data. [2025-09-15T21:14:11.190628] [INFO ] [MAIN ] Derivative Progress: 420/2083 symbols completed. CNR took 0.7s. Estimated remaining: 9m 12s. Rate: 180.7 symbols/min [2025-09-15T21:14:11.191239] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:11.191160] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:11.191946] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:11.235601] [DEBUG] [LOCAL ] CODI: Loaded 31124 existing records from primary storage. [2025-09-15T21:14:11.243201] [INFO ] [MAIN ] CODI: Loaded 31124 primary data records. [2025-09-15T21:14:11.374897] [DEBUG] [LOCAL ] COF: Loaded 39597 existing records from primary storage. [2025-09-15T21:14:11.377128] [INFO ] [MAIN ] COF: Loaded 39597 primary data records. [2025-09-15T21:14:11.376988] [DEBUG] [LOCAL ] CNX: Loaded 37796 existing records from primary storage. [2025-09-15T21:14:11.423890] [INFO ] [MAIN ] CNX: Loaded 37796 primary data records. [2025-09-15T21:14:12.098112] [DEBUG] [MAIN ] CODI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:12.099569] [INFO ] [MAIN ] CODI: Generated 1326 derivative records from 31124 primary records. [2025-09-15T21:14:12.099880] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-15T21:14:12.115661] [DEBUG] [MAIN ] COF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:12.121368] [INFO ] [MAIN ] COF: Generated 1326 derivative records from 39597 primary records. [2025-09-15T21:14:12.122090] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-15T21:14:12.124105] [DEBUG] [LOCAL ] CODI: Derivative data saved (1326 records). [2025-09-15T21:14:12.125100] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-15T21:14:12.127216] [INFO ] [MAIN ] Derivative Progress: 421/2083 symbols completed. CODI took 0.9s. Estimated remaining: 9m 14s. Rate: 179.9 symbols/min [2025-09-15T21:14:12.127480] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:12.147044] [DEBUG] [MAIN ] CNX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:12.149290] [INFO ] [MAIN ] CNX: Generated 1326 derivative records from 37796 primary records. [2025-09-15T21:14:12.150511] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-15T21:14:12.151831] [DEBUG] [LOCAL ] COF: Derivative data saved (1326 records). [2025-09-15T21:14:12.152105] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-15T21:14:12.160416] [INFO ] [MAIN ] Derivative Progress: 422/2083 symbols completed. COF took 1.0s. Estimated remaining: 9m 13s. Rate: 180.3 symbols/min [2025-09-15T21:14:12.163528] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:12.166145] [DEBUG] [LOCAL ] CNX: Derivative data saved (1326 records). [2025-09-15T21:14:12.166301] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-15T21:14:12.168472] [INFO ] [MAIN ] Derivative Progress: 423/2083 symbols completed. CNX took 1.0s. Estimated remaining: 9m 11s. Rate: 180.7 symbols/min [2025-09-15T21:14:12.169351] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:12.222975] [DEBUG] [LOCAL ] COHR: Loaded 39393 existing records from primary storage. [2025-09-15T21:14:12.223302] [INFO ] [MAIN ] COHR: Loaded 39393 primary data records. [2025-09-15T21:14:12.424816] [DEBUG] [LOCAL ] COMP: Loaded 39382 existing records from primary storage. [2025-09-15T21:14:12.427254] [DEBUG] [LOCAL ] COLD: Loaded 38617 existing records from primary storage. [2025-09-15T21:14:12.427358] [INFO ] [MAIN ] COMP: Loaded 39382 primary data records. [2025-09-15T21:14:12.427456] [INFO ] [MAIN ] COLD: Loaded 38617 primary data records. [2025-09-15T21:14:13.164299] [DEBUG] [MAIN ] COHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:13.165666] [INFO ] [MAIN ] COHR: Generated 1326 derivative records from 39393 primary records. [2025-09-15T21:14:13.165911] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-15T21:14:13.179514] [DEBUG] [LOCAL ] COHR: Derivative data saved (1326 records). [2025-09-15T21:14:13.180239] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-15T21:14:13.181928] [INFO ] [MAIN ] Derivative Progress: 424/2083 symbols completed. COHR took 1.1s. Estimated remaining: 9m 13s. Rate: 179.9 symbols/min [2025-09-15T21:14:13.184020] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:13.200367] [DEBUG] [MAIN ] COMP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:13.211164] [INFO ] [MAIN ] COMP: Generated 1326 derivative records from 39382 primary records. [2025-09-15T21:14:13.211556] [DEBUG] [MAIN ] COLD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:13.211721] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-15T21:14:13.212536] [INFO ] [MAIN ] COLD: Generated 1326 derivative records from 38617 primary records. [2025-09-15T21:14:13.212713] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-15T21:14:13.234754] [DEBUG] [LOCAL ] COLD: Derivative data saved (1326 records). [2025-09-15T21:14:13.235118] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-15T21:14:13.237432] [INFO ] [MAIN ] Derivative Progress: 425/2083 symbols completed. COLD took 1.1s. Estimated remaining: 9m 12s. Rate: 180.2 symbols/min [2025-09-15T21:14:13.237661] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:13.249260] [DEBUG] [LOCAL ] COMP: Derivative data saved (1326 records). [2025-09-15T21:14:13.249341] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-15T21:14:13.251333] [INFO ] [MAIN ] Derivative Progress: 426/2083 symbols completed. COMP took 1.1s. Estimated remaining: 9m 10s. Rate: 180.6 symbols/min [2025-09-15T21:14:13.251634] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:13.267912] [DEBUG] [LOCAL ] CON: Loaded 28443 existing records from primary storage. [2025-09-15T21:14:13.268139] [INFO ] [MAIN ] CON: Loaded 28443 primary data records. [2025-09-15T21:14:13.374655] [DEBUG] [LOCAL ] COOK: Loaded 18462 existing records from primary storage. [2025-09-15T21:14:13.390777] [INFO ] [MAIN ] COOK: Loaded 18462 primary data records. [2025-09-15T21:14:13.615046] [DEBUG] [LOCAL ] COP: Loaded 39687 existing records from primary storage. [2025-09-15T21:14:13.717047] [INFO ] [MAIN ] COP: Loaded 39687 primary data records. [2025-09-15T21:14:14.165611] [DEBUG] [MAIN ] CON: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:14.176672] [INFO ] [MAIN ] CON: Generated 1326 derivative records from 28443 primary records. [2025-09-15T21:14:14.177131] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-15T21:14:14.177031] [DEBUG] [MAIN ] COOK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:14.178931] [INFO ] [MAIN ] COOK: Generated 1326 derivative records from 18462 primary records. [2025-09-15T21:14:14.179606] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-15T21:14:14.205807] [DEBUG] [LOCAL ] COOK: Derivative data saved (1326 records). [2025-09-15T21:14:14.206925] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-15T21:14:14.210280] [INFO ] [MAIN ] Derivative Progress: 427/2083 symbols completed. COOK took 1.0s. Estimated remaining: 9m 12s. Rate: 179.8 symbols/min [2025-09-15T21:14:14.207039] [DEBUG] [LOCAL ] CON: Derivative data saved (1326 records). [2025-09-15T21:14:14.210465] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-15T21:14:14.210725] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:14.214443] [INFO ] [MAIN ] Derivative Progress: 428/2083 symbols completed. CON took 1.0s. Estimated remaining: 9m 11s. Rate: 180.3 symbols/min [2025-09-15T21:14:14.215133] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:14.225924] [DEBUG] [MAIN ] COP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:14.226883] [INFO ] [MAIN ] COP: Generated 1326 derivative records from 39687 primary records. [2025-09-15T21:14:14.227114] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-15T21:14:14.240033] [DEBUG] [LOCAL ] COP: Derivative data saved (1326 records). [2025-09-15T21:14:14.240153] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-15T21:14:14.242455] [INFO ] [MAIN ] Derivative Progress: 429/2083 symbols completed. COP took 1.0s. Estimated remaining: 9m 9s. Rate: 180.6 symbols/min [2025-09-15T21:14:14.242882] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:14.284402] [DEBUG] [LOCAL ] COTY: Loaded 39335 existing records from primary storage. [2025-09-15T21:14:14.284556] [INFO ] [MAIN ] COTY: Loaded 39335 primary data records. [2025-09-15T21:14:14.410464] [DEBUG] [LOCAL ] COUR: Loaded 36333 existing records from primary storage. [2025-09-15T21:14:14.410927] [INFO ] [MAIN ] COUR: Loaded 36333 primary data records. [2025-09-15T21:14:14.591910] [DEBUG] [LOCAL ] CP: Loaded 39276 existing records from primary storage. [2025-09-15T21:14:14.694050] [INFO ] [MAIN ] CP: Loaded 39276 primary data records. [2025-09-15T21:14:15.245738] [DEBUG] [MAIN ] COTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:15.247234] [INFO ] [MAIN ] COTY: Generated 1326 derivative records from 39335 primary records. [2025-09-15T21:14:15.247514] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-15T21:14:15.261207] [DEBUG] [LOCAL ] COTY: Derivative data saved (1326 records). [2025-09-15T21:14:15.261727] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-15T21:14:15.267515] [INFO ] [MAIN ] Derivative Progress: 430/2083 symbols completed. COTY took 1.1s. Estimated remaining: 9m 12s. Rate: 179.8 symbols/min [2025-09-15T21:14:15.268185] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:15.282178] [DEBUG] [MAIN ] COUR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:15.283748] [INFO ] [MAIN ] COUR: Generated 1326 derivative records from 36333 primary records. [2025-09-15T21:14:15.283942] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-15T21:14:15.309227] [DEBUG] [MAIN ] CP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:15.310758] [INFO ] [MAIN ] CP: Generated 1326 derivative records from 39276 primary records. [2025-09-15T21:14:15.311152] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-15T21:14:15.324871] [DEBUG] [LOCAL ] COUR: Derivative data saved (1326 records). [2025-09-15T21:14:15.328720] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-15T21:14:15.334526] [INFO ] [MAIN ] Derivative Progress: 431/2083 symbols completed. COUR took 1.1s. Estimated remaining: 9m 10s. Rate: 180.1 symbols/min [2025-09-15T21:14:15.335843] [DEBUG] [LOCAL ] CP: Derivative data saved (1326 records). [2025-09-15T21:14:15.342498] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:15.344417] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-15T21:14:15.347210] [INFO ] [MAIN ] Derivative Progress: 432/2083 symbols completed. CP took 1.1s. Estimated remaining: 9m 9s. Rate: 180.5 symbols/min [2025-09-15T21:14:15.348230] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:15.348028] [DEBUG] [LOCAL ] CPA: Loaded 21144 existing records from primary storage. [2025-09-15T21:14:15.348428] [INFO ] [MAIN ] CPA: Loaded 21144 primary data records. [2025-09-15T21:14:15.467448] [DEBUG] [LOCAL ] CPF: Loaded 10798 existing records from primary storage. [2025-09-15T21:14:15.488336] [INFO ] [MAIN ] CPF: Loaded 10798 primary data records. [2025-09-15T21:14:15.743972] [DEBUG] [LOCAL ] CPAY: Loaded 22320 existing records from primary storage. [2025-09-15T21:14:15.744399] [INFO ] [MAIN ] CPAY: Loaded 22320 primary data records. [2025-09-15T21:14:16.196634] [DEBUG] [MAIN ] CPA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:16.198541] [INFO ] [MAIN ] CPA: Generated 1326 derivative records from 21144 primary records. [2025-09-15T21:14:16.198751] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-15T21:14:16.213425] [DEBUG] [LOCAL ] CPA: Derivative data saved (1326 records). [2025-09-15T21:14:16.214487] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-15T21:14:16.216359] [INFO ] [MAIN ] Derivative Progress: 433/2083 symbols completed. CPA took 0.9s. Estimated remaining: 9m 11s. Rate: 179.8 symbols/min [2025-09-15T21:14:16.228593] [DEBUG] [MAIN ] CPF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:16.229735] [INFO ] [MAIN ] CPF: Generated 1326 derivative records from 10798 primary records. [2025-09-15T21:14:16.229925] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-15T21:14:16.243084] [DEBUG] [LOCAL ] CPF: Derivative data saved (1326 records). [2025-09-15T21:14:16.243220] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-15T21:14:16.245483] [INFO ] [MAIN ] Derivative Progress: 434/2083 symbols completed. CPF took 0.9s. Estimated remaining: 9m 9s. Rate: 180.2 symbols/min [2025-09-15T21:14:16.257463] [DEBUG] [MAIN ] CPAY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:16.258030] [INFO ] [MAIN ] CPAY: Generated 1326 derivative records from 22320 primary records. [2025-09-15T21:14:16.258091] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-15T21:14:16.271024] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1326 records). [2025-09-15T21:14:16.271091] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-15T21:14:16.273274] [INFO ] [MAIN ] Derivative Progress: 435/2083 symbols completed. CPAY took 0.9s. Estimated remaining: 9m 8s. Rate: 180.6 symbols/min [2025-09-15T21:14:16.273786] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:16.273905] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:16.274263] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:16.286972] [DEBUG] [LOCAL ] CPK: Loaded 9139 existing records from primary storage. [2025-09-15T21:14:16.287181] [INFO ] [MAIN ] CPK: Loaded 9139 primary data records. [2025-09-15T21:14:16.598267] [DEBUG] [LOCAL ] CPRI: Loaded 38730 existing records from primary storage. [2025-09-15T21:14:16.599004] [INFO ] [MAIN ] CPRI: Loaded 38730 primary data records. [2025-09-15T21:14:16.611473] [DEBUG] [LOCAL ] CPNG: Loaded 39648 existing records from primary storage. [2025-09-15T21:14:16.631681] [INFO ] [MAIN ] CPNG: Loaded 39648 primary data records. [2025-09-15T21:14:17.227477] [DEBUG] [MAIN ] CPK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:17.228781] [INFO ] [MAIN ] CPK: Generated 1326 derivative records from 9139 primary records. [2025-09-15T21:14:17.229109] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-15T21:14:17.244012] [DEBUG] [LOCAL ] CPK: Derivative data saved (1326 records). [2025-09-15T21:14:17.244982] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-15T21:14:17.247069] [INFO ] [MAIN ] Derivative Progress: 436/2083 symbols completed. CPK took 1.0s. Estimated remaining: 9m 10s. Rate: 179.8 symbols/min [2025-09-15T21:14:17.248064] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:17.259502] [DEBUG] [MAIN ] CPRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:17.260249] [INFO ] [MAIN ] CPRI: Generated 1326 derivative records from 38730 primary records. [2025-09-15T21:14:17.260452] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-15T21:14:17.279406] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1326 records). [2025-09-15T21:14:17.279660] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-15T21:14:17.281927] [INFO ] [MAIN ] Derivative Progress: 437/2083 symbols completed. CPRI took 1.0s. Estimated remaining: 9m 8s. Rate: 180.2 symbols/min [2025-09-15T21:14:17.288596] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:17.300294] [DEBUG] [MAIN ] CPNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:17.303078] [INFO ] [MAIN ] CPNG: Generated 1326 derivative records from 39648 primary records. [2025-09-15T21:14:17.303235] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-15T21:14:17.302028] [DEBUG] [LOCAL ] CPS: Loaded 18514 existing records from primary storage. [2025-09-15T21:14:17.304460] [INFO ] [MAIN ] CPS: Loaded 18514 primary data records. [2025-09-15T21:14:17.432041] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1326 records). [2025-09-15T21:14:17.448239] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-15T21:14:17.506907] [INFO ] [MAIN ] Derivative Progress: 438/2083 symbols completed. CPNG took 1.2s. Estimated remaining: 9m 7s. Rate: 180.3 symbols/min [2025-09-15T21:14:17.511802] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:17.606573] [DEBUG] [LOCAL ] CPT: Loaded 32473 existing records from primary storage. [2025-09-15T21:14:17.606808] [INFO ] [MAIN ] CPT: Loaded 32473 primary data records. [2025-09-15T21:14:17.730696] [DEBUG] [LOCAL ] CQP: Loaded 14914 existing records from primary storage. [2025-09-15T21:14:17.730919] [INFO ] [MAIN ] CQP: Loaded 14914 primary data records. [2025-09-15T21:14:18.219076] [DEBUG] [MAIN ] CPS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:18.222667] [INFO ] [MAIN ] CPS: Generated 1326 derivative records from 18514 primary records. [2025-09-15T21:14:18.223128] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-15T21:14:18.237217] [DEBUG] [LOCAL ] CPS: Derivative data saved (1326 records). [2025-09-15T21:14:18.238771] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-15T21:14:18.241579] [INFO ] [MAIN ] Derivative Progress: 439/2083 symbols completed. CPS took 1.0s. Estimated remaining: 9m 9s. Rate: 179.8 symbols/min [2025-09-15T21:14:18.241877] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:18.258793] [DEBUG] [MAIN ] CPT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:18.261478] [INFO ] [MAIN ] CPT: Generated 1326 derivative records from 32473 primary records. [2025-09-15T21:14:18.267238] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-15T21:14:18.284171] [DEBUG] [MAIN ] CQP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:18.289003] [INFO ] [MAIN ] CQP: Generated 1326 derivative records from 14914 primary records. [2025-09-15T21:14:18.290757] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-15T21:14:18.298465] [DEBUG] [LOCAL ] CPT: Derivative data saved (1326 records). [2025-09-15T21:14:18.298996] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-15T21:14:18.299708] [DEBUG] [LOCAL ] CR: Loaded 17772 existing records from primary storage. [2025-09-15T21:14:18.302652] [INFO ] [MAIN ] Derivative Progress: 440/2083 symbols completed. CPT took 1.0s. Estimated remaining: 9m 7s. Rate: 180.1 symbols/min [2025-09-15T21:14:18.308140] [INFO ] [MAIN ] CR: Loaded 17772 primary data records. [2025-09-15T21:14:18.313593] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:18.335921] [DEBUG] [LOCAL ] CQP: Derivative data saved (1326 records). [2025-09-15T21:14:18.381308] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-15T21:14:18.400400] [INFO ] [MAIN ] Derivative Progress: 441/2083 symbols completed. CQP took 0.9s. Estimated remaining: 9m 6s. Rate: 180.4 symbols/min [2025-09-15T21:14:18.426970] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:18.423232] [DEBUG] [LOCAL ] CRBD: Loaded 6872 existing records from primary storage. [2025-09-15T21:14:18.427719] [INFO ] [MAIN ] CRBD: Loaded 6872 primary data records. [2025-09-15T21:14:18.901231] [DEBUG] [LOCAL ] CRBG: Loaded 38714 existing records from primary storage. [2025-09-15T21:14:18.901501] [INFO ] [MAIN ] CRBG: Loaded 38714 primary data records. [2025-09-15T21:14:19.189307] [DEBUG] [MAIN ] CR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:19.190748] [INFO ] [MAIN ] CR: Generated 1326 derivative records from 17772 primary records. [2025-09-15T21:14:19.191432] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-15T21:14:19.217116] [DEBUG] [LOCAL ] CR: Derivative data saved (1326 records). [2025-09-15T21:14:19.217568] [DEBUG] [MAIN ] CRBD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:19.217626] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-15T21:14:19.219205] [INFO ] [MAIN ] Derivative Progress: 442/2083 symbols completed. CR took 1.0s. Estimated remaining: 9m 8s. Rate: 179.8 symbols/min [2025-09-15T21:14:19.219929] [INFO ] [MAIN ] CRBD: Generated 1326 derivative records from 6872 primary records. [2025-09-15T21:14:19.220206] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-15T21:14:19.220581] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:19.233916] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1326 records). [2025-09-15T21:14:19.234209] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-15T21:14:19.236479] [INFO ] [MAIN ] Derivative Progress: 443/2083 symbols completed. CRBD took 0.9s. Estimated remaining: 9m 6s. Rate: 180.2 symbols/min [2025-09-15T21:14:19.236705] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:19.250349] [DEBUG] [MAIN ] CRBG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:19.251169] [INFO ] [MAIN ] CRBG: Generated 1326 derivative records from 38714 primary records. [2025-09-15T21:14:19.251298] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-15T21:14:19.274251] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1326 records). [2025-09-15T21:14:19.274522] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-15T21:14:19.276344] [INFO ] [MAIN ] Derivative Progress: 444/2083 symbols completed. CRBG took 0.8s. Estimated remaining: 9m 5s. Rate: 180.6 symbols/min [2025-09-15T21:14:19.276678] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:19.297808] [DEBUG] [LOCAL ] CRC: Loaded 32513 existing records from primary storage. [2025-09-15T21:14:19.297999] [INFO ] [MAIN ] CRC: Loaded 32513 primary data records. [2025-09-15T21:14:19.412626] [DEBUG] [LOCAL ] CRGY: Loaded 38598 existing records from primary storage. [2025-09-15T21:14:19.412862] [INFO ] [MAIN ] CRGY: Loaded 38598 primary data records. [2025-09-15T21:14:19.748034] [DEBUG] [LOCAL ] CRH: Loaded 39445 existing records from primary storage. [2025-09-15T21:14:19.764035] [INFO ] [MAIN ] CRH: Loaded 39445 primary data records. [2025-09-15T21:14:20.221763] [DEBUG] [MAIN ] CRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:20.223747] [INFO ] [MAIN ] CRC: Generated 1326 derivative records from 32513 primary records. [2025-09-15T21:14:20.224699] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-15T21:14:20.247554] [DEBUG] [MAIN ] CRGY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:20.249790] [INFO ] [MAIN ] CRGY: Generated 1326 derivative records from 38598 primary records. [2025-09-15T21:14:20.250320] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-15T21:14:20.253195] [DEBUG] [LOCAL ] CRC: Derivative data saved (1326 records). [2025-09-15T21:14:20.258835] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-15T21:14:20.260513] [INFO ] [MAIN ] Derivative Progress: 445/2083 symbols completed. CRC took 1.0s. Estimated remaining: 9m 7s. Rate: 179.8 symbols/min [2025-09-15T21:14:20.264046] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:20.270547] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1326 records). [2025-09-15T21:14:20.270838] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-15T21:14:20.273431] [INFO ] [MAIN ] Derivative Progress: 446/2083 symbols completed. CRGY took 1.0s. Estimated remaining: 9m 5s. Rate: 180.2 symbols/min [2025-09-15T21:14:20.273822] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:20.284493] [DEBUG] [MAIN ] CRH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:20.285225] [INFO ] [MAIN ] CRH: Generated 1326 derivative records from 39445 primary records. [2025-09-15T21:14:20.285333] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-15T21:14:20.298786] [DEBUG] [LOCAL ] CRH: Derivative data saved (1326 records). [2025-09-15T21:14:20.299004] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-15T21:14:20.301103] [INFO ] [MAIN ] Derivative Progress: 447/2083 symbols completed. CRH took 1.0s. Estimated remaining: 9m 4s. Rate: 180.5 symbols/min [2025-09-15T21:14:20.301499] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:20.330496] [DEBUG] [LOCAL ] CRI: Loaded 36947 existing records from primary storage. [2025-09-15T21:14:20.330770] [INFO ] [MAIN ] CRI: Loaded 36947 primary data records. [2025-09-15T21:14:20.477431] [DEBUG] [LOCAL ] CRK: Loaded 38364 existing records from primary storage. [2025-09-15T21:14:20.498522] [INFO ] [MAIN ] CRK: Loaded 38364 primary data records. [2025-09-15T21:14:20.595541] [DEBUG] [LOCAL ] CRM: Loaded 39730 existing records from primary storage. [2025-09-15T21:14:20.621183] [INFO ] [MAIN ] CRM: Loaded 39730 primary data records. [2025-09-15T21:14:21.211328] [DEBUG] [MAIN ] CRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:21.212289] [INFO ] [MAIN ] CRI: Generated 1326 derivative records from 36947 primary records. [2025-09-15T21:14:21.212715] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-15T21:14:21.238081] [DEBUG] [MAIN ] CRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:21.240116] [DEBUG] [LOCAL ] CRI: Derivative data saved (1326 records). [2025-09-15T21:14:21.239911] [INFO ] [MAIN ] CRK: Generated 1326 derivative records from 38364 primary records. [2025-09-15T21:14:21.240510] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-15T21:14:21.240469] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-15T21:14:21.242549] [INFO ] [MAIN ] Derivative Progress: 448/2083 symbols completed. CRI took 1.0s. Estimated remaining: 9m 6s. Rate: 179.8 symbols/min [2025-09-15T21:14:21.258843] [DEBUG] [LOCAL ] CRK: Derivative data saved (1326 records). [2025-09-15T21:14:21.259015] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-15T21:14:21.270284] [INFO ] [MAIN ] Derivative Progress: 449/2083 symbols completed. CRK took 1.0s. Estimated remaining: 9m 4s. Rate: 180.2 symbols/min [2025-09-15T21:14:21.270886] [DEBUG] [MAIN ] CRM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:21.271457] [INFO ] [MAIN ] CRM: Generated 1326 derivative records from 39730 primary records. [2025-09-15T21:14:21.271522] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-15T21:14:21.283392] [DEBUG] [LOCAL ] CRM: Derivative data saved (1326 records). [2025-09-15T21:14:21.283450] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-15T21:14:21.285350] [INFO ] [MAIN ] Derivative Progress: 450/2083 symbols completed. CRM took 1.0s. Estimated remaining: 9m 3s. Rate: 180.6 symbols/min [2025-09-15T21:14:21.286195] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:21.286293] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:21.286130] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:21.294254] [DEBUG] [LOCAL ] CRT: Loaded 3442 existing records from primary storage. [2025-09-15T21:14:21.294440] [INFO ] [MAIN ] CRT: Loaded 3442 primary data records. [2025-09-15T21:14:21.601624] [DEBUG] [LOCAL ] CRS: Loaded 32032 existing records from primary storage. [2025-09-15T21:14:21.602082] [INFO ] [MAIN ] CRS: Loaded 32032 primary data records. [2025-09-15T21:14:21.600572] [DEBUG] [LOCAL ] CSAN: Loaded 31174 existing records from primary storage. [2025-09-15T21:14:21.613739] [INFO ] [MAIN ] CSAN: Loaded 31174 primary data records. [2025-09-15T21:14:22.202137] [DEBUG] [MAIN ] CRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:22.203356] [INFO ] [MAIN ] CRT: Generated 1326 derivative records from 3442 primary records. [2025-09-15T21:14:22.203802] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-15T21:14:22.217129] [DEBUG] [LOCAL ] CRT: Derivative data saved (1326 records). [2025-09-15T21:14:22.217549] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-15T21:14:22.219733] [INFO ] [MAIN ] Derivative Progress: 451/2083 symbols completed. CRT took 0.9s. Estimated remaining: 9m 5s. Rate: 179.8 symbols/min [2025-09-15T21:14:22.220353] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:22.235693] [DEBUG] [MAIN ] CSAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:22.237665] [INFO ] [MAIN ] CSAN: Generated 1326 derivative records from 31174 primary records. [2025-09-15T21:14:22.237926] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-15T21:14:22.254261] [DEBUG] [MAIN ] CRS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:22.265232] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1326 records). [2025-09-15T21:14:22.263727] [INFO ] [MAIN ] CRS: Generated 1326 derivative records from 32032 primary records. [2025-09-15T21:14:22.265409] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-15T21:14:22.265467] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-15T21:14:22.268275] [INFO ] [MAIN ] Derivative Progress: 452/2083 symbols completed. CSAN took 1.0s. Estimated remaining: 9m 3s. Rate: 180.2 symbols/min [2025-09-15T21:14:22.274674] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:22.289545] [DEBUG] [LOCAL ] CSL: Loaded 22192 existing records from primary storage. [2025-09-15T21:14:22.290169] [INFO ] [MAIN ] CSL: Loaded 22192 primary data records. [2025-09-15T21:14:22.323772] [DEBUG] [LOCAL ] CRS: Derivative data saved (1326 records). [2025-09-15T21:14:22.364671] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-15T21:14:22.378096] [INFO ] [MAIN ] Derivative Progress: 453/2083 symbols completed. CRS took 1.1s. Estimated remaining: 9m 2s. Rate: 180.4 symbols/min [2025-09-15T21:14:22.389840] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:22.407064] [DEBUG] [LOCAL ] CSR: Loaded 9476 existing records from primary storage. [2025-09-15T21:14:22.418378] [INFO ] [MAIN ] CSR: Loaded 9476 primary data records. [2025-09-15T21:14:22.778196] [DEBUG] [LOCAL ] CSTM: Loaded 34900 existing records from primary storage. [2025-09-15T21:14:22.864248] [INFO ] [MAIN ] CSTM: Loaded 34900 primary data records. [2025-09-15T21:14:23.163619] [DEBUG] [MAIN ] CSR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:23.163918] [DEBUG] [MAIN ] CSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:23.164703] [INFO ] [MAIN ] CSL: Generated 1326 derivative records from 22192 primary records. [2025-09-15T21:14:23.165333] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-15T21:14:23.165263] [INFO ] [MAIN ] CSR: Generated 1326 derivative records from 9476 primary records. [2025-09-15T21:14:23.166039] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-15T21:14:23.190124] [DEBUG] [LOCAL ] CSR: Derivative data saved (1326 records). [2025-09-15T21:14:23.192135] [DEBUG] [LOCAL ] CSL: Derivative data saved (1326 records). [2025-09-15T21:14:23.191682] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-15T21:14:23.194685] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-15T21:14:23.194594] [INFO ] [MAIN ] Derivative Progress: 454/2083 symbols completed. CSR took 0.9s. Estimated remaining: 9m 3s. Rate: 179.9 symbols/min [2025-09-15T21:14:23.196581] [INFO ] [MAIN ] Derivative Progress: 455/2083 symbols completed. CSL took 1.0s. Estimated remaining: 9m 2s. Rate: 180.3 symbols/min [2025-09-15T21:14:23.194961] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:23.196814] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:23.218578] [DEBUG] [MAIN ] CSTM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:23.218819] [DEBUG] [LOCAL ] CTBB: Loaded 4787 existing records from primary storage. [2025-09-15T21:14:23.219034] [INFO ] [MAIN ] CTBB: Loaded 4787 primary data records. [2025-09-15T21:14:23.219746] [INFO ] [MAIN ] CSTM: Generated 1326 derivative records from 34900 primary records. [2025-09-15T21:14:23.260110] [DEBUG] [LOCAL ] CSV: Loaded 8876 existing records from primary storage. [2025-09-15T21:14:23.265357] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-15T21:14:23.298301] [INFO ] [MAIN ] CSV: Loaded 8876 primary data records. [2025-09-15T21:14:23.622344] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1326 records). [2025-09-15T21:14:23.627878] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-15T21:14:23.630054] [INFO ] [MAIN ] Derivative Progress: 456/2083 symbols completed. CSTM took 1.2s. Estimated remaining: 9m 2s. Rate: 180.1 symbols/min [2025-09-15T21:14:23.679192] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:23.774609] [DEBUG] [LOCAL ] CTDD: Loaded 3783 existing records from primary storage. [2025-09-15T21:14:23.775521] [INFO ] [MAIN ] CTDD: Loaded 3783 primary data records. [2025-09-15T21:14:24.099807] [DEBUG] [MAIN ] CTBB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:24.113110] [INFO ] [MAIN ] CTBB: Generated 1326 derivative records from 4787 primary records. [2025-09-15T21:14:24.113356] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-15T21:14:24.130600] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1326 records). [2025-09-15T21:14:24.131610] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-15T21:14:24.133372] [INFO ] [MAIN ] Derivative Progress: 457/2083 symbols completed. CTBB took 0.9s. Estimated remaining: 9m 2s. Rate: 179.9 symbols/min [2025-09-15T21:14:24.144125] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:24.144624] [DEBUG] [MAIN ] CSV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:24.146914] [INFO ] [MAIN ] CSV: Generated 1326 derivative records from 8876 primary records. [2025-09-15T21:14:24.147231] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-15T21:14:24.168391] [DEBUG] [LOCAL ] CSV: Derivative data saved (1326 records). [2025-09-15T21:14:24.168711] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-15T21:14:24.176801] [INFO ] [MAIN ] Derivative Progress: 458/2083 symbols completed. CSV took 1.0s. Estimated remaining: 9m 1s. Rate: 180.3 symbols/min [2025-09-15T21:14:24.181005] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:24.181522] [DEBUG] [MAIN ] CTDD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:24.182609] [INFO ] [MAIN ] CTDD: Generated 1326 derivative records from 3783 primary records. [2025-09-15T21:14:24.188601] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-15T21:14:24.190506] [DEBUG] [LOCAL ] CTO: Loaded 19381 existing records from primary storage. [2025-09-15T21:14:24.190918] [INFO ] [MAIN ] CTO: Loaded 19381 primary data records. [2025-09-15T21:14:24.322372] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1326 records). [2025-09-15T21:14:24.345891] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-15T21:14:24.395533] [INFO ] [MAIN ] Derivative Progress: 459/2083 symbols completed. CTDD took 0.7s. Estimated remaining: 9m 0s. Rate: 180.4 symbols/min [2025-09-15T21:14:24.395830] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:24.390832] [DEBUG] [LOCAL ] CTOS: Loaded 26642 existing records from primary storage. [2025-09-15T21:14:24.396029] [INFO ] [MAIN ] CTOS: Loaded 26642 primary data records. [2025-09-15T21:14:24.779974] [DEBUG] [LOCAL ] CTRA: Loaded 39612 existing records from primary storage. [2025-09-15T21:14:24.780398] [INFO ] [MAIN ] CTRA: Loaded 39612 primary data records. [2025-09-15T21:14:24.913597] [DEBUG] [MAIN ] CTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:24.969705] [INFO ] [MAIN ] CTO: Generated 1326 derivative records from 19381 primary records. [2025-09-15T21:14:25.058504] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-15T21:14:25.072099] [DEBUG] [LOCAL ] CTO: Derivative data saved (1326 records). [2025-09-15T21:14:25.072407] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-15T21:14:25.074421] [INFO ] [MAIN ] Derivative Progress: 460/2083 symbols completed. CTO took 0.9s. Estimated remaining: 9m 1s. Rate: 180.0 symbols/min [2025-09-15T21:14:25.075235] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:25.089480] [DEBUG] [MAIN ] CTOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:25.090314] [INFO ] [MAIN ] CTOS: Generated 1326 derivative records from 26642 primary records. [2025-09-15T21:14:25.090415] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-15T21:14:25.104968] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1326 records). [2025-09-15T21:14:25.105951] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-15T21:14:25.108861] [INFO ] [MAIN ] Derivative Progress: 461/2083 symbols completed. CTOS took 0.9s. Estimated remaining: 8m 60s. Rate: 180.4 symbols/min [2025-09-15T21:14:25.109266] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:25.129168] [DEBUG] [MAIN ] CTRA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:25.129977] [INFO ] [MAIN ] CTRA: Generated 1326 derivative records from 39612 primary records. [2025-09-15T21:14:25.130155] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-15T21:14:25.153155] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1326 records). [2025-09-15T21:14:25.154479] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-15T21:14:25.162782] [INFO ] [MAIN ] Derivative Progress: 462/2083 symbols completed. CTRA took 0.8s. Estimated remaining: 8m 58s. Rate: 180.7 symbols/min [2025-09-15T21:14:25.163134] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:25.165088] [DEBUG] [LOCAL ] CTRE: Loaded 36257 existing records from primary storage. [2025-09-15T21:14:25.165342] [INFO ] [MAIN ] CTRE: Loaded 36257 primary data records. [2025-09-15T21:14:25.291327] [DEBUG] [LOCAL ] CTRI: Loaded 29026 existing records from primary storage. [2025-09-15T21:14:25.290736] [DEBUG] [LOCAL ] CTS: Loaded 13778 existing records from primary storage. [2025-09-15T21:14:25.302274] [INFO ] [MAIN ] CTRI: Loaded 29026 primary data records. [2025-09-15T21:14:25.351756] [INFO ] [MAIN ] CTS: Loaded 13778 primary data records. [2025-09-15T21:14:26.006484] [DEBUG] [MAIN ] CTRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:26.007665] [INFO ] [MAIN ] CTRE: Generated 1326 derivative records from 36257 primary records. [2025-09-15T21:14:26.007935] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-15T21:14:26.022717] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1326 records). [2025-09-15T21:14:26.022855] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-15T21:14:26.029997] [INFO ] [MAIN ] Derivative Progress: 463/2083 symbols completed. CTRE took 1.0s. Estimated remaining: 8m 60s. Rate: 180.1 symbols/min [2025-09-15T21:14:26.034882] [DEBUG] [MAIN ] CTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:26.036535] [INFO ] [MAIN ] CTS: Generated 1326 derivative records from 13778 primary records. [2025-09-15T21:14:26.036735] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-15T21:14:26.051963] [DEBUG] [MAIN ] CTRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:26.055416] [INFO ] [MAIN ] CTRI: Generated 1326 derivative records from 29026 primary records. [2025-09-15T21:14:26.055878] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-15T21:14:26.068432] [DEBUG] [LOCAL ] CTS: Derivative data saved (1326 records). [2025-09-15T21:14:26.068835] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-15T21:14:26.071192] [INFO ] [MAIN ] Derivative Progress: 464/2083 symbols completed. CTS took 0.9s. Estimated remaining: 8m 58s. Rate: 180.4 symbols/min [2025-09-15T21:14:26.072189] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1326 records). [2025-09-15T21:14:26.072247] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-15T21:14:26.074039] [INFO ] [MAIN ] Derivative Progress: 465/2083 symbols completed. CTRI took 1.0s. Estimated remaining: 8m 57s. Rate: 180.8 symbols/min [2025-09-15T21:14:26.074688] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:26.074860] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:26.074951] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:26.108609] [DEBUG] [LOCAL ] CUBI: Loaded 19575 existing records from primary storage. [2025-09-15T21:14:26.108777] [INFO ] [MAIN ] CUBI: Loaded 19575 primary data records. [2025-09-15T21:14:26.325022] [DEBUG] [LOCAL ] CTVA: Loaded 39324 existing records from primary storage. [2025-09-15T21:14:26.325207] [INFO ] [MAIN ] CTVA: Loaded 39324 primary data records. [2025-09-15T21:14:26.324477] [DEBUG] [LOCAL ] CUBE: Loaded 37556 existing records from primary storage. [2025-09-15T21:14:26.409014] [INFO ] [MAIN ] CUBE: Loaded 37556 primary data records. [2025-09-15T21:14:27.002141] [DEBUG] [MAIN ] CUBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:27.003253] [INFO ] [MAIN ] CUBI: Generated 1326 derivative records from 19575 primary records. [2025-09-15T21:14:27.003805] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-15T21:14:27.019027] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1326 records). [2025-09-15T21:14:27.019606] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-15T21:14:27.021171] [INFO ] [MAIN ] Derivative Progress: 466/2083 symbols completed. CUBI took 0.9s. Estimated remaining: 8m 59s. Rate: 180.1 symbols/min [2025-09-15T21:14:27.021605] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:27.036543] [DEBUG] [MAIN ] CTVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:27.037566] [INFO ] [MAIN ] CTVA: Generated 1326 derivative records from 39324 primary records. [2025-09-15T21:14:27.037861] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-15T21:14:27.053234] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1326 records). [2025-09-15T21:14:27.063300] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-15T21:14:27.063660] [DEBUG] [MAIN ] CUBE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:27.066763] [INFO ] [MAIN ] Derivative Progress: 467/2083 symbols completed. CTVA took 1.0s. Estimated remaining: 8m 57s. Rate: 180.4 symbols/min [2025-09-15T21:14:27.064504] [INFO ] [MAIN ] CUBE: Generated 1326 derivative records from 37556 primary records. [2025-09-15T21:14:27.067231] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-15T21:14:27.067128] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:27.090387] [DEBUG] [LOCAL ] CULP: Loaded 1982 existing records from primary storage. [2025-09-15T21:14:27.091118] [INFO ] [MAIN ] CULP: Loaded 1982 primary data records. [2025-09-15T21:14:27.143783] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1326 records). [2025-09-15T21:14:27.177418] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-15T21:14:27.193131] [INFO ] [MAIN ] Derivative Progress: 468/2083 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 56s. Rate: 180.6 symbols/min [2025-09-15T21:14:27.191142] [DEBUG] [LOCAL ] CUK: Loaded 37358 existing records from primary storage. [2025-09-15T21:14:27.216898] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:27.213330] [INFO ] [MAIN ] CUK: Loaded 37358 primary data records. [2025-09-15T21:14:27.667599] [DEBUG] [LOCAL ] CURB: Loaded 23402 existing records from primary storage. [2025-09-15T21:14:27.668302] [INFO ] [MAIN ] CURB: Loaded 23402 primary data records. [2025-09-15T21:14:27.965312] [DEBUG] [MAIN ] CULP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:27.966599] [INFO ] [MAIN ] CULP: Generated 1326 derivative records from 1982 primary records. [2025-09-15T21:14:27.967057] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-15T21:14:27.979220] [DEBUG] [LOCAL ] CULP: Derivative data saved (1326 records). [2025-09-15T21:14:27.981159] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-15T21:14:27.983651] [INFO ] [MAIN ] Derivative Progress: 469/2083 symbols completed. CULP took 0.9s. Estimated remaining: 8m 58s. Rate: 180.1 symbols/min [2025-09-15T21:14:27.984209] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:27.994981] [DEBUG] [MAIN ] CUK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:27.996114] [INFO ] [MAIN ] CUK: Generated 1326 derivative records from 37358 primary records. [2025-09-15T21:14:27.996241] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-15T21:14:28.029929] [DEBUG] [LOCAL ] CUK: Derivative data saved (1326 records). [2025-09-15T21:14:28.034880] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-15T21:14:28.037515] [INFO ] [MAIN ] Derivative Progress: 470/2083 symbols completed. CUK took 1.0s. Estimated remaining: 8m 56s. Rate: 180.4 symbols/min [2025-09-15T21:14:28.038608] [DEBUG] [LOCAL ] CURV: Loaded 19728 existing records from primary storage. [2025-09-15T21:14:28.038724] [INFO ] [MAIN ] CURV: Loaded 19728 primary data records. [2025-09-15T21:14:28.037935] [DEBUG] [MAIN ] CURB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:28.039674] [INFO ] [MAIN ] CURB: Generated 1326 derivative records from 23402 primary records. [2025-09-15T21:14:28.039891] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-15T21:14:28.038909] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:28.161294] [DEBUG] [LOCAL ] CURB: Derivative data saved (1326 records). [2025-09-15T21:14:28.167167] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-15T21:14:28.214850] [INFO ] [MAIN ] Derivative Progress: 471/2083 symbols completed. CURB took 1.0s. Estimated remaining: 8m 56s. Rate: 180.6 symbols/min [2025-09-15T21:14:28.247763] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:28.347131] [DEBUG] [LOCAL ] CUZ: Loaded 36592 existing records from primary storage. [2025-09-15T21:14:28.348452] [INFO ] [MAIN ] CUZ: Loaded 36592 primary data records. [2025-09-15T21:14:28.690198] [DEBUG] [LOCAL ] CVE: Loaded 39534 existing records from primary storage. [2025-09-15T21:14:28.690479] [INFO ] [MAIN ] CVE: Loaded 39534 primary data records. [2025-09-15T21:14:28.722720] [DEBUG] [MAIN ] CURV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:28.747686] [INFO ] [MAIN ] CURV: Generated 1326 derivative records from 19728 primary records. [2025-09-15T21:14:28.760671] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-15T21:14:28.880546] [DEBUG] [LOCAL ] CURV: Derivative data saved (1326 records). [2025-09-15T21:14:28.898477] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-15T21:14:28.903361] [INFO ] [MAIN ] Derivative Progress: 472/2083 symbols completed. CURV took 0.9s. Estimated remaining: 8m 56s. Rate: 180.2 symbols/min [2025-09-15T21:14:28.988325] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:29.009560] [DEBUG] [MAIN ] CUZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:29.015004] [DEBUG] [LOCAL ] CVEO: Loaded 11679 existing records from primary storage. [2025-09-15T21:14:29.014883] [INFO ] [MAIN ] CUZ: Generated 1326 derivative records from 36592 primary records. [2025-09-15T21:14:29.015261] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-15T21:14:29.015127] [INFO ] [MAIN ] CVEO: Loaded 11679 primary data records. [2025-09-15T21:14:29.130163] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1326 records). [2025-09-15T21:14:29.134295] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-15T21:14:29.137464] [INFO ] [MAIN ] Derivative Progress: 473/2083 symbols completed. CUZ took 1.1s. Estimated remaining: 8m 56s. Rate: 180.3 symbols/min [2025-09-15T21:14:29.143141] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:29.307535] [DEBUG] [MAIN ] CVE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:29.319069] [INFO ] [MAIN ] CVE: Generated 1326 derivative records from 39534 primary records. [2025-09-15T21:14:29.319224] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-15T21:14:29.342555] [DEBUG] [LOCAL ] CVE: Derivative data saved (1326 records). [2025-09-15T21:14:29.342996] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-15T21:14:29.344848] [INFO ] [MAIN ] Derivative Progress: 474/2083 symbols completed. CVE took 1.1s. Estimated remaining: 8m 55s. Rate: 180.5 symbols/min [2025-09-15T21:14:29.345486] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:29.358356] [DEBUG] [LOCAL ] CVI: Loaded 33984 existing records from primary storage. [2025-09-15T21:14:29.358720] [INFO ] [MAIN ] CVI: Loaded 33984 primary data records. [2025-09-15T21:14:29.465679] [DEBUG] [LOCAL ] CVLG: Loaded 11290 existing records from primary storage. [2025-09-15T21:14:29.468881] [INFO ] [MAIN ] CVLG: Loaded 11290 primary data records. [2025-09-15T21:14:29.775312] [DEBUG] [MAIN ] CVEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:29.824361] [INFO ] [MAIN ] CVEO: Generated 1326 derivative records from 11679 primary records. [2025-09-15T21:14:29.913291] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-15T21:14:29.930660] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1326 records). [2025-09-15T21:14:29.931115] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-15T21:14:29.933469] [INFO ] [MAIN ] Derivative Progress: 475/2083 symbols completed. CVEO took 0.9s. Estimated remaining: 8m 55s. Rate: 180.2 symbols/min [2025-09-15T21:14:29.934179] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:29.950273] [DEBUG] [MAIN ] CVI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:29.951025] [INFO ] [MAIN ] CVI: Generated 1326 derivative records from 33984 primary records. [2025-09-15T21:14:29.951263] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-15T21:14:29.965999] [DEBUG] [LOCAL ] CVI: Derivative data saved (1326 records). [2025-09-15T21:14:29.972031] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-15T21:14:29.978388] [INFO ] [MAIN ] Derivative Progress: 476/2083 symbols completed. CVI took 0.8s. Estimated remaining: 8m 54s. Rate: 180.5 symbols/min [2025-09-15T21:14:29.979320] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:29.978901] [DEBUG] [MAIN ] CVLG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:29.980099] [INFO ] [MAIN ] CVLG: Generated 1326 derivative records from 11290 primary records. [2025-09-15T21:14:29.980538] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-15T21:14:30.002986] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1326 records). [2025-09-15T21:14:30.003137] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-15T21:14:30.004981] [INFO ] [MAIN ] Derivative Progress: 477/2083 symbols completed. CVLG took 0.7s. Estimated remaining: 8m 53s. Rate: 180.8 symbols/min [2025-09-15T21:14:30.005301] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:30.021544] [DEBUG] [LOCAL ] CVNA: Loaded 39119 existing records from primary storage. [2025-09-15T21:14:30.021908] [INFO ] [MAIN ] CVNA: Loaded 39119 primary data records. [2025-09-15T21:14:30.218073] [DEBUG] [LOCAL ] CVS: Loaded 39658 existing records from primary storage. [2025-09-15T21:14:30.243559] [INFO ] [MAIN ] CVS: Loaded 39658 primary data records. [2025-09-15T21:14:30.457384] [DEBUG] [LOCAL ] CVX: Loaded 39720 existing records from primary storage. [2025-09-15T21:14:30.463430] [INFO ] [MAIN ] CVX: Loaded 39720 primary data records. [2025-09-15T21:14:30.958449] [DEBUG] [MAIN ] CVNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:30.959271] [INFO ] [MAIN ] CVNA: Generated 1326 derivative records from 39119 primary records. [2025-09-15T21:14:30.960505] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-15T21:14:30.976008] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1326 records). [2025-09-15T21:14:30.976403] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-15T21:14:30.980560] [INFO ] [MAIN ] Derivative Progress: 478/2083 symbols completed. CVNA took 1.0s. Estimated remaining: 8m 55s. Rate: 180.1 symbols/min [2025-09-15T21:14:30.991769] [DEBUG] [MAIN ] CVS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:30.992725] [INFO ] [MAIN ] CVS: Generated 1326 derivative records from 39658 primary records. [2025-09-15T21:14:30.993586] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-15T21:14:31.016795] [DEBUG] [MAIN ] CVX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:31.017660] [DEBUG] [LOCAL ] CVS: Derivative data saved (1326 records). [2025-09-15T21:14:31.018498] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-15T21:14:31.021235] [INFO ] [MAIN ] Derivative Progress: 479/2083 symbols completed. CVS took 1.0s. Estimated remaining: 8m 53s. Rate: 180.4 symbols/min [2025-09-15T21:14:31.018441] [INFO ] [MAIN ] CVX: Generated 1326 derivative records from 39720 primary records. [2025-09-15T21:14:31.021479] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-15T21:14:31.033697] [DEBUG] [LOCAL ] CVX: Derivative data saved (1326 records). [2025-09-15T21:14:31.033755] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-15T21:14:31.036100] [INFO ] [MAIN ] Derivative Progress: 480/2083 symbols completed. CVX took 1.0s. Estimated remaining: 8m 52s. Rate: 180.8 symbols/min [2025-09-15T21:14:31.036585] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:31.036781] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:31.036505] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:31.059834] [DEBUG] [LOCAL ] CW: Loaded 16766 existing records from primary storage. [2025-09-15T21:14:31.060061] [INFO ] [MAIN ] CW: Loaded 16766 primary data records. [2025-09-15T21:14:31.238532] [DEBUG] [LOCAL ] CWEN: Loaded 32791 existing records from primary storage. [2025-09-15T21:14:31.278611] [INFO ] [MAIN ] CWEN: Loaded 32791 primary data records. [2025-09-15T21:14:31.382291] [DEBUG] [LOCAL ] CWAN: Loaded 38857 existing records from primary storage. [2025-09-15T21:14:31.399363] [INFO ] [MAIN ] CWAN: Loaded 38857 primary data records. [2025-09-15T21:14:31.920182] [DEBUG] [MAIN ] CW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:31.921317] [INFO ] [MAIN ] CW: Generated 1326 derivative records from 16766 primary records. [2025-09-15T21:14:31.921862] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-15T21:14:31.937286] [DEBUG] [LOCAL ] CW: Derivative data saved (1326 records). [2025-09-15T21:14:31.939077] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-15T21:14:31.940981] [INFO ] [MAIN ] Derivative Progress: 481/2083 symbols completed. CW took 0.9s. Estimated remaining: 8m 54s. Rate: 180.2 symbols/min [2025-09-15T21:14:31.951716] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:31.952485] [DEBUG] [MAIN ] CWEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:31.953486] [INFO ] [MAIN ] CWEN: Generated 1326 derivative records from 32791 primary records. [2025-09-15T21:14:31.954303] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-15T21:14:31.972931] [DEBUG] [MAIN ] CWAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:31.976475] [INFO ] [MAIN ] CWAN: Generated 1326 derivative records from 38857 primary records. [2025-09-15T21:14:31.977851] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-15T21:14:31.979026] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1326 records). [2025-09-15T21:14:31.980162] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-15T21:14:31.982035] [INFO ] [MAIN ] Derivative Progress: 482/2083 symbols completed. CWEN took 0.9s. Estimated remaining: 8m 52s. Rate: 180.5 symbols/min [2025-09-15T21:14:31.982247] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:32.004894] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1326 records). [2025-09-15T21:14:32.005229] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-15T21:14:32.007174] [INFO ] [MAIN ] Derivative Progress: 483/2083 symbols completed. CWAN took 1.0s. Estimated remaining: 8m 51s. Rate: 180.8 symbols/min [2025-09-15T21:14:32.007465] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:32.023202] [DEBUG] [LOCAL ] CWH: Loaded 38060 existing records from primary storage. [2025-09-15T21:14:32.027994] [INFO ] [MAIN ] CWH: Loaded 38060 primary data records. [2025-09-15T21:14:32.149296] [DEBUG] [LOCAL ] CWT: Loaded 20038 existing records from primary storage. [2025-09-15T21:14:32.165253] [INFO ] [MAIN ] CWT: Loaded 20038 primary data records. [2025-09-15T21:14:32.417197] [DEBUG] [LOCAL ] CX: Loaded 38965 existing records from primary storage. [2025-09-15T21:14:32.423371] [INFO ] [MAIN ] CX: Loaded 38965 primary data records. [2025-09-15T21:14:32.880135] [DEBUG] [MAIN ] CWH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:32.881544] [INFO ] [MAIN ] CWH: Generated 1326 derivative records from 38060 primary records. [2025-09-15T21:14:32.881985] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-15T21:14:32.896503] [DEBUG] [LOCAL ] CWH: Derivative data saved (1326 records). [2025-09-15T21:14:32.897420] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-15T21:14:32.899324] [INFO ] [MAIN ] Derivative Progress: 484/2083 symbols completed. CWH took 1.0s. Estimated remaining: 8m 52s. Rate: 180.2 symbols/min [2025-09-15T21:14:32.899904] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:32.916201] [DEBUG] [MAIN ] CWT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:32.917858] [INFO ] [MAIN ] CWT: Generated 1326 derivative records from 20038 primary records. [2025-09-15T21:14:32.918113] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-15T21:14:32.923218] [DEBUG] [LOCAL ] CXE: Loaded 4647 existing records from primary storage. [2025-09-15T21:14:32.925477] [INFO ] [MAIN ] CXE: Loaded 4647 primary data records. [2025-09-15T21:14:32.977028] [DEBUG] [LOCAL ] CWT: Derivative data saved (1326 records). [2025-09-15T21:14:33.018245] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-15T21:14:33.047991] [INFO ] [MAIN ] Derivative Progress: 485/2083 symbols completed. CWT took 1.1s. Estimated remaining: 8m 51s. Rate: 180.4 symbols/min [2025-09-15T21:14:33.059367] [DEBUG] [MAIN ] CX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:33.060305] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:33.066368] [INFO ] [MAIN ] CX: Generated 1326 derivative records from 38965 primary records. [2025-09-15T21:14:33.071716] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-15T21:14:33.273023] [DEBUG] [LOCAL ] CXH: Loaded 3905 existing records from primary storage. [2025-09-15T21:14:33.286296] [DEBUG] [LOCAL ] CX: Derivative data saved (1326 records). [2025-09-15T21:14:33.286377] [INFO ] [MAIN ] CXH: Loaded 3905 primary data records. [2025-09-15T21:14:33.286543] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-15T21:14:33.326418] [INFO ] [MAIN ] Derivative Progress: 486/2083 symbols completed. CX took 1.3s. Estimated remaining: 8m 51s. Rate: 180.5 symbols/min [2025-09-15T21:14:33.355101] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:33.605519] [DEBUG] [LOCAL ] CXM: Loaded 35117 existing records from primary storage. [2025-09-15T21:14:33.605846] [DEBUG] [MAIN ] CXE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:33.608481] [INFO ] [MAIN ] CXE: Generated 1326 derivative records from 4647 primary records. [2025-09-15T21:14:33.607426] [INFO ] [MAIN ] CXM: Loaded 35117 primary data records. [2025-09-15T21:14:33.609184] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-15T21:14:33.690664] [DEBUG] [LOCAL ] CXE: Derivative data saved (1326 records). [2025-09-15T21:14:33.708049] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-15T21:14:33.716726] [INFO ] [MAIN ] Derivative Progress: 487/2083 symbols completed. CXE took 0.8s. Estimated remaining: 8m 51s. Rate: 180.4 symbols/min [2025-09-15T21:14:33.729190] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:33.785242] [DEBUG] [MAIN ] CXH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:33.818166] [INFO ] [MAIN ] CXH: Generated 1326 derivative records from 3905 primary records. [2025-09-15T21:14:33.825279] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-15T21:14:33.940972] [DEBUG] [LOCAL ] CXT: Loaded 22071 existing records from primary storage. [2025-09-15T21:14:33.941083] [DEBUG] [LOCAL ] CXH: Derivative data saved (1326 records). [2025-09-15T21:14:33.941810] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-15T21:14:33.941619] [INFO ] [MAIN ] CXT: Loaded 22071 primary data records. [2025-09-15T21:14:33.944601] [INFO ] [MAIN ] Derivative Progress: 488/2083 symbols completed. CXH took 0.9s. Estimated remaining: 8m 50s. Rate: 180.5 symbols/min [2025-09-15T21:14:33.945076] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:34.239274] [DEBUG] [MAIN ] CXM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:34.240945] [INFO ] [MAIN ] CXM: Generated 1326 derivative records from 35117 primary records. [2025-09-15T21:14:34.253686] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-15T21:14:34.254775] [DEBUG] [LOCAL ] CXW: Loaded 32561 existing records from primary storage. [2025-09-15T21:14:34.256032] [INFO ] [MAIN ] CXW: Loaded 32561 primary data records. [2025-09-15T21:14:34.360634] [DEBUG] [LOCAL ] CXM: Derivative data saved (1326 records). [2025-09-15T21:14:34.380968] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-15T21:14:34.406907] [INFO ] [MAIN ] Derivative Progress: 489/2083 symbols completed. CXM took 1.1s. Estimated remaining: 8m 50s. Rate: 180.4 symbols/min [2025-09-15T21:14:34.469039] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:34.479494] [DEBUG] [MAIN ] CXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:34.486569] [INFO ] [MAIN ] CXT: Generated 1326 derivative records from 22071 primary records. [2025-09-15T21:14:34.578837] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-15T21:14:34.598847] [DEBUG] [LOCAL ] CXT: Derivative data saved (1326 records). [2025-09-15T21:14:34.599479] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-15T21:14:34.602331] [INFO ] [MAIN ] Derivative Progress: 490/2083 symbols completed. CXT took 0.9s. Estimated remaining: 8m 49s. Rate: 180.5 symbols/min [2025-09-15T21:14:34.609588] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:34.623307] [DEBUG] [LOCAL ] CYD: Loaded 18953 existing records from primary storage. [2025-09-15T21:14:34.624142] [INFO ] [MAIN ] CYD: Loaded 18953 primary data records. [2025-09-15T21:14:34.832696] [DEBUG] [LOCAL ] CYH: Loaded 35531 existing records from primary storage. [2025-09-15T21:14:34.908986] [INFO ] [MAIN ] CYH: Loaded 35531 primary data records. [2025-09-15T21:14:34.886981] [DEBUG] [MAIN ] CXW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:35.030760] [INFO ] [MAIN ] CXW: Generated 1326 derivative records from 32561 primary records. [2025-09-15T21:14:35.063883] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-15T21:14:35.216822] [DEBUG] [LOCAL ] CXW: Derivative data saved (1326 records). [2025-09-15T21:14:35.242394] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-15T21:14:35.252601] [INFO ] [MAIN ] Derivative Progress: 491/2083 symbols completed. CXW took 1.3s. Estimated remaining: 8m 50s. Rate: 180.2 symbols/min [2025-09-15T21:14:35.322170] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:35.545812] [DEBUG] [MAIN ] CYD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:35.547622] [INFO ] [MAIN ] CYD: Generated 1326 derivative records from 18953 primary records. [2025-09-15T21:14:35.548252] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-15T21:14:35.576955] [DEBUG] [LOCAL ] CYD: Derivative data saved (1326 records). [2025-09-15T21:14:35.577506] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-15T21:14:35.579820] [INFO ] [MAIN ] Derivative Progress: 492/2083 symbols completed. CYD took 1.1s. Estimated remaining: 8m 50s. Rate: 180.2 symbols/min [2025-09-15T21:14:35.580765] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:35.603358] [DEBUG] [LOCAL ] DAN: Loaded 36208 existing records from primary storage. [2025-09-15T21:14:35.604273] [INFO ] [MAIN ] DAN: Loaded 36208 primary data records. [2025-09-15T21:14:35.732560] [DEBUG] [LOCAL ] DAO: Loaded 13357 existing records from primary storage. [2025-09-15T21:14:35.744208] [INFO ] [MAIN ] DAO: Loaded 13357 primary data records. [2025-09-15T21:14:35.856109] [DEBUG] [MAIN ] CYH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:35.927691] [INFO ] [MAIN ] CYH: Generated 1326 derivative records from 35531 primary records. [2025-09-15T21:14:35.960029] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-15T21:14:36.159991] [DEBUG] [LOCAL ] CYH: Derivative data saved (1326 records). [2025-09-15T21:14:36.178100] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-15T21:14:36.268077] [INFO ] [MAIN ] Derivative Progress: 493/2083 symbols completed. CYH took 1.7s. Estimated remaining: 8m 51s. Rate: 179.8 symbols/min [2025-09-15T21:14:36.286018] [DEBUG] [MAIN ] DAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:36.286832] [INFO ] [MAIN ] DAN: Generated 1326 derivative records from 36208 primary records. [2025-09-15T21:14:36.286985] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-15T21:14:36.300557] [DEBUG] [LOCAL ] DAN: Derivative data saved (1326 records). [2025-09-15T21:14:36.301131] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-15T21:14:36.303127] [INFO ] [MAIN ] Derivative Progress: 494/2083 symbols completed. DAN took 1.0s. Estimated remaining: 8m 49s. Rate: 180.1 symbols/min [2025-09-15T21:14:36.312933] [DEBUG] [MAIN ] DAO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:36.313488] [INFO ] [MAIN ] DAO: Generated 1326 derivative records from 13357 primary records. [2025-09-15T21:14:36.313548] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-15T21:14:36.324940] [DEBUG] [LOCAL ] DAO: Derivative data saved (1326 records). [2025-09-15T21:14:36.324996] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-15T21:14:36.327293] [INFO ] [MAIN ] Derivative Progress: 495/2083 symbols completed. DAO took 0.7s. Estimated remaining: 8m 48s. Rate: 180.5 symbols/min [2025-09-15T21:14:36.328027] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:36.328175] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:36.328324] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:36.401365] [DEBUG] [LOCAL ] DAVA: Loaded 30318 existing records from primary storage. [2025-09-15T21:14:36.399777] [DEBUG] [LOCAL ] DAY: Loaded 36701 existing records from primary storage. [2025-09-15T21:14:36.401754] [INFO ] [MAIN ] DAVA: Loaded 30318 primary data records. [2025-09-15T21:14:36.401866] [INFO ] [MAIN ] DAY: Loaded 36701 primary data records. [2025-09-15T21:14:36.579180] [DEBUG] [LOCAL ] DB: Loaded 38694 existing records from primary storage. [2025-09-15T21:14:36.639407] [INFO ] [MAIN ] DB: Loaded 38694 primary data records. [2025-09-15T21:14:37.294439] [DEBUG] [MAIN ] DAVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:37.295475] [INFO ] [MAIN ] DAVA: Generated 1326 derivative records from 30318 primary records. [2025-09-15T21:14:37.304876] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-15T21:14:37.305416] [DEBUG] [MAIN ] DAY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:37.307094] [INFO ] [MAIN ] DAY: Generated 1326 derivative records from 36701 primary records. [2025-09-15T21:14:37.312975] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-15T21:14:37.320169] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1326 records). [2025-09-15T21:14:37.329357] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-15T21:14:37.333352] [INFO ] [MAIN ] Derivative Progress: 496/2083 symbols completed. DAVA took 1.0s. Estimated remaining: 8m 50s. Rate: 179.7 symbols/min [2025-09-15T21:14:37.336089] [DEBUG] [LOCAL ] DAY: Derivative data saved (1326 records). [2025-09-15T21:14:37.337921] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:37.339124] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-15T21:14:37.341089] [INFO ] [MAIN ] Derivative Progress: 497/2083 symbols completed. DAY took 1.0s. Estimated remaining: 8m 48s. Rate: 180.1 symbols/min [2025-09-15T21:14:37.341726] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:37.353985] [DEBUG] [MAIN ] DB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:37.355136] [INFO ] [MAIN ] DB: Generated 1326 derivative records from 38694 primary records. [2025-09-15T21:14:37.355397] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-15T21:14:37.376201] [DEBUG] [LOCAL ] DBL: Loaded 7034 existing records from primary storage. [2025-09-15T21:14:37.375876] [DEBUG] [LOCAL ] DB: Derivative data saved (1326 records). [2025-09-15T21:14:37.376535] [INFO ] [MAIN ] DBL: Loaded 7034 primary data records. [2025-09-15T21:14:37.376705] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-15T21:14:37.392034] [INFO ] [MAIN ] Derivative Progress: 498/2083 symbols completed. DB took 1.1s. Estimated remaining: 8m 47s. Rate: 180.4 symbols/min [2025-09-15T21:14:37.420073] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:37.549315] [DEBUG] [LOCAL ] DBI: Loaded 32715 existing records from primary storage. [2025-09-15T21:14:37.584384] [INFO ] [MAIN ] DBI: Loaded 32715 primary data records. [2025-09-15T21:14:37.898931] [DEBUG] [LOCAL ] DBRG: Loaded 36678 existing records from primary storage. [2025-09-15T21:14:37.974528] [INFO ] [MAIN ] DBRG: Loaded 36678 primary data records. [2025-09-15T21:14:38.155604] [DEBUG] [MAIN ] DBL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:38.172576] [INFO ] [MAIN ] DBL: Generated 1326 derivative records from 7034 primary records. [2025-09-15T21:14:38.194406] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-15T21:14:38.343267] [DEBUG] [LOCAL ] DBL: Derivative data saved (1326 records). [2025-09-15T21:14:38.344338] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-15T21:14:38.346049] [INFO ] [MAIN ] Derivative Progress: 499/2083 symbols completed. DBL took 1.0s. Estimated remaining: 8m 49s. Rate: 179.7 symbols/min [2025-09-15T21:14:38.352412] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:38.357478] [DEBUG] [MAIN ] DBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:38.358668] [INFO ] [MAIN ] DBI: Generated 1326 derivative records from 32715 primary records. [2025-09-15T21:14:38.358952] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-15T21:14:38.376559] [DEBUG] [LOCAL ] DBI: Derivative data saved (1326 records). [2025-09-15T21:14:38.377012] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-15T21:14:38.380196] [INFO ] [MAIN ] Derivative Progress: 500/2083 symbols completed. DBI took 1.0s. Estimated remaining: 8m 48s. Rate: 180.0 symbols/min [2025-09-15T21:14:38.389502] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:38.407298] [DEBUG] [LOCAL ] DCI: Loaded 27192 existing records from primary storage. [2025-09-15T21:14:38.417194] [INFO ] [MAIN ] DCI: Loaded 27192 primary data records. [2025-09-15T21:14:38.417784] [DEBUG] [MAIN ] DBRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:38.435970] [INFO ] [MAIN ] DBRG: Generated 1326 derivative records from 36678 primary records. [2025-09-15T21:14:38.481042] [DEBUG] [LOCAL ] DCO: Loaded 10699 existing records from primary storage. [2025-09-15T21:14:38.506894] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-15T21:14:38.518064] [INFO ] [MAIN ] DCO: Loaded 10699 primary data records. [2025-09-15T21:14:38.650228] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1326 records). [2025-09-15T21:14:38.690601] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-15T21:14:38.720061] [INFO ] [MAIN ] Derivative Progress: 501/2083 symbols completed. DBRG took 1.3s. Estimated remaining: 8m 47s. Rate: 180.0 symbols/min [2025-09-15T21:14:38.720552] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:39.015535] [DEBUG] [MAIN ] DCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:39.018051] [INFO ] [MAIN ] DCI: Generated 1326 derivative records from 27192 primary records. [2025-09-15T21:14:39.018252] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-15T21:14:39.016667] [DEBUG] [LOCAL ] DD: Loaded 38986 existing records from primary storage. [2025-09-15T21:14:39.019131] [INFO ] [MAIN ] DD: Loaded 38986 primary data records. [2025-09-15T21:14:39.141998] [DEBUG] [LOCAL ] DCI: Derivative data saved (1326 records). [2025-09-15T21:14:39.145705] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-15T21:14:39.147720] [INFO ] [MAIN ] Derivative Progress: 502/2083 symbols completed. DCI took 0.8s. Estimated remaining: 8m 47s. Rate: 179.9 symbols/min [2025-09-15T21:14:39.158824] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:39.153579] [DEBUG] [MAIN ] DCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:39.175199] [INFO ] [MAIN ] DCO: Generated 1326 derivative records from 10699 primary records. [2025-09-15T21:14:39.197694] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-15T21:14:39.323333] [DEBUG] [LOCAL ] DCO: Derivative data saved (1326 records). [2025-09-15T21:14:39.324168] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-15T21:14:39.326993] [INFO ] [MAIN ] Derivative Progress: 503/2083 symbols completed. DCO took 0.9s. Estimated remaining: 8m 46s. Rate: 180.1 symbols/min [2025-09-15T21:14:39.327560] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:39.355900] [DEBUG] [LOCAL ] DDD: Loaded 37346 existing records from primary storage. [2025-09-15T21:14:39.357355] [INFO ] [MAIN ] DDD: Loaded 37346 primary data records. [2025-09-15T21:14:39.407865] [DEBUG] [MAIN ] DD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:39.446805] [INFO ] [MAIN ] DD: Generated 1326 derivative records from 38986 primary records. [2025-09-15T21:14:39.453251] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-15T21:14:39.523336] [DEBUG] [LOCAL ] DD: Derivative data saved (1326 records). [2025-09-15T21:14:39.507219] [DEBUG] [LOCAL ] DDL: Loaded 25348 existing records from primary storage. [2025-09-15T21:14:39.528672] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-15T21:14:39.532586] [INFO ] [MAIN ] Derivative Progress: 504/2083 symbols completed. DD took 0.8s. Estimated remaining: 8m 46s. Rate: 180.2 symbols/min [2025-09-15T21:14:39.563236] [INFO ] [MAIN ] DDL: Loaded 25348 primary data records. [2025-09-15T21:14:39.565636] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:39.794417] [DEBUG] [LOCAL ] DDS: Loaded 9514 existing records from primary storage. [2025-09-15T21:14:39.795140] [INFO ] [MAIN ] DDS: Loaded 9514 primary data records. [2025-09-15T21:14:40.236318] [DEBUG] [MAIN ] DDD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:40.237662] [INFO ] [MAIN ] DDD: Generated 1326 derivative records from 37346 primary records. [2025-09-15T21:14:40.237924] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-15T21:14:40.252698] [DEBUG] [LOCAL ] DDD: Derivative data saved (1326 records). [2025-09-15T21:14:40.253676] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-15T21:14:40.255349] [INFO ] [MAIN ] Derivative Progress: 505/2083 symbols completed. DDD took 1.1s. Estimated remaining: 8m 47s. Rate: 179.8 symbols/min [2025-09-15T21:14:40.257200] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:40.269153] [DEBUG] [MAIN ] DDL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:40.270371] [INFO ] [MAIN ] DDL: Generated 1326 derivative records from 25348 primary records. [2025-09-15T21:14:40.272435] [DEBUG] [LOCAL ] DDT: Loaded 1355 existing records from primary storage. [2025-09-15T21:14:40.270496] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-15T21:14:40.272998] [INFO ] [MAIN ] DDT: Loaded 1355 primary data records. [2025-09-15T21:14:40.399350] [DEBUG] [LOCAL ] DDL: Derivative data saved (1326 records). [2025-09-15T21:14:40.387284] [DEBUG] [MAIN ] DDS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:40.400008] [INFO ] [MAIN ] DDS: Generated 1326 derivative records from 9514 primary records. [2025-09-15T21:14:40.400088] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-15T21:14:40.400146] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-15T21:14:40.402307] [INFO ] [MAIN ] Derivative Progress: 506/2083 symbols completed. DDL took 1.1s. Estimated remaining: 8m 46s. Rate: 180.0 symbols/min [2025-09-15T21:14:40.402719] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:40.434828] [DEBUG] [LOCAL ] DDS: Derivative data saved (1326 records). [2025-09-15T21:14:40.434987] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-15T21:14:40.455818] [INFO ] [MAIN ] Derivative Progress: 507/2083 symbols completed. DDS took 0.9s. Estimated remaining: 8m 44s. Rate: 180.3 symbols/min [2025-09-15T21:14:40.487420] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:40.634966] [DEBUG] [MAIN ] DDT: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:14:40.644398] [INFO ] [MAIN ] DDT: Generated 1325 derivative records from 1355 primary records. [2025-09-15T21:14:40.650748] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-15T21:14:40.651350] [DEBUG] [LOCAL ] DEA: Loaded 29061 existing records from primary storage. [2025-09-15T21:14:40.651909] [INFO ] [MAIN ] DEA: Loaded 29061 primary data records. [2025-09-15T21:14:40.651847] [DEBUG] [LOCAL ] DEC: Loaded 21123 existing records from primary storage. [2025-09-15T21:14:40.652707] [INFO ] [MAIN ] DEC: Loaded 21123 primary data records. [2025-09-15T21:14:40.800331] [DEBUG] [LOCAL ] DDT: Derivative data saved (1325 records). [2025-09-15T21:14:40.864937] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-15T21:14:40.877695] [INFO ] [MAIN ] Derivative Progress: 508/2083 symbols completed. DDT took 0.6s. Estimated remaining: 8m 44s. Rate: 180.2 symbols/min [2025-09-15T21:14:41.217594] [DEBUG] [MAIN ] DEC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:41.218453] [INFO ] [MAIN ] DEC: Generated 1326 derivative records from 21123 primary records. [2025-09-15T21:14:41.218701] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-15T21:14:41.228817] [DEBUG] [MAIN ] DEA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:41.229715] [INFO ] [MAIN ] DEA: Generated 1326 derivative records from 29061 primary records. [2025-09-15T21:14:41.235260] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-15T21:14:41.252568] [DEBUG] [LOCAL ] DEC: Derivative data saved (1326 records). [2025-09-15T21:14:41.253585] [DEBUG] [LOCAL ] DEA: Derivative data saved (1326 records). [2025-09-15T21:14:41.253718] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-15T21:14:41.255410] [INFO ] [MAIN ] Derivative Progress: 509/2083 symbols completed. DEC took 0.8s. Estimated remaining: 8m 44s. Rate: 180.2 symbols/min [2025-09-15T21:14:41.255628] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-15T21:14:41.257358] [INFO ] [MAIN ] Derivative Progress: 510/2083 symbols completed. DEA took 0.9s. Estimated remaining: 8m 43s. Rate: 180.5 symbols/min [2025-09-15T21:14:41.257917] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:41.258214] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:41.258753] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:41.313898] [DEBUG] [LOCAL ] DECK: Loaded 39340 existing records from primary storage. [2025-09-15T21:14:41.314050] [INFO ] [MAIN ] DECK: Loaded 39340 primary data records. [2025-09-15T21:14:41.435501] [DEBUG] [LOCAL ] DEI: Loaded 35546 existing records from primary storage. [2025-09-15T21:14:41.456949] [DEBUG] [LOCAL ] DEO: Loaded 35760 existing records from primary storage. [2025-09-15T21:14:41.451354] [INFO ] [MAIN ] DEI: Loaded 35546 primary data records. [2025-09-15T21:14:41.483674] [INFO ] [MAIN ] DEO: Loaded 35760 primary data records. [2025-09-15T21:14:42.153903] [DEBUG] [MAIN ] DECK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:42.155009] [INFO ] [MAIN ] DECK: Generated 1326 derivative records from 39340 primary records. [2025-09-15T21:14:42.155384] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-15T21:14:42.168505] [DEBUG] [LOCAL ] DECK: Derivative data saved (1326 records). [2025-09-15T21:14:42.169387] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-15T21:14:42.172850] [INFO ] [MAIN ] Derivative Progress: 511/2083 symbols completed. DECK took 0.9s. Estimated remaining: 8m 44s. Rate: 179.9 symbols/min [2025-09-15T21:14:42.173821] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:42.194677] [DEBUG] [MAIN ] DEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:42.194906] [DEBUG] [MAIN ] DEI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:42.195858] [INFO ] [MAIN ] DEO: Generated 1326 derivative records from 35760 primary records. [2025-09-15T21:14:42.196455] [INFO ] [MAIN ] DEI: Generated 1326 derivative records from 35546 primary records. [2025-09-15T21:14:42.195984] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-15T21:14:42.196593] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-15T21:14:42.219019] [DEBUG] [LOCAL ] DEI: Derivative data saved (1326 records). [2025-09-15T21:14:42.220050] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-15T21:14:42.222128] [INFO ] [MAIN ] Derivative Progress: 512/2083 symbols completed. DEI took 1.0s. Estimated remaining: 8m 43s. Rate: 180.2 symbols/min [2025-09-15T21:14:42.222666] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:42.225275] [DEBUG] [LOCAL ] DEO: Derivative data saved (1326 records). [2025-09-15T21:14:42.225471] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-15T21:14:42.228210] [INFO ] [MAIN ] Derivative Progress: 513/2083 symbols completed. DEO took 1.0s. Estimated remaining: 8m 42s. Rate: 180.5 symbols/min [2025-09-15T21:14:42.228600] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:42.248785] [DEBUG] [LOCAL ] DFIN: Loaded 15977 existing records from primary storage. [2025-09-15T21:14:42.256552] [INFO ] [MAIN ] DFIN: Loaded 15977 primary data records. [2025-09-15T21:14:42.287876] [DEBUG] [LOCAL ] DFH: Loaded 23634 existing records from primary storage. [2025-09-15T21:14:42.325700] [INFO ] [MAIN ] DFH: Loaded 23634 primary data records. [2025-09-15T21:14:42.615359] [DEBUG] [LOCAL ] DG: Loaded 39311 existing records from primary storage. [2025-09-15T21:14:42.725221] [INFO ] [MAIN ] DG: Loaded 39311 primary data records. [2025-09-15T21:14:43.142545] [DEBUG] [MAIN ] DFIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:43.144268] [INFO ] [MAIN ] DFIN: Generated 1326 derivative records from 15977 primary records. [2025-09-15T21:14:43.144562] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-15T21:14:43.160258] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1326 records). [2025-09-15T21:14:43.161892] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-15T21:14:43.163971] [INFO ] [MAIN ] Derivative Progress: 514/2083 symbols completed. DFIN took 0.9s. Estimated remaining: 8m 43s. Rate: 179.9 symbols/min [2025-09-15T21:14:43.164420] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:43.175619] [DEBUG] [MAIN ] DFH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:43.177976] [INFO ] [MAIN ] DFH: Generated 1326 derivative records from 23634 primary records. [2025-09-15T21:14:43.178329] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-15T21:14:43.192475] [DEBUG] [LOCAL ] DFH: Derivative data saved (1326 records). [2025-09-15T21:14:43.192808] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-15T21:14:43.194682] [INFO ] [MAIN ] Derivative Progress: 515/2083 symbols completed. DFH took 1.0s. Estimated remaining: 8m 42s. Rate: 180.2 symbols/min [2025-09-15T21:14:43.195119] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:43.210461] [DEBUG] [MAIN ] DG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:43.222298] [INFO ] [MAIN ] DG: Generated 1326 derivative records from 39311 primary records. [2025-09-15T21:14:43.222545] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-15T21:14:43.245874] [DEBUG] [LOCAL ] DG: Derivative data saved (1326 records). [2025-09-15T21:14:43.256313] [DEBUG] [LOCAL ] DHF: Loaded 15803 existing records from primary storage. [2025-09-15T21:14:43.258263] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-15T21:14:43.258169] [INFO ] [MAIN ] DHF: Loaded 15803 primary data records. [2025-09-15T21:14:43.260362] [INFO ] [MAIN ] Derivative Progress: 516/2083 symbols completed. DG took 1.0s. Estimated remaining: 8m 41s. Rate: 180.5 symbols/min [2025-09-15T21:14:43.265852] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:43.284856] [DEBUG] [LOCAL ] DGX: Loaded 32994 existing records from primary storage. [2025-09-15T21:14:43.314954] [INFO ] [MAIN ] DGX: Loaded 32994 primary data records. [2025-09-15T21:14:43.863262] [DEBUG] [LOCAL ] DHI: Loaded 39418 existing records from primary storage. [2025-09-15T21:14:43.865330] [INFO ] [MAIN ] DHI: Loaded 39418 primary data records. [2025-09-15T21:14:44.071882] [DEBUG] [MAIN ] DHF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:44.148459] [INFO ] [MAIN ] DHF: Generated 1326 derivative records from 15803 primary records. [2025-09-15T21:14:44.160724] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-15T21:14:44.178052] [DEBUG] [LOCAL ] DHF: Derivative data saved (1326 records). [2025-09-15T21:14:44.189017] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-15T21:14:44.190599] [INFO ] [MAIN ] Derivative Progress: 517/2083 symbols completed. DHF took 1.0s. Estimated remaining: 8m 42s. Rate: 179.9 symbols/min [2025-09-15T21:14:44.192404] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:44.191543] [DEBUG] [MAIN ] DGX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:44.194574] [INFO ] [MAIN ] DGX: Generated 1326 derivative records from 32994 primary records. [2025-09-15T21:14:44.194780] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-15T21:14:44.212160] [DEBUG] [LOCAL ] DGX: Derivative data saved (1326 records). [2025-09-15T21:14:44.212388] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-15T21:14:44.214551] [INFO ] [MAIN ] Derivative Progress: 518/2083 symbols completed. DGX took 1.1s. Estimated remaining: 8m 41s. Rate: 180.2 symbols/min [2025-09-15T21:14:44.214951] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:44.229895] [DEBUG] [MAIN ] DHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:44.234374] [INFO ] [MAIN ] DHI: Generated 1326 derivative records from 39418 primary records. [2025-09-15T21:14:44.234658] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-15T21:14:44.260704] [DEBUG] [LOCAL ] DHX: Loaded 9039 existing records from primary storage. [2025-09-15T21:14:44.262860] [INFO ] [MAIN ] DHX: Loaded 9039 primary data records. [2025-09-15T21:14:44.263520] [DEBUG] [LOCAL ] DHI: Derivative data saved (1326 records). [2025-09-15T21:14:44.312621] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-15T21:14:44.347941] [INFO ] [MAIN ] Derivative Progress: 519/2083 symbols completed. DHI took 1.1s. Estimated remaining: 8m 40s. Rate: 180.4 symbols/min [2025-09-15T21:14:44.383116] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:44.388440] [DEBUG] [LOCAL ] DHR: Loaded 39395 existing records from primary storage. [2025-09-15T21:14:44.389090] [INFO ] [MAIN ] DHR: Loaded 39395 primary data records. [2025-09-15T21:14:44.739143] [DEBUG] [LOCAL ] DIN: Loaded 26800 existing records from primary storage. [2025-09-15T21:14:44.759533] [INFO ] [MAIN ] DIN: Loaded 26800 primary data records. [2025-09-15T21:14:45.194496] [DEBUG] [MAIN ] DHX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:45.198080] [INFO ] [MAIN ] DHX: Generated 1326 derivative records from 9039 primary records. [2025-09-15T21:14:45.199043] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-15T21:14:45.227076] [DEBUG] [MAIN ] DHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:45.227180] [DEBUG] [LOCAL ] DHX: Derivative data saved (1326 records). [2025-09-15T21:14:45.227401] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-15T21:14:45.228205] [INFO ] [MAIN ] DHR: Generated 1326 derivative records from 39395 primary records. [2025-09-15T21:14:45.229903] [INFO ] [MAIN ] Derivative Progress: 520/2083 symbols completed. DHX took 1.0s. Estimated remaining: 8m 41s. Rate: 179.8 symbols/min [2025-09-15T21:14:45.228338] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-15T21:14:45.230931] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:45.245138] [DEBUG] [LOCAL ] DHR: Derivative data saved (1326 records). [2025-09-15T21:14:45.245460] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-15T21:14:45.247470] [INFO ] [MAIN ] Derivative Progress: 521/2083 symbols completed. DHR took 1.1s. Estimated remaining: 8m 40s. Rate: 180.2 symbols/min [2025-09-15T21:14:45.247854] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:45.261558] [DEBUG] [MAIN ] DIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:45.262410] [INFO ] [MAIN ] DIN: Generated 1326 derivative records from 26800 primary records. [2025-09-15T21:14:45.262584] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-15T21:14:45.275460] [DEBUG] [LOCAL ] DIN: Derivative data saved (1326 records). [2025-09-15T21:14:45.275718] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-15T21:14:45.277586] [INFO ] [MAIN ] Derivative Progress: 522/2083 symbols completed. DIN took 0.9s. Estimated remaining: 8m 39s. Rate: 180.5 symbols/min [2025-09-15T21:14:45.278041] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:45.318758] [DEBUG] [LOCAL ] DINO: Loaded 39092 existing records from primary storage. [2025-09-15T21:14:45.319063] [INFO ] [MAIN ] DINO: Loaded 39092 primary data records. [2025-09-15T21:14:45.454786] [DEBUG] [LOCAL ] DIS: Loaded 39748 existing records from primary storage. [2025-09-15T21:14:45.467693] [INFO ] [MAIN ] DIS: Loaded 39748 primary data records. [2025-09-15T21:14:45.468941] [DEBUG] [LOCAL ] DK: Loaded 36616 existing records from primary storage. [2025-09-15T21:14:45.490009] [INFO ] [MAIN ] DK: Loaded 36616 primary data records. [2025-09-15T21:14:46.246751] [DEBUG] [MAIN ] DINO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:46.248052] [INFO ] [MAIN ] DINO: Generated 1326 derivative records from 39092 primary records. [2025-09-15T21:14:46.248929] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-15T21:14:46.273300] [DEBUG] [LOCAL ] DINO: Derivative data saved (1326 records). [2025-09-15T21:14:46.273236] [DEBUG] [MAIN ] DIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:46.274296] [INFO ] [MAIN ] DIS: Generated 1326 derivative records from 39748 primary records. [2025-09-15T21:14:46.273598] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-15T21:14:46.277425] [INFO ] [MAIN ] Derivative Progress: 523/2083 symbols completed. DINO took 1.0s. Estimated remaining: 8m 41s. Rate: 179.8 symbols/min [2025-09-15T21:14:46.274615] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-15T21:14:46.299472] [DEBUG] [MAIN ] DK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:46.302339] [INFO ] [MAIN ] DK: Generated 1326 derivative records from 36616 primary records. [2025-09-15T21:14:46.303017] [DEBUG] [LOCAL ] DIS: Derivative data saved (1326 records). [2025-09-15T21:14:46.303092] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-15T21:14:46.303445] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-15T21:14:46.306439] [INFO ] [MAIN ] Derivative Progress: 524/2083 symbols completed. DIS took 1.1s. Estimated remaining: 8m 39s. Rate: 180.1 symbols/min [2025-09-15T21:14:46.318064] [DEBUG] [LOCAL ] DK: Derivative data saved (1326 records). [2025-09-15T21:14:46.318124] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-15T21:14:46.320231] [INFO ] [MAIN ] Derivative Progress: 525/2083 symbols completed. DK took 1.0s. Estimated remaining: 8m 38s. Rate: 180.4 symbols/min [2025-09-15T21:14:46.320844] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:46.320798] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:46.320975] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:46.338951] [DEBUG] [LOCAL ] DKL: Loaded 12610 existing records from primary storage. [2025-09-15T21:14:46.339148] [INFO ] [MAIN ] DKL: Loaded 12610 primary data records. [2025-09-15T21:14:46.505249] [DEBUG] [LOCAL ] DLB: Loaded 23670 existing records from primary storage. [2025-09-15T21:14:46.538625] [INFO ] [MAIN ] DLB: Loaded 23670 primary data records. [2025-09-15T21:14:46.680842] [DEBUG] [LOCAL ] DKS: Loaded 36782 existing records from primary storage. [2025-09-15T21:14:46.707192] [INFO ] [MAIN ] DKS: Loaded 36782 primary data records. [2025-09-15T21:14:47.209510] [DEBUG] [MAIN ] DKL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:47.211127] [INFO ] [MAIN ] DKL: Generated 1326 derivative records from 12610 primary records. [2025-09-15T21:14:47.211535] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-15T21:14:47.226995] [DEBUG] [LOCAL ] DKL: Derivative data saved (1326 records). [2025-09-15T21:14:47.227230] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-15T21:14:47.229600] [INFO ] [MAIN ] Derivative Progress: 526/2083 symbols completed. DKL took 0.9s. Estimated remaining: 8m 39s. Rate: 179.8 symbols/min [2025-09-15T21:14:47.229887] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:47.248478] [DEBUG] [LOCAL ] DLNG: Loaded 4259 existing records from primary storage. [2025-09-15T21:14:47.248242] [DEBUG] [MAIN ] DLB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:47.249337] [INFO ] [MAIN ] DLNG: Loaded 4259 primary data records. [2025-09-15T21:14:47.255501] [INFO ] [MAIN ] DLB: Generated 1326 derivative records from 23670 primary records. [2025-09-15T21:14:47.256326] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-15T21:14:47.381225] [DEBUG] [LOCAL ] DLB: Derivative data saved (1326 records). [2025-09-15T21:14:47.382308] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-15T21:14:47.382218] [DEBUG] [MAIN ] DKS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:47.384739] [INFO ] [MAIN ] Derivative Progress: 527/2083 symbols completed. DLB took 1.1s. Estimated remaining: 8m 39s. Rate: 180.0 symbols/min [2025-09-15T21:14:47.391411] [INFO ] [MAIN ] DKS: Generated 1326 derivative records from 36782 primary records. [2025-09-15T21:14:47.391735] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:47.412674] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-15T21:14:47.485975] [DEBUG] [LOCAL ] DKS: Derivative data saved (1326 records). [2025-09-15T21:14:47.611417] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-15T21:14:47.625332] [INFO ] [MAIN ] Derivative Progress: 528/2083 symbols completed. DKS took 1.3s. Estimated remaining: 8m 38s. Rate: 180.1 symbols/min [2025-09-15T21:14:47.625685] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:47.663825] [DEBUG] [MAIN ] DLNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:47.671724] [INFO ] [MAIN ] DLNG: Generated 1326 derivative records from 4259 primary records. [2025-09-15T21:14:47.671845] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-15T21:14:47.672622] [DEBUG] [LOCAL ] DLX: Loaded 21432 existing records from primary storage. [2025-09-15T21:14:47.673059] [INFO ] [MAIN ] DLX: Loaded 21432 primary data records. [2025-09-15T21:14:47.754361] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1326 records). [2025-09-15T21:14:47.809376] [DEBUG] [LOCAL ] DLR: Loaded 37449 existing records from primary storage. [2025-09-15T21:14:47.797086] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-15T21:14:47.825306] [INFO ] [MAIN ] DLR: Loaded 37449 primary data records. [2025-09-15T21:14:47.827182] [INFO ] [MAIN ] Derivative Progress: 529/2083 symbols completed. DLNG took 0.6s. Estimated remaining: 8m 37s. Rate: 180.3 symbols/min [2025-09-15T21:14:47.887395] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:48.075229] [DEBUG] [LOCAL ] DMA: Loaded 3612 existing records from primary storage. [2025-09-15T21:14:48.075436] [INFO ] [MAIN ] DMA: Loaded 3612 primary data records. [2025-09-15T21:14:48.545990] [DEBUG] [MAIN ] DLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:48.547143] [INFO ] [MAIN ] DLX: Generated 1326 derivative records from 21432 primary records. [2025-09-15T21:14:48.547415] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-15T21:14:48.563715] [DEBUG] [LOCAL ] DLX: Derivative data saved (1326 records). [2025-09-15T21:14:48.564036] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-15T21:14:48.565658] [INFO ] [MAIN ] Derivative Progress: 530/2083 symbols completed. DLX took 0.9s. Estimated remaining: 8m 38s. Rate: 179.8 symbols/min [2025-09-15T21:14:48.566952] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:48.580883] [DEBUG] [MAIN ] DLR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:48.584592] [INFO ] [MAIN ] DLR: Generated 1326 derivative records from 37449 primary records. [2025-09-15T21:14:48.585179] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-15T21:14:48.602168] [DEBUG] [LOCAL ] DMB: Loaded 7871 existing records from primary storage. [2025-09-15T21:14:48.604027] [INFO ] [MAIN ] DMB: Loaded 7871 primary data records. [2025-09-15T21:14:48.679182] [DEBUG] [MAIN ] DMA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:48.702596] [DEBUG] [LOCAL ] DLR: Derivative data saved (1326 records). [2025-09-15T21:14:48.717065] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-15T21:14:48.722322] [INFO ] [MAIN ] Derivative Progress: 531/2083 symbols completed. DLR took 1.3s. Estimated remaining: 8m 37s. Rate: 180.0 symbols/min [2025-09-15T21:14:48.723308] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:48.723112] [INFO ] [MAIN ] DMA: Generated 1326 derivative records from 3612 primary records. [2025-09-15T21:14:48.729347] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-15T21:14:48.907768] [DEBUG] [LOCAL ] DMO: Loaded 6850 existing records from primary storage. [2025-09-15T21:14:48.909102] [INFO ] [MAIN ] DMO: Loaded 6850 primary data records. [2025-09-15T21:14:48.931073] [DEBUG] [LOCAL ] DMA: Derivative data saved (1326 records). [2025-09-15T21:14:48.947307] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-15T21:14:48.986538] [INFO ] [MAIN ] Derivative Progress: 532/2083 symbols completed. DMA took 1.1s. Estimated remaining: 8m 37s. Rate: 180.1 symbols/min [2025-09-15T21:14:48.987239] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:49.220550] [DEBUG] [MAIN ] DMB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:49.222247] [INFO ] [MAIN ] DMB: Generated 1326 derivative records from 7871 primary records. [2025-09-15T21:14:49.222458] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-15T21:14:49.244313] [DEBUG] [LOCAL ] DNA: Loaded 35541 existing records from primary storage. [2025-09-15T21:14:49.245616] [INFO ] [MAIN ] DNA: Loaded 35541 primary data records. [2025-09-15T21:14:49.302075] [DEBUG] [LOCAL ] DMB: Derivative data saved (1326 records). [2025-09-15T21:14:49.317941] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-15T21:14:49.319709] [INFO ] [MAIN ] Derivative Progress: 533/2083 symbols completed. DMB took 0.8s. Estimated remaining: 8m 36s. Rate: 180.1 symbols/min [2025-09-15T21:14:49.333084] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:49.365012] [DEBUG] [MAIN ] DMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:49.382746] [INFO ] [MAIN ] DMO: Generated 1326 derivative records from 6850 primary records. [2025-09-15T21:14:49.393171] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-15T21:14:49.542678] [DEBUG] [LOCAL ] DMO: Derivative data saved (1326 records). [2025-09-15T21:14:49.543248] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-15T21:14:49.545413] [INFO ] [MAIN ] Derivative Progress: 534/2083 symbols completed. DMO took 0.8s. Estimated remaining: 8m 36s. Rate: 180.2 symbols/min [2025-09-15T21:14:49.545767] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:49.556848] [DEBUG] [LOCAL ] DNP: Loaded 24357 existing records from primary storage. [2025-09-15T21:14:49.557515] [INFO ] [MAIN ] DNP: Loaded 24357 primary data records. [2025-09-15T21:14:49.904022] [DEBUG] [LOCAL ] DOC: Loaded 39535 existing records from primary storage. [2025-09-15T21:14:49.906169] [INFO ] [MAIN ] DOC: Loaded 39535 primary data records. [2025-09-15T21:14:50.001521] [DEBUG] [MAIN ] DNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:50.026952] [INFO ] [MAIN ] DNA: Generated 1326 derivative records from 35541 primary records. [2025-09-15T21:14:50.030917] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-15T21:14:50.209412] [DEBUG] [LOCAL ] DNA: Derivative data saved (1326 records). [2025-09-15T21:14:50.221327] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-15T21:14:50.223319] [INFO ] [MAIN ] Derivative Progress: 535/2083 symbols completed. DNA took 1.2s. Estimated remaining: 8m 36s. Rate: 179.9 symbols/min [2025-09-15T21:14:50.227189] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:50.243754] [DEBUG] [MAIN ] DNP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:50.245051] [INFO ] [MAIN ] DNP: Generated 1326 derivative records from 24357 primary records. [2025-09-15T21:14:50.245576] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-15T21:14:50.261259] [DEBUG] [LOCAL ] DNP: Derivative data saved (1326 records). [2025-09-15T21:14:50.261569] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-15T21:14:50.265213] [INFO ] [MAIN ] Derivative Progress: 536/2083 symbols completed. DNP took 0.9s. Estimated remaining: 8m 35s. Rate: 180.2 symbols/min [2025-09-15T21:14:50.266443] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:50.290463] [DEBUG] [MAIN ] DOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:50.291431] [INFO ] [MAIN ] DOC: Generated 1326 derivative records from 39535 primary records. [2025-09-15T21:14:50.291570] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-15T21:14:50.319291] [DEBUG] [LOCAL ] DOC: Derivative data saved (1326 records). [2025-09-15T21:14:50.320881] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-15T21:14:50.324569] [INFO ] [MAIN ] Derivative Progress: 537/2083 symbols completed. DOC took 0.8s. Estimated remaining: 8m 34s. Rate: 180.4 symbols/min [2025-09-15T21:14:50.324966] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:50.326471] [DEBUG] [LOCAL ] DOCN: Loaded 37526 existing records from primary storage. [2025-09-15T21:14:50.334682] [INFO ] [MAIN ] DOCN: Loaded 37526 primary data records. [2025-09-15T21:14:50.468498] [DEBUG] [LOCAL ] DOCS: Loaded 37582 existing records from primary storage. [2025-09-15T21:14:50.468837] [INFO ] [MAIN ] DOCS: Loaded 37582 primary data records. [2025-09-15T21:14:50.696240] [DEBUG] [LOCAL ] DOLE: Loaded 28240 existing records from primary storage. [2025-09-15T21:14:50.764219] [INFO ] [MAIN ] DOLE: Loaded 28240 primary data records. [2025-09-15T21:14:51.249952] [DEBUG] [MAIN ] DOCN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:51.252328] [INFO ] [MAIN ] DOCN: Generated 1326 derivative records from 37526 primary records. [2025-09-15T21:14:51.252896] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-15T21:14:51.266876] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1326 records). [2025-09-15T21:14:51.267153] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-15T21:14:51.268760] [INFO ] [MAIN ] Derivative Progress: 538/2083 symbols completed. DOCN took 1.0s. Estimated remaining: 8m 36s. Rate: 179.8 symbols/min [2025-09-15T21:14:51.283595] [DEBUG] [MAIN ] DOCS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:51.285461] [INFO ] [MAIN ] DOCS: Generated 1326 derivative records from 37582 primary records. [2025-09-15T21:14:51.285636] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-15T21:14:51.301393] [DEBUG] [MAIN ] DOLE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:51.305079] [INFO ] [MAIN ] DOLE: Generated 1326 derivative records from 28240 primary records. [2025-09-15T21:14:51.305534] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-15T21:14:51.316966] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1326 records). [2025-09-15T21:14:51.317422] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-15T21:14:51.319481] [INFO ] [MAIN ] Derivative Progress: 539/2083 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 34s. Rate: 180.1 symbols/min [2025-09-15T21:14:51.322217] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1326 records). [2025-09-15T21:14:51.322280] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-15T21:14:51.324006] [INFO ] [MAIN ] Derivative Progress: 540/2083 symbols completed. DOLE took 1.0s. Estimated remaining: 8m 33s. Rate: 180.4 symbols/min [2025-09-15T21:14:51.324726] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:51.324826] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:51.325422] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:51.337627] [DEBUG] [LOCAL ] DPG: Loaded 9724 existing records from primary storage. [2025-09-15T21:14:51.337830] [INFO ] [MAIN ] DPG: Loaded 9724 primary data records. [2025-09-15T21:14:51.515268] [DEBUG] [LOCAL ] DOUG: Loaded 25700 existing records from primary storage. [2025-09-15T21:14:51.549700] [INFO ] [MAIN ] DOUG: Loaded 25700 primary data records. [2025-09-15T21:14:51.747280] [DEBUG] [LOCAL ] DOW: Loaded 39693 existing records from primary storage. [2025-09-15T21:14:51.766053] [INFO ] [MAIN ] DOW: Loaded 39693 primary data records. [2025-09-15T21:14:52.312084] [DEBUG] [MAIN ] DPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:52.323523] [INFO ] [MAIN ] DPG: Generated 1326 derivative records from 9724 primary records. [2025-09-15T21:14:52.324375] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-15T21:14:52.324135] [DEBUG] [MAIN ] DOUG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:52.325379] [INFO ] [MAIN ] DOUG: Generated 1326 derivative records from 25700 primary records. [2025-09-15T21:14:52.325750] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-15T21:14:52.349220] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1326 records). [2025-09-15T21:14:52.349428] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-15T21:14:52.353566] [INFO ] [MAIN ] Derivative Progress: 541/2083 symbols completed. DOUG took 1.0s. Estimated remaining: 8m 35s. Rate: 179.7 symbols/min [2025-09-15T21:14:52.355333] [DEBUG] [LOCAL ] DPG: Derivative data saved (1326 records). [2025-09-15T21:14:52.355576] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:52.355795] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-15T21:14:52.360472] [INFO ] [MAIN ] Derivative Progress: 542/2083 symbols completed. DPG took 1.0s. Estimated remaining: 8m 34s. Rate: 180.1 symbols/min [2025-09-15T21:14:52.361717] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:52.372537] [DEBUG] [MAIN ] DOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:52.373752] [INFO ] [MAIN ] DOW: Generated 1326 derivative records from 39693 primary records. [2025-09-15T21:14:52.374083] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-15T21:14:52.387506] [DEBUG] [LOCAL ] DOW: Derivative data saved (1326 records). [2025-09-15T21:14:52.387629] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-15T21:14:52.389381] [INFO ] [MAIN ] Derivative Progress: 543/2083 symbols completed. DOW took 1.1s. Estimated remaining: 8m 32s. Rate: 180.4 symbols/min [2025-09-15T21:14:52.389763] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:52.425119] [DEBUG] [LOCAL ] DRD: Loaded 26240 existing records from primary storage. [2025-09-15T21:14:52.425764] [INFO ] [MAIN ] DRD: Loaded 26240 primary data records. [2025-09-15T21:14:52.473583] [DEBUG] [LOCAL ] DQ: Loaded 31306 existing records from primary storage. [2025-09-15T21:14:52.501345] [INFO ] [MAIN ] DQ: Loaded 31306 primary data records. [2025-09-15T21:14:52.714924] [DEBUG] [LOCAL ] DRH: Loaded 37030 existing records from primary storage. [2025-09-15T21:14:52.744393] [INFO ] [MAIN ] DRH: Loaded 37030 primary data records. [2025-09-15T21:14:53.344499] [DEBUG] [MAIN ] DRD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:53.345470] [INFO ] [MAIN ] DRD: Generated 1326 derivative records from 26240 primary records. [2025-09-15T21:14:53.345750] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-15T21:14:53.357184] [DEBUG] [MAIN ] DQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:53.364918] [INFO ] [MAIN ] DQ: Generated 1326 derivative records from 31306 primary records. [2025-09-15T21:14:53.373007] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-15T21:14:53.373093] [DEBUG] [LOCAL ] DRD: Derivative data saved (1326 records). [2025-09-15T21:14:53.380990] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-15T21:14:53.388008] [INFO ] [MAIN ] Derivative Progress: 544/2083 symbols completed. DRD took 1.0s. Estimated remaining: 8m 34s. Rate: 179.7 symbols/min [2025-09-15T21:14:53.389872] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:53.399403] [DEBUG] [LOCAL ] DQ: Derivative data saved (1326 records). [2025-09-15T21:14:53.403945] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-15T21:14:53.406020] [INFO ] [MAIN ] Derivative Progress: 545/2083 symbols completed. DQ took 1.1s. Estimated remaining: 8m 33s. Rate: 180.0 symbols/min [2025-09-15T21:14:53.406717] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:53.406406] [DEBUG] [MAIN ] DRH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:53.408040] [INFO ] [MAIN ] DRH: Generated 1326 derivative records from 37030 primary records. [2025-09-15T21:14:53.408156] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-15T21:14:53.423049] [DEBUG] [LOCAL ] DRH: Derivative data saved (1326 records). [2025-09-15T21:14:53.423192] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-15T21:14:53.424906] [INFO ] [MAIN ] Derivative Progress: 546/2083 symbols completed. DRH took 1.0s. Estimated remaining: 8m 31s. Rate: 180.3 symbols/min [2025-09-15T21:14:53.425278] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:53.429548] [DEBUG] [LOCAL ] DRLL: Loaded 6438 existing records from primary storage. [2025-09-15T21:14:53.429696] [INFO ] [MAIN ] DRLL: Loaded 6438 primary data records. [2025-09-15T21:14:53.650606] [DEBUG] [LOCAL ] DRI: Loaded 34727 existing records from primary storage. [2025-09-15T21:14:53.734234] [DEBUG] [LOCAL ] DSL: Loaded 19964 existing records from primary storage. [2025-09-15T21:14:53.734334] [INFO ] [MAIN ] DRI: Loaded 34727 primary data records. [2025-09-15T21:14:53.735058] [INFO ] [MAIN ] DSL: Loaded 19964 primary data records. [2025-09-15T21:14:54.281710] [DEBUG] [MAIN ] DRLL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:54.283285] [INFO ] [MAIN ] DRLL: Generated 1326 derivative records from 6438 primary records. [2025-09-15T21:14:54.283580] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-15T21:14:54.300117] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1326 records). [2025-09-15T21:14:54.300440] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-15T21:14:54.302834] [INFO ] [MAIN ] Derivative Progress: 547/2083 symbols completed. DRLL took 0.9s. Estimated remaining: 8m 33s. Rate: 179.8 symbols/min [2025-09-15T21:14:54.303343] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:54.330981] [DEBUG] [MAIN ] DSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:54.332103] [DEBUG] [MAIN ] DRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:54.331859] [INFO ] [MAIN ] DSL: Generated 1326 derivative records from 19964 primary records. [2025-09-15T21:14:54.332884] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-15T21:14:54.332826] [INFO ] [MAIN ] DRI: Generated 1326 derivative records from 34727 primary records. [2025-09-15T21:14:54.343135] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-15T21:14:54.344550] [DEBUG] [LOCAL ] DSM: Loaded 10060 existing records from primary storage. [2025-09-15T21:14:54.344896] [INFO ] [MAIN ] DSM: Loaded 10060 primary data records. [2025-09-15T21:14:54.403169] [DEBUG] [LOCAL ] DRI: Derivative data saved (1326 records). [2025-09-15T21:14:54.415921] [DEBUG] [LOCAL ] DSL: Derivative data saved (1326 records). [2025-09-15T21:14:54.424737] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-15T21:14:54.424673] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-15T21:14:54.438032] [INFO ] [MAIN ] Derivative Progress: 548/2083 symbols completed. DRI took 1.0s. Estimated remaining: 8m 32s. Rate: 180.0 symbols/min [2025-09-15T21:14:54.466413] [INFO ] [MAIN ] Derivative Progress: 549/2083 symbols completed. DSL took 1.0s. Estimated remaining: 8m 31s. Rate: 180.3 symbols/min [2025-09-15T21:14:54.466788] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:54.466728] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:54.518699] [DEBUG] [LOCAL ] DSMC: Loaded 1215 existing records from primary storage. [2025-09-15T21:14:54.531430] [INFO ] [MAIN ] DSMC: Loaded 1215 primary data records. [2025-09-15T21:14:54.631504] [DEBUG] [LOCAL ] DSX: Loaded 17629 existing records from primary storage. [2025-09-15T21:14:54.767685] [INFO ] [MAIN ] DSX: Loaded 17629 primary data records. [2025-09-15T21:14:55.227198] [DEBUG] [MAIN ] DSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:55.228427] [INFO ] [MAIN ] DSM: Generated 1326 derivative records from 10060 primary records. [2025-09-15T21:14:55.228531] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-15T21:14:55.248723] [DEBUG] [LOCAL ] DSM: Derivative data saved (1326 records). [2025-09-15T21:14:55.253423] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-15T21:14:55.253373] [DEBUG] [MAIN ] DSMC: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:14:55.255249] [INFO ] [MAIN ] Derivative Progress: 550/2083 symbols completed. DSM took 1.0s. Estimated remaining: 8m 31s. Rate: 179.8 symbols/min [2025-09-15T21:14:55.255970] [INFO ] [MAIN ] DSMC: Generated 1325 derivative records from 1215 primary records. [2025-09-15T21:14:55.256532] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-15T21:14:55.256666] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:55.269141] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1325 records). [2025-09-15T21:14:55.270238] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-15T21:14:55.274057] [INFO ] [MAIN ] Derivative Progress: 551/2083 symbols completed. DSMC took 0.8s. Estimated remaining: 8m 30s. Rate: 180.1 symbols/min [2025-09-15T21:14:55.274549] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:55.284323] [DEBUG] [MAIN ] DSX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:55.285179] [INFO ] [MAIN ] DSX: Generated 1326 derivative records from 17629 primary records. [2025-09-15T21:14:55.285322] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-15T21:14:55.300908] [DEBUG] [LOCAL ] DTB: Loaded 3739 existing records from primary storage. [2025-09-15T21:14:55.301517] [DEBUG] [LOCAL ] DSX: Derivative data saved (1326 records). [2025-09-15T21:14:55.301660] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-15T21:14:55.301714] [INFO ] [MAIN ] DTB: Loaded 3739 primary data records. [2025-09-15T21:14:55.303721] [INFO ] [MAIN ] Derivative Progress: 552/2083 symbols completed. DSX took 0.8s. Estimated remaining: 8m 29s. Rate: 180.4 symbols/min [2025-09-15T21:14:55.324590] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:55.479197] [DEBUG] [LOCAL ] DT: Loaded 39040 existing records from primary storage. [2025-09-15T21:14:55.578220] [INFO ] [MAIN ] DT: Loaded 39040 primary data records. [2025-09-15T21:14:55.721561] [DEBUG] [LOCAL ] DTE: Loaded 35164 existing records from primary storage. [2025-09-15T21:14:55.748664] [INFO ] [MAIN ] DTE: Loaded 35164 primary data records. [2025-09-15T21:14:56.035877] [DEBUG] [MAIN ] DTB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:56.069635] [INFO ] [MAIN ] DTB: Generated 1326 derivative records from 3739 primary records. [2025-09-15T21:14:56.176149] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-15T21:14:56.193799] [DEBUG] [LOCAL ] DTB: Derivative data saved (1326 records). [2025-09-15T21:14:56.194201] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-15T21:14:56.196871] [INFO ] [MAIN ] Derivative Progress: 553/2083 symbols completed. DTB took 0.9s. Estimated remaining: 8m 30s. Rate: 179.9 symbols/min [2025-09-15T21:14:56.210200] [DEBUG] [MAIN ] DT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:56.210987] [INFO ] [MAIN ] DT: Generated 1326 derivative records from 39040 primary records. [2025-09-15T21:14:56.211189] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-15T21:14:56.234608] [DEBUG] [LOCAL ] DT: Derivative data saved (1326 records). [2025-09-15T21:14:56.234910] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-15T21:14:56.234822] [DEBUG] [MAIN ] DTE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:56.237066] [INFO ] [MAIN ] Derivative Progress: 554/2083 symbols completed. DT took 1.0s. Estimated remaining: 8m 29s. Rate: 180.2 symbols/min [2025-09-15T21:14:56.237717] [INFO ] [MAIN ] DTE: Generated 1326 derivative records from 35164 primary records. [2025-09-15T21:14:56.237910] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-15T21:14:56.249765] [DEBUG] [LOCAL ] DTE: Derivative data saved (1326 records). [2025-09-15T21:14:56.249821] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-15T21:14:56.251954] [INFO ] [MAIN ] Derivative Progress: 555/2083 symbols completed. DTE took 0.9s. Estimated remaining: 8m 28s. Rate: 180.5 symbols/min [2025-09-15T21:14:56.252601] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:56.252832] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:56.252727] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:56.260351] [DEBUG] [LOCAL ] DTW: Loaded 3503 existing records from primary storage. [2025-09-15T21:14:56.260529] [INFO ] [MAIN ] DTW: Loaded 3503 primary data records. [2025-09-15T21:14:56.548881] [DEBUG] [LOCAL ] DTM: Loaded 31775 existing records from primary storage. [2025-09-15T21:14:56.549193] [INFO ] [MAIN ] DTM: Loaded 31775 primary data records. [2025-09-15T21:14:56.663030] [DEBUG] [LOCAL ] DUK: Loaded 39449 existing records from primary storage. [2025-09-15T21:14:56.663726] [INFO ] [MAIN ] DUK: Loaded 39449 primary data records. [2025-09-15T21:14:57.143627] [DEBUG] [MAIN ] DTW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:57.144762] [INFO ] [MAIN ] DTW: Generated 1326 derivative records from 3503 primary records. [2025-09-15T21:14:57.144981] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-15T21:14:57.158922] [DEBUG] [LOCAL ] DTW: Derivative data saved (1326 records). [2025-09-15T21:14:57.159584] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-15T21:14:57.162399] [INFO ] [MAIN ] Derivative Progress: 556/2083 symbols completed. DTW took 0.9s. Estimated remaining: 8m 29s. Rate: 179.9 symbols/min [2025-09-15T21:14:57.163282] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:57.179177] [DEBUG] [MAIN ] DTM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:57.181861] [DEBUG] [LOCAL ] DUKB: Loaded 4653 existing records from primary storage. [2025-09-15T21:14:57.182751] [INFO ] [MAIN ] DTM: Generated 1326 derivative records from 31775 primary records. [2025-09-15T21:14:57.182900] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-15T21:14:57.182859] [INFO ] [MAIN ] DUKB: Loaded 4653 primary data records. [2025-09-15T21:14:57.315919] [DEBUG] [MAIN ] DUK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:57.329271] [INFO ] [MAIN ] DUK: Generated 1326 derivative records from 39449 primary records. [2025-09-15T21:14:57.329469] [DEBUG] [LOCAL ] DTM: Derivative data saved (1326 records). [2025-09-15T21:14:57.339852] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-15T21:14:57.345034] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-15T21:14:57.371919] [INFO ] [MAIN ] Derivative Progress: 557/2083 symbols completed. DTM took 1.1s. Estimated remaining: 8m 29s. Rate: 180.0 symbols/min [2025-09-15T21:14:57.409051] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:57.501047] [DEBUG] [LOCAL ] DUK: Derivative data saved (1326 records). [2025-09-15T21:14:57.502077] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-15T21:14:57.504228] [INFO ] [MAIN ] Derivative Progress: 558/2083 symbols completed. DUK took 1.3s. Estimated remaining: 8m 28s. Rate: 180.2 symbols/min [2025-09-15T21:14:57.505343] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:57.539320] [DEBUG] [MAIN ] DUKB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:57.547022] [INFO ] [MAIN ] DUKB: Generated 1326 derivative records from 4653 primary records. [2025-09-15T21:14:57.547658] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-15T21:14:57.569380] [DEBUG] [LOCAL ] DV: Loaded 37587 existing records from primary storage. [2025-09-15T21:14:57.570283] [INFO ] [MAIN ] DV: Loaded 37587 primary data records. [2025-09-15T21:14:57.583119] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1326 records). [2025-09-15T21:14:57.583269] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-15T21:14:57.619514] [DEBUG] [LOCAL ] DVA: Loaded 30220 existing records from primary storage. [2025-09-15T21:14:57.628838] [INFO ] [MAIN ] Derivative Progress: 559/2083 symbols completed. DUKB took 0.5s. Estimated remaining: 8m 27s. Rate: 180.4 symbols/min [2025-09-15T21:14:57.666585] [INFO ] [MAIN ] DVA: Loaded 30220 primary data records. [2025-09-15T21:14:57.671922] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:58.137798] [DEBUG] [LOCAL ] DVN: Loaded 39659 existing records from primary storage. [2025-09-15T21:14:58.138534] [INFO ] [MAIN ] DVN: Loaded 39659 primary data records. [2025-09-15T21:14:58.338439] [DEBUG] [MAIN ] DV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:58.339713] [INFO ] [MAIN ] DV: Generated 1326 derivative records from 37587 primary records. [2025-09-15T21:14:58.432303] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-15T21:14:58.450880] [DEBUG] [MAIN ] DVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:58.455284] [INFO ] [MAIN ] DVA: Generated 1326 derivative records from 30220 primary records. [2025-09-15T21:14:58.455992] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-15T21:14:58.460466] [DEBUG] [LOCAL ] DV: Derivative data saved (1326 records). [2025-09-15T21:14:58.469564] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-15T21:14:58.471305] [INFO ] [MAIN ] Derivative Progress: 560/2083 symbols completed. DV took 1.1s. Estimated remaining: 8m 28s. Rate: 179.9 symbols/min [2025-09-15T21:14:58.473027] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:58.474852] [DEBUG] [LOCAL ] DVA: Derivative data saved (1326 records). [2025-09-15T21:14:58.475126] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-15T21:14:58.477417] [INFO ] [MAIN ] Derivative Progress: 561/2083 symbols completed. DVA took 1.0s. Estimated remaining: 8m 27s. Rate: 180.3 symbols/min [2025-09-15T21:14:58.477837] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:58.499151] [DEBUG] [MAIN ] DVN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:58.500115] [INFO ] [MAIN ] DVN: Generated 1326 derivative records from 39659 primary records. [2025-09-15T21:14:58.500235] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-15T21:14:58.529941] [DEBUG] [LOCAL ] DVN: Derivative data saved (1326 records). [2025-09-15T21:14:58.530176] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-15T21:14:58.532099] [INFO ] [MAIN ] Derivative Progress: 562/2083 symbols completed. DVN took 0.9s. Estimated remaining: 8m 26s. Rate: 180.5 symbols/min [2025-09-15T21:14:58.532441] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:58.557292] [DEBUG] [LOCAL ] DX: Loaded 38676 existing records from primary storage. [2025-09-15T21:14:58.558064] [INFO ] [MAIN ] DX: Loaded 38676 primary data records. [2025-09-15T21:14:58.557832] [DEBUG] [LOCAL ] DXC: Loaded 36743 existing records from primary storage. [2025-09-15T21:14:58.558283] [INFO ] [MAIN ] DXC: Loaded 36743 primary data records. [2025-09-15T21:14:59.023915] [DEBUG] [LOCAL ] DXYZ: Loaded 26469 existing records from primary storage. [2025-09-15T21:14:59.158280] [INFO ] [MAIN ] DXYZ: Loaded 26469 primary data records. [2025-09-15T21:14:59.441164] [DEBUG] [MAIN ] DXC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:59.443212] [INFO ] [MAIN ] DXC: Generated 1326 derivative records from 36743 primary records. [2025-09-15T21:14:59.443411] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-15T21:14:59.463873] [DEBUG] [MAIN ] DX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:59.465397] [INFO ] [MAIN ] DX: Generated 1326 derivative records from 38676 primary records. [2025-09-15T21:14:59.465552] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-15T21:14:59.477771] [DEBUG] [LOCAL ] DXC: Derivative data saved (1326 records). [2025-09-15T21:14:59.478783] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-15T21:14:59.481759] [INFO ] [MAIN ] Derivative Progress: 563/2083 symbols completed. DXC took 1.0s. Estimated remaining: 8m 27s. Rate: 179.9 symbols/min [2025-09-15T21:14:59.482002] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:59.479745] [DEBUG] [LOCAL ] DX: Derivative data saved (1326 records). [2025-09-15T21:14:59.482237] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-15T21:14:59.483858] [INFO ] [MAIN ] Derivative Progress: 564/2083 symbols completed. DX took 1.0s. Estimated remaining: 8m 26s. Rate: 180.3 symbols/min [2025-09-15T21:14:59.484941] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:59.497613] [DEBUG] [MAIN ] DXYZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:14:59.498443] [INFO ] [MAIN ] DXYZ: Generated 1326 derivative records from 26469 primary records. [2025-09-15T21:14:59.498586] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-15T21:14:59.516001] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1326 records). [2025-09-15T21:14:59.516159] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-15T21:14:59.517754] [INFO ] [MAIN ] Derivative Progress: 565/2083 symbols completed. DXYZ took 1.0s. Estimated remaining: 8m 24s. Rate: 180.5 symbols/min [2025-09-15T21:14:59.518094] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:14:59.538952] [DEBUG] [LOCAL ] DY: Loaded 20943 existing records from primary storage. [2025-09-15T21:14:59.539963] [INFO ] [MAIN ] DY: Loaded 20943 primary data records. [2025-09-15T21:14:59.561312] [DEBUG] [LOCAL ] E: Loaded 24276 existing records from primary storage. [2025-09-15T21:14:59.577592] [INFO ] [MAIN ] E: Loaded 24276 primary data records. [2025-09-15T21:14:59.862171] [DEBUG] [LOCAL ] EAF: Loaded 32555 existing records from primary storage. [2025-09-15T21:14:59.964753] [INFO ] [MAIN ] EAF: Loaded 32555 primary data records. [2025-09-15T21:15:00.366606] [DEBUG] [MAIN ] DY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:00.367516] [INFO ] [MAIN ] DY: Generated 1326 derivative records from 20943 primary records. [2025-09-15T21:15:00.376971] [DEBUG] [MAIN ] E: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:00.376712] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-15T21:15:00.378140] [INFO ] [MAIN ] E: Generated 1326 derivative records from 24276 primary records. [2025-09-15T21:15:00.379100] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-15T21:15:00.400634] [DEBUG] [LOCAL ] DY: Derivative data saved (1326 records). [2025-09-15T21:15:00.401209] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-15T21:15:00.403057] [INFO ] [MAIN ] Derivative Progress: 566/2083 symbols completed. DY took 0.9s. Estimated remaining: 8m 26s. Rate: 180.0 symbols/min [2025-09-15T21:15:00.403625] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:00.405709] [DEBUG] [LOCAL ] E: Derivative data saved (1326 records). [2025-09-15T21:15:00.405863] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-15T21:15:00.407536] [INFO ] [MAIN ] Derivative Progress: 567/2083 symbols completed. E took 0.9s. Estimated remaining: 8m 24s. Rate: 180.3 symbols/min [2025-09-15T21:15:00.407849] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:00.413964] [DEBUG] [LOCAL ] EAI: Loaded 2827 existing records from primary storage. [2025-09-15T21:15:00.414265] [INFO ] [MAIN ] EAI: Loaded 2827 primary data records. [2025-09-15T21:15:00.434980] [DEBUG] [MAIN ] EAF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:00.461397] [INFO ] [MAIN ] EAF: Generated 1326 derivative records from 32555 primary records. [2025-09-15T21:15:00.527143] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-15T21:15:00.588387] [DEBUG] [LOCAL ] EARN: Loaded 20059 existing records from primary storage. [2025-09-15T21:15:00.619483] [INFO ] [MAIN ] EARN: Loaded 20059 primary data records. [2025-09-15T21:15:00.738157] [DEBUG] [LOCAL ] EAF: Derivative data saved (1326 records). [2025-09-15T21:15:00.761959] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-15T21:15:00.791143] [INFO ] [MAIN ] Derivative Progress: 568/2083 symbols completed. EAF took 1.3s. Estimated remaining: 8m 24s. Rate: 180.3 symbols/min [2025-09-15T21:15:01.038119] [DEBUG] [MAIN ] EAI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:01.039104] [INFO ] [MAIN ] EAI: Generated 1326 derivative records from 2827 primary records. [2025-09-15T21:15:01.039329] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-15T21:15:01.053325] [DEBUG] [LOCAL ] EAI: Derivative data saved (1326 records). [2025-09-15T21:15:01.053750] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-15T21:15:01.055294] [INFO ] [MAIN ] Derivative Progress: 569/2083 symbols completed. EAI took 0.7s. Estimated remaining: 8m 24s. Rate: 180.3 symbols/min [2025-09-15T21:15:01.070677] [DEBUG] [MAIN ] EARN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:01.071538] [INFO ] [MAIN ] EARN: Generated 1326 derivative records from 20059 primary records. [2025-09-15T21:15:01.071721] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-15T21:15:01.084369] [DEBUG] [LOCAL ] EARN: Derivative data saved (1326 records). [2025-09-15T21:15:01.084527] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-15T21:15:01.086953] [INFO ] [MAIN ] Derivative Progress: 570/2083 symbols completed. EARN took 0.7s. Estimated remaining: 8m 23s. Rate: 180.6 symbols/min [2025-09-15T21:15:01.087775] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:01.088029] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:01.088565] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:01.109895] [DEBUG] [LOCAL ] EBF: Loaded 13862 existing records from primary storage. [2025-09-15T21:15:01.110134] [INFO ] [MAIN ] EBF: Loaded 13862 primary data records. [2025-09-15T21:15:01.278112] [DEBUG] [LOCAL ] EB: Loaded 26972 existing records from primary storage. [2025-09-15T21:15:01.307758] [INFO ] [MAIN ] EB: Loaded 26972 primary data records. [2025-09-15T21:15:01.336308] [DEBUG] [LOCAL ] EAT: Loaded 36616 existing records from primary storage. [2025-09-15T21:15:01.341771] [INFO ] [MAIN ] EAT: Loaded 36616 primary data records. [2025-09-15T21:15:02.120357] [DEBUG] [MAIN ] EBF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:02.121693] [INFO ] [MAIN ] EBF: Generated 1326 derivative records from 13862 primary records. [2025-09-15T21:15:02.122108] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-15T21:15:02.148850] [DEBUG] [LOCAL ] EBF: Derivative data saved (1326 records). [2025-09-15T21:15:02.149215] [DEBUG] [MAIN ] EB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:02.149536] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-15T21:15:02.152730] [INFO ] [MAIN ] Derivative Progress: 571/2083 symbols completed. EBF took 1.1s. Estimated remaining: 8m 24s. Rate: 179.9 symbols/min [2025-09-15T21:15:02.151092] [INFO ] [MAIN ] EB: Generated 1326 derivative records from 26972 primary records. [2025-09-15T21:15:02.154702] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:02.154839] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-15T21:15:02.166810] [DEBUG] [MAIN ] EAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:02.174043] [INFO ] [MAIN ] EAT: Generated 1326 derivative records from 36616 primary records. [2025-09-15T21:15:02.174182] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-15T21:15:02.191341] [DEBUG] [LOCAL ] EB: Derivative data saved (1326 records). [2025-09-15T21:15:02.192261] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-15T21:15:02.195238] [INFO ] [MAIN ] Derivative Progress: 572/2083 symbols completed. EB took 1.1s. Estimated remaining: 8m 23s. Rate: 180.2 symbols/min [2025-09-15T21:15:02.195673] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:02.201077] [DEBUG] [LOCAL ] EAT: Derivative data saved (1326 records). [2025-09-15T21:15:02.211815] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-15T21:15:02.214313] [INFO ] [MAIN ] Derivative Progress: 573/2083 symbols completed. EAT took 1.1s. Estimated remaining: 8m 22s. Rate: 180.5 symbols/min [2025-09-15T21:15:02.214703] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:02.230022] [DEBUG] [LOCAL ] EBR: Loaded 31335 existing records from primary storage. [2025-09-15T21:15:02.230231] [INFO ] [MAIN ] EBR: Loaded 31335 primary data records. [2025-09-15T21:15:02.440293] [DEBUG] [LOCAL ] EBS: Loaded 34806 existing records from primary storage. [2025-09-15T21:15:02.468790] [INFO ] [MAIN ] EBS: Loaded 34806 primary data records. [2025-09-15T21:15:02.642121] [DEBUG] [LOCAL ] EC: Loaded 36092 existing records from primary storage. [2025-09-15T21:15:02.665621] [INFO ] [MAIN ] EC: Loaded 36092 primary data records. [2025-09-15T21:15:03.165466] [DEBUG] [MAIN ] EBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:03.166562] [INFO ] [MAIN ] EBR: Generated 1326 derivative records from 31335 primary records. [2025-09-15T21:15:03.167388] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-15T21:15:03.182715] [DEBUG] [LOCAL ] EBR: Derivative data saved (1326 records). [2025-09-15T21:15:03.183087] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-15T21:15:03.186820] [INFO ] [MAIN ] Derivative Progress: 574/2083 symbols completed. EBR took 1.0s. Estimated remaining: 8m 23s. Rate: 179.9 symbols/min [2025-09-15T21:15:03.190875] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:03.205422] [DEBUG] [MAIN ] EBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:03.209279] [INFO ] [MAIN ] EBS: Generated 1326 derivative records from 34806 primary records. [2025-09-15T21:15:03.209816] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-15T21:15:03.235164] [DEBUG] [MAIN ] EC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:03.243107] [DEBUG] [LOCAL ] EBS: Derivative data saved (1326 records). [2025-09-15T21:15:03.244317] [INFO ] [MAIN ] EC: Generated 1326 derivative records from 36092 primary records. [2025-09-15T21:15:03.244625] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-15T21:15:03.244738] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-15T21:15:03.246936] [INFO ] [MAIN ] Derivative Progress: 575/2083 symbols completed. EBS took 1.1s. Estimated remaining: 8m 22s. Rate: 180.2 symbols/min [2025-09-15T21:15:03.248385] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:03.268351] [DEBUG] [LOCAL ] ECAT: Loaded 21685 existing records from primary storage. [2025-09-15T21:15:03.270516] [INFO ] [MAIN ] ECAT: Loaded 21685 primary data records. [2025-09-15T21:15:03.318125] [DEBUG] [LOCAL ] EC: Derivative data saved (1326 records). [2025-09-15T21:15:03.340727] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-15T21:15:03.371696] [INFO ] [MAIN ] Derivative Progress: 576/2083 symbols completed. EC took 1.2s. Estimated remaining: 8m 21s. Rate: 180.4 symbols/min [2025-09-15T21:15:03.393502] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:03.567427] [DEBUG] [LOCAL ] ECC: Loaded 31558 existing records from primary storage. [2025-09-15T21:15:03.583612] [DEBUG] [LOCAL ] ECCU: Loaded 1672 existing records from primary storage. [2025-09-15T21:15:03.583745] [INFO ] [MAIN ] ECC: Loaded 31558 primary data records. [2025-09-15T21:15:03.583935] [INFO ] [MAIN ] ECCU: Loaded 1672 primary data records. [2025-09-15T21:15:04.263123] [DEBUG] [MAIN ] ECAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:04.265070] [INFO ] [MAIN ] ECAT: Generated 1326 derivative records from 21685 primary records. [2025-09-15T21:15:04.265273] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-15T21:15:04.284827] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1326 records). [2025-09-15T21:15:04.285027] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-15T21:15:04.287452] [INFO ] [MAIN ] Derivative Progress: 577/2083 symbols completed. ECAT took 1.1s. Estimated remaining: 8m 23s. Rate: 179.8 symbols/min [2025-09-15T21:15:04.288305] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:04.318037] [DEBUG] [MAIN ] ECCU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:04.318946] [DEBUG] [MAIN ] ECC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:04.326519] [INFO ] [MAIN ] ECCU: Generated 1326 derivative records from 1672 primary records. [2025-09-15T21:15:04.327617] [INFO ] [MAIN ] ECC: Generated 1326 derivative records from 31558 primary records. [2025-09-15T21:15:04.327845] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-09-15T21:15:04.327952] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-15T21:15:04.350376] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1326 records). [2025-09-15T21:15:04.362505] [DEBUG] [LOCAL ] ECC: Derivative data saved (1326 records). [2025-09-15T21:15:04.362960] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-15T21:15:04.362783] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-09-15T21:15:04.365336] [INFO ] [MAIN ] Derivative Progress: 578/2083 symbols completed. ECCU took 1.0s. Estimated remaining: 8m 22s. Rate: 180.0 symbols/min [2025-09-15T21:15:04.369944] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:04.369798] [INFO ] [MAIN ] Derivative Progress: 579/2083 symbols completed. ECC took 1.1s. Estimated remaining: 8m 20s. Rate: 180.4 symbols/min [2025-09-15T21:15:04.369428] [DEBUG] [LOCAL ] ECG: Loaded 24130 existing records from primary storage. [2025-09-15T21:15:04.370876] [INFO ] [MAIN ] ECG: Loaded 24130 primary data records. [2025-09-15T21:15:04.371307] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:04.586331] [DEBUG] [LOCAL ] ECO: Loaded 13055 existing records from primary storage. [2025-09-15T21:15:04.590967] [INFO ] [MAIN ] ECO: Loaded 13055 primary data records. [2025-09-15T21:15:04.729254] [DEBUG] [LOCAL ] ECL: Loaded 33964 existing records from primary storage. [2025-09-15T21:15:04.749921] [INFO ] [MAIN ] ECL: Loaded 33964 primary data records. [2025-09-15T21:15:05.276747] [DEBUG] [MAIN ] ECG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:05.279579] [INFO ] [MAIN ] ECG: Generated 1326 derivative records from 24130 primary records. [2025-09-15T21:15:05.279766] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-15T21:15:05.295422] [DEBUG] [LOCAL ] ECG: Derivative data saved (1326 records). [2025-09-15T21:15:05.295794] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-15T21:15:05.298007] [INFO ] [MAIN ] Derivative Progress: 580/2083 symbols completed. ECG took 1.0s. Estimated remaining: 8m 22s. Rate: 179.8 symbols/min [2025-09-15T21:15:05.298901] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:05.318063] [DEBUG] [MAIN ] ECL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:05.329877] [INFO ] [MAIN ] ECL: Generated 1326 derivative records from 33964 primary records. [2025-09-15T21:15:05.330504] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-15T21:15:05.330360] [DEBUG] [MAIN ] ECO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:05.341919] [INFO ] [MAIN ] ECO: Generated 1326 derivative records from 13055 primary records. [2025-09-15T21:15:05.350728] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-15T21:15:05.355347] [DEBUG] [LOCAL ] ECL: Derivative data saved (1326 records). [2025-09-15T21:15:05.370263] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-15T21:15:05.377836] [INFO ] [MAIN ] Derivative Progress: 581/2083 symbols completed. ECL took 1.0s. Estimated remaining: 8m 21s. Rate: 180.0 symbols/min [2025-09-15T21:15:05.381565] [DEBUG] [LOCAL ] ECVT: Loaded 31664 existing records from primary storage. [2025-09-15T21:15:05.385672] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:05.385396] [INFO ] [MAIN ] ECVT: Loaded 31664 primary data records. [2025-09-15T21:15:05.385248] [DEBUG] [LOCAL ] ECO: Derivative data saved (1326 records). [2025-09-15T21:15:05.386264] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-15T21:15:05.401776] [INFO ] [MAIN ] Derivative Progress: 582/2083 symbols completed. ECO took 1.0s. Estimated remaining: 8m 19s. Rate: 180.3 symbols/min [2025-09-15T21:15:05.434751] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:05.601991] [DEBUG] [LOCAL ] EDD: Loaded 19939 existing records from primary storage. [2025-09-15T21:15:05.697716] [INFO ] [MAIN ] EDD: Loaded 19939 primary data records. [2025-09-15T21:15:05.698560] [DEBUG] [LOCAL ] ED: Loaded 38957 existing records from primary storage. [2025-09-15T21:15:05.703886] [INFO ] [MAIN ] ED: Loaded 38957 primary data records. [2025-09-15T21:15:06.348816] [DEBUG] [MAIN ] ECVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:06.350167] [INFO ] [MAIN ] ECVT: Generated 1326 derivative records from 31664 primary records. [2025-09-15T21:15:06.350450] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-15T21:15:06.365498] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1326 records). [2025-09-15T21:15:06.365984] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-15T21:15:06.368054] [INFO ] [MAIN ] Derivative Progress: 583/2083 symbols completed. ECVT took 1.1s. Estimated remaining: 8m 21s. Rate: 179.7 symbols/min [2025-09-15T21:15:06.386619] [DEBUG] [MAIN ] ED: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:06.397322] [INFO ] [MAIN ] ED: Generated 1326 derivative records from 38957 primary records. [2025-09-15T21:15:06.397793] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-15T21:15:06.397717] [DEBUG] [MAIN ] EDD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:06.399400] [INFO ] [MAIN ] EDD: Generated 1326 derivative records from 19939 primary records. [2025-09-15T21:15:06.399490] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-15T21:15:06.421742] [DEBUG] [LOCAL ] ED: Derivative data saved (1326 records). [2025-09-15T21:15:06.422525] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-15T21:15:06.425344] [INFO ] [MAIN ] Derivative Progress: 584/2083 symbols completed. ED took 1.0s. Estimated remaining: 8m 20s. Rate: 180.0 symbols/min [2025-09-15T21:15:06.426840] [DEBUG] [LOCAL ] EDD: Derivative data saved (1326 records). [2025-09-15T21:15:06.426930] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-15T21:15:06.428907] [INFO ] [MAIN ] Derivative Progress: 585/2083 symbols completed. EDD took 1.0s. Estimated remaining: 8m 19s. Rate: 180.3 symbols/min [2025-09-15T21:15:06.429704] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:06.429615] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:06.429811] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:06.448267] [DEBUG] [LOCAL ] EDF: Loaded 9497 existing records from primary storage. [2025-09-15T21:15:06.448454] [INFO ] [MAIN ] EDF: Loaded 9497 primary data records. [2025-09-15T21:15:06.523919] [DEBUG] [LOCAL ] EDN: Loaded 12886 existing records from primary storage. [2025-09-15T21:15:06.551051] [INFO ] [MAIN ] EDN: Loaded 12886 primary data records. [2025-09-15T21:15:06.777429] [DEBUG] [LOCAL ] EDU: Loaded 32550 existing records from primary storage. [2025-09-15T21:15:06.782027] [INFO ] [MAIN ] EDU: Loaded 32550 primary data records. [2025-09-15T21:15:07.336839] [DEBUG] [MAIN ] EDF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:07.338468] [INFO ] [MAIN ] EDF: Generated 1326 derivative records from 9497 primary records. [2025-09-15T21:15:07.338988] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-15T21:15:07.355684] [DEBUG] [LOCAL ] EDF: Derivative data saved (1326 records). [2025-09-15T21:15:07.355866] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-15T21:15:07.357708] [INFO ] [MAIN ] Derivative Progress: 586/2083 symbols completed. EDF took 0.9s. Estimated remaining: 8m 20s. Rate: 179.7 symbols/min [2025-09-15T21:15:07.363945] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:07.370209] [DEBUG] [MAIN ] EDN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:07.372239] [INFO ] [MAIN ] EDN: Generated 1326 derivative records from 12886 primary records. [2025-09-15T21:15:07.373488] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-15T21:15:07.406766] [DEBUG] [LOCAL ] EDN: Derivative data saved (1326 records). [2025-09-15T21:15:07.407267] [DEBUG] [MAIN ] EDU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:07.407542] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-15T21:15:07.408383] [INFO ] [MAIN ] EDU: Generated 1326 derivative records from 32550 primary records. [2025-09-15T21:15:07.411820] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-15T21:15:07.411708] [INFO ] [MAIN ] Derivative Progress: 587/2083 symbols completed. EDN took 1.0s. Estimated remaining: 8m 19s. Rate: 180.0 symbols/min [2025-09-15T21:15:07.413194] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:07.434166] [DEBUG] [LOCAL ] EDU: Derivative data saved (1326 records). [2025-09-15T21:15:07.435011] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-15T21:15:07.449695] [INFO ] [MAIN ] Derivative Progress: 588/2083 symbols completed. EDU took 1.0s. Estimated remaining: 8m 18s. Rate: 180.3 symbols/min [2025-09-15T21:15:07.445857] [DEBUG] [LOCAL ] EEA: Loaded 1980 existing records from primary storage. [2025-09-15T21:15:07.450096] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:07.451894] [DEBUG] [LOCAL ] EE: Loaded 23948 existing records from primary storage. [2025-09-15T21:15:07.451021] [INFO ] [MAIN ] EEA: Loaded 1980 primary data records. [2025-09-15T21:15:07.452294] [INFO ] [MAIN ] EE: Loaded 23948 primary data records. [2025-09-15T21:15:07.623176] [DEBUG] [LOCAL ] EEX: Loaded 7231 existing records from primary storage. [2025-09-15T21:15:07.650747] [INFO ] [MAIN ] EEX: Loaded 7231 primary data records. [2025-09-15T21:15:08.351442] [DEBUG] [MAIN ] EEA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:08.357265] [DEBUG] [MAIN ] EE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:08.358449] [INFO ] [MAIN ] EEA: Generated 1326 derivative records from 1980 primary records. [2025-09-15T21:15:08.358853] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-15T21:15:08.359615] [INFO ] [MAIN ] EE: Generated 1326 derivative records from 23948 primary records. [2025-09-15T21:15:08.360461] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-15T21:15:08.388398] [DEBUG] [MAIN ] EEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:08.387171] [DEBUG] [LOCAL ] EEA: Derivative data saved (1326 records). [2025-09-15T21:15:08.391252] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-15T21:15:08.391195] [INFO ] [MAIN ] EEX: Generated 1326 derivative records from 7231 primary records. [2025-09-15T21:15:08.394224] [DEBUG] [LOCAL ] EE: Derivative data saved (1326 records). [2025-09-15T21:15:08.396372] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-15T21:15:08.396191] [INFO ] [MAIN ] Derivative Progress: 589/2083 symbols completed. EEA took 1.0s. Estimated remaining: 8m 19s. Rate: 179.7 symbols/min [2025-09-15T21:15:08.397190] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-15T21:15:08.405368] [INFO ] [MAIN ] Derivative Progress: 590/2083 symbols completed. EE took 1.0s. Estimated remaining: 8m 18s. Rate: 180.0 symbols/min [2025-09-15T21:15:08.405467] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:08.410209] [DEBUG] [LOCAL ] EEX: Derivative data saved (1326 records). [2025-09-15T21:15:08.410985] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-15T21:15:08.412824] [INFO ] [MAIN ] Derivative Progress: 591/2083 symbols completed. EEX took 1.0s. Estimated remaining: 8m 16s. Rate: 180.3 symbols/min [2025-09-15T21:15:08.413031] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:08.410726] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:08.436001] [DEBUG] [LOCAL ] EFT: Loaded 9090 existing records from primary storage. [2025-09-15T21:15:08.436301] [INFO ] [MAIN ] EFT: Loaded 9090 primary data records. [2025-09-15T21:15:08.599415] [DEBUG] [LOCAL ] EFX: Loaded 32620 existing records from primary storage. [2025-09-15T21:15:08.621244] [DEBUG] [LOCAL ] EFC: Loaded 33691 existing records from primary storage. [2025-09-15T21:15:08.661471] [INFO ] [MAIN ] EFX: Loaded 32620 primary data records. [2025-09-15T21:15:08.709550] [INFO ] [MAIN ] EFC: Loaded 33691 primary data records. [2025-09-15T21:15:09.406375] [DEBUG] [MAIN ] EFT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:09.407386] [INFO ] [MAIN ] EFT: Generated 1326 derivative records from 9090 primary records. [2025-09-15T21:15:09.407481] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-15T21:15:09.423804] [DEBUG] [LOCAL ] EFT: Derivative data saved (1326 records). [2025-09-15T21:15:09.424226] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-15T21:15:09.426123] [INFO ] [MAIN ] Derivative Progress: 592/2083 symbols completed. EFT took 1.0s. Estimated remaining: 8m 18s. Rate: 179.7 symbols/min [2025-09-15T21:15:09.426456] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:09.441403] [DEBUG] [MAIN ] EFC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:09.451226] [INFO ] [MAIN ] EFC: Generated 1326 derivative records from 33691 primary records. [2025-09-15T21:15:09.450627] [DEBUG] [MAIN ] EFX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:09.451409] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-15T21:15:09.451920] [INFO ] [MAIN ] EFX: Generated 1326 derivative records from 32620 primary records. [2025-09-15T21:15:09.452686] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-15T21:15:09.475346] [DEBUG] [LOCAL ] EFC: Derivative data saved (1326 records). [2025-09-15T21:15:09.475488] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-15T21:15:09.479929] [INFO ] [MAIN ] Derivative Progress: 593/2083 symbols completed. EFC took 1.1s. Estimated remaining: 8m 17s. Rate: 179.9 symbols/min [2025-09-15T21:15:09.487943] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:09.489543] [DEBUG] [LOCAL ] EFXT: Loaded 20982 existing records from primary storage. [2025-09-15T21:15:09.491951] [INFO ] [MAIN ] EFXT: Loaded 20982 primary data records. [2025-09-15T21:15:09.492014] [DEBUG] [LOCAL ] EFX: Derivative data saved (1326 records). [2025-09-15T21:15:09.503553] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-15T21:15:09.514952] [INFO ] [MAIN ] Derivative Progress: 594/2083 symbols completed. EFX took 1.1s. Estimated remaining: 8m 16s. Rate: 180.2 symbols/min [2025-09-15T21:15:09.525278] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:09.693737] [DEBUG] [LOCAL ] EG: Loaded 20850 existing records from primary storage. [2025-09-15T21:15:09.777472] [INFO ] [MAIN ] EG: Loaded 20850 primary data records. [2025-09-15T21:15:09.837531] [DEBUG] [LOCAL ] EGP: Loaded 22063 existing records from primary storage. [2025-09-15T21:15:09.873029] [INFO ] [MAIN ] EGP: Loaded 22063 primary data records. [2025-09-15T21:15:10.361726] [DEBUG] [MAIN ] EFXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:10.363257] [INFO ] [MAIN ] EFXT: Generated 1326 derivative records from 20982 primary records. [2025-09-15T21:15:10.363523] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-15T21:15:10.379245] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1326 records). [2025-09-15T21:15:10.380529] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-15T21:15:10.384097] [INFO ] [MAIN ] Derivative Progress: 595/2083 symbols completed. EFXT took 1.0s. Estimated remaining: 8m 17s. Rate: 179.7 symbols/min [2025-09-15T21:15:10.384451] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:10.402408] [DEBUG] [MAIN ] EG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:10.403370] [INFO ] [MAIN ] EG: Generated 1326 derivative records from 20850 primary records. [2025-09-15T21:15:10.409342] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-15T21:15:10.414165] [DEBUG] [MAIN ] EGP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:10.421466] [INFO ] [MAIN ] EGP: Generated 1326 derivative records from 22063 primary records. [2025-09-15T21:15:10.423655] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-15T21:15:10.446741] [DEBUG] [LOCAL ] EGP: Derivative data saved (1326 records). [2025-09-15T21:15:10.447125] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-15T21:15:10.448591] [INFO ] [MAIN ] Derivative Progress: 596/2083 symbols completed. EGP took 0.9s. Estimated remaining: 8m 16s. Rate: 180.0 symbols/min [2025-09-15T21:15:10.447057] [DEBUG] [LOCAL ] EG: Derivative data saved (1326 records). [2025-09-15T21:15:10.448861] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:10.449081] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-15T21:15:10.451375] [INFO ] [MAIN ] Derivative Progress: 597/2083 symbols completed. EG took 1.0s. Estimated remaining: 8m 15s. Rate: 180.3 symbols/min [2025-09-15T21:15:10.452156] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:10.462721] [DEBUG] [LOCAL ] EGY: Loaded 30410 existing records from primary storage. [2025-09-15T21:15:10.462908] [INFO ] [MAIN ] EGY: Loaded 30410 primary data records. [2025-09-15T21:15:10.671074] [DEBUG] [LOCAL ] EHAB: Loaded 22563 existing records from primary storage. [2025-09-15T21:15:10.758630] [INFO ] [MAIN ] EHAB: Loaded 22563 primary data records. [2025-09-15T21:15:10.805997] [DEBUG] [LOCAL ] EHC: Loaded 30763 existing records from primary storage. [2025-09-15T21:15:10.839832] [INFO ] [MAIN ] EHC: Loaded 30763 primary data records. [2025-09-15T21:15:11.366102] [DEBUG] [MAIN ] EGY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:11.367908] [INFO ] [MAIN ] EGY: Generated 1326 derivative records from 30410 primary records. [2025-09-15T21:15:11.368702] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-15T21:15:11.383284] [DEBUG] [LOCAL ] EGY: Derivative data saved (1326 records). [2025-09-15T21:15:11.383720] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-15T21:15:11.386229] [INFO ] [MAIN ] Derivative Progress: 598/2083 symbols completed. EGY took 1.0s. Estimated remaining: 8m 16s. Rate: 179.7 symbols/min [2025-09-15T21:15:11.404810] [DEBUG] [MAIN ] EHAB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:11.413853] [DEBUG] [MAIN ] EHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:11.414458] [INFO ] [MAIN ] EHAB: Generated 1326 derivative records from 22563 primary records. [2025-09-15T21:15:11.415033] [INFO ] [MAIN ] EHC: Generated 1326 derivative records from 30763 primary records. [2025-09-15T21:15:11.415077] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-15T21:15:11.415164] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-15T21:15:11.437880] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1326 records). [2025-09-15T21:15:11.438326] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-15T21:15:11.440060] [INFO ] [MAIN ] Derivative Progress: 599/2083 symbols completed. EHAB took 1.0s. Estimated remaining: 8m 15s. Rate: 180.0 symbols/min [2025-09-15T21:15:11.438288] [DEBUG] [LOCAL ] EHC: Derivative data saved (1326 records). [2025-09-15T21:15:11.440268] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-15T21:15:11.441950] [INFO ] [MAIN ] Derivative Progress: 600/2083 symbols completed. EHC took 1.0s. Estimated remaining: 8m 14s. Rate: 180.3 symbols/min [2025-09-15T21:15:11.442317] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:11.442601] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:11.442740] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:11.478952] [DEBUG] [LOCAL ] EHI: Loaded 7828 existing records from primary storage. [2025-09-15T21:15:11.485203] [DEBUG] [LOCAL ] EIG: Loaded 15429 existing records from primary storage. [2025-09-15T21:15:11.485869] [INFO ] [MAIN ] EHI: Loaded 7828 primary data records. [2025-09-15T21:15:11.485801] [DEBUG] [LOCAL ] EIC: Loaded 17683 existing records from primary storage. [2025-09-15T21:15:11.491269] [INFO ] [MAIN ] EIG: Loaded 15429 primary data records. [2025-09-15T21:15:11.507455] [INFO ] [MAIN ] EIC: Loaded 17683 primary data records. [2025-09-15T21:15:12.324461] [DEBUG] [MAIN ] EHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:12.331291] [INFO ] [MAIN ] EHI: Generated 1326 derivative records from 7828 primary records. [2025-09-15T21:15:12.331583] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-15T21:15:12.337799] [DEBUG] [MAIN ] EIC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:12.351038] [DEBUG] [LOCAL ] EHI: Derivative data saved (1326 records). [2025-09-15T21:15:12.351162] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-15T21:15:12.350891] [INFO ] [MAIN ] EIC: Generated 1326 derivative records from 17683 primary records. [2025-09-15T21:15:12.362246] [INFO ] [MAIN ] Derivative Progress: 601/2083 symbols completed. EHI took 0.9s. Estimated remaining: 8m 15s. Rate: 179.7 symbols/min [2025-09-15T21:15:12.362476] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-15T21:15:12.362726] [DEBUG] [MAIN ] EIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:12.363672] [INFO ] [MAIN ] EIG: Generated 1326 derivative records from 15429 primary records. [2025-09-15T21:15:12.363991] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-15T21:15:12.363128] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:12.386535] [DEBUG] [LOCAL ] EIG: Derivative data saved (1326 records). [2025-09-15T21:15:12.387656] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-15T21:15:12.390079] [INFO ] [MAIN ] Derivative Progress: 602/2083 symbols completed. EIG took 0.9s. Estimated remaining: 8m 14s. Rate: 180.0 symbols/min [2025-09-15T21:15:12.390469] [DEBUG] [LOCAL ] EIC: Derivative data saved (1326 records). [2025-09-15T21:15:12.390682] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:12.390924] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-15T21:15:12.392993] [INFO ] [MAIN ] Derivative Progress: 603/2083 symbols completed. EIC took 1.0s. Estimated remaining: 8m 12s. Rate: 180.3 symbols/min [2025-09-15T21:15:12.393599] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:12.436027] [DEBUG] [LOCAL ] EL: Loaded 39517 existing records from primary storage. [2025-09-15T21:15:12.436338] [INFO ] [MAIN ] EL: Loaded 39517 primary data records. [2025-09-15T21:15:12.584303] [DEBUG] [LOCAL ] ELAN: Loaded 39316 existing records from primary storage. [2025-09-15T21:15:12.625401] [INFO ] [MAIN ] ELAN: Loaded 39316 primary data records. [2025-09-15T21:15:12.661061] [DEBUG] [LOCAL ] ELF: Loaded 38501 existing records from primary storage. [2025-09-15T21:15:12.669997] [INFO ] [MAIN ] ELF: Loaded 38501 primary data records. [2025-09-15T21:15:13.344802] [DEBUG] [MAIN ] EL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:13.346098] [INFO ] [MAIN ] EL: Generated 1326 derivative records from 39517 primary records. [2025-09-15T21:15:13.346278] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-15T21:15:13.360583] [DEBUG] [LOCAL ] EL: Derivative data saved (1326 records). [2025-09-15T21:15:13.360871] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-15T21:15:13.362401] [INFO ] [MAIN ] Derivative Progress: 604/2083 symbols completed. EL took 1.0s. Estimated remaining: 8m 14s. Rate: 179.7 symbols/min [2025-09-15T21:15:13.364550] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:13.375793] [DEBUG] [MAIN ] ELAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:13.379386] [INFO ] [MAIN ] ELAN: Generated 1326 derivative records from 39316 primary records. [2025-09-15T21:15:13.379559] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-15T21:15:13.402145] [DEBUG] [MAIN ] ELF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:13.403500] [INFO ] [MAIN ] ELF: Generated 1326 derivative records from 38501 primary records. [2025-09-15T21:15:13.408992] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-15T21:15:13.418105] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1326 records). [2025-09-15T21:15:13.420511] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-15T21:15:13.422831] [INFO ] [MAIN ] Derivative Progress: 605/2083 symbols completed. ELAN took 1.0s. Estimated remaining: 8m 13s. Rate: 180.0 symbols/min [2025-09-15T21:15:13.428402] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:13.433416] [DEBUG] [LOCAL ] ELP: Loaded 19225 existing records from primary storage. [2025-09-15T21:15:13.433703] [INFO ] [MAIN ] ELP: Loaded 19225 primary data records. [2025-09-15T21:15:13.433607] [DEBUG] [LOCAL ] ELF: Derivative data saved (1326 records). [2025-09-15T21:15:13.433985] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-15T21:15:13.447588] [INFO ] [MAIN ] Derivative Progress: 606/2083 symbols completed. ELF took 1.1s. Estimated remaining: 8m 12s. Rate: 180.3 symbols/min [2025-09-15T21:15:13.504376] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:13.607074] [DEBUG] [LOCAL ] EMD: Loaded 14899 existing records from primary storage. [2025-09-15T21:15:13.633876] [INFO ] [MAIN ] EMD: Loaded 14899 primary data records. [2025-09-15T21:15:13.888979] [DEBUG] [LOCAL ] EME: Loaded 22200 existing records from primary storage. [2025-09-15T21:15:13.917533] [INFO ] [MAIN ] EME: Loaded 22200 primary data records. [2025-09-15T21:15:14.287067] [DEBUG] [MAIN ] ELP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:14.288133] [INFO ] [MAIN ] ELP: Generated 1326 derivative records from 19225 primary records. [2025-09-15T21:15:14.288288] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-15T21:15:14.303396] [DEBUG] [LOCAL ] ELP: Derivative data saved (1326 records). [2025-09-15T21:15:14.304386] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-15T21:15:14.306903] [INFO ] [MAIN ] Derivative Progress: 607/2083 symbols completed. ELP took 0.9s. Estimated remaining: 8m 13s. Rate: 179.8 symbols/min [2025-09-15T21:15:14.307869] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:14.319883] [DEBUG] [MAIN ] EMD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:14.320857] [INFO ] [MAIN ] EMD: Generated 1326 derivative records from 14899 primary records. [2025-09-15T21:15:14.321075] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-15T21:15:14.323597] [DEBUG] [LOCAL ] EMF: Loaded 2155 existing records from primary storage. [2025-09-15T21:15:14.324054] [INFO ] [MAIN ] EMF: Loaded 2155 primary data records. [2025-09-15T21:15:14.441686] [DEBUG] [LOCAL ] EMD: Derivative data saved (1326 records). [2025-09-15T21:15:14.441904] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-15T21:15:14.443792] [INFO ] [MAIN ] Derivative Progress: 608/2083 symbols completed. EMD took 1.0s. Estimated remaining: 8m 12s. Rate: 180.0 symbols/min [2025-09-15T21:15:14.444310] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:14.494794] [DEBUG] [MAIN ] EME: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:14.506354] [INFO ] [MAIN ] EME: Generated 1326 derivative records from 22200 primary records. [2025-09-15T21:15:14.532725] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-15T21:15:14.642885] [DEBUG] [LOCAL ] EME: Derivative data saved (1326 records). [2025-09-15T21:15:14.643109] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-15T21:15:14.644961] [INFO ] [MAIN ] Derivative Progress: 609/2083 symbols completed. EME took 1.2s. Estimated remaining: 8m 11s. Rate: 180.1 symbols/min [2025-09-15T21:15:14.645274] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:14.659363] [DEBUG] [LOCAL ] EMN: Loaded 37455 existing records from primary storage. [2025-09-15T21:15:14.659918] [INFO ] [MAIN ] EMN: Loaded 37455 primary data records. [2025-09-15T21:15:14.752201] [DEBUG] [LOCAL ] EMO: Loaded 9432 existing records from primary storage. [2025-09-15T21:15:14.769025] [INFO ] [MAIN ] EMO: Loaded 9432 primary data records. [2025-09-15T21:15:14.894569] [DEBUG] [MAIN ] EMF: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:15:15.038154] [INFO ] [MAIN ] EMF: Generated 1325 derivative records from 2155 primary records. [2025-09-15T21:15:15.049763] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-15T21:15:15.222760] [DEBUG] [LOCAL ] EMF: Derivative data saved (1325 records). [2025-09-15T21:15:15.223148] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-15T21:15:15.224846] [INFO ] [MAIN ] Derivative Progress: 610/2083 symbols completed. EMF took 0.9s. Estimated remaining: 8m 11s. Rate: 179.9 symbols/min [2025-09-15T21:15:15.225135] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:15.245433] [DEBUG] [MAIN ] EMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:15.246187] [INFO ] [MAIN ] EMN: Generated 1326 derivative records from 37455 primary records. [2025-09-15T21:15:15.246488] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-15T21:15:15.280080] [DEBUG] [LOCAL ] EMN: Derivative data saved (1326 records). [2025-09-15T21:15:15.279681] [DEBUG] [MAIN ] EMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:15.280269] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-15T21:15:15.280903] [INFO ] [MAIN ] EMO: Generated 1326 derivative records from 9432 primary records. [2025-09-15T21:15:15.282842] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-15T21:15:15.282769] [INFO ] [MAIN ] Derivative Progress: 611/2083 symbols completed. EMN took 0.8s. Estimated remaining: 8m 10s. Rate: 180.1 symbols/min [2025-09-15T21:15:15.283046] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:15.296109] [DEBUG] [LOCAL ] EMO: Derivative data saved (1326 records). [2025-09-15T21:15:15.296876] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-15T21:15:15.298833] [INFO ] [MAIN ] Derivative Progress: 612/2083 symbols completed. EMO took 0.7s. Estimated remaining: 8m 9s. Rate: 180.4 symbols/min [2025-09-15T21:15:15.309202] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:15.311247] [DEBUG] [LOCAL ] EMR: Loaded 39273 existing records from primary storage. [2025-09-15T21:15:15.311457] [INFO ] [MAIN ] EMR: Loaded 39273 primary data records. [2025-09-15T21:15:15.624483] [DEBUG] [LOCAL ] ENIC: Loaded 27637 existing records from primary storage. [2025-09-15T21:15:15.635476] [INFO ] [MAIN ] ENIC: Loaded 27637 primary data records. [2025-09-15T21:15:15.668987] [DEBUG] [LOCAL ] ENB: Loaded 39511 existing records from primary storage. [2025-09-15T21:15:15.681851] [INFO ] [MAIN ] ENB: Loaded 39511 primary data records. [2025-09-15T21:15:16.183889] [DEBUG] [MAIN ] EMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:16.185111] [INFO ] [MAIN ] EMR: Generated 1326 derivative records from 39273 primary records. [2025-09-15T21:15:16.186179] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-15T21:15:16.200455] [DEBUG] [LOCAL ] EMR: Derivative data saved (1326 records). [2025-09-15T21:15:16.200732] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-15T21:15:16.203009] [INFO ] [MAIN ] Derivative Progress: 613/2083 symbols completed. EMR took 1.0s. Estimated remaining: 8m 10s. Rate: 179.9 symbols/min [2025-09-15T21:15:16.216118] [DEBUG] [MAIN ] ENIC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:16.217662] [INFO ] [MAIN ] ENIC: Generated 1326 derivative records from 27637 primary records. [2025-09-15T21:15:16.217831] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-15T21:15:16.232875] [DEBUG] [MAIN ] ENB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:16.234203] [INFO ] [MAIN ] ENB: Generated 1326 derivative records from 39511 primary records. [2025-09-15T21:15:16.236181] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-15T21:15:16.248017] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1326 records). [2025-09-15T21:15:16.248474] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-15T21:15:16.251533] [INFO ] [MAIN ] Derivative Progress: 614/2083 symbols completed. ENIC took 1.0s. Estimated remaining: 8m 9s. Rate: 180.1 symbols/min [2025-09-15T21:15:16.252349] [DEBUG] [LOCAL ] ENB: Derivative data saved (1326 records). [2025-09-15T21:15:16.252467] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-15T21:15:16.254228] [INFO ] [MAIN ] Derivative Progress: 615/2083 symbols completed. ENB took 1.0s. Estimated remaining: 8m 8s. Rate: 180.4 symbols/min [2025-09-15T21:15:16.254877] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:16.255045] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:16.255594] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:16.259311] [DEBUG] [LOCAL ] ENO: Loaded 1228 existing records from primary storage. [2025-09-15T21:15:16.259471] [INFO ] [MAIN ] ENO: Loaded 1228 primary data records. [2025-09-15T21:15:16.530577] [DEBUG] [LOCAL ] ENS: Loaded 21455 existing records from primary storage. [2025-09-15T21:15:16.541067] [INFO ] [MAIN ] ENS: Loaded 21455 primary data records. [2025-09-15T21:15:16.657372] [DEBUG] [LOCAL ] ENR: Loaded 32871 existing records from primary storage. [2025-09-15T21:15:16.658413] [INFO ] [MAIN ] ENR: Loaded 32871 primary data records. [2025-09-15T21:15:17.109579] [DEBUG] [MAIN ] ENO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:17.111156] [INFO ] [MAIN ] ENO: Generated 1326 derivative records from 1228 primary records. [2025-09-15T21:15:17.111824] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-15T21:15:17.123551] [DEBUG] [LOCAL ] ENO: Derivative data saved (1326 records). [2025-09-15T21:15:17.123939] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-15T21:15:17.126036] [INFO ] [MAIN ] Derivative Progress: 616/2083 symbols completed. ENO took 0.9s. Estimated remaining: 8m 9s. Rate: 180.0 symbols/min [2025-09-15T21:15:17.126480] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:17.142848] [DEBUG] [MAIN ] ENS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:17.143798] [INFO ] [MAIN ] ENS: Generated 1326 derivative records from 21455 primary records. [2025-09-15T21:15:17.144060] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-15T21:15:17.164198] [DEBUG] [LOCAL ] ENS: Derivative data saved (1326 records). [2025-09-15T21:15:17.164458] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-15T21:15:17.166480] [INFO ] [MAIN ] Derivative Progress: 617/2083 symbols completed. ENS took 0.9s. Estimated remaining: 8m 8s. Rate: 180.2 symbols/min [2025-09-15T21:15:17.172494] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:17.184488] [DEBUG] [LOCAL ] ENVA: Loaded 18662 existing records from primary storage. [2025-09-15T21:15:17.183774] [DEBUG] [MAIN ] ENR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:17.184826] [INFO ] [MAIN ] ENVA: Loaded 18662 primary data records. [2025-09-15T21:15:17.185634] [INFO ] [MAIN ] ENR: Generated 1326 derivative records from 32871 primary records. [2025-09-15T21:15:17.206559] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-15T21:15:17.304997] [DEBUG] [LOCAL ] EOD: Loaded 10829 existing records from primary storage. [2025-09-15T21:15:17.307041] [INFO ] [MAIN ] EOD: Loaded 10829 primary data records. [2025-09-15T21:15:17.313005] [DEBUG] [LOCAL ] ENR: Derivative data saved (1326 records). [2025-09-15T21:15:17.384262] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-15T21:15:17.445942] [INFO ] [MAIN ] Derivative Progress: 618/2083 symbols completed. ENR took 1.2s. Estimated remaining: 8m 8s. Rate: 180.3 symbols/min [2025-09-15T21:15:17.552058] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:17.822194] [DEBUG] [MAIN ] ENVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:17.823892] [INFO ] [MAIN ] ENVA: Generated 1326 derivative records from 18662 primary records. [2025-09-15T21:15:17.824036] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-15T21:15:17.837635] [DEBUG] [LOCAL ] EOG: Loaded 39357 existing records from primary storage. [2025-09-15T21:15:17.843341] [INFO ] [MAIN ] EOG: Loaded 39357 primary data records. [2025-09-15T21:15:17.958147] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1326 records). [2025-09-15T21:15:17.968276] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-15T21:15:17.968953] [DEBUG] [MAIN ] EOD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:17.997336] [INFO ] [MAIN ] EOD: Generated 1326 derivative records from 10829 primary records. [2025-09-15T21:15:17.997441] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-15T21:15:17.996509] [INFO ] [MAIN ] Derivative Progress: 619/2083 symbols completed. ENVA took 0.9s. Estimated remaining: 8m 8s. Rate: 180.1 symbols/min [2025-09-15T21:15:18.011731] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:18.153560] [DEBUG] [LOCAL ] EOD: Derivative data saved (1326 records). [2025-09-15T21:15:18.154433] [DEBUG] [LOCAL ] EOI: Loaded 6869 existing records from primary storage. [2025-09-15T21:15:18.154501] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-15T21:15:18.156685] [INFO ] [MAIN ] Derivative Progress: 620/2083 symbols completed. EOD took 1.0s. Estimated remaining: 8m 7s. Rate: 180.2 symbols/min [2025-09-15T21:15:18.157138] [INFO ] [MAIN ] EOI: Loaded 6869 primary data records. [2025-09-15T21:15:18.221825] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:18.436322] [DEBUG] [LOCAL ] EOS: Loaded 10119 existing records from primary storage. [2025-09-15T21:15:18.437133] [INFO ] [MAIN ] EOS: Loaded 10119 primary data records. [2025-09-15T21:15:18.471208] [DEBUG] [MAIN ] EOG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:18.487563] [INFO ] [MAIN ] EOG: Generated 1326 derivative records from 39357 primary records. [2025-09-15T21:15:18.487850] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-15T21:15:18.570883] [DEBUG] [LOCAL ] EOG: Derivative data saved (1326 records). [2025-09-15T21:15:18.577627] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-15T21:15:18.585784] [INFO ] [MAIN ] Derivative Progress: 621/2083 symbols completed. EOG took 1.1s. Estimated remaining: 8m 7s. Rate: 180.1 symbols/min [2025-09-15T21:15:18.591412] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:18.744004] [DEBUG] [LOCAL ] EOT: Loaded 4995 existing records from primary storage. [2025-09-15T21:15:18.744925] [INFO ] [MAIN ] EOT: Loaded 4995 primary data records. [2025-09-15T21:15:18.848590] [DEBUG] [MAIN ] EOI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:18.860305] [INFO ] [MAIN ] EOI: Generated 1326 derivative records from 6869 primary records. [2025-09-15T21:15:18.866037] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-15T21:15:18.930107] [DEBUG] [LOCAL ] EOI: Derivative data saved (1326 records). [2025-09-15T21:15:18.930221] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-15T21:15:18.949701] [INFO ] [MAIN ] Derivative Progress: 622/2083 symbols completed. EOI took 0.9s. Estimated remaining: 8m 7s. Rate: 180.1 symbols/min [2025-09-15T21:15:19.047465] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:19.062185] [DEBUG] [MAIN ] EOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:19.063621] [INFO ] [MAIN ] EOS: Generated 1326 derivative records from 10119 primary records. [2025-09-15T21:15:19.063867] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-15T21:15:19.082732] [DEBUG] [LOCAL ] EOS: Derivative data saved (1326 records). [2025-09-15T21:15:19.083039] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-15T21:15:19.084966] [INFO ] [MAIN ] Derivative Progress: 623/2083 symbols completed. EOS took 0.9s. Estimated remaining: 8m 6s. Rate: 180.3 symbols/min [2025-09-15T21:15:19.085453] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:19.093421] [DEBUG] [LOCAL ] EPAC: Loaded 18981 existing records from primary storage. [2025-09-15T21:15:19.093771] [INFO ] [MAIN ] EPAC: Loaded 18981 primary data records. [2025-09-15T21:15:19.262257] [DEBUG] [MAIN ] EOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:19.303456] [INFO ] [MAIN ] EOT: Generated 1326 derivative records from 4995 primary records. [2025-09-15T21:15:19.379506] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-15T21:15:19.391096] [DEBUG] [LOCAL ] EPAM: Loaded 28631 existing records from primary storage. [2025-09-15T21:15:19.391776] [INFO ] [MAIN ] EPAM: Loaded 28631 primary data records. [2025-09-15T21:15:19.506318] [DEBUG] [LOCAL ] EOT: Derivative data saved (1326 records). [2025-09-15T21:15:19.506685] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-15T21:15:19.508684] [INFO ] [MAIN ] Derivative Progress: 624/2083 symbols completed. EOT took 0.9s. Estimated remaining: 8m 6s. Rate: 180.2 symbols/min [2025-09-15T21:15:19.508856] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:19.708879] [DEBUG] [LOCAL ] EPC: Loaded 29617 existing records from primary storage. [2025-09-15T21:15:19.709849] [DEBUG] [MAIN ] EPAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:19.710156] [INFO ] [MAIN ] EPC: Loaded 29617 primary data records. [2025-09-15T21:15:19.711029] [INFO ] [MAIN ] EPAC: Generated 1326 derivative records from 18981 primary records. [2025-09-15T21:15:19.711242] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-15T21:15:19.878797] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1326 records). [2025-09-15T21:15:19.917276] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-15T21:15:19.919729] [INFO ] [MAIN ] Derivative Progress: 625/2083 symbols completed. EPAC took 0.9s. Estimated remaining: 8m 6s. Rate: 180.1 symbols/min [2025-09-15T21:15:19.919995] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:19.917819] [DEBUG] [MAIN ] EPAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:20.038001] [INFO ] [MAIN ] EPAM: Generated 1326 derivative records from 28631 primary records. [2025-09-15T21:15:20.038320] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-15T21:15:20.055292] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1326 records). [2025-09-15T21:15:20.055591] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-15T21:15:20.057766] [INFO ] [MAIN ] Derivative Progress: 626/2083 symbols completed. EPAM took 1.0s. Estimated remaining: 8m 5s. Rate: 180.3 symbols/min [2025-09-15T21:15:20.059633] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:20.078427] [DEBUG] [MAIN ] EPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:20.088680] [INFO ] [MAIN ] EPC: Generated 1326 derivative records from 29617 primary records. [2025-09-15T21:15:20.088964] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-15T21:15:20.102635] [DEBUG] [LOCAL ] EPC: Derivative data saved (1326 records). [2025-09-15T21:15:20.102771] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-15T21:15:20.105283] [INFO ] [MAIN ] Derivative Progress: 627/2083 symbols completed. EPC took 0.6s. Estimated remaining: 8m 4s. Rate: 180.6 symbols/min [2025-09-15T21:15:20.105761] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:20.125624] [DEBUG] [LOCAL ] EPD: Loaded 39582 existing records from primary storage. [2025-09-15T21:15:20.125937] [INFO ] [MAIN ] EPD: Loaded 39582 primary data records. [2025-09-15T21:15:20.258315] [DEBUG] [LOCAL ] EPRT: Loaded 35533 existing records from primary storage. [2025-09-15T21:15:20.247330] [DEBUG] [LOCAL ] EQBK: Loaded 7957 existing records from primary storage. [2025-09-15T21:15:20.268923] [INFO ] [MAIN ] EPRT: Loaded 35533 primary data records. [2025-09-15T21:15:20.269037] [INFO ] [MAIN ] EQBK: Loaded 7957 primary data records. [2025-09-15T21:15:20.999723] [DEBUG] [MAIN ] EPD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:21.001379] [INFO ] [MAIN ] EPD: Generated 1326 derivative records from 39582 primary records. [2025-09-15T21:15:21.002985] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-15T21:15:21.026748] [DEBUG] [MAIN ] EPRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:21.029224] [DEBUG] [LOCAL ] EPD: Derivative data saved (1326 records). [2025-09-15T21:15:21.029530] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-15T21:15:21.028925] [INFO ] [MAIN ] EPRT: Generated 1326 derivative records from 35533 primary records. [2025-09-15T21:15:21.031504] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-15T21:15:21.031258] [INFO ] [MAIN ] Derivative Progress: 628/2083 symbols completed. EPD took 1.1s. Estimated remaining: 8m 5s. Rate: 180.0 symbols/min [2025-09-15T21:15:21.049081] [DEBUG] [MAIN ] EQBK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:21.052084] [INFO ] [MAIN ] EQBK: Generated 1326 derivative records from 7957 primary records. [2025-09-15T21:15:21.053421] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-15T21:15:21.066577] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1326 records). [2025-09-15T21:15:21.066916] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-15T21:15:21.069113] [INFO ] [MAIN ] Derivative Progress: 629/2083 symbols completed. EPRT took 1.0s. Estimated remaining: 8m 4s. Rate: 180.3 symbols/min [2025-09-15T21:15:21.070655] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1326 records). [2025-09-15T21:15:21.070732] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-15T21:15:21.072379] [INFO ] [MAIN ] Derivative Progress: 630/2083 symbols completed. EQBK took 1.0s. Estimated remaining: 8m 3s. Rate: 180.6 symbols/min [2025-09-15T21:15:21.072925] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:21.073086] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:21.073525] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:21.137835] [DEBUG] [LOCAL ] EQH: Loaded 38767 existing records from primary storage. [2025-09-15T21:15:21.139025] [INFO ] [MAIN ] EQH: Loaded 38767 primary data records. [2025-09-15T21:15:21.138898] [DEBUG] [LOCAL ] EQR: Loaded 37964 existing records from primary storage. [2025-09-15T21:15:21.139242] [INFO ] [MAIN ] EQR: Loaded 37964 primary data records. [2025-09-15T21:15:21.318089] [DEBUG] [LOCAL ] EQT: Loaded 39645 existing records from primary storage. [2025-09-15T21:15:21.340851] [INFO ] [MAIN ] EQT: Loaded 39645 primary data records. [2025-09-15T21:15:22.035844] [DEBUG] [MAIN ] EQH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:22.037713] [INFO ] [MAIN ] EQH: Generated 1326 derivative records from 38767 primary records. [2025-09-15T21:15:22.037945] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-15T21:15:22.063151] [DEBUG] [MAIN ] EQR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:22.065047] [INFO ] [MAIN ] EQR: Generated 1326 derivative records from 37964 primary records. [2025-09-15T21:15:22.065699] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-15T21:15:22.066701] [DEBUG] [LOCAL ] EQH: Derivative data saved (1326 records). [2025-09-15T21:15:22.067139] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-15T21:15:22.069203] [INFO ] [MAIN ] Derivative Progress: 631/2083 symbols completed. EQH took 1.0s. Estimated remaining: 8m 4s. Rate: 180.0 symbols/min [2025-09-15T21:15:22.077555] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:22.090857] [DEBUG] [LOCAL ] EQV: Loaded 2157 existing records from primary storage. [2025-09-15T21:15:22.091035] [INFO ] [MAIN ] EQV: Loaded 2157 primary data records. [2025-09-15T21:15:22.088616] [DEBUG] [LOCAL ] EQR: Derivative data saved (1326 records). [2025-09-15T21:15:22.109826] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-15T21:15:22.168219] [INFO ] [MAIN ] Derivative Progress: 632/2083 symbols completed. EQR took 1.1s. Estimated remaining: 8m 3s. Rate: 180.2 symbols/min [2025-09-15T21:15:22.198333] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:22.210442] [DEBUG] [MAIN ] EQT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:22.224274] [INFO ] [MAIN ] EQT: Generated 1326 derivative records from 39645 primary records. [2025-09-15T21:15:22.224746] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-15T21:15:22.438831] [DEBUG] [LOCAL ] EQT: Derivative data saved (1326 records). [2025-09-15T21:15:22.439065] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-15T21:15:22.441481] [INFO ] [MAIN ] Derivative Progress: 633/2083 symbols completed. EQT took 1.4s. Estimated remaining: 8m 3s. Rate: 180.3 symbols/min [2025-09-15T21:15:22.442808] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:22.474381] [DEBUG] [LOCAL ] ERJ: Loaded 37326 existing records from primary storage. [2025-09-15T21:15:22.474801] [INFO ] [MAIN ] ERJ: Loaded 37326 primary data records. [2025-09-15T21:15:22.686718] [DEBUG] [MAIN ] EQV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:22.687896] [DEBUG] [LOCAL ] ERO: Loaded 29843 existing records from primary storage. [2025-09-15T21:15:22.771784] [INFO ] [MAIN ] ERO: Loaded 29843 primary data records. [2025-09-15T21:15:22.772895] [INFO ] [MAIN ] EQV: Generated 1326 derivative records from 2157 primary records. [2025-09-15T21:15:22.784762] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-15T21:15:22.861376] [DEBUG] [LOCAL ] EQV: Derivative data saved (1326 records). [2025-09-15T21:15:22.861898] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-15T21:15:22.873621] [INFO ] [MAIN ] Derivative Progress: 634/2083 symbols completed. EQV took 0.8s. Estimated remaining: 8m 3s. Rate: 180.2 symbols/min [2025-09-15T21:15:22.891314] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:23.084630] [DEBUG] [MAIN ] ERJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:23.086056] [INFO ] [MAIN ] ERJ: Generated 1326 derivative records from 37326 primary records. [2025-09-15T21:15:23.086201] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-15T21:15:23.100518] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1326 records). [2025-09-15T21:15:23.113004] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-15T21:15:23.116123] [INFO ] [MAIN ] Derivative Progress: 635/2083 symbols completed. ERJ took 0.9s. Estimated remaining: 8m 2s. Rate: 180.3 symbols/min [2025-09-15T21:15:23.113787] [DEBUG] [LOCAL ] ES: Loaded 38782 existing records from primary storage. [2025-09-15T21:15:23.116913] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:23.117017] [INFO ] [MAIN ] ES: Loaded 38782 primary data records. [2025-09-15T21:15:23.291755] [DEBUG] [LOCAL ] ESAB: Loaded 18188 existing records from primary storage. [2025-09-15T21:15:23.320508] [DEBUG] [MAIN ] ERO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:23.327245] [INFO ] [MAIN ] ERO: Generated 1326 derivative records from 29843 primary records. [2025-09-15T21:15:23.326524] [INFO ] [MAIN ] ESAB: Loaded 18188 primary data records. [2025-09-15T21:15:23.348229] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-15T21:15:23.515670] [DEBUG] [LOCAL ] ERO: Derivative data saved (1326 records). [2025-09-15T21:15:23.521334] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-15T21:15:23.537815] [INFO ] [MAIN ] Derivative Progress: 636/2083 symbols completed. ERO took 1.1s. Estimated remaining: 8m 2s. Rate: 180.2 symbols/min [2025-09-15T21:15:23.542081] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:23.730613] [DEBUG] [MAIN ] ES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:23.731371] [DEBUG] [LOCAL ] ESE: Loaded 12123 existing records from primary storage. [2025-09-15T21:15:23.731987] [INFO ] [MAIN ] ESE: Loaded 12123 primary data records. [2025-09-15T21:15:23.732857] [INFO ] [MAIN ] ES: Generated 1326 derivative records from 38782 primary records. [2025-09-15T21:15:23.782311] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-15T21:15:23.857167] [DEBUG] [LOCAL ] ES: Derivative data saved (1326 records). [2025-09-15T21:15:23.868118] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-15T21:15:23.880718] [INFO ] [MAIN ] Derivative Progress: 637/2083 symbols completed. ES took 1.0s. Estimated remaining: 8m 2s. Rate: 180.2 symbols/min [2025-09-15T21:15:23.910796] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:24.030094] [DEBUG] [MAIN ] ESAB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:24.030854] [INFO ] [MAIN ] ESAB: Generated 1326 derivative records from 18188 primary records. [2025-09-15T21:15:24.030995] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-15T21:15:24.045510] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1326 records). [2025-09-15T21:15:24.045975] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-15T21:15:24.047582] [INFO ] [MAIN ] Derivative Progress: 638/2083 symbols completed. ESAB took 0.9s. Estimated remaining: 8m 1s. Rate: 180.3 symbols/min [2025-09-15T21:15:24.048769] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:24.075454] [DEBUG] [MAIN ] ESE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:24.076239] [INFO ] [MAIN ] ESE: Generated 1326 derivative records from 12123 primary records. [2025-09-15T21:15:24.076376] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-15T21:15:24.106945] [DEBUG] [LOCAL ] ESE: Derivative data saved (1326 records). [2025-09-15T21:15:24.107103] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-15T21:15:24.108789] [INFO ] [MAIN ] Derivative Progress: 639/2083 symbols completed. ESE took 0.6s. Estimated remaining: 7m 60s. Rate: 180.5 symbols/min [2025-09-15T21:15:24.110796] [DEBUG] [LOCAL ] ESI: Loaded 37061 existing records from primary storage. [2025-09-15T21:15:24.109065] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:24.111000] [INFO ] [MAIN ] ESI: Loaded 37061 primary data records. [2025-09-15T21:15:24.239992] [DEBUG] [LOCAL ] ESRT: Loaded 34095 existing records from primary storage. [2025-09-15T21:15:24.255815] [INFO ] [MAIN ] ESRT: Loaded 34095 primary data records. [2025-09-15T21:15:24.474427] [DEBUG] [LOCAL ] ESS: Loaded 21846 existing records from primary storage. [2025-09-15T21:15:24.491960] [INFO ] [MAIN ] ESS: Loaded 21846 primary data records. [2025-09-15T21:15:25.031999] [DEBUG] [MAIN ] ESI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:25.033604] [INFO ] [MAIN ] ESI: Generated 1326 derivative records from 37061 primary records. [2025-09-15T21:15:25.034206] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-15T21:15:25.051238] [DEBUG] [LOCAL ] ESI: Derivative data saved (1326 records). [2025-09-15T21:15:25.051866] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-15T21:15:25.053499] [INFO ] [MAIN ] Derivative Progress: 640/2083 symbols completed. ESI took 1.1s. Estimated remaining: 8m 1s. Rate: 180.0 symbols/min [2025-09-15T21:15:25.060041] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:25.064842] [DEBUG] [MAIN ] ESRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:25.065896] [INFO ] [MAIN ] ESRT: Generated 1326 derivative records from 34095 primary records. [2025-09-15T21:15:25.066219] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-15T21:15:25.082216] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1326 records). [2025-09-15T21:15:25.082511] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-15T21:15:25.090996] [INFO ] [MAIN ] Derivative Progress: 641/2083 symbols completed. ESRT took 1.0s. Estimated remaining: 7m 60s. Rate: 180.3 symbols/min [2025-09-15T21:15:25.095874] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:25.096827] [DEBUG] [MAIN ] ESS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:25.097806] [INFO ] [MAIN ] ESS: Generated 1326 derivative records from 21846 primary records. [2025-09-15T21:15:25.098020] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-15T21:15:25.110696] [DEBUG] [LOCAL ] ESS: Derivative data saved (1326 records). [2025-09-15T21:15:25.110841] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-15T21:15:25.112490] [INFO ] [MAIN ] Derivative Progress: 642/2083 symbols completed. ESS took 1.0s. Estimated remaining: 7m 59s. Rate: 180.5 symbols/min [2025-09-15T21:15:25.112943] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:25.138925] [DEBUG] [LOCAL ] ESTC: Loaded 37222 existing records from primary storage. [2025-09-15T21:15:25.139142] [INFO ] [MAIN ] ESTC: Loaded 37222 primary data records. [2025-09-15T21:15:25.263953] [DEBUG] [LOCAL ] ETD: Loaded 20372 existing records from primary storage. [2025-09-15T21:15:25.301735] [INFO ] [MAIN ] ETD: Loaded 20372 primary data records. [2025-09-15T21:15:25.465777] [DEBUG] [LOCAL ] ET: Loaded 39750 existing records from primary storage. [2025-09-15T21:15:25.510097] [INFO ] [MAIN ] ET: Loaded 39750 primary data records. [2025-09-15T21:15:26.004946] [DEBUG] [MAIN ] ESTC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:26.006354] [INFO ] [MAIN ] ESTC: Generated 1326 derivative records from 37222 primary records. [2025-09-15T21:15:26.006842] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-15T21:15:26.023389] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1326 records). [2025-09-15T21:15:26.033948] [DEBUG] [MAIN ] ETD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:26.034897] [INFO ] [MAIN ] ETD: Generated 1326 derivative records from 20372 primary records. [2025-09-15T21:15:26.034093] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-15T21:15:26.037200] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-15T21:15:26.036985] [INFO ] [MAIN ] Derivative Progress: 643/2083 symbols completed. ESTC took 1.0s. Estimated remaining: 7m 60s. Rate: 180.0 symbols/min [2025-09-15T21:15:26.051953] [DEBUG] [LOCAL ] ETD: Derivative data saved (1326 records). [2025-09-15T21:15:26.052154] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-15T21:15:26.063047] [INFO ] [MAIN ] Derivative Progress: 644/2083 symbols completed. ETD took 1.0s. Estimated remaining: 7m 59s. Rate: 180.3 symbols/min [2025-09-15T21:15:26.063619] [DEBUG] [MAIN ] ET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:26.064377] [INFO ] [MAIN ] ET: Generated 1326 derivative records from 39750 primary records. [2025-09-15T21:15:26.064441] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-15T21:15:26.076163] [DEBUG] [LOCAL ] ET: Derivative data saved (1326 records). [2025-09-15T21:15:26.076245] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-15T21:15:26.078551] [INFO ] [MAIN ] Derivative Progress: 645/2083 symbols completed. ET took 1.0s. Estimated remaining: 7m 58s. Rate: 180.6 symbols/min [2025-09-15T21:15:26.079048] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:26.079224] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:26.078991] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:26.095516] [DEBUG] [LOCAL ] ETJ: Loaded 10939 existing records from primary storage. [2025-09-15T21:15:26.095658] [INFO ] [MAIN ] ETJ: Loaded 10939 primary data records. [2025-09-15T21:15:26.173520] [DEBUG] [LOCAL ] ETG: Loaded 12094 existing records from primary storage. [2025-09-15T21:15:26.205605] [INFO ] [MAIN ] ETG: Loaded 12094 primary data records. [2025-09-15T21:15:26.498739] [DEBUG] [LOCAL ] ETN: Loaded 38883 existing records from primary storage. [2025-09-15T21:15:26.514366] [INFO ] [MAIN ] ETN: Loaded 38883 primary data records. [2025-09-15T21:15:27.013874] [DEBUG] [MAIN ] ETJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:27.015560] [INFO ] [MAIN ] ETJ: Generated 1326 derivative records from 10939 primary records. [2025-09-15T21:15:27.015949] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-15T21:15:27.032888] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1326 records). [2025-09-15T21:15:27.034196] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-15T21:15:27.036826] [INFO ] [MAIN ] Derivative Progress: 646/2083 symbols completed. ETJ took 1.0s. Estimated remaining: 7m 59s. Rate: 180.0 symbols/min [2025-09-15T21:15:27.037472] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:27.052777] [DEBUG] [MAIN ] ETG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:27.053774] [INFO ] [MAIN ] ETG: Generated 1326 derivative records from 12094 primary records. [2025-09-15T21:15:27.054089] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-15T21:15:27.060278] [DEBUG] [LOCAL ] ETO: Loaded 4841 existing records from primary storage. [2025-09-15T21:15:27.069912] [INFO ] [MAIN ] ETO: Loaded 4841 primary data records. [2025-09-15T21:15:27.117472] [DEBUG] [LOCAL ] ETG: Derivative data saved (1326 records). [2025-09-15T21:15:27.188299] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-15T21:15:27.194268] [DEBUG] [MAIN ] ETN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:27.207335] [INFO ] [MAIN ] Derivative Progress: 647/2083 symbols completed. ETG took 1.1s. Estimated remaining: 7m 58s. Rate: 180.2 symbols/min [2025-09-15T21:15:27.237919] [INFO ] [MAIN ] ETN: Generated 1326 derivative records from 38883 primary records. [2025-09-15T21:15:27.256499] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:27.256667] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-15T21:15:27.387453] [DEBUG] [LOCAL ] ETN: Derivative data saved (1326 records). [2025-09-15T21:15:27.387796] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-15T21:15:27.396761] [INFO ] [MAIN ] Derivative Progress: 648/2083 symbols completed. ETN took 1.3s. Estimated remaining: 7m 58s. Rate: 180.3 symbols/min [2025-09-15T21:15:27.426808] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:27.608836] [DEBUG] [LOCAL ] ETV: Loaded 14880 existing records from primary storage. [2025-09-15T21:15:27.610874] [DEBUG] [LOCAL ] ETR: Loaded 39268 existing records from primary storage. [2025-09-15T21:15:27.609118] [INFO ] [MAIN ] ETV: Loaded 14880 primary data records. [2025-09-15T21:15:27.611159] [INFO ] [MAIN ] ETR: Loaded 39268 primary data records. [2025-09-15T21:15:28.168241] [DEBUG] [MAIN ] ETO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:28.181538] [INFO ] [MAIN ] ETO: Generated 1326 derivative records from 4841 primary records. [2025-09-15T21:15:28.382540] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-15T21:15:28.405075] [DEBUG] [LOCAL ] ETO: Derivative data saved (1326 records). [2025-09-15T21:15:28.406443] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-15T21:15:28.408873] [INFO ] [MAIN ] Derivative Progress: 649/2083 symbols completed. ETO took 1.4s. Estimated remaining: 7m 59s. Rate: 179.7 symbols/min [2025-09-15T21:15:28.409592] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:28.444822] [DEBUG] [MAIN ] ETR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:28.445097] [DEBUG] [MAIN ] ETV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:28.445824] [INFO ] [MAIN ] ETV: Generated 1326 derivative records from 14880 primary records. [2025-09-15T21:15:28.453146] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-15T21:15:28.446442] [INFO ] [MAIN ] ETR: Generated 1326 derivative records from 39268 primary records. [2025-09-15T21:15:28.453674] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-15T21:15:28.454318] [DEBUG] [LOCAL ] ETW: Loaded 17970 existing records from primary storage. [2025-09-15T21:15:28.455172] [INFO ] [MAIN ] ETW: Loaded 17970 primary data records. [2025-09-15T21:15:28.488093] [DEBUG] [LOCAL ] ETR: Derivative data saved (1326 records). [2025-09-15T21:15:28.488889] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-15T21:15:28.517928] [DEBUG] [LOCAL ] ETV: Derivative data saved (1326 records). [2025-09-15T21:15:28.517407] [INFO ] [MAIN ] Derivative Progress: 650/2083 symbols completed. ETR took 1.3s. Estimated remaining: 7m 58s. Rate: 179.9 symbols/min [2025-09-15T21:15:28.530392] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-15T21:15:28.547636] [INFO ] [MAIN ] Derivative Progress: 651/2083 symbols completed. ETV took 1.1s. Estimated remaining: 7m 57s. Rate: 180.2 symbols/min [2025-09-15T21:15:28.552928] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:28.561348] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:28.763552] [DEBUG] [LOCAL ] EVC: Loaded 13742 existing records from primary storage. [2025-09-15T21:15:28.771544] [INFO ] [MAIN ] EVC: Loaded 13742 primary data records. [2025-09-15T21:15:28.771964] [DEBUG] [LOCAL ] EVEX: Loaded 22449 existing records from primary storage. [2025-09-15T21:15:28.772182] [INFO ] [MAIN ] EVEX: Loaded 22449 primary data records. [2025-09-15T21:15:29.338006] [DEBUG] [MAIN ] ETW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:29.339384] [INFO ] [MAIN ] ETW: Generated 1326 derivative records from 17970 primary records. [2025-09-15T21:15:29.339677] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-15T21:15:29.352858] [DEBUG] [LOCAL ] ETW: Derivative data saved (1326 records). [2025-09-15T21:15:29.353167] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-15T21:15:29.355181] [INFO ] [MAIN ] Derivative Progress: 652/2083 symbols completed. ETW took 0.9s. Estimated remaining: 7m 58s. Rate: 179.8 symbols/min [2025-09-15T21:15:29.355535] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:29.379714] [DEBUG] [LOCAL ] EVF: Loaded 6398 existing records from primary storage. [2025-09-15T21:15:29.379491] [DEBUG] [MAIN ] EVEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:29.380902] [INFO ] [MAIN ] EVEX: Generated 1326 derivative records from 22449 primary records. [2025-09-15T21:15:29.380201] [INFO ] [MAIN ] EVF: Loaded 6398 primary data records. [2025-09-15T21:15:29.401333] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-15T21:15:29.526533] [DEBUG] [MAIN ] EVC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:29.525827] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1326 records). [2025-09-15T21:15:29.532270] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-15T21:15:29.540455] [INFO ] [MAIN ] Derivative Progress: 653/2083 symbols completed. EVEX took 1.0s. Estimated remaining: 7m 57s. Rate: 179.9 symbols/min [2025-09-15T21:15:29.533762] [INFO ] [MAIN ] EVC: Generated 1326 derivative records from 13742 primary records. [2025-09-15T21:15:29.562607] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-15T21:15:29.562513] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:29.739580] [DEBUG] [LOCAL ] EVG: Loaded 4289 existing records from primary storage. [2025-09-15T21:15:29.741280] [INFO ] [MAIN ] EVG: Loaded 4289 primary data records. [2025-09-15T21:15:29.754025] [DEBUG] [LOCAL ] EVC: Derivative data saved (1326 records). [2025-09-15T21:15:29.774782] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-15T21:15:29.794599] [INFO ] [MAIN ] Derivative Progress: 654/2083 symbols completed. EVC took 1.3s. Estimated remaining: 7m 56s. Rate: 180.0 symbols/min [2025-09-15T21:15:29.823623] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:30.046870] [DEBUG] [MAIN ] EVF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:30.048502] [INFO ] [MAIN ] EVF: Generated 1326 derivative records from 6398 primary records. [2025-09-15T21:15:30.049031] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-15T21:15:30.073786] [DEBUG] [LOCAL ] EVF: Derivative data saved (1326 records). [2025-09-15T21:15:30.073982] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-15T21:15:30.074847] [DEBUG] [LOCAL ] EVH: Loaded 36311 existing records from primary storage. [2025-09-15T21:15:30.077810] [INFO ] [MAIN ] Derivative Progress: 655/2083 symbols completed. EVF took 0.7s. Estimated remaining: 7m 56s. Rate: 180.0 symbols/min [2025-09-15T21:15:30.078196] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:30.078283] [INFO ] [MAIN ] EVH: Loaded 36311 primary data records. [2025-09-15T21:15:30.196286] [DEBUG] [LOCAL ] EVT: Loaded 12619 existing records from primary storage. [2025-09-15T21:15:30.198077] [INFO ] [MAIN ] EVT: Loaded 12619 primary data records. [2025-09-15T21:15:30.318859] [DEBUG] [MAIN ] EVG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:30.334973] [INFO ] [MAIN ] EVG: Generated 1326 derivative records from 4289 primary records. [2025-09-15T21:15:30.396252] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-15T21:15:30.576665] [DEBUG] [LOCAL ] EVG: Derivative data saved (1326 records). [2025-09-15T21:15:30.660049] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-15T21:15:30.662324] [INFO ] [MAIN ] Derivative Progress: 656/2083 symbols completed. EVG took 1.1s. Estimated remaining: 7m 56s. Rate: 179.8 symbols/min [2025-09-15T21:15:30.663153] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:30.688562] [DEBUG] [MAIN ] EVH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:30.689464] [INFO ] [MAIN ] EVH: Generated 1326 derivative records from 36311 primary records. [2025-09-15T21:15:30.689690] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-15T21:15:30.708420] [DEBUG] [LOCAL ] EVTC: Loaded 19286 existing records from primary storage. [2025-09-15T21:15:30.710815] [INFO ] [MAIN ] EVTC: Loaded 19286 primary data records. [2025-09-15T21:15:30.711250] [DEBUG] [LOCAL ] EVH: Derivative data saved (1326 records). [2025-09-15T21:15:30.751076] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-15T21:15:30.756579] [DEBUG] [MAIN ] EVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:30.785101] [INFO ] [MAIN ] Derivative Progress: 657/2083 symbols completed. EVH took 1.0s. Estimated remaining: 7m 55s. Rate: 180.0 symbols/min [2025-09-15T21:15:30.796670] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:30.797287] [INFO ] [MAIN ] EVT: Generated 1326 derivative records from 12619 primary records. [2025-09-15T21:15:30.820849] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-15T21:15:31.000993] [DEBUG] [LOCAL ] EVT: Derivative data saved (1326 records). [2025-09-15T21:15:31.001136] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-15T21:15:31.002875] [INFO ] [MAIN ] Derivative Progress: 658/2083 symbols completed. EVT took 0.9s. Estimated remaining: 7m 55s. Rate: 180.1 symbols/min [2025-09-15T21:15:31.016700] [DEBUG] [LOCAL ] EVTL: Loaded 29727 existing records from primary storage. [2025-09-15T21:15:31.017469] [INFO ] [MAIN ] EVTL: Loaded 29727 primary data records. [2025-09-15T21:15:31.285382] [DEBUG] [MAIN ] EVTC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:31.286109] [INFO ] [MAIN ] EVTC: Generated 1326 derivative records from 19286 primary records. [2025-09-15T21:15:31.286174] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-15T21:15:31.299449] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1326 records). [2025-09-15T21:15:31.299834] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-15T21:15:31.301578] [INFO ] [MAIN ] Derivative Progress: 659/2083 symbols completed. EVTC took 0.6s. Estimated remaining: 7m 54s. Rate: 180.1 symbols/min [2025-09-15T21:15:31.316843] [DEBUG] [MAIN ] EVTL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:31.317404] [INFO ] [MAIN ] EVTL: Generated 1326 derivative records from 29727 primary records. [2025-09-15T21:15:31.317464] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-15T21:15:31.328986] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1326 records). [2025-09-15T21:15:31.329053] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-15T21:15:31.330715] [INFO ] [MAIN ] Derivative Progress: 660/2083 symbols completed. EVTL took 0.5s. Estimated remaining: 7m 53s. Rate: 180.3 symbols/min [2025-09-15T21:15:31.331211] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:31.331138] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:31.332177] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:31.354100] [DEBUG] [LOCAL ] EVTR: Loaded 17176 existing records from primary storage. [2025-09-15T21:15:31.354267] [INFO ] [MAIN ] EVTR: Loaded 17176 primary data records. [2025-09-15T21:15:31.473078] [DEBUG] [LOCAL ] EXP: Loaded 21794 existing records from primary storage. [2025-09-15T21:15:31.513538] [INFO ] [MAIN ] EXP: Loaded 21794 primary data records. [2025-09-15T21:15:31.611196] [DEBUG] [LOCAL ] EW: Loaded 39389 existing records from primary storage. [2025-09-15T21:15:31.727932] [INFO ] [MAIN ] EW: Loaded 39389 primary data records. [2025-09-15T21:15:32.221054] [DEBUG] [MAIN ] EVTR: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:15:32.223295] [INFO ] [MAIN ] EVTR: Generated 1325 derivative records from 17176 primary records. [2025-09-15T21:15:32.224699] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-15T21:15:32.235294] [DEBUG] [MAIN ] EXP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:32.245284] [INFO ] [MAIN ] EXP: Generated 1326 derivative records from 21794 primary records. [2025-09-15T21:15:32.246610] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-15T21:15:32.247881] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1325 records). [2025-09-15T21:15:32.248298] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-15T21:15:32.250104] [INFO ] [MAIN ] Derivative Progress: 661/2083 symbols completed. EVTR took 0.9s. Estimated remaining: 7m 54s. Rate: 179.9 symbols/min [2025-09-15T21:15:32.259583] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:32.264385] [DEBUG] [LOCAL ] EXP: Derivative data saved (1326 records). [2025-09-15T21:15:32.264775] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-15T21:15:32.274852] [INFO ] [MAIN ] Derivative Progress: 662/2083 symbols completed. EXP took 0.9s. Estimated remaining: 7m 53s. Rate: 180.1 symbols/min [2025-09-15T21:15:32.280832] [DEBUG] [MAIN ] EW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:32.280991] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:32.282012] [INFO ] [MAIN ] EW: Generated 1326 derivative records from 39389 primary records. [2025-09-15T21:15:32.282425] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-15T21:15:32.302113] [DEBUG] [LOCAL ] EW: Derivative data saved (1326 records). [2025-09-15T21:15:32.302374] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-15T21:15:32.305290] [INFO ] [MAIN ] Derivative Progress: 663/2083 symbols completed. EW took 1.0s. Estimated remaining: 7m 52s. Rate: 180.4 symbols/min [2025-09-15T21:15:32.305804] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:32.354999] [DEBUG] [LOCAL ] EXPD: Loaded 35289 existing records from primary storage. [2025-09-15T21:15:32.355205] [INFO ] [MAIN ] EXPD: Loaded 35289 primary data records. [2025-09-15T21:15:32.355737] [DEBUG] [LOCAL ] EXR: Loaded 33469 existing records from primary storage. [2025-09-15T21:15:32.356027] [INFO ] [MAIN ] EXR: Loaded 33469 primary data records. [2025-09-15T21:15:32.615243] [DEBUG] [LOCAL ] F: Loaded 39780 existing records from primary storage. [2025-09-15T21:15:32.679806] [INFO ] [MAIN ] F: Loaded 39780 primary data records. [2025-09-15T21:15:33.289874] [DEBUG] [MAIN ] EXR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:33.292231] [INFO ] [MAIN ] EXR: Generated 1326 derivative records from 33469 primary records. [2025-09-15T21:15:33.291312] [DEBUG] [MAIN ] EXPD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:33.293888] [INFO ] [MAIN ] EXPD: Generated 1326 derivative records from 35289 primary records. [2025-09-15T21:15:33.292958] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-15T21:15:33.294065] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-15T21:15:33.319193] [DEBUG] [LOCAL ] EXR: Derivative data saved (1326 records). [2025-09-15T21:15:33.320195] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-15T21:15:33.322953] [INFO ] [MAIN ] Derivative Progress: 664/2083 symbols completed. EXR took 1.0s. Estimated remaining: 7m 54s. Rate: 179.8 symbols/min [2025-09-15T21:15:33.324347] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:33.324828] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1326 records). [2025-09-15T21:15:33.325448] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-15T21:15:33.328474] [INFO ] [MAIN ] Derivative Progress: 665/2083 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 52s. Rate: 180.1 symbols/min [2025-09-15T21:15:33.329058] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:33.346222] [DEBUG] [MAIN ] F: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:33.347251] [INFO ] [MAIN ] F: Generated 1326 derivative records from 39780 primary records. [2025-09-15T21:15:33.347476] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-15T21:15:33.371086] [DEBUG] [LOCAL ] F: Derivative data saved (1326 records). [2025-09-15T21:15:33.371363] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-15T21:15:33.374448] [INFO ] [MAIN ] Derivative Progress: 666/2083 symbols completed. F took 1.1s. Estimated remaining: 7m 52s. Rate: 180.3 symbols/min [2025-09-15T21:15:33.375123] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:33.407827] [DEBUG] [LOCAL ] FBIN: Loaded 37347 existing records from primary storage. [2025-09-15T21:15:33.408114] [INFO ] [MAIN ] FBIN: Loaded 37347 primary data records. [2025-09-15T21:15:33.408904] [DEBUG] [LOCAL ] FAF: Loaded 31072 existing records from primary storage. [2025-09-15T21:15:33.439897] [INFO ] [MAIN ] FAF: Loaded 31072 primary data records. [2025-09-15T21:15:33.724767] [DEBUG] [LOCAL ] FBP: Loaded 33317 existing records from primary storage. [2025-09-15T21:15:33.743581] [INFO ] [MAIN ] FBP: Loaded 33317 primary data records. [2025-09-15T21:15:34.302184] [DEBUG] [MAIN ] FBIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:34.303055] [INFO ] [MAIN ] FBIN: Generated 1326 derivative records from 37347 primary records. [2025-09-15T21:15:34.303448] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-15T21:15:34.318070] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1326 records). [2025-09-15T21:15:34.318302] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-15T21:15:34.321152] [INFO ] [MAIN ] Derivative Progress: 667/2083 symbols completed. FBIN took 1.0s. Estimated remaining: 7m 53s. Rate: 179.8 symbols/min [2025-09-15T21:15:34.321620] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:34.332548] [DEBUG] [MAIN ] FAF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:34.333495] [INFO ] [MAIN ] FAF: Generated 1326 derivative records from 31072 primary records. [2025-09-15T21:15:34.334790] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-15T21:15:34.349973] [DEBUG] [LOCAL ] FAF: Derivative data saved (1326 records). [2025-09-15T21:15:34.359157] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-15T21:15:34.361668] [INFO ] [MAIN ] Derivative Progress: 668/2083 symbols completed. FAF took 1.0s. Estimated remaining: 7m 52s. Rate: 180.0 symbols/min [2025-09-15T21:15:34.362047] [DEBUG] [MAIN ] FBP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:34.362218] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:34.363104] [INFO ] [MAIN ] FBP: Generated 1326 derivative records from 33317 primary records. [2025-09-15T21:15:34.368973] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-15T21:15:34.381545] [DEBUG] [LOCAL ] FBP: Derivative data saved (1326 records). [2025-09-15T21:15:34.388632] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-15T21:15:34.390732] [INFO ] [MAIN ] Derivative Progress: 669/2083 symbols completed. FBP took 1.0s. Estimated remaining: 7m 51s. Rate: 180.3 symbols/min [2025-09-15T21:15:34.394547] [DEBUG] [LOCAL ] FBRT: Loaded 24991 existing records from primary storage. [2025-09-15T21:15:34.394664] [INFO ] [MAIN ] FBRT: Loaded 24991 primary data records. [2025-09-15T21:15:34.394088] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:34.453678] [DEBUG] [LOCAL ] FC: Loaded 10433 existing records from primary storage. [2025-09-15T21:15:34.479286] [INFO ] [MAIN ] FC: Loaded 10433 primary data records. [2025-09-15T21:15:34.800538] [DEBUG] [LOCAL ] FCF: Loaded 28033 existing records from primary storage. [2025-09-15T21:15:34.856670] [INFO ] [MAIN ] FCF: Loaded 28033 primary data records. [2025-09-15T21:15:35.225323] [DEBUG] [MAIN ] FBRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:35.226861] [INFO ] [MAIN ] FBRT: Generated 1326 derivative records from 24991 primary records. [2025-09-15T21:15:35.227565] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-15T21:15:35.249764] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1326 records). [2025-09-15T21:15:35.250011] [DEBUG] [MAIN ] FC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:35.250250] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-15T21:15:35.252497] [INFO ] [MAIN ] Derivative Progress: 670/2083 symbols completed. FBRT took 0.9s. Estimated remaining: 7m 51s. Rate: 179.9 symbols/min [2025-09-15T21:15:35.252784] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:35.250824] [INFO ] [MAIN ] FC: Generated 1326 derivative records from 10433 primary records. [2025-09-15T21:15:35.253274] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-15T21:15:35.266021] [DEBUG] [LOCAL ] FC: Derivative data saved (1326 records). [2025-09-15T21:15:35.266364] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-15T21:15:35.268814] [INFO ] [MAIN ] Derivative Progress: 671/2083 symbols completed. FC took 0.9s. Estimated remaining: 7m 50s. Rate: 180.1 symbols/min [2025-09-15T21:15:35.270343] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:35.280860] [DEBUG] [MAIN ] FCF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:35.281510] [INFO ] [MAIN ] FCF: Generated 1326 derivative records from 28033 primary records. [2025-09-15T21:15:35.281615] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-15T21:15:35.302743] [DEBUG] [LOCAL ] FCF: Derivative data saved (1326 records). [2025-09-15T21:15:35.302905] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-15T21:15:35.304738] [INFO ] [MAIN ] Derivative Progress: 672/2083 symbols completed. FCF took 0.9s. Estimated remaining: 7m 49s. Rate: 180.4 symbols/min [2025-09-15T21:15:35.309078] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:35.309347] [DEBUG] [LOCAL ] FCT: Loaded 10373 existing records from primary storage. [2025-09-15T21:15:35.309776] [INFO ] [MAIN ] FCT: Loaded 10373 primary data records. [2025-09-15T21:15:35.401521] [DEBUG] [LOCAL ] FCPT: Loaded 26579 existing records from primary storage. [2025-09-15T21:15:35.427294] [INFO ] [MAIN ] FCPT: Loaded 26579 primary data records. [2025-09-15T21:15:35.567453] [DEBUG] [LOCAL ] FDS: Loaded 18187 existing records from primary storage. [2025-09-15T21:15:35.680378] [INFO ] [MAIN ] FDS: Loaded 18187 primary data records. [2025-09-15T21:15:36.150702] [DEBUG] [MAIN ] FCT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:36.151672] [INFO ] [MAIN ] FCT: Generated 1326 derivative records from 10373 primary records. [2025-09-15T21:15:36.151865] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-15T21:15:36.165853] [DEBUG] [LOCAL ] FCT: Derivative data saved (1326 records). [2025-09-15T21:15:36.167211] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-15T21:15:36.170988] [INFO ] [MAIN ] Derivative Progress: 673/2083 symbols completed. FCT took 0.9s. Estimated remaining: 7m 50s. Rate: 179.9 symbols/min [2025-09-15T21:15:36.187247] [DEBUG] [MAIN ] FCPT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:36.188597] [INFO ] [MAIN ] FCPT: Generated 1326 derivative records from 26579 primary records. [2025-09-15T21:15:36.188746] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-15T21:15:36.198971] [DEBUG] [MAIN ] FDS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:36.199925] [INFO ] [MAIN ] FDS: Generated 1326 derivative records from 18187 primary records. [2025-09-15T21:15:36.208367] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-15T21:15:36.227773] [DEBUG] [LOCAL ] FDS: Derivative data saved (1326 records). [2025-09-15T21:15:36.229758] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-15T21:15:36.231757] [INFO ] [MAIN ] Derivative Progress: 674/2083 symbols completed. FDS took 0.9s. Estimated remaining: 7m 49s. Rate: 180.1 symbols/min [2025-09-15T21:15:36.229845] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1326 records). [2025-09-15T21:15:36.231955] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-15T21:15:36.234599] [INFO ] [MAIN ] Derivative Progress: 675/2083 symbols completed. FCPT took 1.0s. Estimated remaining: 7m 48s. Rate: 180.4 symbols/min [2025-09-15T21:15:36.235387] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:36.235314] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:36.235199] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:36.251245] [DEBUG] [LOCAL ] FET: Loaded 8868 existing records from primary storage. [2025-09-15T21:15:36.251478] [INFO ] [MAIN ] FET: Loaded 8868 primary data records. [2025-09-15T21:15:36.495182] [DEBUG] [LOCAL ] FE: Loaded 39450 existing records from primary storage. [2025-09-15T21:15:36.495326] [INFO ] [MAIN ] FE: Loaded 39450 primary data records. [2025-09-15T21:15:36.566502] [DEBUG] [LOCAL ] FDX: Loaded 37922 existing records from primary storage. [2025-09-15T21:15:36.588155] [INFO ] [MAIN ] FDX: Loaded 37922 primary data records. [2025-09-15T21:15:37.141129] [DEBUG] [MAIN ] FET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:37.142502] [INFO ] [MAIN ] FET: Generated 1326 derivative records from 8868 primary records. [2025-09-15T21:15:37.142788] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-15T21:15:37.157404] [DEBUG] [LOCAL ] FET: Derivative data saved (1326 records). [2025-09-15T21:15:37.157613] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-15T21:15:37.159385] [INFO ] [MAIN ] Derivative Progress: 676/2083 symbols completed. FET took 0.9s. Estimated remaining: 7m 49s. Rate: 179.9 symbols/min [2025-09-15T21:15:37.160063] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:37.174623] [DEBUG] [MAIN ] FDX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:37.176817] [INFO ] [MAIN ] FDX: Generated 1326 derivative records from 37922 primary records. [2025-09-15T21:15:37.176996] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-15T21:15:37.203390] [DEBUG] [LOCAL ] FDX: Derivative data saved (1326 records). [2025-09-15T21:15:37.200427] [DEBUG] [MAIN ] FE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:37.204195] [INFO ] [MAIN ] FE: Generated 1326 derivative records from 39450 primary records. [2025-09-15T21:15:37.204300] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-15T21:15:37.204678] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-15T21:15:37.206391] [INFO ] [MAIN ] Derivative Progress: 677/2083 symbols completed. FDX took 1.0s. Estimated remaining: 7m 48s. Rate: 180.2 symbols/min [2025-09-15T21:15:37.213114] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:37.213530] [DEBUG] [LOCAL ] FF: Loaded 17610 existing records from primary storage. [2025-09-15T21:15:37.213700] [INFO ] [MAIN ] FF: Loaded 17610 primary data records. [2025-09-15T21:15:37.303695] [DEBUG] [LOCAL ] FE: Derivative data saved (1326 records). [2025-09-15T21:15:37.311787] [DEBUG] [LOCAL ] FFA: Loaded 3377 existing records from primary storage. [2025-09-15T21:15:37.317171] [INFO ] [MAIN ] FFA: Loaded 3377 primary data records. [2025-09-15T21:15:37.311891] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-15T21:15:37.340004] [INFO ] [MAIN ] Derivative Progress: 678/2083 symbols completed. FE took 1.1s. Estimated remaining: 7m 47s. Rate: 180.3 symbols/min [2025-09-15T21:15:37.386753] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:37.761631] [DEBUG] [LOCAL ] FFC: Loaded 11958 existing records from primary storage. [2025-09-15T21:15:37.772986] [INFO ] [MAIN ] FFC: Loaded 11958 primary data records. [2025-09-15T21:15:38.073380] [DEBUG] [MAIN ] FFA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:38.073798] [DEBUG] [MAIN ] FF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:38.074450] [INFO ] [MAIN ] FFA: Generated 1326 derivative records from 3377 primary records. [2025-09-15T21:15:38.076006] [INFO ] [MAIN ] FF: Generated 1326 derivative records from 17610 primary records. [2025-09-15T21:15:38.075447] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-15T21:15:38.076586] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-15T21:15:38.096472] [DEBUG] [LOCAL ] FFA: Derivative data saved (1326 records). [2025-09-15T21:15:38.096861] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-15T21:15:38.098919] [INFO ] [MAIN ] Derivative Progress: 679/2083 symbols completed. FFA took 0.9s. Estimated remaining: 7m 48s. Rate: 180.0 symbols/min [2025-09-15T21:15:38.099217] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:38.103804] [DEBUG] [LOCAL ] FF: Derivative data saved (1326 records). [2025-09-15T21:15:38.104822] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-15T21:15:38.106992] [INFO ] [MAIN ] Derivative Progress: 680/2083 symbols completed. FF took 0.9s. Estimated remaining: 7m 47s. Rate: 180.2 symbols/min [2025-09-15T21:15:38.107347] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:38.118518] [DEBUG] [MAIN ] FFC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:38.119290] [INFO ] [MAIN ] FFC: Generated 1326 derivative records from 11958 primary records. [2025-09-15T21:15:38.119351] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-15T21:15:38.138669] [DEBUG] [LOCAL ] FFC: Derivative data saved (1326 records). [2025-09-15T21:15:38.138884] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-15T21:15:38.140836] [INFO ] [MAIN ] Derivative Progress: 681/2083 symbols completed. FFC took 0.8s. Estimated remaining: 7m 46s. Rate: 180.5 symbols/min [2025-09-15T21:15:38.141158] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:38.154776] [DEBUG] [LOCAL ] FFWM: Loaded 26071 existing records from primary storage. [2025-09-15T21:15:38.162016] [DEBUG] [LOCAL ] FG: Loaded 15163 existing records from primary storage. [2025-09-15T21:15:38.161712] [DEBUG] [LOCAL ] FGN: Loaded 2723 existing records from primary storage. [2025-09-15T21:15:38.161777] [INFO ] [MAIN ] FFWM: Loaded 26071 primary data records. [2025-09-15T21:15:38.162194] [INFO ] [MAIN ] FG: Loaded 15163 primary data records. [2025-09-15T21:15:38.162318] [INFO ] [MAIN ] FGN: Loaded 2723 primary data records. [2025-09-15T21:15:39.039556] [DEBUG] [MAIN ] FG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:39.054970] [DEBUG] [MAIN ] FGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:39.059275] [INFO ] [MAIN ] FG: Generated 1326 derivative records from 15163 primary records. [2025-09-15T21:15:39.060005] [INFO ] [MAIN ] FGN: Generated 1326 derivative records from 2723 primary records. [2025-09-15T21:15:39.060543] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-15T21:15:39.060435] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-15T21:15:39.060376] [DEBUG] [MAIN ] FFWM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:39.062231] [INFO ] [MAIN ] FFWM: Generated 1326 derivative records from 26071 primary records. [2025-09-15T21:15:39.068455] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-15T21:15:39.080137] [DEBUG] [LOCAL ] FGN: Derivative data saved (1326 records). [2025-09-15T21:15:39.082375] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-15T21:15:39.090580] [INFO ] [MAIN ] Derivative Progress: 682/2083 symbols completed. FGN took 0.9s. Estimated remaining: 7m 47s. Rate: 180.0 symbols/min [2025-09-15T21:15:39.094151] [INFO ] [MAIN ] FGSN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:39.097317] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1326 records). [2025-09-15T21:15:39.097815] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-15T21:15:39.101718] [INFO ] [MAIN ] Derivative Progress: 683/2083 symbols completed. FFWM took 1.0s. Estimated remaining: 7m 46s. Rate: 180.2 symbols/min [2025-09-15T21:15:39.102232] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:39.102884] [DEBUG] [LOCAL ] FG: Derivative data saved (1326 records). [2025-09-15T21:15:39.103307] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-15T21:15:39.105159] [INFO ] [MAIN ] Derivative Progress: 684/2083 symbols completed. FG took 1.0s. Estimated remaining: 7m 45s. Rate: 180.5 symbols/min [2025-09-15T21:15:39.105626] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:39.108367] [DEBUG] [LOCAL ] FGSN: Loaded 3496 existing records from primary storage. [2025-09-15T21:15:39.108907] [INFO ] [MAIN ] FGSN: Loaded 3496 primary data records. [2025-09-15T21:15:39.408194] [DEBUG] [LOCAL ] FHI: Loaded 29782 existing records from primary storage. [2025-09-15T21:15:39.410818] [DEBUG] [LOCAL ] FHN: Loaded 39364 existing records from primary storage. [2025-09-15T21:15:39.411119] [INFO ] [MAIN ] FHI: Loaded 29782 primary data records. [2025-09-15T21:15:39.411231] [INFO ] [MAIN ] FHN: Loaded 39364 primary data records. [2025-09-15T21:15:39.961195] [DEBUG] [MAIN ] FGSN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:39.962670] [INFO ] [MAIN ] FGSN: Generated 1326 derivative records from 3496 primary records. [2025-09-15T21:15:39.963143] [DEBUG] [LOCAL ] FGSN: Saving derivative data. [2025-09-15T21:15:39.975779] [DEBUG] [LOCAL ] FGSN: Derivative data saved (1326 records). [2025-09-15T21:15:39.975920] [INFO ] [MAIN ] FGSN: Successfully saved derivative data. [2025-09-15T21:15:39.977865] [INFO ] [MAIN ] Derivative Progress: 685/2083 symbols completed. FGSN took 0.9s. Estimated remaining: 7m 46s. Rate: 180.1 symbols/min [2025-09-15T21:15:39.979663] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:40.003249] [DEBUG] [MAIN ] FHN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:40.007094] [DEBUG] [MAIN ] FHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:40.007987] [INFO ] [MAIN ] FHN: Generated 1326 derivative records from 39364 primary records. [2025-09-15T21:15:40.008942] [INFO ] [MAIN ] FHI: Generated 1326 derivative records from 29782 primary records. [2025-09-15T21:15:40.009079] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-15T21:15:40.009040] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-15T21:15:40.031840] [DEBUG] [LOCAL ] FHI: Derivative data saved (1326 records). [2025-09-15T21:15:40.041523] [DEBUG] [LOCAL ] FHN: Derivative data saved (1326 records). [2025-09-15T21:15:40.040997] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-15T21:15:40.043438] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-15T21:15:40.043380] [INFO ] [MAIN ] Derivative Progress: 686/2083 symbols completed. FHI took 0.9s. Estimated remaining: 7m 45s. Rate: 180.3 symbols/min [2025-09-15T21:15:40.043691] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:40.045291] [INFO ] [MAIN ] Derivative Progress: 687/2083 symbols completed. FHN took 0.9s. Estimated remaining: 7m 44s. Rate: 180.6 symbols/min [2025-09-15T21:15:40.045710] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:40.061967] [DEBUG] [LOCAL ] FI: Loaded 39603 existing records from primary storage. [2025-09-15T21:15:40.062172] [INFO ] [MAIN ] FI: Loaded 39603 primary data records. [2025-09-15T21:15:40.183699] [DEBUG] [LOCAL ] FICO: Loaded 16098 existing records from primary storage. [2025-09-15T21:15:40.205130] [INFO ] [MAIN ] FICO: Loaded 16098 primary data records. [2025-09-15T21:15:40.389358] [DEBUG] [LOCAL ] FIGS: Loaded 36014 existing records from primary storage. [2025-09-15T21:15:40.448516] [INFO ] [MAIN ] FIGS: Loaded 36014 primary data records. [2025-09-15T21:15:40.960088] [DEBUG] [MAIN ] FI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:40.961188] [INFO ] [MAIN ] FI: Generated 1326 derivative records from 39603 primary records. [2025-09-15T21:15:40.961480] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-15T21:15:40.975758] [DEBUG] [LOCAL ] FI: Derivative data saved (1326 records). [2025-09-15T21:15:40.976680] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-15T21:15:40.979499] [INFO ] [MAIN ] Derivative Progress: 688/2083 symbols completed. FI took 1.0s. Estimated remaining: 7m 45s. Rate: 180.1 symbols/min [2025-09-15T21:15:40.989972] [DEBUG] [MAIN ] FICO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:40.990844] [INFO ] [MAIN ] FICO: Generated 1326 derivative records from 16098 primary records. [2025-09-15T21:15:40.991100] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-15T21:15:41.004090] [DEBUG] [LOCAL ] FICO: Derivative data saved (1326 records). [2025-09-15T21:15:41.005500] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-15T21:15:41.007724] [INFO ] [MAIN ] Derivative Progress: 689/2083 symbols completed. FICO took 1.0s. Estimated remaining: 7m 44s. Rate: 180.3 symbols/min [2025-09-15T21:15:41.017396] [DEBUG] [MAIN ] FIGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:41.018021] [INFO ] [MAIN ] FIGS: Generated 1326 derivative records from 36014 primary records. [2025-09-15T21:15:41.018082] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-15T21:15:41.029728] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1326 records). [2025-09-15T21:15:41.029785] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-15T21:15:41.032076] [INFO ] [MAIN ] Derivative Progress: 690/2083 symbols completed. FIGS took 1.0s. Estimated remaining: 7m 43s. Rate: 180.6 symbols/min [2025-09-15T21:15:41.032735] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:41.032890] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:41.033017] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:41.045408] [DEBUG] [LOCAL ] FINS: Loaded 6401 existing records from primary storage. [2025-09-15T21:15:41.045606] [INFO ] [MAIN ] FINS: Loaded 6401 primary data records. [2025-09-15T21:15:41.193732] [DEBUG] [LOCAL ] FIHL: Loaded 28558 existing records from primary storage. [2025-09-15T21:15:41.209858] [INFO ] [MAIN ] FIHL: Loaded 28558 primary data records. [2025-09-15T21:15:41.313084] [DEBUG] [LOCAL ] FINV: Loaded 32958 existing records from primary storage. [2025-09-15T21:15:41.395388] [INFO ] [MAIN ] FINV: Loaded 32958 primary data records. [2025-09-15T21:15:41.920518] [DEBUG] [MAIN ] FINS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:41.923491] [INFO ] [MAIN ] FINS: Generated 1326 derivative records from 6401 primary records. [2025-09-15T21:15:41.924593] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-15T21:15:41.936012] [DEBUG] [MAIN ] FIHL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:41.943756] [INFO ] [MAIN ] FIHL: Generated 1326 derivative records from 28558 primary records. [2025-09-15T21:15:41.944023] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-15T21:15:41.961412] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1326 records). [2025-09-15T21:15:41.964592] [DEBUG] [LOCAL ] FINS: Derivative data saved (1326 records). [2025-09-15T21:15:41.965355] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-15T21:15:41.964694] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-15T21:15:41.967739] [INFO ] [MAIN ] Derivative Progress: 691/2083 symbols completed. FIHL took 0.9s. Estimated remaining: 7m 44s. Rate: 180.1 symbols/min [2025-09-15T21:15:41.969678] [INFO ] [MAIN ] Derivative Progress: 692/2083 symbols completed. FINS took 0.9s. Estimated remaining: 7m 43s. Rate: 180.3 symbols/min [2025-09-15T21:15:41.975754] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:41.975857] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:41.980456] [DEBUG] [MAIN ] FINV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:41.981723] [INFO ] [MAIN ] FINV: Generated 1326 derivative records from 32958 primary records. [2025-09-15T21:15:41.981872] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-15T21:15:41.996065] [DEBUG] [LOCAL ] FINV: Derivative data saved (1326 records). [2025-09-15T21:15:41.996217] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-15T21:15:41.998357] [INFO ] [MAIN ] Derivative Progress: 693/2083 symbols completed. FINV took 1.0s. Estimated remaining: 7m 42s. Rate: 180.6 symbols/min [2025-09-15T21:15:41.998730] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:42.005971] [DEBUG] [LOCAL ] FLC: Loaded 3882 existing records from primary storage. [2025-09-15T21:15:42.011621] [INFO ] [MAIN ] FLC: Loaded 3882 primary data records. [2025-09-15T21:15:42.130190] [DEBUG] [LOCAL ] FIX: Loaded 21071 existing records from primary storage. [2025-09-15T21:15:42.145613] [INFO ] [MAIN ] FIX: Loaded 21071 primary data records. [2025-09-15T21:15:42.189190] [DEBUG] [LOCAL ] FIS: Loaded 39350 existing records from primary storage. [2025-09-15T21:15:42.279695] [INFO ] [MAIN ] FIS: Loaded 39350 primary data records. [2025-09-15T21:15:42.893591] [DEBUG] [MAIN ] FLC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:42.894760] [INFO ] [MAIN ] FLC: Generated 1326 derivative records from 3882 primary records. [2025-09-15T21:15:42.895657] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-15T21:15:42.908603] [DEBUG] [LOCAL ] FLC: Derivative data saved (1326 records). [2025-09-15T21:15:42.908937] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-15T21:15:42.911552] [INFO ] [MAIN ] Derivative Progress: 694/2083 symbols completed. FLC took 0.9s. Estimated remaining: 7m 43s. Rate: 180.1 symbols/min [2025-09-15T21:15:42.912332] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:42.923594] [DEBUG] [MAIN ] FIX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:42.924725] [INFO ] [MAIN ] FIX: Generated 1326 derivative records from 21071 primary records. [2025-09-15T21:15:42.925012] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-15T21:15:42.938965] [DEBUG] [LOCAL ] FIX: Derivative data saved (1326 records). [2025-09-15T21:15:42.939105] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-15T21:15:42.941175] [INFO ] [MAIN ] Derivative Progress: 695/2083 symbols completed. FIX took 1.0s. Estimated remaining: 7m 42s. Rate: 180.4 symbols/min [2025-09-15T21:15:42.941377] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:42.951997] [DEBUG] [MAIN ] FIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:42.952773] [INFO ] [MAIN ] FIS: Generated 1326 derivative records from 39350 primary records. [2025-09-15T21:15:42.952874] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-15T21:15:42.965389] [DEBUG] [LOCAL ] FIS: Derivative data saved (1326 records). [2025-09-15T21:15:42.965746] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-15T21:15:42.976439] [INFO ] [MAIN ] Derivative Progress: 696/2083 symbols completed. FIS took 1.0s. Estimated remaining: 7m 41s. Rate: 180.6 symbols/min [2025-09-15T21:15:42.976728] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:43.007530] [DEBUG] [LOCAL ] FLNG: Loaded 24804 existing records from primary storage. [2025-09-15T21:15:43.008499] [INFO ] [MAIN ] FLNG: Loaded 24804 primary data records. [2025-09-15T21:15:43.008339] [DEBUG] [LOCAL ] FLG: Loaded 39349 existing records from primary storage. [2025-09-15T21:15:43.029176] [INFO ] [MAIN ] FLG: Loaded 39349 primary data records. [2025-09-15T21:15:43.396889] [DEBUG] [LOCAL ] FLO: Loaded 38409 existing records from primary storage. [2025-09-15T21:15:43.465506] [INFO ] [MAIN ] FLO: Loaded 38409 primary data records. [2025-09-15T21:15:43.895058] [DEBUG] [MAIN ] FLNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:43.902161] [INFO ] [MAIN ] FLNG: Generated 1326 derivative records from 24804 primary records. [2025-09-15T21:15:43.905741] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-15T21:15:43.908226] [DEBUG] [MAIN ] FLG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:43.908961] [INFO ] [MAIN ] FLG: Generated 1326 derivative records from 39349 primary records. [2025-09-15T21:15:43.909384] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-15T21:15:43.922069] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1326 records). [2025-09-15T21:15:43.922452] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-15T21:15:43.924709] [INFO ] [MAIN ] Derivative Progress: 697/2083 symbols completed. FLNG took 1.0s. Estimated remaining: 7m 42s. Rate: 180.1 symbols/min [2025-09-15T21:15:43.933764] [INFO ] [MAIN ] FLOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:43.937179] [DEBUG] [LOCAL ] FLG: Derivative data saved (1326 records). [2025-09-15T21:15:43.937456] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-15T21:15:43.939400] [INFO ] [MAIN ] Derivative Progress: 698/2083 symbols completed. FLG took 1.0s. Estimated remaining: 7m 41s. Rate: 180.4 symbols/min [2025-09-15T21:15:43.939738] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:43.954332] [DEBUG] [MAIN ] FLO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:43.955122] [INFO ] [MAIN ] FLO: Generated 1326 derivative records from 38409 primary records. [2025-09-15T21:15:43.955233] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-15T21:15:43.972877] [DEBUG] [LOCAL ] FLO: Derivative data saved (1326 records). [2025-09-15T21:15:43.972941] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-15T21:15:43.974727] [INFO ] [MAIN ] Derivative Progress: 699/2083 symbols completed. FLO took 1.0s. Estimated remaining: 7m 40s. Rate: 180.6 symbols/min [2025-09-15T21:15:43.974975] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:43.984798] [DEBUG] [LOCAL ] FLOC: Loaded 20511 existing records from primary storage. [2025-09-15T21:15:43.984970] [INFO ] [MAIN ] FLOC: Loaded 20511 primary data records. [2025-09-15T21:15:44.144175] [DEBUG] [LOCAL ] FLS: Loaded 36835 existing records from primary storage. [2025-09-15T21:15:44.173936] [INFO ] [MAIN ] FLS: Loaded 36835 primary data records. [2025-09-15T21:15:44.363457] [DEBUG] [LOCAL ] FLUT: Loaded 37330 existing records from primary storage. [2025-09-15T21:15:44.376398] [INFO ] [MAIN ] FLUT: Loaded 37330 primary data records. [2025-09-15T21:15:44.866476] [DEBUG] [MAIN ] FLOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:44.867349] [INFO ] [MAIN ] FLOC: Generated 1326 derivative records from 20511 primary records. [2025-09-15T21:15:44.868676] [DEBUG] [LOCAL ] FLOC: Saving derivative data. [2025-09-15T21:15:44.883980] [DEBUG] [LOCAL ] FLOC: Derivative data saved (1326 records). [2025-09-15T21:15:44.884299] [INFO ] [MAIN ] FLOC: Successfully saved derivative data. [2025-09-15T21:15:44.886322] [INFO ] [MAIN ] Derivative Progress: 700/2083 symbols completed. FLOC took 1.0s. Estimated remaining: 7m 41s. Rate: 180.2 symbols/min [2025-09-15T21:15:44.893164] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:44.897794] [DEBUG] [MAIN ] FLS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:44.898873] [INFO ] [MAIN ] FLS: Generated 1326 derivative records from 36835 primary records. [2025-09-15T21:15:44.899130] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-15T21:15:44.913099] [DEBUG] [LOCAL ] FLS: Derivative data saved (1326 records). [2025-09-15T21:15:44.913357] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-15T21:15:44.915148] [INFO ] [MAIN ] Derivative Progress: 701/2083 symbols completed. FLS took 1.0s. Estimated remaining: 7m 40s. Rate: 180.4 symbols/min [2025-09-15T21:15:44.925919] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:44.930124] [DEBUG] [MAIN ] FLUT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:44.931194] [INFO ] [MAIN ] FLUT: Generated 1326 derivative records from 37330 primary records. [2025-09-15T21:15:44.931390] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-15T21:15:44.949929] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1326 records). [2025-09-15T21:15:44.950543] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-15T21:15:44.950409] [DEBUG] [LOCAL ] FLXR: Loaded 15177 existing records from primary storage. [2025-09-15T21:15:44.953417] [INFO ] [MAIN ] Derivative Progress: 702/2083 symbols completed. FLUT took 1.0s. Estimated remaining: 7m 39s. Rate: 180.6 symbols/min [2025-09-15T21:15:44.953553] [INFO ] [MAIN ] FLXR: Loaded 15177 primary data records. [2025-09-15T21:15:44.953956] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:45.050120] [DEBUG] [LOCAL ] FMN: Loaded 3809 existing records from primary storage. [2025-09-15T21:15:45.076394] [INFO ] [MAIN ] FMN: Loaded 3809 primary data records. [2025-09-15T21:15:45.397171] [DEBUG] [LOCAL ] FMC: Loaded 38090 existing records from primary storage. [2025-09-15T21:15:45.397879] [INFO ] [MAIN ] FMC: Loaded 38090 primary data records. [2025-09-15T21:15:45.860572] [DEBUG] [MAIN ] FLXR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:45.871890] [INFO ] [MAIN ] FLXR: Generated 1326 derivative records from 15177 primary records. [2025-09-15T21:15:45.872414] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-15T21:15:45.872176] [DEBUG] [MAIN ] FMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:45.873948] [INFO ] [MAIN ] FMN: Generated 1326 derivative records from 3809 primary records. [2025-09-15T21:15:45.880092] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-15T21:15:45.887186] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1326 records). [2025-09-15T21:15:45.896787] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-15T21:15:45.899473] [INFO ] [MAIN ] Derivative Progress: 703/2083 symbols completed. FLXR took 1.0s. Estimated remaining: 7m 40s. Rate: 180.1 symbols/min [2025-09-15T21:15:45.901964] [DEBUG] [LOCAL ] FMN: Derivative data saved (1326 records). [2025-09-15T21:15:45.902362] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-15T21:15:45.904359] [INFO ] [MAIN ] Derivative Progress: 704/2083 symbols completed. FMN took 1.0s. Estimated remaining: 7m 39s. Rate: 180.4 symbols/min [2025-09-15T21:15:45.916670] [DEBUG] [MAIN ] FMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:45.917333] [INFO ] [MAIN ] FMC: Generated 1326 derivative records from 38090 primary records. [2025-09-15T21:15:45.917398] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-15T21:15:45.929525] [DEBUG] [LOCAL ] FMC: Derivative data saved (1326 records). [2025-09-15T21:15:45.929691] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-15T21:15:45.931719] [INFO ] [MAIN ] Derivative Progress: 705/2083 symbols completed. FMC took 1.0s. Estimated remaining: 7m 38s. Rate: 180.6 symbols/min [2025-09-15T21:15:45.932427] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:45.932551] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:45.932749] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:45.937044] [DEBUG] [LOCAL ] FMY: Loaded 1018 existing records from primary storage. [2025-09-15T21:15:45.937296] [INFO ] [MAIN ] FMY: Loaded 1018 primary data records. [2025-09-15T21:15:46.152218] [DEBUG] [LOCAL ] FMS: Loaded 22098 existing records from primary storage. [2025-09-15T21:15:46.241472] [INFO ] [MAIN ] FMS: Loaded 22098 primary data records. [2025-09-15T21:15:46.354013] [DEBUG] [LOCAL ] FNB: Loaded 38602 existing records from primary storage. [2025-09-15T21:15:46.366463] [INFO ] [MAIN ] FNB: Loaded 38602 primary data records. [2025-09-15T21:15:46.826215] [DEBUG] [MAIN ] FMY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:46.827479] [INFO ] [MAIN ] FMY: Generated 1326 derivative records from 1018 primary records. [2025-09-15T21:15:46.828576] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-15T21:15:46.848081] [DEBUG] [LOCAL ] FMY: Derivative data saved (1326 records). [2025-09-15T21:15:46.848935] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-15T21:15:46.851302] [INFO ] [MAIN ] Derivative Progress: 706/2083 symbols completed. FMY took 0.9s. Estimated remaining: 7m 39s. Rate: 180.2 symbols/min [2025-09-15T21:15:46.851588] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:46.871050] [DEBUG] [MAIN ] FMS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:46.872140] [INFO ] [MAIN ] FMS: Generated 1326 derivative records from 22098 primary records. [2025-09-15T21:15:46.873790] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-15T21:15:46.898008] [DEBUG] [MAIN ] FNB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:46.899875] [DEBUG] [LOCAL ] FMS: Derivative data saved (1326 records). [2025-09-15T21:15:46.900943] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-15T21:15:46.900875] [INFO ] [MAIN ] FNB: Generated 1326 derivative records from 38602 primary records. [2025-09-15T21:15:46.902748] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-15T21:15:46.902577] [INFO ] [MAIN ] Derivative Progress: 707/2083 symbols completed. FMS took 1.0s. Estimated remaining: 7m 38s. Rate: 180.4 symbols/min [2025-09-15T21:15:46.903533] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:46.926062] [DEBUG] [LOCAL ] FNB: Derivative data saved (1326 records). [2025-09-15T21:15:46.926229] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-15T21:15:46.929140] [INFO ] [MAIN ] Derivative Progress: 708/2083 symbols completed. FNB took 1.0s. Estimated remaining: 7m 37s. Rate: 180.6 symbols/min [2025-09-15T21:15:46.929579] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:46.944773] [DEBUG] [LOCAL ] FND: Loaded 38434 existing records from primary storage. [2025-09-15T21:15:46.945102] [INFO ] [MAIN ] FND: Loaded 38434 primary data records. [2025-09-15T21:15:47.270926] [DEBUG] [LOCAL ] FNF: Loaded 36151 existing records from primary storage. [2025-09-15T21:15:47.271853] [INFO ] [MAIN ] FNF: Loaded 36151 primary data records. [2025-09-15T21:15:47.272147] [DEBUG] [LOCAL ] FNV: Loaded 33565 existing records from primary storage. [2025-09-15T21:15:47.306491] [INFO ] [MAIN ] FNV: Loaded 33565 primary data records. [2025-09-15T21:15:47.916786] [DEBUG] [MAIN ] FND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:47.919492] [INFO ] [MAIN ] FND: Generated 1326 derivative records from 38434 primary records. [2025-09-15T21:15:47.921233] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-15T21:15:47.936821] [DEBUG] [LOCAL ] FND: Derivative data saved (1326 records). [2025-09-15T21:15:47.937909] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-15T21:15:47.940868] [INFO ] [MAIN ] Derivative Progress: 709/2083 symbols completed. FND took 1.1s. Estimated remaining: 7m 38s. Rate: 180.1 symbols/min [2025-09-15T21:15:47.941481] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:47.962354] [DEBUG] [MAIN ] FNF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:47.967926] [INFO ] [MAIN ] FNF: Generated 1326 derivative records from 36151 primary records. [2025-09-15T21:15:47.967046] [DEBUG] [LOCAL ] FOA: Loaded 9145 existing records from primary storage. [2025-09-15T21:15:47.968164] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-15T21:15:47.969041] [INFO ] [MAIN ] FOA: Loaded 9145 primary data records. [2025-09-15T21:15:48.011464] [DEBUG] [LOCAL ] FNF: Derivative data saved (1326 records). [2025-09-15T21:15:48.011616] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-15T21:15:48.036808] [INFO ] [MAIN ] Derivative Progress: 710/2083 symbols completed. FNF took 1.1s. Estimated remaining: 7m 37s. Rate: 180.3 symbols/min [2025-09-15T21:15:48.049368] [DEBUG] [MAIN ] FNV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:48.076675] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:48.071303] [INFO ] [MAIN ] FNV: Generated 1326 derivative records from 33565 primary records. [2025-09-15T21:15:48.099521] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-15T21:15:48.170401] [DEBUG] [LOCAL ] FNV: Derivative data saved (1326 records). [2025-09-15T21:15:48.188743] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-15T21:15:48.194084] [INFO ] [MAIN ] Derivative Progress: 711/2083 symbols completed. FNV took 1.3s. Estimated remaining: 7m 36s. Rate: 180.4 symbols/min [2025-09-15T21:15:48.281510] [DEBUG] [LOCAL ] FOF: Loaded 5732 existing records from primary storage. [2025-09-15T21:15:48.266881] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:48.281697] [INFO ] [MAIN ] FOF: Loaded 5732 primary data records. [2025-09-15T21:15:48.472667] [DEBUG] [LOCAL ] FOR: Loaded 14480 existing records from primary storage. [2025-09-15T21:15:48.557064] [INFO ] [MAIN ] FOR: Loaded 14480 primary data records. [2025-09-15T21:15:48.847073] [DEBUG] [MAIN ] FOA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:48.858936] [INFO ] [MAIN ] FOA: Generated 1326 derivative records from 9145 primary records. [2025-09-15T21:15:48.859240] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-15T21:15:48.874084] [DEBUG] [LOCAL ] FOA: Derivative data saved (1326 records). [2025-09-15T21:15:48.875519] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-15T21:15:48.878105] [INFO ] [MAIN ] Derivative Progress: 712/2083 symbols completed. FOA took 0.9s. Estimated remaining: 7m 37s. Rate: 180.2 symbols/min [2025-09-15T21:15:48.878793] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:48.890424] [DEBUG] [MAIN ] FOF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:48.891173] [INFO ] [MAIN ] FOF: Generated 1326 derivative records from 5732 primary records. [2025-09-15T21:15:48.891424] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-15T21:15:48.903820] [DEBUG] [LOCAL ] FOF: Derivative data saved (1326 records). [2025-09-15T21:15:48.904155] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-15T21:15:48.906297] [INFO ] [MAIN ] Derivative Progress: 713/2083 symbols completed. FOF took 0.8s. Estimated remaining: 7m 36s. Rate: 180.4 symbols/min [2025-09-15T21:15:48.906754] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:48.920323] [DEBUG] [MAIN ] FOR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:48.921027] [INFO ] [MAIN ] FOR: Generated 1326 derivative records from 14480 primary records. [2025-09-15T21:15:48.921130] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-15T21:15:48.945722] [DEBUG] [LOCAL ] FOR: Derivative data saved (1326 records). [2025-09-15T21:15:48.945856] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-15T21:15:48.947794] [INFO ] [MAIN ] Derivative Progress: 714/2083 symbols completed. FOR took 0.7s. Estimated remaining: 7m 35s. Rate: 180.6 symbols/min [2025-09-15T21:15:48.948613] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:48.965069] [DEBUG] [LOCAL ] FPF: Loaded 12774 existing records from primary storage. [2025-09-15T21:15:48.966070] [DEBUG] [LOCAL ] FOUR: Loaded 36302 existing records from primary storage. [2025-09-15T21:15:48.966166] [INFO ] [MAIN ] FPF: Loaded 12774 primary data records. [2025-09-15T21:15:48.966251] [INFO ] [MAIN ] FOUR: Loaded 36302 primary data records. [2025-09-15T21:15:49.154214] [DEBUG] [LOCAL ] FPH: Loaded 14437 existing records from primary storage. [2025-09-15T21:15:49.170158] [INFO ] [MAIN ] FPH: Loaded 14437 primary data records. [2025-09-15T21:15:49.849188] [DEBUG] [MAIN ] FPF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:49.853785] [INFO ] [MAIN ] FPF: Generated 1326 derivative records from 12774 primary records. [2025-09-15T21:15:49.854098] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-15T21:15:49.854047] [DEBUG] [MAIN ] FOUR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:49.859311] [INFO ] [MAIN ] FOUR: Generated 1326 derivative records from 36302 primary records. [2025-09-15T21:15:49.860760] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-15T21:15:49.884329] [DEBUG] [LOCAL ] FPF: Derivative data saved (1326 records). [2025-09-15T21:15:49.885097] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-15T21:15:49.887558] [INFO ] [MAIN ] Derivative Progress: 715/2083 symbols completed. FPF took 1.0s. Estimated remaining: 7m 36s. Rate: 180.1 symbols/min [2025-09-15T21:15:49.900425] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:49.896377] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1326 records). [2025-09-15T21:15:49.901668] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-15T21:15:49.901110] [DEBUG] [MAIN ] FPH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:49.904780] [INFO ] [MAIN ] Derivative Progress: 716/2083 symbols completed. FOUR took 1.0s. Estimated remaining: 7m 35s. Rate: 180.4 symbols/min [2025-09-15T21:15:49.902713] [INFO ] [MAIN ] FPH: Generated 1326 derivative records from 14437 primary records. [2025-09-15T21:15:49.905325] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:49.905157] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-15T21:15:49.922108] [DEBUG] [LOCAL ] FPH: Derivative data saved (1326 records). [2025-09-15T21:15:49.922238] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-15T21:15:49.924450] [INFO ] [MAIN ] Derivative Progress: 717/2083 symbols completed. FPH took 1.0s. Estimated remaining: 7m 34s. Rate: 180.6 symbols/min [2025-09-15T21:15:49.924772] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:49.929738] [DEBUG] [LOCAL ] FRA: Loaded 9987 existing records from primary storage. [2025-09-15T21:15:49.930184] [INFO ] [MAIN ] FRA: Loaded 9987 primary data records. [2025-09-15T21:15:50.202534] [DEBUG] [LOCAL ] FR: Loaded 34195 existing records from primary storage. [2025-09-15T21:15:50.213099] [INFO ] [MAIN ] FR: Loaded 34195 primary data records. [2025-09-15T21:15:50.359170] [DEBUG] [LOCAL ] FRO: Loaded 38124 existing records from primary storage. [2025-09-15T21:15:50.406927] [INFO ] [MAIN ] FRO: Loaded 38124 primary data records. [2025-09-15T21:15:50.708118] [DEBUG] [MAIN ] FRA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:50.790834] [INFO ] [MAIN ] FRA: Generated 1326 derivative records from 9987 primary records. [2025-09-15T21:15:50.806888] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-15T21:15:50.821098] [DEBUG] [LOCAL ] FRA: Derivative data saved (1326 records). [2025-09-15T21:15:50.821732] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-15T21:15:50.823664] [INFO ] [MAIN ] Derivative Progress: 718/2083 symbols completed. FRA took 0.9s. Estimated remaining: 7m 35s. Rate: 180.2 symbols/min [2025-09-15T21:15:50.836782] [DEBUG] [MAIN ] FR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:50.837570] [INFO ] [MAIN ] FR: Generated 1326 derivative records from 34195 primary records. [2025-09-15T21:15:50.838542] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-15T21:15:50.852303] [DEBUG] [LOCAL ] FR: Derivative data saved (1326 records). [2025-09-15T21:15:50.852566] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-15T21:15:50.855465] [INFO ] [MAIN ] Derivative Progress: 719/2083 symbols completed. FR took 1.0s. Estimated remaining: 7m 34s. Rate: 180.4 symbols/min [2025-09-15T21:15:50.872716] [DEBUG] [MAIN ] FRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:50.873563] [INFO ] [MAIN ] FRO: Generated 1326 derivative records from 38124 primary records. [2025-09-15T21:15:50.873660] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-15T21:15:50.892044] [DEBUG] [LOCAL ] FRO: Derivative data saved (1326 records). [2025-09-15T21:15:50.892206] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-15T21:15:50.894676] [INFO ] [MAIN ] Derivative Progress: 720/2083 symbols completed. FRO took 1.0s. Estimated remaining: 7m 33s. Rate: 180.6 symbols/min [2025-09-15T21:15:50.895231] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:50.895448] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:50.895340] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:50.953903] [DEBUG] [LOCAL ] FSK: Loaded 35641 existing records from primary storage. [2025-09-15T21:15:50.975696] [INFO ] [MAIN ] FSK: Loaded 35641 primary data records. [2025-09-15T21:15:50.976260] [DEBUG] [LOCAL ] FSLY: Loaded 37625 existing records from primary storage. [2025-09-15T21:15:50.976390] [INFO ] [MAIN ] FSLY: Loaded 37625 primary data records. [2025-09-15T21:15:50.977161] [DEBUG] [LOCAL ] FSM: Loaded 39280 existing records from primary storage. [2025-09-15T21:15:50.999364] [INFO ] [MAIN ] FSM: Loaded 39280 primary data records. [2025-09-15T21:15:51.824230] [DEBUG] [MAIN ] FSK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:51.837536] [INFO ] [MAIN ] FSK: Generated 1326 derivative records from 35641 primary records. [2025-09-15T21:15:51.837954] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-15T21:15:51.838176] [DEBUG] [MAIN ] FSLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:51.837783] [DEBUG] [MAIN ] FSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:51.839281] [INFO ] [MAIN ] FSLY: Generated 1326 derivative records from 37625 primary records. [2025-09-15T21:15:51.840064] [INFO ] [MAIN ] FSM: Generated 1326 derivative records from 39280 primary records. [2025-09-15T21:15:51.848291] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-15T21:15:51.839561] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-15T21:15:51.851855] [DEBUG] [LOCAL ] FSK: Derivative data saved (1326 records). [2025-09-15T21:15:51.863235] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-15T21:15:51.867107] [INFO ] [MAIN ] Derivative Progress: 721/2083 symbols completed. FSK took 1.0s. Estimated remaining: 7m 34s. Rate: 180.2 symbols/min [2025-09-15T21:15:51.871919] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:51.873744] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1326 records). [2025-09-15T21:15:51.874155] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-15T21:15:51.875736] [INFO ] [MAIN ] Derivative Progress: 722/2083 symbols completed. FSLY took 1.0s. Estimated remaining: 7m 33s. Rate: 180.4 symbols/min [2025-09-15T21:15:51.876564] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:51.878541] [DEBUG] [LOCAL ] FSM: Derivative data saved (1326 records). [2025-09-15T21:15:51.879030] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-15T21:15:51.881094] [INFO ] [MAIN ] Derivative Progress: 723/2083 symbols completed. FSM took 1.0s. Estimated remaining: 7m 32s. Rate: 180.6 symbols/min [2025-09-15T21:15:51.881314] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:51.889870] [DEBUG] [LOCAL ] FT: Loaded 4670 existing records from primary storage. [2025-09-15T21:15:51.890088] [INFO ] [MAIN ] FT: Loaded 4670 primary data records. [2025-09-15T21:15:51.978275] [DEBUG] [LOCAL ] FTHY: Loaded 8497 existing records from primary storage. [2025-09-15T21:15:51.994440] [INFO ] [MAIN ] FTHY: Loaded 8497 primary data records. [2025-09-15T21:15:52.191872] [DEBUG] [LOCAL ] FSS: Loaded 24725 existing records from primary storage. [2025-09-15T21:15:52.192149] [INFO ] [MAIN ] FSS: Loaded 24725 primary data records. [2025-09-15T21:15:52.818258] [DEBUG] [MAIN ] FT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:52.819745] [INFO ] [MAIN ] FT: Generated 1326 derivative records from 4670 primary records. [2025-09-15T21:15:52.820020] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-15T21:15:52.832871] [DEBUG] [LOCAL ] FT: Derivative data saved (1326 records). [2025-09-15T21:15:52.833659] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-15T21:15:52.835824] [INFO ] [MAIN ] Derivative Progress: 724/2083 symbols completed. FT took 1.0s. Estimated remaining: 7m 33s. Rate: 180.2 symbols/min [2025-09-15T21:15:52.836379] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:52.847339] [DEBUG] [MAIN ] FTHY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:52.848358] [INFO ] [MAIN ] FTHY: Generated 1326 derivative records from 8497 primary records. [2025-09-15T21:15:52.848677] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-15T21:15:52.875022] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1326 records). [2025-09-15T21:15:52.875486] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-15T21:15:52.875417] [DEBUG] [MAIN ] FSS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:52.877573] [INFO ] [MAIN ] Derivative Progress: 725/2083 symbols completed. FTHY took 1.0s. Estimated remaining: 7m 32s. Rate: 180.4 symbols/min [2025-09-15T21:15:52.878578] [INFO ] [MAIN ] FSS: Generated 1326 derivative records from 24725 primary records. [2025-09-15T21:15:52.887057] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-15T21:15:52.886861] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:52.901983] [DEBUG] [LOCAL ] FSS: Derivative data saved (1326 records). [2025-09-15T21:15:52.902634] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-15T21:15:52.904819] [INFO ] [MAIN ] Derivative Progress: 726/2083 symbols completed. FSS took 1.0s. Estimated remaining: 7m 31s. Rate: 180.6 symbols/min [2025-09-15T21:15:52.914735] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:52.916026] [DEBUG] [LOCAL ] FTS: Loaded 31167 existing records from primary storage. [2025-09-15T21:15:52.916259] [INFO ] [MAIN ] FTS: Loaded 31167 primary data records. [2025-09-15T21:15:52.962904] [DEBUG] [LOCAL ] FTWO: Loaded 1273 existing records from primary storage. [2025-09-15T21:15:52.989693] [INFO ] [MAIN ] FTWO: Loaded 1273 primary data records. [2025-09-15T21:15:53.312112] [DEBUG] [LOCAL ] FTV: Loaded 39181 existing records from primary storage. [2025-09-15T21:15:53.323096] [INFO ] [MAIN ] FTV: Loaded 39181 primary data records. [2025-09-15T21:15:53.781687] [DEBUG] [MAIN ] FTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:53.782810] [INFO ] [MAIN ] FTS: Generated 1326 derivative records from 31167 primary records. [2025-09-15T21:15:53.785011] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-15T21:15:53.807251] [DEBUG] [LOCAL ] FTS: Derivative data saved (1326 records). [2025-09-15T21:15:53.808447] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-15T21:15:53.807768] [DEBUG] [MAIN ] FTWO: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:15:53.810589] [INFO ] [MAIN ] Derivative Progress: 727/2083 symbols completed. FTS took 1.0s. Estimated remaining: 7m 31s. Rate: 180.2 symbols/min [2025-09-15T21:15:53.811318] [INFO ] [MAIN ] FTWO: Generated 1324 derivative records from 1273 primary records. [2025-09-15T21:15:53.812299] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:53.812846] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-15T21:15:53.831495] [DEBUG] [MAIN ] FTV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:53.833362] [INFO ] [MAIN ] FTV: Generated 1326 derivative records from 39181 primary records. [2025-09-15T21:15:53.835409] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-15T21:15:53.835349] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1324 records). [2025-09-15T21:15:53.835758] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-15T21:15:53.838722] [INFO ] [MAIN ] Derivative Progress: 728/2083 symbols completed. FTWO took 0.9s. Estimated remaining: 7m 31s. Rate: 180.4 symbols/min [2025-09-15T21:15:53.845319] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:53.851100] [DEBUG] [LOCAL ] FTV: Derivative data saved (1326 records). [2025-09-15T21:15:53.851257] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-15T21:15:53.853951] [INFO ] [MAIN ] Derivative Progress: 729/2083 symbols completed. FTV took 1.0s. Estimated remaining: 7m 30s. Rate: 180.7 symbols/min [2025-09-15T21:15:53.854425] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:53.884686] [DEBUG] [LOCAL ] FVR: Loaded 16121 existing records from primary storage. [2025-09-15T21:15:53.884844] [INFO ] [MAIN ] FVR: Loaded 16121 primary data records. [2025-09-15T21:15:54.007187] [DEBUG] [LOCAL ] FUBO: Loaded 39688 existing records from primary storage. [2025-09-15T21:15:54.033153] [INFO ] [MAIN ] FUBO: Loaded 39688 primary data records. [2025-09-15T21:15:54.088058] [DEBUG] [LOCAL ] FUN: Loaded 38428 existing records from primary storage. [2025-09-15T21:15:54.113473] [INFO ] [MAIN ] FUN: Loaded 38428 primary data records. [2025-09-15T21:15:54.815625] [DEBUG] [MAIN ] FVR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:54.816550] [INFO ] [MAIN ] FVR: Generated 1326 derivative records from 16121 primary records. [2025-09-15T21:15:54.817711] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-15T21:15:54.837354] [DEBUG] [LOCAL ] FVR: Derivative data saved (1326 records). [2025-09-15T21:15:54.846579] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-15T21:15:54.846951] [DEBUG] [MAIN ] FUBO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:54.848697] [INFO ] [MAIN ] Derivative Progress: 730/2083 symbols completed. FVR took 1.0s. Estimated remaining: 7m 31s. Rate: 180.2 symbols/min [2025-09-15T21:15:54.849069] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:54.850964] [INFO ] [MAIN ] FUBO: Generated 1326 derivative records from 39688 primary records. [2025-09-15T21:15:54.851929] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-15T21:15:54.874629] [DEBUG] [MAIN ] FUN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:54.876485] [INFO ] [MAIN ] FUN: Generated 1326 derivative records from 38428 primary records. [2025-09-15T21:15:54.875696] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1326 records). [2025-09-15T21:15:54.876766] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-15T21:15:54.876713] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-15T21:15:54.878970] [INFO ] [MAIN ] Derivative Progress: 731/2083 symbols completed. FUBO took 1.1s. Estimated remaining: 7m 30s. Rate: 180.4 symbols/min [2025-09-15T21:15:54.879858] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:54.901464] [DEBUG] [LOCAL ] FXED: Loaded 868 existing records from primary storage. [2025-09-15T21:15:54.902808] [INFO ] [MAIN ] FXED: Loaded 868 primary data records. [2025-09-15T21:15:54.902725] [DEBUG] [LOCAL ] FUN: Derivative data saved (1326 records). [2025-09-15T21:15:54.934531] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-15T21:15:54.990183] [INFO ] [MAIN ] Derivative Progress: 732/2083 symbols completed. FUN took 1.1s. Estimated remaining: 7m 29s. Rate: 180.6 symbols/min [2025-09-15T21:15:55.018368] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:55.018219] [DEBUG] [LOCAL ] FVRR: Loaded 29697 existing records from primary storage. [2025-09-15T21:15:55.019179] [INFO ] [MAIN ] FVRR: Loaded 29697 primary data records. [2025-09-15T21:15:55.475256] [DEBUG] [LOCAL ] G: Loaded 36743 existing records from primary storage. [2025-09-15T21:15:55.476669] [INFO ] [MAIN ] G: Loaded 36743 primary data records. [2025-09-15T21:15:55.752989] [DEBUG] [MAIN ] FXED: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:55.754231] [INFO ] [MAIN ] FXED: Generated 1326 derivative records from 868 primary records. [2025-09-15T21:15:55.756615] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-15T21:15:55.775893] [DEBUG] [MAIN ] FVRR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:55.777371] [INFO ] [MAIN ] FVRR: Generated 1326 derivative records from 29697 primary records. [2025-09-15T21:15:55.778429] [DEBUG] [LOCAL ] FXED: Derivative data saved (1326 records). [2025-09-15T21:15:55.778508] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-15T21:15:55.780198] [INFO ] [MAIN ] Derivative Progress: 733/2083 symbols completed. FXED took 0.9s. Estimated remaining: 7m 29s. Rate: 180.2 symbols/min [2025-09-15T21:15:55.780341] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-15T21:15:55.793242] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1326 records). [2025-09-15T21:15:55.793431] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-15T21:15:55.795509] [INFO ] [MAIN ] Derivative Progress: 734/2083 symbols completed. FVRR took 0.9s. Estimated remaining: 7m 29s. Rate: 180.5 symbols/min [2025-09-15T21:15:55.808137] [DEBUG] [MAIN ] G: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:55.808708] [INFO ] [MAIN ] G: Generated 1326 derivative records from 36743 primary records. [2025-09-15T21:15:55.808771] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-15T21:15:55.820479] [DEBUG] [LOCAL ] G: Derivative data saved (1326 records). [2025-09-15T21:15:55.820538] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-15T21:15:55.822363] [INFO ] [MAIN ] Derivative Progress: 735/2083 symbols completed. G took 0.8s. Estimated remaining: 7m 28s. Rate: 180.7 symbols/min [2025-09-15T21:15:55.823047] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:55.823186] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:55.823422] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:55.828952] [DEBUG] [LOCAL ] GAM: Loaded 2775 existing records from primary storage. [2025-09-15T21:15:55.829146] [INFO ] [MAIN ] GAM: Loaded 2775 primary data records. [2025-09-15T21:15:55.954200] [DEBUG] [LOCAL ] GAB: Loaded 19323 existing records from primary storage. [2025-09-15T21:15:55.954848] [INFO ] [MAIN ] GAB: Loaded 19323 primary data records. [2025-09-15T21:15:56.290980] [DEBUG] [LOCAL ] GAP: Loaded 39617 existing records from primary storage. [2025-09-15T21:15:56.395811] [INFO ] [MAIN ] GAP: Loaded 39617 primary data records. [2025-09-15T21:15:56.759532] [DEBUG] [MAIN ] GAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:56.760545] [INFO ] [MAIN ] GAM: Generated 1326 derivative records from 2775 primary records. [2025-09-15T21:15:56.760813] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-15T21:15:56.775391] [DEBUG] [LOCAL ] GAM: Derivative data saved (1326 records). [2025-09-15T21:15:56.775841] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-15T21:15:56.783246] [INFO ] [MAIN ] Derivative Progress: 736/2083 symbols completed. GAM took 1.0s. Estimated remaining: 7m 28s. Rate: 180.2 symbols/min [2025-09-15T21:15:56.787080] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:56.787906] [DEBUG] [MAIN ] GAB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:56.789834] [INFO ] [MAIN ] GAB: Generated 1326 derivative records from 19323 primary records. [2025-09-15T21:15:56.790215] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-15T21:15:56.802731] [DEBUG] [LOCAL ] GAB: Derivative data saved (1326 records). [2025-09-15T21:15:56.805211] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-15T21:15:56.807055] [INFO ] [MAIN ] Derivative Progress: 737/2083 symbols completed. GAB took 1.0s. Estimated remaining: 7m 28s. Rate: 180.4 symbols/min [2025-09-15T21:15:56.807345] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:56.813495] [DEBUG] [LOCAL ] GBAB: Loaded 9535 existing records from primary storage. [2025-09-15T21:15:56.815032] [INFO ] [MAIN ] GBAB: Loaded 9535 primary data records. [2025-09-15T21:15:56.911602] [DEBUG] [MAIN ] GAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:56.936667] [INFO ] [MAIN ] GAP: Generated 1326 derivative records from 39617 primary records. [2025-09-15T21:15:56.937039] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-15T21:15:57.125544] [DEBUG] [LOCAL ] GAP: Derivative data saved (1326 records). [2025-09-15T21:15:57.125699] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-15T21:15:57.128972] [INFO ] [MAIN ] Derivative Progress: 738/2083 symbols completed. GAP took 1.3s. Estimated remaining: 7m 27s. Rate: 180.5 symbols/min [2025-09-15T21:15:57.129346] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:57.130863] [DEBUG] [LOCAL ] GBTG: Loaded 29741 existing records from primary storage. [2025-09-15T21:15:57.132060] [INFO ] [MAIN ] GBTG: Loaded 29741 primary data records. [2025-09-15T21:15:57.325197] [DEBUG] [LOCAL ] GBX: Loaded 20311 existing records from primary storage. [2025-09-15T21:15:57.397127] [INFO ] [MAIN ] GBX: Loaded 20311 primary data records. [2025-09-15T21:15:57.530456] [DEBUG] [MAIN ] GBAB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:57.553312] [INFO ] [MAIN ] GBAB: Generated 1326 derivative records from 9535 primary records. [2025-09-15T21:15:57.563909] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-15T21:15:57.637280] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1326 records). [2025-09-15T21:15:57.637599] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-15T21:15:57.639465] [INFO ] [MAIN ] Derivative Progress: 739/2083 symbols completed. GBAB took 0.9s. Estimated remaining: 7m 27s. Rate: 180.3 symbols/min [2025-09-15T21:15:57.725612] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:57.746389] [DEBUG] [MAIN ] GBTG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:57.747460] [INFO ] [MAIN ] GBTG: Generated 1326 derivative records from 29741 primary records. [2025-09-15T21:15:57.747654] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-15T21:15:57.761565] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1326 records). [2025-09-15T21:15:57.762001] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-15T21:15:57.764422] [INFO ] [MAIN ] Derivative Progress: 740/2083 symbols completed. GBTG took 1.0s. Estimated remaining: 7m 26s. Rate: 180.5 symbols/min [2025-09-15T21:15:57.764721] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:57.799182] [DEBUG] [LOCAL ] GCI: Loaded 32264 existing records from primary storage. [2025-09-15T21:15:57.802852] [DEBUG] [MAIN ] GBX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:57.803072] [INFO ] [MAIN ] GCI: Loaded 32264 primary data records. [2025-09-15T21:15:57.803783] [INFO ] [MAIN ] GBX: Generated 1326 derivative records from 20311 primary records. [2025-09-15T21:15:57.847144] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-15T21:15:57.876519] [DEBUG] [LOCAL ] GCO: Loaded 17261 existing records from primary storage. [2025-09-15T21:15:57.914088] [INFO ] [MAIN ] GCO: Loaded 17261 primary data records. [2025-09-15T21:15:58.112569] [DEBUG] [LOCAL ] GBX: Derivative data saved (1326 records). [2025-09-15T21:15:58.197948] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-15T21:15:58.205408] [INFO ] [MAIN ] Derivative Progress: 741/2083 symbols completed. GBX took 1.1s. Estimated remaining: 7m 26s. Rate: 180.4 symbols/min [2025-09-15T21:15:58.216750] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:58.376544] [DEBUG] [LOCAL ] GCV: Loaded 5377 existing records from primary storage. [2025-09-15T21:15:58.376985] [INFO ] [MAIN ] GCV: Loaded 5377 primary data records. [2025-09-15T21:15:58.574225] [DEBUG] [MAIN ] GCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:58.662154] [INFO ] [MAIN ] GCI: Generated 1326 derivative records from 32264 primary records. [2025-09-15T21:15:58.663174] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-15T21:15:58.689067] [DEBUG] [MAIN ] GCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:58.690093] [DEBUG] [LOCAL ] GCI: Derivative data saved (1326 records). [2025-09-15T21:15:58.690180] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-15T21:15:58.692945] [INFO ] [MAIN ] Derivative Progress: 742/2083 symbols completed. GCI took 1.0s. Estimated remaining: 7m 26s. Rate: 180.3 symbols/min [2025-09-15T21:15:58.690835] [INFO ] [MAIN ] GCO: Generated 1326 derivative records from 17261 primary records. [2025-09-15T21:15:58.693083] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-15T21:15:58.694004] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:58.707776] [DEBUG] [LOCAL ] GCO: Derivative data saved (1326 records). [2025-09-15T21:15:58.707897] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-15T21:15:58.709708] [INFO ] [MAIN ] Derivative Progress: 743/2083 symbols completed. GCO took 0.9s. Estimated remaining: 7m 25s. Rate: 180.5 symbols/min [2025-09-15T21:15:58.710236] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:58.725068] [DEBUG] [MAIN ] GCV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:58.725923] [INFO ] [MAIN ] GCV: Generated 1326 derivative records from 5377 primary records. [2025-09-15T21:15:58.726034] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-15T21:15:58.741826] [DEBUG] [LOCAL ] GCV: Derivative data saved (1326 records). [2025-09-15T21:15:58.750416] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-15T21:15:58.752503] [INFO ] [MAIN ] Derivative Progress: 744/2083 symbols completed. GCV took 0.5s. Estimated remaining: 7m 25s. Rate: 180.7 symbols/min [2025-09-15T21:15:58.752792] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:58.775955] [DEBUG] [LOCAL ] GD: Loaded 34238 existing records from primary storage. [2025-09-15T21:15:58.775221] [DEBUG] [LOCAL ] GDIV: Loaded 2590 existing records from primary storage. [2025-09-15T21:15:58.776121] [INFO ] [MAIN ] GDIV: Loaded 2590 primary data records. [2025-09-15T21:15:58.776187] [INFO ] [MAIN ] GD: Loaded 34238 primary data records. [2025-09-15T21:15:59.004501] [DEBUG] [LOCAL ] GDDY: Loaded 36534 existing records from primary storage. [2025-09-15T21:15:59.015241] [INFO ] [MAIN ] GDDY: Loaded 36534 primary data records. [2025-09-15T21:15:59.690248] [DEBUG] [MAIN ] GD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:59.692731] [INFO ] [MAIN ] GD: Generated 1326 derivative records from 34238 primary records. [2025-09-15T21:15:59.693094] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-15T21:15:59.713695] [DEBUG] [MAIN ] GDIV: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:15:59.716250] [INFO ] [MAIN ] GDIV: Generated 1325 derivative records from 2590 primary records. [2025-09-15T21:15:59.716352] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-15T21:15:59.728126] [DEBUG] [LOCAL ] GD: Derivative data saved (1326 records). [2025-09-15T21:15:59.729062] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-15T21:15:59.732067] [INFO ] [MAIN ] Derivative Progress: 745/2083 symbols completed. GD took 1.0s. Estimated remaining: 7m 25s. Rate: 180.3 symbols/min [2025-09-15T21:15:59.734698] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1325 records). [2025-09-15T21:15:59.735012] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:59.735317] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-15T21:15:59.736996] [INFO ] [MAIN ] Derivative Progress: 746/2083 symbols completed. GDIV took 1.0s. Estimated remaining: 7m 24s. Rate: 180.5 symbols/min [2025-09-15T21:15:59.737366] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:15:59.748765] [DEBUG] [MAIN ] GDDY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:15:59.751589] [INFO ] [MAIN ] GDDY: Generated 1326 derivative records from 36534 primary records. [2025-09-15T21:15:59.750675] [DEBUG] [LOCAL ] GDL: Loaded 1737 existing records from primary storage. [2025-09-15T21:15:59.751832] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-15T21:15:59.751879] [INFO ] [MAIN ] GDL: Loaded 1737 primary data records. [2025-09-15T21:15:59.844246] [DEBUG] [LOCAL ] GDO: Loaded 4329 existing records from primary storage. [2025-09-15T21:15:59.855396] [INFO ] [MAIN ] GDO: Loaded 4329 primary data records. [2025-09-15T21:16:00.051295] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1326 records). [2025-09-15T21:16:00.058280] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-15T21:16:00.078065] [INFO ] [MAIN ] Derivative Progress: 747/2083 symbols completed. GDDY took 1.4s. Estimated remaining: 7m 24s. Rate: 180.5 symbols/min [2025-09-15T21:16:00.152060] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:00.351077] [DEBUG] [LOCAL ] GDOT: Loaded 27340 existing records from primary storage. [2025-09-15T21:16:00.351581] [INFO ] [MAIN ] GDOT: Loaded 27340 primary data records. [2025-09-15T21:16:00.641538] [DEBUG] [MAIN ] GDL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:00.642923] [INFO ] [MAIN ] GDL: Generated 1326 derivative records from 1737 primary records. [2025-09-15T21:16:00.648810] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-15T21:16:00.654760] [DEBUG] [MAIN ] GDO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:00.661905] [INFO ] [MAIN ] GDO: Generated 1326 derivative records from 4329 primary records. [2025-09-15T21:16:00.662440] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-15T21:16:00.676556] [DEBUG] [LOCAL ] GDL: Derivative data saved (1326 records). [2025-09-15T21:16:00.679460] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-15T21:16:00.679258] [DEBUG] [LOCAL ] GDO: Derivative data saved (1326 records). [2025-09-15T21:16:00.681478] [INFO ] [MAIN ] Derivative Progress: 748/2083 symbols completed. GDL took 0.9s. Estimated remaining: 7m 24s. Rate: 180.3 symbols/min [2025-09-15T21:16:00.679601] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-15T21:16:00.684266] [INFO ] [MAIN ] Derivative Progress: 749/2083 symbols completed. GDO took 0.9s. Estimated remaining: 7m 23s. Rate: 180.5 symbols/min [2025-09-15T21:16:00.700419] [DEBUG] [MAIN ] GDOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:00.701222] [INFO ] [MAIN ] GDOT: Generated 1326 derivative records from 27340 primary records. [2025-09-15T21:16:00.701337] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-15T21:16:00.713583] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1326 records). [2025-09-15T21:16:00.713674] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-15T21:16:00.715747] [INFO ] [MAIN ] Derivative Progress: 750/2083 symbols completed. GDOT took 0.6s. Estimated remaining: 7m 22s. Rate: 180.7 symbols/min [2025-09-15T21:16:00.716421] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:00.716505] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:00.717127] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:00.738985] [DEBUG] [LOCAL ] GDV: Loaded 14265 existing records from primary storage. [2025-09-15T21:16:00.745096] [INFO ] [MAIN ] GDV: Loaded 14265 primary data records. [2025-09-15T21:16:00.745698] [DEBUG] [LOCAL ] GEF: Loaded 15263 existing records from primary storage. [2025-09-15T21:16:00.771078] [INFO ] [MAIN ] GEF: Loaded 15263 primary data records. [2025-09-15T21:16:01.042766] [DEBUG] [LOCAL ] GE: Loaded 39678 existing records from primary storage. [2025-09-15T21:16:01.089154] [INFO ] [MAIN ] GE: Loaded 39678 primary data records. [2025-09-15T21:16:01.747109] [DEBUG] [MAIN ] GEF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:01.748144] [INFO ] [MAIN ] GEF: Generated 1326 derivative records from 15263 primary records. [2025-09-15T21:16:01.758016] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-15T21:16:01.758326] [DEBUG] [MAIN ] GDV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:01.760061] [INFO ] [MAIN ] GDV: Generated 1326 derivative records from 14265 primary records. [2025-09-15T21:16:01.760579] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-15T21:16:01.778527] [DEBUG] [LOCAL ] GEF: Derivative data saved (1326 records). [2025-09-15T21:16:01.781911] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-15T21:16:01.784583] [INFO ] [MAIN ] Derivative Progress: 751/2083 symbols completed. GEF took 1.1s. Estimated remaining: 7m 23s. Rate: 180.2 symbols/min [2025-09-15T21:16:01.785955] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:01.788999] [DEBUG] [LOCAL ] GDV: Derivative data saved (1326 records). [2025-09-15T21:16:01.789179] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-15T21:16:01.792893] [INFO ] [MAIN ] Derivative Progress: 752/2083 symbols completed. GDV took 1.1s. Estimated remaining: 7m 23s. Rate: 180.4 symbols/min [2025-09-15T21:16:01.793235] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:01.805600] [DEBUG] [MAIN ] GE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:01.806419] [INFO ] [MAIN ] GE: Generated 1326 derivative records from 39678 primary records. [2025-09-15T21:16:01.806623] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-15T21:16:01.820464] [DEBUG] [LOCAL ] GE: Derivative data saved (1326 records). [2025-09-15T21:16:01.820551] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-15T21:16:01.822798] [INFO ] [MAIN ] Derivative Progress: 753/2083 symbols completed. GE took 1.1s. Estimated remaining: 7m 22s. Rate: 180.7 symbols/min [2025-09-15T21:16:01.823211] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:01.846488] [DEBUG] [LOCAL ] GEL: Loaded 24836 existing records from primary storage. [2025-09-15T21:16:01.846633] [INFO ] [MAIN ] GEL: Loaded 24836 primary data records. [2025-09-15T21:16:02.071494] [DEBUG] [LOCAL ] GENI: Loaded 38999 existing records from primary storage. [2025-09-15T21:16:02.153863] [INFO ] [MAIN ] GENI: Loaded 38999 primary data records. [2025-09-15T21:16:02.161073] [DEBUG] [LOCAL ] GEO: Loaded 38450 existing records from primary storage. [2025-09-15T21:16:02.161369] [INFO ] [MAIN ] GEO: Loaded 38450 primary data records. [2025-09-15T21:16:02.716252] [DEBUG] [MAIN ] GEL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:02.718001] [INFO ] [MAIN ] GEL: Generated 1326 derivative records from 24836 primary records. [2025-09-15T21:16:02.718466] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-15T21:16:02.737579] [DEBUG] [LOCAL ] GEL: Derivative data saved (1326 records). [2025-09-15T21:16:02.737776] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-15T21:16:02.740115] [INFO ] [MAIN ] Derivative Progress: 754/2083 symbols completed. GEL took 1.0s. Estimated remaining: 7m 22s. Rate: 180.2 symbols/min [2025-09-15T21:16:02.741456] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:02.772019] [DEBUG] [MAIN ] GEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:02.772302] [DEBUG] [MAIN ] GENI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:02.773183] [INFO ] [MAIN ] GENI: Generated 1326 derivative records from 38999 primary records. [2025-09-15T21:16:02.773956] [INFO ] [MAIN ] GEO: Generated 1326 derivative records from 38450 primary records. [2025-09-15T21:16:02.773325] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-15T21:16:02.774576] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-15T21:16:02.799872] [DEBUG] [LOCAL ] GEO: Derivative data saved (1326 records). [2025-09-15T21:16:02.800764] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-15T21:16:02.810526] [INFO ] [MAIN ] Derivative Progress: 755/2083 symbols completed. GEO took 1.0s. Estimated remaining: 7m 22s. Rate: 180.4 symbols/min [2025-09-15T21:16:02.811821] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:02.813557] [DEBUG] [LOCAL ] GENI: Derivative data saved (1326 records). [2025-09-15T21:16:02.813724] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-15T21:16:02.816839] [INFO ] [MAIN ] Derivative Progress: 756/2083 symbols completed. GENI took 1.0s. Estimated remaining: 7m 21s. Rate: 180.7 symbols/min [2025-09-15T21:16:02.817308] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:02.828346] [DEBUG] [LOCAL ] GES: Loaded 28051 existing records from primary storage. [2025-09-15T21:16:02.828750] [INFO ] [MAIN ] GES: Loaded 28051 primary data records. [2025-09-15T21:16:03.032459] [DEBUG] [LOCAL ] GETY: Loaded 25721 existing records from primary storage. [2025-09-15T21:16:03.045468] [INFO ] [MAIN ] GETY: Loaded 25721 primary data records. [2025-09-15T21:16:03.123542] [DEBUG] [LOCAL ] GEV: Loaded 39188 existing records from primary storage. [2025-09-15T21:16:03.233303] [INFO ] [MAIN ] GEV: Loaded 39188 primary data records. [2025-09-15T21:16:03.756600] [DEBUG] [MAIN ] GES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:03.758320] [INFO ] [MAIN ] GES: Generated 1326 derivative records from 28051 primary records. [2025-09-15T21:16:03.758794] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-15T21:16:03.774767] [DEBUG] [LOCAL ] GES: Derivative data saved (1326 records). [2025-09-15T21:16:03.775211] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-15T21:16:03.777097] [INFO ] [MAIN ] Derivative Progress: 757/2083 symbols completed. GES took 1.0s. Estimated remaining: 7m 21s. Rate: 180.2 symbols/min [2025-09-15T21:16:03.777613] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:03.790548] [DEBUG] [MAIN ] GETY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:03.793013] [INFO ] [MAIN ] GETY: Generated 1326 derivative records from 25721 primary records. [2025-09-15T21:16:03.793352] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-15T21:16:03.806506] [DEBUG] [LOCAL ] GF: Loaded 2108 existing records from primary storage. [2025-09-15T21:16:03.807542] [INFO ] [MAIN ] GF: Loaded 2108 primary data records. [2025-09-15T21:16:03.807114] [DEBUG] [MAIN ] GEV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:03.838778] [INFO ] [MAIN ] GEV: Generated 1326 derivative records from 39188 primary records. [2025-09-15T21:16:03.839564] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-15T21:16:03.933837] [DEBUG] [LOCAL ] GETY: Derivative data saved (1326 records). [2025-09-15T21:16:03.934147] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-15T21:16:03.937588] [INFO ] [MAIN ] Derivative Progress: 758/2083 symbols completed. GETY took 1.1s. Estimated remaining: 7m 21s. Rate: 180.3 symbols/min [2025-09-15T21:16:03.938976] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:03.990727] [DEBUG] [LOCAL ] GEV: Derivative data saved (1326 records). [2025-09-15T21:16:04.014431] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-15T21:16:04.017292] [INFO ] [MAIN ] Derivative Progress: 759/2083 symbols completed. GEV took 1.2s. Estimated remaining: 7m 20s. Rate: 180.5 symbols/min [2025-09-15T21:16:04.021762] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:04.127026] [DEBUG] [LOCAL ] GFF: Loaded 22267 existing records from primary storage. [2025-09-15T21:16:04.127502] [INFO ] [MAIN ] GFF: Loaded 22267 primary data records. [2025-09-15T21:16:04.334563] [DEBUG] [LOCAL ] GFI: Loaded 39110 existing records from primary storage. [2025-09-15T21:16:04.338194] [INFO ] [MAIN ] GFI: Loaded 39110 primary data records. [2025-09-15T21:16:04.409349] [DEBUG] [MAIN ] GF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:04.460108] [INFO ] [MAIN ] GF: Generated 1326 derivative records from 2108 primary records. [2025-09-15T21:16:04.478709] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-15T21:16:04.539961] [DEBUG] [LOCAL ] GF: Derivative data saved (1326 records). [2025-09-15T21:16:04.550868] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-15T21:16:04.563091] [INFO ] [MAIN ] Derivative Progress: 760/2083 symbols completed. GF took 0.8s. Estimated remaining: 7m 20s. Rate: 180.4 symbols/min [2025-09-15T21:16:04.597583] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:04.716934] [DEBUG] [MAIN ] GFF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:04.717925] [INFO ] [MAIN ] GFF: Generated 1326 derivative records from 22267 primary records. [2025-09-15T21:16:04.718948] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-15T21:16:04.731891] [DEBUG] [LOCAL ] GFF: Derivative data saved (1326 records). [2025-09-15T21:16:04.740129] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-15T21:16:04.742460] [INFO ] [MAIN ] Derivative Progress: 761/2083 symbols completed. GFF took 0.8s. Estimated remaining: 7m 19s. Rate: 180.5 symbols/min [2025-09-15T21:16:04.742771] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:04.757912] [DEBUG] [MAIN ] GFI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:04.760760] [DEBUG] [LOCAL ] GFR: Loaded 5085 existing records from primary storage. [2025-09-15T21:16:04.771083] [INFO ] [MAIN ] GFR: Loaded 5085 primary data records. [2025-09-15T21:16:04.770303] [INFO ] [MAIN ] GFI: Generated 1326 derivative records from 39110 primary records. [2025-09-15T21:16:04.782156] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-15T21:16:04.834666] [DEBUG] [LOCAL ] GFL: Loaded 34741 existing records from primary storage. [2025-09-15T21:16:04.862397] [INFO ] [MAIN ] GFL: Loaded 34741 primary data records. [2025-09-15T21:16:05.063423] [DEBUG] [LOCAL ] GFI: Derivative data saved (1326 records). [2025-09-15T21:16:05.144482] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-15T21:16:05.151936] [INFO ] [MAIN ] Derivative Progress: 762/2083 symbols completed. GFI took 1.1s. Estimated remaining: 7m 19s. Rate: 180.4 symbols/min [2025-09-15T21:16:05.168446] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:05.329871] [DEBUG] [MAIN ] GFR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:05.330819] [INFO ] [MAIN ] GFR: Generated 1326 derivative records from 5085 primary records. [2025-09-15T21:16:05.331016] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-15T21:16:05.351288] [DEBUG] [LOCAL ] GFR: Derivative data saved (1326 records). [2025-09-15T21:16:05.353316] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-15T21:16:05.355955] [INFO ] [MAIN ] Derivative Progress: 763/2083 symbols completed. GFR took 0.6s. Estimated remaining: 7m 19s. Rate: 180.5 symbols/min [2025-09-15T21:16:05.376604] [DEBUG] [LOCAL ] GGB: Loaded 37887 existing records from primary storage. [2025-09-15T21:16:05.376856] [DEBUG] [MAIN ] GFL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:05.377506] [INFO ] [MAIN ] GGB: Loaded 37887 primary data records. [2025-09-15T21:16:05.377462] [INFO ] [MAIN ] GFL: Generated 1326 derivative records from 34741 primary records. [2025-09-15T21:16:05.377668] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-15T21:16:05.534895] [DEBUG] [LOCAL ] GFL: Derivative data saved (1326 records). [2025-09-15T21:16:05.541167] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-15T21:16:05.560423] [INFO ] [MAIN ] Derivative Progress: 764/2083 symbols completed. GFL took 1.0s. Estimated remaining: 7m 18s. Rate: 180.6 symbols/min [2025-09-15T21:16:05.664290] [DEBUG] [MAIN ] GGB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:05.665060] [INFO ] [MAIN ] GGB: Generated 1326 derivative records from 37887 primary records. [2025-09-15T21:16:05.665124] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-15T21:16:05.677575] [DEBUG] [LOCAL ] GGB: Derivative data saved (1326 records). [2025-09-15T21:16:05.677694] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-15T21:16:05.679279] [INFO ] [MAIN ] Derivative Progress: 765/2083 symbols completed. GGB took 0.5s. Estimated remaining: 7m 17s. Rate: 180.8 symbols/min [2025-09-15T21:16:05.679985] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:05.680177] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:05.680444] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:05.685281] [DEBUG] [LOCAL ] GGZ: Loaded 1696 existing records from primary storage. [2025-09-15T21:16:05.685452] [INFO ] [MAIN ] GGZ: Loaded 1696 primary data records. [2025-09-15T21:16:05.807448] [DEBUG] [LOCAL ] GGT: Loaded 11031 existing records from primary storage. [2025-09-15T21:16:05.813069] [INFO ] [MAIN ] GGT: Loaded 11031 primary data records. [2025-09-15T21:16:05.996195] [DEBUG] [LOCAL ] GGG: Loaded 29577 existing records from primary storage. [2025-09-15T21:16:06.124311] [INFO ] [MAIN ] GGG: Loaded 29577 primary data records. [2025-09-15T21:16:06.543952] [DEBUG] [MAIN ] GGZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:06.545087] [INFO ] [MAIN ] GGZ: Generated 1326 derivative records from 1696 primary records. [2025-09-15T21:16:06.545296] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-15T21:16:06.557676] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1326 records). [2025-09-15T21:16:06.558731] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-15T21:16:06.560345] [INFO ] [MAIN ] Derivative Progress: 766/2083 symbols completed. GGZ took 0.9s. Estimated remaining: 7m 18s. Rate: 180.4 symbols/min [2025-09-15T21:16:06.566208] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:06.570186] [DEBUG] [MAIN ] GGT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:06.571148] [INFO ] [MAIN ] GGT: Generated 1326 derivative records from 11031 primary records. [2025-09-15T21:16:06.571330] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-15T21:16:06.584187] [DEBUG] [LOCAL ] GHC: Loaded 2054 existing records from primary storage. [2025-09-15T21:16:06.584830] [INFO ] [MAIN ] GHC: Loaded 2054 primary data records. [2025-09-15T21:16:06.621886] [DEBUG] [LOCAL ] GGT: Derivative data saved (1326 records). [2025-09-15T21:16:06.633567] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-15T21:16:06.666836] [INFO ] [MAIN ] Derivative Progress: 767/2083 symbols completed. GGT took 1.0s. Estimated remaining: 7m 17s. Rate: 180.5 symbols/min [2025-09-15T21:16:06.696727] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:06.703728] [DEBUG] [MAIN ] GGG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:06.704663] [INFO ] [MAIN ] GGG: Generated 1326 derivative records from 29577 primary records. [2025-09-15T21:16:06.704762] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-15T21:16:06.789865] [DEBUG] [LOCAL ] GHI: Loaded 5230 existing records from primary storage. [2025-09-15T21:16:06.875554] [INFO ] [MAIN ] GHI: Loaded 5230 primary data records. [2025-09-15T21:16:06.887214] [DEBUG] [LOCAL ] GGG: Derivative data saved (1326 records). [2025-09-15T21:16:06.907061] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-15T21:16:06.933153] [INFO ] [MAIN ] Derivative Progress: 768/2083 symbols completed. GGG took 1.3s. Estimated remaining: 7m 17s. Rate: 180.6 symbols/min [2025-09-15T21:16:06.942675] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:07.061261] [DEBUG] [LOCAL ] GHLD: Loaded 3305 existing records from primary storage. [2025-09-15T21:16:07.061386] [INFO ] [MAIN ] GHLD: Loaded 3305 primary data records. [2025-09-15T21:16:07.419985] [DEBUG] [MAIN ] GHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:07.420921] [INFO ] [MAIN ] GHC: Generated 1326 derivative records from 2054 primary records. [2025-09-15T21:16:07.421721] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-15T21:16:07.434722] [DEBUG] [LOCAL ] GHC: Derivative data saved (1326 records). [2025-09-15T21:16:07.434965] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-15T21:16:07.438264] [INFO ] [MAIN ] Derivative Progress: 769/2083 symbols completed. GHC took 0.9s. Estimated remaining: 7m 17s. Rate: 180.5 symbols/min [2025-09-15T21:16:07.439670] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:07.451509] [DEBUG] [MAIN ] GHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:07.452353] [INFO ] [MAIN ] GHI: Generated 1326 derivative records from 5230 primary records. [2025-09-15T21:16:07.452575] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-15T21:16:07.484044] [DEBUG] [MAIN ] GHLD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:07.483475] [DEBUG] [LOCAL ] GHM: Loaded 10420 existing records from primary storage. [2025-09-15T21:16:07.483744] [DEBUG] [LOCAL ] GHI: Derivative data saved (1326 records). [2025-09-15T21:16:07.484815] [INFO ] [MAIN ] GHM: Loaded 10420 primary data records. [2025-09-15T21:16:07.484744] [INFO ] [MAIN ] GHLD: Generated 1326 derivative records from 3305 primary records. [2025-09-15T21:16:07.484992] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-15T21:16:07.484911] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-15T21:16:07.520379] [INFO ] [MAIN ] Derivative Progress: 770/2083 symbols completed. GHI took 0.8s. Estimated remaining: 7m 16s. Rate: 180.6 symbols/min [2025-09-15T21:16:07.539304] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:07.611326] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1326 records). [2025-09-15T21:16:07.640982] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-15T21:16:07.666016] [INFO ] [MAIN ] Derivative Progress: 771/2083 symbols completed. GHLD took 0.7s. Estimated remaining: 7m 15s. Rate: 180.8 symbols/min [2025-09-15T21:16:07.680813] [DEBUG] [LOCAL ] GHY: Loaded 14869 existing records from primary storage. [2025-09-15T21:16:07.679730] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:07.681002] [INFO ] [MAIN ] GHY: Loaded 14869 primary data records. [2025-09-15T21:16:07.963990] [DEBUG] [LOCAL ] GIB: Loaded 22652 existing records from primary storage. [2025-09-15T21:16:08.095588] [INFO ] [MAIN ] GIB: Loaded 22652 primary data records. [2025-09-15T21:16:08.298263] [DEBUG] [MAIN ] GHM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:08.383399] [INFO ] [MAIN ] GHM: Generated 1326 derivative records from 10420 primary records. [2025-09-15T21:16:08.383704] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-15T21:16:08.399479] [DEBUG] [LOCAL ] GHM: Derivative data saved (1326 records). [2025-09-15T21:16:08.399664] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-15T21:16:08.401391] [INFO ] [MAIN ] Derivative Progress: 772/2083 symbols completed. GHM took 1.0s. Estimated remaining: 7m 16s. Rate: 180.5 symbols/min [2025-09-15T21:16:08.403450] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:08.416340] [DEBUG] [MAIN ] GHY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:08.417257] [INFO ] [MAIN ] GHY: Generated 1326 derivative records from 14869 primary records. [2025-09-15T21:16:08.417455] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-15T21:16:08.444166] [DEBUG] [MAIN ] GIB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:08.445522] [INFO ] [MAIN ] GIB: Generated 1326 derivative records from 22652 primary records. [2025-09-15T21:16:08.445663] [DEBUG] [LOCAL ] GHY: Derivative data saved (1326 records). [2025-09-15T21:16:08.445808] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-15T21:16:08.447968] [INFO ] [MAIN ] Derivative Progress: 773/2083 symbols completed. GHY took 0.9s. Estimated remaining: 7m 15s. Rate: 180.7 symbols/min [2025-09-15T21:16:08.445756] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-15T21:16:08.448966] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:08.468678] [DEBUG] [LOCAL ] GIB: Derivative data saved (1326 records). [2025-09-15T21:16:08.468859] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-15T21:16:08.470809] [INFO ] [MAIN ] Derivative Progress: 774/2083 symbols completed. GIB took 0.8s. Estimated remaining: 7m 14s. Rate: 180.9 symbols/min [2025-09-15T21:16:08.471877] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:08.482967] [DEBUG] [LOCAL ] GIL: Loaded 31665 existing records from primary storage. [2025-09-15T21:16:08.483148] [INFO ] [MAIN ] GIL: Loaded 31665 primary data records. [2025-09-15T21:16:08.802551] [DEBUG] [LOCAL ] GIS: Loaded 39641 existing records from primary storage. [2025-09-15T21:16:08.800872] [DEBUG] [LOCAL ] GKOS: Loaded 31298 existing records from primary storage. [2025-09-15T21:16:08.802817] [INFO ] [MAIN ] GIS: Loaded 39641 primary data records. [2025-09-15T21:16:08.802906] [INFO ] [MAIN ] GKOS: Loaded 31298 primary data records. [2025-09-15T21:16:09.351825] [DEBUG] [MAIN ] GIL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:09.353052] [INFO ] [MAIN ] GIL: Generated 1326 derivative records from 31665 primary records. [2025-09-15T21:16:09.353714] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-15T21:16:09.368662] [DEBUG] [LOCAL ] GIL: Derivative data saved (1326 records). [2025-09-15T21:16:09.368971] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-15T21:16:09.372604] [INFO ] [MAIN ] Derivative Progress: 775/2083 symbols completed. GIL took 1.0s. Estimated remaining: 7m 15s. Rate: 180.5 symbols/min [2025-09-15T21:16:09.373362] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:09.389819] [DEBUG] [MAIN ] GKOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:09.399848] [INFO ] [MAIN ] GKOS: Generated 1326 derivative records from 31298 primary records. [2025-09-15T21:16:09.400265] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-15T21:16:09.400183] [DEBUG] [MAIN ] GIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:09.401412] [INFO ] [MAIN ] GIS: Generated 1326 derivative records from 39641 primary records. [2025-09-15T21:16:09.401729] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-15T21:16:09.431382] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1326 records). [2025-09-15T21:16:09.432010] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-15T21:16:09.434126] [INFO ] [MAIN ] Derivative Progress: 776/2083 symbols completed. GKOS took 1.0s. Estimated remaining: 7m 14s. Rate: 180.7 symbols/min [2025-09-15T21:16:09.435537] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:09.436237] [DEBUG] [LOCAL ] GIS: Derivative data saved (1326 records). [2025-09-15T21:16:09.437089] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-15T21:16:09.439492] [INFO ] [MAIN ] Derivative Progress: 777/2083 symbols completed. GIS took 1.0s. Estimated remaining: 7m 13s. Rate: 180.9 symbols/min [2025-09-15T21:16:09.439996] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:09.451993] [DEBUG] [LOCAL ] GL: Loaded 27677 existing records from primary storage. [2025-09-15T21:16:09.452204] [INFO ] [MAIN ] GL: Loaded 27677 primary data records. [2025-09-15T21:16:09.734927] [DEBUG] [LOCAL ] GLOB: Loaded 35383 existing records from primary storage. [2025-09-15T21:16:09.743505] [INFO ] [MAIN ] GLOB: Loaded 35383 primary data records. [2025-09-15T21:16:09.864189] [DEBUG] [LOCAL ] GLW: Loaded 39598 existing records from primary storage. [2025-09-15T21:16:09.865022] [INFO ] [MAIN ] GLW: Loaded 39598 primary data records. [2025-09-15T21:16:10.233888] [DEBUG] [MAIN ] GL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:10.379762] [INFO ] [MAIN ] GL: Generated 1326 derivative records from 27677 primary records. [2025-09-15T21:16:10.379949] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-15T21:16:10.408010] [DEBUG] [MAIN ] GLOB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:10.409441] [INFO ] [MAIN ] GLOB: Generated 1326 derivative records from 35383 primary records. [2025-09-15T21:16:10.408837] [DEBUG] [LOCAL ] GL: Derivative data saved (1326 records). [2025-09-15T21:16:10.410288] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-15T21:16:10.410446] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-15T21:16:10.412324] [INFO ] [MAIN ] Derivative Progress: 778/2083 symbols completed. GL took 1.0s. Estimated remaining: 7m 14s. Rate: 180.5 symbols/min [2025-09-15T21:16:10.425350] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1326 records). [2025-09-15T21:16:10.425559] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-15T21:16:10.427560] [INFO ] [MAIN ] Derivative Progress: 779/2083 symbols completed. GLOB took 1.0s. Estimated remaining: 7m 13s. Rate: 180.7 symbols/min [2025-09-15T21:16:10.439147] [DEBUG] [MAIN ] GLW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:10.439703] [INFO ] [MAIN ] GLW: Generated 1326 derivative records from 39598 primary records. [2025-09-15T21:16:10.439771] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-15T21:16:10.451061] [DEBUG] [LOCAL ] GLW: Derivative data saved (1326 records). [2025-09-15T21:16:10.451123] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-15T21:16:10.453085] [INFO ] [MAIN ] Derivative Progress: 780/2083 symbols completed. GLW took 1.0s. Estimated remaining: 7m 12s. Rate: 180.9 symbols/min [2025-09-15T21:16:10.453672] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:10.453612] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:10.453782] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:10.522476] [DEBUG] [LOCAL ] GMED: Loaded 35554 existing records from primary storage. [2025-09-15T21:16:10.522679] [INFO ] [MAIN ] GMED: Loaded 35554 primary data records. [2025-09-15T21:16:10.567721] [DEBUG] [LOCAL ] GME: Loaded 39747 existing records from primary storage. [2025-09-15T21:16:10.608308] [INFO ] [MAIN ] GME: Loaded 39747 primary data records. [2025-09-15T21:16:10.692985] [DEBUG] [LOCAL ] GM: Loaded 39689 existing records from primary storage. [2025-09-15T21:16:10.715459] [INFO ] [MAIN ] GM: Loaded 39689 primary data records. [2025-09-15T21:16:11.354472] [DEBUG] [MAIN ] GMED: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:11.364075] [DEBUG] [MAIN ] GME: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:11.365304] [INFO ] [MAIN ] GME: Generated 1326 derivative records from 39747 primary records. [2025-09-15T21:16:11.364817] [INFO ] [MAIN ] GMED: Generated 1326 derivative records from 35554 primary records. [2025-09-15T21:16:11.365395] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-15T21:16:11.365872] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-15T21:16:11.399786] [DEBUG] [LOCAL ] GME: Derivative data saved (1326 records). [2025-09-15T21:16:11.400528] [DEBUG] [LOCAL ] GMED: Derivative data saved (1326 records). [2025-09-15T21:16:11.400607] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-15T21:16:11.400014] [DEBUG] [MAIN ] GM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:11.400740] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-15T21:16:11.402094] [INFO ] [MAIN ] Derivative Progress: 781/2083 symbols completed. GMED took 0.9s. Estimated remaining: 7m 13s. Rate: 180.5 symbols/min [2025-09-15T21:16:11.404746] [INFO ] [MAIN ] Derivative Progress: 782/2083 symbols completed. GME took 1.0s. Estimated remaining: 7m 12s. Rate: 180.7 symbols/min [2025-09-15T21:16:11.402782] [INFO ] [MAIN ] GM: Generated 1326 derivative records from 39689 primary records. [2025-09-15T21:16:11.405041] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:11.404904] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-15T21:16:11.404700] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:11.419037] [DEBUG] [LOCAL ] GM: Derivative data saved (1326 records). [2025-09-15T21:16:11.422628] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-15T21:16:11.424718] [INFO ] [MAIN ] Derivative Progress: 783/2083 symbols completed. GM took 1.0s. Estimated remaining: 7m 11s. Rate: 180.9 symbols/min [2025-09-15T21:16:11.425027] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:11.434589] [DEBUG] [LOCAL ] GNE: Loaded 14550 existing records from primary storage. [2025-09-15T21:16:11.434743] [INFO ] [MAIN ] GNE: Loaded 14550 primary data records. [2025-09-15T21:16:11.579614] [DEBUG] [LOCAL ] GNK: Loaded 29366 existing records from primary storage. [2025-09-15T21:16:11.585231] [INFO ] [MAIN ] GNK: Loaded 29366 primary data records. [2025-09-15T21:16:11.720069] [DEBUG] [LOCAL ] GNL: Loaded 34319 existing records from primary storage. [2025-09-15T21:16:11.818068] [INFO ] [MAIN ] GNL: Loaded 34319 primary data records. [2025-09-15T21:16:12.284678] [DEBUG] [MAIN ] GNE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:12.286529] [INFO ] [MAIN ] GNE: Generated 1326 derivative records from 14550 primary records. [2025-09-15T21:16:12.286845] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-15T21:16:12.303525] [DEBUG] [MAIN ] GNK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:12.307467] [INFO ] [MAIN ] GNK: Generated 1326 derivative records from 29366 primary records. [2025-09-15T21:16:12.310374] [DEBUG] [LOCAL ] GNE: Derivative data saved (1326 records). [2025-09-15T21:16:12.310585] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-15T21:16:12.310715] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-15T21:16:12.312670] [INFO ] [MAIN ] Derivative Progress: 784/2083 symbols completed. GNE took 0.9s. Estimated remaining: 7m 12s. Rate: 180.5 symbols/min [2025-09-15T21:16:12.320169] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:12.335955] [DEBUG] [MAIN ] GNL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:12.337128] [INFO ] [MAIN ] GNL: Generated 1326 derivative records from 34319 primary records. [2025-09-15T21:16:12.337596] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-15T21:16:12.337837] [DEBUG] [LOCAL ] GNK: Derivative data saved (1326 records). [2025-09-15T21:16:12.338001] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-15T21:16:12.340472] [INFO ] [MAIN ] Derivative Progress: 785/2083 symbols completed. GNK took 0.9s. Estimated remaining: 7m 11s. Rate: 180.7 symbols/min [2025-09-15T21:16:12.340949] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:12.357201] [DEBUG] [LOCAL ] GNL: Derivative data saved (1326 records). [2025-09-15T21:16:12.360488] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-15T21:16:12.362552] [INFO ] [MAIN ] Derivative Progress: 786/2083 symbols completed. GNL took 0.9s. Estimated remaining: 7m 10s. Rate: 181.0 symbols/min [2025-09-15T21:16:12.360442] [DEBUG] [LOCAL ] GNT: Loaded 5815 existing records from primary storage. [2025-09-15T21:16:12.362894] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:12.362948] [INFO ] [MAIN ] GNT: Loaded 5815 primary data records. [2025-09-15T21:16:12.501657] [DEBUG] [LOCAL ] GNRC: Loaded 33188 existing records from primary storage. [2025-09-15T21:16:12.530921] [INFO ] [MAIN ] GNRC: Loaded 33188 primary data records. [2025-09-15T21:16:12.800670] [DEBUG] [LOCAL ] GNW: Loaded 37886 existing records from primary storage. [2025-09-15T21:16:12.822223] [INFO ] [MAIN ] GNW: Loaded 37886 primary data records. [2025-09-15T21:16:13.241877] [DEBUG] [MAIN ] GNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:13.243810] [INFO ] [MAIN ] GNT: Generated 1326 derivative records from 5815 primary records. [2025-09-15T21:16:13.244557] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-15T21:16:13.260898] [DEBUG] [LOCAL ] GNT: Derivative data saved (1326 records). [2025-09-15T21:16:13.261169] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-15T21:16:13.263010] [INFO ] [MAIN ] Derivative Progress: 787/2083 symbols completed. GNT took 0.9s. Estimated remaining: 7m 11s. Rate: 180.6 symbols/min [2025-09-15T21:16:13.272736] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:13.272960] [DEBUG] [MAIN ] GNRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:13.273624] [INFO ] [MAIN ] GNRC: Generated 1326 derivative records from 33188 primary records. [2025-09-15T21:16:13.273814] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-15T21:16:13.287712] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1326 records). [2025-09-15T21:16:13.288880] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-15T21:16:13.291738] [INFO ] [MAIN ] Derivative Progress: 788/2083 symbols completed. GNRC took 1.0s. Estimated remaining: 7m 10s. Rate: 180.8 symbols/min [2025-09-15T21:16:13.292154] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:13.303339] [DEBUG] [MAIN ] GNW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:13.304209] [INFO ] [MAIN ] GNW: Generated 1326 derivative records from 37886 primary records. [2025-09-15T21:16:13.304410] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-15T21:16:13.325633] [DEBUG] [LOCAL ] GNW: Derivative data saved (1326 records). [2025-09-15T21:16:13.325822] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-15T21:16:13.327903] [INFO ] [MAIN ] Derivative Progress: 789/2083 symbols completed. GNW took 1.0s. Estimated remaining: 7m 9s. Rate: 181.0 symbols/min [2025-09-15T21:16:13.328224] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:13.352142] [DEBUG] [LOCAL ] GOF: Loaded 30983 existing records from primary storage. [2025-09-15T21:16:13.352310] [INFO ] [MAIN ] GOF: Loaded 30983 primary data records. [2025-09-15T21:16:13.352786] [DEBUG] [LOCAL ] GOLF: Loaded 22665 existing records from primary storage. [2025-09-15T21:16:13.373779] [INFO ] [MAIN ] GOLF: Loaded 22665 primary data records. [2025-09-15T21:16:13.645121] [DEBUG] [LOCAL ] GOOS: Loaded 33701 existing records from primary storage. [2025-09-15T21:16:13.812364] [INFO ] [MAIN ] GOOS: Loaded 33701 primary data records. [2025-09-15T21:16:14.185824] [DEBUG] [MAIN ] GOF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:14.187554] [INFO ] [MAIN ] GOF: Generated 1326 derivative records from 30983 primary records. [2025-09-15T21:16:14.188635] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-15T21:16:14.210676] [DEBUG] [MAIN ] GOLF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:14.212688] [INFO ] [MAIN ] GOLF: Generated 1326 derivative records from 22665 primary records. [2025-09-15T21:16:14.212868] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-15T21:16:14.219838] [DEBUG] [LOCAL ] GOF: Derivative data saved (1326 records). [2025-09-15T21:16:14.220006] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-15T21:16:14.221556] [INFO ] [MAIN ] Derivative Progress: 790/2083 symbols completed. GOF took 0.9s. Estimated remaining: 7m 10s. Rate: 180.6 symbols/min [2025-09-15T21:16:14.225805] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:14.227983] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1326 records). [2025-09-15T21:16:14.228046] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-15T21:16:14.230021] [INFO ] [MAIN ] Derivative Progress: 791/2083 symbols completed. GOLF took 0.9s. Estimated remaining: 7m 9s. Rate: 180.8 symbols/min [2025-09-15T21:16:14.230433] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:14.242919] [DEBUG] [MAIN ] GOOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:14.243794] [INFO ] [MAIN ] GOOS: Generated 1326 derivative records from 33701 primary records. [2025-09-15T21:16:14.243886] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-15T21:16:14.256603] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1326 records). [2025-09-15T21:16:14.256810] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-15T21:16:14.258790] [INFO ] [MAIN ] Derivative Progress: 792/2083 symbols completed. GOOS took 0.9s. Estimated remaining: 7m 8s. Rate: 181.0 symbols/min [2025-09-15T21:16:14.259175] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:14.288762] [DEBUG] [LOCAL ] GOTU: Loaded 27638 existing records from primary storage. [2025-09-15T21:16:14.288924] [INFO ] [MAIN ] GOTU: Loaded 27638 primary data records. [2025-09-15T21:16:14.347892] [DEBUG] [LOCAL ] GPI: Loaded 10095 existing records from primary storage. [2025-09-15T21:16:14.378677] [INFO ] [MAIN ] GPI: Loaded 10095 primary data records. [2025-09-15T21:16:14.450923] [DEBUG] [LOCAL ] GPC: Loaded 33780 existing records from primary storage. [2025-09-15T21:16:14.478546] [INFO ] [MAIN ] GPC: Loaded 33780 primary data records. [2025-09-15T21:16:15.151129] [DEBUG] [MAIN ] GOTU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:15.152799] [INFO ] [MAIN ] GOTU: Generated 1326 derivative records from 27638 primary records. [2025-09-15T21:16:15.153779] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-15T21:16:15.167260] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1326 records). [2025-09-15T21:16:15.169257] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-15T21:16:15.170887] [INFO ] [MAIN ] Derivative Progress: 793/2083 symbols completed. GOTU took 0.9s. Estimated remaining: 7m 9s. Rate: 180.6 symbols/min [2025-09-15T21:16:15.183441] [DEBUG] [MAIN ] GPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:15.184057] [INFO ] [MAIN ] GPI: Generated 1326 derivative records from 10095 primary records. [2025-09-15T21:16:15.184174] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-15T21:16:15.201968] [DEBUG] [MAIN ] GPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:15.203427] [INFO ] [MAIN ] GPC: Generated 1326 derivative records from 33780 primary records. [2025-09-15T21:16:15.203698] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-15T21:16:15.205411] [DEBUG] [LOCAL ] GPI: Derivative data saved (1326 records). [2025-09-15T21:16:15.205741] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-15T21:16:15.207739] [INFO ] [MAIN ] Derivative Progress: 794/2083 symbols completed. GPI took 0.9s. Estimated remaining: 7m 8s. Rate: 180.8 symbols/min [2025-09-15T21:16:15.218728] [DEBUG] [LOCAL ] GPC: Derivative data saved (1326 records). [2025-09-15T21:16:15.218786] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-15T21:16:15.220603] [INFO ] [MAIN ] Derivative Progress: 795/2083 symbols completed. GPC took 1.0s. Estimated remaining: 7m 7s. Rate: 181.0 symbols/min [2025-09-15T21:16:15.221066] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:15.221015] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:15.221214] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:15.227464] [DEBUG] [LOCAL ] GPJA: Loaded 3082 existing records from primary storage. [2025-09-15T21:16:15.227631] [INFO ] [MAIN ] GPJA: Loaded 3082 primary data records. [2025-09-15T21:16:15.423485] [DEBUG] [LOCAL ] GPMT: Loaded 20224 existing records from primary storage. [2025-09-15T21:16:15.504402] [INFO ] [MAIN ] GPMT: Loaded 20224 primary data records. [2025-09-15T21:16:15.620319] [DEBUG] [LOCAL ] GPK: Loaded 39013 existing records from primary storage. [2025-09-15T21:16:15.636636] [INFO ] [MAIN ] GPK: Loaded 39013 primary data records. [2025-09-15T21:16:16.057616] [DEBUG] [MAIN ] GPJA: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:16:16.058360] [INFO ] [MAIN ] GPJA: Generated 1325 derivative records from 3082 primary records. [2025-09-15T21:16:16.058609] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-15T21:16:16.071771] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1325 records). [2025-09-15T21:16:16.072471] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-15T21:16:16.074714] [INFO ] [MAIN ] Derivative Progress: 796/2083 symbols completed. GPJA took 0.9s. Estimated remaining: 7m 7s. Rate: 180.7 symbols/min [2025-09-15T21:16:16.075053] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:16.090215] [DEBUG] [MAIN ] GPMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:16.091252] [INFO ] [MAIN ] GPMT: Generated 1326 derivative records from 20224 primary records. [2025-09-15T21:16:16.091637] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-15T21:16:16.110675] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1326 records). [2025-09-15T21:16:16.112331] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-15T21:16:16.114342] [INFO ] [MAIN ] Derivative Progress: 797/2083 symbols completed. GPMT took 0.9s. Estimated remaining: 7m 7s. Rate: 180.9 symbols/min [2025-09-15T21:16:16.114710] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:16.124889] [DEBUG] [MAIN ] GPK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:16.125730] [INFO ] [MAIN ] GPK: Generated 1326 derivative records from 39013 primary records. [2025-09-15T21:16:16.126013] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-15T21:16:16.148083] [DEBUG] [LOCAL ] GPK: Derivative data saved (1326 records). [2025-09-15T21:16:16.148214] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-15T21:16:16.150240] [INFO ] [MAIN ] Derivative Progress: 798/2083 symbols completed. GPK took 0.9s. Estimated remaining: 7m 6s. Rate: 181.1 symbols/min [2025-09-15T21:16:16.151083] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:16.167494] [DEBUG] [LOCAL ] GPN: Loaded 38444 existing records from primary storage. [2025-09-15T21:16:16.167670] [INFO ] [MAIN ] GPN: Loaded 38444 primary data records. [2025-09-15T21:16:16.254271] [DEBUG] [LOCAL ] GPOR: Loaded 16284 existing records from primary storage. [2025-09-15T21:16:16.282832] [INFO ] [MAIN ] GPOR: Loaded 16284 primary data records. [2025-09-15T21:16:16.546108] [DEBUG] [LOCAL ] GPRK: Loaded 28378 existing records from primary storage. [2025-09-15T21:16:16.556962] [INFO ] [MAIN ] GPRK: Loaded 28378 primary data records. [2025-09-15T21:16:17.067901] [DEBUG] [MAIN ] GPN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:17.069412] [INFO ] [MAIN ] GPN: Generated 1326 derivative records from 38444 primary records. [2025-09-15T21:16:17.070496] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-15T21:16:17.091866] [DEBUG] [MAIN ] GPOR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:17.096269] [INFO ] [MAIN ] GPOR: Generated 1326 derivative records from 16284 primary records. [2025-09-15T21:16:17.096762] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-15T21:16:17.096592] [DEBUG] [LOCAL ] GPN: Derivative data saved (1326 records). [2025-09-15T21:16:17.106795] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-15T21:16:17.109606] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1326 records). [2025-09-15T21:16:17.111675] [INFO ] [MAIN ] Derivative Progress: 799/2083 symbols completed. GPN took 1.0s. Estimated remaining: 7m 6s. Rate: 180.7 symbols/min [2025-09-15T21:16:17.109972] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-15T21:16:17.112170] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:17.114512] [INFO ] [MAIN ] Derivative Progress: 800/2083 symbols completed. GPOR took 1.0s. Estimated remaining: 7m 6s. Rate: 180.9 symbols/min [2025-09-15T21:16:17.114902] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:17.132127] [DEBUG] [MAIN ] GPRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:17.134711] [INFO ] [MAIN ] GPRK: Generated 1326 derivative records from 28378 primary records. [2025-09-15T21:16:17.134877] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-15T21:16:17.151609] [DEBUG] [LOCAL ] GRC: Loaded 6266 existing records from primary storage. [2025-09-15T21:16:17.156528] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1326 records). [2025-09-15T21:16:17.156920] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-15T21:16:17.156748] [INFO ] [MAIN ] GRC: Loaded 6266 primary data records. [2025-09-15T21:16:17.170737] [INFO ] [MAIN ] Derivative Progress: 801/2083 symbols completed. GPRK took 1.0s. Estimated remaining: 7m 5s. Rate: 181.1 symbols/min [2025-09-15T21:16:17.220545] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:17.248930] [DEBUG] [LOCAL ] GRBK: Loaded 19511 existing records from primary storage. [2025-09-15T21:16:17.270139] [INFO ] [MAIN ] GRBK: Loaded 19511 primary data records. [2025-09-15T21:16:17.618169] [DEBUG] [LOCAL ] GRMN: Loaded 29826 existing records from primary storage. [2025-09-15T21:16:17.737454] [INFO ] [MAIN ] GRMN: Loaded 29826 primary data records. [2025-09-15T21:16:18.034522] [DEBUG] [MAIN ] GRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:18.035758] [INFO ] [MAIN ] GRC: Generated 1326 derivative records from 6266 primary records. [2025-09-15T21:16:18.036866] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-15T21:16:18.053910] [DEBUG] [LOCAL ] GRC: Derivative data saved (1326 records). [2025-09-15T21:16:18.064467] [DEBUG] [MAIN ] GRBK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:18.064233] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-15T21:16:18.067381] [INFO ] [MAIN ] Derivative Progress: 802/2083 symbols completed. GRC took 1.0s. Estimated remaining: 7m 5s. Rate: 180.7 symbols/min [2025-09-15T21:16:18.065583] [INFO ] [MAIN ] GRBK: Generated 1326 derivative records from 19511 primary records. [2025-09-15T21:16:18.067692] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:18.067539] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-15T21:16:18.084410] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1326 records). [2025-09-15T21:16:18.086382] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-15T21:16:18.088610] [INFO ] [MAIN ] Derivative Progress: 803/2083 symbols completed. GRBK took 1.0s. Estimated remaining: 7m 5s. Rate: 180.9 symbols/min [2025-09-15T21:16:18.089037] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:18.100309] [DEBUG] [MAIN ] GRMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:18.101121] [INFO ] [MAIN ] GRMN: Generated 1326 derivative records from 29826 primary records. [2025-09-15T21:16:18.101213] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-15T21:16:18.123703] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1326 records). [2025-09-15T21:16:18.124344] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-15T21:16:18.126856] [INFO ] [MAIN ] Derivative Progress: 804/2083 symbols completed. GRMN took 0.9s. Estimated remaining: 7m 4s. Rate: 181.1 symbols/min [2025-09-15T21:16:18.132138] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:18.144135] [DEBUG] [LOCAL ] GRND: Loaded 36943 existing records from primary storage. [2025-09-15T21:16:18.144353] [INFO ] [MAIN ] GRND: Loaded 36943 primary data records. [2025-09-15T21:16:18.252878] [DEBUG] [LOCAL ] GROV: Loaded 6809 existing records from primary storage. [2025-09-15T21:16:18.237908] [DEBUG] [LOCAL ] GRNT: Loaded 24663 existing records from primary storage. [2025-09-15T21:16:18.291016] [INFO ] [MAIN ] GRNT: Loaded 24663 primary data records. [2025-09-15T21:16:18.287818] [INFO ] [MAIN ] GROV: Loaded 6809 primary data records. [2025-09-15T21:16:19.026219] [DEBUG] [MAIN ] GRND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:19.027354] [INFO ] [MAIN ] GRND: Generated 1326 derivative records from 36943 primary records. [2025-09-15T21:16:19.027758] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-15T21:16:19.054826] [DEBUG] [LOCAL ] GRND: Derivative data saved (1326 records). [2025-09-15T21:16:19.065057] [DEBUG] [MAIN ] GRNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:19.065404] [DEBUG] [MAIN ] GROV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:19.066476] [INFO ] [MAIN ] GROV: Generated 1326 derivative records from 6809 primary records. [2025-09-15T21:16:19.066561] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-15T21:16:19.067496] [INFO ] [MAIN ] GRNT: Generated 1326 derivative records from 24663 primary records. [2025-09-15T21:16:19.069697] [INFO ] [MAIN ] Derivative Progress: 805/2083 symbols completed. GRND took 1.0s. Estimated remaining: 7m 4s. Rate: 180.7 symbols/min [2025-09-15T21:16:19.069860] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-15T21:16:19.069807] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-15T21:16:19.070086] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:19.095507] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1326 records). [2025-09-15T21:16:19.095616] [DEBUG] [LOCAL ] GROV: Derivative data saved (1326 records). [2025-09-15T21:16:19.095809] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-15T21:16:19.095925] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-15T21:16:19.099551] [INFO ] [MAIN ] Derivative Progress: 806/2083 symbols completed. GRNT took 1.0s. Estimated remaining: 7m 4s. Rate: 180.9 symbols/min [2025-09-15T21:16:19.104832] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:19.104581] [DEBUG] [LOCAL ] GRX: Loaded 3278 existing records from primary storage. [2025-09-15T21:16:19.105101] [INFO ] [MAIN ] Derivative Progress: 807/2083 symbols completed. GROV took 1.0s. Estimated remaining: 7m 3s. Rate: 181.1 symbols/min [2025-09-15T21:16:19.105457] [INFO ] [MAIN ] GRX: Loaded 3278 primary data records. [2025-09-15T21:16:19.105774] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:19.449409] [DEBUG] [LOCAL ] GSK: Loaded 39497 existing records from primary storage. [2025-09-15T21:16:19.450187] [INFO ] [MAIN ] GSK: Loaded 39497 primary data records. [2025-09-15T21:16:19.450836] [DEBUG] [LOCAL ] GS: Loaded 38263 existing records from primary storage. [2025-09-15T21:16:19.462269] [INFO ] [MAIN ] GS: Loaded 38263 primary data records. [2025-09-15T21:16:20.029846] [DEBUG] [MAIN ] GRX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:20.031727] [INFO ] [MAIN ] GRX: Generated 1326 derivative records from 3278 primary records. [2025-09-15T21:16:20.031932] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-15T21:16:20.045439] [DEBUG] [LOCAL ] GRX: Derivative data saved (1326 records). [2025-09-15T21:16:20.045719] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-15T21:16:20.047923] [INFO ] [MAIN ] Derivative Progress: 808/2083 symbols completed. GRX took 1.0s. Estimated remaining: 7m 3s. Rate: 180.7 symbols/min [2025-09-15T21:16:20.065995] [DEBUG] [MAIN ] GSK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:20.066936] [INFO ] [MAIN ] GSK: Generated 1326 derivative records from 39497 primary records. [2025-09-15T21:16:20.076368] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-15T21:16:20.076984] [DEBUG] [MAIN ] GS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:20.078120] [INFO ] [MAIN ] GS: Generated 1326 derivative records from 38263 primary records. [2025-09-15T21:16:20.078423] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-15T21:16:20.099445] [DEBUG] [LOCAL ] GSK: Derivative data saved (1326 records). [2025-09-15T21:16:20.100363] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-15T21:16:20.104384] [INFO ] [MAIN ] Derivative Progress: 809/2083 symbols completed. GSK took 1.0s. Estimated remaining: 7m 3s. Rate: 180.9 symbols/min [2025-09-15T21:16:20.105172] [DEBUG] [LOCAL ] GS: Derivative data saved (1326 records). [2025-09-15T21:16:20.105389] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-15T21:16:20.107617] [INFO ] [MAIN ] Derivative Progress: 810/2083 symbols completed. GS took 1.0s. Estimated remaining: 7m 2s. Rate: 181.1 symbols/min [2025-09-15T21:16:20.108190] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:20.108077] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:20.108543] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:20.137452] [DEBUG] [LOCAL ] GSL: Loaded 24348 existing records from primary storage. [2025-09-15T21:16:20.137603] [INFO ] [MAIN ] GSL: Loaded 24348 primary data records. [2025-09-15T21:16:20.265351] [DEBUG] [LOCAL ] GTES: Loaded 37017 existing records from primary storage. [2025-09-15T21:16:20.268820] [INFO ] [MAIN ] GTES: Loaded 37017 primary data records. [2025-09-15T21:16:20.385961] [DEBUG] [LOCAL ] GTLS: Loaded 31961 existing records from primary storage. [2025-09-15T21:16:20.439231] [INFO ] [MAIN ] GTLS: Loaded 31961 primary data records. [2025-09-15T21:16:21.034246] [DEBUG] [MAIN ] GSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:21.035366] [INFO ] [MAIN ] GSL: Generated 1326 derivative records from 24348 primary records. [2025-09-15T21:16:21.035458] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-15T21:16:21.058260] [DEBUG] [LOCAL ] GSL: Derivative data saved (1326 records). [2025-09-15T21:16:21.062380] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-15T21:16:21.062623] [DEBUG] [MAIN ] GTES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:21.064412] [INFO ] [MAIN ] Derivative Progress: 811/2083 symbols completed. GSL took 1.0s. Estimated remaining: 7m 2s. Rate: 180.7 symbols/min [2025-09-15T21:16:21.065191] [INFO ] [MAIN ] GTES: Generated 1326 derivative records from 37017 primary records. [2025-09-15T21:16:21.065632] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-15T21:16:21.065848] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:21.081164] [DEBUG] [LOCAL ] GTES: Derivative data saved (1326 records). [2025-09-15T21:16:21.081472] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-15T21:16:21.084662] [INFO ] [MAIN ] Derivative Progress: 812/2083 symbols completed. GTES took 1.0s. Estimated remaining: 7m 2s. Rate: 180.9 symbols/min [2025-09-15T21:16:21.085147] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:21.095357] [DEBUG] [MAIN ] GTLS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:21.096629] [INFO ] [MAIN ] GTLS: Generated 1326 derivative records from 31961 primary records. [2025-09-15T21:16:21.097478] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-15T21:16:21.120972] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1326 records). [2025-09-15T21:16:21.121134] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-15T21:16:21.123145] [INFO ] [MAIN ] Derivative Progress: 813/2083 symbols completed. GTLS took 1.0s. Estimated remaining: 7m 1s. Rate: 181.1 symbols/min [2025-09-15T21:16:21.123667] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:21.146934] [DEBUG] [LOCAL ] GTN: Loaded 33382 existing records from primary storage. [2025-09-15T21:16:21.147905] [INFO ] [MAIN ] GTN: Loaded 33382 primary data records. [2025-09-15T21:16:21.148353] [DEBUG] [LOCAL ] GTY: Loaded 21698 existing records from primary storage. [2025-09-15T21:16:21.160453] [INFO ] [MAIN ] GTY: Loaded 21698 primary data records. [2025-09-15T21:16:21.335848] [DEBUG] [LOCAL ] GUG: Loaded 8754 existing records from primary storage. [2025-09-15T21:16:21.363199] [INFO ] [MAIN ] GUG: Loaded 8754 primary data records. [2025-09-15T21:16:22.033482] [DEBUG] [MAIN ] GTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:22.035695] [INFO ] [MAIN ] GTY: Generated 1326 derivative records from 21698 primary records. [2025-09-15T21:16:22.045398] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-15T21:16:22.045989] [DEBUG] [MAIN ] GTN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:22.056091] [INFO ] [MAIN ] GTN: Generated 1326 derivative records from 33382 primary records. [2025-09-15T21:16:22.061938] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-15T21:16:22.062856] [DEBUG] [MAIN ] GUG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:22.066407] [INFO ] [MAIN ] GUG: Generated 1326 derivative records from 8754 primary records. [2025-09-15T21:16:22.066848] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-15T21:16:22.074331] [DEBUG] [LOCAL ] GTY: Derivative data saved (1326 records). [2025-09-15T21:16:22.074972] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-15T21:16:22.076986] [INFO ] [MAIN ] Derivative Progress: 814/2083 symbols completed. GTY took 1.0s. Estimated remaining: 7m 1s. Rate: 180.7 symbols/min [2025-09-15T21:16:22.079251] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:22.093424] [DEBUG] [LOCAL ] GUG: Derivative data saved (1326 records). [2025-09-15T21:16:22.094433] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-15T21:16:22.094527] [DEBUG] [LOCAL ] GTN: Derivative data saved (1326 records). [2025-09-15T21:16:22.094626] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-15T21:16:22.096654] [INFO ] [MAIN ] Derivative Progress: 815/2083 symbols completed. GUG took 1.0s. Estimated remaining: 7m 1s. Rate: 180.9 symbols/min [2025-09-15T21:16:22.100065] [INFO ] [MAIN ] Derivative Progress: 816/2083 symbols completed. GTN took 1.0s. Estimated remaining: 6m 60s. Rate: 181.1 symbols/min [2025-09-15T21:16:22.100011] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:22.105321] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:22.111662] [DEBUG] [LOCAL ] GUT: Loaded 11442 existing records from primary storage. [2025-09-15T21:16:22.111837] [INFO ] [MAIN ] GUT: Loaded 11442 primary data records. [2025-09-15T21:16:22.227233] [DEBUG] [LOCAL ] GWH: Loaded 12801 existing records from primary storage. [2025-09-15T21:16:22.243405] [INFO ] [MAIN ] GWH: Loaded 12801 primary data records. [2025-09-15T21:16:22.384742] [DEBUG] [LOCAL ] GVA: Loaded 23856 existing records from primary storage. [2025-09-15T21:16:22.397127] [INFO ] [MAIN ] GVA: Loaded 23856 primary data records. [2025-09-15T21:16:22.955822] [DEBUG] [MAIN ] GUT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:22.957596] [INFO ] [MAIN ] GUT: Generated 1326 derivative records from 11442 primary records. [2025-09-15T21:16:22.957869] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-15T21:16:22.970620] [DEBUG] [LOCAL ] GUT: Derivative data saved (1326 records). [2025-09-15T21:16:22.970816] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-15T21:16:22.972468] [INFO ] [MAIN ] Derivative Progress: 817/2083 symbols completed. GUT took 0.9s. Estimated remaining: 7m 0s. Rate: 180.7 symbols/min [2025-09-15T21:16:22.973010] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:22.987745] [DEBUG] [MAIN ] GWH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:22.989261] [INFO ] [MAIN ] GWH: Generated 1326 derivative records from 12801 primary records. [2025-09-15T21:16:22.989446] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-15T21:16:23.005409] [DEBUG] [MAIN ] GVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:23.010421] [INFO ] [MAIN ] GVA: Generated 1326 derivative records from 23856 primary records. [2025-09-15T21:16:23.012302] [DEBUG] [LOCAL ] GWH: Derivative data saved (1326 records). [2025-09-15T21:16:23.012390] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-15T21:16:23.012531] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-15T21:16:23.015970] [INFO ] [MAIN ] Derivative Progress: 818/2083 symbols completed. GWH took 0.9s. Estimated remaining: 6m 60s. Rate: 180.9 symbols/min [2025-09-15T21:16:23.016461] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:23.035836] [DEBUG] [LOCAL ] GVA: Derivative data saved (1326 records). [2025-09-15T21:16:23.036003] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-15T21:16:23.037919] [INFO ] [MAIN ] Derivative Progress: 819/2083 symbols completed. GVA took 0.9s. Estimated remaining: 6m 59s. Rate: 181.1 symbols/min [2025-09-15T21:16:23.038276] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:23.049549] [DEBUG] [LOCAL ] GWRE: Loaded 29708 existing records from primary storage. [2025-09-15T21:16:23.052828] [INFO ] [MAIN ] GWRE: Loaded 29708 primary data records. [2025-09-15T21:16:23.167588] [DEBUG] [LOCAL ] GWW: Loaded 13875 existing records from primary storage. [2025-09-15T21:16:23.167848] [INFO ] [MAIN ] GWW: Loaded 13875 primary data records. [2025-09-15T21:16:23.359949] [DEBUG] [LOCAL ] GXO: Loaded 34160 existing records from primary storage. [2025-09-15T21:16:23.444500] [INFO ] [MAIN ] GXO: Loaded 34160 primary data records. [2025-09-15T21:16:23.941493] [DEBUG] [MAIN ] GWRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:23.942621] [INFO ] [MAIN ] GWRE: Generated 1326 derivative records from 29708 primary records. [2025-09-15T21:16:23.942835] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-15T21:16:23.953407] [DEBUG] [MAIN ] GWW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:23.960200] [INFO ] [MAIN ] GWW: Generated 1326 derivative records from 13875 primary records. [2025-09-15T21:16:23.963097] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-15T21:16:23.967207] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1326 records). [2025-09-15T21:16:23.974580] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-15T21:16:23.976325] [INFO ] [MAIN ] Derivative Progress: 820/2083 symbols completed. GWRE took 1.0s. Estimated remaining: 6m 59s. Rate: 180.7 symbols/min [2025-09-15T21:16:23.982952] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:23.991476] [DEBUG] [MAIN ] GXO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:23.992345] [INFO ] [MAIN ] GXO: Generated 1326 derivative records from 34160 primary records. [2025-09-15T21:16:23.993215] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-15T21:16:23.994755] [DEBUG] [LOCAL ] GWW: Derivative data saved (1326 records). [2025-09-15T21:16:24.002541] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-15T21:16:24.001786] [DEBUG] [LOCAL ] GYLD: Loaded 1104 existing records from primary storage. [2025-09-15T21:16:24.004767] [INFO ] [MAIN ] Derivative Progress: 821/2083 symbols completed. GWW took 1.0s. Estimated remaining: 6m 58s. Rate: 180.9 symbols/min [2025-09-15T21:16:24.009623] [DEBUG] [LOCAL ] GXO: Derivative data saved (1326 records). [2025-09-15T21:16:24.009781] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:24.006905] [INFO ] [MAIN ] GYLD: Loaded 1104 primary data records. [2025-09-15T21:16:24.009910] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-15T21:16:24.011854] [INFO ] [MAIN ] Derivative Progress: 822/2083 symbols completed. GXO took 1.0s. Estimated remaining: 6m 58s. Rate: 181.1 symbols/min [2025-09-15T21:16:24.023281] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:24.311556] [DEBUG] [LOCAL ] HAE: Loaded 27848 existing records from primary storage. [2025-09-15T21:16:24.311837] [INFO ] [MAIN ] HAE: Loaded 27848 primary data records. [2025-09-15T21:16:24.425492] [DEBUG] [LOCAL ] H: Loaded 32936 existing records from primary storage. [2025-09-15T21:16:24.428978] [INFO ] [MAIN ] H: Loaded 32936 primary data records. [2025-09-15T21:16:24.908671] [DEBUG] [MAIN ] GYLD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:24.909941] [INFO ] [MAIN ] GYLD: Generated 1326 derivative records from 1104 primary records. [2025-09-15T21:16:24.910310] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-15T21:16:24.923993] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1326 records). [2025-09-15T21:16:24.924135] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-15T21:16:24.925969] [INFO ] [MAIN ] Derivative Progress: 823/2083 symbols completed. GYLD took 0.9s. Estimated remaining: 6m 58s. Rate: 180.8 symbols/min [2025-09-15T21:16:24.945356] [DEBUG] [MAIN ] HAE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:24.947520] [INFO ] [MAIN ] HAE: Generated 1326 derivative records from 27848 primary records. [2025-09-15T21:16:24.947712] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-15T21:16:24.972561] [DEBUG] [MAIN ] H: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:24.975411] [INFO ] [MAIN ] H: Generated 1326 derivative records from 32936 primary records. [2025-09-15T21:16:24.975682] [DEBUG] [LOCAL ] HAE: Derivative data saved (1326 records). [2025-09-15T21:16:24.975767] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-15T21:16:24.975841] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-15T21:16:24.978016] [INFO ] [MAIN ] Derivative Progress: 824/2083 symbols completed. HAE took 1.0s. Estimated remaining: 6m 57s. Rate: 180.9 symbols/min [2025-09-15T21:16:24.996040] [DEBUG] [LOCAL ] H: Derivative data saved (1326 records). [2025-09-15T21:16:24.996111] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-15T21:16:24.998401] [INFO ] [MAIN ] Derivative Progress: 825/2083 symbols completed. H took 1.0s. Estimated remaining: 6m 57s. Rate: 181.2 symbols/min [2025-09-15T21:16:24.999046] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:24.999448] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:24.999206] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:25.040846] [DEBUG] [LOCAL ] HAFN: Loaded 31519 existing records from primary storage. [2025-09-15T21:16:25.041050] [INFO ] [MAIN ] HAFN: Loaded 31519 primary data records. [2025-09-15T21:16:25.178659] [DEBUG] [LOCAL ] HASI: Loaded 35139 existing records from primary storage. [2025-09-15T21:16:25.200090] [DEBUG] [LOCAL ] HAL: Loaded 39678 existing records from primary storage. [2025-09-15T21:16:25.205370] [INFO ] [MAIN ] HASI: Loaded 35139 primary data records. [2025-09-15T21:16:25.205493] [INFO ] [MAIN ] HAL: Loaded 39678 primary data records. [2025-09-15T21:16:25.897500] [DEBUG] [MAIN ] HAFN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:25.898340] [INFO ] [MAIN ] HAFN: Generated 1326 derivative records from 31519 primary records. [2025-09-15T21:16:25.898666] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-15T21:16:25.914720] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1326 records). [2025-09-15T21:16:25.933822] [DEBUG] [MAIN ] HAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:25.930200] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-15T21:16:25.934823] [INFO ] [MAIN ] HAL: Generated 1326 derivative records from 39678 primary records. [2025-09-15T21:16:25.934211] [DEBUG] [MAIN ] HASI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:25.934935] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-15T21:16:25.936717] [INFO ] [MAIN ] Derivative Progress: 826/2083 symbols completed. HAFN took 0.9s. Estimated remaining: 6m 57s. Rate: 180.8 symbols/min [2025-09-15T21:16:25.936967] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:25.937980] [INFO ] [MAIN ] HASI: Generated 1326 derivative records from 35139 primary records. [2025-09-15T21:16:25.938523] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-15T21:16:25.960801] [DEBUG] [LOCAL ] HASI: Derivative data saved (1326 records). [2025-09-15T21:16:25.962697] [DEBUG] [LOCAL ] HAL: Derivative data saved (1326 records). [2025-09-15T21:16:25.962793] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-15T21:16:25.964736] [INFO ] [MAIN ] Derivative Progress: 827/2083 symbols completed. HASI took 1.0s. Estimated remaining: 6m 56s. Rate: 181.0 symbols/min [2025-09-15T21:16:25.962880] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-15T21:16:25.967214] [INFO ] [MAIN ] Derivative Progress: 828/2083 symbols completed. HAL took 1.0s. Estimated remaining: 6m 56s. Rate: 181.2 symbols/min [2025-09-15T21:16:25.964928] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:25.967820] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:26.001702] [DEBUG] [LOCAL ] HAYW: Loaded 35753 existing records from primary storage. [2025-09-15T21:16:26.010529] [INFO ] [MAIN ] HAYW: Loaded 35753 primary data records. [2025-09-15T21:16:26.163474] [DEBUG] [LOCAL ] HBM: Loaded 38996 existing records from primary storage. [2025-09-15T21:16:26.169567] [DEBUG] [LOCAL ] HBI: Loaded 39082 existing records from primary storage. [2025-09-15T21:16:26.169680] [INFO ] [MAIN ] HBM: Loaded 38996 primary data records. [2025-09-15T21:16:26.174857] [INFO ] [MAIN ] HBI: Loaded 39082 primary data records. [2025-09-15T21:16:26.946307] [DEBUG] [MAIN ] HAYW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:26.947233] [INFO ] [MAIN ] HAYW: Generated 1326 derivative records from 35753 primary records. [2025-09-15T21:16:26.947524] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-15T21:16:26.962839] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1326 records). [2025-09-15T21:16:26.965548] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-15T21:16:26.969075] [INFO ] [MAIN ] Derivative Progress: 829/2083 symbols completed. HAYW took 1.0s. Estimated remaining: 6m 56s. Rate: 180.7 symbols/min [2025-09-15T21:16:26.970080] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:26.981385] [DEBUG] [MAIN ] HBM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:26.992267] [INFO ] [MAIN ] HBM: Generated 1326 derivative records from 38996 primary records. [2025-09-15T21:16:26.992578] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-15T21:16:26.992945] [DEBUG] [MAIN ] HBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:26.994750] [INFO ] [MAIN ] HBI: Generated 1326 derivative records from 39082 primary records. [2025-09-15T21:16:27.001532] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-15T21:16:27.007663] [DEBUG] [LOCAL ] HBM: Derivative data saved (1326 records). [2025-09-15T21:16:27.008026] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-15T21:16:27.009902] [INFO ] [MAIN ] Derivative Progress: 830/2083 symbols completed. HBM took 1.0s. Estimated remaining: 6m 56s. Rate: 180.9 symbols/min [2025-09-15T21:16:27.015497] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:27.022511] [DEBUG] [LOCAL ] HBI: Derivative data saved (1326 records). [2025-09-15T21:16:27.022803] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-15T21:16:27.025502] [INFO ] [MAIN ] Derivative Progress: 831/2083 symbols completed. HBI took 1.1s. Estimated remaining: 6m 55s. Rate: 181.1 symbols/min [2025-09-15T21:16:27.025863] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:27.055992] [DEBUG] [LOCAL ] HCA: Loaded 34822 existing records from primary storage. [2025-09-15T21:16:27.056393] [INFO ] [MAIN ] HCA: Loaded 34822 primary data records. [2025-09-15T21:16:27.093856] [DEBUG] [LOCAL ] HCI: Loaded 10345 existing records from primary storage. [2025-09-15T21:16:27.141263] [INFO ] [MAIN ] HCI: Loaded 10345 primary data records. [2025-09-15T21:16:27.267777] [DEBUG] [LOCAL ] HCC: Loaded 33376 existing records from primary storage. [2025-09-15T21:16:27.285600] [INFO ] [MAIN ] HCC: Loaded 33376 primary data records. [2025-09-15T21:16:27.962283] [DEBUG] [MAIN ] HCA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:27.967106] [INFO ] [MAIN ] HCA: Generated 1326 derivative records from 34822 primary records. [2025-09-15T21:16:27.967206] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-15T21:16:27.979516] [DEBUG] [MAIN ] HCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:27.993349] [DEBUG] [LOCAL ] HCA: Derivative data saved (1326 records). [2025-09-15T21:16:27.990375] [INFO ] [MAIN ] HCI: Generated 1326 derivative records from 10345 primary records. [2025-09-15T21:16:27.993568] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-15T21:16:27.994734] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-15T21:16:27.996533] [INFO ] [MAIN ] Derivative Progress: 832/2083 symbols completed. HCA took 1.0s. Estimated remaining: 6m 55s. Rate: 180.7 symbols/min [2025-09-15T21:16:27.996753] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:28.012307] [DEBUG] [LOCAL ] HCI: Derivative data saved (1326 records). [2025-09-15T21:16:28.012682] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-15T21:16:28.015042] [INFO ] [MAIN ] Derivative Progress: 833/2083 symbols completed. HCI took 1.0s. Estimated remaining: 6m 55s. Rate: 180.9 symbols/min [2025-09-15T21:16:28.015354] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:28.026201] [DEBUG] [MAIN ] HCC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:28.027392] [INFO ] [MAIN ] HCC: Generated 1326 derivative records from 33376 primary records. [2025-09-15T21:16:28.027720] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-15T21:16:28.040419] [DEBUG] [LOCAL ] HCC: Derivative data saved (1326 records). [2025-09-15T21:16:28.040534] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-15T21:16:28.042581] [INFO ] [MAIN ] Derivative Progress: 834/2083 symbols completed. HCC took 1.0s. Estimated remaining: 6m 54s. Rate: 181.1 symbols/min [2025-09-15T21:16:28.042865] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:28.086430] [DEBUG] [LOCAL ] HD: Loaded 39510 existing records from primary storage. [2025-09-15T21:16:28.096502] [INFO ] [MAIN ] HD: Loaded 39510 primary data records. [2025-09-15T21:16:28.224166] [DEBUG] [LOCAL ] HDB: Loaded 38022 existing records from primary storage. [2025-09-15T21:16:28.230943] [INFO ] [MAIN ] HDB: Loaded 38022 primary data records. [2025-09-15T21:16:28.230830] [DEBUG] [LOCAL ] HE: Loaded 35907 existing records from primary storage. [2025-09-15T21:16:28.262391] [INFO ] [MAIN ] HE: Loaded 35907 primary data records. [2025-09-15T21:16:29.010593] [DEBUG] [MAIN ] HD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:29.011674] [INFO ] [MAIN ] HD: Generated 1326 derivative records from 39510 primary records. [2025-09-15T21:16:29.011970] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-15T21:16:29.026799] [DEBUG] [LOCAL ] HD: Derivative data saved (1326 records). [2025-09-15T21:16:29.037234] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-15T21:16:29.037961] [DEBUG] [MAIN ] HDB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:29.039977] [INFO ] [MAIN ] Derivative Progress: 835/2083 symbols completed. HD took 1.0s. Estimated remaining: 6m 54s. Rate: 180.7 symbols/min [2025-09-15T21:16:29.040494] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:29.042346] [INFO ] [MAIN ] HDB: Generated 1326 derivative records from 38022 primary records. [2025-09-15T21:16:29.043672] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-15T21:16:29.066260] [DEBUG] [MAIN ] HE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:29.068060] [INFO ] [MAIN ] HE: Generated 1326 derivative records from 35907 primary records. [2025-09-15T21:16:29.069473] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-15T21:16:29.072008] [DEBUG] [LOCAL ] HDB: Derivative data saved (1326 records). [2025-09-15T21:16:29.078499] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-15T21:16:29.082870] [INFO ] [MAIN ] Derivative Progress: 836/2083 symbols completed. HDB took 1.1s. Estimated remaining: 6m 54s. Rate: 180.9 symbols/min [2025-09-15T21:16:29.086234] [DEBUG] [LOCAL ] HE: Derivative data saved (1326 records). [2025-09-15T21:16:29.084809] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:29.086409] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-15T21:16:29.088929] [INFO ] [MAIN ] Derivative Progress: 837/2083 symbols completed. HE took 1.0s. Estimated remaining: 6m 53s. Rate: 181.1 symbols/min [2025-09-15T21:16:29.089317] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:29.102579] [DEBUG] [LOCAL ] HEQ: Loaded 4271 existing records from primary storage. [2025-09-15T21:16:29.102841] [INFO ] [MAIN ] HEQ: Loaded 4271 primary data records. [2025-09-15T21:16:29.183423] [DEBUG] [LOCAL ] HEI: Loaded 23374 existing records from primary storage. [2025-09-15T21:16:29.194222] [INFO ] [MAIN ] HEI: Loaded 23374 primary data records. [2025-09-15T21:16:29.433721] [DEBUG] [LOCAL ] HESM: Loaded 35628 existing records from primary storage. [2025-09-15T21:16:29.448503] [INFO ] [MAIN ] HESM: Loaded 35628 primary data records. [2025-09-15T21:16:30.003782] [DEBUG] [MAIN ] HEQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:30.005961] [INFO ] [MAIN ] HEQ: Generated 1326 derivative records from 4271 primary records. [2025-09-15T21:16:30.006702] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-15T21:16:30.027663] [DEBUG] [MAIN ] HEI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:30.027405] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1326 records). [2025-09-15T21:16:30.027773] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-15T21:16:30.029288] [INFO ] [MAIN ] Derivative Progress: 838/2083 symbols completed. HEQ took 0.9s. Estimated remaining: 6m 53s. Rate: 180.7 symbols/min [2025-09-15T21:16:30.030128] [INFO ] [MAIN ] HEI: Generated 1326 derivative records from 23374 primary records. [2025-09-15T21:16:30.030216] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-15T21:16:30.055056] [DEBUG] [LOCAL ] HEI: Derivative data saved (1326 records). [2025-09-15T21:16:30.055424] [DEBUG] [MAIN ] HESM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:30.055593] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-15T21:16:30.057732] [INFO ] [MAIN ] Derivative Progress: 839/2083 symbols completed. HEI took 1.0s. Estimated remaining: 6m 53s. Rate: 180.9 symbols/min [2025-09-15T21:16:30.058446] [INFO ] [MAIN ] HESM: Generated 1326 derivative records from 35628 primary records. [2025-09-15T21:16:30.058553] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-15T21:16:30.070204] [DEBUG] [LOCAL ] HESM: Derivative data saved (1326 records). [2025-09-15T21:16:30.070265] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-15T21:16:30.072317] [INFO ] [MAIN ] Derivative Progress: 840/2083 symbols completed. HESM took 1.0s. Estimated remaining: 6m 52s. Rate: 181.1 symbols/min [2025-09-15T21:16:30.072713] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:30.072972] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:30.073121] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:30.088414] [DEBUG] [LOCAL ] HGLB: Loaded 6515 existing records from primary storage. [2025-09-15T21:16:30.088826] [INFO ] [MAIN ] HGLB: Loaded 6515 primary data records. [2025-09-15T21:16:30.138176] [DEBUG] [LOCAL ] HFRO: Loaded 11867 existing records from primary storage. [2025-09-15T21:16:30.145451] [DEBUG] [LOCAL ] HGER: Loaded 9870 existing records from primary storage. [2025-09-15T21:16:30.150903] [INFO ] [MAIN ] HFRO: Loaded 11867 primary data records. [2025-09-15T21:16:30.158144] [INFO ] [MAIN ] HGER: Loaded 9870 primary data records. [2025-09-15T21:16:30.964353] [DEBUG] [MAIN ] HGLB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:30.965198] [INFO ] [MAIN ] HGLB: Generated 1326 derivative records from 6515 primary records. [2025-09-15T21:16:30.965525] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-15T21:16:30.980719] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1326 records). [2025-09-15T21:16:30.980947] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-15T21:16:30.988160] [INFO ] [MAIN ] Derivative Progress: 841/2083 symbols completed. HGLB took 0.9s. Estimated remaining: 6m 52s. Rate: 180.7 symbols/min [2025-09-15T21:16:31.001093] [DEBUG] [MAIN ] HFRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:31.001843] [INFO ] [MAIN ] HFRO: Generated 1326 derivative records from 11867 primary records. [2025-09-15T21:16:31.002321] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-15T21:16:31.002283] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.002082] [DEBUG] [MAIN ] HGER: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:31.003429] [INFO ] [MAIN ] HGER: Generated 1326 derivative records from 9870 primary records. [2025-09-15T21:16:31.003920] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-15T21:16:31.029188] [DEBUG] [LOCAL ] HGER: Derivative data saved (1326 records). [2025-09-15T21:16:31.028814] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1326 records). [2025-09-15T21:16:31.029390] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-15T21:16:31.029356] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-15T21:16:31.031549] [INFO ] [MAIN ] Derivative Progress: 842/2083 symbols completed. HGER took 1.0s. Estimated remaining: 6m 52s. Rate: 180.9 symbols/min [2025-09-15T21:16:31.033792] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.033833] [INFO ] [MAIN ] Derivative Progress: 843/2083 symbols completed. HFRO took 1.0s. Estimated remaining: 6m 51s. Rate: 181.1 symbols/min [2025-09-15T21:16:31.034056] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.039033] [DEBUG] [LOCAL ] HGTY: Loaded 9760 existing records from primary storage. [2025-09-15T21:16:31.039209] [INFO ] [MAIN ] HGTY: Loaded 9760 primary data records. [2025-09-15T21:16:31.343401] [DEBUG] [LOCAL ] HHH: Loaded 25501 existing records from primary storage. [2025-09-15T21:16:31.343599] [INFO ] [MAIN ] HHH: Loaded 25501 primary data records. [2025-09-15T21:16:31.344095] [DEBUG] [LOCAL ] HGV: Loaded 34755 existing records from primary storage. [2025-09-15T21:16:31.355941] [INFO ] [MAIN ] HGV: Loaded 34755 primary data records. [2025-09-15T21:16:31.899892] [DEBUG] [MAIN ] HGTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:31.901626] [INFO ] [MAIN ] HGTY: Generated 1326 derivative records from 9760 primary records. [2025-09-15T21:16:31.901869] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-15T21:16:31.916452] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1326 records). [2025-09-15T21:16:31.917499] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-15T21:16:31.920118] [INFO ] [MAIN ] Derivative Progress: 844/2083 symbols completed. HGTY took 0.9s. Estimated remaining: 6m 51s. Rate: 180.7 symbols/min [2025-09-15T21:16:31.920541] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.933349] [DEBUG] [MAIN ] HHH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:31.934028] [INFO ] [MAIN ] HHH: Generated 1326 derivative records from 25501 primary records. [2025-09-15T21:16:31.934211] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-15T21:16:31.949144] [DEBUG] [LOCAL ] HHH: Derivative data saved (1326 records). [2025-09-15T21:16:31.949301] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-15T21:16:31.951102] [INFO ] [MAIN ] Derivative Progress: 845/2083 symbols completed. HHH took 0.9s. Estimated remaining: 6m 51s. Rate: 180.9 symbols/min [2025-09-15T21:16:31.951404] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.962067] [DEBUG] [MAIN ] HGV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:31.962828] [INFO ] [MAIN ] HGV: Generated 1326 derivative records from 34755 primary records. [2025-09-15T21:16:31.970360] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-15T21:16:31.984514] [DEBUG] [LOCAL ] HGV: Derivative data saved (1326 records). [2025-09-15T21:16:31.984808] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-15T21:16:31.994236] [INFO ] [MAIN ] Derivative Progress: 846/2083 symbols completed. HGV took 1.0s. Estimated remaining: 6m 50s. Rate: 181.1 symbols/min [2025-09-15T21:16:31.995582] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:31.997089] [DEBUG] [LOCAL ] HI: Loaded 25684 existing records from primary storage. [2025-09-15T21:16:31.997301] [INFO ] [MAIN ] HI: Loaded 25684 primary data records. [2025-09-15T21:16:32.164285] [DEBUG] [LOCAL ] HIG: Loaded 37942 existing records from primary storage. [2025-09-15T21:16:32.185684] [INFO ] [MAIN ] HIG: Loaded 37942 primary data records. [2025-09-15T21:16:32.219478] [DEBUG] [LOCAL ] HII: Loaded 24141 existing records from primary storage. [2025-09-15T21:16:32.256552] [INFO ] [MAIN ] HII: Loaded 24141 primary data records. [2025-09-15T21:16:32.853972] [DEBUG] [MAIN ] HI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:32.855209] [INFO ] [MAIN ] HI: Generated 1326 derivative records from 25684 primary records. [2025-09-15T21:16:32.855420] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-15T21:16:32.879445] [DEBUG] [LOCAL ] HI: Derivative data saved (1326 records). [2025-09-15T21:16:32.879936] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-15T21:16:32.879757] [DEBUG] [MAIN ] HIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:32.881578] [INFO ] [MAIN ] Derivative Progress: 847/2083 symbols completed. HI took 1.0s. Estimated remaining: 6m 50s. Rate: 180.8 symbols/min [2025-09-15T21:16:32.882271] [INFO ] [MAIN ] HIG: Generated 1326 derivative records from 37942 primary records. [2025-09-15T21:16:32.882875] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-15T21:16:32.882494] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:32.896165] [DEBUG] [LOCAL ] HIG: Derivative data saved (1326 records). [2025-09-15T21:16:32.896272] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-15T21:16:32.900333] [INFO ] [MAIN ] Derivative Progress: 848/2083 symbols completed. HIG took 0.9s. Estimated remaining: 6m 49s. Rate: 181.0 symbols/min [2025-09-15T21:16:32.900956] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:32.912858] [DEBUG] [MAIN ] HII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:32.913716] [INFO ] [MAIN ] HII: Generated 1326 derivative records from 24141 primary records. [2025-09-15T21:16:32.913852] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-15T21:16:32.937986] [DEBUG] [LOCAL ] HII: Derivative data saved (1326 records). [2025-09-15T21:16:32.938395] [DEBUG] [LOCAL ] HIO: Loaded 15857 existing records from primary storage. [2025-09-15T21:16:32.938448] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-15T21:16:32.938607] [INFO ] [MAIN ] HIO: Loaded 15857 primary data records. [2025-09-15T21:16:32.941061] [INFO ] [MAIN ] Derivative Progress: 849/2083 symbols completed. HII took 0.9s. Estimated remaining: 6m 49s. Rate: 181.2 symbols/min [2025-09-15T21:16:32.953219] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:33.152116] [DEBUG] [LOCAL ] HIPO: Loaded 16581 existing records from primary storage. [2025-09-15T21:16:33.213093] [DEBUG] [LOCAL ] HIMS: Loaded 39777 existing records from primary storage. [2025-09-15T21:16:33.250961] [INFO ] [MAIN ] HIMS: Loaded 39777 primary data records. [2025-09-15T21:16:33.212067] [INFO ] [MAIN ] HIPO: Loaded 16581 primary data records. [2025-09-15T21:16:33.820335] [DEBUG] [MAIN ] HIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:33.821267] [INFO ] [MAIN ] HIO: Generated 1326 derivative records from 15857 primary records. [2025-09-15T21:16:33.821975] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-15T21:16:33.839018] [DEBUG] [LOCAL ] HIO: Derivative data saved (1326 records). [2025-09-15T21:16:33.839164] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-15T21:16:33.840931] [INFO ] [MAIN ] Derivative Progress: 850/2083 symbols completed. HIO took 0.9s. Estimated remaining: 6m 49s. Rate: 180.8 symbols/min [2025-09-15T21:16:33.841602] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:33.863364] [DEBUG] [MAIN ] HIPO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:33.867857] [INFO ] [MAIN ] HIPO: Generated 1326 derivative records from 16581 primary records. [2025-09-15T21:16:33.868392] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-15T21:16:33.868316] [DEBUG] [MAIN ] HIMS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:33.869917] [INFO ] [MAIN ] HIMS: Generated 1326 derivative records from 39777 primary records. [2025-09-15T21:16:33.870264] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-15T21:16:33.888407] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1326 records). [2025-09-15T21:16:33.899379] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-15T21:16:33.904624] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1326 records). [2025-09-15T21:16:33.902989] [INFO ] [MAIN ] Derivative Progress: 851/2083 symbols completed. HIPO took 1.0s. Estimated remaining: 6m 48s. Rate: 181.0 symbols/min [2025-09-15T21:16:33.905019] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:33.904851] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-15T21:16:33.908127] [INFO ] [MAIN ] Derivative Progress: 852/2083 symbols completed. HIMS took 1.0s. Estimated remaining: 6m 48s. Rate: 181.2 symbols/min [2025-09-15T21:16:33.908782] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:33.921672] [DEBUG] [LOCAL ] HIW: Loaded 32873 existing records from primary storage. [2025-09-15T21:16:33.921837] [INFO ] [MAIN ] HIW: Loaded 32873 primary data records. [2025-09-15T21:16:34.037424] [DEBUG] [LOCAL ] HKD: Loaded 13415 existing records from primary storage. [2025-09-15T21:16:34.058566] [INFO ] [MAIN ] HKD: Loaded 13415 primary data records. [2025-09-15T21:16:34.103532] [DEBUG] [LOCAL ] HIX: Loaded 14901 existing records from primary storage. [2025-09-15T21:16:34.155291] [INFO ] [MAIN ] HIX: Loaded 14901 primary data records. [2025-09-15T21:16:34.755258] [DEBUG] [MAIN ] HIW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:34.756121] [INFO ] [MAIN ] HIW: Generated 1326 derivative records from 32873 primary records. [2025-09-15T21:16:34.756346] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-15T21:16:34.776100] [DEBUG] [MAIN ] HKD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:34.781171] [INFO ] [MAIN ] HKD: Generated 1326 derivative records from 13415 primary records. [2025-09-15T21:16:34.781289] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-15T21:16:34.780413] [DEBUG] [LOCAL ] HIW: Derivative data saved (1326 records). [2025-09-15T21:16:34.781427] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-15T21:16:34.783689] [INFO ] [MAIN ] Derivative Progress: 853/2083 symbols completed. HIW took 0.9s. Estimated remaining: 6m 48s. Rate: 180.8 symbols/min [2025-09-15T21:16:34.803348] [DEBUG] [MAIN ] HIX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:34.804367] [INFO ] [MAIN ] HIX: Generated 1326 derivative records from 14901 primary records. [2025-09-15T21:16:34.804794] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-15T21:16:34.805964] [DEBUG] [LOCAL ] HKD: Derivative data saved (1326 records). [2025-09-15T21:16:34.806029] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-15T21:16:34.808144] [INFO ] [MAIN ] Derivative Progress: 854/2083 symbols completed. HKD took 0.9s. Estimated remaining: 6m 47s. Rate: 181.0 symbols/min [2025-09-15T21:16:34.818594] [DEBUG] [LOCAL ] HIX: Derivative data saved (1326 records). [2025-09-15T21:16:34.818667] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-15T21:16:34.820544] [INFO ] [MAIN ] Derivative Progress: 855/2083 symbols completed. HIX took 0.9s. Estimated remaining: 6m 47s. Rate: 181.2 symbols/min [2025-09-15T21:16:34.821126] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:34.820993] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:34.822727] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:34.867208] [DEBUG] [LOCAL ] HLI: Loaded 22468 existing records from primary storage. [2025-09-15T21:16:34.877954] [INFO ] [MAIN ] HLI: Loaded 22468 primary data records. [2025-09-15T21:16:34.914169] [DEBUG] [LOCAL ] HLF: Loaded 36076 existing records from primary storage. [2025-09-15T21:16:34.947857] [INFO ] [MAIN ] HLF: Loaded 36076 primary data records. [2025-09-15T21:16:34.963282] [DEBUG] [LOCAL ] HL: Loaded 39637 existing records from primary storage. [2025-09-15T21:16:34.991354] [INFO ] [MAIN ] HL: Loaded 39637 primary data records. [2025-09-15T21:16:35.752012] [DEBUG] [MAIN ] HLI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:35.752966] [INFO ] [MAIN ] HLI: Generated 1326 derivative records from 22468 primary records. [2025-09-15T21:16:35.753282] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-15T21:16:35.770202] [DEBUG] [LOCAL ] HLI: Derivative data saved (1326 records). [2025-09-15T21:16:35.770459] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-15T21:16:35.772015] [INFO ] [MAIN ] Derivative Progress: 856/2083 symbols completed. HLI took 1.0s. Estimated remaining: 6m 47s. Rate: 180.8 symbols/min [2025-09-15T21:16:35.791632] [DEBUG] [MAIN ] HL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:35.790895] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:35.791316] [DEBUG] [MAIN ] HLF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:35.792439] [INFO ] [MAIN ] HLF: Generated 1326 derivative records from 36076 primary records. [2025-09-15T21:16:35.792958] [INFO ] [MAIN ] HL: Generated 1326 derivative records from 39637 primary records. [2025-09-15T21:16:35.793312] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-15T21:16:35.793892] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-15T21:16:35.814919] [DEBUG] [LOCAL ] HLF: Derivative data saved (1326 records). [2025-09-15T21:16:35.815618] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-15T21:16:35.818358] [INFO ] [MAIN ] Derivative Progress: 857/2083 symbols completed. HLF took 1.0s. Estimated remaining: 6m 46s. Rate: 181.0 symbols/min [2025-09-15T21:16:35.818894] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:35.821410] [DEBUG] [LOCAL ] HL: Derivative data saved (1326 records). [2025-09-15T21:16:35.826417] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-15T21:16:35.828430] [INFO ] [MAIN ] Derivative Progress: 858/2083 symbols completed. HL took 1.0s. Estimated remaining: 6m 46s. Rate: 181.2 symbols/min [2025-09-15T21:16:35.828742] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:35.839552] [DEBUG] [LOCAL ] HLIO: Loaded 21669 existing records from primary storage. [2025-09-15T21:16:35.839704] [INFO ] [MAIN ] HLIO: Loaded 21669 primary data records. [2025-09-15T21:16:36.011052] [DEBUG] [LOCAL ] HLLY: Loaded 24451 existing records from primary storage. [2025-09-15T21:16:36.035137] [INFO ] [MAIN ] HLLY: Loaded 24451 primary data records. [2025-09-15T21:16:36.234059] [DEBUG] [LOCAL ] HLN: Loaded 39179 existing records from primary storage. [2025-09-15T21:16:36.240128] [INFO ] [MAIN ] HLN: Loaded 39179 primary data records. [2025-09-15T21:16:36.680797] [DEBUG] [MAIN ] HLIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:36.681921] [INFO ] [MAIN ] HLIO: Generated 1326 derivative records from 21669 primary records. [2025-09-15T21:16:36.682263] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-15T21:16:36.698934] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1326 records). [2025-09-15T21:16:36.699092] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-15T21:16:36.701122] [INFO ] [MAIN ] Derivative Progress: 859/2083 symbols completed. HLIO took 0.9s. Estimated remaining: 6m 46s. Rate: 180.9 symbols/min [2025-09-15T21:16:36.701438] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:36.711586] [DEBUG] [MAIN ] HLLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:36.712444] [INFO ] [MAIN ] HLLY: Generated 1326 derivative records from 24451 primary records. [2025-09-15T21:16:36.712736] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-15T21:16:36.726321] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1326 records). [2025-09-15T21:16:36.726521] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-15T21:16:36.728060] [INFO ] [MAIN ] Derivative Progress: 860/2083 symbols completed. HLLY took 0.9s. Estimated remaining: 6m 45s. Rate: 181.1 symbols/min [2025-09-15T21:16:36.728306] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:36.738081] [DEBUG] [MAIN ] HLN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:36.739023] [INFO ] [MAIN ] HLN: Generated 1326 derivative records from 39179 primary records. [2025-09-15T21:16:36.739133] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-15T21:16:36.756240] [DEBUG] [LOCAL ] HLN: Derivative data saved (1326 records). [2025-09-15T21:16:36.756337] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-15T21:16:36.758174] [INFO ] [MAIN ] Derivative Progress: 861/2083 symbols completed. HLN took 0.9s. Estimated remaining: 6m 45s. Rate: 181.3 symbols/min [2025-09-15T21:16:36.768118] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:36.801851] [DEBUG] [LOCAL ] HLT: Loaded 37122 existing records from primary storage. [2025-09-15T21:16:36.802595] [INFO ] [MAIN ] HLT: Loaded 37122 primary data records. [2025-09-15T21:16:36.802514] [DEBUG] [LOCAL ] HLX: Loaded 35148 existing records from primary storage. [2025-09-15T21:16:36.823385] [INFO ] [MAIN ] HLX: Loaded 35148 primary data records. [2025-09-15T21:16:37.114308] [DEBUG] [LOCAL ] HMC: Loaded 33997 existing records from primary storage. [2025-09-15T21:16:37.247748] [INFO ] [MAIN ] HMC: Loaded 33997 primary data records. [2025-09-15T21:16:37.670968] [DEBUG] [MAIN ] HLT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:37.671586] [DEBUG] [MAIN ] HLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:37.673201] [INFO ] [MAIN ] HLX: Generated 1326 derivative records from 35148 primary records. [2025-09-15T21:16:37.672192] [INFO ] [MAIN ] HLT: Generated 1326 derivative records from 37122 primary records. [2025-09-15T21:16:37.673453] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-15T21:16:37.673823] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-15T21:16:37.694817] [DEBUG] [LOCAL ] HLX: Derivative data saved (1326 records). [2025-09-15T21:16:37.696918] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-15T21:16:37.699181] [INFO ] [MAIN ] Derivative Progress: 862/2083 symbols completed. HLX took 1.0s. Estimated remaining: 6m 45s. Rate: 180.9 symbols/min [2025-09-15T21:16:37.697190] [DEBUG] [LOCAL ] HLT: Derivative data saved (1326 records). [2025-09-15T21:16:37.699589] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:37.699697] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-15T21:16:37.701518] [INFO ] [MAIN ] Derivative Progress: 863/2083 symbols completed. HLT took 1.0s. Estimated remaining: 6m 44s. Rate: 181.1 symbols/min [2025-09-15T21:16:37.703044] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:37.715145] [DEBUG] [MAIN ] HMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:37.715970] [INFO ] [MAIN ] HMC: Generated 1326 derivative records from 33997 primary records. [2025-09-15T21:16:37.716070] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-15T21:16:37.738907] [DEBUG] [LOCAL ] HMN: Loaded 17769 existing records from primary storage. [2025-09-15T21:16:37.739543] [DEBUG] [LOCAL ] HMC: Derivative data saved (1326 records). [2025-09-15T21:16:37.739620] [INFO ] [MAIN ] HMN: Loaded 17769 primary data records. [2025-09-15T21:16:37.739786] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-15T21:16:37.773701] [INFO ] [MAIN ] Derivative Progress: 864/2083 symbols completed. HMC took 1.0s. Estimated remaining: 6m 44s. Rate: 181.2 symbols/min [2025-09-15T21:16:37.808072] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:38.027810] [DEBUG] [LOCAL ] HMY: Loaded 39146 existing records from primary storage. [2025-09-15T21:16:38.028132] [INFO ] [MAIN ] HMY: Loaded 39146 primary data records. [2025-09-15T21:16:38.185886] [DEBUG] [LOCAL ] HNI: Loaded 21203 existing records from primary storage. [2025-09-15T21:16:38.221880] [INFO ] [MAIN ] HNI: Loaded 21203 primary data records. [2025-09-15T21:16:38.583014] [DEBUG] [MAIN ] HMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:38.583854] [INFO ] [MAIN ] HMN: Generated 1326 derivative records from 17769 primary records. [2025-09-15T21:16:38.584790] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-15T21:16:38.600124] [DEBUG] [LOCAL ] HMN: Derivative data saved (1326 records). [2025-09-15T21:16:38.600304] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-15T21:16:38.601873] [INFO ] [MAIN ] Derivative Progress: 865/2083 symbols completed. HMN took 0.9s. Estimated remaining: 6m 44s. Rate: 180.9 symbols/min [2025-09-15T21:16:38.602196] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:38.614170] [DEBUG] [MAIN ] HMY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:38.614862] [INFO ] [MAIN ] HMY: Generated 1326 derivative records from 39146 primary records. [2025-09-15T21:16:38.615017] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-15T21:16:38.631196] [DEBUG] [LOCAL ] HMY: Derivative data saved (1326 records). [2025-09-15T21:16:38.640794] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-15T21:16:38.644418] [INFO ] [MAIN ] Derivative Progress: 866/2083 symbols completed. HMY took 0.9s. Estimated remaining: 6m 43s. Rate: 181.1 symbols/min [2025-09-15T21:16:38.644841] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:38.641269] [DEBUG] [MAIN ] HNI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:38.646124] [INFO ] [MAIN ] HNI: Generated 1326 derivative records from 21203 primary records. [2025-09-15T21:16:38.646313] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-15T21:16:38.667902] [DEBUG] [LOCAL ] HNI: Derivative data saved (1326 records). [2025-09-15T21:16:38.668083] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-15T21:16:38.670134] [INFO ] [MAIN ] Derivative Progress: 867/2083 symbols completed. HNI took 0.9s. Estimated remaining: 6m 42s. Rate: 181.3 symbols/min [2025-09-15T21:16:38.670473] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:38.685386] [DEBUG] [LOCAL ] HOG: Loaded 37469 existing records from primary storage. [2025-09-15T21:16:38.692930] [INFO ] [MAIN ] HOG: Loaded 37469 primary data records. [2025-09-15T21:16:38.828276] [DEBUG] [LOCAL ] HOMB: Loaded 31393 existing records from primary storage. [2025-09-15T21:16:38.863780] [INFO ] [MAIN ] HOMB: Loaded 31393 primary data records. [2025-09-15T21:16:38.967332] [DEBUG] [LOCAL ] HOUS: Loaded 32545 existing records from primary storage. [2025-09-15T21:16:39.058831] [INFO ] [MAIN ] HOUS: Loaded 32545 primary data records. [2025-09-15T21:16:39.550823] [DEBUG] [MAIN ] HOG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:39.552154] [INFO ] [MAIN ] HOG: Generated 1326 derivative records from 37469 primary records. [2025-09-15T21:16:39.552400] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-15T21:16:39.568182] [DEBUG] [LOCAL ] HOG: Derivative data saved (1326 records). [2025-09-15T21:16:39.568405] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-15T21:16:39.570747] [INFO ] [MAIN ] Derivative Progress: 868/2083 symbols completed. HOG took 1.0s. Estimated remaining: 6m 43s. Rate: 180.9 symbols/min [2025-09-15T21:16:39.581246] [DEBUG] [MAIN ] HOMB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:39.582034] [INFO ] [MAIN ] HOMB: Generated 1326 derivative records from 31393 primary records. [2025-09-15T21:16:39.582184] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-15T21:16:39.594679] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1326 records). [2025-09-15T21:16:39.594746] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-15T21:16:39.597088] [INFO ] [MAIN ] Derivative Progress: 869/2083 symbols completed. HOMB took 1.0s. Estimated remaining: 6m 42s. Rate: 181.1 symbols/min [2025-09-15T21:16:39.608540] [DEBUG] [MAIN ] HOUS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:39.609107] [INFO ] [MAIN ] HOUS: Generated 1326 derivative records from 32545 primary records. [2025-09-15T21:16:39.609168] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-15T21:16:39.620292] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1326 records). [2025-09-15T21:16:39.620350] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-15T21:16:39.622423] [INFO ] [MAIN ] Derivative Progress: 870/2083 symbols completed. HOUS took 1.0s. Estimated remaining: 6m 41s. Rate: 181.3 symbols/min [2025-09-15T21:16:39.622848] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:39.622967] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:39.623079] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:39.636683] [DEBUG] [LOCAL ] HOV: Loaded 10490 existing records from primary storage. [2025-09-15T21:16:39.636940] [INFO ] [MAIN ] HOV: Loaded 10490 primary data records. [2025-09-15T21:16:39.966585] [DEBUG] [LOCAL ] HP: Loaded 38311 existing records from primary storage. [2025-09-15T21:16:39.978675] [INFO ] [MAIN ] HP: Loaded 38311 primary data records. [2025-09-15T21:16:39.977972] [DEBUG] [LOCAL ] HPE: Loaded 39657 existing records from primary storage. [2025-09-15T21:16:39.999763] [INFO ] [MAIN ] HPE: Loaded 39657 primary data records. [2025-09-15T21:16:40.555195] [DEBUG] [MAIN ] HOV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:40.557221] [INFO ] [MAIN ] HOV: Generated 1326 derivative records from 10490 primary records. [2025-09-15T21:16:40.557720] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-15T21:16:40.580045] [DEBUG] [LOCAL ] HOV: Derivative data saved (1326 records). [2025-09-15T21:16:40.580549] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-15T21:16:40.582811] [INFO ] [MAIN ] Derivative Progress: 871/2083 symbols completed. HOV took 1.0s. Estimated remaining: 6m 42s. Rate: 180.9 symbols/min [2025-09-15T21:16:40.583720] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:40.621212] [DEBUG] [MAIN ] HP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:40.620769] [DEBUG] [LOCAL ] HPF: Loaded 5553 existing records from primary storage. [2025-09-15T21:16:40.625590] [DEBUG] [MAIN ] HPE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:40.625282] [INFO ] [MAIN ] HPF: Loaded 5553 primary data records. [2025-09-15T21:16:40.626250] [INFO ] [MAIN ] HP: Generated 1326 derivative records from 38311 primary records. [2025-09-15T21:16:40.637696] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-15T21:16:40.659466] [INFO ] [MAIN ] HPE: Generated 1326 derivative records from 39657 primary records. [2025-09-15T21:16:40.707864] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-15T21:16:40.779877] [DEBUG] [LOCAL ] HPE: Derivative data saved (1326 records). [2025-09-15T21:16:40.819470] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-15T21:16:40.863538] [INFO ] [MAIN ] Derivative Progress: 872/2083 symbols completed. HPE took 1.2s. Estimated remaining: 6m 42s. Rate: 181.0 symbols/min [2025-09-15T21:16:40.866196] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:40.866332] [DEBUG] [LOCAL ] HP: Derivative data saved (1326 records). [2025-09-15T21:16:40.992328] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-15T21:16:40.995836] [INFO ] [MAIN ] Derivative Progress: 873/2083 symbols completed. HP took 1.4s. Estimated remaining: 6m 41s. Rate: 181.1 symbols/min [2025-09-15T21:16:40.996903] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:41.011121] [DEBUG] [LOCAL ] HPI: Loaded 7603 existing records from primary storage. [2025-09-15T21:16:41.011946] [INFO ] [MAIN ] HPI: Loaded 7603 primary data records. [2025-09-15T21:16:41.234416] [DEBUG] [LOCAL ] HPQ: Loaded 39632 existing records from primary storage. [2025-09-15T21:16:41.259764] [INFO ] [MAIN ] HPQ: Loaded 39632 primary data records. [2025-09-15T21:16:41.300115] [DEBUG] [MAIN ] HPF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:41.301253] [INFO ] [MAIN ] HPF: Generated 1326 derivative records from 5553 primary records. [2025-09-15T21:16:41.356001] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-15T21:16:41.676740] [DEBUG] [LOCAL ] HPF: Derivative data saved (1326 records). [2025-09-15T21:16:41.687298] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-15T21:16:41.748254] [INFO ] [MAIN ] Derivative Progress: 874/2083 symbols completed. HPF took 1.2s. Estimated remaining: 6m 41s. Rate: 180.8 symbols/min [2025-09-15T21:16:41.844221] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:41.858144] [DEBUG] [LOCAL ] HPS: Loaded 7654 existing records from primary storage. [2025-09-15T21:16:41.858664] [INFO ] [MAIN ] HPS: Loaded 7654 primary data records. [2025-09-15T21:16:41.946041] [DEBUG] [MAIN ] HPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:41.966159] [INFO ] [MAIN ] HPI: Generated 1326 derivative records from 7603 primary records. [2025-09-15T21:16:41.978683] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-15T21:16:42.167616] [DEBUG] [LOCAL ] HPI: Derivative data saved (1326 records). [2025-09-15T21:16:42.168188] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-15T21:16:42.179197] [INFO ] [MAIN ] Derivative Progress: 875/2083 symbols completed. HPI took 1.3s. Estimated remaining: 6m 41s. Rate: 180.8 symbols/min [2025-09-15T21:16:42.180533] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:42.180863] [DEBUG] [MAIN ] HPQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:42.181946] [INFO ] [MAIN ] HPQ: Generated 1326 derivative records from 39632 primary records. [2025-09-15T21:16:42.183026] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-15T21:16:42.197573] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1326 records). [2025-09-15T21:16:42.197947] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-15T21:16:42.200116] [INFO ] [MAIN ] Derivative Progress: 876/2083 symbols completed. HPQ took 1.2s. Estimated remaining: 6m 40s. Rate: 181.0 symbols/min [2025-09-15T21:16:42.200553] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:42.228434] [DEBUG] [LOCAL ] HQL: Loaded 11683 existing records from primary storage. [2025-09-15T21:16:42.229420] [INFO ] [MAIN ] HQL: Loaded 11683 primary data records. [2025-09-15T21:16:42.229218] [DEBUG] [LOCAL ] HQH: Loaded 18689 existing records from primary storage. [2025-09-15T21:16:42.250478] [INFO ] [MAIN ] HQH: Loaded 18689 primary data records. [2025-09-15T21:16:42.337191] [DEBUG] [MAIN ] HPS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:42.365517] [INFO ] [MAIN ] HPS: Generated 1326 derivative records from 7654 primary records. [2025-09-15T21:16:42.410537] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-15T21:16:42.752366] [DEBUG] [LOCAL ] HPS: Derivative data saved (1326 records). [2025-09-15T21:16:42.752748] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-15T21:16:42.755300] [INFO ] [MAIN ] Derivative Progress: 877/2083 symbols completed. HPS took 0.9s. Estimated remaining: 6m 40s. Rate: 180.8 symbols/min [2025-09-15T21:16:42.837843] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:42.871832] [DEBUG] [MAIN ] HQL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:42.884832] [DEBUG] [MAIN ] HQH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:42.885604] [INFO ] [MAIN ] HQL: Generated 1326 derivative records from 11683 primary records. [2025-09-15T21:16:42.886502] [INFO ] [MAIN ] HQH: Generated 1326 derivative records from 18689 primary records. [2025-09-15T21:16:42.886631] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-15T21:16:42.886756] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-15T21:16:42.908146] [DEBUG] [LOCAL ] HQL: Derivative data saved (1326 records). [2025-09-15T21:16:42.920195] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-15T21:16:42.923221] [INFO ] [MAIN ] Derivative Progress: 878/2083 symbols completed. HQL took 0.7s. Estimated remaining: 6m 40s. Rate: 180.9 symbols/min [2025-09-15T21:16:42.923460] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:42.926143] [DEBUG] [LOCAL ] HR: Loaded 38391 existing records from primary storage. [2025-09-15T21:16:42.925122] [DEBUG] [LOCAL ] HQH: Derivative data saved (1326 records). [2025-09-15T21:16:42.926367] [INFO ] [MAIN ] HR: Loaded 38391 primary data records. [2025-09-15T21:16:42.926420] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-15T21:16:42.928290] [INFO ] [MAIN ] Derivative Progress: 879/2083 symbols completed. HQH took 0.7s. Estimated remaining: 6m 39s. Rate: 181.1 symbols/min [2025-09-15T21:16:42.964273] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:43.222694] [DEBUG] [LOCAL ] HRI: Loaded 23844 existing records from primary storage. [2025-09-15T21:16:43.223290] [DEBUG] [LOCAL ] HRB: Loaded 35716 existing records from primary storage. [2025-09-15T21:16:43.224320] [INFO ] [MAIN ] HRI: Loaded 23844 primary data records. [2025-09-15T21:16:43.224496] [INFO ] [MAIN ] HRB: Loaded 35716 primary data records. [2025-09-15T21:16:43.783492] [DEBUG] [MAIN ] HR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:43.785176] [INFO ] [MAIN ] HR: Generated 1326 derivative records from 38391 primary records. [2025-09-15T21:16:43.785720] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-15T21:16:43.802809] [DEBUG] [LOCAL ] HR: Derivative data saved (1326 records). [2025-09-15T21:16:43.803221] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-15T21:16:43.805890] [INFO ] [MAIN ] Derivative Progress: 880/2083 symbols completed. HR took 1.0s. Estimated remaining: 6m 39s. Rate: 180.8 symbols/min [2025-09-15T21:16:43.806203] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:43.829618] [DEBUG] [MAIN ] HRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:43.834489] [INFO ] [MAIN ] HRI: Generated 1326 derivative records from 23844 primary records. [2025-09-15T21:16:43.834670] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-15T21:16:43.833498] [DEBUG] [MAIN ] HRB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:43.836361] [INFO ] [MAIN ] HRB: Generated 1326 derivative records from 35716 primary records. [2025-09-15T21:16:43.836865] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-15T21:16:43.865949] [DEBUG] [LOCAL ] HRI: Derivative data saved (1326 records). [2025-09-15T21:16:43.869413] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-15T21:16:43.879687] [DEBUG] [LOCAL ] HRB: Derivative data saved (1326 records). [2025-09-15T21:16:43.881789] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-15T21:16:43.881688] [INFO ] [MAIN ] Derivative Progress: 881/2083 symbols completed. HRI took 0.9s. Estimated remaining: 6m 39s. Rate: 180.9 symbols/min [2025-09-15T21:16:43.882327] [DEBUG] [LOCAL ] HRTG: Loaded 25072 existing records from primary storage. [2025-09-15T21:16:43.885323] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:43.885184] [INFO ] [MAIN ] Derivative Progress: 882/2083 symbols completed. HRB took 1.0s. Estimated remaining: 6m 38s. Rate: 181.1 symbols/min [2025-09-15T21:16:43.885860] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:43.885682] [INFO ] [MAIN ] HRTG: Loaded 25072 primary data records. [2025-09-15T21:16:43.987574] [DEBUG] [LOCAL ] HSHP: Loaded 10106 existing records from primary storage. [2025-09-15T21:16:43.998335] [INFO ] [MAIN ] HSHP: Loaded 10106 primary data records. [2025-09-15T21:16:44.283391] [DEBUG] [LOCAL ] HSBC: Loaded 37442 existing records from primary storage. [2025-09-15T21:16:44.304418] [INFO ] [MAIN ] HSBC: Loaded 37442 primary data records. [2025-09-15T21:16:44.789363] [DEBUG] [MAIN ] HRTG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:44.790385] [INFO ] [MAIN ] HRTG: Generated 1326 derivative records from 25072 primary records. [2025-09-15T21:16:44.791419] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-15T21:16:44.813529] [DEBUG] [MAIN ] HSHP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:44.814944] [INFO ] [MAIN ] HSHP: Generated 1326 derivative records from 10106 primary records. [2025-09-15T21:16:44.816389] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-15T21:16:44.816963] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1326 records). [2025-09-15T21:16:44.817335] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-15T21:16:44.819161] [INFO ] [MAIN ] Derivative Progress: 883/2083 symbols completed. HRTG took 1.0s. Estimated remaining: 6m 38s. Rate: 180.8 symbols/min [2025-09-15T21:16:44.831764] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1326 records). [2025-09-15T21:16:44.831926] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-15T21:16:44.842392] [INFO ] [MAIN ] Derivative Progress: 884/2083 symbols completed. HSHP took 1.0s. Estimated remaining: 6m 38s. Rate: 181.0 symbols/min [2025-09-15T21:16:44.843034] [DEBUG] [MAIN ] HSBC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:44.843585] [INFO ] [MAIN ] HSBC: Generated 1326 derivative records from 37442 primary records. [2025-09-15T21:16:44.843673] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-15T21:16:44.855164] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1326 records). [2025-09-15T21:16:44.855222] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-15T21:16:44.857153] [INFO ] [MAIN ] Derivative Progress: 885/2083 symbols completed. HSBC took 1.0s. Estimated remaining: 6m 37s. Rate: 181.2 symbols/min [2025-09-15T21:16:44.857567] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:44.857829] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:44.857699] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:44.871247] [DEBUG] [LOCAL ] HTD: Loaded 9858 existing records from primary storage. [2025-09-15T21:16:44.871401] [INFO ] [MAIN ] HTD: Loaded 9858 primary data records. [2025-09-15T21:16:45.195939] [DEBUG] [LOCAL ] HSY: Loaded 37273 existing records from primary storage. [2025-09-15T21:16:45.184840] [DEBUG] [LOCAL ] HTGC: Loaded 34840 existing records from primary storage. [2025-09-15T21:16:45.196678] [INFO ] [MAIN ] HSY: Loaded 37273 primary data records. [2025-09-15T21:16:45.196788] [INFO ] [MAIN ] HTGC: Loaded 34840 primary data records. [2025-09-15T21:16:45.776092] [DEBUG] [MAIN ] HTD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:45.778720] [INFO ] [MAIN ] HTD: Generated 1326 derivative records from 9858 primary records. [2025-09-15T21:16:45.778939] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-15T21:16:45.794780] [DEBUG] [LOCAL ] HTD: Derivative data saved (1326 records). [2025-09-15T21:16:45.795038] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-15T21:16:45.798073] [INFO ] [MAIN ] Derivative Progress: 886/2083 symbols completed. HTD took 0.9s. Estimated remaining: 6m 37s. Rate: 180.8 symbols/min [2025-09-15T21:16:45.800757] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:45.812942] [DEBUG] [MAIN ] HSY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:45.813764] [INFO ] [MAIN ] HSY: Generated 1326 derivative records from 37273 primary records. [2025-09-15T21:16:45.822737] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-15T21:16:45.823658] [DEBUG] [MAIN ] HTGC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:45.824915] [INFO ] [MAIN ] HTGC: Generated 1326 derivative records from 34840 primary records. [2025-09-15T21:16:45.825260] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-15T21:16:45.854866] [DEBUG] [LOCAL ] HSY: Derivative data saved (1326 records). [2025-09-15T21:16:45.855189] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1326 records). [2025-09-15T21:16:45.855790] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-15T21:16:45.855732] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-15T21:16:45.866589] [INFO ] [MAIN ] Derivative Progress: 887/2083 symbols completed. HSY took 1.0s. Estimated remaining: 6m 37s. Rate: 180.9 symbols/min [2025-09-15T21:16:45.868816] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:45.868899] [INFO ] [MAIN ] Derivative Progress: 888/2083 symbols completed. HTGC took 1.0s. Estimated remaining: 6m 36s. Rate: 181.2 symbols/min [2025-09-15T21:16:45.869782] [DEBUG] [LOCAL ] HTH: Loaded 24977 existing records from primary storage. [2025-09-15T21:16:45.869910] [INFO ] [MAIN ] HTH: Loaded 24977 primary data records. [2025-09-15T21:16:45.870353] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:46.176031] [DEBUG] [LOCAL ] HUBB: Loaded 26654 existing records from primary storage. [2025-09-15T21:16:46.176258] [INFO ] [MAIN ] HUBB: Loaded 26654 primary data records. [2025-09-15T21:16:46.176951] [DEBUG] [LOCAL ] HUBS: Loaded 28996 existing records from primary storage. [2025-09-15T21:16:46.194203] [INFO ] [MAIN ] HUBS: Loaded 28996 primary data records. [2025-09-15T21:16:46.739357] [DEBUG] [MAIN ] HTH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:46.740625] [INFO ] [MAIN ] HTH: Generated 1326 derivative records from 24977 primary records. [2025-09-15T21:16:46.740862] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-15T21:16:46.753978] [DEBUG] [LOCAL ] HTH: Derivative data saved (1326 records). [2025-09-15T21:16:46.754958] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-15T21:16:46.756770] [INFO ] [MAIN ] Derivative Progress: 889/2083 symbols completed. HTH took 1.0s. Estimated remaining: 6m 36s. Rate: 180.8 symbols/min [2025-09-15T21:16:46.757269] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:46.785368] [DEBUG] [MAIN ] HUBB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:46.785163] [DEBUG] [MAIN ] HUBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:46.786299] [INFO ] [MAIN ] HUBB: Generated 1326 derivative records from 26654 primary records. [2025-09-15T21:16:46.787060] [INFO ] [MAIN ] HUBS: Generated 1326 derivative records from 28996 primary records. [2025-09-15T21:16:46.787229] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-15T21:16:46.787284] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-15T21:16:46.807158] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1326 records). [2025-09-15T21:16:46.812527] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1326 records). [2025-09-15T21:16:46.812725] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-15T21:16:46.824412] [INFO ] [MAIN ] Derivative Progress: 890/2083 symbols completed. HUBB took 1.0s. Estimated remaining: 6m 36s. Rate: 181.0 symbols/min [2025-09-15T21:16:46.824630] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:46.824900] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-15T21:16:46.827597] [INFO ] [MAIN ] Derivative Progress: 891/2083 symbols completed. HUBS took 1.0s. Estimated remaining: 6m 35s. Rate: 181.2 symbols/min [2025-09-15T21:16:46.828108] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:46.850849] [DEBUG] [LOCAL ] HUM: Loaded 36176 existing records from primary storage. [2025-09-15T21:16:46.851140] [INFO ] [MAIN ] HUM: Loaded 36176 primary data records. [2025-09-15T21:16:47.047548] [DEBUG] [LOCAL ] HUYA: Loaded 31968 existing records from primary storage. [2025-09-15T21:16:47.055838] [INFO ] [MAIN ] HUYA: Loaded 31968 primary data records. [2025-09-15T21:16:47.082793] [DEBUG] [LOCAL ] HUN: Loaded 39242 existing records from primary storage. [2025-09-15T21:16:47.104238] [INFO ] [MAIN ] HUN: Loaded 39242 primary data records. [2025-09-15T21:16:47.790783] [DEBUG] [MAIN ] HUM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:47.792379] [INFO ] [MAIN ] HUM: Generated 1326 derivative records from 36176 primary records. [2025-09-15T21:16:47.793438] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-15T21:16:47.814830] [DEBUG] [MAIN ] HUYA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:47.818515] [INFO ] [MAIN ] HUYA: Generated 1326 derivative records from 31968 primary records. [2025-09-15T21:16:47.817923] [DEBUG] [LOCAL ] HUM: Derivative data saved (1326 records). [2025-09-15T21:16:47.819507] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-15T21:16:47.819596] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-15T21:16:47.822167] [INFO ] [MAIN ] Derivative Progress: 892/2083 symbols completed. HUM took 1.1s. Estimated remaining: 6m 35s. Rate: 180.8 symbols/min [2025-09-15T21:16:47.828057] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:47.842863] [DEBUG] [MAIN ] HUN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:47.844536] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1326 records). [2025-09-15T21:16:47.844481] [INFO ] [MAIN ] HUN: Generated 1326 derivative records from 39242 primary records. [2025-09-15T21:16:47.844621] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-15T21:16:47.846773] [INFO ] [MAIN ] Derivative Progress: 893/2083 symbols completed. HUYA took 1.0s. Estimated remaining: 6m 35s. Rate: 181.0 symbols/min [2025-09-15T21:16:47.846847] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-15T21:16:47.847025] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:47.866551] [DEBUG] [LOCAL ] HVT: Loaded 10975 existing records from primary storage. [2025-09-15T21:16:47.866290] [DEBUG] [LOCAL ] HUN: Derivative data saved (1326 records). [2025-09-15T21:16:47.866742] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-15T21:16:47.868478] [INFO ] [MAIN ] Derivative Progress: 894/2083 symbols completed. HUN took 1.0s. Estimated remaining: 6m 34s. Rate: 181.1 symbols/min [2025-09-15T21:16:47.868818] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:47.868933] [INFO ] [MAIN ] HVT: Loaded 10975 primary data records. [2025-09-15T21:16:48.093704] [DEBUG] [LOCAL ] HWM: Loaded 39128 existing records from primary storage. [2025-09-15T21:16:48.178701] [INFO ] [MAIN ] HWM: Loaded 39128 primary data records. [2025-09-15T21:16:48.303808] [DEBUG] [LOCAL ] HXL: Loaded 33913 existing records from primary storage. [2025-09-15T21:16:48.304574] [INFO ] [MAIN ] HXL: Loaded 33913 primary data records. [2025-09-15T21:16:48.761134] [DEBUG] [MAIN ] HVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:48.763573] [INFO ] [MAIN ] HVT: Generated 1326 derivative records from 10975 primary records. [2025-09-15T21:16:48.763912] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-15T21:16:48.794521] [DEBUG] [LOCAL ] HVT: Derivative data saved (1326 records). [2025-09-15T21:16:48.795441] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-15T21:16:48.799799] [INFO ] [MAIN ] Derivative Progress: 895/2083 symbols completed. HVT took 1.0s. Estimated remaining: 6m 34s. Rate: 180.8 symbols/min [2025-09-15T21:16:48.811521] [DEBUG] [MAIN ] HWM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:48.813109] [INFO ] [MAIN ] HWM: Generated 1326 derivative records from 39128 primary records. [2025-09-15T21:16:48.812230] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:48.813217] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-15T21:16:48.828426] [DEBUG] [LOCAL ] HWM: Derivative data saved (1326 records). [2025-09-15T21:16:48.828742] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-15T21:16:48.830674] [INFO ] [MAIN ] Derivative Progress: 896/2083 symbols completed. HWM took 1.0s. Estimated remaining: 6m 34s. Rate: 181.0 symbols/min [2025-09-15T21:16:48.833579] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:48.844344] [DEBUG] [LOCAL ] HY: Loaded 7126 existing records from primary storage. [2025-09-15T21:16:48.846974] [INFO ] [MAIN ] HY: Loaded 7126 primary data records. [2025-09-15T21:16:48.900181] [DEBUG] [MAIN ] HXL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:48.925272] [DEBUG] [LOCAL ] HYI: Loaded 6436 existing records from primary storage. [2025-09-15T21:16:48.935467] [INFO ] [MAIN ] HXL: Generated 1326 derivative records from 33913 primary records. [2025-09-15T21:16:48.941163] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-15T21:16:48.935927] [INFO ] [MAIN ] HYI: Loaded 6436 primary data records. [2025-09-15T21:16:49.087590] [DEBUG] [LOCAL ] HXL: Derivative data saved (1326 records). [2025-09-15T21:16:49.172958] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-15T21:16:49.180395] [INFO ] [MAIN ] Derivative Progress: 897/2083 symbols completed. HXL took 1.3s. Estimated remaining: 6m 33s. Rate: 180.9 symbols/min [2025-09-15T21:16:49.280045] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:49.486674] [DEBUG] [LOCAL ] HYT: Loaded 24150 existing records from primary storage. [2025-09-15T21:16:49.490508] [INFO ] [MAIN ] HYT: Loaded 24150 primary data records. [2025-09-15T21:16:49.576281] [DEBUG] [MAIN ] HY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:49.584936] [INFO ] [MAIN ] HY: Generated 1326 derivative records from 7126 primary records. [2025-09-15T21:16:49.595911] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-15T21:16:49.698291] [DEBUG] [MAIN ] HYI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:49.698395] [DEBUG] [LOCAL ] HY: Derivative data saved (1326 records). [2025-09-15T21:16:49.730496] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-15T21:16:49.727450] [INFO ] [MAIN ] HYI: Generated 1326 derivative records from 6436 primary records. [2025-09-15T21:16:49.732849] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-15T21:16:49.732791] [INFO ] [MAIN ] Derivative Progress: 898/2083 symbols completed. HY took 0.9s. Estimated remaining: 6m 33s. Rate: 180.8 symbols/min [2025-09-15T21:16:49.832440] [DEBUG] [LOCAL ] HYI: Derivative data saved (1326 records). [2025-09-15T21:16:49.832757] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-15T21:16:49.835153] [INFO ] [MAIN ] Derivative Progress: 899/2083 symbols completed. HYI took 1.0s. Estimated remaining: 6m 33s. Rate: 181.0 symbols/min [2025-09-15T21:16:49.854899] [DEBUG] [MAIN ] HYT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:49.855699] [INFO ] [MAIN ] HYT: Generated 1326 derivative records from 24150 primary records. [2025-09-15T21:16:49.855763] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-15T21:16:49.868050] [DEBUG] [LOCAL ] HYT: Derivative data saved (1326 records). [2025-09-15T21:16:49.868177] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-15T21:16:49.870708] [INFO ] [MAIN ] Derivative Progress: 900/2083 symbols completed. HYT took 0.6s. Estimated remaining: 6m 32s. Rate: 181.1 symbols/min [2025-09-15T21:16:49.871779] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:49.871525] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:49.871849] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:49.879192] [DEBUG] [LOCAL ] HYTR: Loaded 2215 existing records from primary storage. [2025-09-15T21:16:49.879559] [INFO ] [MAIN ] HYTR: Loaded 2215 primary data records. [2025-09-15T21:16:49.962589] [DEBUG] [LOCAL ] IAE: Loaded 4215 existing records from primary storage. [2025-09-15T21:16:49.985900] [INFO ] [MAIN ] IAE: Loaded 4215 primary data records. [2025-09-15T21:16:50.109456] [DEBUG] [LOCAL ] HZO: Loaded 20526 existing records from primary storage. [2025-09-15T21:16:50.187349] [INFO ] [MAIN ] HZO: Loaded 20526 primary data records. [2025-09-15T21:16:50.775505] [DEBUG] [MAIN ] HYTR: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:16:50.777486] [INFO ] [MAIN ] HYTR: Generated 1325 derivative records from 2215 primary records. [2025-09-15T21:16:50.777790] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-15T21:16:50.791895] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1325 records). [2025-09-15T21:16:50.792080] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-15T21:16:50.793942] [INFO ] [MAIN ] Derivative Progress: 901/2083 symbols completed. HYTR took 0.9s. Estimated remaining: 6m 32s. Rate: 180.8 symbols/min [2025-09-15T21:16:50.794429] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:50.805402] [DEBUG] [MAIN ] IAE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:50.818340] [INFO ] [MAIN ] IAE: Generated 1326 derivative records from 4215 primary records. [2025-09-15T21:16:50.818924] [DEBUG] [MAIN ] HZO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:50.819766] [INFO ] [MAIN ] HZO: Generated 1326 derivative records from 20526 primary records. [2025-09-15T21:16:50.819878] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-15T21:16:50.819124] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-15T21:16:50.847696] [DEBUG] [LOCAL ] HZO: Derivative data saved (1326 records). [2025-09-15T21:16:50.847905] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-15T21:16:50.849736] [INFO ] [MAIN ] Derivative Progress: 902/2083 symbols completed. HZO took 1.0s. Estimated remaining: 6m 32s. Rate: 180.9 symbols/min [2025-09-15T21:16:50.847570] [DEBUG] [LOCAL ] IAE: Derivative data saved (1326 records). [2025-09-15T21:16:50.849963] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:50.850394] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-15T21:16:50.852938] [INFO ] [MAIN ] Derivative Progress: 903/2083 symbols completed. IAE took 1.0s. Estimated remaining: 6m 31s. Rate: 181.1 symbols/min [2025-09-15T21:16:50.863046] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:50.883807] [DEBUG] [LOCAL ] IAG: Loaded 39458 existing records from primary storage. [2025-09-15T21:16:50.884161] [INFO ] [MAIN ] IAG: Loaded 39458 primary data records. [2025-09-15T21:16:51.117037] [DEBUG] [LOCAL ] IBM: Loaded 39615 existing records from primary storage. [2025-09-15T21:16:51.121754] [INFO ] [MAIN ] IBM: Loaded 39615 primary data records. [2025-09-15T21:16:51.305188] [DEBUG] [LOCAL ] IBN: Loaded 38999 existing records from primary storage. [2025-09-15T21:16:51.318765] [INFO ] [MAIN ] IBN: Loaded 38999 primary data records. [2025-09-15T21:16:51.891013] [DEBUG] [MAIN ] IAG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:51.892945] [INFO ] [MAIN ] IAG: Generated 1326 derivative records from 39458 primary records. [2025-09-15T21:16:51.893402] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-15T21:16:51.908542] [DEBUG] [LOCAL ] IAG: Derivative data saved (1326 records). [2025-09-15T21:16:51.910331] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-15T21:16:51.914895] [INFO ] [MAIN ] Derivative Progress: 904/2083 symbols completed. IAG took 1.1s. Estimated remaining: 6m 31s. Rate: 180.7 symbols/min [2025-09-15T21:16:51.916702] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:51.928706] [DEBUG] [MAIN ] IBM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:51.929906] [INFO ] [MAIN ] IBM: Generated 1326 derivative records from 39615 primary records. [2025-09-15T21:16:51.930124] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-15T21:16:51.944760] [DEBUG] [LOCAL ] IBM: Derivative data saved (1326 records). [2025-09-15T21:16:51.946661] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-15T21:16:51.948518] [INFO ] [MAIN ] Derivative Progress: 905/2083 symbols completed. IBM took 1.1s. Estimated remaining: 6m 31s. Rate: 180.9 symbols/min [2025-09-15T21:16:51.948971] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:51.967618] [DEBUG] [MAIN ] IBN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:51.968522] [INFO ] [MAIN ] IBN: Generated 1326 derivative records from 38999 primary records. [2025-09-15T21:16:51.968732] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-15T21:16:51.988764] [DEBUG] [LOCAL ] IBN: Derivative data saved (1326 records). [2025-09-15T21:16:51.990286] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-15T21:16:51.992799] [INFO ] [MAIN ] Derivative Progress: 906/2083 symbols completed. IBN took 1.1s. Estimated remaining: 6m 30s. Rate: 181.1 symbols/min [2025-09-15T21:16:51.993975] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:51.993625] [DEBUG] [LOCAL ] IBP: Loaded 21527 existing records from primary storage. [2025-09-15T21:16:51.994540] [INFO ] [MAIN ] IBP: Loaded 21527 primary data records. [2025-09-15T21:16:52.211662] [DEBUG] [LOCAL ] IBTA: Loaded 25982 existing records from primary storage. [2025-09-15T21:16:52.284161] [INFO ] [MAIN ] IBTA: Loaded 25982 primary data records. [2025-09-15T21:16:52.427000] [DEBUG] [LOCAL ] ICE: Loaded 39028 existing records from primary storage. [2025-09-15T21:16:52.461634] [INFO ] [MAIN ] ICE: Loaded 39028 primary data records. [2025-09-15T21:16:52.849244] [DEBUG] [MAIN ] IBP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:52.850234] [INFO ] [MAIN ] IBP: Generated 1326 derivative records from 21527 primary records. [2025-09-15T21:16:52.850448] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-15T21:16:52.876678] [DEBUG] [MAIN ] IBTA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:52.878216] [INFO ] [MAIN ] IBTA: Generated 1326 derivative records from 25982 primary records. [2025-09-15T21:16:52.878311] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-15T21:16:52.877608] [DEBUG] [LOCAL ] IBP: Derivative data saved (1326 records). [2025-09-15T21:16:52.879451] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-15T21:16:52.890387] [INFO ] [MAIN ] Derivative Progress: 907/2083 symbols completed. IBP took 1.0s. Estimated remaining: 6m 30s. Rate: 180.7 symbols/min [2025-09-15T21:16:52.891411] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:52.894894] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1326 records). [2025-09-15T21:16:52.895046] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-15T21:16:52.896770] [INFO ] [MAIN ] Derivative Progress: 908/2083 symbols completed. IBTA took 0.9s. Estimated remaining: 6m 30s. Rate: 180.9 symbols/min [2025-09-15T21:16:52.897108] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:52.910314] [DEBUG] [MAIN ] ICE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:52.911049] [INFO ] [MAIN ] ICE: Generated 1326 derivative records from 39028 primary records. [2025-09-15T21:16:52.911299] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-15T21:16:52.936391] [DEBUG] [LOCAL ] ICE: Derivative data saved (1326 records). [2025-09-15T21:16:52.936544] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-15T21:16:52.938827] [INFO ] [MAIN ] Derivative Progress: 909/2083 symbols completed. ICE took 0.9s. Estimated remaining: 6m 29s. Rate: 181.1 symbols/min [2025-09-15T21:16:52.939123] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:52.956963] [DEBUG] [LOCAL ] ICL: Loaded 28261 existing records from primary storage. [2025-09-15T21:16:52.957984] [INFO ] [MAIN ] ICL: Loaded 28261 primary data records. [2025-09-15T21:16:52.958469] [DEBUG] [LOCAL ] IDA: Loaded 24568 existing records from primary storage. [2025-09-15T21:16:52.990585] [INFO ] [MAIN ] IDA: Loaded 24568 primary data records. [2025-09-15T21:16:53.083500] [DEBUG] [LOCAL ] IDE: Loaded 6534 existing records from primary storage. [2025-09-15T21:16:53.115010] [INFO ] [MAIN ] IDE: Loaded 6534 primary data records. [2025-09-15T21:16:53.784515] [DEBUG] [MAIN ] ICL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:53.786203] [INFO ] [MAIN ] ICL: Generated 1326 derivative records from 28261 primary records. [2025-09-15T21:16:53.787926] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-15T21:16:53.798207] [DEBUG] [MAIN ] IDA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:53.817922] [DEBUG] [MAIN ] IDE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:53.820005] [DEBUG] [LOCAL ] ICL: Derivative data saved (1326 records). [2025-09-15T21:16:53.820094] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-15T21:16:53.818775] [INFO ] [MAIN ] IDA: Generated 1326 derivative records from 24568 primary records. [2025-09-15T21:16:53.819726] [INFO ] [MAIN ] IDE: Generated 1326 derivative records from 6534 primary records. [2025-09-15T21:16:53.820260] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-15T21:16:53.822407] [INFO ] [MAIN ] Derivative Progress: 910/2083 symbols completed. ICL took 0.9s. Estimated remaining: 6m 29s. Rate: 180.8 symbols/min [2025-09-15T21:16:53.820219] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-15T21:16:53.831616] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:53.845445] [DEBUG] [LOCAL ] IDE: Derivative data saved (1326 records). [2025-09-15T21:16:53.846675] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-15T21:16:53.848437] [INFO ] [MAIN ] Derivative Progress: 911/2083 symbols completed. IDE took 0.9s. Estimated remaining: 6m 29s. Rate: 180.9 symbols/min [2025-09-15T21:16:53.846614] [DEBUG] [LOCAL ] IDA: Derivative data saved (1326 records). [2025-09-15T21:16:53.848669] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:53.848857] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-15T21:16:53.851328] [INFO ] [MAIN ] Derivative Progress: 912/2083 symbols completed. IDA took 1.0s. Estimated remaining: 6m 28s. Rate: 181.1 symbols/min [2025-09-15T21:16:53.851687] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:53.867753] [DEBUG] [LOCAL ] IDT: Loaded 13084 existing records from primary storage. [2025-09-15T21:16:53.867915] [INFO ] [MAIN ] IDT: Loaded 13084 primary data records. [2025-09-15T21:16:54.114478] [DEBUG] [LOCAL ] IFF: Loaded 37546 existing records from primary storage. [2025-09-15T21:16:54.115511] [DEBUG] [LOCAL ] IEX: Loaded 28450 existing records from primary storage. [2025-09-15T21:16:54.115872] [INFO ] [MAIN ] IEX: Loaded 28450 primary data records. [2025-09-15T21:16:54.115939] [INFO ] [MAIN ] IFF: Loaded 37546 primary data records. [2025-09-15T21:16:54.780259] [DEBUG] [MAIN ] IDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:54.782311] [INFO ] [MAIN ] IDT: Generated 1326 derivative records from 13084 primary records. [2025-09-15T21:16:54.783237] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-15T21:16:54.801570] [DEBUG] [LOCAL ] IDT: Derivative data saved (1326 records). [2025-09-15T21:16:54.802076] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-15T21:16:54.803800] [INFO ] [MAIN ] Derivative Progress: 913/2083 symbols completed. IDT took 1.0s. Estimated remaining: 6m 28s. Rate: 180.8 symbols/min [2025-09-15T21:16:54.829890] [DEBUG] [MAIN ] IEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:54.831163] [INFO ] [MAIN ] IEX: Generated 1326 derivative records from 28450 primary records. [2025-09-15T21:16:54.830362] [DEBUG] [MAIN ] IFF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:54.831319] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-15T21:16:54.831983] [INFO ] [MAIN ] IFF: Generated 1326 derivative records from 37546 primary records. [2025-09-15T21:16:54.832464] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-15T21:16:54.854989] [DEBUG] [LOCAL ] IEX: Derivative data saved (1326 records). [2025-09-15T21:16:54.855500] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-15T21:16:54.858072] [INFO ] [MAIN ] Derivative Progress: 914/2083 symbols completed. IEX took 1.0s. Estimated remaining: 6m 28s. Rate: 180.9 symbols/min [2025-09-15T21:16:54.859574] [DEBUG] [LOCAL ] IFF: Derivative data saved (1326 records). [2025-09-15T21:16:54.859669] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-15T21:16:54.862033] [INFO ] [MAIN ] Derivative Progress: 915/2083 symbols completed. IFF took 1.0s. Estimated remaining: 6m 27s. Rate: 181.1 symbols/min [2025-09-15T21:16:54.862529] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:54.862751] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:54.863285] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:54.879325] [DEBUG] [LOCAL ] IGA: Loaded 6917 existing records from primary storage. [2025-09-15T21:16:54.883767] [INFO ] [MAIN ] IGA: Loaded 6917 primary data records. [2025-09-15T21:16:54.920195] [DEBUG] [LOCAL ] IFN: Loaded 13576 existing records from primary storage. [2025-09-15T21:16:54.932339] [INFO ] [MAIN ] IFN: Loaded 13576 primary data records. [2025-09-15T21:16:55.041459] [DEBUG] [LOCAL ] IFS: Loaded 16343 existing records from primary storage. [2025-09-15T21:16:55.082605] [INFO ] [MAIN ] IFS: Loaded 16343 primary data records. [2025-09-15T21:16:55.731494] [DEBUG] [MAIN ] IFN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:55.732861] [INFO ] [MAIN ] IFN: Generated 1326 derivative records from 13576 primary records. [2025-09-15T21:16:55.733158] [DEBUG] [MAIN ] IGA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:55.733577] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-15T21:16:55.735296] [INFO ] [MAIN ] IGA: Generated 1326 derivative records from 6917 primary records. [2025-09-15T21:16:55.737567] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-15T21:16:55.749724] [DEBUG] [LOCAL ] IFN: Derivative data saved (1326 records). [2025-09-15T21:16:55.749989] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-15T21:16:55.763384] [INFO ] [MAIN ] Derivative Progress: 916/2083 symbols completed. IFN took 0.9s. Estimated remaining: 6m 27s. Rate: 180.8 symbols/min [2025-09-15T21:16:55.768522] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:55.771210] [DEBUG] [MAIN ] IFS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:55.774424] [DEBUG] [LOCAL ] IGA: Derivative data saved (1326 records). [2025-09-15T21:16:55.775444] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-15T21:16:55.777255] [INFO ] [MAIN ] Derivative Progress: 917/2083 symbols completed. IGA took 0.9s. Estimated remaining: 6m 27s. Rate: 181.0 symbols/min [2025-09-15T21:16:55.775292] [INFO ] [MAIN ] IFS: Generated 1326 derivative records from 16343 primary records. [2025-09-15T21:16:55.777715] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-15T21:16:55.778060] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:55.798052] [DEBUG] [LOCAL ] IGI: Loaded 2713 existing records from primary storage. [2025-09-15T21:16:55.799026] [DEBUG] [LOCAL ] IFS: Derivative data saved (1326 records). [2025-09-15T21:16:55.804209] [DEBUG] [LOCAL ] IGD: Loaded 13795 existing records from primary storage. [2025-09-15T21:16:55.803822] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-15T21:16:55.803915] [INFO ] [MAIN ] IGI: Loaded 2713 primary data records. [2025-09-15T21:16:55.811446] [INFO ] [MAIN ] Derivative Progress: 918/2083 symbols completed. IFS took 0.9s. Estimated remaining: 6m 26s. Rate: 181.1 symbols/min [2025-09-15T21:16:55.804365] [INFO ] [MAIN ] IGD: Loaded 13795 primary data records. [2025-09-15T21:16:55.859070] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:56.295920] [DEBUG] [LOCAL ] IGR: Loaded 22380 existing records from primary storage. [2025-09-15T21:16:56.379497] [INFO ] [MAIN ] IGR: Loaded 22380 primary data records. [2025-09-15T21:16:56.677453] [DEBUG] [MAIN ] IGD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:56.680089] [INFO ] [MAIN ] IGD: Generated 1326 derivative records from 13795 primary records. [2025-09-15T21:16:56.680578] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-15T21:16:56.691470] [DEBUG] [MAIN ] IGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:56.701341] [INFO ] [MAIN ] IGI: Generated 1326 derivative records from 2713 primary records. [2025-09-15T21:16:56.704560] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-15T21:16:56.705257] [DEBUG] [LOCAL ] IGD: Derivative data saved (1326 records). [2025-09-15T21:16:56.706044] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-15T21:16:56.715262] [INFO ] [MAIN ] Derivative Progress: 919/2083 symbols completed. IGD took 0.9s. Estimated remaining: 6m 26s. Rate: 180.8 symbols/min [2025-09-15T21:16:56.716226] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:56.719345] [DEBUG] [LOCAL ] IGI: Derivative data saved (1326 records). [2025-09-15T21:16:56.719537] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-15T21:16:56.721756] [INFO ] [MAIN ] Derivative Progress: 920/2083 symbols completed. IGI took 0.9s. Estimated remaining: 6m 26s. Rate: 181.0 symbols/min [2025-09-15T21:16:56.722466] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:56.726521] [DEBUG] [LOCAL ] IH: Loaded 2002 existing records from primary storage. [2025-09-15T21:16:56.727634] [INFO ] [MAIN ] IH: Loaded 2002 primary data records. [2025-09-15T21:16:56.806635] [DEBUG] [LOCAL ] IHD: Loaded 5148 existing records from primary storage. [2025-09-15T21:16:56.806395] [DEBUG] [MAIN ] IGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:56.812024] [INFO ] [MAIN ] IHD: Loaded 5148 primary data records. [2025-09-15T21:16:56.840477] [INFO ] [MAIN ] IGR: Generated 1326 derivative records from 22380 primary records. [2025-09-15T21:16:56.900240] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-15T21:16:57.087433] [DEBUG] [LOCAL ] IGR: Derivative data saved (1326 records). [2025-09-15T21:16:57.195701] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-15T21:16:57.286365] [INFO ] [MAIN ] Derivative Progress: 921/2083 symbols completed. IGR took 1.5s. Estimated remaining: 6m 25s. Rate: 180.9 symbols/min [2025-09-15T21:16:57.288192] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:57.316451] [DEBUG] [MAIN ] IH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:57.322615] [INFO ] [MAIN ] IH: Generated 1326 derivative records from 2002 primary records. [2025-09-15T21:16:57.323075] [DEBUG] [LOCAL ] IHG: Loaded 17602 existing records from primary storage. [2025-09-15T21:16:57.323230] [INFO ] [MAIN ] IHG: Loaded 17602 primary data records. [2025-09-15T21:16:57.322810] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-15T21:16:57.369172] [DEBUG] [MAIN ] IHD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:57.396178] [INFO ] [MAIN ] IHD: Generated 1326 derivative records from 5148 primary records. [2025-09-15T21:16:57.405423] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-15T21:16:57.454931] [DEBUG] [LOCAL ] IH: Derivative data saved (1326 records). [2025-09-15T21:16:57.455303] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-15T21:16:57.457251] [INFO ] [MAIN ] Derivative Progress: 922/2083 symbols completed. IH took 0.7s. Estimated remaining: 6m 25s. Rate: 181.0 symbols/min [2025-09-15T21:16:57.474718] [DEBUG] [LOCAL ] IHD: Derivative data saved (1326 records). [2025-09-15T21:16:57.479986] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:57.510920] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-15T21:16:57.516368] [INFO ] [MAIN ] Derivative Progress: 923/2083 symbols completed. IHD took 0.8s. Estimated remaining: 6m 24s. Rate: 181.1 symbols/min [2025-09-15T21:16:57.542211] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:57.631952] [DEBUG] [LOCAL ] IIF: Loaded 4027 existing records from primary storage. [2025-09-15T21:16:57.633458] [INFO ] [MAIN ] IIF: Loaded 4027 primary data records. [2025-09-15T21:16:57.754230] [DEBUG] [LOCAL ] IHS: Loaded 29102 existing records from primary storage. [2025-09-15T21:16:57.759965] [INFO ] [MAIN ] IHS: Loaded 29102 primary data records. [2025-09-15T21:16:58.057719] [DEBUG] [MAIN ] IHG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:58.080151] [INFO ] [MAIN ] IHG: Generated 1326 derivative records from 17602 primary records. [2025-09-15T21:16:58.089474] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-15T21:16:58.208329] [DEBUG] [LOCAL ] IHG: Derivative data saved (1326 records). [2025-09-15T21:16:58.208565] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-15T21:16:58.210307] [INFO ] [MAIN ] Derivative Progress: 924/2083 symbols completed. IHG took 0.9s. Estimated remaining: 6m 24s. Rate: 180.9 symbols/min [2025-09-15T21:16:58.210809] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:58.235269] [DEBUG] [MAIN ] IIF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:58.235342] [DEBUG] [LOCAL ] IIIN: Loaded 11671 existing records from primary storage. [2025-09-15T21:16:58.235496] [INFO ] [MAIN ] IIIN: Loaded 11671 primary data records. [2025-09-15T21:16:58.236158] [INFO ] [MAIN ] IIF: Generated 1326 derivative records from 4027 primary records. [2025-09-15T21:16:58.273482] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-15T21:16:58.351365] [DEBUG] [LOCAL ] IIF: Derivative data saved (1326 records). [2025-09-15T21:16:58.352092] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-15T21:16:58.355403] [INFO ] [MAIN ] Derivative Progress: 925/2083 symbols completed. IIF took 0.8s. Estimated remaining: 6m 24s. Rate: 181.0 symbols/min [2025-09-15T21:16:58.464510] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:58.466979] [DEBUG] [MAIN ] IHS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:58.541969] [INFO ] [MAIN ] IHS: Generated 1326 derivative records from 29102 primary records. [2025-09-15T21:16:58.552439] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-15T21:16:58.567578] [DEBUG] [LOCAL ] IHS: Derivative data saved (1326 records). [2025-09-15T21:16:58.567862] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-15T21:16:58.569624] [INFO ] [MAIN ] Derivative Progress: 926/2083 symbols completed. IHS took 1.1s. Estimated remaining: 6m 23s. Rate: 181.1 symbols/min [2025-09-15T21:16:58.570442] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:58.576446] [DEBUG] [LOCAL ] IIM: Loaded 11317 existing records from primary storage. [2025-09-15T21:16:58.576631] [INFO ] [MAIN ] IIM: Loaded 11317 primary data records. [2025-09-15T21:16:58.851262] [DEBUG] [LOCAL ] IIPR: Loaded 20582 existing records from primary storage. [2025-09-15T21:16:58.854077] [INFO ] [MAIN ] IIPR: Loaded 20582 primary data records. [2025-09-15T21:16:58.920096] [DEBUG] [MAIN ] IIIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:58.947874] [INFO ] [MAIN ] IIIN: Generated 1326 derivative records from 11671 primary records. [2025-09-15T21:16:58.953510] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-15T21:16:59.004094] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1326 records). [2025-09-15T21:16:59.039623] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-15T21:16:59.061383] [INFO ] [MAIN ] Derivative Progress: 927/2083 symbols completed. IIIN took 0.9s. Estimated remaining: 6m 23s. Rate: 181.0 symbols/min [2025-09-15T21:16:59.146876] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:59.163248] [DEBUG] [MAIN ] IIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:59.164292] [INFO ] [MAIN ] IIM: Generated 1326 derivative records from 11317 primary records. [2025-09-15T21:16:59.164549] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-15T21:16:59.177440] [DEBUG] [LOCAL ] IIM: Derivative data saved (1326 records). [2025-09-15T21:16:59.177728] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-15T21:16:59.179804] [INFO ] [MAIN ] Derivative Progress: 928/2083 symbols completed. IIM took 0.8s. Estimated remaining: 6m 23s. Rate: 181.1 symbols/min [2025-09-15T21:16:59.204892] [DEBUG] [MAIN ] IIPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:59.214636] [INFO ] [MAIN ] IIPR: Generated 1326 derivative records from 20582 primary records. [2025-09-15T21:16:59.214775] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-15T21:16:59.215957] [DEBUG] [LOCAL ] IMAX: Loaded 31543 existing records from primary storage. [2025-09-15T21:16:59.216249] [INFO ] [MAIN ] IMAX: Loaded 31543 primary data records. [2025-09-15T21:16:59.335548] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1326 records). [2025-09-15T21:16:59.340816] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-15T21:16:59.352921] [INFO ] [MAIN ] Derivative Progress: 929/2083 symbols completed. IIPR took 0.8s. Estimated remaining: 6m 22s. Rate: 181.2 symbols/min [2025-09-15T21:16:59.503142] [DEBUG] [MAIN ] IMAX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:16:59.503851] [INFO ] [MAIN ] IMAX: Generated 1326 derivative records from 31543 primary records. [2025-09-15T21:16:59.503913] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-15T21:16:59.515740] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1326 records). [2025-09-15T21:16:59.515802] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-15T21:16:59.517450] [INFO ] [MAIN ] Derivative Progress: 930/2083 symbols completed. IMAX took 0.4s. Estimated remaining: 6m 22s. Rate: 181.3 symbols/min [2025-09-15T21:16:59.518073] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:59.517888] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:59.518164] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:16:59.572794] [DEBUG] [LOCAL ] INFA: Loaded 36912 existing records from primary storage. [2025-09-15T21:16:59.572987] [INFO ] [MAIN ] INFA: Loaded 36912 primary data records. [2025-09-15T21:16:59.720196] [DEBUG] [LOCAL ] ING: Loaded 37270 existing records from primary storage. [2025-09-15T21:16:59.714974] [DEBUG] [LOCAL ] INFY: Loaded 39568 existing records from primary storage. [2025-09-15T21:16:59.725536] [INFO ] [MAIN ] INFY: Loaded 39568 primary data records. [2025-09-15T21:16:59.725595] [INFO ] [MAIN ] ING: Loaded 37270 primary data records. [2025-09-15T21:17:00.472797] [DEBUG] [MAIN ] INFA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:00.473905] [INFO ] [MAIN ] INFA: Generated 1326 derivative records from 36912 primary records. [2025-09-15T21:17:00.474173] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-15T21:17:00.487921] [DEBUG] [LOCAL ] INFA: Derivative data saved (1326 records). [2025-09-15T21:17:00.488137] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-15T21:17:00.489725] [INFO ] [MAIN ] Derivative Progress: 931/2083 symbols completed. INFA took 1.0s. Estimated remaining: 6m 22s. Rate: 180.9 symbols/min [2025-09-15T21:17:00.491334] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:00.514378] [DEBUG] [MAIN ] ING: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:00.515580] [INFO ] [MAIN ] ING: Generated 1326 derivative records from 37270 primary records. [2025-09-15T21:17:00.515763] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-15T21:17:00.514864] [DEBUG] [MAIN ] INFY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:00.517105] [INFO ] [MAIN ] INFY: Generated 1326 derivative records from 39568 primary records. [2025-09-15T21:17:00.517469] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-15T21:17:00.544313] [DEBUG] [LOCAL ] INFY: Derivative data saved (1326 records). [2025-09-15T21:17:00.551622] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-15T21:17:00.554234] [INFO ] [MAIN ] Derivative Progress: 932/2083 symbols completed. INFY took 1.0s. Estimated remaining: 6m 21s. Rate: 181.1 symbols/min [2025-09-15T21:17:00.555395] [DEBUG] [LOCAL ] INGM: Loaded 20005 existing records from primary storage. [2025-09-15T21:17:00.554874] [DEBUG] [LOCAL ] ING: Derivative data saved (1326 records). [2025-09-15T21:17:00.555748] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-15T21:17:00.558264] [INFO ] [MAIN ] Derivative Progress: 933/2083 symbols completed. ING took 1.0s. Estimated remaining: 6m 21s. Rate: 181.3 symbols/min [2025-09-15T21:17:00.555620] [INFO ] [MAIN ] INGM: Loaded 20005 primary data records. [2025-09-15T21:17:00.558422] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:00.579165] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:00.869252] [DEBUG] [LOCAL ] INGR: Loaded 23872 existing records from primary storage. [2025-09-15T21:17:00.879148] [INFO ] [MAIN ] INGR: Loaded 23872 primary data records. [2025-09-15T21:17:00.910918] [DEBUG] [LOCAL ] INN: Loaded 31262 existing records from primary storage. [2025-09-15T21:17:00.955873] [INFO ] [MAIN ] INN: Loaded 31262 primary data records. [2025-09-15T21:17:01.423489] [DEBUG] [MAIN ] INGM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:01.424725] [INFO ] [MAIN ] INGM: Generated 1326 derivative records from 20005 primary records. [2025-09-15T21:17:01.424888] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-15T21:17:01.440667] [DEBUG] [LOCAL ] INGM: Derivative data saved (1326 records). [2025-09-15T21:17:01.440990] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-15T21:17:01.442872] [INFO ] [MAIN ] Derivative Progress: 934/2083 symbols completed. INGM took 1.0s. Estimated remaining: 6m 21s. Rate: 181.0 symbols/min [2025-09-15T21:17:01.443600] [INFO ] [MAIN ] INR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:01.457249] [DEBUG] [MAIN ] INGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:01.457976] [INFO ] [MAIN ] INGR: Generated 1326 derivative records from 23872 primary records. [2025-09-15T21:17:01.458260] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-15T21:17:01.482763] [DEBUG] [LOCAL ] INGR: Derivative data saved (1326 records). [2025-09-15T21:17:01.483567] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-15T21:17:01.485804] [INFO ] [MAIN ] Derivative Progress: 935/2083 symbols completed. INGR took 0.9s. Estimated remaining: 6m 20s. Rate: 181.1 symbols/min [2025-09-15T21:17:01.486062] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:01.496442] [DEBUG] [LOCAL ] INR: Loaded 19051 existing records from primary storage. [2025-09-15T21:17:01.496747] [DEBUG] [MAIN ] INN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:01.497454] [INFO ] [MAIN ] INN: Generated 1326 derivative records from 31262 primary records. [2025-09-15T21:17:01.497510] [INFO ] [MAIN ] INR: Loaded 19051 primary data records. [2025-09-15T21:17:01.497603] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-15T21:17:01.666971] [DEBUG] [LOCAL ] INN: Derivative data saved (1326 records). [2025-09-15T21:17:01.672572] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-15T21:17:01.714752] [DEBUG] [LOCAL ] INSP: Loaded 27714 existing records from primary storage. [2025-09-15T21:17:01.694441] [INFO ] [MAIN ] Derivative Progress: 936/2083 symbols completed. INN took 1.1s. Estimated remaining: 6m 20s. Rate: 181.2 symbols/min [2025-09-15T21:17:01.802449] [INFO ] [MAIN ] INSP: Loaded 27714 primary data records. [2025-09-15T21:17:01.802631] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:02.100392] [DEBUG] [LOCAL ] INSW: Loaded 29210 existing records from primary storage. [2025-09-15T21:17:02.100824] [INFO ] [MAIN ] INSW: Loaded 29210 primary data records. [2025-09-15T21:17:02.223354] [DEBUG] [MAIN ] INR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:02.235082] [INFO ] [MAIN ] INR: Generated 1326 derivative records from 19051 primary records. [2025-09-15T21:17:02.245932] [DEBUG] [LOCAL ] INR: Saving derivative data. [2025-09-15T21:17:02.400227] [DEBUG] [LOCAL ] INR: Derivative data saved (1326 records). [2025-09-15T21:17:02.401273] [INFO ] [MAIN ] INR: Successfully saved derivative data. [2025-09-15T21:17:02.402904] [INFO ] [MAIN ] Derivative Progress: 937/2083 symbols completed. INR took 1.0s. Estimated remaining: 6m 20s. Rate: 181.0 symbols/min [2025-09-15T21:17:02.404093] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:02.418165] [DEBUG] [MAIN ] INSP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:02.419052] [INFO ] [MAIN ] INSP: Generated 1326 derivative records from 27714 primary records. [2025-09-15T21:17:02.419224] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-15T21:17:02.433403] [DEBUG] [LOCAL ] INSP: Derivative data saved (1326 records). [2025-09-15T21:17:02.433559] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-15T21:17:02.435658] [INFO ] [MAIN ] Derivative Progress: 938/2083 symbols completed. INSP took 0.9s. Estimated remaining: 6m 19s. Rate: 181.1 symbols/min [2025-09-15T21:17:02.436598] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:02.451338] [DEBUG] [MAIN ] INSW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:02.451992] [INFO ] [MAIN ] INSW: Generated 1326 derivative records from 29210 primary records. [2025-09-15T21:17:02.452075] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-15T21:17:02.477043] [DEBUG] [LOCAL ] INSW: Derivative data saved (1326 records). [2025-09-15T21:17:02.477216] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-15T21:17:02.478967] [INFO ] [MAIN ] Derivative Progress: 939/2083 symbols completed. INSW took 0.7s. Estimated remaining: 6m 19s. Rate: 181.3 symbols/min [2025-09-15T21:17:02.479684] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:02.497841] [DEBUG] [LOCAL ] INVX: Loaded 21242 existing records from primary storage. [2025-09-15T21:17:02.499392] [INFO ] [MAIN ] INVX: Loaded 21242 primary data records. [2025-09-15T21:17:02.500193] [DEBUG] [LOCAL ] INVH: Loaded 39223 existing records from primary storage. [2025-09-15T21:17:02.520953] [INFO ] [MAIN ] INVH: Loaded 39223 primary data records. [2025-09-15T21:17:03.081968] [DEBUG] [LOCAL ] IONQ: Loaded 39748 existing records from primary storage. [2025-09-15T21:17:03.092620] [INFO ] [MAIN ] IONQ: Loaded 39748 primary data records. [2025-09-15T21:17:03.415540] [DEBUG] [MAIN ] INVH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:03.415957] [DEBUG] [MAIN ] INVX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:03.418320] [INFO ] [MAIN ] INVX: Generated 1326 derivative records from 21242 primary records. [2025-09-15T21:17:03.417585] [INFO ] [MAIN ] INVH: Generated 1326 derivative records from 39223 primary records. [2025-09-15T21:17:03.418631] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-15T21:17:03.418491] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-15T21:17:03.445343] [DEBUG] [LOCAL ] INVX: Derivative data saved (1326 records). [2025-09-15T21:17:03.447701] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-15T21:17:03.450949] [INFO ] [MAIN ] Derivative Progress: 940/2083 symbols completed. INVX took 1.0s. Estimated remaining: 6m 19s. Rate: 180.9 symbols/min [2025-09-15T21:17:03.445247] [DEBUG] [LOCAL ] INVH: Derivative data saved (1326 records). [2025-09-15T21:17:03.451304] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:03.451577] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-15T21:17:03.453988] [INFO ] [MAIN ] Derivative Progress: 941/2083 symbols completed. INVH took 1.1s. Estimated remaining: 6m 18s. Rate: 181.1 symbols/min [2025-09-15T21:17:03.454721] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:03.473008] [DEBUG] [MAIN ] IONQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:03.474083] [INFO ] [MAIN ] IONQ: Generated 1326 derivative records from 39748 primary records. [2025-09-15T21:17:03.474242] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-15T21:17:03.504311] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1326 records). [2025-09-15T21:17:03.504719] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-15T21:17:03.507208] [INFO ] [MAIN ] Derivative Progress: 942/2083 symbols completed. IONQ took 1.0s. Estimated remaining: 6m 18s. Rate: 181.3 symbols/min [2025-09-15T21:17:03.516620] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:03.532174] [DEBUG] [LOCAL ] IOT: Loaded 39479 existing records from primary storage. [2025-09-15T21:17:03.543747] [INFO ] [MAIN ] IOT: Loaded 39479 primary data records. [2025-09-15T21:17:03.566407] [DEBUG] [LOCAL ] IP: Loaded 39314 existing records from primary storage. [2025-09-15T21:17:03.590704] [INFO ] [MAIN ] IP: Loaded 39314 primary data records. [2025-09-15T21:17:04.018116] [DEBUG] [LOCAL ] IPG: Loaded 39313 existing records from primary storage. [2025-09-15T21:17:04.022890] [INFO ] [MAIN ] IPG: Loaded 39313 primary data records. [2025-09-15T21:17:04.433121] [DEBUG] [MAIN ] IOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:04.435607] [INFO ] [MAIN ] IOT: Generated 1326 derivative records from 39479 primary records. [2025-09-15T21:17:04.436161] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-15T21:17:04.462773] [DEBUG] [MAIN ] IP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:04.465487] [INFO ] [MAIN ] IP: Generated 1326 derivative records from 39314 primary records. [2025-09-15T21:17:04.466134] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-15T21:17:04.483788] [DEBUG] [LOCAL ] IP: Derivative data saved (1326 records). [2025-09-15T21:17:04.484184] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-15T21:17:04.483912] [DEBUG] [LOCAL ] IOT: Derivative data saved (1326 records). [2025-09-15T21:17:04.486248] [INFO ] [MAIN ] Derivative Progress: 943/2083 symbols completed. IP took 1.0s. Estimated remaining: 6m 18s. Rate: 180.9 symbols/min [2025-09-15T21:17:04.486815] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-15T21:17:04.489785] [INFO ] [MAIN ] Derivative Progress: 944/2083 symbols completed. IOT took 1.0s. Estimated remaining: 6m 17s. Rate: 181.1 symbols/min [2025-09-15T21:17:04.503985] [DEBUG] [MAIN ] IPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:04.504928] [INFO ] [MAIN ] IPG: Generated 1326 derivative records from 39313 primary records. [2025-09-15T21:17:04.505009] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-15T21:17:04.518703] [DEBUG] [LOCAL ] IPG: Derivative data saved (1326 records). [2025-09-15T21:17:04.518919] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-15T21:17:04.521565] [INFO ] [MAIN ] Derivative Progress: 945/2083 symbols completed. IPG took 1.0s. Estimated remaining: 6m 17s. Rate: 181.3 symbols/min [2025-09-15T21:17:04.522626] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:04.523407] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:04.522812] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:04.553158] [DEBUG] [LOCAL ] IPI: Loaded 15432 existing records from primary storage. [2025-09-15T21:17:04.553337] [INFO ] [MAIN ] IPI: Loaded 15432 primary data records. [2025-09-15T21:17:04.660893] [DEBUG] [LOCAL ] IQI: Loaded 13437 existing records from primary storage. [2025-09-15T21:17:04.683865] [INFO ] [MAIN ] IQI: Loaded 13437 primary data records. [2025-09-15T21:17:04.718860] [DEBUG] [LOCAL ] IQV: Loaded 37209 existing records from primary storage. [2025-09-15T21:17:04.752747] [INFO ] [MAIN ] IQV: Loaded 37209 primary data records. [2025-09-15T21:17:05.653217] [DEBUG] [MAIN ] IPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:05.655736] [INFO ] [MAIN ] IPI: Generated 1326 derivative records from 15432 primary records. [2025-09-15T21:17:05.655893] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-15T21:17:05.682722] [DEBUG] [LOCAL ] IPI: Derivative data saved (1326 records). [2025-09-15T21:17:05.683115] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-15T21:17:05.686485] [INFO ] [MAIN ] Derivative Progress: 946/2083 symbols completed. IPI took 1.2s. Estimated remaining: 6m 17s. Rate: 180.8 symbols/min [2025-09-15T21:17:05.686951] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:05.700354] [DEBUG] [MAIN ] IQI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:05.701360] [INFO ] [MAIN ] IQI: Generated 1326 derivative records from 13437 primary records. [2025-09-15T21:17:05.707516] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-15T21:17:05.711908] [DEBUG] [MAIN ] IQV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:05.713693] [INFO ] [MAIN ] IQV: Generated 1326 derivative records from 37209 primary records. [2025-09-15T21:17:05.719434] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-15T21:17:05.737097] [DEBUG] [LOCAL ] IQV: Derivative data saved (1326 records). [2025-09-15T21:17:05.737682] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-15T21:17:05.739280] [DEBUG] [LOCAL ] IQI: Derivative data saved (1326 records). [2025-09-15T21:17:05.742626] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-15T21:17:05.742513] [INFO ] [MAIN ] Derivative Progress: 947/2083 symbols completed. IQV took 1.2s. Estimated remaining: 6m 17s. Rate: 181.0 symbols/min [2025-09-15T21:17:05.745126] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:05.745222] [INFO ] [MAIN ] Derivative Progress: 948/2083 symbols completed. IQI took 1.2s. Estimated remaining: 6m 16s. Rate: 181.1 symbols/min [2025-09-15T21:17:05.746141] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:05.786335] [DEBUG] [LOCAL ] IRS: Loaded 16167 existing records from primary storage. [2025-09-15T21:17:05.786630] [INFO ] [MAIN ] IRS: Loaded 16167 primary data records. [2025-09-15T21:17:05.919312] [DEBUG] [LOCAL ] IR: Loaded 38888 existing records from primary storage. [2025-09-15T21:17:05.935556] [INFO ] [MAIN ] IR: Loaded 38888 primary data records. [2025-09-15T21:17:06.025486] [DEBUG] [LOCAL ] IRM: Loaded 36011 existing records from primary storage. [2025-09-15T21:17:06.039677] [INFO ] [MAIN ] IRM: Loaded 36011 primary data records. [2025-09-15T21:17:06.739149] [DEBUG] [MAIN ] IRS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:06.741777] [INFO ] [MAIN ] IRS: Generated 1326 derivative records from 16167 primary records. [2025-09-15T21:17:06.742191] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-15T21:17:06.756659] [DEBUG] [LOCAL ] IRS: Derivative data saved (1326 records). [2025-09-15T21:17:06.758755] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-15T21:17:06.762133] [INFO ] [MAIN ] Derivative Progress: 949/2083 symbols completed. IRS took 1.0s. Estimated remaining: 6m 16s. Rate: 180.8 symbols/min [2025-09-15T21:17:06.763080] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:06.773851] [DEBUG] [MAIN ] IR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:06.775009] [INFO ] [MAIN ] IR: Generated 1326 derivative records from 38888 primary records. [2025-09-15T21:17:06.775170] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-15T21:17:06.801789] [DEBUG] [MAIN ] IRM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:06.803808] [INFO ] [MAIN ] IRM: Generated 1326 derivative records from 36011 primary records. [2025-09-15T21:17:06.803962] [DEBUG] [LOCAL ] IR: Derivative data saved (1326 records). [2025-09-15T21:17:06.804311] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-15T21:17:06.804237] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-15T21:17:06.806225] [INFO ] [MAIN ] Derivative Progress: 950/2083 symbols completed. IR took 1.1s. Estimated remaining: 6m 16s. Rate: 180.9 symbols/min [2025-09-15T21:17:06.807265] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:06.820727] [DEBUG] [LOCAL ] IRM: Derivative data saved (1326 records). [2025-09-15T21:17:06.820959] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-15T21:17:06.824429] [INFO ] [MAIN ] Derivative Progress: 951/2083 symbols completed. IRM took 1.1s. Estimated remaining: 6m 15s. Rate: 181.1 symbols/min [2025-09-15T21:17:06.824948] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:06.845431] [DEBUG] [LOCAL ] ISD: Loaded 11068 existing records from primary storage. [2025-09-15T21:17:06.845598] [INFO ] [MAIN ] ISD: Loaded 11068 primary data records. [2025-09-15T21:17:06.967755] [DEBUG] [LOCAL ] IRT: Loaded 37200 existing records from primary storage. [2025-09-15T21:17:06.983809] [INFO ] [MAIN ] IRT: Loaded 37200 primary data records. [2025-09-15T21:17:07.252193] [DEBUG] [LOCAL ] IT: Loaded 30721 existing records from primary storage. [2025-09-15T21:17:07.268931] [INFO ] [MAIN ] IT: Loaded 30721 primary data records. [2025-09-15T21:17:07.762998] [DEBUG] [MAIN ] ISD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:07.764885] [INFO ] [MAIN ] ISD: Generated 1326 derivative records from 11068 primary records. [2025-09-15T21:17:07.765132] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-15T21:17:07.781231] [DEBUG] [LOCAL ] ISD: Derivative data saved (1326 records). [2025-09-15T21:17:07.781498] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-15T21:17:07.791755] [DEBUG] [MAIN ] IRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:07.793866] [INFO ] [MAIN ] Derivative Progress: 952/2083 symbols completed. ISD took 1.0s. Estimated remaining: 6m 15s. Rate: 180.7 symbols/min [2025-09-15T21:17:07.794292] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:07.795012] [INFO ] [MAIN ] IRT: Generated 1326 derivative records from 37200 primary records. [2025-09-15T21:17:07.795897] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-15T21:17:07.809569] [DEBUG] [LOCAL ] IRT: Derivative data saved (1326 records). [2025-09-15T21:17:07.809947] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-15T21:17:07.811866] [INFO ] [MAIN ] Derivative Progress: 953/2083 symbols completed. IRT took 1.0s. Estimated remaining: 6m 15s. Rate: 180.9 symbols/min [2025-09-15T21:17:07.812232] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:07.831876] [DEBUG] [MAIN ] IT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:07.832727] [INFO ] [MAIN ] IT: Generated 1326 derivative records from 30721 primary records. [2025-09-15T21:17:07.832898] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-15T21:17:07.851669] [DEBUG] [LOCAL ] ITGR: Loaded 22027 existing records from primary storage. [2025-09-15T21:17:07.852295] [INFO ] [MAIN ] ITGR: Loaded 22027 primary data records. [2025-09-15T21:17:07.890659] [DEBUG] [LOCAL ] IT: Derivative data saved (1326 records). [2025-09-15T21:17:07.917480] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-15T21:17:07.969110] [INFO ] [MAIN ] Derivative Progress: 954/2083 symbols completed. IT took 1.1s. Estimated remaining: 6m 14s. Rate: 181.0 symbols/min [2025-09-15T21:17:07.986717] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:07.987361] [DEBUG] [LOCAL ] ITT: Loaded 23217 existing records from primary storage. [2025-09-15T21:17:08.003908] [INFO ] [MAIN ] ITT: Loaded 23217 primary data records. [2025-09-15T21:17:08.455763] [DEBUG] [LOCAL ] ITUB: Loaded 39382 existing records from primary storage. [2025-09-15T21:17:08.456861] [INFO ] [MAIN ] ITUB: Loaded 39382 primary data records. [2025-09-15T21:17:08.658228] [DEBUG] [MAIN ] ITGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:08.738472] [INFO ] [MAIN ] ITGR: Generated 1326 derivative records from 22027 primary records. [2025-09-15T21:17:08.750314] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-15T21:17:08.776140] [DEBUG] [MAIN ] ITT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:08.778255] [INFO ] [MAIN ] ITT: Generated 1326 derivative records from 23217 primary records. [2025-09-15T21:17:08.778544] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-15T21:17:08.790059] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1326 records). [2025-09-15T21:17:08.791927] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-15T21:17:08.796849] [INFO ] [MAIN ] Derivative Progress: 955/2083 symbols completed. ITGR took 1.0s. Estimated remaining: 6m 14s. Rate: 180.7 symbols/min [2025-09-15T21:17:08.798215] [DEBUG] [LOCAL ] ITT: Derivative data saved (1326 records). [2025-09-15T21:17:08.798102] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:08.799110] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-15T21:17:08.801909] [INFO ] [MAIN ] Derivative Progress: 956/2083 symbols completed. ITT took 1.0s. Estimated remaining: 6m 14s. Rate: 180.9 symbols/min [2025-09-15T21:17:08.802375] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:08.818197] [DEBUG] [MAIN ] ITUB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:08.818993] [INFO ] [MAIN ] ITUB: Generated 1326 derivative records from 39382 primary records. [2025-09-15T21:17:08.819116] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-15T21:17:08.842100] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1326 records). [2025-09-15T21:17:08.842337] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-15T21:17:08.846799] [INFO ] [MAIN ] Derivative Progress: 957/2083 symbols completed. ITUB took 0.9s. Estimated remaining: 6m 13s. Rate: 181.1 symbols/min [2025-09-15T21:17:08.847122] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:08.870494] [DEBUG] [LOCAL ] ITW: Loaded 33742 existing records from primary storage. [2025-09-15T21:17:08.870721] [INFO ] [MAIN ] ITW: Loaded 33742 primary data records. [2025-09-15T21:17:08.991432] [DEBUG] [LOCAL ] IVR: Loaded 34880 existing records from primary storage. [2025-09-15T21:17:09.008050] [INFO ] [MAIN ] IVR: Loaded 34880 primary data records. [2025-09-15T21:17:09.002754] [DEBUG] [LOCAL ] IVT: Loaded 22298 existing records from primary storage. [2025-09-15T21:17:09.018557] [INFO ] [MAIN ] IVT: Loaded 22298 primary data records. [2025-09-15T21:17:09.770126] [DEBUG] [MAIN ] ITW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:09.771604] [INFO ] [MAIN ] ITW: Generated 1326 derivative records from 33742 primary records. [2025-09-15T21:17:09.781480] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-15T21:17:09.782459] [DEBUG] [MAIN ] IVR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:09.783853] [INFO ] [MAIN ] IVR: Generated 1326 derivative records from 34880 primary records. [2025-09-15T21:17:09.784474] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-15T21:17:09.797565] [DEBUG] [LOCAL ] ITW: Derivative data saved (1326 records). [2025-09-15T21:17:09.804930] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-15T21:17:09.807877] [INFO ] [MAIN ] Derivative Progress: 958/2083 symbols completed. ITW took 1.0s. Estimated remaining: 6m 14s. Rate: 180.7 symbols/min [2025-09-15T21:17:09.821786] [DEBUG] [MAIN ] IVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:09.823176] [INFO ] [MAIN ] IVT: Generated 1326 derivative records from 22298 primary records. [2025-09-15T21:17:09.823618] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-15T21:17:09.830782] [DEBUG] [LOCAL ] IVR: Derivative data saved (1326 records). [2025-09-15T21:17:09.830868] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-15T21:17:09.833974] [INFO ] [MAIN ] Derivative Progress: 959/2083 symbols completed. IVR took 1.0s. Estimated remaining: 6m 13s. Rate: 180.9 symbols/min [2025-09-15T21:17:09.839216] [DEBUG] [LOCAL ] IVT: Derivative data saved (1326 records). [2025-09-15T21:17:09.839279] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-15T21:17:09.842074] [INFO ] [MAIN ] Derivative Progress: 960/2083 symbols completed. IVT took 1.0s. Estimated remaining: 6m 12s. Rate: 181.1 symbols/min [2025-09-15T21:17:09.842615] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:09.843014] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:09.842887] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:09.865620] [DEBUG] [LOCAL ] IX: Loaded 16193 existing records from primary storage. [2025-09-15T21:17:09.865853] [INFO ] [MAIN ] IX: Loaded 16193 primary data records. [2025-09-15T21:17:10.009919] [DEBUG] [LOCAL ] J: Loaded 29311 existing records from primary storage. [2025-09-15T21:17:10.026779] [INFO ] [MAIN ] J: Loaded 29311 primary data records. [2025-09-15T21:17:10.185304] [DEBUG] [LOCAL ] IVZ: Loaded 39170 existing records from primary storage. [2025-09-15T21:17:10.336757] [INFO ] [MAIN ] IVZ: Loaded 39170 primary data records. [2025-09-15T21:17:10.804092] [DEBUG] [MAIN ] IX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:10.805254] [INFO ] [MAIN ] IX: Generated 1326 derivative records from 16193 primary records. [2025-09-15T21:17:10.805815] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-15T21:17:10.819759] [DEBUG] [LOCAL ] IX: Derivative data saved (1326 records). [2025-09-15T21:17:10.820117] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-15T21:17:10.822135] [INFO ] [MAIN ] Derivative Progress: 961/2083 symbols completed. IX took 1.0s. Estimated remaining: 6m 13s. Rate: 180.7 symbols/min [2025-09-15T21:17:10.824272] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:10.835677] [DEBUG] [MAIN ] J: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:10.836748] [INFO ] [MAIN ] J: Generated 1326 derivative records from 29311 primary records. [2025-09-15T21:17:10.836870] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-15T21:17:10.859158] [DEBUG] [LOCAL ] J: Derivative data saved (1326 records). [2025-09-15T21:17:10.863926] [DEBUG] [MAIN ] IVZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:10.864095] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-15T21:17:10.864808] [INFO ] [MAIN ] IVZ: Generated 1326 derivative records from 39170 primary records. [2025-09-15T21:17:10.874753] [INFO ] [MAIN ] Derivative Progress: 962/2083 symbols completed. J took 1.0s. Estimated remaining: 6m 12s. Rate: 180.9 symbols/min [2025-09-15T21:17:10.874895] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-15T21:17:10.876021] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:10.898203] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1326 records). [2025-09-15T21:17:10.898432] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-15T21:17:10.898912] [DEBUG] [LOCAL ] JBGS: Loaded 31240 existing records from primary storage. [2025-09-15T21:17:10.900982] [INFO ] [MAIN ] Derivative Progress: 963/2083 symbols completed. IVZ took 1.1s. Estimated remaining: 6m 11s. Rate: 181.0 symbols/min [2025-09-15T21:17:10.901289] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:10.901366] [INFO ] [MAIN ] JBGS: Loaded 31240 primary data records. [2025-09-15T21:17:11.188866] [DEBUG] [LOCAL ] JBI: Loaded 31610 existing records from primary storage. [2025-09-15T21:17:11.189890] [INFO ] [MAIN ] JBI: Loaded 31610 primary data records. [2025-09-15T21:17:11.299839] [DEBUG] [LOCAL ] JBL: Loaded 35106 existing records from primary storage. [2025-09-15T21:17:11.312270] [INFO ] [MAIN ] JBL: Loaded 35106 primary data records. [2025-09-15T21:17:11.777955] [DEBUG] [MAIN ] JBGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:11.781487] [INFO ] [MAIN ] JBGS: Generated 1326 derivative records from 31240 primary records. [2025-09-15T21:17:11.782115] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-15T21:17:11.796382] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1326 records). [2025-09-15T21:17:11.796902] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-15T21:17:11.799997] [INFO ] [MAIN ] Derivative Progress: 964/2083 symbols completed. JBGS took 1.0s. Estimated remaining: 6m 12s. Rate: 180.7 symbols/min [2025-09-15T21:17:11.800478] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:11.816869] [DEBUG] [MAIN ] JBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:11.817903] [INFO ] [MAIN ] JBI: Generated 1326 derivative records from 31610 primary records. [2025-09-15T21:17:11.818190] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-15T21:17:11.831481] [DEBUG] [LOCAL ] JBI: Derivative data saved (1326 records). [2025-09-15T21:17:11.836864] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-15T21:17:11.838560] [INFO ] [MAIN ] Derivative Progress: 965/2083 symbols completed. JBI took 1.0s. Estimated remaining: 6m 11s. Rate: 180.9 symbols/min [2025-09-15T21:17:11.839348] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:11.850602] [DEBUG] [LOCAL ] JBND: Loaded 18819 existing records from primary storage. [2025-09-15T21:17:11.850952] [INFO ] [MAIN ] JBND: Loaded 18819 primary data records. [2025-09-15T21:17:11.882786] [DEBUG] [MAIN ] JBL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:11.940855] [INFO ] [MAIN ] JBL: Generated 1326 derivative records from 35106 primary records. [2025-09-15T21:17:11.963369] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-15T21:17:12.044577] [DEBUG] [LOCAL ] JBL: Derivative data saved (1326 records). [2025-09-15T21:17:12.079304] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-15T21:17:12.082544] [INFO ] [MAIN ] Derivative Progress: 966/2083 symbols completed. JBL took 1.2s. Estimated remaining: 6m 10s. Rate: 180.9 symbols/min [2025-09-15T21:17:12.167536] [DEBUG] [LOCAL ] JBTM: Loaded 23791 existing records from primary storage. [2025-09-15T21:17:12.168274] [INFO ] [MAIN ] JBTM: Loaded 23791 primary data records. [2025-09-15T21:17:12.168086] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:12.276874] [DEBUG] [LOCAL ] JCE: Loaded 4686 existing records from primary storage. [2025-09-15T21:17:12.280550] [INFO ] [MAIN ] JCE: Loaded 4686 primary data records. [2025-09-15T21:17:12.714281] [DEBUG] [MAIN ] JBND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:12.783091] [INFO ] [MAIN ] JBND: Generated 1326 derivative records from 18819 primary records. [2025-09-15T21:17:12.807594] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-15T21:17:12.826607] [DEBUG] [LOCAL ] JBND: Derivative data saved (1326 records). [2025-09-15T21:17:12.827632] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-15T21:17:12.829421] [INFO ] [MAIN ] Derivative Progress: 967/2083 symbols completed. JBND took 1.0s. Estimated remaining: 6m 11s. Rate: 180.7 symbols/min [2025-09-15T21:17:12.838987] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:12.840400] [DEBUG] [MAIN ] JBTM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:12.841881] [INFO ] [MAIN ] JBTM: Generated 1326 derivative records from 23791 primary records. [2025-09-15T21:17:12.842139] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-09-15T21:17:12.856263] [DEBUG] [LOCAL ] JBTM: Derivative data saved (1326 records). [2025-09-15T21:17:12.856485] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-09-15T21:17:12.858916] [INFO ] [MAIN ] Derivative Progress: 968/2083 symbols completed. JBTM took 1.0s. Estimated remaining: 6m 10s. Rate: 180.9 symbols/min [2025-09-15T21:17:12.859325] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:12.873788] [DEBUG] [MAIN ] JCE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:12.875682] [INFO ] [MAIN ] JCE: Generated 1326 derivative records from 4686 primary records. [2025-09-15T21:17:12.875954] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-15T21:17:12.899742] [DEBUG] [LOCAL ] JCE: Derivative data saved (1326 records). [2025-09-15T21:17:12.899898] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-15T21:17:12.905114] [INFO ] [MAIN ] Derivative Progress: 969/2083 symbols completed. JCE took 0.7s. Estimated remaining: 6m 9s. Rate: 181.0 symbols/min [2025-09-15T21:17:12.905556] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:12.930090] [DEBUG] [LOCAL ] JCI: Loaded 39530 existing records from primary storage. [2025-09-15T21:17:12.930388] [INFO ] [MAIN ] JCI: Loaded 39530 primary data records. [2025-09-15T21:17:13.060860] [DEBUG] [LOCAL ] JEF: Loaded 36411 existing records from primary storage. [2025-09-15T21:17:13.071539] [INFO ] [MAIN ] JEF: Loaded 36411 primary data records. [2025-09-15T21:17:13.302824] [DEBUG] [LOCAL ] JELD: Loaded 34097 existing records from primary storage. [2025-09-15T21:17:13.309154] [INFO ] [MAIN ] JELD: Loaded 34097 primary data records. [2025-09-15T21:17:13.800206] [DEBUG] [MAIN ] JCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:13.801705] [INFO ] [MAIN ] JCI: Generated 1326 derivative records from 39530 primary records. [2025-09-15T21:17:13.802519] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-15T21:17:13.827398] [DEBUG] [MAIN ] JEF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:13.829926] [INFO ] [MAIN ] JEF: Generated 1326 derivative records from 36411 primary records. [2025-09-15T21:17:13.830321] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-15T21:17:13.831261] [DEBUG] [LOCAL ] JCI: Derivative data saved (1326 records). [2025-09-15T21:17:13.831654] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-15T21:17:13.834413] [INFO ] [MAIN ] Derivative Progress: 970/2083 symbols completed. JCI took 1.0s. Estimated remaining: 6m 10s. Rate: 180.7 symbols/min [2025-09-15T21:17:13.841879] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:13.858627] [DEBUG] [MAIN ] JELD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:13.861289] [INFO ] [MAIN ] JELD: Generated 1326 derivative records from 34097 primary records. [2025-09-15T21:17:13.861388] [DEBUG] [LOCAL ] JEF: Derivative data saved (1326 records). [2025-09-15T21:17:13.861499] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-15T21:17:13.861582] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-15T21:17:13.864000] [INFO ] [MAIN ] Derivative Progress: 971/2083 symbols completed. JEF took 1.0s. Estimated remaining: 6m 9s. Rate: 180.9 symbols/min [2025-09-15T21:17:13.864989] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:13.874836] [DEBUG] [LOCAL ] JEQ: Loaded 5801 existing records from primary storage. [2025-09-15T21:17:13.878890] [INFO ] [MAIN ] JEQ: Loaded 5801 primary data records. [2025-09-15T21:17:13.881259] [DEBUG] [LOCAL ] JELD: Derivative data saved (1326 records). [2025-09-15T21:17:13.892975] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-15T21:17:13.945801] [INFO ] [MAIN ] Derivative Progress: 972/2083 symbols completed. JELD took 1.0s. Estimated remaining: 6m 8s. Rate: 181.0 symbols/min [2025-09-15T21:17:13.967246] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:14.035954] [DEBUG] [LOCAL ] JFR: Loaded 21424 existing records from primary storage. [2025-09-15T21:17:14.063853] [INFO ] [MAIN ] JFR: Loaded 21424 primary data records. [2025-09-15T21:17:14.272823] [DEBUG] [LOCAL ] JGH: Loaded 8029 existing records from primary storage. [2025-09-15T21:17:14.276846] [INFO ] [MAIN ] JGH: Loaded 8029 primary data records. [2025-09-15T21:17:14.788249] [DEBUG] [MAIN ] JEQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:14.789135] [INFO ] [MAIN ] JEQ: Generated 1326 derivative records from 5801 primary records. [2025-09-15T21:17:14.789335] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-15T21:17:14.806677] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1326 records). [2025-09-15T21:17:14.817187] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-15T21:17:14.817009] [DEBUG] [MAIN ] JFR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:14.819731] [INFO ] [MAIN ] Derivative Progress: 973/2083 symbols completed. JEQ took 1.0s. Estimated remaining: 6m 9s. Rate: 180.7 symbols/min [2025-09-15T21:17:14.820603] [INFO ] [MAIN ] JFR: Generated 1326 derivative records from 21424 primary records. [2025-09-15T21:17:14.820979] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-15T21:17:14.835898] [DEBUG] [LOCAL ] JFR: Derivative data saved (1326 records). [2025-09-15T21:17:14.836088] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-15T21:17:14.848209] [INFO ] [MAIN ] Derivative Progress: 974/2083 symbols completed. JFR took 1.0s. Estimated remaining: 6m 8s. Rate: 180.9 symbols/min [2025-09-15T21:17:14.846087] [DEBUG] [MAIN ] JGH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:14.849137] [INFO ] [MAIN ] JGH: Generated 1326 derivative records from 8029 primary records. [2025-09-15T21:17:14.849205] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-15T21:17:14.862078] [DEBUG] [LOCAL ] JGH: Derivative data saved (1326 records). [2025-09-15T21:17:14.862157] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-15T21:17:14.864273] [INFO ] [MAIN ] Derivative Progress: 975/2083 symbols completed. JGH took 0.9s. Estimated remaining: 6m 7s. Rate: 181.0 symbols/min [2025-09-15T21:17:14.865126] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:14.865034] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:14.864914] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:14.871864] [DEBUG] [LOCAL ] JHS: Loaded 2257 existing records from primary storage. [2025-09-15T21:17:14.873703] [DEBUG] [LOCAL ] JHI: Loaded 2473 existing records from primary storage. [2025-09-15T21:17:14.873887] [INFO ] [MAIN ] JHS: Loaded 2257 primary data records. [2025-09-15T21:17:14.873964] [INFO ] [MAIN ] JHI: Loaded 2473 primary data records. [2025-09-15T21:17:15.438316] [DEBUG] [LOCAL ] JHG: Loaded 35163 existing records from primary storage. [2025-09-15T21:17:15.440012] [INFO ] [MAIN ] JHG: Loaded 35163 primary data records. [2025-09-15T21:17:15.729903] [DEBUG] [MAIN ] JHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:15.732453] [INFO ] [MAIN ] JHI: Generated 1326 derivative records from 2473 primary records. [2025-09-15T21:17:15.733968] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-15T21:17:15.754668] [DEBUG] [LOCAL ] JHI: Derivative data saved (1326 records). [2025-09-15T21:17:15.758920] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-15T21:17:15.759215] [DEBUG] [MAIN ] JHS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:15.761974] [INFO ] [MAIN ] Derivative Progress: 976/2083 symbols completed. JHI took 0.9s. Estimated remaining: 6m 8s. Rate: 180.7 symbols/min [2025-09-15T21:17:15.763020] [INFO ] [MAIN ] JHS: Generated 1326 derivative records from 2257 primary records. [2025-09-15T21:17:15.763137] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-15T21:17:15.764163] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:15.775679] [DEBUG] [LOCAL ] JHS: Derivative data saved (1326 records). [2025-09-15T21:17:15.775904] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-15T21:17:15.777820] [INFO ] [MAIN ] Derivative Progress: 977/2083 symbols completed. JHS took 0.9s. Estimated remaining: 6m 7s. Rate: 180.9 symbols/min [2025-09-15T21:17:15.778464] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:15.791775] [DEBUG] [MAIN ] JHG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:15.792453] [INFO ] [MAIN ] JHG: Generated 1326 derivative records from 35163 primary records. [2025-09-15T21:17:15.792577] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-15T21:17:15.813914] [DEBUG] [LOCAL ] JILL: Loaded 11480 existing records from primary storage. [2025-09-15T21:17:15.813820] [DEBUG] [LOCAL ] JHG: Derivative data saved (1326 records). [2025-09-15T21:17:15.814160] [INFO ] [MAIN ] JILL: Loaded 11480 primary data records. [2025-09-15T21:17:15.814218] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-15T21:17:15.828030] [INFO ] [MAIN ] Derivative Progress: 978/2083 symbols completed. JHG took 1.0s. Estimated remaining: 6m 6s. Rate: 181.1 symbols/min [2025-09-15T21:17:15.828239] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:16.007968] [DEBUG] [LOCAL ] JHX: Loaded 39218 existing records from primary storage. [2025-09-15T21:17:16.029196] [INFO ] [MAIN ] JHX: Loaded 39218 primary data records. [2025-09-15T21:17:16.204799] [DEBUG] [LOCAL ] JKS: Loaded 28310 existing records from primary storage. [2025-09-15T21:17:16.223969] [INFO ] [MAIN ] JKS: Loaded 28310 primary data records. [2025-09-15T21:17:16.731096] [DEBUG] [MAIN ] JILL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:16.733056] [INFO ] [MAIN ] JILL: Generated 1326 derivative records from 11480 primary records. [2025-09-15T21:17:16.733791] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-15T21:17:16.748020] [DEBUG] [LOCAL ] JILL: Derivative data saved (1326 records). [2025-09-15T21:17:16.748322] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-15T21:17:16.750519] [INFO ] [MAIN ] Derivative Progress: 979/2083 symbols completed. JILL took 1.0s. Estimated remaining: 6m 6s. Rate: 180.7 symbols/min [2025-09-15T21:17:16.752701] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:16.765305] [DEBUG] [MAIN ] JHX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:16.767732] [INFO ] [MAIN ] JHX: Generated 1326 derivative records from 39218 primary records. [2025-09-15T21:17:16.777292] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-15T21:17:16.777250] [DEBUG] [MAIN ] JKS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:16.778362] [INFO ] [MAIN ] JKS: Generated 1326 derivative records from 28310 primary records. [2025-09-15T21:17:16.778695] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-15T21:17:16.800335] [DEBUG] [LOCAL ] JKS: Derivative data saved (1326 records). [2025-09-15T21:17:16.806085] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-15T21:17:16.808330] [INFO ] [MAIN ] Derivative Progress: 980/2083 symbols completed. JKS took 1.0s. Estimated remaining: 6m 6s. Rate: 180.9 symbols/min [2025-09-15T21:17:16.809758] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:16.810398] [DEBUG] [LOCAL ] JHX: Derivative data saved (1326 records). [2025-09-15T21:17:16.810575] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-15T21:17:16.812434] [INFO ] [MAIN ] Derivative Progress: 981/2083 symbols completed. JHX took 1.0s. Estimated remaining: 6m 5s. Rate: 181.1 symbols/min [2025-09-15T21:17:16.813062] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:16.823493] [DEBUG] [LOCAL ] JLL: Loaded 23872 existing records from primary storage. [2025-09-15T21:17:16.823687] [INFO ] [MAIN ] JLL: Loaded 23872 primary data records. [2025-09-15T21:17:16.858080] [DEBUG] [LOCAL ] JLS: Loaded 2854 existing records from primary storage. [2025-09-15T21:17:16.890718] [INFO ] [MAIN ] JLS: Loaded 2854 primary data records. [2025-09-15T21:17:17.331487] [DEBUG] [LOCAL ] JMIA: Loaded 37586 existing records from primary storage. [2025-09-15T21:17:17.334156] [INFO ] [MAIN ] JMIA: Loaded 37586 primary data records. [2025-09-15T21:17:17.712901] [DEBUG] [MAIN ] JLL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:17.714368] [INFO ] [MAIN ] JLL: Generated 1326 derivative records from 23872 primary records. [2025-09-15T21:17:17.715451] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-15T21:17:17.738884] [DEBUG] [MAIN ] JLS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:17.742841] [INFO ] [MAIN ] JLS: Generated 1326 derivative records from 2854 primary records. [2025-09-15T21:17:17.742011] [DEBUG] [LOCAL ] JLL: Derivative data saved (1326 records). [2025-09-15T21:17:17.743046] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-15T21:17:17.743005] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-15T21:17:17.745802] [INFO ] [MAIN ] Derivative Progress: 982/2083 symbols completed. JLL took 1.0s. Estimated remaining: 6m 6s. Rate: 180.7 symbols/min [2025-09-15T21:17:17.752525] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:17.758498] [DEBUG] [LOCAL ] JLS: Derivative data saved (1326 records). [2025-09-15T21:17:17.759159] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-15T21:17:17.761461] [INFO ] [MAIN ] Derivative Progress: 983/2083 symbols completed. JLS took 1.0s. Estimated remaining: 6m 5s. Rate: 180.9 symbols/min [2025-09-15T21:17:17.761913] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:17.771583] [DEBUG] [MAIN ] JMIA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:17.772718] [INFO ] [MAIN ] JMIA: Generated 1326 derivative records from 37586 primary records. [2025-09-15T21:17:17.773131] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-15T21:17:17.786587] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1326 records). [2025-09-15T21:17:17.786769] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-15T21:17:17.788861] [INFO ] [MAIN ] Derivative Progress: 984/2083 symbols completed. JMIA took 1.0s. Estimated remaining: 6m 4s. Rate: 181.1 symbols/min [2025-09-15T21:17:17.789335] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:17.826039] [DEBUG] [LOCAL ] JOE: Loaded 17669 existing records from primary storage. [2025-09-15T21:17:17.826172] [INFO ] [MAIN ] JOE: Loaded 17669 primary data records. [2025-09-15T21:17:17.942651] [DEBUG] [LOCAL ] JNJ: Loaded 39713 existing records from primary storage. [2025-09-15T21:17:17.953368] [INFO ] [MAIN ] JNJ: Loaded 39713 primary data records. [2025-09-15T21:17:17.954037] [DEBUG] [LOCAL ] JOBY: Loaded 39771 existing records from primary storage. [2025-09-15T21:17:17.970154] [INFO ] [MAIN ] JOBY: Loaded 39771 primary data records. [2025-09-15T21:17:18.669074] [DEBUG] [MAIN ] JOE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:18.669976] [INFO ] [MAIN ] JOE: Generated 1326 derivative records from 17669 primary records. [2025-09-15T21:17:18.670184] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-15T21:17:18.694945] [DEBUG] [MAIN ] JOBY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:18.697301] [INFO ] [MAIN ] JOBY: Generated 1326 derivative records from 39771 primary records. [2025-09-15T21:17:18.703302] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-15T21:17:18.703657] [DEBUG] [LOCAL ] JOE: Derivative data saved (1326 records). [2025-09-15T21:17:18.707709] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-15T21:17:18.715231] [INFO ] [MAIN ] Derivative Progress: 985/2083 symbols completed. JOE took 0.9s. Estimated remaining: 6m 4s. Rate: 180.8 symbols/min [2025-09-15T21:17:18.708304] [DEBUG] [MAIN ] JNJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:18.717071] [INFO ] [MAIN ] JNJ: Generated 1326 derivative records from 39713 primary records. [2025-09-15T21:17:18.719136] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:18.719213] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-15T21:17:18.723074] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1326 records). [2025-09-15T21:17:18.723428] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-15T21:17:18.725627] [INFO ] [MAIN ] Derivative Progress: 986/2083 symbols completed. JOBY took 1.0s. Estimated remaining: 6m 4s. Rate: 180.9 symbols/min [2025-09-15T21:17:18.731737] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:18.741682] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1326 records). [2025-09-15T21:17:18.741875] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-15T21:17:18.744049] [INFO ] [MAIN ] Derivative Progress: 987/2083 symbols completed. JNJ took 1.0s. Estimated remaining: 6m 3s. Rate: 181.1 symbols/min [2025-09-15T21:17:18.747414] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:18.747775] [DEBUG] [LOCAL ] JOF: Loaded 5046 existing records from primary storage. [2025-09-15T21:17:18.748777] [INFO ] [MAIN ] JOF: Loaded 5046 primary data records. [2025-09-15T21:17:18.846933] [DEBUG] [LOCAL ] JPI: Loaded 3826 existing records from primary storage. [2025-09-15T21:17:18.863816] [INFO ] [MAIN ] JPI: Loaded 3826 primary data records. [2025-09-15T21:17:18.929206] [DEBUG] [LOCAL ] JPC: Loaded 26736 existing records from primary storage. [2025-09-15T21:17:19.015995] [INFO ] [MAIN ] JPC: Loaded 26736 primary data records. [2025-09-15T21:17:19.686015] [DEBUG] [MAIN ] JOF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:19.687948] [INFO ] [MAIN ] JOF: Generated 1326 derivative records from 5046 primary records. [2025-09-15T21:17:19.688705] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-15T21:17:19.735880] [DEBUG] [MAIN ] JPI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:19.738178] [INFO ] [MAIN ] JPI: Generated 1326 derivative records from 3826 primary records. [2025-09-15T21:17:19.738693] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-15T21:17:19.739760] [DEBUG] [LOCAL ] JOF: Derivative data saved (1326 records). [2025-09-15T21:17:19.736199] [DEBUG] [MAIN ] JPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:19.740776] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-15T21:17:19.743799] [INFO ] [MAIN ] Derivative Progress: 988/2083 symbols completed. JOF took 1.0s. Estimated remaining: 6m 4s. Rate: 180.7 symbols/min [2025-09-15T21:17:19.757121] [DEBUG] [LOCAL ] JPI: Derivative data saved (1326 records). [2025-09-15T21:17:19.754287] [INFO ] [MAIN ] JPC: Generated 1326 derivative records from 26736 primary records. [2025-09-15T21:17:19.757261] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-15T21:17:19.760624] [INFO ] [MAIN ] Derivative Progress: 989/2083 symbols completed. JPI took 1.0s. Estimated remaining: 6m 3s. Rate: 180.9 symbols/min [2025-09-15T21:17:19.757332] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-15T21:17:19.780042] [DEBUG] [LOCAL ] JPC: Derivative data saved (1326 records). [2025-09-15T21:17:19.780243] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-15T21:17:19.785065] [INFO ] [MAIN ] Derivative Progress: 990/2083 symbols completed. JPC took 1.1s. Estimated remaining: 6m 2s. Rate: 181.1 symbols/min [2025-09-15T21:17:19.785765] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:19.785959] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:19.787082] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:19.800762] [DEBUG] [LOCAL ] JRI: Loaded 11077 existing records from primary storage. [2025-09-15T21:17:19.800946] [INFO ] [MAIN ] JRI: Loaded 11077 primary data records. [2025-09-15T21:17:19.941230] [DEBUG] [LOCAL ] JQC: Loaded 24051 existing records from primary storage. [2025-09-15T21:17:19.988706] [INFO ] [MAIN ] JQC: Loaded 24051 primary data records. [2025-09-15T21:17:20.160554] [DEBUG] [LOCAL ] JPM: Loaded 39754 existing records from primary storage. [2025-09-15T21:17:20.177947] [INFO ] [MAIN ] JPM: Loaded 39754 primary data records. [2025-09-15T21:17:20.685963] [DEBUG] [MAIN ] JRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:20.687465] [INFO ] [MAIN ] JRI: Generated 1326 derivative records from 11077 primary records. [2025-09-15T21:17:20.688084] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-15T21:17:20.704752] [DEBUG] [LOCAL ] JRI: Derivative data saved (1326 records). [2025-09-15T21:17:20.704938] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-15T21:17:20.706549] [INFO ] [MAIN ] Derivative Progress: 991/2083 symbols completed. JRI took 0.9s. Estimated remaining: 6m 2s. Rate: 180.8 symbols/min [2025-09-15T21:17:20.707043] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:20.733715] [DEBUG] [MAIN ] JQC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:20.734976] [INFO ] [MAIN ] JQC: Generated 1326 derivative records from 24051 primary records. [2025-09-15T21:17:20.734325] [DEBUG] [MAIN ] JPM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:20.735698] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-15T21:17:20.735619] [INFO ] [MAIN ] JPM: Generated 1326 derivative records from 39754 primary records. [2025-09-15T21:17:20.736418] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-15T21:17:20.762081] [DEBUG] [LOCAL ] JRS: Loaded 8279 existing records from primary storage. [2025-09-15T21:17:20.758116] [DEBUG] [LOCAL ] JPM: Derivative data saved (1326 records). [2025-09-15T21:17:20.762699] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-15T21:17:20.762751] [INFO ] [MAIN ] JRS: Loaded 8279 primary data records. [2025-09-15T21:17:20.766377] [INFO ] [MAIN ] Derivative Progress: 992/2083 symbols completed. JPM took 1.0s. Estimated remaining: 6m 2s. Rate: 180.9 symbols/min [2025-09-15T21:17:20.778158] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:20.854725] [DEBUG] [LOCAL ] JQC: Derivative data saved (1326 records). [2025-09-15T21:17:20.875452] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-15T21:17:20.882161] [INFO ] [MAIN ] Derivative Progress: 993/2083 symbols completed. JQC took 1.1s. Estimated remaining: 6m 1s. Rate: 181.0 symbols/min [2025-09-15T21:17:20.882867] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:21.065477] [DEBUG] [LOCAL ] JXN: Loaded 32954 existing records from primary storage. [2025-09-15T21:17:21.065769] [INFO ] [MAIN ] JXN: Loaded 32954 primary data records. [2025-09-15T21:17:21.253216] [DEBUG] [LOCAL ] K: Loaded 37003 existing records from primary storage. [2025-09-15T21:17:21.274160] [INFO ] [MAIN ] K: Loaded 37003 primary data records. [2025-09-15T21:17:21.598070] [DEBUG] [MAIN ] JRS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:21.727937] [INFO ] [MAIN ] JRS: Generated 1326 derivative records from 8279 primary records. [2025-09-15T21:17:21.740199] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-15T21:17:21.760928] [DEBUG] [LOCAL ] JRS: Derivative data saved (1326 records). [2025-09-15T21:17:21.761282] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-15T21:17:21.763126] [INFO ] [MAIN ] Derivative Progress: 994/2083 symbols completed. JRS took 1.1s. Estimated remaining: 6m 2s. Rate: 180.7 symbols/min [2025-09-15T21:17:21.763374] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:21.773805] [DEBUG] [MAIN ] JXN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:21.774709] [INFO ] [MAIN ] JXN: Generated 1326 derivative records from 32954 primary records. [2025-09-15T21:17:21.774871] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-15T21:17:21.791683] [DEBUG] [LOCAL ] JXN: Derivative data saved (1326 records). [2025-09-15T21:17:21.791951] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-15T21:17:21.793933] [INFO ] [MAIN ] Derivative Progress: 995/2083 symbols completed. JXN took 1.0s. Estimated remaining: 6m 1s. Rate: 180.9 symbols/min [2025-09-15T21:17:21.794448] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:21.799471] [DEBUG] [LOCAL ] KAI: Loaded 9742 existing records from primary storage. [2025-09-15T21:17:21.799950] [INFO ] [MAIN ] KAI: Loaded 9742 primary data records. [2025-09-15T21:17:22.000390] [DEBUG] [MAIN ] K: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:22.085388] [INFO ] [MAIN ] K: Generated 1326 derivative records from 37003 primary records. [2025-09-15T21:17:22.086156] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-15T21:17:22.108327] [DEBUG] [LOCAL ] KAR: Loaded 29474 existing records from primary storage. [2025-09-15T21:17:22.112082] [INFO ] [MAIN ] KAR: Loaded 29474 primary data records. [2025-09-15T21:17:22.111818] [DEBUG] [LOCAL ] K: Derivative data saved (1326 records). [2025-09-15T21:17:22.118077] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-15T21:17:22.148110] [INFO ] [MAIN ] Derivative Progress: 996/2083 symbols completed. K took 1.3s. Estimated remaining: 6m 1s. Rate: 180.9 symbols/min [2025-09-15T21:17:22.167186] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:22.406293] [DEBUG] [LOCAL ] KB: Loaded 17840 existing records from primary storage. [2025-09-15T21:17:22.420891] [INFO ] [MAIN ] KB: Loaded 17840 primary data records. [2025-09-15T21:17:22.430322] [DEBUG] [MAIN ] KAI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:22.452522] [INFO ] [MAIN ] KAI: Generated 1326 derivative records from 9742 primary records. [2025-09-15T21:17:22.468628] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-15T21:17:22.502305] [DEBUG] [LOCAL ] KAI: Derivative data saved (1326 records). [2025-09-15T21:17:22.511742] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-15T21:17:22.531511] [INFO ] [MAIN ] Derivative Progress: 997/2083 symbols completed. KAI took 0.8s. Estimated remaining: 6m 0s. Rate: 180.8 symbols/min [2025-09-15T21:17:22.537051] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:22.745718] [DEBUG] [LOCAL ] KBDC: Loaded 14554 existing records from primary storage. [2025-09-15T21:17:22.746196] [INFO ] [MAIN ] KBDC: Loaded 14554 primary data records. [2025-09-15T21:17:22.872997] [DEBUG] [MAIN ] KAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:22.929492] [INFO ] [MAIN ] KAR: Generated 1326 derivative records from 29474 primary records. [2025-09-15T21:17:22.963570] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-15T21:17:23.075744] [DEBUG] [LOCAL ] KAR: Derivative data saved (1326 records). [2025-09-15T21:17:23.077211] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-15T21:17:23.079504] [INFO ] [MAIN ] Derivative Progress: 998/2083 symbols completed. KAR took 1.3s. Estimated remaining: 6m 0s. Rate: 180.7 symbols/min [2025-09-15T21:17:23.091860] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:23.092331] [DEBUG] [MAIN ] KB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:23.094799] [INFO ] [MAIN ] KB: Generated 1326 derivative records from 17840 primary records. [2025-09-15T21:17:23.095828] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-15T21:17:23.111310] [DEBUG] [LOCAL ] KB: Derivative data saved (1326 records). [2025-09-15T21:17:23.111784] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-15T21:17:23.113786] [INFO ] [MAIN ] Derivative Progress: 999/2083 symbols completed. KB took 0.9s. Estimated remaining: 5m 60s. Rate: 180.9 symbols/min [2025-09-15T21:17:23.114190] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:23.132594] [DEBUG] [MAIN ] KBDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:23.133704] [INFO ] [MAIN ] KBDC: Generated 1326 derivative records from 14554 primary records. [2025-09-15T21:17:23.133866] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-15T21:17:23.160280] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1326 records). [2025-09-15T21:17:23.168411] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-15T21:17:23.171790] [INFO ] [MAIN ] Derivative Progress: 1000/2083 symbols completed. KBDC took 0.6s. Estimated remaining: 5m 59s. Rate: 181.0 symbols/min [2025-09-15T21:17:23.172298] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:23.186274] [DEBUG] [LOCAL ] KBH: Loaded 35669 existing records from primary storage. [2025-09-15T21:17:23.186503] [INFO ] [MAIN ] KBH: Loaded 35669 primary data records. [2025-09-15T21:17:23.262410] [DEBUG] [LOCAL ] KBR: Loaded 35623 existing records from primary storage. [2025-09-15T21:17:23.276537] [INFO ] [MAIN ] KBR: Loaded 35623 primary data records. [2025-09-15T21:17:23.529250] [DEBUG] [LOCAL ] KD: Loaded 38505 existing records from primary storage. [2025-09-15T21:17:23.568023] [INFO ] [MAIN ] KD: Loaded 38505 primary data records. [2025-09-15T21:17:24.216420] [DEBUG] [MAIN ] KBH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:24.218477] [INFO ] [MAIN ] KBH: Generated 1326 derivative records from 35669 primary records. [2025-09-15T21:17:24.218719] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-15T21:17:24.236166] [DEBUG] [LOCAL ] KBH: Derivative data saved (1326 records). [2025-09-15T21:17:24.242423] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-15T21:17:24.248843] [DEBUG] [MAIN ] KBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:24.249922] [INFO ] [MAIN ] KBR: Generated 1326 derivative records from 35623 primary records. [2025-09-15T21:17:24.248422] [INFO ] [MAIN ] Derivative Progress: 1001/2083 symbols completed. KBH took 1.2s. Estimated remaining: 5m 59s. Rate: 180.6 symbols/min [2025-09-15T21:17:24.251332] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:24.250023] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-15T21:17:24.270427] [DEBUG] [LOCAL ] KEN: Loaded 3286 existing records from primary storage. [2025-09-15T21:17:24.267597] [DEBUG] [LOCAL ] KBR: Derivative data saved (1326 records). [2025-09-15T21:17:24.270564] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-15T21:17:24.270901] [INFO ] [MAIN ] KEN: Loaded 3286 primary data records. [2025-09-15T21:17:24.272799] [INFO ] [MAIN ] Derivative Progress: 1002/2083 symbols completed. KBR took 1.2s. Estimated remaining: 5m 59s. Rate: 180.8 symbols/min [2025-09-15T21:17:24.331569] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:24.341325] [DEBUG] [MAIN ] KD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:24.369918] [INFO ] [MAIN ] KD: Generated 1326 derivative records from 38505 primary records. [2025-09-15T21:17:24.389027] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-15T21:17:24.493308] [DEBUG] [LOCAL ] KD: Derivative data saved (1326 records). [2025-09-15T21:17:24.496354] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-15T21:17:24.499144] [INFO ] [MAIN ] Derivative Progress: 1003/2083 symbols completed. KD took 1.3s. Estimated remaining: 5m 58s. Rate: 180.9 symbols/min [2025-09-15T21:17:24.594877] [DEBUG] [LOCAL ] KEP: Loaded 24216 existing records from primary storage. [2025-09-15T21:17:24.595984] [INFO ] [MAIN ] KEP: Loaded 24216 primary data records. [2025-09-15T21:17:24.888140] [DEBUG] [MAIN ] KEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:24.889003] [INFO ] [MAIN ] KEN: Generated 1326 derivative records from 3286 primary records. [2025-09-15T21:17:24.889604] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-15T21:17:24.902556] [DEBUG] [LOCAL ] KEN: Derivative data saved (1326 records). [2025-09-15T21:17:24.902992] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-15T21:17:24.905313] [INFO ] [MAIN ] Derivative Progress: 1004/2083 symbols completed. KEN took 0.7s. Estimated remaining: 5m 58s. Rate: 180.8 symbols/min [2025-09-15T21:17:24.920552] [DEBUG] [MAIN ] KEP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:24.921362] [INFO ] [MAIN ] KEP: Generated 1326 derivative records from 24216 primary records. [2025-09-15T21:17:24.921431] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-15T21:17:24.934021] [DEBUG] [LOCAL ] KEP: Derivative data saved (1326 records). [2025-09-15T21:17:24.934090] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-15T21:17:24.937068] [INFO ] [MAIN ] Derivative Progress: 1005/2083 symbols completed. KEP took 0.6s. Estimated remaining: 5m 57s. Rate: 181.0 symbols/min [2025-09-15T21:17:24.937949] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:24.938212] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:24.938983] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:24.948903] [DEBUG] [LOCAL ] KF: Loaded 1744 existing records from primary storage. [2025-09-15T21:17:24.949269] [INFO ] [MAIN ] KF: Loaded 1744 primary data records. [2025-09-15T21:17:25.193061] [DEBUG] [LOCAL ] KEX: Loaded 27514 existing records from primary storage. [2025-09-15T21:17:25.274433] [DEBUG] [LOCAL ] KEYS: Loaded 31401 existing records from primary storage. [2025-09-15T21:17:25.280681] [INFO ] [MAIN ] KEX: Loaded 27514 primary data records. [2025-09-15T21:17:25.281090] [INFO ] [MAIN ] KEYS: Loaded 31401 primary data records. [2025-09-15T21:17:25.891573] [DEBUG] [MAIN ] KF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:25.893454] [INFO ] [MAIN ] KF: Generated 1326 derivative records from 1744 primary records. [2025-09-15T21:17:25.893740] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-15T21:17:25.907674] [DEBUG] [LOCAL ] KF: Derivative data saved (1326 records). [2025-09-15T21:17:25.908189] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-15T21:17:25.910482] [INFO ] [MAIN ] Derivative Progress: 1006/2083 symbols completed. KF took 1.0s. Estimated remaining: 5m 58s. Rate: 180.6 symbols/min [2025-09-15T21:17:25.911169] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:25.933865] [DEBUG] [MAIN ] KEYS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:25.934936] [INFO ] [MAIN ] KEYS: Generated 1326 derivative records from 31401 primary records. [2025-09-15T21:17:25.943691] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-15T21:17:25.945375] [DEBUG] [MAIN ] KEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:25.952734] [INFO ] [MAIN ] KEX: Generated 1326 derivative records from 27514 primary records. [2025-09-15T21:17:25.953514] [DEBUG] [LOCAL ] KFRC: Loaded 14809 existing records from primary storage. [2025-09-15T21:17:25.953717] [INFO ] [MAIN ] KFRC: Loaded 14809 primary data records. [2025-09-15T21:17:25.953910] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-15T21:17:26.014975] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1326 records). [2025-09-15T21:17:26.027627] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-15T21:17:26.053287] [INFO ] [MAIN ] Derivative Progress: 1007/2083 symbols completed. KEYS took 1.1s. Estimated remaining: 5m 57s. Rate: 180.7 symbols/min [2025-09-15T21:17:26.091885] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:26.072354] [DEBUG] [LOCAL ] KEX: Derivative data saved (1326 records). [2025-09-15T21:17:26.092577] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-15T21:17:26.111290] [INFO ] [MAIN ] Derivative Progress: 1008/2083 symbols completed. KEX took 1.2s. Estimated remaining: 5m 57s. Rate: 180.9 symbols/min [2025-09-15T21:17:26.122263] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:26.261182] [DEBUG] [LOCAL ] KFS: Loaded 6290 existing records from primary storage. [2025-09-15T21:17:26.261949] [INFO ] [MAIN ] KFS: Loaded 6290 primary data records. [2025-09-15T21:17:26.463113] [DEBUG] [LOCAL ] KFY: Loaded 21543 existing records from primary storage. [2025-09-15T21:17:26.467009] [INFO ] [MAIN ] KFY: Loaded 21543 primary data records. [2025-09-15T21:17:26.739828] [DEBUG] [MAIN ] KFRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:26.767166] [INFO ] [MAIN ] KFRC: Generated 1326 derivative records from 14809 primary records. [2025-09-15T21:17:26.783258] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-15T21:17:26.923630] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1326 records). [2025-09-15T21:17:26.924989] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-15T21:17:26.926672] [INFO ] [MAIN ] Derivative Progress: 1009/2083 symbols completed. KFRC took 1.0s. Estimated remaining: 5m 57s. Rate: 180.6 symbols/min [2025-09-15T21:17:26.928570] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:26.940422] [DEBUG] [MAIN ] KFS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:26.941433] [INFO ] [MAIN ] KFS: Generated 1326 derivative records from 6290 primary records. [2025-09-15T21:17:26.941696] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-15T21:17:26.954739] [DEBUG] [LOCAL ] KFS: Derivative data saved (1326 records). [2025-09-15T21:17:26.955085] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-15T21:17:26.957347] [INFO ] [MAIN ] Derivative Progress: 1010/2083 symbols completed. KFS took 0.9s. Estimated remaining: 5m 56s. Rate: 180.8 symbols/min [2025-09-15T21:17:26.957608] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:26.972245] [DEBUG] [MAIN ] KFY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:26.973045] [INFO ] [MAIN ] KFY: Generated 1326 derivative records from 21543 primary records. [2025-09-15T21:17:26.973191] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-15T21:17:26.998194] [DEBUG] [LOCAL ] KFY: Derivative data saved (1326 records). [2025-09-15T21:17:26.998362] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-15T21:17:27.000080] [INFO ] [MAIN ] Derivative Progress: 1011/2083 symbols completed. KFY took 0.9s. Estimated remaining: 5m 55s. Rate: 180.9 symbols/min [2025-09-15T21:17:27.000440] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:27.024834] [DEBUG] [LOCAL ] KGC: Loaded 39660 existing records from primary storage. [2025-09-15T21:17:27.025095] [INFO ] [MAIN ] KGC: Loaded 39660 primary data records. [2025-09-15T21:17:27.139981] [DEBUG] [LOCAL ] KGS: Loaded 33588 existing records from primary storage. [2025-09-15T21:17:27.145806] [INFO ] [MAIN ] KGS: Loaded 33588 primary data records. [2025-09-15T21:17:27.434025] [DEBUG] [LOCAL ] KIM: Loaded 39124 existing records from primary storage. [2025-09-15T21:17:27.450005] [INFO ] [MAIN ] KIM: Loaded 39124 primary data records. [2025-09-15T21:17:27.893568] [DEBUG] [MAIN ] KGC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:27.894901] [INFO ] [MAIN ] KGC: Generated 1326 derivative records from 39660 primary records. [2025-09-15T21:17:27.895195] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-15T21:17:27.919012] [DEBUG] [MAIN ] KGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:27.922949] [INFO ] [MAIN ] KGS: Generated 1326 derivative records from 33588 primary records. [2025-09-15T21:17:27.923174] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-15T21:17:27.922159] [DEBUG] [LOCAL ] KGC: Derivative data saved (1326 records). [2025-09-15T21:17:27.923981] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-15T21:17:27.926404] [INFO ] [MAIN ] Derivative Progress: 1012/2083 symbols completed. KGC took 1.0s. Estimated remaining: 5m 56s. Rate: 180.6 symbols/min [2025-09-15T21:17:27.926879] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:27.940598] [DEBUG] [LOCAL ] KGS: Derivative data saved (1326 records). [2025-09-15T21:17:27.941983] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-15T21:17:27.943949] [INFO ] [MAIN ] Derivative Progress: 1013/2083 symbols completed. KGS took 1.0s. Estimated remaining: 5m 55s. Rate: 180.8 symbols/min [2025-09-15T21:17:27.944362] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:27.955806] [DEBUG] [MAIN ] KIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:27.956697] [INFO ] [MAIN ] KIM: Generated 1326 derivative records from 39124 primary records. [2025-09-15T21:17:27.956859] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-15T21:17:27.969496] [DEBUG] [LOCAL ] KIM: Derivative data saved (1326 records). [2025-09-15T21:17:27.973212] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-15T21:17:27.975102] [INFO ] [MAIN ] Derivative Progress: 1014/2083 symbols completed. KIM took 1.0s. Estimated remaining: 5m 54s. Rate: 180.9 symbols/min [2025-09-15T21:17:27.975402] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:27.987079] [DEBUG] [LOCAL ] KIO: Loaded 15394 existing records from primary storage. [2025-09-15T21:17:27.987286] [INFO ] [MAIN ] KIO: Loaded 15394 primary data records. [2025-09-15T21:17:28.025410] [DEBUG] [LOCAL ] KKRS: Loaded 4474 existing records from primary storage. [2025-09-15T21:17:28.062523] [INFO ] [MAIN ] KKRS: Loaded 4474 primary data records. [2025-09-15T21:17:28.274492] [DEBUG] [LOCAL ] KKR: Loaded 39486 existing records from primary storage. [2025-09-15T21:17:28.311373] [INFO ] [MAIN ] KKR: Loaded 39486 primary data records. [2025-09-15T21:17:28.888386] [DEBUG] [MAIN ] KKRS: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:17:28.889018] [DEBUG] [MAIN ] KIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:28.890742] [INFO ] [MAIN ] KIO: Generated 1326 derivative records from 15394 primary records. [2025-09-15T21:17:28.889900] [INFO ] [MAIN ] KKRS: Generated 1325 derivative records from 4474 primary records. [2025-09-15T21:17:28.890908] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-15T21:17:28.890973] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-15T21:17:28.912898] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1325 records). [2025-09-15T21:17:28.914851] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-15T21:17:28.917070] [INFO ] [MAIN ] Derivative Progress: 1015/2083 symbols completed. KKRS took 0.9s. Estimated remaining: 5m 55s. Rate: 180.6 symbols/min [2025-09-15T21:17:28.918062] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:28.918847] [DEBUG] [LOCAL ] KIO: Derivative data saved (1326 records). [2025-09-15T21:17:28.920530] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-15T21:17:28.922663] [INFO ] [MAIN ] Derivative Progress: 1016/2083 symbols completed. KIO took 1.0s. Estimated remaining: 5m 54s. Rate: 180.8 symbols/min [2025-09-15T21:17:28.923151] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:28.933733] [DEBUG] [MAIN ] KKR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:28.934422] [INFO ] [MAIN ] KKR: Generated 1326 derivative records from 39486 primary records. [2025-09-15T21:17:28.934564] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-15T21:17:28.955587] [DEBUG] [LOCAL ] KKR: Derivative data saved (1326 records). [2025-09-15T21:17:28.955806] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-15T21:17:28.958158] [INFO ] [MAIN ] Derivative Progress: 1017/2083 symbols completed. KKR took 1.0s. Estimated remaining: 5m 53s. Rate: 181.0 symbols/min [2025-09-15T21:17:28.958430] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:28.974820] [DEBUG] [LOCAL ] KLC: Loaded 26104 existing records from primary storage. [2025-09-15T21:17:28.975135] [INFO ] [MAIN ] KLC: Loaded 26104 primary data records. [2025-09-15T21:17:29.100003] [DEBUG] [LOCAL ] KLG: Loaded 30713 existing records from primary storage. [2025-09-15T21:17:29.116556] [INFO ] [MAIN ] KLG: Loaded 30713 primary data records. [2025-09-15T21:17:29.390475] [DEBUG] [LOCAL ] KMI: Loaded 39653 existing records from primary storage. [2025-09-15T21:17:29.401626] [INFO ] [MAIN ] KMI: Loaded 39653 primary data records. [2025-09-15T21:17:29.854497] [DEBUG] [MAIN ] KLC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:29.855810] [INFO ] [MAIN ] KLC: Generated 1326 derivative records from 26104 primary records. [2025-09-15T21:17:29.856159] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-15T21:17:29.873840] [DEBUG] [LOCAL ] KLC: Derivative data saved (1326 records). [2025-09-15T21:17:29.876706] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-15T21:17:29.879683] [INFO ] [MAIN ] Derivative Progress: 1018/2083 symbols completed. KLC took 1.0s. Estimated remaining: 5m 54s. Rate: 180.6 symbols/min [2025-09-15T21:17:29.890226] [DEBUG] [MAIN ] KLG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:29.891573] [INFO ] [MAIN ] KLG: Generated 1326 derivative records from 30713 primary records. [2025-09-15T21:17:29.892293] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-15T21:17:29.911598] [DEBUG] [MAIN ] KMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:29.912153] [INFO ] [MAIN ] KMI: Generated 1326 derivative records from 39653 primary records. [2025-09-15T21:17:29.912214] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-15T21:17:29.915167] [DEBUG] [LOCAL ] KLG: Derivative data saved (1326 records). [2025-09-15T21:17:29.915377] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-15T21:17:29.924382] [INFO ] [MAIN ] Derivative Progress: 1019/2083 symbols completed. KLG took 1.0s. Estimated remaining: 5m 53s. Rate: 180.8 symbols/min [2025-09-15T21:17:29.929387] [DEBUG] [LOCAL ] KMI: Derivative data saved (1326 records). [2025-09-15T21:17:29.929599] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-15T21:17:29.932036] [INFO ] [MAIN ] Derivative Progress: 1020/2083 symbols completed. KMI took 1.0s. Estimated remaining: 5m 52s. Rate: 181.0 symbols/min [2025-09-15T21:17:29.932747] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:29.932847] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:29.933077] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:29.939050] [DEBUG] [LOCAL ] KMPB: Loaded 2557 existing records from primary storage. [2025-09-15T21:17:29.939215] [INFO ] [MAIN ] KMPB: Loaded 2557 primary data records. [2025-09-15T21:17:30.168852] [DEBUG] [LOCAL ] KMT: Loaded 31670 existing records from primary storage. [2025-09-15T21:17:30.170337] [DEBUG] [LOCAL ] KMPR: Loaded 29002 existing records from primary storage. [2025-09-15T21:17:30.247063] [INFO ] [MAIN ] KMT: Loaded 31670 primary data records. [2025-09-15T21:17:30.252948] [INFO ] [MAIN ] KMPR: Loaded 29002 primary data records. [2025-09-15T21:17:30.852714] [DEBUG] [MAIN ] KMPB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:30.854876] [INFO ] [MAIN ] KMPB: Generated 1326 derivative records from 2557 primary records. [2025-09-15T21:17:30.855005] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-15T21:17:30.868412] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1326 records). [2025-09-15T21:17:30.869374] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-15T21:17:30.872182] [INFO ] [MAIN ] Derivative Progress: 1021/2083 symbols completed. KMPB took 0.9s. Estimated remaining: 5m 53s. Rate: 180.6 symbols/min [2025-09-15T21:17:30.874765] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:30.888287] [DEBUG] [MAIN ] KMPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:30.889306] [INFO ] [MAIN ] KMPR: Generated 1326 derivative records from 29002 primary records. [2025-09-15T21:17:30.899201] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-15T21:17:30.899482] [DEBUG] [MAIN ] KMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:30.901235] [INFO ] [MAIN ] KMT: Generated 1326 derivative records from 31670 primary records. [2025-09-15T21:17:30.906754] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-15T21:17:30.925295] [DEBUG] [LOCAL ] KMT: Derivative data saved (1326 records). [2025-09-15T21:17:30.925488] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-15T21:17:30.925405] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1326 records). [2025-09-15T21:17:30.929720] [INFO ] [MAIN ] Derivative Progress: 1022/2083 symbols completed. KMT took 1.0s. Estimated remaining: 5m 52s. Rate: 180.8 symbols/min [2025-09-15T21:17:30.930248] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:30.930473] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-15T21:17:30.933569] [INFO ] [MAIN ] Derivative Progress: 1023/2083 symbols completed. KMPR took 1.0s. Estimated remaining: 5m 51s. Rate: 181.0 symbols/min [2025-09-15T21:17:30.933935] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:30.975695] [DEBUG] [LOCAL ] KMX: Loaded 39282 existing records from primary storage. [2025-09-15T21:17:30.985039] [INFO ] [MAIN ] KMX: Loaded 39282 primary data records. [2025-09-15T21:17:31.109140] [DEBUG] [LOCAL ] KNF: Loaded 26473 existing records from primary storage. [2025-09-15T21:17:31.113305] [INFO ] [MAIN ] KNF: Loaded 26473 primary data records. [2025-09-15T21:17:31.113924] [DEBUG] [LOCAL ] KN: Loaded 27770 existing records from primary storage. [2025-09-15T21:17:31.114590] [INFO ] [MAIN ] KN: Loaded 27770 primary data records. [2025-09-15T21:17:31.939018] [DEBUG] [MAIN ] KMX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:31.940390] [INFO ] [MAIN ] KMX: Generated 1326 derivative records from 39282 primary records. [2025-09-15T21:17:31.940884] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-15T21:17:31.967170] [DEBUG] [LOCAL ] KMX: Derivative data saved (1326 records). [2025-09-15T21:17:31.967770] [DEBUG] [MAIN ] KNF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:31.967842] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-15T21:17:31.977619] [INFO ] [MAIN ] KNF: Generated 1326 derivative records from 26473 primary records. [2025-09-15T21:17:31.979490] [INFO ] [MAIN ] Derivative Progress: 1024/2083 symbols completed. KMX took 1.1s. Estimated remaining: 5m 52s. Rate: 180.6 symbols/min [2025-09-15T21:17:31.980062] [DEBUG] [MAIN ] KN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:31.980171] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-15T21:17:31.980119] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:31.981017] [INFO ] [MAIN ] KN: Generated 1326 derivative records from 27770 primary records. [2025-09-15T21:17:31.987990] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-15T21:17:32.009928] [DEBUG] [LOCAL ] KNF: Derivative data saved (1326 records). [2025-09-15T21:17:32.011876] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-15T21:17:32.014631] [INFO ] [MAIN ] Derivative Progress: 1025/2083 symbols completed. KNF took 1.1s. Estimated remaining: 5m 51s. Rate: 180.7 symbols/min [2025-09-15T21:17:32.016191] [DEBUG] [LOCAL ] KN: Derivative data saved (1326 records). [2025-09-15T21:17:32.020036] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:32.020292] [DEBUG] [LOCAL ] KNOP: Loaded 6609 existing records from primary storage. [2025-09-15T21:17:32.020618] [INFO ] [MAIN ] KNOP: Loaded 6609 primary data records. [2025-09-15T21:17:32.020818] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-15T21:17:32.061520] [INFO ] [MAIN ] Derivative Progress: 1026/2083 symbols completed. KN took 1.1s. Estimated remaining: 5m 51s. Rate: 180.9 symbols/min [2025-09-15T21:17:32.074287] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:32.217576] [DEBUG] [LOCAL ] KNSL: Loaded 13501 existing records from primary storage. [2025-09-15T21:17:32.289242] [INFO ] [MAIN ] KNSL: Loaded 13501 primary data records. [2025-09-15T21:17:32.450144] [DEBUG] [LOCAL ] KNTK: Loaded 34724 existing records from primary storage. [2025-09-15T21:17:32.486764] [INFO ] [MAIN ] KNTK: Loaded 34724 primary data records. [2025-09-15T21:17:32.879939] [DEBUG] [MAIN ] KNOP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:32.880968] [INFO ] [MAIN ] KNOP: Generated 1326 derivative records from 6609 primary records. [2025-09-15T21:17:32.881399] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-15T21:17:32.896724] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1326 records). [2025-09-15T21:17:32.897373] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-15T21:17:32.899682] [INFO ] [MAIN ] Derivative Progress: 1027/2083 symbols completed. KNOP took 0.9s. Estimated remaining: 5m 51s. Rate: 180.6 symbols/min [2025-09-15T21:17:32.900463] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:32.922065] [DEBUG] [MAIN ] KNSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:32.923348] [INFO ] [MAIN ] KNSL: Generated 1326 derivative records from 13501 primary records. [2025-09-15T21:17:32.923584] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-15T21:17:32.937491] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1326 records). [2025-09-15T21:17:32.937743] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-15T21:17:32.940032] [INFO ] [MAIN ] Derivative Progress: 1028/2083 symbols completed. KNSL took 0.9s. Estimated remaining: 5m 50s. Rate: 180.8 symbols/min [2025-09-15T21:17:32.941109] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:32.957208] [DEBUG] [MAIN ] KNTK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:32.958198] [INFO ] [MAIN ] KNTK: Generated 1326 derivative records from 34724 primary records. [2025-09-15T21:17:32.958303] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-15T21:17:32.983456] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1326 records). [2025-09-15T21:17:32.983612] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-15T21:17:32.986181] [INFO ] [MAIN ] Derivative Progress: 1029/2083 symbols completed. KNTK took 0.9s. Estimated remaining: 5m 50s. Rate: 180.9 symbols/min [2025-09-15T21:17:32.986749] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:33.007725] [DEBUG] [LOCAL ] KNX: Loaded 38684 existing records from primary storage. [2025-09-15T21:17:33.007974] [INFO ] [MAIN ] KNX: Loaded 38684 primary data records. [2025-09-15T21:17:33.246561] [DEBUG] [LOCAL ] KODK: Loaded 31957 existing records from primary storage. [2025-09-15T21:17:33.266012] [DEBUG] [LOCAL ] KO: Loaded 39778 existing records from primary storage. [2025-09-15T21:17:33.289532] [INFO ] [MAIN ] KODK: Loaded 31957 primary data records. [2025-09-15T21:17:33.306772] [INFO ] [MAIN ] KO: Loaded 39778 primary data records. [2025-09-15T21:17:34.349816] [DEBUG] [MAIN ] KNX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:34.351775] [INFO ] [MAIN ] KNX: Generated 1326 derivative records from 38684 primary records. [2025-09-15T21:17:34.352044] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-15T21:17:34.373937] [DEBUG] [LOCAL ] KNX: Derivative data saved (1326 records). [2025-09-15T21:17:34.374801] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-15T21:17:34.377718] [INFO ] [MAIN ] Derivative Progress: 1030/2083 symbols completed. KNX took 1.5s. Estimated remaining: 5m 50s. Rate: 180.4 symbols/min [2025-09-15T21:17:34.380662] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:34.410701] [DEBUG] [MAIN ] KODK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:34.410448] [DEBUG] [MAIN ] KO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:34.411584] [INFO ] [MAIN ] KO: Generated 1326 derivative records from 39778 primary records. [2025-09-15T21:17:34.412494] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-15T21:17:34.412345] [INFO ] [MAIN ] KODK: Generated 1326 derivative records from 31957 primary records. [2025-09-15T21:17:34.413368] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-15T21:17:34.443033] [DEBUG] [LOCAL ] KODK: Derivative data saved (1326 records). [2025-09-15T21:17:34.441392] [DEBUG] [LOCAL ] KO: Derivative data saved (1326 records). [2025-09-15T21:17:34.443310] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-15T21:17:34.445719] [INFO ] [MAIN ] Derivative Progress: 1031/2083 symbols completed. KODK took 1.5s. Estimated remaining: 5m 50s. Rate: 180.5 symbols/min [2025-09-15T21:17:34.446005] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:34.443389] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-15T21:17:34.448654] [INFO ] [MAIN ] Derivative Progress: 1032/2083 symbols completed. KO took 1.5s. Estimated remaining: 5m 49s. Rate: 180.7 symbols/min [2025-09-15T21:17:34.449010] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:34.458567] [DEBUG] [LOCAL ] KOF: Loaded 19529 existing records from primary storage. [2025-09-15T21:17:34.458820] [INFO ] [MAIN ] KOF: Loaded 19529 primary data records. [2025-09-15T21:17:34.461181] [DEBUG] [LOCAL ] KORE: Loaded 1525 existing records from primary storage. [2025-09-15T21:17:34.498031] [INFO ] [MAIN ] KORE: Loaded 1525 primary data records. [2025-09-15T21:17:34.659379] [DEBUG] [LOCAL ] KOP: Loaded 12639 existing records from primary storage. [2025-09-15T21:17:34.689629] [INFO ] [MAIN ] KOP: Loaded 12639 primary data records. [2025-09-15T21:17:35.361431] [DEBUG] [MAIN ] KORE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:35.362421] [DEBUG] [MAIN ] KOF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:35.363583] [INFO ] [MAIN ] KORE: Generated 1326 derivative records from 1525 primary records. [2025-09-15T21:17:35.364476] [INFO ] [MAIN ] KOF: Generated 1326 derivative records from 19529 primary records. [2025-09-15T21:17:35.364662] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-15T21:17:35.362027] [DEBUG] [MAIN ] KOP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:35.364796] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-15T21:17:35.366981] [INFO ] [MAIN ] KOP: Generated 1326 derivative records from 12639 primary records. [2025-09-15T21:17:35.375516] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-15T21:17:35.387886] [DEBUG] [LOCAL ] KORE: Derivative data saved (1326 records). [2025-09-15T21:17:35.396029] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-15T21:17:35.390350] [DEBUG] [LOCAL ] KOF: Derivative data saved (1326 records). [2025-09-15T21:17:35.396265] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-15T21:17:35.398130] [INFO ] [MAIN ] Derivative Progress: 1033/2083 symbols completed. KORE took 0.9s. Estimated remaining: 5m 49s. Rate: 180.4 symbols/min [2025-09-15T21:17:35.403689] [INFO ] [MAIN ] Derivative Progress: 1034/2083 symbols completed. KOF took 1.0s. Estimated remaining: 5m 49s. Rate: 180.5 symbols/min [2025-09-15T21:17:35.406809] [DEBUG] [LOCAL ] KOP: Derivative data saved (1326 records). [2025-09-15T21:17:35.406893] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-15T21:17:35.408465] [INFO ] [MAIN ] Derivative Progress: 1035/2083 symbols completed. KOP took 1.0s. Estimated remaining: 5m 48s. Rate: 180.7 symbols/min [2025-09-15T21:17:35.409026] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:35.409134] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:35.409821] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:35.477973] [DEBUG] [LOCAL ] KRC: Loaded 35359 existing records from primary storage. [2025-09-15T21:17:35.489626] [INFO ] [MAIN ] KRC: Loaded 35359 primary data records. [2025-09-15T21:17:35.490187] [DEBUG] [LOCAL ] KR: Loaded 39643 existing records from primary storage. [2025-09-15T21:17:35.490523] [INFO ] [MAIN ] KR: Loaded 39643 primary data records. [2025-09-15T21:17:35.491086] [DEBUG] [LOCAL ] KOS: Loaded 39184 existing records from primary storage. [2025-09-15T21:17:35.514214] [INFO ] [MAIN ] KOS: Loaded 39184 primary data records. [2025-09-15T21:17:36.367993] [DEBUG] [MAIN ] KRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:36.374277] [INFO ] [MAIN ] KRC: Generated 1326 derivative records from 35359 primary records. [2025-09-15T21:17:36.377953] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-15T21:17:36.378458] [DEBUG] [MAIN ] KR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:36.379600] [INFO ] [MAIN ] KR: Generated 1326 derivative records from 39643 primary records. [2025-09-15T21:17:36.388466] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-15T21:17:36.401791] [DEBUG] [LOCAL ] KRC: Derivative data saved (1326 records). [2025-09-15T21:17:36.401951] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-15T21:17:36.403338] [INFO ] [MAIN ] Derivative Progress: 1036/2083 symbols completed. KRC took 1.0s. Estimated remaining: 5m 48s. Rate: 180.4 symbols/min [2025-09-15T21:17:36.409685] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:36.414545] [DEBUG] [MAIN ] KOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:36.417443] [DEBUG] [LOCAL ] KR: Derivative data saved (1326 records). [2025-09-15T21:17:36.416504] [INFO ] [MAIN ] KOS: Generated 1326 derivative records from 39184 primary records. [2025-09-15T21:17:36.417587] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-15T21:17:36.419600] [INFO ] [MAIN ] Derivative Progress: 1037/2083 symbols completed. KR took 1.0s. Estimated remaining: 5m 48s. Rate: 180.5 symbols/min [2025-09-15T21:17:36.419752] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-15T21:17:36.420765] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:36.444882] [DEBUG] [LOCAL ] KOS: Derivative data saved (1326 records). [2025-09-15T21:17:36.445029] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-15T21:17:36.446551] [INFO ] [MAIN ] Derivative Progress: 1038/2083 symbols completed. KOS took 1.0s. Estimated remaining: 5m 47s. Rate: 180.7 symbols/min [2025-09-15T21:17:36.446920] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:36.459304] [DEBUG] [LOCAL ] KREF: Loaded 27019 existing records from primary storage. [2025-09-15T21:17:36.459506] [INFO ] [MAIN ] KREF: Loaded 27019 primary data records. [2025-09-15T21:17:36.633207] [DEBUG] [LOCAL ] KRG: Loaded 36082 existing records from primary storage. [2025-09-15T21:17:36.633313] [DEBUG] [LOCAL ] KRO: Loaded 19369 existing records from primary storage. [2025-09-15T21:17:36.648687] [INFO ] [MAIN ] KRG: Loaded 36082 primary data records. [2025-09-15T21:17:36.648738] [INFO ] [MAIN ] KRO: Loaded 19369 primary data records. [2025-09-15T21:17:37.310538] [DEBUG] [MAIN ] KREF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:37.312193] [INFO ] [MAIN ] KREF: Generated 1326 derivative records from 27019 primary records. [2025-09-15T21:17:37.312754] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-15T21:17:37.337073] [DEBUG] [MAIN ] KRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:37.347489] [INFO ] [MAIN ] KRG: Generated 1326 derivative records from 36082 primary records. [2025-09-15T21:17:37.348231] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-15T21:17:37.348477] [DEBUG] [MAIN ] KRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:37.350559] [INFO ] [MAIN ] KRO: Generated 1326 derivative records from 19369 primary records. [2025-09-15T21:17:37.350674] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-15T21:17:37.349615] [DEBUG] [LOCAL ] KREF: Derivative data saved (1326 records). [2025-09-15T21:17:37.351569] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-15T21:17:37.359460] [INFO ] [MAIN ] Derivative Progress: 1039/2083 symbols completed. KREF took 0.9s. Estimated remaining: 5m 47s. Rate: 180.4 symbols/min [2025-09-15T21:17:37.371608] [DEBUG] [LOCAL ] KRO: Derivative data saved (1326 records). [2025-09-15T21:17:37.373766] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:37.376824] [DEBUG] [LOCAL ] KRG: Derivative data saved (1326 records). [2025-09-15T21:17:37.376929] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-15T21:17:37.377020] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-15T21:17:37.378810] [INFO ] [MAIN ] Derivative Progress: 1040/2083 symbols completed. KRG took 1.0s. Estimated remaining: 5m 47s. Rate: 180.5 symbols/min [2025-09-15T21:17:37.379394] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:37.381502] [INFO ] [MAIN ] Derivative Progress: 1041/2083 symbols completed. KRO took 0.9s. Estimated remaining: 5m 46s. Rate: 180.7 symbols/min [2025-09-15T21:17:37.381825] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:37.441510] [DEBUG] [LOCAL ] KRP: Loaded 26642 existing records from primary storage. [2025-09-15T21:17:37.442226] [INFO ] [MAIN ] KRP: Loaded 26642 primary data records. [2025-09-15T21:17:37.442142] [DEBUG] [LOCAL ] KT: Loaded 33182 existing records from primary storage. [2025-09-15T21:17:37.463430] [INFO ] [MAIN ] KT: Loaded 33182 primary data records. [2025-09-15T21:17:37.644449] [DEBUG] [LOCAL ] KSS: Loaded 39575 existing records from primary storage. [2025-09-15T21:17:37.654927] [INFO ] [MAIN ] KSS: Loaded 39575 primary data records. [2025-09-15T21:17:38.298778] [DEBUG] [MAIN ] KRP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:38.299435] [DEBUG] [MAIN ] KT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:38.300167] [INFO ] [MAIN ] KRP: Generated 1326 derivative records from 26642 primary records. [2025-09-15T21:17:38.300457] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-15T21:17:38.301169] [INFO ] [MAIN ] KT: Generated 1326 derivative records from 33182 primary records. [2025-09-15T21:17:38.301530] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-15T21:17:38.316860] [DEBUG] [LOCAL ] KRP: Derivative data saved (1326 records). [2025-09-15T21:17:38.317090] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-15T21:17:38.324051] [INFO ] [MAIN ] Derivative Progress: 1042/2083 symbols completed. KRP took 1.0s. Estimated remaining: 5m 46s. Rate: 180.4 symbols/min [2025-09-15T21:17:38.333938] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:38.337563] [DEBUG] [MAIN ] KSS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:38.341001] [DEBUG] [LOCAL ] KT: Derivative data saved (1326 records). [2025-09-15T21:17:38.341924] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-15T21:17:38.341729] [INFO ] [MAIN ] KSS: Generated 1326 derivative records from 39575 primary records. [2025-09-15T21:17:38.344462] [INFO ] [MAIN ] Derivative Progress: 1043/2083 symbols completed. KT took 1.0s. Estimated remaining: 5m 46s. Rate: 180.6 symbols/min [2025-09-15T21:17:38.344845] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:38.344613] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-15T21:17:38.358612] [DEBUG] [LOCAL ] KSS: Derivative data saved (1326 records). [2025-09-15T21:17:38.358697] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-15T21:17:38.360280] [INFO ] [MAIN ] Derivative Progress: 1044/2083 symbols completed. KSS took 1.0s. Estimated remaining: 5m 45s. Rate: 180.7 symbols/min [2025-09-15T21:17:38.363225] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:38.371210] [DEBUG] [LOCAL ] KTF: Loaded 8631 existing records from primary storage. [2025-09-15T21:17:38.379067] [INFO ] [MAIN ] KTF: Loaded 8631 primary data records. [2025-09-15T21:17:38.495999] [DEBUG] [LOCAL ] KTB: Loaded 30183 existing records from primary storage. [2025-09-15T21:17:38.506759] [INFO ] [MAIN ] KTB: Loaded 30183 primary data records. [2025-09-15T21:17:38.867382] [DEBUG] [LOCAL ] KVUE: Loaded 39627 existing records from primary storage. [2025-09-15T21:17:38.896538] [INFO ] [MAIN ] KVUE: Loaded 39627 primary data records. [2025-09-15T21:17:39.269132] [DEBUG] [MAIN ] KTF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:39.270218] [INFO ] [MAIN ] KTF: Generated 1326 derivative records from 8631 primary records. [2025-09-15T21:17:39.270664] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-15T21:17:39.285501] [DEBUG] [LOCAL ] KTF: Derivative data saved (1326 records). [2025-09-15T21:17:39.286207] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-15T21:17:39.288587] [INFO ] [MAIN ] Derivative Progress: 1045/2083 symbols completed. KTF took 0.9s. Estimated remaining: 5m 45s. Rate: 180.4 symbols/min [2025-09-15T21:17:39.289797] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:39.303170] [DEBUG] [MAIN ] KTB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:39.303879] [INFO ] [MAIN ] KTB: Generated 1326 derivative records from 30183 primary records. [2025-09-15T21:17:39.304083] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-15T21:17:39.316914] [DEBUG] [LOCAL ] KTB: Derivative data saved (1326 records). [2025-09-15T21:17:39.317066] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-15T21:17:39.318939] [INFO ] [MAIN ] Derivative Progress: 1046/2083 symbols completed. KTB took 1.0s. Estimated remaining: 5m 45s. Rate: 180.6 symbols/min [2025-09-15T21:17:39.319362] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:39.332204] [DEBUG] [MAIN ] KVUE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:39.333081] [INFO ] [MAIN ] KVUE: Generated 1326 derivative records from 39627 primary records. [2025-09-15T21:17:39.334539] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-15T21:17:39.357084] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1326 records). [2025-09-15T21:17:39.357298] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-15T21:17:39.359048] [INFO ] [MAIN ] Derivative Progress: 1047/2083 symbols completed. KVUE took 1.0s. Estimated remaining: 5m 44s. Rate: 180.7 symbols/min [2025-09-15T21:17:39.359320] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:39.379959] [DEBUG] [LOCAL ] KVYO: Loaded 37223 existing records from primary storage. [2025-09-15T21:17:39.380222] [INFO ] [MAIN ] KVYO: Loaded 37223 primary data records. [2025-09-15T21:17:39.501514] [DEBUG] [LOCAL ] KWR: Loaded 12280 existing records from primary storage. [2025-09-15T21:17:39.507655] [INFO ] [MAIN ] KWR: Loaded 12280 primary data records. [2025-09-15T21:17:39.507538] [DEBUG] [LOCAL ] KW: Loaded 29877 existing records from primary storage. [2025-09-15T21:17:39.548955] [INFO ] [MAIN ] KW: Loaded 29877 primary data records. [2025-09-15T21:17:40.225992] [DEBUG] [MAIN ] KVYO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:40.227159] [INFO ] [MAIN ] KVYO: Generated 1326 derivative records from 37223 primary records. [2025-09-15T21:17:40.228219] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-15T21:17:40.251952] [DEBUG] [MAIN ] KWR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:40.253364] [INFO ] [MAIN ] KWR: Generated 1326 derivative records from 12280 primary records. [2025-09-15T21:17:40.254320] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-15T21:17:40.255659] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1326 records). [2025-09-15T21:17:40.261281] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-15T21:17:40.266147] [INFO ] [MAIN ] Derivative Progress: 1048/2083 symbols completed. KVYO took 1.0s. Estimated remaining: 5m 44s. Rate: 180.4 symbols/min [2025-09-15T21:17:40.270717] [DEBUG] [LOCAL ] KWR: Derivative data saved (1326 records). [2025-09-15T21:17:40.270878] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-15T21:17:40.273830] [INFO ] [MAIN ] Derivative Progress: 1049/2083 symbols completed. KWR took 0.9s. Estimated remaining: 5m 44s. Rate: 180.6 symbols/min [2025-09-15T21:17:40.283611] [DEBUG] [MAIN ] KW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:40.284743] [INFO ] [MAIN ] KW: Generated 1326 derivative records from 29877 primary records. [2025-09-15T21:17:40.284948] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-15T21:17:40.297070] [DEBUG] [LOCAL ] KW: Derivative data saved (1326 records). [2025-09-15T21:17:40.297194] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-15T21:17:40.299046] [INFO ] [MAIN ] Derivative Progress: 1050/2083 symbols completed. KW took 1.0s. Estimated remaining: 5m 43s. Rate: 180.7 symbols/min [2025-09-15T21:17:40.299855] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:40.299611] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:40.300786] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:40.333236] [DEBUG] [LOCAL ] KYN: Loaded 21836 existing records from primary storage. [2025-09-15T21:17:40.333370] [INFO ] [MAIN ] KYN: Loaded 21836 primary data records. [2025-09-15T21:17:40.466733] [DEBUG] [LOCAL ] L: Loaded 30026 existing records from primary storage. [2025-09-15T21:17:40.478193] [INFO ] [MAIN ] L: Loaded 30026 primary data records. [2025-09-15T21:17:40.467682] [DEBUG] [LOCAL ] LAC: Loaded 38655 existing records from primary storage. [2025-09-15T21:17:40.528600] [INFO ] [MAIN ] LAC: Loaded 38655 primary data records. [2025-09-15T21:17:41.223206] [DEBUG] [MAIN ] KYN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:41.224063] [INFO ] [MAIN ] KYN: Generated 1326 derivative records from 21836 primary records. [2025-09-15T21:17:41.224390] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-15T21:17:41.239348] [DEBUG] [LOCAL ] KYN: Derivative data saved (1326 records). [2025-09-15T21:17:41.241399] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-15T21:17:41.245585] [INFO ] [MAIN ] Derivative Progress: 1051/2083 symbols completed. KYN took 0.9s. Estimated remaining: 5m 43s. Rate: 180.4 symbols/min [2025-09-15T21:17:41.246285] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:41.266141] [DEBUG] [MAIN ] L: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:41.267883] [INFO ] [MAIN ] L: Generated 1326 derivative records from 30026 primary records. [2025-09-15T21:17:41.267101] [DEBUG] [MAIN ] LAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:41.268124] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-15T21:17:41.269607] [INFO ] [MAIN ] LAC: Generated 1326 derivative records from 38655 primary records. [2025-09-15T21:17:41.276735] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-15T21:17:41.293563] [DEBUG] [LOCAL ] L: Derivative data saved (1326 records). [2025-09-15T21:17:41.293739] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-15T21:17:41.297959] [INFO ] [MAIN ] Derivative Progress: 1052/2083 symbols completed. L took 1.0s. Estimated remaining: 5m 43s. Rate: 180.6 symbols/min [2025-09-15T21:17:41.298992] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:41.308530] [DEBUG] [LOCAL ] LAC: Derivative data saved (1326 records). [2025-09-15T21:17:41.308981] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-15T21:17:41.308924] [DEBUG] [LOCAL ] LAD: Loaded 16862 existing records from primary storage. [2025-09-15T21:17:41.311678] [INFO ] [MAIN ] Derivative Progress: 1053/2083 symbols completed. LAC took 1.0s. Estimated remaining: 5m 42s. Rate: 180.7 symbols/min [2025-09-15T21:17:41.311930] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:41.312114] [INFO ] [MAIN ] LAD: Loaded 16862 primary data records. [2025-09-15T21:17:41.395824] [DEBUG] [LOCAL ] LANV: Loaded 1908 existing records from primary storage. [2025-09-15T21:17:41.421136] [INFO ] [MAIN ] LANV: Loaded 1908 primary data records. [2025-09-15T21:17:41.718966] [DEBUG] [LOCAL ] LADR: Loaded 28214 existing records from primary storage. [2025-09-15T21:17:41.766760] [INFO ] [MAIN ] LADR: Loaded 28214 primary data records. [2025-09-15T21:17:42.147936] [DEBUG] [MAIN ] LAD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:42.149144] [INFO ] [MAIN ] LAD: Generated 1326 derivative records from 16862 primary records. [2025-09-15T21:17:42.149348] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-15T21:17:42.170109] [DEBUG] [LOCAL ] LAD: Derivative data saved (1326 records). [2025-09-15T21:17:42.170463] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-15T21:17:42.178028] [INFO ] [MAIN ] Derivative Progress: 1054/2083 symbols completed. LAD took 0.9s. Estimated remaining: 5m 42s. Rate: 180.5 symbols/min [2025-09-15T21:17:42.182740] [INFO ] [MAIN ] LAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:42.182494] [DEBUG] [MAIN ] LANV: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:17:42.183686] [INFO ] [MAIN ] LANV: Generated 1325 derivative records from 1908 primary records. [2025-09-15T21:17:42.184420] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-15T21:17:42.208980] [DEBUG] [LOCAL ] LANV: Derivative data saved (1325 records). [2025-09-15T21:17:42.209433] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-15T21:17:42.211719] [INFO ] [MAIN ] Derivative Progress: 1055/2083 symbols completed. LANV took 0.9s. Estimated remaining: 5m 41s. Rate: 180.6 symbols/min [2025-09-15T21:17:42.209721] [DEBUG] [MAIN ] LADR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:42.212557] [INFO ] [MAIN ] LADR: Generated 1326 derivative records from 28214 primary records. [2025-09-15T21:17:42.214203] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:42.212739] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-15T21:17:42.238358] [DEBUG] [LOCAL ] LADR: Derivative data saved (1326 records). [2025-09-15T21:17:42.238523] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-15T21:17:42.240460] [INFO ] [MAIN ] Derivative Progress: 1056/2083 symbols completed. LADR took 0.9s. Estimated remaining: 5m 41s. Rate: 180.8 symbols/min [2025-09-15T21:17:42.240838] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:42.256534] [DEBUG] [LOCAL ] LAW: Loaded 10545 existing records from primary storage. [2025-09-15T21:17:42.257245] [DEBUG] [LOCAL ] LAR: Loaded 33317 existing records from primary storage. [2025-09-15T21:17:42.256739] [INFO ] [MAIN ] LAW: Loaded 10545 primary data records. [2025-09-15T21:17:42.262554] [INFO ] [MAIN ] LAR: Loaded 33317 primary data records. [2025-09-15T21:17:42.813340] [DEBUG] [LOCAL ] LAZ: Loaded 33117 existing records from primary storage. [2025-09-15T21:17:42.814259] [INFO ] [MAIN ] LAZ: Loaded 33117 primary data records. [2025-09-15T21:17:43.174270] [DEBUG] [MAIN ] LAW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:43.173971] [DEBUG] [MAIN ] LAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:43.175043] [INFO ] [MAIN ] LAW: Generated 1326 derivative records from 10545 primary records. [2025-09-15T21:17:43.175610] [INFO ] [MAIN ] LAR: Generated 1326 derivative records from 33317 primary records. [2025-09-15T21:17:43.175749] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-15T21:17:43.183302] [DEBUG] [LOCAL ] LAR: Saving derivative data. [2025-09-15T21:17:43.189387] [DEBUG] [LOCAL ] LAW: Derivative data saved (1326 records). [2025-09-15T21:17:43.190720] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-15T21:17:43.197811] [INFO ] [MAIN ] Derivative Progress: 1057/2083 symbols completed. LAW took 1.0s. Estimated remaining: 5m 41s. Rate: 180.5 symbols/min [2025-09-15T21:17:43.198139] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:43.205901] [DEBUG] [LOCAL ] LAR: Derivative data saved (1326 records). [2025-09-15T21:17:43.206093] [INFO ] [MAIN ] LAR: Successfully saved derivative data. [2025-09-15T21:17:43.207946] [INFO ] [MAIN ] Derivative Progress: 1058/2083 symbols completed. LAR took 1.0s. Estimated remaining: 5m 40s. Rate: 180.6 symbols/min [2025-09-15T21:17:43.208317] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:43.222851] [DEBUG] [MAIN ] LAZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:43.223536] [INFO ] [MAIN ] LAZ: Generated 1326 derivative records from 33117 primary records. [2025-09-15T21:17:43.223685] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-15T21:17:43.244533] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1326 records). [2025-09-15T21:17:43.244682] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-15T21:17:43.246306] [INFO ] [MAIN ] Derivative Progress: 1059/2083 symbols completed. LAZ took 1.0s. Estimated remaining: 5m 40s. Rate: 180.8 symbols/min [2025-09-15T21:17:43.246624] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:43.258620] [DEBUG] [LOCAL ] LB: Loaded 27501 existing records from primary storage. [2025-09-15T21:17:43.258796] [INFO ] [MAIN ] LB: Loaded 27501 primary data records. [2025-09-15T21:17:43.471970] [DEBUG] [LOCAL ] LBRT: Loaded 39012 existing records from primary storage. [2025-09-15T21:17:43.487600] [INFO ] [MAIN ] LBRT: Loaded 39012 primary data records. [2025-09-15T21:17:43.605044] [DEBUG] [LOCAL ] LC: Loaded 35229 existing records from primary storage. [2025-09-15T21:17:43.629267] [INFO ] [MAIN ] LC: Loaded 35229 primary data records. [2025-09-15T21:17:44.135835] [DEBUG] [MAIN ] LB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:44.137268] [INFO ] [MAIN ] LB: Generated 1326 derivative records from 27501 primary records. [2025-09-15T21:17:44.137376] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-15T21:17:44.151796] [DEBUG] [LOCAL ] LB: Derivative data saved (1326 records). [2025-09-15T21:17:44.151986] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-15T21:17:44.153404] [INFO ] [MAIN ] Derivative Progress: 1060/2083 symbols completed. LB took 1.0s. Estimated remaining: 5m 40s. Rate: 180.5 symbols/min [2025-09-15T21:17:44.153856] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:44.167719] [DEBUG] [MAIN ] LBRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:44.168525] [INFO ] [MAIN ] LBRT: Generated 1326 derivative records from 39012 primary records. [2025-09-15T21:17:44.169063] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-15T21:17:44.199121] [DEBUG] [MAIN ] LC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:44.199905] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1326 records). [2025-09-15T21:17:44.200675] [INFO ] [MAIN ] LC: Generated 1326 derivative records from 35229 primary records. [2025-09-15T21:17:44.200025] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-15T21:17:44.203116] [INFO ] [MAIN ] Derivative Progress: 1061/2083 symbols completed. LBRT took 1.0s. Estimated remaining: 5m 39s. Rate: 180.6 symbols/min [2025-09-15T21:17:44.200816] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-15T21:17:44.209361] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:44.211310] [DEBUG] [LOCAL ] LCII: Loaded 20124 existing records from primary storage. [2025-09-15T21:17:44.218150] [INFO ] [MAIN ] LCII: Loaded 20124 primary data records. [2025-09-15T21:17:44.293910] [DEBUG] [LOCAL ] LC: Derivative data saved (1326 records). [2025-09-15T21:17:44.305767] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-15T21:17:44.326017] [INFO ] [MAIN ] Derivative Progress: 1062/2083 symbols completed. LC took 1.1s. Estimated remaining: 5m 39s. Rate: 180.7 symbols/min [2025-09-15T21:17:44.329354] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:44.513052] [DEBUG] [LOCAL ] LDI: Loaded 31881 existing records from primary storage. [2025-09-15T21:17:44.514425] [INFO ] [MAIN ] LDI: Loaded 31881 primary data records. [2025-09-15T21:17:44.713698] [DEBUG] [LOCAL ] LDOS: Loaded 33182 existing records from primary storage. [2025-09-15T21:17:44.801034] [INFO ] [MAIN ] LDOS: Loaded 33182 primary data records. [2025-09-15T21:17:45.079196] [DEBUG] [MAIN ] LCII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:45.091801] [INFO ] [MAIN ] LCII: Generated 1326 derivative records from 20124 primary records. [2025-09-15T21:17:45.091948] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-15T21:17:45.115929] [DEBUG] [LOCAL ] LCII: Derivative data saved (1326 records). [2025-09-15T21:17:45.116131] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-15T21:17:45.128168] [INFO ] [MAIN ] Derivative Progress: 1063/2083 symbols completed. LCII took 1.0s. Estimated remaining: 5m 39s. Rate: 180.5 symbols/min [2025-09-15T21:17:45.128887] [DEBUG] [MAIN ] LDI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:45.129716] [INFO ] [MAIN ] LDI: Generated 1326 derivative records from 31881 primary records. [2025-09-15T21:17:45.129931] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-15T21:17:45.142911] [DEBUG] [LOCAL ] LDI: Derivative data saved (1326 records). [2025-09-15T21:17:45.143110] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-15T21:17:45.145470] [INFO ] [MAIN ] Derivative Progress: 1064/2083 symbols completed. LDI took 0.9s. Estimated remaining: 5m 38s. Rate: 180.6 symbols/min [2025-09-15T21:17:45.158050] [DEBUG] [MAIN ] LDOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:45.158729] [INFO ] [MAIN ] LDOS: Generated 1326 derivative records from 33182 primary records. [2025-09-15T21:17:45.158792] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-15T21:17:45.170817] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1326 records). [2025-09-15T21:17:45.170905] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-15T21:17:45.172923] [INFO ] [MAIN ] Derivative Progress: 1065/2083 symbols completed. LDOS took 0.8s. Estimated remaining: 5m 38s. Rate: 180.8 symbols/min [2025-09-15T21:17:45.173425] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:45.173704] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:45.173803] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:45.188540] [DEBUG] [LOCAL ] LDP: Loaded 9342 existing records from primary storage. [2025-09-15T21:17:45.188823] [INFO ] [MAIN ] LDP: Loaded 9342 primary data records. [2025-09-15T21:17:45.412327] [DEBUG] [LOCAL ] LEA: Loaded 30256 existing records from primary storage. [2025-09-15T21:17:45.528221] [INFO ] [MAIN ] LEA: Loaded 30256 primary data records. [2025-09-15T21:17:45.551689] [DEBUG] [LOCAL ] LEN: Loaded 39223 existing records from primary storage. [2025-09-15T21:17:45.585224] [INFO ] [MAIN ] LEN: Loaded 39223 primary data records. [2025-09-15T21:17:46.096724] [DEBUG] [MAIN ] LDP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:46.097723] [INFO ] [MAIN ] LDP: Generated 1326 derivative records from 9342 primary records. [2025-09-15T21:17:46.098147] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-15T21:17:46.110866] [DEBUG] [LOCAL ] LDP: Derivative data saved (1326 records). [2025-09-15T21:17:46.111506] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-15T21:17:46.113455] [INFO ] [MAIN ] Derivative Progress: 1066/2083 symbols completed. LDP took 0.9s. Estimated remaining: 5m 38s. Rate: 180.5 symbols/min [2025-09-15T21:17:46.113846] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:46.132542] [DEBUG] [MAIN ] LEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:46.134907] [INFO ] [MAIN ] LEN: Generated 1326 derivative records from 39223 primary records. [2025-09-15T21:17:46.135071] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-15T21:17:46.149813] [DEBUG] [LOCAL ] LEO: Loaded 11897 existing records from primary storage. [2025-09-15T21:17:46.158765] [INFO ] [MAIN ] LEO: Loaded 11897 primary data records. [2025-09-15T21:17:46.161062] [DEBUG] [MAIN ] LEA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:46.162875] [DEBUG] [LOCAL ] LEN: Derivative data saved (1326 records). [2025-09-15T21:17:46.162404] [INFO ] [MAIN ] LEA: Generated 1326 derivative records from 30256 primary records. [2025-09-15T21:17:46.174087] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-15T21:17:46.174031] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-15T21:17:46.195176] [INFO ] [MAIN ] Derivative Progress: 1067/2083 symbols completed. LEN took 1.0s. Estimated remaining: 5m 38s. Rate: 180.6 symbols/min [2025-09-15T21:17:46.233831] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:46.352830] [DEBUG] [LOCAL ] LEA: Derivative data saved (1326 records). [2025-09-15T21:17:46.356693] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-15T21:17:46.358904] [INFO ] [MAIN ] Derivative Progress: 1068/2083 symbols completed. LEA took 1.2s. Estimated remaining: 5m 37s. Rate: 180.7 symbols/min [2025-09-15T21:17:46.450104] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:46.469982] [DEBUG] [LOCAL ] LEVI: Loaded 37969 existing records from primary storage. [2025-09-15T21:17:46.476282] [INFO ] [MAIN ] LEVI: Loaded 37969 primary data records. [2025-09-15T21:17:46.476591] [DEBUG] [LOCAL ] LFT: Loaded 13970 existing records from primary storage. [2025-09-15T21:17:46.488211] [INFO ] [MAIN ] LFT: Loaded 13970 primary data records. [2025-09-15T21:17:46.933840] [DEBUG] [MAIN ] LEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:47.018591] [INFO ] [MAIN ] LEO: Generated 1326 derivative records from 11897 primary records. [2025-09-15T21:17:47.018771] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-15T21:17:47.032536] [DEBUG] [LOCAL ] LEO: Derivative data saved (1326 records). [2025-09-15T21:17:47.033784] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-15T21:17:47.036627] [INFO ] [MAIN ] Derivative Progress: 1069/2083 symbols completed. LEO took 0.9s. Estimated remaining: 5m 37s. Rate: 180.5 symbols/min [2025-09-15T21:17:47.037620] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:47.049075] [DEBUG] [LOCAL ] LGI: Loaded 7281 existing records from primary storage. [2025-09-15T21:17:47.049407] [INFO ] [MAIN ] LGI: Loaded 7281 primary data records. [2025-09-15T21:17:47.175124] [DEBUG] [MAIN ] LEVI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:47.175625] [DEBUG] [MAIN ] LFT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:47.181994] [INFO ] [MAIN ] LFT: Generated 1326 derivative records from 13970 primary records. [2025-09-15T21:17:47.176298] [INFO ] [MAIN ] LEVI: Generated 1326 derivative records from 37969 primary records. [2025-09-15T21:17:47.192337] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-15T21:17:47.217278] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-15T21:17:47.364017] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1326 records). [2025-09-15T21:17:47.366112] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-15T21:17:47.367846] [INFO ] [MAIN ] Derivative Progress: 1070/2083 symbols completed. LEVI took 1.1s. Estimated remaining: 5m 37s. Rate: 180.5 symbols/min [2025-09-15T21:17:47.365511] [DEBUG] [LOCAL ] LFT: Derivative data saved (1326 records). [2025-09-15T21:17:47.368387] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:47.368688] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-15T21:17:47.371347] [INFO ] [MAIN ] Derivative Progress: 1071/2083 symbols completed. LFT took 0.9s. Estimated remaining: 5m 36s. Rate: 180.7 symbols/min [2025-09-15T21:17:47.371812] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:47.390937] [DEBUG] [MAIN ] LGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:47.391614] [INFO ] [MAIN ] LGI: Generated 1326 derivative records from 7281 primary records. [2025-09-15T21:17:47.399269] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-15T21:17:47.430158] [DEBUG] [LOCAL ] LGI: Derivative data saved (1326 records). [2025-09-15T21:17:47.430742] [DEBUG] [LOCAL ] LH: Loaded 27924 existing records from primary storage. [2025-09-15T21:17:47.430884] [INFO ] [MAIN ] LH: Loaded 27924 primary data records. [2025-09-15T21:17:47.430801] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-15T21:17:47.433056] [INFO ] [MAIN ] Derivative Progress: 1072/2083 symbols completed. LGI took 0.4s. Estimated remaining: 5m 35s. Rate: 180.8 symbols/min [2025-09-15T21:17:47.473351] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:47.526020] [DEBUG] [LOCAL ] LHX: Loaded 36187 existing records from primary storage. [2025-09-15T21:17:47.547272] [INFO ] [MAIN ] LHX: Loaded 36187 primary data records. [2025-09-15T21:17:47.831356] [DEBUG] [LOCAL ] LII: Loaded 20183 existing records from primary storage. [2025-09-15T21:17:47.852413] [INFO ] [MAIN ] LII: Loaded 20183 primary data records. [2025-09-15T21:17:48.292547] [DEBUG] [MAIN ] LH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:48.294281] [INFO ] [MAIN ] LH: Generated 1326 derivative records from 27924 primary records. [2025-09-15T21:17:48.295212] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-15T21:17:48.315207] [DEBUG] [LOCAL ] LH: Derivative data saved (1326 records). [2025-09-15T21:17:48.319346] [DEBUG] [MAIN ] LHX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:48.319444] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-15T21:17:48.321151] [INFO ] [MAIN ] Derivative Progress: 1073/2083 symbols completed. LH took 1.0s. Estimated remaining: 5m 36s. Rate: 180.6 symbols/min [2025-09-15T21:17:48.322151] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:48.321917] [INFO ] [MAIN ] LHX: Generated 1326 derivative records from 36187 primary records. [2025-09-15T21:17:48.322435] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-15T21:17:48.345633] [DEBUG] [MAIN ] LII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:48.346620] [INFO ] [MAIN ] LII: Generated 1326 derivative records from 20183 primary records. [2025-09-15T21:17:48.347196] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-15T21:17:48.347837] [DEBUG] [LOCAL ] LHX: Derivative data saved (1326 records). [2025-09-15T21:17:48.348320] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-15T21:17:48.350157] [INFO ] [MAIN ] Derivative Progress: 1074/2083 symbols completed. LHX took 1.0s. Estimated remaining: 5m 35s. Rate: 180.7 symbols/min [2025-09-15T21:17:48.357139] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:48.362657] [DEBUG] [LOCAL ] LII: Derivative data saved (1326 records). [2025-09-15T21:17:48.371086] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-15T21:17:48.373160] [INFO ] [MAIN ] Derivative Progress: 1075/2083 symbols completed. LII took 0.9s. Estimated remaining: 5m 34s. Rate: 180.9 symbols/min [2025-09-15T21:17:48.373976] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:48.376853] [DEBUG] [LOCAL ] LITB: Loaded 2317 existing records from primary storage. [2025-09-15T21:17:48.377030] [INFO ] [MAIN ] LITB: Loaded 2317 primary data records. [2025-09-15T21:17:48.490513] [DEBUG] [LOCAL ] LION: Loaded 35366 existing records from primary storage. [2025-09-15T21:17:48.490756] [INFO ] [MAIN ] LION: Loaded 35366 primary data records. [2025-09-15T21:17:48.945864] [DEBUG] [LOCAL ] LLY: Loaded 39337 existing records from primary storage. [2025-09-15T21:17:48.947009] [INFO ] [MAIN ] LLY: Loaded 39337 primary data records. [2025-09-15T21:17:49.152488] [DEBUG] [MAIN ] LITB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:49.235951] [INFO ] [MAIN ] LITB: Generated 1326 derivative records from 2317 primary records. [2025-09-15T21:17:49.236272] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-15T21:17:49.247538] [DEBUG] [LOCAL ] LITB: Derivative data saved (1326 records). [2025-09-15T21:17:49.247794] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-15T21:17:49.249580] [INFO ] [MAIN ] Derivative Progress: 1076/2083 symbols completed. LITB took 0.9s. Estimated remaining: 5m 35s. Rate: 180.6 symbols/min [2025-09-15T21:17:49.250112] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:49.264824] [DEBUG] [MAIN ] LION: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:49.265476] [INFO ] [MAIN ] LION: Generated 1326 derivative records from 35366 primary records. [2025-09-15T21:17:49.265634] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-15T21:17:49.277731] [DEBUG] [LOCAL ] LION: Derivative data saved (1326 records). [2025-09-15T21:17:49.277892] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-15T21:17:49.280325] [INFO ] [MAIN ] Derivative Progress: 1077/2083 symbols completed. LION took 1.0s. Estimated remaining: 5m 34s. Rate: 180.7 symbols/min [2025-09-15T21:17:49.280660] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:49.296217] [DEBUG] [MAIN ] LLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:49.305997] [INFO ] [MAIN ] LLY: Generated 1326 derivative records from 39337 primary records. [2025-09-15T21:17:49.306120] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-15T21:17:49.317983] [DEBUG] [LOCAL ] LLY: Derivative data saved (1326 records). [2025-09-15T21:17:49.318139] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-15T21:17:49.320038] [INFO ] [MAIN ] Derivative Progress: 1078/2083 symbols completed. LLY took 0.9s. Estimated remaining: 5m 33s. Rate: 180.9 symbols/min [2025-09-15T21:17:49.332758] [DEBUG] [LOCAL ] LMND: Loaded 38437 existing records from primary storage. [2025-09-15T21:17:49.332938] [INFO ] [MAIN ] LMND: Loaded 38437 primary data records. [2025-09-15T21:17:49.529352] [DEBUG] [LOCAL ] LMT: Loaded 36693 existing records from primary storage. [2025-09-15T21:17:49.610581] [INFO ] [MAIN ] LMT: Loaded 36693 primary data records. [2025-09-15T21:17:49.925951] [DEBUG] [MAIN ] LMND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:49.927023] [INFO ] [MAIN ] LMND: Generated 1326 derivative records from 38437 primary records. [2025-09-15T21:17:49.927113] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-15T21:17:49.946245] [DEBUG] [LOCAL ] LMND: Derivative data saved (1326 records). [2025-09-15T21:17:49.947952] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-15T21:17:49.950523] [INFO ] [MAIN ] Derivative Progress: 1079/2083 symbols completed. LMND took 0.7s. Estimated remaining: 5m 33s. Rate: 180.7 symbols/min [2025-09-15T21:17:49.960577] [DEBUG] [MAIN ] LMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:49.961355] [INFO ] [MAIN ] LMT: Generated 1326 derivative records from 36693 primary records. [2025-09-15T21:17:49.961417] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-15T21:17:49.973263] [DEBUG] [LOCAL ] LMT: Derivative data saved (1326 records). [2025-09-15T21:17:49.973329] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-15T21:17:49.975868] [INFO ] [MAIN ] Derivative Progress: 1080/2083 symbols completed. LMT took 0.7s. Estimated remaining: 5m 33s. Rate: 180.9 symbols/min [2025-09-15T21:17:49.976499] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:49.976379] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:49.976557] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:49.983368] [DEBUG] [LOCAL ] LND: Loaded 3604 existing records from primary storage. [2025-09-15T21:17:49.983523] [INFO ] [MAIN ] LND: Loaded 3604 primary data records. [2025-09-15T21:17:50.296117] [DEBUG] [LOCAL ] LNC: Loaded 37942 existing records from primary storage. [2025-09-15T21:17:50.297027] [INFO ] [MAIN ] LNC: Loaded 37942 primary data records. [2025-09-15T21:17:50.297740] [DEBUG] [LOCAL ] LNG: Loaded 37954 existing records from primary storage. [2025-09-15T21:17:50.318812] [INFO ] [MAIN ] LNG: Loaded 37954 primary data records. [2025-09-15T21:17:50.848314] [DEBUG] [MAIN ] LND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:50.849449] [INFO ] [MAIN ] LND: Generated 1326 derivative records from 3604 primary records. [2025-09-15T21:17:50.850201] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-15T21:17:50.863940] [DEBUG] [LOCAL ] LND: Derivative data saved (1326 records). [2025-09-15T21:17:50.864207] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-15T21:17:50.866219] [INFO ] [MAIN ] Derivative Progress: 1081/2083 symbols completed. LND took 0.9s. Estimated remaining: 5m 33s. Rate: 180.6 symbols/min [2025-09-15T21:17:50.866848] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:50.881167] [DEBUG] [LOCAL ] LNN: Loaded 8087 existing records from primary storage. [2025-09-15T21:17:50.889149] [INFO ] [MAIN ] LNN: Loaded 8087 primary data records. [2025-09-15T21:17:50.899682] [DEBUG] [MAIN ] LNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:50.935517] [DEBUG] [MAIN ] LNC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:50.941417] [INFO ] [MAIN ] LNG: Generated 1326 derivative records from 37954 primary records. [2025-09-15T21:17:50.949003] [INFO ] [MAIN ] LNC: Generated 1326 derivative records from 37942 primary records. [2025-09-15T21:17:50.961235] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-15T21:17:50.969998] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-15T21:17:51.032629] [DEBUG] [LOCAL ] LNC: Derivative data saved (1326 records). [2025-09-15T21:17:51.059412] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-15T21:17:51.059631] [DEBUG] [LOCAL ] LNG: Derivative data saved (1326 records). [2025-09-15T21:17:51.106806] [INFO ] [MAIN ] Derivative Progress: 1082/2083 symbols completed. LNC took 1.1s. Estimated remaining: 5m 32s. Rate: 180.7 symbols/min [2025-09-15T21:17:51.193252] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:51.182190] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-15T21:17:51.203778] [INFO ] [MAIN ] Derivative Progress: 1083/2083 symbols completed. LNG took 1.2s. Estimated remaining: 5m 32s. Rate: 180.8 symbols/min [2025-09-15T21:17:51.204422] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:51.238557] [DEBUG] [LOCAL ] LOB: Loaded 19142 existing records from primary storage. [2025-09-15T21:17:51.252893] [INFO ] [MAIN ] LOB: Loaded 19142 primary data records. [2025-09-15T21:17:51.285967] [DEBUG] [MAIN ] LNN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:51.331490] [DEBUG] [LOCAL ] LOAR: Loaded 32217 existing records from primary storage. [2025-09-15T21:17:51.337559] [INFO ] [MAIN ] LNN: Generated 1326 derivative records from 8087 primary records. [2025-09-15T21:17:51.345246] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-15T21:17:51.345149] [INFO ] [MAIN ] LOAR: Loaded 32217 primary data records. [2025-09-15T21:17:51.582841] [DEBUG] [LOCAL ] LNN: Derivative data saved (1326 records). [2025-09-15T21:17:51.671404] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-15T21:17:51.674054] [INFO ] [MAIN ] Derivative Progress: 1084/2083 symbols completed. LNN took 0.8s. Estimated remaining: 5m 32s. Rate: 180.7 symbols/min [2025-09-15T21:17:51.690737] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:51.759385] [DEBUG] [LOCAL ] LOCL: Loaded 1941 existing records from primary storage. [2025-09-15T21:17:51.759618] [INFO ] [MAIN ] LOCL: Loaded 1941 primary data records. [2025-09-15T21:17:52.178766] [DEBUG] [MAIN ] LOB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:52.180162] [INFO ] [MAIN ] LOB: Generated 1326 derivative records from 19142 primary records. [2025-09-15T21:17:52.180850] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-15T21:17:52.195215] [DEBUG] [LOCAL ] LOB: Derivative data saved (1326 records). [2025-09-15T21:17:52.195930] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-15T21:17:52.197957] [INFO ] [MAIN ] Derivative Progress: 1085/2083 symbols completed. LOB took 1.0s. Estimated remaining: 5m 32s. Rate: 180.6 symbols/min [2025-09-15T21:17:52.199119] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:52.210022] [DEBUG] [MAIN ] LOAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:52.210982] [INFO ] [MAIN ] LOAR: Generated 1326 derivative records from 32217 primary records. [2025-09-15T21:17:52.211168] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-15T21:17:52.224131] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1326 records). [2025-09-15T21:17:52.224251] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-15T21:17:52.225909] [INFO ] [MAIN ] Derivative Progress: 1086/2083 symbols completed. LOAR took 1.0s. Estimated remaining: 5m 31s. Rate: 180.8 symbols/min [2025-09-15T21:17:52.226393] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:52.245278] [DEBUG] [MAIN ] LOCL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:52.246042] [INFO ] [MAIN ] LOCL: Generated 1326 derivative records from 1941 primary records. [2025-09-15T21:17:52.246208] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-15T21:17:52.264025] [DEBUG] [LOCAL ] LOMA: Loaded 22980 existing records from primary storage. [2025-09-15T21:17:52.264669] [INFO ] [MAIN ] LOMA: Loaded 22980 primary data records. [2025-09-15T21:17:52.264970] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1326 records). [2025-09-15T21:17:52.265154] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-15T21:17:52.297382] [INFO ] [MAIN ] Derivative Progress: 1087/2083 symbols completed. LOCL took 0.6s. Estimated remaining: 5m 30s. Rate: 180.9 symbols/min [2025-09-15T21:17:52.330439] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:52.554236] [DEBUG] [LOCAL ] LOW: Loaded 39109 existing records from primary storage. [2025-09-15T21:17:52.554495] [INFO ] [MAIN ] LOW: Loaded 39109 primary data records. [2025-09-15T21:17:52.752225] [DEBUG] [LOCAL ] LPG: Loaded 29546 existing records from primary storage. [2025-09-15T21:17:52.757163] [INFO ] [MAIN ] LPG: Loaded 29546 primary data records. [2025-09-15T21:17:53.031948] [DEBUG] [MAIN ] LOMA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:53.118926] [INFO ] [MAIN ] LOMA: Generated 1326 derivative records from 22980 primary records. [2025-09-15T21:17:53.119315] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-15T21:17:53.132983] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1326 records). [2025-09-15T21:17:53.133422] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-15T21:17:53.134932] [INFO ] [MAIN ] Derivative Progress: 1088/2083 symbols completed. LOMA took 0.9s. Estimated remaining: 5m 30s. Rate: 180.6 symbols/min [2025-09-15T21:17:53.135909] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:53.149480] [DEBUG] [MAIN ] LOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:53.150225] [INFO ] [MAIN ] LOW: Generated 1326 derivative records from 39109 primary records. [2025-09-15T21:17:53.150388] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-15T21:17:53.163378] [DEBUG] [LOCAL ] LOW: Derivative data saved (1326 records). [2025-09-15T21:17:53.167976] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-15T21:17:53.170121] [INFO ] [MAIN ] Derivative Progress: 1089/2083 symbols completed. LOW took 0.9s. Estimated remaining: 5m 30s. Rate: 180.8 symbols/min [2025-09-15T21:17:53.170495] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:53.181814] [DEBUG] [LOCAL ] LPL: Loaded 19036 existing records from primary storage. [2025-09-15T21:17:53.191397] [INFO ] [MAIN ] LPL: Loaded 19036 primary data records. [2025-09-15T21:17:53.191881] [DEBUG] [MAIN ] LPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:53.192775] [INFO ] [MAIN ] LPG: Generated 1326 derivative records from 29546 primary records. [2025-09-15T21:17:53.192871] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-15T21:17:53.343166] [DEBUG] [LOCAL ] LPG: Derivative data saved (1326 records). [2025-09-15T21:17:53.349015] [DEBUG] [LOCAL ] LPX: Loaded 29378 existing records from primary storage. [2025-09-15T21:17:53.368583] [INFO ] [MAIN ] LPX: Loaded 29378 primary data records. [2025-09-15T21:17:53.384479] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-15T21:17:53.387004] [INFO ] [MAIN ] Derivative Progress: 1090/2083 symbols completed. LPG took 1.1s. Estimated remaining: 5m 29s. Rate: 180.8 symbols/min [2025-09-15T21:17:53.443469] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:53.808543] [DEBUG] [LOCAL ] LRN: Loaded 29198 existing records from primary storage. [2025-09-15T21:17:53.809428] [INFO ] [MAIN ] LRN: Loaded 29198 primary data records. [2025-09-15T21:17:53.926393] [DEBUG] [MAIN ] LPL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:53.943316] [INFO ] [MAIN ] LPL: Generated 1326 derivative records from 19036 primary records. [2025-09-15T21:17:53.953696] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-15T21:17:54.112615] [DEBUG] [LOCAL ] LPL: Derivative data saved (1326 records). [2025-09-15T21:17:54.113505] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-15T21:17:54.115863] [INFO ] [MAIN ] Derivative Progress: 1091/2083 symbols completed. LPL took 1.0s. Estimated remaining: 5m 29s. Rate: 180.6 symbols/min [2025-09-15T21:17:54.113844] [DEBUG] [MAIN ] LPX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:54.116467] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:54.117955] [INFO ] [MAIN ] LPX: Generated 1326 derivative records from 29378 primary records. [2025-09-15T21:17:54.118159] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-15T21:17:54.131129] [DEBUG] [LOCAL ] LPX: Derivative data saved (1326 records). [2025-09-15T21:17:54.131283] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-15T21:17:54.132837] [INFO ] [MAIN ] Derivative Progress: 1092/2083 symbols completed. LPX took 1.0s. Estimated remaining: 5m 29s. Rate: 180.8 symbols/min [2025-09-15T21:17:54.133109] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:54.156275] [DEBUG] [MAIN ] LRN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:54.156945] [INFO ] [MAIN ] LRN: Generated 1326 derivative records from 29198 primary records. [2025-09-15T21:17:54.157074] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-15T21:17:54.175071] [DEBUG] [LOCAL ] LRN: Derivative data saved (1326 records). [2025-09-15T21:17:54.175388] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-15T21:17:54.186492] [INFO ] [MAIN ] Derivative Progress: 1093/2083 symbols completed. LRN took 0.7s. Estimated remaining: 5m 28s. Rate: 180.9 symbols/min [2025-09-15T21:17:54.187834] [DEBUG] [LOCAL ] LSPD: Loaded 30931 existing records from primary storage. [2025-09-15T21:17:54.188143] [INFO ] [MAIN ] LSPD: Loaded 30931 primary data records. [2025-09-15T21:17:54.284948] [DEBUG] [LOCAL ] LTC: Loaded 22112 existing records from primary storage. [2025-09-15T21:17:54.295039] [INFO ] [MAIN ] LTC: Loaded 22112 primary data records. [2025-09-15T21:17:54.773463] [DEBUG] [MAIN ] LSPD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:54.775021] [INFO ] [MAIN ] LSPD: Generated 1326 derivative records from 30931 primary records. [2025-09-15T21:17:54.776263] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-15T21:17:54.795962] [DEBUG] [MAIN ] LTC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:54.799234] [INFO ] [MAIN ] LTC: Generated 1326 derivative records from 22112 primary records. [2025-09-15T21:17:54.799705] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-15T21:17:54.799599] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1326 records). [2025-09-15T21:17:54.800120] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-15T21:17:54.802039] [INFO ] [MAIN ] Derivative Progress: 1094/2083 symbols completed. LSPD took 0.7s. Estimated remaining: 5m 28s. Rate: 180.8 symbols/min [2025-09-15T21:17:54.813155] [DEBUG] [LOCAL ] LTC: Derivative data saved (1326 records). [2025-09-15T21:17:54.813232] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-15T21:17:54.814940] [INFO ] [MAIN ] Derivative Progress: 1095/2083 symbols completed. LTC took 0.7s. Estimated remaining: 5m 28s. Rate: 181.0 symbols/min [2025-09-15T21:17:54.815621] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:54.815709] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:54.816301] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:54.851857] [DEBUG] [LOCAL ] LTM: Loaded 27982 existing records from primary storage. [2025-09-15T21:17:54.852004] [INFO ] [MAIN ] LTM: Loaded 27982 primary data records. [2025-09-15T21:17:54.989819] [DEBUG] [LOCAL ] LU: Loaded 36227 existing records from primary storage. [2025-09-15T21:17:55.011054] [INFO ] [MAIN ] LU: Loaded 36227 primary data records. [2025-09-15T21:17:55.110174] [DEBUG] [LOCAL ] LTH: Loaded 38227 existing records from primary storage. [2025-09-15T21:17:55.243373] [INFO ] [MAIN ] LTH: Loaded 38227 primary data records. [2025-09-15T21:17:55.730619] [DEBUG] [MAIN ] LTM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:55.732280] [INFO ] [MAIN ] LTM: Generated 1326 derivative records from 27982 primary records. [2025-09-15T21:17:55.732491] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-15T21:17:55.747057] [DEBUG] [LOCAL ] LTM: Derivative data saved (1326 records). [2025-09-15T21:17:55.747942] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-15T21:17:55.749585] [INFO ] [MAIN ] Derivative Progress: 1096/2083 symbols completed. LTM took 0.9s. Estimated remaining: 5m 28s. Rate: 180.7 symbols/min [2025-09-15T21:17:55.751417] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:55.763563] [DEBUG] [MAIN ] LU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:55.764283] [INFO ] [MAIN ] LU: Generated 1326 derivative records from 36227 primary records. [2025-09-15T21:17:55.764508] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-15T21:17:55.778144] [DEBUG] [LOCAL ] LU: Derivative data saved (1326 records). [2025-09-15T21:17:55.782758] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-15T21:17:55.784815] [INFO ] [MAIN ] Derivative Progress: 1097/2083 symbols completed. LU took 1.0s. Estimated remaining: 5m 27s. Rate: 180.8 symbols/min [2025-09-15T21:17:55.785211] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:55.795483] [DEBUG] [LOCAL ] LUCK: Loaded 17494 existing records from primary storage. [2025-09-15T21:17:55.805240] [INFO ] [MAIN ] LUCK: Loaded 17494 primary data records. [2025-09-15T21:17:55.805826] [DEBUG] [MAIN ] LTH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:55.850188] [INFO ] [MAIN ] LTH: Generated 1326 derivative records from 38227 primary records. [2025-09-15T21:17:55.877148] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-15T21:17:55.976031] [DEBUG] [LOCAL ] LTH: Derivative data saved (1326 records). [2025-09-15T21:17:56.007825] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-15T21:17:56.010062] [INFO ] [MAIN ] Derivative Progress: 1098/2083 symbols completed. LTH took 1.2s. Estimated remaining: 5m 27s. Rate: 180.9 symbols/min [2025-09-15T21:17:56.015628] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:56.124244] [DEBUG] [LOCAL ] LUMN: Loaded 39620 existing records from primary storage. [2025-09-15T21:17:56.124781] [INFO ] [MAIN ] LUMN: Loaded 39620 primary data records. [2025-09-15T21:17:56.423512] [DEBUG] [LOCAL ] LUV: Loaded 39649 existing records from primary storage. [2025-09-15T21:17:56.424835] [INFO ] [MAIN ] LUV: Loaded 39649 primary data records. [2025-09-15T21:17:56.546923] [DEBUG] [MAIN ] LUCK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:56.564185] [INFO ] [MAIN ] LUCK: Generated 1326 derivative records from 17494 primary records. [2025-09-15T21:17:56.596802] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-09-15T21:17:56.635532] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1326 records). [2025-09-15T21:17:56.638622] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-09-15T21:17:56.640483] [INFO ] [MAIN ] Derivative Progress: 1099/2083 symbols completed. LUCK took 0.9s. Estimated remaining: 5m 27s. Rate: 180.7 symbols/min [2025-09-15T21:17:56.732057] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:56.784042] [DEBUG] [MAIN ] LUMN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:56.785741] [INFO ] [MAIN ] LUMN: Generated 1326 derivative records from 39620 primary records. [2025-09-15T21:17:56.786049] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-15T21:17:56.799145] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1326 records). [2025-09-15T21:17:56.799337] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-15T21:17:56.802995] [INFO ] [MAIN ] Derivative Progress: 1100/2083 symbols completed. LUMN took 1.0s. Estimated remaining: 5m 26s. Rate: 180.8 symbols/min [2025-09-15T21:17:56.804311] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:56.829903] [DEBUG] [MAIN ] LUV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:56.830628] [INFO ] [MAIN ] LUV: Generated 1326 derivative records from 39649 primary records. [2025-09-15T21:17:56.830816] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-15T21:17:56.858174] [DEBUG] [LOCAL ] LVS: Loaded 39539 existing records from primary storage. [2025-09-15T21:17:56.865329] [DEBUG] [LOCAL ] LVWR: Loaded 15660 existing records from primary storage. [2025-09-15T21:17:56.864740] [DEBUG] [LOCAL ] LUV: Derivative data saved (1326 records). [2025-09-15T21:17:56.865686] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-15T21:17:56.865417] [INFO ] [MAIN ] LVS: Loaded 39539 primary data records. [2025-09-15T21:17:56.865621] [INFO ] [MAIN ] LVWR: Loaded 15660 primary data records. [2025-09-15T21:17:56.890519] [INFO ] [MAIN ] Derivative Progress: 1101/2083 symbols completed. LUV took 0.9s. Estimated remaining: 5m 26s. Rate: 180.9 symbols/min [2025-09-15T21:17:56.890818] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:57.415131] [DEBUG] [LOCAL ] LW: Loaded 37616 existing records from primary storage. [2025-09-15T21:17:57.416214] [INFO ] [MAIN ] LW: Loaded 37616 primary data records. [2025-09-15T21:17:57.725360] [DEBUG] [MAIN ] LVWR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:57.727349] [INFO ] [MAIN ] LVWR: Generated 1326 derivative records from 15660 primary records. [2025-09-15T21:17:57.727552] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-15T21:17:57.726619] [DEBUG] [MAIN ] LVS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:57.729516] [INFO ] [MAIN ] LVS: Generated 1326 derivative records from 39539 primary records. [2025-09-15T21:17:57.729848] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-15T21:17:57.741259] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1326 records). [2025-09-15T21:17:57.741559] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-15T21:17:57.748797] [INFO ] [MAIN ] Derivative Progress: 1102/2083 symbols completed. LVWR took 0.9s. Estimated remaining: 5m 26s. Rate: 180.7 symbols/min [2025-09-15T21:17:57.749009] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:57.758599] [DEBUG] [LOCAL ] LVS: Derivative data saved (1326 records). [2025-09-15T21:17:57.758867] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-15T21:17:57.761227] [INFO ] [MAIN ] Derivative Progress: 1103/2083 symbols completed. LVS took 1.1s. Estimated remaining: 5m 25s. Rate: 180.8 symbols/min [2025-09-15T21:17:57.762021] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:57.775690] [DEBUG] [LOCAL ] LXFR: Loaded 12308 existing records from primary storage. [2025-09-15T21:17:57.782002] [INFO ] [MAIN ] LXFR: Loaded 12308 primary data records. [2025-09-15T21:17:57.786254] [DEBUG] [MAIN ] LW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:57.823559] [INFO ] [MAIN ] LW: Generated 1326 derivative records from 37616 primary records. [2025-09-15T21:17:57.842094] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-15T21:17:57.901758] [DEBUG] [LOCAL ] LW: Derivative data saved (1326 records). [2025-09-15T21:17:57.902087] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-15T21:17:57.913054] [INFO ] [MAIN ] Derivative Progress: 1104/2083 symbols completed. LW took 1.0s. Estimated remaining: 5m 25s. Rate: 180.9 symbols/min [2025-09-15T21:17:57.964366] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:58.084491] [DEBUG] [LOCAL ] LXP: Loaded 37393 existing records from primary storage. [2025-09-15T21:17:58.084722] [INFO ] [MAIN ] LXP: Loaded 37393 primary data records. [2025-09-15T21:17:58.220925] [DEBUG] [LOCAL ] LXU: Loaded 23480 existing records from primary storage. [2025-09-15T21:17:58.248809] [INFO ] [MAIN ] LXU: Loaded 23480 primary data records. [2025-09-15T21:17:58.691628] [DEBUG] [MAIN ] LXFR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:58.692922] [INFO ] [MAIN ] LXFR: Generated 1326 derivative records from 12308 primary records. [2025-09-15T21:17:58.693241] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-15T21:17:58.708534] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1326 records). [2025-09-15T21:17:58.709753] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-15T21:17:58.711819] [INFO ] [MAIN ] Derivative Progress: 1105/2083 symbols completed. LXFR took 1.0s. Estimated remaining: 5m 25s. Rate: 180.7 symbols/min [2025-09-15T21:17:58.712379] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:58.729942] [DEBUG] [MAIN ] LXP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:58.731044] [INFO ] [MAIN ] LXP: Generated 1326 derivative records from 37393 primary records. [2025-09-15T21:17:58.731417] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-15T21:17:58.746512] [DEBUG] [LOCAL ] LXP: Derivative data saved (1326 records). [2025-09-15T21:17:58.750232] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-15T21:17:58.752598] [INFO ] [MAIN ] Derivative Progress: 1106/2083 symbols completed. LXP took 1.0s. Estimated remaining: 5m 24s. Rate: 180.8 symbols/min [2025-09-15T21:17:58.762928] [DEBUG] [MAIN ] LXU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:58.762616] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:58.763855] [INFO ] [MAIN ] LXU: Generated 1326 derivative records from 23480 primary records. [2025-09-15T21:17:58.764449] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-15T21:17:58.787050] [DEBUG] [LOCAL ] LXU: Derivative data saved (1326 records). [2025-09-15T21:17:58.787339] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-15T21:17:58.790507] [INFO ] [MAIN ] Derivative Progress: 1107/2083 symbols completed. LXU took 0.8s. Estimated remaining: 5m 24s. Rate: 181.0 symbols/min [2025-09-15T21:17:58.790913] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:58.810536] [DEBUG] [LOCAL ] LYB: Loaded 39585 existing records from primary storage. [2025-09-15T21:17:58.810841] [INFO ] [MAIN ] LYB: Loaded 39585 primary data records. [2025-09-15T21:17:58.996446] [DEBUG] [LOCAL ] LYG: Loaded 38981 existing records from primary storage. [2025-09-15T21:17:59.005732] [INFO ] [MAIN ] LYG: Loaded 38981 primary data records. [2025-09-15T21:17:59.154438] [DEBUG] [LOCAL ] LYV: Loaded 37576 existing records from primary storage. [2025-09-15T21:17:59.222144] [INFO ] [MAIN ] LYV: Loaded 37576 primary data records. [2025-09-15T21:17:59.770857] [DEBUG] [MAIN ] LYB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:59.772079] [INFO ] [MAIN ] LYB: Generated 1326 derivative records from 39585 primary records. [2025-09-15T21:17:59.772195] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-15T21:17:59.787124] [DEBUG] [LOCAL ] LYB: Derivative data saved (1326 records). [2025-09-15T21:17:59.787240] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-15T21:17:59.788859] [INFO ] [MAIN ] Derivative Progress: 1108/2083 symbols completed. LYB took 1.1s. Estimated remaining: 5m 24s. Rate: 180.6 symbols/min [2025-09-15T21:17:59.804016] [DEBUG] [MAIN ] LYG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:59.805472] [INFO ] [MAIN ] LYG: Generated 1326 derivative records from 38981 primary records. [2025-09-15T21:17:59.805667] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-15T21:17:59.821548] [DEBUG] [MAIN ] LYV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:17:59.825181] [INFO ] [MAIN ] LYV: Generated 1326 derivative records from 37576 primary records. [2025-09-15T21:17:59.828270] [DEBUG] [LOCAL ] LYG: Derivative data saved (1326 records). [2025-09-15T21:17:59.828356] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-15T21:17:59.828478] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-15T21:17:59.831042] [INFO ] [MAIN ] Derivative Progress: 1109/2083 symbols completed. LYG took 1.1s. Estimated remaining: 5m 23s. Rate: 180.8 symbols/min [2025-09-15T21:17:59.842555] [DEBUG] [LOCAL ] LYV: Derivative data saved (1326 records). [2025-09-15T21:17:59.842614] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-15T21:17:59.844615] [INFO ] [MAIN ] Derivative Progress: 1110/2083 symbols completed. LYV took 1.1s. Estimated remaining: 5m 23s. Rate: 180.9 symbols/min [2025-09-15T21:17:59.845239] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:59.845495] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:59.845417] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:17:59.859817] [DEBUG] [LOCAL ] LZM: Loaded 8818 existing records from primary storage. [2025-09-15T21:17:59.860000] [INFO ] [MAIN ] LZM: Loaded 8818 primary data records. [2025-09-15T21:18:00.006915] [DEBUG] [LOCAL ] LZB: Loaded 26036 existing records from primary storage. [2025-09-15T21:18:00.011256] [INFO ] [MAIN ] LZB: Loaded 26036 primary data records. [2025-09-15T21:18:00.125622] [DEBUG] [LOCAL ] M: Loaded 39519 existing records from primary storage. [2025-09-15T21:18:00.154961] [INFO ] [MAIN ] M: Loaded 39519 primary data records. [2025-09-15T21:18:00.773936] [DEBUG] [MAIN ] LZM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:00.775174] [INFO ] [MAIN ] LZM: Generated 1326 derivative records from 8818 primary records. [2025-09-15T21:18:00.775503] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-15T21:18:00.789982] [DEBUG] [LOCAL ] LZM: Derivative data saved (1326 records). [2025-09-15T21:18:00.791053] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-15T21:18:00.792544] [INFO ] [MAIN ] Derivative Progress: 1111/2083 symbols completed. LZM took 0.9s. Estimated remaining: 5m 23s. Rate: 180.6 symbols/min [2025-09-15T21:18:00.793992] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:00.816729] [DEBUG] [MAIN ] M: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:00.817304] [DEBUG] [MAIN ] LZB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:00.817980] [INFO ] [MAIN ] M: Generated 1326 derivative records from 39519 primary records. [2025-09-15T21:18:00.819052] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-15T21:18:00.818832] [INFO ] [MAIN ] LZB: Generated 1326 derivative records from 26036 primary records. [2025-09-15T21:18:00.819830] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-15T21:18:00.832164] [DEBUG] [LOCAL ] M: Derivative data saved (1326 records). [2025-09-15T21:18:00.838419] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-15T21:18:00.843083] [DEBUG] [LOCAL ] LZB: Derivative data saved (1326 records). [2025-09-15T21:18:00.845143] [INFO ] [MAIN ] Derivative Progress: 1112/2083 symbols completed. M took 1.0s. Estimated remaining: 5m 22s. Rate: 180.8 symbols/min [2025-09-15T21:18:00.845432] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:00.845580] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-15T21:18:00.847785] [INFO ] [MAIN ] Derivative Progress: 1113/2083 symbols completed. LZB took 1.0s. Estimated remaining: 5m 22s. Rate: 180.9 symbols/min [2025-09-15T21:18:00.848129] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:00.888912] [DEBUG] [LOCAL ] MA: Loaded 38662 existing records from primary storage. [2025-09-15T21:18:00.889170] [INFO ] [MAIN ] MA: Loaded 38662 primary data records. [2025-09-15T21:18:01.021353] [DEBUG] [LOCAL ] MAA: Loaded 31623 existing records from primary storage. [2025-09-15T21:18:01.037662] [INFO ] [MAIN ] MAA: Loaded 31623 primary data records. [2025-09-15T21:18:01.074551] [DEBUG] [LOCAL ] MAC: Loaded 36424 existing records from primary storage. [2025-09-15T21:18:01.103181] [INFO ] [MAIN ] MAC: Loaded 36424 primary data records. [2025-09-15T21:18:01.813920] [DEBUG] [MAIN ] MA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:01.815162] [INFO ] [MAIN ] MA: Generated 1326 derivative records from 38662 primary records. [2025-09-15T21:18:01.816296] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-15T21:18:01.839940] [DEBUG] [MAIN ] MAA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:01.841863] [INFO ] [MAIN ] MAA: Generated 1326 derivative records from 31623 primary records. [2025-09-15T21:18:01.841184] [DEBUG] [LOCAL ] MA: Derivative data saved (1326 records). [2025-09-15T21:18:01.847790] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-15T21:18:01.851388] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-15T21:18:01.852936] [INFO ] [MAIN ] Derivative Progress: 1114/2083 symbols completed. MA took 1.1s. Estimated remaining: 5m 22s. Rate: 180.6 symbols/min [2025-09-15T21:18:01.853755] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:01.853599] [DEBUG] [MAIN ] MAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:01.854682] [INFO ] [MAIN ] MAC: Generated 1326 derivative records from 36424 primary records. [2025-09-15T21:18:01.854873] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-15T21:18:01.877438] [DEBUG] [LOCAL ] MAA: Derivative data saved (1326 records). [2025-09-15T21:18:01.878021] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-15T21:18:01.880801] [INFO ] [MAIN ] Derivative Progress: 1115/2083 symbols completed. MAA took 1.0s. Estimated remaining: 5m 21s. Rate: 180.7 symbols/min [2025-09-15T21:18:01.881367] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:01.883111] [DEBUG] [LOCAL ] MAC: Derivative data saved (1326 records). [2025-09-15T21:18:01.883269] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-15T21:18:01.885835] [INFO ] [MAIN ] Derivative Progress: 1116/2083 symbols completed. MAC took 1.0s. Estimated remaining: 5m 21s. Rate: 180.9 symbols/min [2025-09-15T21:18:01.886149] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:01.909341] [DEBUG] [LOCAL ] MAGN: Loaded 26043 existing records from primary storage. [2025-09-15T21:18:01.909483] [INFO ] [MAIN ] MAGN: Loaded 26043 primary data records. [2025-09-15T21:18:02.077689] [DEBUG] [LOCAL ] MAIN: Loaded 30333 existing records from primary storage. [2025-09-15T21:18:02.111950] [INFO ] [MAIN ] MAIN: Loaded 30333 primary data records. [2025-09-15T21:18:02.181917] [DEBUG] [LOCAL ] MAN: Loaded 32327 existing records from primary storage. [2025-09-15T21:18:02.299151] [INFO ] [MAIN ] MAN: Loaded 32327 primary data records. [2025-09-15T21:18:02.807749] [DEBUG] [MAIN ] MAGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:02.808754] [INFO ] [MAIN ] MAGN: Generated 1326 derivative records from 26043 primary records. [2025-09-15T21:18:02.809297] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-15T21:18:02.823586] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1326 records). [2025-09-15T21:18:02.825197] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-15T21:18:02.827099] [INFO ] [MAIN ] Derivative Progress: 1117/2083 symbols completed. MAGN took 1.0s. Estimated remaining: 5m 21s. Rate: 180.6 symbols/min [2025-09-15T21:18:02.827657] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:02.838216] [DEBUG] [MAIN ] MAIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:02.838946] [INFO ] [MAIN ] MAIN: Generated 1326 derivative records from 30333 primary records. [2025-09-15T21:18:02.839018] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-15T21:18:02.853469] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1326 records). [2025-09-15T21:18:02.853690] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-15T21:18:02.856198] [INFO ] [MAIN ] Derivative Progress: 1118/2083 symbols completed. MAIN took 1.0s. Estimated remaining: 5m 20s. Rate: 180.8 symbols/min [2025-09-15T21:18:02.861074] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:02.871728] [DEBUG] [MAIN ] MAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:02.872552] [INFO ] [MAIN ] MAN: Generated 1326 derivative records from 32327 primary records. [2025-09-15T21:18:02.872706] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-15T21:18:02.889308] [DEBUG] [LOCAL ] MANU: Loaded 19151 existing records from primary storage. [2025-09-15T21:18:02.890155] [INFO ] [MAIN ] MANU: Loaded 19151 primary data records. [2025-09-15T21:18:02.964245] [DEBUG] [LOCAL ] MAN: Derivative data saved (1326 records). [2025-09-15T21:18:02.986871] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-15T21:18:03.007840] [INFO ] [MAIN ] Derivative Progress: 1119/2083 symbols completed. MAN took 1.1s. Estimated remaining: 5m 20s. Rate: 180.8 symbols/min [2025-09-15T21:18:03.035301] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:03.096417] [DEBUG] [LOCAL ] MAS: Loaded 38615 existing records from primary storage. [2025-09-15T21:18:03.169426] [INFO ] [MAIN ] MAS: Loaded 38615 primary data records. [2025-09-15T21:18:03.395483] [DEBUG] [LOCAL ] MATV: Loaded 26656 existing records from primary storage. [2025-09-15T21:18:03.485578] [INFO ] [MAIN ] MATV: Loaded 26656 primary data records. [2025-09-15T21:18:03.651155] [DEBUG] [MAIN ] MANU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:03.684286] [INFO ] [MAIN ] MANU: Generated 1326 derivative records from 19151 primary records. [2025-09-15T21:18:03.685328] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-15T21:18:03.835125] [DEBUG] [LOCAL ] MANU: Derivative data saved (1326 records). [2025-09-15T21:18:03.835276] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-15T21:18:03.836978] [INFO ] [MAIN ] Derivative Progress: 1120/2083 symbols completed. MANU took 1.0s. Estimated remaining: 5m 20s. Rate: 180.6 symbols/min [2025-09-15T21:18:03.837679] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:03.852978] [DEBUG] [MAIN ] MAS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:03.853966] [INFO ] [MAIN ] MAS: Generated 1326 derivative records from 38615 primary records. [2025-09-15T21:18:03.854188] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-15T21:18:03.875094] [DEBUG] [LOCAL ] MAS: Derivative data saved (1326 records). [2025-09-15T21:18:03.875308] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-15T21:18:03.877469] [INFO ] [MAIN ] Derivative Progress: 1121/2083 symbols completed. MAS took 1.0s. Estimated remaining: 5m 19s. Rate: 180.7 symbols/min [2025-09-15T21:18:03.883708] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:03.896496] [DEBUG] [LOCAL ] MATX: Loaded 23548 existing records from primary storage. [2025-09-15T21:18:03.896878] [DEBUG] [MAIN ] MATV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:03.897199] [INFO ] [MAIN ] MATX: Loaded 23548 primary data records. [2025-09-15T21:18:03.897892] [INFO ] [MAIN ] MATV: Generated 1326 derivative records from 26656 primary records. [2025-09-15T21:18:03.898156] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-15T21:18:03.996725] [DEBUG] [LOCAL ] MATV: Derivative data saved (1326 records). [2025-09-15T21:18:04.008361] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-15T21:18:04.020911] [INFO ] [MAIN ] Derivative Progress: 1122/2083 symbols completed. MATV took 1.0s. Estimated remaining: 5m 19s. Rate: 180.8 symbols/min [2025-09-15T21:18:04.021288] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:04.088783] [DEBUG] [LOCAL ] MAX: Loaded 22023 existing records from primary storage. [2025-09-15T21:18:04.110140] [INFO ] [MAIN ] MAX: Loaded 22023 primary data records. [2025-09-15T21:18:04.347848] [DEBUG] [LOCAL ] MBC: Loaded 31444 existing records from primary storage. [2025-09-15T21:18:04.364094] [INFO ] [MAIN ] MBC: Loaded 31444 primary data records. [2025-09-15T21:18:04.785168] [DEBUG] [MAIN ] MATX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:04.786049] [INFO ] [MAIN ] MATX: Generated 1326 derivative records from 23548 primary records. [2025-09-15T21:18:04.787357] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-15T21:18:04.801553] [DEBUG] [LOCAL ] MATX: Derivative data saved (1326 records). [2025-09-15T21:18:04.802012] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-15T21:18:04.803868] [INFO ] [MAIN ] Derivative Progress: 1123/2083 symbols completed. MATX took 1.0s. Estimated remaining: 5m 19s. Rate: 180.6 symbols/min [2025-09-15T21:18:04.818767] [DEBUG] [MAIN ] MAX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:04.819465] [INFO ] [MAIN ] MAX: Generated 1326 derivative records from 22023 primary records. [2025-09-15T21:18:04.819674] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-15T21:18:04.834161] [DEBUG] [LOCAL ] MAX: Derivative data saved (1326 records). [2025-09-15T21:18:04.834259] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-15T21:18:04.836016] [INFO ] [MAIN ] Derivative Progress: 1124/2083 symbols completed. MAX took 1.0s. Estimated remaining: 5m 18s. Rate: 180.8 symbols/min [2025-09-15T21:18:04.845629] [DEBUG] [MAIN ] MBC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:04.846232] [INFO ] [MAIN ] MBC: Generated 1326 derivative records from 31444 primary records. [2025-09-15T21:18:04.846293] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-15T21:18:04.858042] [DEBUG] [LOCAL ] MBC: Derivative data saved (1326 records). [2025-09-15T21:18:04.858101] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-15T21:18:04.860216] [INFO ] [MAIN ] Derivative Progress: 1125/2083 symbols completed. MBC took 0.8s. Estimated remaining: 5m 18s. Rate: 180.9 symbols/min [2025-09-15T21:18:04.860628] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:04.860815] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:04.860906] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:04.875216] [DEBUG] [LOCAL ] MCB: Loaded 8093 existing records from primary storage. [2025-09-15T21:18:04.875409] [INFO ] [MAIN ] MCB: Loaded 8093 primary data records. [2025-09-15T21:18:05.002529] [DEBUG] [LOCAL ] MBI: Loaded 17482 existing records from primary storage. [2025-09-15T21:18:05.060702] [DEBUG] [LOCAL ] MC: Loaded 32268 existing records from primary storage. [2025-09-15T21:18:05.063915] [INFO ] [MAIN ] MC: Loaded 32268 primary data records. [2025-09-15T21:18:05.060104] [INFO ] [MAIN ] MBI: Loaded 17482 primary data records. [2025-09-15T21:18:05.757693] [DEBUG] [MAIN ] MCB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:05.758731] [INFO ] [MAIN ] MCB: Generated 1326 derivative records from 8093 primary records. [2025-09-15T21:18:05.759222] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-15T21:18:05.776600] [DEBUG] [LOCAL ] MCB: Derivative data saved (1326 records). [2025-09-15T21:18:05.776741] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-15T21:18:05.787580] [INFO ] [MAIN ] Derivative Progress: 1126/2083 symbols completed. MCB took 0.9s. Estimated remaining: 5m 18s. Rate: 180.6 symbols/min [2025-09-15T21:18:05.791707] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:05.793063] [DEBUG] [MAIN ] MBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:05.803917] [INFO ] [MAIN ] MBI: Generated 1326 derivative records from 17482 primary records. [2025-09-15T21:18:05.804277] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-15T21:18:05.810985] [DEBUG] [MAIN ] MC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:05.815172] [INFO ] [MAIN ] MC: Generated 1326 derivative records from 32268 primary records. [2025-09-15T21:18:05.818150] [DEBUG] [LOCAL ] MBI: Derivative data saved (1326 records). [2025-09-15T21:18:05.818316] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-15T21:18:05.818410] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-15T21:18:05.820629] [INFO ] [MAIN ] Derivative Progress: 1127/2083 symbols completed. MBI took 1.0s. Estimated remaining: 5m 17s. Rate: 180.8 symbols/min [2025-09-15T21:18:05.822089] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:05.835520] [DEBUG] [LOCAL ] MC: Derivative data saved (1326 records). [2025-09-15T21:18:05.835683] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-15T21:18:05.838699] [INFO ] [MAIN ] Derivative Progress: 1128/2083 symbols completed. MC took 1.0s. Estimated remaining: 5m 17s. Rate: 180.9 symbols/min [2025-09-15T21:18:05.839295] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:05.847436] [DEBUG] [LOCAL ] MCI: Loaded 4602 existing records from primary storage. [2025-09-15T21:18:05.847697] [INFO ] [MAIN ] MCI: Loaded 4602 primary data records. [2025-09-15T21:18:06.068784] [DEBUG] [LOCAL ] MCD: Loaded 39466 existing records from primary storage. [2025-09-15T21:18:06.190309] [DEBUG] [LOCAL ] MCK: Loaded 28290 existing records from primary storage. [2025-09-15T21:18:06.179142] [INFO ] [MAIN ] MCD: Loaded 39466 primary data records. [2025-09-15T21:18:06.191161] [INFO ] [MAIN ] MCK: Loaded 28290 primary data records. [2025-09-15T21:18:06.775363] [DEBUG] [MAIN ] MCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:06.776635] [INFO ] [MAIN ] MCI: Generated 1326 derivative records from 4602 primary records. [2025-09-15T21:18:06.776762] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-15T21:18:06.792821] [DEBUG] [LOCAL ] MCI: Derivative data saved (1326 records). [2025-09-15T21:18:06.793131] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-15T21:18:06.795174] [INFO ] [MAIN ] Derivative Progress: 1129/2083 symbols completed. MCI took 1.0s. Estimated remaining: 5m 17s. Rate: 180.6 symbols/min [2025-09-15T21:18:06.795868] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:06.819733] [DEBUG] [LOCAL ] MCN: Loaded 5926 existing records from primary storage. [2025-09-15T21:18:06.816083] [DEBUG] [MAIN ] MCK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:06.829162] [INFO ] [MAIN ] MCN: Loaded 5926 primary data records. [2025-09-15T21:18:06.829680] [DEBUG] [MAIN ] MCD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:06.830583] [INFO ] [MAIN ] MCK: Generated 1326 derivative records from 28290 primary records. [2025-09-15T21:18:06.852353] [INFO ] [MAIN ] MCD: Generated 1326 derivative records from 39466 primary records. [2025-09-15T21:18:06.842096] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-15T21:18:06.867687] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-15T21:18:06.953518] [DEBUG] [LOCAL ] MCK: Derivative data saved (1326 records). [2025-09-15T21:18:06.959695] [DEBUG] [LOCAL ] MCD: Derivative data saved (1326 records). [2025-09-15T21:18:06.960051] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-15T21:18:06.960153] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-15T21:18:06.962580] [INFO ] [MAIN ] Derivative Progress: 1130/2083 symbols completed. MCD took 1.2s. Estimated remaining: 5m 16s. Rate: 180.7 symbols/min [2025-09-15T21:18:06.981850] [INFO ] [MAIN ] Derivative Progress: 1131/2083 symbols completed. MCK took 1.1s. Estimated remaining: 5m 16s. Rate: 180.8 symbols/min [2025-09-15T21:18:06.981948] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:06.987398] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:07.140679] [DEBUG] [LOCAL ] MCR: Loaded 6518 existing records from primary storage. [2025-09-15T21:18:07.140908] [INFO ] [MAIN ] MCR: Loaded 6518 primary data records. [2025-09-15T21:18:07.337792] [DEBUG] [LOCAL ] MCO: Loaded 27717 existing records from primary storage. [2025-09-15T21:18:07.427948] [INFO ] [MAIN ] MCO: Loaded 27717 primary data records. [2025-09-15T21:18:07.643184] [DEBUG] [MAIN ] MCN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:07.731476] [INFO ] [MAIN ] MCN: Generated 1326 derivative records from 5926 primary records. [2025-09-15T21:18:07.731825] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-15T21:18:07.747657] [DEBUG] [LOCAL ] MCN: Derivative data saved (1326 records). [2025-09-15T21:18:07.748291] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-15T21:18:07.751118] [INFO ] [MAIN ] Derivative Progress: 1132/2083 symbols completed. MCN took 1.0s. Estimated remaining: 5m 16s. Rate: 180.6 symbols/min [2025-09-15T21:18:07.751985] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:07.767539] [DEBUG] [MAIN ] MCR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:07.768469] [INFO ] [MAIN ] MCR: Generated 1326 derivative records from 6518 primary records. [2025-09-15T21:18:07.768742] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-15T21:18:07.786689] [DEBUG] [LOCAL ] MCR: Derivative data saved (1326 records). [2025-09-15T21:18:07.794794] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-15T21:18:07.797146] [INFO ] [MAIN ] Derivative Progress: 1133/2083 symbols completed. MCR took 0.8s. Estimated remaining: 5m 15s. Rate: 180.8 symbols/min [2025-09-15T21:18:07.794965] [DEBUG] [LOCAL ] MCS: Loaded 15437 existing records from primary storage. [2025-09-15T21:18:07.797683] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:07.799401] [INFO ] [MAIN ] MCS: Loaded 15437 primary data records. [2025-09-15T21:18:07.849025] [DEBUG] [MAIN ] MCO: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:07.868950] [INFO ] [MAIN ] MCO: Generated 1325 derivative records from 27717 primary records. [2025-09-15T21:18:07.881685] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-15T21:18:07.943679] [DEBUG] [LOCAL ] MCO: Derivative data saved (1325 records). [2025-09-15T21:18:07.951318] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-15T21:18:07.954475] [INFO ] [MAIN ] Derivative Progress: 1134/2083 symbols completed. MCO took 1.0s. Estimated remaining: 5m 15s. Rate: 180.9 symbols/min [2025-09-15T21:18:07.954944] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:07.992956] [DEBUG] [LOCAL ] MCY: Loaded 17493 existing records from primary storage. [2025-09-15T21:18:07.993266] [INFO ] [MAIN ] MCY: Loaded 17493 primary data records. [2025-09-15T21:18:08.394197] [DEBUG] [LOCAL ] MD: Loaded 28839 existing records from primary storage. [2025-09-15T21:18:08.517749] [INFO ] [MAIN ] MD: Loaded 28839 primary data records. [2025-09-15T21:18:08.821776] [DEBUG] [MAIN ] MCS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:08.832487] [INFO ] [MAIN ] MCS: Generated 1326 derivative records from 15437 primary records. [2025-09-15T21:18:08.831777] [DEBUG] [MAIN ] MCY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:08.833251] [INFO ] [MAIN ] MCY: Generated 1326 derivative records from 17493 primary records. [2025-09-15T21:18:08.833373] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-15T21:18:08.833526] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-15T21:18:08.860178] [DEBUG] [LOCAL ] MCY: Derivative data saved (1326 records). [2025-09-15T21:18:08.860301] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-15T21:18:08.864049] [INFO ] [MAIN ] Derivative Progress: 1135/2083 symbols completed. MCY took 1.1s. Estimated remaining: 5m 15s. Rate: 180.6 symbols/min [2025-09-15T21:18:08.864594] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:08.864185] [DEBUG] [LOCAL ] MCS: Derivative data saved (1326 records). [2025-09-15T21:18:08.865364] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-15T21:18:08.868147] [INFO ] [MAIN ] Derivative Progress: 1136/2083 symbols completed. MCS took 1.1s. Estimated remaining: 5m 14s. Rate: 180.7 symbols/min [2025-09-15T21:18:08.869119] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:08.877279] [DEBUG] [LOCAL ] MDST: Loaded 4046 existing records from primary storage. [2025-09-15T21:18:08.887085] [INFO ] [MAIN ] MDST: Loaded 4046 primary data records. [2025-09-15T21:18:08.909022] [DEBUG] [MAIN ] MD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:08.925395] [INFO ] [MAIN ] MD: Generated 1326 derivative records from 28839 primary records. [2025-09-15T21:18:08.925564] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-15T21:18:09.001420] [DEBUG] [LOCAL ] MD: Derivative data saved (1326 records). [2025-09-15T21:18:09.001685] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-15T21:18:09.003575] [INFO ] [MAIN ] Derivative Progress: 1137/2083 symbols completed. MD took 1.0s. Estimated remaining: 5m 14s. Rate: 180.8 symbols/min [2025-09-15T21:18:09.007271] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:09.191477] [DEBUG] [LOCAL ] MDT: Loaded 39638 existing records from primary storage. [2025-09-15T21:18:09.191847] [INFO ] [MAIN ] MDT: Loaded 39638 primary data records. [2025-09-15T21:18:09.343588] [DEBUG] [LOCAL ] MDU: Loaded 34744 existing records from primary storage. [2025-09-15T21:18:09.363898] [INFO ] [MAIN ] MDU: Loaded 34744 primary data records. [2025-09-15T21:18:09.678219] [DEBUG] [MAIN ] MDST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:09.767766] [INFO ] [MAIN ] MDST: Generated 1326 derivative records from 4046 primary records. [2025-09-15T21:18:09.768066] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-15T21:18:09.781617] [DEBUG] [LOCAL ] MDST: Derivative data saved (1326 records). [2025-09-15T21:18:09.782077] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-15T21:18:09.784300] [INFO ] [MAIN ] Derivative Progress: 1138/2083 symbols completed. MDST took 0.9s. Estimated remaining: 5m 14s. Rate: 180.6 symbols/min [2025-09-15T21:18:09.798949] [DEBUG] [MAIN ] MDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:09.799933] [INFO ] [MAIN ] MDT: Generated 1326 derivative records from 39638 primary records. [2025-09-15T21:18:09.800112] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-15T21:18:09.813100] [DEBUG] [LOCAL ] MDT: Derivative data saved (1326 records). [2025-09-15T21:18:09.813179] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-15T21:18:09.815710] [INFO ] [MAIN ] Derivative Progress: 1139/2083 symbols completed. MDT took 0.9s. Estimated remaining: 5m 13s. Rate: 180.8 symbols/min [2025-09-15T21:18:09.827732] [DEBUG] [MAIN ] MDU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:09.828398] [INFO ] [MAIN ] MDU: Generated 1326 derivative records from 34744 primary records. [2025-09-15T21:18:09.828460] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-15T21:18:09.840625] [DEBUG] [LOCAL ] MDU: Derivative data saved (1326 records). [2025-09-15T21:18:09.840782] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-15T21:18:09.842536] [INFO ] [MAIN ] Derivative Progress: 1140/2083 symbols completed. MDU took 0.8s. Estimated remaining: 5m 13s. Rate: 180.9 symbols/min [2025-09-15T21:18:09.843022] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:09.843571] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:09.843672] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:09.862933] [DEBUG] [LOCAL ] MED: Loaded 15589 existing records from primary storage. [2025-09-15T21:18:09.866451] [INFO ] [MAIN ] MED: Loaded 15589 primary data records. [2025-09-15T21:18:09.890482] [DEBUG] [LOCAL ] MDV: Loaded 6491 existing records from primary storage. [2025-09-15T21:18:09.912409] [INFO ] [MAIN ] MDV: Loaded 6491 primary data records. [2025-09-15T21:18:10.029461] [DEBUG] [LOCAL ] MEC: Loaded 12261 existing records from primary storage. [2025-09-15T21:18:10.084689] [INFO ] [MAIN ] MEC: Loaded 12261 primary data records. [2025-09-15T21:18:10.800931] [DEBUG] [MAIN ] MDV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:10.801980] [DEBUG] [MAIN ] MED: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:10.803167] [INFO ] [MAIN ] MDV: Generated 1326 derivative records from 6491 primary records. [2025-09-15T21:18:10.804094] [INFO ] [MAIN ] MED: Generated 1326 derivative records from 15589 primary records. [2025-09-15T21:18:10.804326] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-15T21:18:10.804411] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-15T21:18:10.827594] [DEBUG] [LOCAL ] MED: Derivative data saved (1326 records). [2025-09-15T21:18:10.828745] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-15T21:18:10.828668] [DEBUG] [LOCAL ] MDV: Derivative data saved (1326 records). [2025-09-15T21:18:10.830690] [INFO ] [MAIN ] Derivative Progress: 1141/2083 symbols completed. MED took 1.0s. Estimated remaining: 5m 13s. Rate: 180.6 symbols/min [2025-09-15T21:18:10.830756] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-15T21:18:10.831003] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:10.833906] [INFO ] [MAIN ] Derivative Progress: 1142/2083 symbols completed. MDV took 1.0s. Estimated remaining: 5m 12s. Rate: 180.8 symbols/min [2025-09-15T21:18:10.834299] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:10.846384] [DEBUG] [MAIN ] MEC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:10.847052] [INFO ] [MAIN ] MEC: Generated 1326 derivative records from 12261 primary records. [2025-09-15T21:18:10.847184] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-15T21:18:10.861355] [DEBUG] [LOCAL ] MEC: Derivative data saved (1326 records). [2025-09-15T21:18:10.866658] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-15T21:18:10.871720] [INFO ] [MAIN ] Derivative Progress: 1143/2083 symbols completed. MEC took 1.0s. Estimated remaining: 5m 12s. Rate: 180.9 symbols/min [2025-09-15T21:18:10.872046] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:10.881747] [DEBUG] [LOCAL ] MEG: Loaded 22278 existing records from primary storage. [2025-09-15T21:18:10.886780] [INFO ] [MAIN ] MEG: Loaded 22278 primary data records. [2025-09-15T21:18:10.887064] [DEBUG] [LOCAL ] MEGI: Loaded 14795 existing records from primary storage. [2025-09-15T21:18:10.887187] [INFO ] [MAIN ] MEGI: Loaded 14795 primary data records. [2025-09-15T21:18:11.252037] [DEBUG] [LOCAL ] MEI: Loaded 23106 existing records from primary storage. [2025-09-15T21:18:11.420277] [INFO ] [MAIN ] MEI: Loaded 23106 primary data records. [2025-09-15T21:18:11.718836] [DEBUG] [MAIN ] MEG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:11.719593] [INFO ] [MAIN ] MEG: Generated 1326 derivative records from 22278 primary records. [2025-09-15T21:18:11.719867] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-15T21:18:11.730605] [DEBUG] [MAIN ] MEGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:11.742746] [DEBUG] [LOCAL ] MEG: Derivative data saved (1326 records). [2025-09-15T21:18:11.742826] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-15T21:18:11.745078] [INFO ] [MAIN ] Derivative Progress: 1144/2083 symbols completed. MEG took 0.9s. Estimated remaining: 5m 12s. Rate: 180.6 symbols/min [2025-09-15T21:18:11.745562] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:11.742912] [INFO ] [MAIN ] MEGI: Generated 1326 derivative records from 14795 primary records. [2025-09-15T21:18:11.745745] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-15T21:18:11.760398] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1326 records). [2025-09-15T21:18:11.760861] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-15T21:18:11.762677] [INFO ] [MAIN ] Derivative Progress: 1145/2083 symbols completed. MEGI took 0.9s. Estimated remaining: 5m 11s. Rate: 180.8 symbols/min [2025-09-15T21:18:11.763042] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:11.777596] [DEBUG] [MAIN ] MEI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:11.778436] [INFO ] [MAIN ] MEI: Generated 1326 derivative records from 23106 primary records. [2025-09-15T21:18:11.778575] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-15T21:18:11.801307] [DEBUG] [LOCAL ] MEI: Derivative data saved (1326 records). [2025-09-15T21:18:11.801501] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-15T21:18:11.803837] [INFO ] [MAIN ] Derivative Progress: 1146/2083 symbols completed. MEI took 0.9s. Estimated remaining: 5m 11s. Rate: 180.9 symbols/min [2025-09-15T21:18:11.804275] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:11.827882] [DEBUG] [LOCAL ] MET: Loaded 39323 existing records from primary storage. [2025-09-15T21:18:11.830558] [DEBUG] [LOCAL ] MFAN: Loaded 3011 existing records from primary storage. [2025-09-15T21:18:11.830775] [INFO ] [MAIN ] MFAN: Loaded 3011 primary data records. [2025-09-15T21:18:11.830825] [INFO ] [MAIN ] MET: Loaded 39323 primary data records. [2025-09-15T21:18:12.022754] [DEBUG] [LOCAL ] MFA: Loaded 32905 existing records from primary storage. [2025-09-15T21:18:12.062923] [INFO ] [MAIN ] MFA: Loaded 32905 primary data records. [2025-09-15T21:18:12.635728] [DEBUG] [MAIN ] MET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:12.642128] [INFO ] [MAIN ] MET: Generated 1326 derivative records from 39323 primary records. [2025-09-15T21:18:12.646071] [DEBUG] [MAIN ] MFAN: Filtered 5146 bins outside market hours, 5747 incomplete bins [2025-09-15T21:18:12.646121] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-15T21:18:12.646761] [INFO ] [MAIN ] MFAN: Generated 1323 derivative records from 3011 primary records. [2025-09-15T21:18:12.647406] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-15T21:18:12.674319] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1323 records). [2025-09-15T21:18:12.673515] [DEBUG] [LOCAL ] MET: Derivative data saved (1326 records). [2025-09-15T21:18:12.683511] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-15T21:18:12.683577] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-15T21:18:12.685587] [INFO ] [MAIN ] Derivative Progress: 1147/2083 symbols completed. MFAN took 0.9s. Estimated remaining: 5m 11s. Rate: 180.7 symbols/min [2025-09-15T21:18:12.687485] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:12.687935] [INFO ] [MAIN ] Derivative Progress: 1148/2083 symbols completed. MET took 0.9s. Estimated remaining: 5m 10s. Rate: 180.8 symbols/min [2025-09-15T21:18:12.687820] [DEBUG] [MAIN ] MFA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:12.688996] [INFO ] [MAIN ] MFA: Generated 1326 derivative records from 32905 primary records. [2025-09-15T21:18:12.689245] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-15T21:18:12.689274] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:12.702666] [DEBUG] [LOCAL ] MFA: Derivative data saved (1326 records). [2025-09-15T21:18:12.702784] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-15T21:18:12.705014] [DEBUG] [LOCAL ] MFAO: Loaded 2818 existing records from primary storage. [2025-09-15T21:18:12.707233] [INFO ] [MAIN ] Derivative Progress: 1149/2083 symbols completed. MFA took 0.9s. Estimated remaining: 5m 10s. Rate: 181.0 symbols/min [2025-09-15T21:18:12.707474] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:12.707342] [INFO ] [MAIN ] MFAO: Loaded 2818 primary data records. [2025-09-15T21:18:13.019137] [DEBUG] [LOCAL ] MFC: Loaded 37624 existing records from primary storage. [2025-09-15T21:18:13.041348] [INFO ] [MAIN ] MFC: Loaded 37624 primary data records. [2025-09-15T21:18:13.047871] [DEBUG] [LOCAL ] MFG: Loaded 36559 existing records from primary storage. [2025-09-15T21:18:13.077185] [INFO ] [MAIN ] MFG: Loaded 36559 primary data records. [2025-09-15T21:18:13.623329] [DEBUG] [MAIN ] MFAO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:13.625210] [INFO ] [MAIN ] MFAO: Generated 1326 derivative records from 2818 primary records. [2025-09-15T21:18:13.625608] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-15T21:18:13.656685] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1326 records). [2025-09-15T21:18:13.657119] [DEBUG] [MAIN ] MFC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:13.657927] [INFO ] [MAIN ] MFC: Generated 1326 derivative records from 37624 primary records. [2025-09-15T21:18:13.657300] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-15T21:18:13.660676] [INFO ] [MAIN ] Derivative Progress: 1150/2083 symbols completed. MFAO took 1.0s. Estimated remaining: 5m 10s. Rate: 180.7 symbols/min [2025-09-15T21:18:13.661104] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:13.661223] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-15T21:18:13.688504] [DEBUG] [MAIN ] MFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:13.690180] [DEBUG] [LOCAL ] MFC: Derivative data saved (1326 records). [2025-09-15T21:18:13.690405] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-15T21:18:13.692774] [INFO ] [MAIN ] MFG: Generated 1326 derivative records from 36559 primary records. [2025-09-15T21:18:13.692070] [INFO ] [MAIN ] Derivative Progress: 1151/2083 symbols completed. MFC took 1.0s. Estimated remaining: 5m 9s. Rate: 180.8 symbols/min [2025-09-15T21:18:13.692925] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-15T21:18:13.693217] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:13.700664] [DEBUG] [LOCAL ] MFM: Loaded 9588 existing records from primary storage. [2025-09-15T21:18:13.713297] [DEBUG] [LOCAL ] MFG: Derivative data saved (1326 records). [2025-09-15T21:18:13.713635] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-15T21:18:13.715913] [INFO ] [MAIN ] Derivative Progress: 1152/2083 symbols completed. MFG took 1.0s. Estimated remaining: 5m 9s. Rate: 181.0 symbols/min [2025-09-15T21:18:13.713468] [INFO ] [MAIN ] MFM: Loaded 9588 primary data records. [2025-09-15T21:18:13.716272] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:13.719366] [DEBUG] [LOCAL ] MFSG: Loaded 3906 existing records from primary storage. [2025-09-15T21:18:13.734517] [INFO ] [MAIN ] MFSG: Loaded 3906 primary data records. [2025-09-15T21:18:13.951954] [DEBUG] [LOCAL ] MFSI: Loaded 8872 existing records from primary storage. [2025-09-15T21:18:13.963002] [INFO ] [MAIN ] MFSI: Loaded 8872 primary data records. [2025-09-15T21:18:14.613744] [DEBUG] [MAIN ] MFM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:14.614797] [INFO ] [MAIN ] MFM: Generated 1326 derivative records from 9588 primary records. [2025-09-15T21:18:14.624748] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-15T21:18:14.626744] [DEBUG] [MAIN ] MFSG: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:14.628113] [INFO ] [MAIN ] MFSG: Generated 1325 derivative records from 3906 primary records. [2025-09-15T21:18:14.628331] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-15T21:18:14.640297] [DEBUG] [LOCAL ] MFM: Derivative data saved (1326 records). [2025-09-15T21:18:14.647003] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-15T21:18:14.650909] [INFO ] [MAIN ] Derivative Progress: 1153/2083 symbols completed. MFM took 1.0s. Estimated remaining: 5m 9s. Rate: 180.7 symbols/min [2025-09-15T21:18:14.655693] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1325 records). [2025-09-15T21:18:14.656630] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-15T21:18:14.659043] [INFO ] [MAIN ] Derivative Progress: 1154/2083 symbols completed. MFSG took 1.0s. Estimated remaining: 5m 8s. Rate: 180.8 symbols/min [2025-09-15T21:18:14.668995] [DEBUG] [MAIN ] MFSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:14.669605] [INFO ] [MAIN ] MFSI: Generated 1326 derivative records from 8872 primary records. [2025-09-15T21:18:14.669688] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-15T21:18:14.681546] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1326 records). [2025-09-15T21:18:14.681617] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-15T21:18:14.683596] [INFO ] [MAIN ] Derivative Progress: 1155/2083 symbols completed. MFSI took 1.0s. Estimated remaining: 5m 8s. Rate: 181.0 symbols/min [2025-09-15T21:18:14.684456] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:14.684803] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:14.684617] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:14.692683] [DEBUG] [LOCAL ] MFSV: Loaded 1681 existing records from primary storage. [2025-09-15T21:18:14.696198] [INFO ] [MAIN ] MFSV: Loaded 1681 primary data records. [2025-09-15T21:18:14.695919] [DEBUG] [LOCAL ] MGF: Loaded 3170 existing records from primary storage. [2025-09-15T21:18:14.701686] [INFO ] [MAIN ] MGF: Loaded 3170 primary data records. [2025-09-15T21:18:14.904227] [DEBUG] [LOCAL ] MG: Loaded 11429 existing records from primary storage. [2025-09-15T21:18:14.925729] [INFO ] [MAIN ] MG: Loaded 11429 primary data records. [2025-09-15T21:18:15.654660] [DEBUG] [MAIN ] MFSV: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:15.659474] [INFO ] [MAIN ] MFSV: Generated 1325 derivative records from 1681 primary records. [2025-09-15T21:18:15.659751] [DEBUG] [MAIN ] MGF: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:15.669256] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-15T21:18:15.669585] [DEBUG] [MAIN ] MG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:15.670454] [INFO ] [MAIN ] MG: Generated 1326 derivative records from 11429 primary records. [2025-09-15T21:18:15.669218] [INFO ] [MAIN ] MGF: Generated 1325 derivative records from 3170 primary records. [2025-09-15T21:18:15.670849] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-15T21:18:15.670809] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-15T21:18:15.702868] [DEBUG] [LOCAL ] MGF: Derivative data saved (1325 records). [2025-09-15T21:18:15.701623] [DEBUG] [LOCAL ] MG: Derivative data saved (1326 records). [2025-09-15T21:18:15.702977] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-15T21:18:15.703039] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-15T21:18:15.698946] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1325 records). [2025-09-15T21:18:15.705123] [INFO ] [MAIN ] Derivative Progress: 1156/2083 symbols completed. MGF took 1.0s. Estimated remaining: 5m 8s. Rate: 180.6 symbols/min [2025-09-15T21:18:15.707332] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:15.707403] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-15T21:18:15.709198] [INFO ] [MAIN ] Derivative Progress: 1157/2083 symbols completed. MFSV took 1.0s. Estimated remaining: 5m 7s. Rate: 180.8 symbols/min [2025-09-15T21:18:15.709537] [INFO ] [MAIN ] Derivative Progress: 1158/2083 symbols completed. MG took 1.0s. Estimated remaining: 5m 7s. Rate: 181.0 symbols/min [2025-09-15T21:18:15.709586] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:15.709957] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:15.716548] [DEBUG] [LOCAL ] MGRB: Loaded 3036 existing records from primary storage. [2025-09-15T21:18:15.716776] [INFO ] [MAIN ] MGRB: Loaded 3036 primary data records. [2025-09-15T21:18:15.766764] [DEBUG] [LOCAL ] MGR: Loaded 4099 existing records from primary storage. [2025-09-15T21:18:15.778739] [INFO ] [MAIN ] MGR: Loaded 4099 primary data records. [2025-09-15T21:18:16.093564] [DEBUG] [LOCAL ] MGM: Loaded 39574 existing records from primary storage. [2025-09-15T21:18:16.181106] [INFO ] [MAIN ] MGM: Loaded 39574 primary data records. [2025-09-15T21:18:16.563702] [DEBUG] [MAIN ] MGRB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:16.563450] [DEBUG] [MAIN ] MGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:16.564453] [INFO ] [MAIN ] MGR: Generated 1326 derivative records from 4099 primary records. [2025-09-15T21:18:16.565182] [INFO ] [MAIN ] MGRB: Generated 1326 derivative records from 3036 primary records. [2025-09-15T21:18:16.565408] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-15T21:18:16.565466] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-15T21:18:16.587409] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1326 records). [2025-09-15T21:18:16.588410] [DEBUG] [LOCAL ] MGR: Derivative data saved (1326 records). [2025-09-15T21:18:16.588484] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-15T21:18:16.590610] [INFO ] [MAIN ] Derivative Progress: 1159/2083 symbols completed. MGRB took 0.9s. Estimated remaining: 5m 7s. Rate: 180.7 symbols/min [2025-09-15T21:18:16.590950] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-15T21:18:16.593042] [INFO ] [MAIN ] Derivative Progress: 1160/2083 symbols completed. MGR took 0.9s. Estimated remaining: 5m 6s. Rate: 180.9 symbols/min [2025-09-15T21:18:16.593229] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:16.590992] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:16.597866] [DEBUG] [LOCAL ] MGRD: Loaded 1640 existing records from primary storage. [2025-09-15T21:18:16.599160] [INFO ] [MAIN ] MGRD: Loaded 1640 primary data records. [2025-09-15T21:18:16.668789] [DEBUG] [LOCAL ] MGRE: Loaded 4814 existing records from primary storage. [2025-09-15T21:18:16.713157] [INFO ] [MAIN ] MGRE: Loaded 4814 primary data records. [2025-09-15T21:18:16.713486] [DEBUG] [MAIN ] MGM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:16.748281] [INFO ] [MAIN ] MGM: Generated 1326 derivative records from 39574 primary records. [2025-09-15T21:18:16.776148] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-15T21:18:16.915470] [DEBUG] [LOCAL ] MGM: Derivative data saved (1326 records). [2025-09-15T21:18:16.997626] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-15T21:18:17.005813] [INFO ] [MAIN ] Derivative Progress: 1161/2083 symbols completed. MGM took 1.3s. Estimated remaining: 5m 6s. Rate: 180.8 symbols/min [2025-09-15T21:18:17.027772] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:17.198081] [DEBUG] [MAIN ] MGRD: Filtered 5146 bins outside market hours, 5748 incomplete bins [2025-09-15T21:18:17.199070] [INFO ] [MAIN ] MGRD: Generated 1322 derivative records from 1640 primary records. [2025-09-15T21:18:17.199224] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-15T21:18:17.212158] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1322 records). [2025-09-15T21:18:17.212345] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-15T21:18:17.213914] [INFO ] [MAIN ] Derivative Progress: 1162/2083 symbols completed. MGRD took 0.6s. Estimated remaining: 5m 6s. Rate: 180.9 symbols/min [2025-09-15T21:18:17.214194] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:17.235818] [DEBUG] [MAIN ] MGRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:17.236412] [DEBUG] [LOCAL ] MGY: Loaded 38628 existing records from primary storage. [2025-09-15T21:18:17.237270] [INFO ] [MAIN ] MGRE: Generated 1326 derivative records from 4814 primary records. [2025-09-15T21:18:17.237429] [INFO ] [MAIN ] MGY: Loaded 38628 primary data records. [2025-09-15T21:18:17.237588] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-15T21:18:17.334380] [DEBUG] [LOCAL ] MHD: Loaded 8707 existing records from primary storage. [2025-09-15T21:18:17.345847] [INFO ] [MAIN ] MHD: Loaded 8707 primary data records. [2025-09-15T21:18:17.378342] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1326 records). [2025-09-15T21:18:17.412119] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-15T21:18:17.428373] [INFO ] [MAIN ] Derivative Progress: 1163/2083 symbols completed. MGRE took 0.8s. Estimated remaining: 5m 5s. Rate: 180.9 symbols/min [2025-09-15T21:18:17.456106] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:17.764975] [DEBUG] [LOCAL ] MHF: Loaded 6816 existing records from primary storage. [2025-09-15T21:18:17.815207] [INFO ] [MAIN ] MHF: Loaded 6816 primary data records. [2025-09-15T21:18:18.130140] [DEBUG] [MAIN ] MGY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:18.129584] [DEBUG] [MAIN ] MHD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:18.132061] [INFO ] [MAIN ] MGY: Generated 1326 derivative records from 38628 primary records. [2025-09-15T21:18:18.132930] [INFO ] [MAIN ] MHD: Generated 1326 derivative records from 8707 primary records. [2025-09-15T21:18:18.133060] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-15T21:18:18.133245] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-15T21:18:18.155849] [DEBUG] [LOCAL ] MHD: Derivative data saved (1326 records). [2025-09-15T21:18:18.158237] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-15T21:18:18.160198] [INFO ] [MAIN ] Derivative Progress: 1164/2083 symbols completed. MHD took 0.9s. Estimated remaining: 5m 5s. Rate: 180.7 symbols/min [2025-09-15T21:18:18.161460] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:18.161102] [DEBUG] [LOCAL ] MGY: Derivative data saved (1326 records). [2025-09-15T21:18:18.162387] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-15T21:18:18.164332] [INFO ] [MAIN ] Derivative Progress: 1165/2083 symbols completed. MGY took 1.1s. Estimated remaining: 5m 4s. Rate: 180.9 symbols/min [2025-09-15T21:18:18.164662] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:18.179273] [DEBUG] [MAIN ] MHF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:18.180049] [INFO ] [MAIN ] MHF: Generated 1326 derivative records from 6816 primary records. [2025-09-15T21:18:18.180144] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-15T21:18:18.184401] [DEBUG] [LOCAL ] MHN: Loaded 5513 existing records from primary storage. [2025-09-15T21:18:18.194595] [DEBUG] [LOCAL ] MHF: Derivative data saved (1326 records). [2025-09-15T21:18:18.194883] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-15T21:18:18.194701] [INFO ] [MAIN ] MHN: Loaded 5513 primary data records. [2025-09-15T21:18:18.208406] [INFO ] [MAIN ] Derivative Progress: 1166/2083 symbols completed. MHF took 0.8s. Estimated remaining: 5m 4s. Rate: 181.0 symbols/min [2025-09-15T21:18:18.236235] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:18.317793] [DEBUG] [LOCAL ] MHK: Loaded 31379 existing records from primary storage. [2025-09-15T21:18:18.328959] [INFO ] [MAIN ] MHK: Loaded 31379 primary data records. [2025-09-15T21:18:18.584705] [DEBUG] [LOCAL ] MHO: Loaded 17637 existing records from primary storage. [2025-09-15T21:18:18.599832] [INFO ] [MAIN ] MHO: Loaded 17637 primary data records. [2025-09-15T21:18:19.032138] [DEBUG] [MAIN ] MHN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:19.033668] [INFO ] [MAIN ] MHN: Generated 1326 derivative records from 5513 primary records. [2025-09-15T21:18:19.033893] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-15T21:18:19.046685] [DEBUG] [LOCAL ] MHN: Derivative data saved (1326 records). [2025-09-15T21:18:19.047243] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-15T21:18:19.049018] [INFO ] [MAIN ] Derivative Progress: 1167/2083 symbols completed. MHN took 0.9s. Estimated remaining: 5m 4s. Rate: 180.8 symbols/min [2025-09-15T21:18:19.049728] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:19.063420] [DEBUG] [MAIN ] MHK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:19.066915] [INFO ] [MAIN ] MHK: Generated 1326 derivative records from 31379 primary records. [2025-09-15T21:18:19.067780] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-15T21:18:19.086203] [DEBUG] [LOCAL ] MIN: Loaded 10623 existing records from primary storage. [2025-09-15T21:18:19.092966] [INFO ] [MAIN ] MIN: Loaded 10623 primary data records. [2025-09-15T21:18:19.096185] [DEBUG] [LOCAL ] MHK: Derivative data saved (1326 records). [2025-09-15T21:18:19.096551] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-15T21:18:19.108242] [DEBUG] [MAIN ] MHO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:19.142412] [INFO ] [MAIN ] MHO: Generated 1326 derivative records from 17637 primary records. [2025-09-15T21:18:19.129660] [INFO ] [MAIN ] Derivative Progress: 1168/2083 symbols completed. MHK took 1.0s. Estimated remaining: 5m 3s. Rate: 180.9 symbols/min [2025-09-15T21:18:19.163094] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-15T21:18:19.289185] [DEBUG] [LOCAL ] MHO: Derivative data saved (1326 records). [2025-09-15T21:18:19.316800] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-15T21:18:19.331600] [INFO ] [MAIN ] Derivative Progress: 1169/2083 symbols completed. MHO took 1.1s. Estimated remaining: 5m 3s. Rate: 181.0 symbols/min [2025-09-15T21:18:19.399359] [DEBUG] [MAIN ] MIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:19.400069] [INFO ] [MAIN ] MIN: Generated 1326 derivative records from 10623 primary records. [2025-09-15T21:18:19.400134] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-15T21:18:19.411478] [DEBUG] [LOCAL ] MIN: Derivative data saved (1326 records). [2025-09-15T21:18:19.411536] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-15T21:18:19.413274] [INFO ] [MAIN ] Derivative Progress: 1170/2083 symbols completed. MIN took 0.4s. Estimated remaining: 5m 3s. Rate: 181.1 symbols/min [2025-09-15T21:18:19.414153] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:19.414083] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:19.414302] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:19.419173] [DEBUG] [LOCAL ] MITP: Loaded 1616 existing records from primary storage. [2025-09-15T21:18:19.419387] [INFO ] [MAIN ] MITP: Loaded 1616 primary data records. [2025-09-15T21:18:19.558521] [DEBUG] [LOCAL ] MITT: Loaded 15605 existing records from primary storage. [2025-09-15T21:18:19.624526] [INFO ] [MAIN ] MITT: Loaded 15605 primary data records. [2025-09-15T21:18:19.815066] [DEBUG] [LOCAL ] MIR: Loaded 37755 existing records from primary storage. [2025-09-15T21:18:19.832723] [INFO ] [MAIN ] MIR: Loaded 37755 primary data records. [2025-09-15T21:18:20.325682] [DEBUG] [MAIN ] MITP: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:20.327030] [INFO ] [MAIN ] MITP: Generated 1325 derivative records from 1616 primary records. [2025-09-15T21:18:20.327324] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-15T21:18:20.340936] [DEBUG] [LOCAL ] MITP: Derivative data saved (1325 records). [2025-09-15T21:18:20.341268] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-15T21:18:20.343459] [INFO ] [MAIN ] Derivative Progress: 1171/2083 symbols completed. MITP took 0.9s. Estimated remaining: 5m 3s. Rate: 180.8 symbols/min [2025-09-15T21:18:20.343797] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:20.354459] [DEBUG] [MAIN ] MITT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:20.355485] [INFO ] [MAIN ] MITT: Generated 1326 derivative records from 15605 primary records. [2025-09-15T21:18:20.359242] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-15T21:18:20.371315] [DEBUG] [LOCAL ] MIY: Loaded 4318 existing records from primary storage. [2025-09-15T21:18:20.383531] [INFO ] [MAIN ] MIY: Loaded 4318 primary data records. [2025-09-15T21:18:20.383462] [DEBUG] [LOCAL ] MITT: Derivative data saved (1326 records). [2025-09-15T21:18:20.406367] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-15T21:18:20.424320] [INFO ] [MAIN ] Derivative Progress: 1172/2083 symbols completed. MITT took 1.0s. Estimated remaining: 5m 2s. Rate: 180.9 symbols/min [2025-09-15T21:18:20.395965] [DEBUG] [MAIN ] MIR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:20.437867] [INFO ] [MAIN ] MIR: Generated 1326 derivative records from 37755 primary records. [2025-09-15T21:18:20.437946] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:20.458825] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-15T21:18:20.669299] [DEBUG] [LOCAL ] MIR: Derivative data saved (1326 records). [2025-09-15T21:18:20.684598] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-15T21:18:20.698501] [INFO ] [MAIN ] Derivative Progress: 1173/2083 symbols completed. MIR took 1.3s. Estimated remaining: 5m 2s. Rate: 180.9 symbols/min [2025-09-15T21:18:20.700081] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:20.722611] [DEBUG] [LOCAL ] MKC: Loaded 38721 existing records from primary storage. [2025-09-15T21:18:20.723306] [INFO ] [MAIN ] MKC: Loaded 38721 primary data records. [2025-09-15T21:18:20.860762] [DEBUG] [LOCAL ] MKL: Loaded 25028 existing records from primary storage. [2025-09-15T21:18:20.861138] [DEBUG] [MAIN ] MIY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:20.872346] [INFO ] [MAIN ] MIY: Generated 1326 derivative records from 4318 primary records. [2025-09-15T21:18:20.872432] [INFO ] [MAIN ] MKL: Loaded 25028 primary data records. [2025-09-15T21:18:20.877816] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-15T21:18:21.126522] [DEBUG] [LOCAL ] MIY: Derivative data saved (1326 records). [2025-09-15T21:18:21.137313] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-15T21:18:21.139085] [INFO ] [MAIN ] Derivative Progress: 1174/2083 symbols completed. MIY took 0.8s. Estimated remaining: 5m 1s. Rate: 180.9 symbols/min [2025-09-15T21:18:21.139425] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:21.345539] [DEBUG] [MAIN ] MKC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:21.346042] [DEBUG] [LOCAL ] MLI: Loaded 31883 existing records from primary storage. [2025-09-15T21:18:21.346223] [INFO ] [MAIN ] MLI: Loaded 31883 primary data records. [2025-09-15T21:18:21.346982] [INFO ] [MAIN ] MKC: Generated 1326 derivative records from 38721 primary records. [2025-09-15T21:18:21.367271] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-15T21:18:21.459139] [DEBUG] [LOCAL ] MKC: Derivative data saved (1326 records). [2025-09-15T21:18:21.459259] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-15T21:18:21.461401] [INFO ] [MAIN ] Derivative Progress: 1175/2083 symbols completed. MKC took 1.0s. Estimated remaining: 5m 1s. Rate: 180.9 symbols/min [2025-09-15T21:18:21.462079] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:21.552112] [DEBUG] [MAIN ] MKL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:21.643397] [INFO ] [MAIN ] MKL: Generated 1326 derivative records from 25028 primary records. [2025-09-15T21:18:21.643687] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-15T21:18:21.658358] [DEBUG] [LOCAL ] MKL: Derivative data saved (1326 records). [2025-09-15T21:18:21.658625] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-15T21:18:21.667317] [INFO ] [MAIN ] Derivative Progress: 1176/2083 symbols completed. MKL took 1.0s. Estimated remaining: 5m 1s. Rate: 181.0 symbols/min [2025-09-15T21:18:21.668138] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:21.667951] [DEBUG] [LOCAL ] MLM: Loaded 21374 existing records from primary storage. [2025-09-15T21:18:21.668352] [INFO ] [MAIN ] MLM: Loaded 21374 primary data records. [2025-09-15T21:18:21.854511] [DEBUG] [LOCAL ] MLNK: Loaded 18738 existing records from primary storage. [2025-09-15T21:18:21.857320] [INFO ] [MAIN ] MLNK: Loaded 18738 primary data records. [2025-09-15T21:18:22.088822] [DEBUG] [MAIN ] MLI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:22.093069] [INFO ] [MAIN ] MLI: Generated 1326 derivative records from 31883 primary records. [2025-09-15T21:18:22.109768] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-15T21:18:22.272439] [DEBUG] [LOCAL ] MLI: Derivative data saved (1326 records). [2025-09-15T21:18:22.273796] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-15T21:18:22.277909] [INFO ] [MAIN ] Derivative Progress: 1177/2083 symbols completed. MLI took 1.1s. Estimated remaining: 5m 1s. Rate: 180.8 symbols/min [2025-09-15T21:18:22.279627] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:22.291406] [DEBUG] [MAIN ] MLM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:22.292681] [INFO ] [MAIN ] MLM: Generated 1326 derivative records from 21374 primary records. [2025-09-15T21:18:22.294073] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-15T21:18:22.296969] [DEBUG] [LOCAL ] MLP: Loaded 2255 existing records from primary storage. [2025-09-15T21:18:22.297240] [INFO ] [MAIN ] MLP: Loaded 2255 primary data records. [2025-09-15T21:18:22.390087] [DEBUG] [LOCAL ] MLM: Derivative data saved (1326 records). [2025-09-15T21:18:22.409117] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-15T21:18:22.413972] [INFO ] [MAIN ] Derivative Progress: 1178/2083 symbols completed. MLM took 1.0s. Estimated remaining: 5m 0s. Rate: 180.9 symbols/min [2025-09-15T21:18:22.414974] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:22.498098] [DEBUG] [MAIN ] MLNK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:22.577352] [DEBUG] [LOCAL ] MLR: Loaded 8409 existing records from primary storage. [2025-09-15T21:18:22.578081] [INFO ] [MAIN ] MLNK: Generated 1326 derivative records from 18738 primary records. [2025-09-15T21:18:22.587933] [INFO ] [MAIN ] MLR: Loaded 8409 primary data records. [2025-09-15T21:18:22.588260] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-15T21:18:22.704548] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1326 records). [2025-09-15T21:18:22.704712] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-15T21:18:22.712918] [INFO ] [MAIN ] Derivative Progress: 1179/2083 symbols completed. MLNK took 1.0s. Estimated remaining: 4m 60s. Rate: 180.9 symbols/min [2025-09-15T21:18:22.718224] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:22.884798] [DEBUG] [MAIN ] MLP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:22.885759] [INFO ] [MAIN ] MLP: Generated 1326 derivative records from 2255 primary records. [2025-09-15T21:18:22.887004] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-15T21:18:22.907698] [DEBUG] [LOCAL ] MLP: Derivative data saved (1326 records). [2025-09-15T21:18:22.907991] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-15T21:18:22.909870] [INFO ] [MAIN ] Derivative Progress: 1180/2083 symbols completed. MLP took 0.6s. Estimated remaining: 4m 59s. Rate: 181.0 symbols/min [2025-09-15T21:18:22.910923] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:22.926015] [DEBUG] [LOCAL ] MMC: Loaded 38185 existing records from primary storage. [2025-09-15T21:18:22.928100] [INFO ] [MAIN ] MMC: Loaded 38185 primary data records. [2025-09-15T21:18:22.980928] [DEBUG] [MAIN ] MLR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:23.014340] [INFO ] [MAIN ] MLR: Generated 1326 derivative records from 8409 primary records. [2025-09-15T21:18:23.045094] [DEBUG] [LOCAL ] MMD: Loaded 7760 existing records from primary storage. [2025-09-15T21:18:23.045199] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-15T21:18:23.046514] [INFO ] [MAIN ] MMD: Loaded 7760 primary data records. [2025-09-15T21:18:23.241116] [DEBUG] [LOCAL ] MLR: Derivative data saved (1326 records). [2025-09-15T21:18:23.339897] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-15T21:18:23.352133] [INFO ] [MAIN ] Derivative Progress: 1181/2083 symbols completed. MLR took 0.9s. Estimated remaining: 4m 59s. Rate: 180.9 symbols/min [2025-09-15T21:18:23.389237] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:23.509377] [DEBUG] [LOCAL ] MMI: Loaded 10782 existing records from primary storage. [2025-09-15T21:18:23.509802] [INFO ] [MAIN ] MMI: Loaded 10782 primary data records. [2025-09-15T21:18:23.698223] [DEBUG] [MAIN ] MMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:23.784997] [INFO ] [MAIN ] MMC: Generated 1326 derivative records from 38185 primary records. [2025-09-15T21:18:23.785952] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-15T21:18:23.808932] [DEBUG] [MAIN ] MMD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:23.811792] [DEBUG] [LOCAL ] MMC: Derivative data saved (1326 records). [2025-09-15T21:18:23.812501] [INFO ] [MAIN ] MMD: Generated 1326 derivative records from 7760 primary records. [2025-09-15T21:18:23.812890] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-15T21:18:23.815515] [INFO ] [MAIN ] Derivative Progress: 1182/2083 symbols completed. MMC took 1.1s. Estimated remaining: 4m 59s. Rate: 180.9 symbols/min [2025-09-15T21:18:23.815600] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-15T21:18:23.815757] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:23.830664] [DEBUG] [LOCAL ] MMD: Derivative data saved (1326 records). [2025-09-15T21:18:23.831004] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-15T21:18:23.832888] [INFO ] [MAIN ] Derivative Progress: 1183/2083 symbols completed. MMD took 0.9s. Estimated remaining: 4m 58s. Rate: 181.0 symbols/min [2025-09-15T21:18:23.847129] [DEBUG] [MAIN ] MMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:23.847903] [INFO ] [MAIN ] MMI: Generated 1326 derivative records from 10782 primary records. [2025-09-15T21:18:23.847974] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-15T21:18:23.862129] [DEBUG] [LOCAL ] MMI: Derivative data saved (1326 records). [2025-09-15T21:18:23.862305] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-15T21:18:23.864508] [INFO ] [MAIN ] Derivative Progress: 1184/2083 symbols completed. MMI took 0.5s. Estimated remaining: 4m 58s. Rate: 181.2 symbols/min [2025-09-15T21:18:23.891326] [DEBUG] [LOCAL ] MMM: Loaded 39261 existing records from primary storage. [2025-09-15T21:18:23.891464] [INFO ] [MAIN ] MMM: Loaded 39261 primary data records. [2025-09-15T21:18:24.194545] [DEBUG] [MAIN ] MMM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:24.195215] [INFO ] [MAIN ] MMM: Generated 1326 derivative records from 39261 primary records. [2025-09-15T21:18:24.195299] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-15T21:18:24.206935] [DEBUG] [LOCAL ] MMM: Derivative data saved (1326 records). [2025-09-15T21:18:24.206992] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-15T21:18:24.208975] [INFO ] [MAIN ] Derivative Progress: 1185/2083 symbols completed. MMM took 0.4s. Estimated remaining: 4m 57s. Rate: 181.2 symbols/min [2025-09-15T21:18:24.209714] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:24.209838] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:24.209943] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:24.224570] [DEBUG] [LOCAL ] MMT: Loaded 7640 existing records from primary storage. [2025-09-15T21:18:24.224786] [INFO ] [MAIN ] MMT: Loaded 7640 primary data records. [2025-09-15T21:18:24.273454] [DEBUG] [LOCAL ] MMU: Loaded 12090 existing records from primary storage. [2025-09-15T21:18:24.316958] [INFO ] [MAIN ] MMU: Loaded 12090 primary data records. [2025-09-15T21:18:24.498103] [DEBUG] [LOCAL ] MMS: Loaded 24361 existing records from primary storage. [2025-09-15T21:18:24.529060] [INFO ] [MAIN ] MMS: Loaded 24361 primary data records. [2025-09-15T21:18:25.077306] [DEBUG] [MAIN ] MMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:25.078542] [INFO ] [MAIN ] MMT: Generated 1326 derivative records from 7640 primary records. [2025-09-15T21:18:25.078803] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-15T21:18:25.088788] [DEBUG] [MAIN ] MMU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:25.097485] [INFO ] [MAIN ] MMU: Generated 1326 derivative records from 12090 primary records. [2025-09-15T21:18:25.098934] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-15T21:18:25.100484] [DEBUG] [LOCAL ] MMT: Derivative data saved (1326 records). [2025-09-15T21:18:25.101063] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-15T21:18:25.102866] [INFO ] [MAIN ] Derivative Progress: 1186/2083 symbols completed. MMT took 0.9s. Estimated remaining: 4m 58s. Rate: 180.9 symbols/min [2025-09-15T21:18:25.112092] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:25.116269] [DEBUG] [LOCAL ] MMU: Derivative data saved (1326 records). [2025-09-15T21:18:25.116426] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-15T21:18:25.118491] [INFO ] [MAIN ] Derivative Progress: 1187/2083 symbols completed. MMU took 0.9s. Estimated remaining: 4m 57s. Rate: 181.1 symbols/min [2025-09-15T21:18:25.118997] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:25.128679] [DEBUG] [MAIN ] MMS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:25.129479] [INFO ] [MAIN ] MMS: Generated 1326 derivative records from 24361 primary records. [2025-09-15T21:18:25.129636] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-15T21:18:25.141653] [DEBUG] [LOCAL ] MMS: Derivative data saved (1326 records). [2025-09-15T21:18:25.141896] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-15T21:18:25.143783] [INFO ] [MAIN ] Derivative Progress: 1188/2083 symbols completed. MMS took 0.9s. Estimated remaining: 4m 56s. Rate: 181.2 symbols/min [2025-09-15T21:18:25.148550] [INFO ] [MAIN ] MO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:25.158724] [DEBUG] [LOCAL ] MNR: Loaded 18562 existing records from primary storage. [2025-09-15T21:18:25.158859] [INFO ] [MAIN ] MNR: Loaded 18562 primary data records. [2025-09-15T21:18:25.295331] [DEBUG] [LOCAL ] MNSO: Loaded 31713 existing records from primary storage. [2025-09-15T21:18:25.340127] [INFO ] [MAIN ] MNSO: Loaded 31713 primary data records. [2025-09-15T21:18:25.546127] [DEBUG] [LOCAL ] MO: Loaded 39714 existing records from primary storage. [2025-09-15T21:18:25.569852] [INFO ] [MAIN ] MO: Loaded 39714 primary data records. [2025-09-15T21:18:26.103498] [DEBUG] [MAIN ] MNR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:26.106666] [INFO ] [MAIN ] MNR: Generated 1326 derivative records from 18562 primary records. [2025-09-15T21:18:26.107571] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-15T21:18:26.137621] [DEBUG] [LOCAL ] MNR: Derivative data saved (1326 records). [2025-09-15T21:18:26.140057] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-15T21:18:26.143569] [INFO ] [MAIN ] Derivative Progress: 1189/2083 symbols completed. MNR took 1.0s. Estimated remaining: 4m 57s. Rate: 180.9 symbols/min [2025-09-15T21:18:26.157158] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:26.157949] [DEBUG] [MAIN ] MNSO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:26.159080] [INFO ] [MAIN ] MNSO: Generated 1326 derivative records from 31713 primary records. [2025-09-15T21:18:26.159523] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-15T21:18:26.183967] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1326 records). [2025-09-15T21:18:26.184223] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-15T21:18:26.202509] [INFO ] [MAIN ] Derivative Progress: 1190/2083 symbols completed. MNSO took 1.1s. Estimated remaining: 4m 56s. Rate: 181.0 symbols/min [2025-09-15T21:18:26.203380] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:26.204319] [DEBUG] [MAIN ] MO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:26.206796] [INFO ] [MAIN ] MO: Generated 1326 derivative records from 39714 primary records. [2025-09-15T21:18:26.207561] [DEBUG] [LOCAL ] MO: Saving derivative data. [2025-09-15T21:18:26.237212] [DEBUG] [LOCAL ] MO: Derivative data saved (1326 records). [2025-09-15T21:18:26.237598] [INFO ] [MAIN ] MO: Successfully saved derivative data. [2025-09-15T21:18:26.240587] [INFO ] [MAIN ] Derivative Progress: 1191/2083 symbols completed. MO took 1.1s. Estimated remaining: 4m 55s. Rate: 181.1 symbols/min [2025-09-15T21:18:26.242315] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:26.261545] [DEBUG] [LOCAL ] MOD: Loaded 32979 existing records from primary storage. [2025-09-15T21:18:26.262008] [INFO ] [MAIN ] MOD: Loaded 32979 primary data records. [2025-09-15T21:18:26.450475] [DEBUG] [LOCAL ] MODG: Loaded 38153 existing records from primary storage. [2025-09-15T21:18:26.463446] [INFO ] [MAIN ] MODG: Loaded 38153 primary data records. [2025-09-15T21:18:26.539618] [DEBUG] [LOCAL ] MOH: Loaded 31518 existing records from primary storage. [2025-09-15T21:18:26.558510] [INFO ] [MAIN ] MOH: Loaded 31518 primary data records. [2025-09-15T21:18:27.446205] [DEBUG] [MAIN ] MOD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:27.447095] [INFO ] [MAIN ] MOD: Generated 1326 derivative records from 32979 primary records. [2025-09-15T21:18:27.447221] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-15T21:18:27.462548] [DEBUG] [LOCAL ] MOD: Derivative data saved (1326 records). [2025-09-15T21:18:27.462972] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-15T21:18:27.464494] [INFO ] [MAIN ] Derivative Progress: 1192/2083 symbols completed. MOD took 1.3s. Estimated remaining: 4m 56s. Rate: 180.7 symbols/min [2025-09-15T21:18:27.465004] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:27.489878] [DEBUG] [MAIN ] MOH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:27.490079] [DEBUG] [MAIN ] MODG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:27.490768] [INFO ] [MAIN ] MOH: Generated 1326 derivative records from 31518 primary records. [2025-09-15T21:18:27.491400] [INFO ] [MAIN ] MODG: Generated 1326 derivative records from 38153 primary records. [2025-09-15T21:18:27.491573] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-15T21:18:27.491610] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-15T21:18:27.514450] [DEBUG] [LOCAL ] MOH: Derivative data saved (1326 records). [2025-09-15T21:18:27.515045] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-15T21:18:27.517193] [INFO ] [MAIN ] Derivative Progress: 1193/2083 symbols completed. MOH took 1.3s. Estimated remaining: 4m 55s. Rate: 180.9 symbols/min [2025-09-15T21:18:27.518785] [DEBUG] [LOCAL ] MODG: Derivative data saved (1326 records). [2025-09-15T21:18:27.517701] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:27.528002] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-15T21:18:27.530072] [INFO ] [MAIN ] Derivative Progress: 1194/2083 symbols completed. MODG took 1.3s. Estimated remaining: 4m 55s. Rate: 181.0 symbols/min [2025-09-15T21:18:27.530704] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:27.551297] [DEBUG] [LOCAL ] MOS: Loaded 39505 existing records from primary storage. [2025-09-15T21:18:27.551551] [INFO ] [MAIN ] MOS: Loaded 39505 primary data records. [2025-09-15T21:18:27.644554] [DEBUG] [LOCAL ] MOV: Loaded 15399 existing records from primary storage. [2025-09-15T21:18:27.664235] [INFO ] [MAIN ] MOV: Loaded 15399 primary data records. [2025-09-15T21:18:27.939323] [DEBUG] [LOCAL ] MP: Loaded 39704 existing records from primary storage. [2025-09-15T21:18:27.965202] [INFO ] [MAIN ] MP: Loaded 39704 primary data records. [2025-09-15T21:18:28.412601] [DEBUG] [MAIN ] MOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:28.414165] [INFO ] [MAIN ] MOS: Generated 1326 derivative records from 39505 primary records. [2025-09-15T21:18:28.415184] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-15T21:18:28.430469] [DEBUG] [LOCAL ] MOS: Derivative data saved (1326 records). [2025-09-15T21:18:28.440232] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-15T21:18:28.440662] [DEBUG] [MAIN ] MOV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:28.443045] [INFO ] [MAIN ] Derivative Progress: 1195/2083 symbols completed. MOS took 1.0s. Estimated remaining: 4m 55s. Rate: 180.7 symbols/min [2025-09-15T21:18:28.444326] [INFO ] [MAIN ] MOV: Generated 1326 derivative records from 15399 primary records. [2025-09-15T21:18:28.444515] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-15T21:18:28.444580] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:28.461589] [DEBUG] [LOCAL ] MOV: Derivative data saved (1326 records). [2025-09-15T21:18:28.461797] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-15T21:18:28.464131] [INFO ] [MAIN ] Derivative Progress: 1196/2083 symbols completed. MOV took 0.9s. Estimated remaining: 4m 54s. Rate: 180.9 symbols/min [2025-09-15T21:18:28.473341] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:28.477350] [DEBUG] [LOCAL ] MPA: Loaded 3946 existing records from primary storage. [2025-09-15T21:18:28.478162] [DEBUG] [MAIN ] MP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:28.478440] [INFO ] [MAIN ] MPA: Loaded 3946 primary data records. [2025-09-15T21:18:28.479132] [INFO ] [MAIN ] MP: Generated 1326 derivative records from 39704 primary records. [2025-09-15T21:18:28.511324] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-15T21:18:28.612299] [DEBUG] [LOCAL ] MP: Derivative data saved (1326 records). [2025-09-15T21:18:28.670838] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-15T21:18:28.693006] [INFO ] [MAIN ] Derivative Progress: 1197/2083 symbols completed. MP took 1.2s. Estimated remaining: 4m 54s. Rate: 180.9 symbols/min [2025-09-15T21:18:28.773377] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:28.797994] [DEBUG] [LOCAL ] MPC: Loaded 38350 existing records from primary storage. [2025-09-15T21:18:28.798312] [INFO ] [MAIN ] MPC: Loaded 38350 primary data records. [2025-09-15T21:18:29.128864] [DEBUG] [LOCAL ] MPLX: Loaded 37164 existing records from primary storage. [2025-09-15T21:18:29.130741] [INFO ] [MAIN ] MPLX: Loaded 37164 primary data records. [2025-09-15T21:18:29.232157] [DEBUG] [MAIN ] MPA: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:18:29.239256] [INFO ] [MAIN ] MPA: Generated 1324 derivative records from 3946 primary records. [2025-09-15T21:18:29.239585] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-15T21:18:29.284666] [DEBUG] [LOCAL ] MPA: Derivative data saved (1324 records). [2025-09-15T21:18:29.284786] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-15T21:18:29.286761] [INFO ] [MAIN ] Derivative Progress: 1198/2083 symbols completed. MPA took 0.8s. Estimated remaining: 4m 54s. Rate: 180.8 symbols/min [2025-09-15T21:18:29.441401] [DEBUG] [MAIN ] MPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:29.442119] [INFO ] [MAIN ] MPC: Generated 1326 derivative records from 38350 primary records. [2025-09-15T21:18:29.442253] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-15T21:18:29.456253] [DEBUG] [LOCAL ] MPC: Derivative data saved (1326 records). [2025-09-15T21:18:29.456500] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-15T21:18:29.459042] [INFO ] [MAIN ] Derivative Progress: 1199/2083 symbols completed. MPC took 1.0s. Estimated remaining: 4m 53s. Rate: 180.9 symbols/min [2025-09-15T21:18:29.474264] [DEBUG] [MAIN ] MPLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:29.474871] [INFO ] [MAIN ] MPLX: Generated 1326 derivative records from 37164 primary records. [2025-09-15T21:18:29.474931] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-15T21:18:29.486481] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1326 records). [2025-09-15T21:18:29.486543] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-15T21:18:29.489031] [INFO ] [MAIN ] Derivative Progress: 1200/2083 symbols completed. MPLX took 0.7s. Estimated remaining: 4m 53s. Rate: 181.0 symbols/min [2025-09-15T21:18:29.489453] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:29.489748] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:29.490293] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:29.501833] [DEBUG] [LOCAL ] MPV: Loaded 3301 existing records from primary storage. [2025-09-15T21:18:29.499067] [DEBUG] [LOCAL ] MPX: Loaded 2844 existing records from primary storage. [2025-09-15T21:18:29.502165] [INFO ] [MAIN ] MPX: Loaded 2844 primary data records. [2025-09-15T21:18:29.502094] [INFO ] [MAIN ] MPV: Loaded 3301 primary data records. [2025-09-15T21:18:30.069604] [DEBUG] [LOCAL ] MPW: Loaded 39513 existing records from primary storage. [2025-09-15T21:18:30.070665] [INFO ] [MAIN ] MPW: Loaded 39513 primary data records. [2025-09-15T21:18:30.364142] [DEBUG] [MAIN ] MPX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:30.371235] [INFO ] [MAIN ] MPX: Generated 1326 derivative records from 2844 primary records. [2025-09-15T21:18:30.375100] [DEBUG] [MAIN ] MPV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:30.375253] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-15T21:18:30.375838] [INFO ] [MAIN ] MPV: Generated 1326 derivative records from 3301 primary records. [2025-09-15T21:18:30.376433] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-15T21:18:30.397130] [DEBUG] [LOCAL ] MPV: Derivative data saved (1326 records). [2025-09-15T21:18:30.398005] [DEBUG] [LOCAL ] MPX: Derivative data saved (1326 records). [2025-09-15T21:18:30.398206] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-15T21:18:30.399919] [INFO ] [MAIN ] Derivative Progress: 1201/2083 symbols completed. MPX took 0.9s. Estimated remaining: 4m 53s. Rate: 180.8 symbols/min [2025-09-15T21:18:30.398166] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-15T21:18:30.400813] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:30.402968] [INFO ] [MAIN ] Derivative Progress: 1202/2083 symbols completed. MPV took 0.9s. Estimated remaining: 4m 52s. Rate: 180.9 symbols/min [2025-09-15T21:18:30.404344] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:30.416377] [DEBUG] [MAIN ] MPW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:30.417083] [INFO ] [MAIN ] MPW: Generated 1326 derivative records from 39513 primary records. [2025-09-15T21:18:30.417265] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-15T21:18:30.431407] [DEBUG] [LOCAL ] MQT: Loaded 5280 existing records from primary storage. [2025-09-15T21:18:30.432110] [INFO ] [MAIN ] MQT: Loaded 5280 primary data records. [2025-09-15T21:18:30.484631] [DEBUG] [LOCAL ] MQY: Loaded 11648 existing records from primary storage. [2025-09-15T21:18:30.512138] [INFO ] [MAIN ] MQY: Loaded 11648 primary data records. [2025-09-15T21:18:30.519968] [DEBUG] [LOCAL ] MPW: Derivative data saved (1326 records). [2025-09-15T21:18:30.555136] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-15T21:18:30.578997] [INFO ] [MAIN ] Derivative Progress: 1203/2083 symbols completed. MPW took 1.1s. Estimated remaining: 4m 52s. Rate: 181.0 symbols/min [2025-09-15T21:18:30.579208] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:30.997138] [DEBUG] [LOCAL ] MRC: Loaded 26794 existing records from primary storage. [2025-09-15T21:18:30.997795] [INFO ] [MAIN ] MRC: Loaded 26794 primary data records. [2025-09-15T21:18:31.342611] [DEBUG] [MAIN ] MQT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:31.343924] [INFO ] [MAIN ] MQT: Generated 1326 derivative records from 5280 primary records. [2025-09-15T21:18:31.344015] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-15T21:18:31.364483] [DEBUG] [MAIN ] MQY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:31.367263] [DEBUG] [LOCAL ] MQT: Derivative data saved (1326 records). [2025-09-15T21:18:31.368258] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-15T21:18:31.370030] [INFO ] [MAIN ] Derivative Progress: 1204/2083 symbols completed. MQT took 1.0s. Estimated remaining: 4m 52s. Rate: 180.8 symbols/min [2025-09-15T21:18:31.370255] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:31.368122] [INFO ] [MAIN ] MQY: Generated 1326 derivative records from 11648 primary records. [2025-09-15T21:18:31.370499] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-15T21:18:31.385219] [DEBUG] [LOCAL ] MQY: Derivative data saved (1326 records). [2025-09-15T21:18:31.386155] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-15T21:18:31.388773] [INFO ] [MAIN ] Derivative Progress: 1205/2083 symbols completed. MQY took 1.0s. Estimated remaining: 4m 51s. Rate: 180.9 symbols/min [2025-09-15T21:18:31.389184] [INFO ] [MAIN ] MRP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:31.399445] [DEBUG] [MAIN ] MRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:31.403440] [INFO ] [MAIN ] MRC: Generated 1326 derivative records from 26794 primary records. [2025-09-15T21:18:31.403868] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-15T21:18:31.416525] [DEBUG] [LOCAL ] MRC: Derivative data saved (1326 records). [2025-09-15T21:18:31.416724] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-15T21:18:31.418533] [INFO ] [MAIN ] Derivative Progress: 1206/2083 symbols completed. MRC took 0.8s. Estimated remaining: 4m 51s. Rate: 181.0 symbols/min [2025-09-15T21:18:31.428205] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:31.447824] [DEBUG] [LOCAL ] MRK: Loaded 39751 existing records from primary storage. [2025-09-15T21:18:31.448080] [INFO ] [MAIN ] MRK: Loaded 39751 primary data records. [2025-09-15T21:18:31.606676] [DEBUG] [LOCAL ] MRP: Loaded 34180 existing records from primary storage. [2025-09-15T21:18:31.672267] [INFO ] [MAIN ] MRP: Loaded 34180 primary data records. [2025-09-15T21:18:31.804785] [DEBUG] [LOCAL ] MS: Loaded 39657 existing records from primary storage. [2025-09-15T21:18:31.836914] [INFO ] [MAIN ] MS: Loaded 39657 primary data records. [2025-09-15T21:18:32.354486] [DEBUG] [MAIN ] MRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:32.356210] [INFO ] [MAIN ] MRK: Generated 1326 derivative records from 39751 primary records. [2025-09-15T21:18:32.356629] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-15T21:18:32.392781] [DEBUG] [MAIN ] MS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:32.393607] [DEBUG] [LOCAL ] MRK: Derivative data saved (1326 records). [2025-09-15T21:18:32.394507] [INFO ] [MAIN ] MS: Generated 1326 derivative records from 39657 primary records. [2025-09-15T21:18:32.394750] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-15T21:18:32.395023] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-15T21:18:32.400683] [INFO ] [MAIN ] Derivative Progress: 1207/2083 symbols completed. MRK took 1.0s. Estimated remaining: 4m 51s. Rate: 180.8 symbols/min [2025-09-15T21:18:32.412109] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:32.415452] [DEBUG] [LOCAL ] MS: Derivative data saved (1326 records). [2025-09-15T21:18:32.425054] [DEBUG] [MAIN ] MRP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:32.425744] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-15T21:18:32.429145] [INFO ] [MAIN ] Derivative Progress: 1208/2083 symbols completed. MS took 1.0s. Estimated remaining: 4m 50s. Rate: 180.9 symbols/min [2025-09-15T21:18:32.429437] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:32.426500] [INFO ] [MAIN ] MRP: Generated 1326 derivative records from 34180 primary records. [2025-09-15T21:18:32.429672] [DEBUG] [LOCAL ] MRP: Saving derivative data. [2025-09-15T21:18:32.447735] [DEBUG] [LOCAL ] MSB: Loaded 5948 existing records from primary storage. [2025-09-15T21:18:32.448446] [INFO ] [MAIN ] MSB: Loaded 5948 primary data records. [2025-09-15T21:18:32.448666] [DEBUG] [LOCAL ] MRP: Derivative data saved (1326 records). [2025-09-15T21:18:32.459998] [INFO ] [MAIN ] MRP: Successfully saved derivative data. [2025-09-15T21:18:32.491344] [INFO ] [MAIN ] Derivative Progress: 1209/2083 symbols completed. MRP took 1.1s. Estimated remaining: 4m 50s. Rate: 181.0 symbols/min [2025-09-15T21:18:32.518733] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:32.566288] [DEBUG] [LOCAL ] MSA: Loaded 13825 existing records from primary storage. [2025-09-15T21:18:32.567263] [INFO ] [MAIN ] MSA: Loaded 13825 primary data records. [2025-09-15T21:18:32.953996] [DEBUG] [LOCAL ] MSCI: Loaded 25068 existing records from primary storage. [2025-09-15T21:18:33.044159] [INFO ] [MAIN ] MSCI: Loaded 25068 primary data records. [2025-09-15T21:18:33.260569] [DEBUG] [MAIN ] MSB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:33.346380] [INFO ] [MAIN ] MSB: Generated 1326 derivative records from 5948 primary records. [2025-09-15T21:18:33.347325] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-15T21:18:33.370500] [DEBUG] [LOCAL ] MSB: Derivative data saved (1326 records). [2025-09-15T21:18:33.374925] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-15T21:18:33.374781] [DEBUG] [MAIN ] MSA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:33.376756] [INFO ] [MAIN ] Derivative Progress: 1210/2083 symbols completed. MSB took 0.9s. Estimated remaining: 4m 50s. Rate: 180.8 symbols/min [2025-09-15T21:18:33.378063] [INFO ] [MAIN ] MSA: Generated 1326 derivative records from 13825 primary records. [2025-09-15T21:18:33.378279] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-15T21:18:33.377072] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:33.395673] [DEBUG] [LOCAL ] MSA: Derivative data saved (1326 records). [2025-09-15T21:18:33.399211] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-15T21:18:33.401510] [INFO ] [MAIN ] Derivative Progress: 1211/2083 symbols completed. MSA took 1.0s. Estimated remaining: 4m 49s. Rate: 180.9 symbols/min [2025-09-15T21:18:33.402340] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:33.407997] [DEBUG] [LOCAL ] MSD: Loaded 11977 existing records from primary storage. [2025-09-15T21:18:33.408157] [INFO ] [MAIN ] MSD: Loaded 11977 primary data records. [2025-09-15T21:18:33.510718] [DEBUG] [MAIN ] MSCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:33.535826] [INFO ] [MAIN ] MSCI: Generated 1326 derivative records from 25068 primary records. [2025-09-15T21:18:33.546492] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-15T21:18:33.686477] [DEBUG] [LOCAL ] MSDL: Loaded 27074 existing records from primary storage. [2025-09-15T21:18:33.755670] [INFO ] [MAIN ] MSDL: Loaded 27074 primary data records. [2025-09-15T21:18:33.757882] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1326 records). [2025-09-15T21:18:33.781794] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-15T21:18:33.825543] [INFO ] [MAIN ] Derivative Progress: 1212/2083 symbols completed. MSCI took 1.3s. Estimated remaining: 4m 49s. Rate: 180.9 symbols/min [2025-09-15T21:18:33.872088] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:34.067209] [DEBUG] [LOCAL ] MSGE: Loaded 19047 existing records from primary storage. [2025-09-15T21:18:34.068432] [INFO ] [MAIN ] MSGE: Loaded 19047 primary data records. [2025-09-15T21:18:34.199791] [DEBUG] [MAIN ] MSD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:34.237092] [INFO ] [MAIN ] MSD: Generated 1326 derivative records from 11977 primary records. [2025-09-15T21:18:34.279774] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-15T21:18:34.389487] [DEBUG] [MAIN ] MSDL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:34.392605] [DEBUG] [LOCAL ] MSD: Derivative data saved (1326 records). [2025-09-15T21:18:34.393819] [INFO ] [MAIN ] MSDL: Generated 1326 derivative records from 27074 primary records. [2025-09-15T21:18:34.395200] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-15T21:18:34.395267] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-15T21:18:34.399692] [INFO ] [MAIN ] Derivative Progress: 1213/2083 symbols completed. MSD took 1.0s. Estimated remaining: 4m 49s. Rate: 180.8 symbols/min [2025-09-15T21:18:34.414543] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1326 records). [2025-09-15T21:18:34.414889] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-15T21:18:34.417008] [INFO ] [MAIN ] Derivative Progress: 1214/2083 symbols completed. MSDL took 1.0s. Estimated remaining: 4m 48s. Rate: 180.9 symbols/min [2025-09-15T21:18:34.434249] [DEBUG] [MAIN ] MSGE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:34.435126] [INFO ] [MAIN ] MSGE: Generated 1326 derivative records from 19047 primary records. [2025-09-15T21:18:34.435196] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-15T21:18:34.447571] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1326 records). [2025-09-15T21:18:34.447769] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-15T21:18:34.450222] [INFO ] [MAIN ] Derivative Progress: 1215/2083 symbols completed. MSGE took 0.6s. Estimated remaining: 4m 48s. Rate: 181.0 symbols/min [2025-09-15T21:18:34.451059] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:34.451191] [INFO ] [MAIN ] MSIF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:34.450948] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:34.472345] [DEBUG] [LOCAL ] MSIF: Loaded 10557 existing records from primary storage. [2025-09-15T21:18:34.478870] [INFO ] [MAIN ] MSIF: Loaded 10557 primary data records. [2025-09-15T21:18:34.479533] [DEBUG] [LOCAL ] MSGS: Loaded 12220 existing records from primary storage. [2025-09-15T21:18:34.480016] [INFO ] [MAIN ] MSGS: Loaded 12220 primary data records. [2025-09-15T21:18:34.767407] [DEBUG] [LOCAL ] MSI: Loaded 29648 existing records from primary storage. [2025-09-15T21:18:34.874248] [INFO ] [MAIN ] MSI: Loaded 29648 primary data records. [2025-09-15T21:18:35.354673] [DEBUG] [MAIN ] MSGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:35.364669] [INFO ] [MAIN ] MSGS: Generated 1326 derivative records from 12220 primary records. [2025-09-15T21:18:35.365321] [DEBUG] [MAIN ] MSIF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:35.365484] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-15T21:18:35.366455] [INFO ] [MAIN ] MSIF: Generated 1326 derivative records from 10557 primary records. [2025-09-15T21:18:35.366851] [DEBUG] [LOCAL ] MSIF: Saving derivative data. [2025-09-15T21:18:35.389325] [DEBUG] [LOCAL ] MSIF: Derivative data saved (1326 records). [2025-09-15T21:18:35.390287] [INFO ] [MAIN ] MSIF: Successfully saved derivative data. [2025-09-15T21:18:35.394175] [INFO ] [MAIN ] Derivative Progress: 1216/2083 symbols completed. MSIF took 0.9s. Estimated remaining: 4m 48s. Rate: 180.8 symbols/min [2025-09-15T21:18:35.394699] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:35.391787] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1326 records). [2025-09-15T21:18:35.394824] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-15T21:18:35.397201] [INFO ] [MAIN ] Derivative Progress: 1217/2083 symbols completed. MSGS took 0.9s. Estimated remaining: 4m 47s. Rate: 180.9 symbols/min [2025-09-15T21:18:35.397607] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:35.411820] [DEBUG] [MAIN ] MSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:35.412595] [INFO ] [MAIN ] MSI: Generated 1326 derivative records from 29648 primary records. [2025-09-15T21:18:35.412724] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-15T21:18:35.425668] [DEBUG] [LOCAL ] MSI: Derivative data saved (1326 records). [2025-09-15T21:18:35.432804] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-15T21:18:35.434982] [INFO ] [MAIN ] Derivative Progress: 1218/2083 symbols completed. MSI took 1.0s. Estimated remaining: 4m 47s. Rate: 181.0 symbols/min [2025-09-15T21:18:35.435358] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:35.448164] [DEBUG] [LOCAL ] MSM: Loaded 25248 existing records from primary storage. [2025-09-15T21:18:35.456205] [INFO ] [MAIN ] MSM: Loaded 25248 primary data records. [2025-09-15T21:18:35.584936] [DEBUG] [LOCAL ] MT: Loaded 37095 existing records from primary storage. [2025-09-15T21:18:35.611447] [INFO ] [MAIN ] MT: Loaded 37095 primary data records. [2025-09-15T21:18:35.692023] [DEBUG] [LOCAL ] MTAL: Loaded 27153 existing records from primary storage. [2025-09-15T21:18:35.708534] [INFO ] [MAIN ] MTAL: Loaded 27153 primary data records. [2025-09-15T21:18:36.337916] [DEBUG] [MAIN ] MSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:36.339076] [INFO ] [MAIN ] MSM: Generated 1326 derivative records from 25248 primary records. [2025-09-15T21:18:36.339818] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-15T21:18:36.354274] [DEBUG] [LOCAL ] MSM: Derivative data saved (1326 records). [2025-09-15T21:18:36.354511] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-15T21:18:36.356106] [INFO ] [MAIN ] Derivative Progress: 1219/2083 symbols completed. MSM took 1.0s. Estimated remaining: 4m 47s. Rate: 180.8 symbols/min [2025-09-15T21:18:36.365782] [DEBUG] [MAIN ] MT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:36.365890] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:36.366563] [INFO ] [MAIN ] MT: Generated 1326 derivative records from 37095 primary records. [2025-09-15T21:18:36.366962] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-15T21:18:36.381508] [DEBUG] [LOCAL ] MT: Derivative data saved (1326 records). [2025-09-15T21:18:36.387664] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-15T21:18:36.389944] [INFO ] [MAIN ] Derivative Progress: 1220/2083 symbols completed. MT took 1.0s. Estimated remaining: 4m 46s. Rate: 180.9 symbols/min [2025-09-15T21:18:36.393707] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:36.393931] [DEBUG] [MAIN ] MTAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:36.394633] [INFO ] [MAIN ] MTAL: Generated 1326 derivative records from 27153 primary records. [2025-09-15T21:18:36.394973] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-15T21:18:36.410311] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1326 records). [2025-09-15T21:18:36.410477] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-15T21:18:36.412299] [INFO ] [MAIN ] Derivative Progress: 1221/2083 symbols completed. MTAL took 1.0s. Estimated remaining: 4m 46s. Rate: 181.0 symbols/min [2025-09-15T21:18:36.419983] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:36.425624] [DEBUG] [LOCAL ] MTD: Loaded 11010 existing records from primary storage. [2025-09-15T21:18:36.425761] [INFO ] [MAIN ] MTD: Loaded 11010 primary data records. [2025-09-15T21:18:36.537133] [DEBUG] [LOCAL ] MTB: Loaded 34251 existing records from primary storage. [2025-09-15T21:18:36.542849] [INFO ] [MAIN ] MTB: Loaded 34251 primary data records. [2025-09-15T21:18:36.819131] [DEBUG] [LOCAL ] MTDR: Loaded 37997 existing records from primary storage. [2025-09-15T21:18:36.830110] [INFO ] [MAIN ] MTDR: Loaded 37997 primary data records. [2025-09-15T21:18:37.256849] [DEBUG] [MAIN ] MTD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:37.258964] [INFO ] [MAIN ] MTD: Generated 1326 derivative records from 11010 primary records. [2025-09-15T21:18:37.259777] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-15T21:18:37.276330] [DEBUG] [LOCAL ] MTD: Derivative data saved (1326 records). [2025-09-15T21:18:37.276991] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-15T21:18:37.278859] [INFO ] [MAIN ] Derivative Progress: 1222/2083 symbols completed. MTD took 0.9s. Estimated remaining: 4m 46s. Rate: 180.8 symbols/min [2025-09-15T21:18:37.288911] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:37.290290] [DEBUG] [MAIN ] MTB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:37.293227] [INFO ] [MAIN ] MTB: Generated 1326 derivative records from 34251 primary records. [2025-09-15T21:18:37.293473] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-15T21:18:37.311275] [DEBUG] [MAIN ] MTDR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:37.315679] [INFO ] [MAIN ] MTDR: Generated 1326 derivative records from 37997 primary records. [2025-09-15T21:18:37.316292] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-15T21:18:37.330849] [DEBUG] [LOCAL ] MTB: Derivative data saved (1326 records). [2025-09-15T21:18:37.331527] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-15T21:18:37.334059] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1326 records). [2025-09-15T21:18:37.334289] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-15T21:18:37.336995] [INFO ] [MAIN ] Derivative Progress: 1223/2083 symbols completed. MTB took 1.0s. Estimated remaining: 4m 45s. Rate: 180.9 symbols/min [2025-09-15T21:18:37.337340] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:37.339292] [INFO ] [MAIN ] Derivative Progress: 1224/2083 symbols completed. MTDR took 0.9s. Estimated remaining: 4m 45s. Rate: 181.1 symbols/min [2025-09-15T21:18:37.339599] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:37.365886] [DEBUG] [LOCAL ] MTG: Loaded 37536 existing records from primary storage. [2025-09-15T21:18:37.366032] [INFO ] [MAIN ] MTG: Loaded 37536 primary data records. [2025-09-15T21:18:37.578340] [DEBUG] [LOCAL ] MTN: Loaded 28572 existing records from primary storage. [2025-09-15T21:18:37.577899] [DEBUG] [LOCAL ] MTH: Loaded 32137 existing records from primary storage. [2025-09-15T21:18:37.578566] [INFO ] [MAIN ] MTH: Loaded 32137 primary data records. [2025-09-15T21:18:37.649091] [INFO ] [MAIN ] MTN: Loaded 28572 primary data records. [2025-09-15T21:18:38.271777] [DEBUG] [MAIN ] MTG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:38.273081] [INFO ] [MAIN ] MTG: Generated 1326 derivative records from 37536 primary records. [2025-09-15T21:18:38.273369] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-15T21:18:38.287858] [DEBUG] [LOCAL ] MTG: Derivative data saved (1326 records). [2025-09-15T21:18:38.288246] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-15T21:18:38.290515] [INFO ] [MAIN ] Derivative Progress: 1225/2083 symbols completed. MTG took 1.0s. Estimated remaining: 4m 45s. Rate: 180.8 symbols/min [2025-09-15T21:18:38.293979] [INFO ] [MAIN ] MTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:38.315864] [DEBUG] [MAIN ] MTH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:38.315615] [DEBUG] [MAIN ] MTN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:38.316700] [INFO ] [MAIN ] MTH: Generated 1326 derivative records from 32137 primary records. [2025-09-15T21:18:38.317529] [INFO ] [MAIN ] MTN: Generated 1326 derivative records from 28572 primary records. [2025-09-15T21:18:38.316804] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-15T21:18:38.319507] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-15T21:18:38.319412] [DEBUG] [LOCAL ] MTR: Loaded 1586 existing records from primary storage. [2025-09-15T21:18:38.319662] [INFO ] [MAIN ] MTR: Loaded 1586 primary data records. [2025-09-15T21:18:38.429361] [DEBUG] [LOCAL ] MTH: Derivative data saved (1326 records). [2025-09-15T21:18:38.452754] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-15T21:18:38.452634] [DEBUG] [LOCAL ] MTN: Derivative data saved (1326 records). [2025-09-15T21:18:38.455550] [INFO ] [MAIN ] Derivative Progress: 1226/2083 symbols completed. MTH took 1.1s. Estimated remaining: 4m 44s. Rate: 180.9 symbols/min [2025-09-15T21:18:38.456538] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:38.455985] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-15T21:18:38.463965] [INFO ] [MAIN ] Derivative Progress: 1227/2083 symbols completed. MTN took 1.1s. Estimated remaining: 4m 44s. Rate: 181.0 symbols/min [2025-09-15T21:18:38.479991] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:38.645719] [DEBUG] [LOCAL ] MTRN: Loaded 13585 existing records from primary storage. [2025-09-15T21:18:38.646186] [INFO ] [MAIN ] MTRN: Loaded 13585 primary data records. [2025-09-15T21:18:38.789251] [DEBUG] [LOCAL ] MTUS: Loaded 20687 existing records from primary storage. [2025-09-15T21:18:38.812114] [INFO ] [MAIN ] MTUS: Loaded 20687 primary data records. [2025-09-15T21:18:39.084194] [DEBUG] [MAIN ] MTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:39.113782] [INFO ] [MAIN ] MTR: Generated 1326 derivative records from 1586 primary records. [2025-09-15T21:18:39.117076] [DEBUG] [LOCAL ] MTR: Saving derivative data. [2025-09-15T21:18:39.214718] [DEBUG] [LOCAL ] MTR: Derivative data saved (1326 records). [2025-09-15T21:18:39.216362] [INFO ] [MAIN ] MTR: Successfully saved derivative data. [2025-09-15T21:18:39.218132] [INFO ] [MAIN ] Derivative Progress: 1228/2083 symbols completed. MTR took 0.9s. Estimated remaining: 4m 44s. Rate: 180.8 symbols/min [2025-09-15T21:18:39.228958] [DEBUG] [MAIN ] MTRN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:39.229770] [INFO ] [MAIN ] MTRN: Generated 1326 derivative records from 13585 primary records. [2025-09-15T21:18:39.229922] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-15T21:18:39.243656] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1326 records). [2025-09-15T21:18:39.243807] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-15T21:18:39.245872] [INFO ] [MAIN ] Derivative Progress: 1229/2083 symbols completed. MTRN took 0.8s. Estimated remaining: 4m 43s. Rate: 181.0 symbols/min [2025-09-15T21:18:39.257523] [DEBUG] [MAIN ] MTUS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:39.258083] [INFO ] [MAIN ] MTUS: Generated 1326 derivative records from 20687 primary records. [2025-09-15T21:18:39.258142] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-15T21:18:39.269705] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1326 records). [2025-09-15T21:18:39.269770] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-15T21:18:39.271707] [INFO ] [MAIN ] Derivative Progress: 1230/2083 symbols completed. MTUS took 0.8s. Estimated remaining: 4m 43s. Rate: 181.1 symbols/min [2025-09-15T21:18:39.272137] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:39.272264] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:39.272381] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:39.302491] [DEBUG] [LOCAL ] MTW: Loaded 19697 existing records from primary storage. [2025-09-15T21:18:39.309186] [DEBUG] [LOCAL ] MTX: Loaded 17395 existing records from primary storage. [2025-09-15T21:18:39.309328] [INFO ] [MAIN ] MTW: Loaded 19697 primary data records. [2025-09-15T21:18:39.309467] [INFO ] [MAIN ] MTX: Loaded 17395 primary data records. [2025-09-15T21:18:39.524813] [DEBUG] [LOCAL ] MTZ: Loaded 31459 existing records from primary storage. [2025-09-15T21:18:39.580707] [INFO ] [MAIN ] MTZ: Loaded 31459 primary data records. [2025-09-15T21:18:40.142561] [DEBUG] [MAIN ] MTX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:40.144122] [INFO ] [MAIN ] MTX: Generated 1326 derivative records from 17395 primary records. [2025-09-15T21:18:40.144520] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-15T21:18:40.166519] [DEBUG] [MAIN ] MTW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:40.168001] [INFO ] [MAIN ] MTW: Generated 1326 derivative records from 19697 primary records. [2025-09-15T21:18:40.168450] [DEBUG] [LOCAL ] MTX: Derivative data saved (1326 records). [2025-09-15T21:18:40.168626] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-15T21:18:40.168987] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-15T21:18:40.171257] [INFO ] [MAIN ] Derivative Progress: 1231/2083 symbols completed. MTX took 0.9s. Estimated remaining: 4m 43s. Rate: 180.8 symbols/min [2025-09-15T21:18:40.171842] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:40.184326] [DEBUG] [LOCAL ] MTW: Derivative data saved (1326 records). [2025-09-15T21:18:40.184532] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-15T21:18:40.189089] [INFO ] [MAIN ] Derivative Progress: 1232/2083 symbols completed. MTW took 0.9s. Estimated remaining: 4m 42s. Rate: 181.0 symbols/min [2025-09-15T21:18:40.190732] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:40.205481] [DEBUG] [MAIN ] MTZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:40.205240] [DEBUG] [LOCAL ] MUA: Loaded 8367 existing records from primary storage. [2025-09-15T21:18:40.206205] [INFO ] [MAIN ] MTZ: Generated 1326 derivative records from 31459 primary records. [2025-09-15T21:18:40.206294] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-15T21:18:40.205608] [INFO ] [MAIN ] MUA: Loaded 8367 primary data records. [2025-09-15T21:18:40.327411] [DEBUG] [LOCAL ] MUC: Loaded 14348 existing records from primary storage. [2025-09-15T21:18:40.327127] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1326 records). [2025-09-15T21:18:40.327552] [INFO ] [MAIN ] MUC: Loaded 14348 primary data records. [2025-09-15T21:18:40.327619] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-15T21:18:40.329588] [INFO ] [MAIN ] Derivative Progress: 1233/2083 symbols completed. MTZ took 1.1s. Estimated remaining: 4m 42s. Rate: 181.1 symbols/min [2025-09-15T21:18:40.376906] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:40.651442] [DEBUG] [LOCAL ] MUE: Loaded 9308 existing records from primary storage. [2025-09-15T21:18:40.673726] [INFO ] [MAIN ] MUE: Loaded 9308 primary data records. [2025-09-15T21:18:41.084280] [DEBUG] [MAIN ] MUA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:41.085728] [INFO ] [MAIN ] MUA: Generated 1326 derivative records from 8367 primary records. [2025-09-15T21:18:41.085922] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-15T21:18:41.101057] [DEBUG] [LOCAL ] MUA: Derivative data saved (1326 records). [2025-09-15T21:18:41.107052] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-15T21:18:41.113005] [INFO ] [MAIN ] Derivative Progress: 1234/2083 symbols completed. MUA took 0.9s. Estimated remaining: 4m 42s. Rate: 180.9 symbols/min [2025-09-15T21:18:41.113281] [DEBUG] [MAIN ] MUC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:41.113750] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:41.114523] [INFO ] [MAIN ] MUC: Generated 1326 derivative records from 14348 primary records. [2025-09-15T21:18:41.114931] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-15T21:18:41.127943] [DEBUG] [LOCAL ] MUC: Derivative data saved (1326 records). [2025-09-15T21:18:41.128111] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-15T21:18:41.130419] [INFO ] [MAIN ] Derivative Progress: 1235/2083 symbols completed. MUC took 0.9s. Estimated remaining: 4m 41s. Rate: 181.0 symbols/min [2025-09-15T21:18:41.130890] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:41.147739] [DEBUG] [MAIN ] MUE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:41.148451] [INFO ] [MAIN ] MUE: Generated 1326 derivative records from 9308 primary records. [2025-09-15T21:18:41.148568] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-15T21:18:41.171972] [DEBUG] [LOCAL ] MUE: Derivative data saved (1326 records). [2025-09-15T21:18:41.176388] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-15T21:18:41.176622] [DEBUG] [LOCAL ] MUJ: Loaded 10188 existing records from primary storage. [2025-09-15T21:18:41.178429] [INFO ] [MAIN ] Derivative Progress: 1236/2083 symbols completed. MUE took 0.8s. Estimated remaining: 4m 41s. Rate: 181.1 symbols/min [2025-09-15T21:18:41.178526] [INFO ] [MAIN ] MUJ: Loaded 10188 primary data records. [2025-09-15T21:18:41.178758] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:41.289523] [DEBUG] [LOCAL ] MUFG: Loaded 38767 existing records from primary storage. [2025-09-15T21:18:41.292961] [INFO ] [MAIN ] MUFG: Loaded 38767 primary data records. [2025-09-15T21:18:41.650045] [DEBUG] [LOCAL ] MUR: Loaded 38975 existing records from primary storage. [2025-09-15T21:18:41.667108] [INFO ] [MAIN ] MUR: Loaded 38975 primary data records. [2025-09-15T21:18:42.063399] [DEBUG] [MAIN ] MUJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:42.065556] [INFO ] [MAIN ] MUJ: Generated 1326 derivative records from 10188 primary records. [2025-09-15T21:18:42.065685] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-15T21:18:42.081533] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1326 records). [2025-09-15T21:18:42.081750] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-15T21:18:42.084715] [INFO ] [MAIN ] Derivative Progress: 1237/2083 symbols completed. MUJ took 1.0s. Estimated remaining: 4m 41s. Rate: 180.9 symbols/min [2025-09-15T21:18:42.094662] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:42.096842] [DEBUG] [MAIN ] MUFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:42.097900] [INFO ] [MAIN ] MUFG: Generated 1326 derivative records from 38767 primary records. [2025-09-15T21:18:42.098856] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-15T21:18:42.118602] [DEBUG] [MAIN ] MUR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:42.122774] [INFO ] [MAIN ] MUR: Generated 1326 derivative records from 38975 primary records. [2025-09-15T21:18:42.128281] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-15T21:18:42.130923] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1326 records). [2025-09-15T21:18:42.131386] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-15T21:18:42.134962] [INFO ] [MAIN ] Derivative Progress: 1238/2083 symbols completed. MUFG took 1.0s. Estimated remaining: 4m 40s. Rate: 181.0 symbols/min [2025-09-15T21:18:42.141413] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:42.154834] [DEBUG] [LOCAL ] MUSA: Loaded 18513 existing records from primary storage. [2025-09-15T21:18:42.155722] [INFO ] [MAIN ] MUSA: Loaded 18513 primary data records. [2025-09-15T21:18:42.195138] [DEBUG] [LOCAL ] MUR: Derivative data saved (1326 records). [2025-09-15T21:18:42.213257] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-15T21:18:42.215925] [INFO ] [MAIN ] Derivative Progress: 1239/2083 symbols completed. MUR took 1.0s. Estimated remaining: 4m 40s. Rate: 181.1 symbols/min [2025-09-15T21:18:42.216197] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:42.350692] [DEBUG] [LOCAL ] MVF: Loaded 8769 existing records from primary storage. [2025-09-15T21:18:42.368023] [INFO ] [MAIN ] MVF: Loaded 8769 primary data records. [2025-09-15T21:18:42.478488] [DEBUG] [LOCAL ] MUX: Loaded 30886 existing records from primary storage. [2025-09-15T21:18:42.501839] [INFO ] [MAIN ] MUX: Loaded 30886 primary data records. [2025-09-15T21:18:43.088356] [DEBUG] [MAIN ] MUSA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:43.089752] [INFO ] [MAIN ] MUSA: Generated 1326 derivative records from 18513 primary records. [2025-09-15T21:18:43.090038] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-15T21:18:43.108767] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1326 records). [2025-09-15T21:18:43.118285] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-15T21:18:43.118504] [DEBUG] [MAIN ] MVF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:43.119346] [INFO ] [MAIN ] MVF: Generated 1326 derivative records from 8769 primary records. [2025-09-15T21:18:43.121276] [INFO ] [MAIN ] Derivative Progress: 1240/2083 symbols completed. MUSA took 1.0s. Estimated remaining: 4m 40s. Rate: 180.9 symbols/min [2025-09-15T21:18:43.121773] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:43.121544] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-15T21:18:43.134483] [DEBUG] [LOCAL ] MVF: Derivative data saved (1326 records). [2025-09-15T21:18:43.136390] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-15T21:18:43.138470] [INFO ] [MAIN ] Derivative Progress: 1241/2083 symbols completed. MVF took 0.9s. Estimated remaining: 4m 39s. Rate: 181.0 symbols/min [2025-09-15T21:18:43.139494] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:43.163260] [DEBUG] [LOCAL ] MVO: Loaded 6388 existing records from primary storage. [2025-09-15T21:18:43.163754] [DEBUG] [MAIN ] MUX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:43.166679] [INFO ] [MAIN ] MVO: Loaded 6388 primary data records. [2025-09-15T21:18:43.172954] [INFO ] [MAIN ] MUX: Generated 1326 derivative records from 30886 primary records. [2025-09-15T21:18:43.189314] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-15T21:18:43.294814] [DEBUG] [LOCAL ] MVT: Loaded 7340 existing records from primary storage. [2025-09-15T21:18:43.296865] [INFO ] [MAIN ] MVT: Loaded 7340 primary data records. [2025-09-15T21:18:43.363526] [DEBUG] [LOCAL ] MUX: Derivative data saved (1326 records). [2025-09-15T21:18:43.452101] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-15T21:18:43.560687] [INFO ] [MAIN ] Derivative Progress: 1242/2083 symbols completed. MUX took 1.4s. Estimated remaining: 4m 39s. Rate: 181.0 symbols/min [2025-09-15T21:18:43.589552] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:43.784045] [DEBUG] [MAIN ] MVO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:43.785103] [INFO ] [MAIN ] MVO: Generated 1326 derivative records from 6388 primary records. [2025-09-15T21:18:43.785337] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-15T21:18:43.799170] [DEBUG] [LOCAL ] MVO: Derivative data saved (1326 records). [2025-09-15T21:18:43.799320] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-15T21:18:43.801083] [INFO ] [MAIN ] Derivative Progress: 1243/2083 symbols completed. MVO took 0.7s. Estimated remaining: 4m 38s. Rate: 181.0 symbols/min [2025-09-15T21:18:43.821999] [DEBUG] [MAIN ] MVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:43.823129] [DEBUG] [LOCAL ] MWA: Loaded 33785 existing records from primary storage. [2025-09-15T21:18:43.823818] [INFO ] [MAIN ] MVT: Generated 1326 derivative records from 7340 primary records. [2025-09-15T21:18:43.823918] [INFO ] [MAIN ] MWA: Loaded 33785 primary data records. [2025-09-15T21:18:43.824062] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-15T21:18:43.953286] [DEBUG] [LOCAL ] MVT: Derivative data saved (1326 records). [2025-09-15T21:18:43.968972] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-15T21:18:43.998437] [INFO ] [MAIN ] Derivative Progress: 1244/2083 symbols completed. MVT took 0.9s. Estimated remaining: 4m 38s. Rate: 181.1 symbols/min [2025-09-15T21:18:44.125011] [DEBUG] [MAIN ] MWA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:44.125718] [INFO ] [MAIN ] MWA: Generated 1326 derivative records from 33785 primary records. [2025-09-15T21:18:44.125833] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-15T21:18:44.137797] [DEBUG] [LOCAL ] MWA: Derivative data saved (1326 records). [2025-09-15T21:18:44.137860] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-15T21:18:44.140058] [INFO ] [MAIN ] Derivative Progress: 1245/2083 symbols completed. MWA took 0.6s. Estimated remaining: 4m 38s. Rate: 181.1 symbols/min [2025-09-15T21:18:44.140682] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:44.141412] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:44.141079] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:44.155167] [DEBUG] [LOCAL ] MXF: Loaded 4055 existing records from primary storage. [2025-09-15T21:18:44.159932] [INFO ] [MAIN ] MXF: Loaded 4055 primary data records. [2025-09-15T21:18:44.160321] [DEBUG] [LOCAL ] MYD: Loaded 9151 existing records from primary storage. [2025-09-15T21:18:44.177225] [INFO ] [MAIN ] MYD: Loaded 9151 primary data records. [2025-09-15T21:18:44.341802] [DEBUG] [LOCAL ] MX: Loaded 16505 existing records from primary storage. [2025-09-15T21:18:44.369462] [INFO ] [MAIN ] MX: Loaded 16505 primary data records. [2025-09-15T21:18:45.131135] [DEBUG] [MAIN ] MXF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:45.132748] [INFO ] [MAIN ] MXF: Generated 1326 derivative records from 4055 primary records. [2025-09-15T21:18:45.131774] [DEBUG] [MAIN ] MYD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:45.133267] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-15T21:18:45.133970] [INFO ] [MAIN ] MYD: Generated 1326 derivative records from 9151 primary records. [2025-09-15T21:18:45.144005] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-15T21:18:45.146690] [DEBUG] [LOCAL ] MXF: Derivative data saved (1326 records). [2025-09-15T21:18:45.148276] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-15T21:18:45.150961] [INFO ] [MAIN ] Derivative Progress: 1246/2083 symbols completed. MXF took 1.0s. Estimated remaining: 4m 38s. Rate: 180.8 symbols/min [2025-09-15T21:18:45.151283] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:45.169161] [DEBUG] [LOCAL ] MYD: Derivative data saved (1326 records). [2025-09-15T21:18:45.172857] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-15T21:18:45.175149] [INFO ] [MAIN ] Derivative Progress: 1247/2083 symbols completed. MYD took 1.0s. Estimated remaining: 4m 37s. Rate: 181.0 symbols/min [2025-09-15T21:18:45.173106] [DEBUG] [MAIN ] MX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:45.175503] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:45.176229] [INFO ] [MAIN ] MX: Generated 1326 derivative records from 16505 primary records. [2025-09-15T21:18:45.176704] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-15T21:18:45.194179] [DEBUG] [LOCAL ] MX: Derivative data saved (1326 records). [2025-09-15T21:18:45.194271] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-15T21:18:45.196482] [INFO ] [MAIN ] Derivative Progress: 1248/2083 symbols completed. MX took 1.1s. Estimated remaining: 4m 37s. Rate: 181.1 symbols/min [2025-09-15T21:18:45.200216] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:45.214999] [DEBUG] [LOCAL ] MYE: Loaded 17475 existing records from primary storage. [2025-09-15T21:18:45.215570] [INFO ] [MAIN ] MYE: Loaded 17475 primary data records. [2025-09-15T21:18:45.215450] [DEBUG] [LOCAL ] MYI: Loaded 13412 existing records from primary storage. [2025-09-15T21:18:45.215850] [INFO ] [MAIN ] MYI: Loaded 13412 primary data records. [2025-09-15T21:18:45.309305] [DEBUG] [LOCAL ] MYN: Loaded 7468 existing records from primary storage. [2025-09-15T21:18:45.374596] [INFO ] [MAIN ] MYN: Loaded 7468 primary data records. [2025-09-15T21:18:46.065877] [DEBUG] [MAIN ] MYI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:46.077549] [INFO ] [MAIN ] MYI: Generated 1326 derivative records from 13412 primary records. [2025-09-15T21:18:46.078322] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-15T21:18:46.078130] [DEBUG] [MAIN ] MYE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:46.086589] [INFO ] [MAIN ] MYE: Generated 1326 derivative records from 17475 primary records. [2025-09-15T21:18:46.096156] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-15T21:18:46.096465] [DEBUG] [MAIN ] MYN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:46.103257] [DEBUG] [LOCAL ] MYI: Derivative data saved (1326 records). [2025-09-15T21:18:46.110764] [INFO ] [MAIN ] MYN: Generated 1326 derivative records from 7468 primary records. [2025-09-15T21:18:46.109991] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-15T21:18:46.115467] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-15T21:18:46.115122] [INFO ] [MAIN ] Derivative Progress: 1249/2083 symbols completed. MYI took 0.9s. Estimated remaining: 4m 37s. Rate: 180.9 symbols/min [2025-09-15T21:18:46.117023] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:46.129937] [DEBUG] [LOCAL ] MYN: Derivative data saved (1326 records). [2025-09-15T21:18:46.130774] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-15T21:18:46.133433] [INFO ] [MAIN ] Derivative Progress: 1250/2083 symbols completed. MYN took 0.9s. Estimated remaining: 4m 36s. Rate: 181.0 symbols/min [2025-09-15T21:18:46.134195] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:46.133957] [DEBUG] [LOCAL ] MYE: Derivative data saved (1326 records). [2025-09-15T21:18:46.134403] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-15T21:18:46.137049] [INFO ] [MAIN ] Derivative Progress: 1251/2083 symbols completed. MYE took 1.0s. Estimated remaining: 4m 36s. Rate: 181.1 symbols/min [2025-09-15T21:18:46.137447] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:46.186837] [DEBUG] [LOCAL ] NAC: Loaded 17588 existing records from primary storage. [2025-09-15T21:18:46.188205] [INFO ] [MAIN ] NAC: Loaded 17588 primary data records. [2025-09-15T21:18:46.187424] [DEBUG] [LOCAL ] NAD: Loaded 24848 existing records from primary storage. [2025-09-15T21:18:46.188090] [DEBUG] [LOCAL ] NABL: Loaded 29090 existing records from primary storage. [2025-09-15T21:18:46.188476] [INFO ] [MAIN ] NAD: Loaded 24848 primary data records. [2025-09-15T21:18:46.188687] [INFO ] [MAIN ] NABL: Loaded 29090 primary data records. [2025-09-15T21:18:47.034691] [DEBUG] [MAIN ] NAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:47.036153] [INFO ] [MAIN ] NAC: Generated 1326 derivative records from 17588 primary records. [2025-09-15T21:18:47.038506] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-15T21:18:47.062854] [DEBUG] [MAIN ] NAD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:47.074247] [INFO ] [MAIN ] NAD: Generated 1326 derivative records from 24848 primary records. [2025-09-15T21:18:47.074622] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-15T21:18:47.076375] [DEBUG] [MAIN ] NABL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:47.084222] [INFO ] [MAIN ] NABL: Generated 1326 derivative records from 29090 primary records. [2025-09-15T21:18:47.084557] [DEBUG] [LOCAL ] NAC: Derivative data saved (1326 records). [2025-09-15T21:18:47.085558] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-15T21:18:47.085657] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-15T21:18:47.087414] [INFO ] [MAIN ] Derivative Progress: 1252/2083 symbols completed. NAC took 1.0s. Estimated remaining: 4m 36s. Rate: 180.9 symbols/min [2025-09-15T21:18:47.088110] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:47.105587] [DEBUG] [LOCAL ] NABL: Derivative data saved (1326 records). [2025-09-15T21:18:47.106588] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-15T21:18:47.109954] [INFO ] [MAIN ] Derivative Progress: 1253/2083 symbols completed. NABL took 1.0s. Estimated remaining: 4m 35s. Rate: 181.0 symbols/min [2025-09-15T21:18:47.110675] [DEBUG] [LOCAL ] NAD: Derivative data saved (1326 records). [2025-09-15T21:18:47.111178] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:47.111131] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-15T21:18:47.113805] [INFO ] [MAIN ] Derivative Progress: 1254/2083 symbols completed. NAD took 1.0s. Estimated remaining: 4m 35s. Rate: 181.1 symbols/min [2025-09-15T21:18:47.114577] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:47.118682] [DEBUG] [LOCAL ] NAN: Loaded 6267 existing records from primary storage. [2025-09-15T21:18:47.118837] [INFO ] [MAIN ] NAN: Loaded 6267 primary data records. [2025-09-15T21:18:47.450194] [DEBUG] [LOCAL ] NATL: Loaded 24035 existing records from primary storage. [2025-09-15T21:18:47.450571] [INFO ] [MAIN ] NATL: Loaded 24035 primary data records. [2025-09-15T21:18:47.451317] [DEBUG] [LOCAL ] NAT: Loaded 35875 existing records from primary storage. [2025-09-15T21:18:47.473176] [INFO ] [MAIN ] NAT: Loaded 35875 primary data records. [2025-09-15T21:18:48.020217] [DEBUG] [MAIN ] NAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:48.021944] [INFO ] [MAIN ] NAN: Generated 1326 derivative records from 6267 primary records. [2025-09-15T21:18:48.022757] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-15T21:18:48.037354] [DEBUG] [LOCAL ] NAN: Derivative data saved (1326 records). [2025-09-15T21:18:48.037970] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-15T21:18:48.041322] [INFO ] [MAIN ] Derivative Progress: 1255/2083 symbols completed. NAN took 1.0s. Estimated remaining: 4m 35s. Rate: 180.9 symbols/min [2025-09-15T21:18:48.042264] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:48.067012] [DEBUG] [MAIN ] NATL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:48.074248] [DEBUG] [MAIN ] NAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:48.075267] [INFO ] [MAIN ] NATL: Generated 1326 derivative records from 24035 primary records. [2025-09-15T21:18:48.076125] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-15T21:18:48.073666] [DEBUG] [LOCAL ] NAZ: Loaded 1952 existing records from primary storage. [2025-09-15T21:18:48.076677] [INFO ] [MAIN ] NAZ: Loaded 1952 primary data records. [2025-09-15T21:18:48.076055] [INFO ] [MAIN ] NAT: Generated 1326 derivative records from 35875 primary records. [2025-09-15T21:18:48.077505] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-15T21:18:48.112374] [DEBUG] [LOCAL ] NATL: Derivative data saved (1326 records). [2025-09-15T21:18:48.123386] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-15T21:18:48.143701] [INFO ] [MAIN ] Derivative Progress: 1256/2083 symbols completed. NATL took 1.0s. Estimated remaining: 4m 34s. Rate: 181.0 symbols/min [2025-09-15T21:18:48.149032] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:48.218975] [DEBUG] [LOCAL ] NAT: Derivative data saved (1326 records). [2025-09-15T21:18:48.245223] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-15T21:18:48.266405] [INFO ] [MAIN ] Derivative Progress: 1257/2083 symbols completed. NAT took 1.2s. Estimated remaining: 4m 34s. Rate: 181.1 symbols/min [2025-09-15T21:18:48.302289] [DEBUG] [LOCAL ] NBB: Loaded 6403 existing records from primary storage. [2025-09-15T21:18:48.305684] [INFO ] [MAIN ] NBB: Loaded 6403 primary data records. [2025-09-15T21:18:48.305563] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:48.689439] [DEBUG] [LOCAL ] NBR: Loaded 25999 existing records from primary storage. [2025-09-15T21:18:48.691690] [INFO ] [MAIN ] NBR: Loaded 25999 primary data records. [2025-09-15T21:18:48.971777] [DEBUG] [MAIN ] NAZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:48.973764] [INFO ] [MAIN ] NAZ: Generated 1326 derivative records from 1952 primary records. [2025-09-15T21:18:48.974137] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-15T21:18:48.990152] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1326 records). [2025-09-15T21:18:48.990588] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-15T21:18:48.993031] [INFO ] [MAIN ] Derivative Progress: 1258/2083 symbols completed. NAZ took 1.0s. Estimated remaining: 4m 34s. Rate: 180.9 symbols/min [2025-09-15T21:18:49.004437] [DEBUG] [MAIN ] NBB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:49.005410] [INFO ] [MAIN ] NBB: Generated 1326 derivative records from 6403 primary records. [2025-09-15T21:18:49.005488] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-15T21:18:49.020318] [DEBUG] [LOCAL ] NBB: Derivative data saved (1326 records). [2025-09-15T21:18:49.020602] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-15T21:18:49.022789] [INFO ] [MAIN ] Derivative Progress: 1259/2083 symbols completed. NBB took 0.9s. Estimated remaining: 4m 33s. Rate: 181.0 symbols/min [2025-09-15T21:18:49.037156] [DEBUG] [MAIN ] NBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:49.038001] [INFO ] [MAIN ] NBR: Generated 1326 derivative records from 25999 primary records. [2025-09-15T21:18:49.038078] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-15T21:18:49.055768] [DEBUG] [LOCAL ] NBR: Derivative data saved (1326 records). [2025-09-15T21:18:49.055921] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-15T21:18:49.059423] [INFO ] [MAIN ] Derivative Progress: 1260/2083 symbols completed. NBR took 0.8s. Estimated remaining: 4m 33s. Rate: 181.2 symbols/min [2025-09-15T21:18:49.060195] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:49.060686] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:49.060387] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:49.066718] [DEBUG] [LOCAL ] NC: Loaded 1162 existing records from primary storage. [2025-09-15T21:18:49.066980] [INFO ] [MAIN ] NC: Loaded 1162 primary data records. [2025-09-15T21:18:49.179548] [DEBUG] [LOCAL ] NCA: Loaded 7083 existing records from primary storage. [2025-09-15T21:18:49.199122] [INFO ] [MAIN ] NCA: Loaded 7083 primary data records. [2025-09-15T21:18:49.201011] [DEBUG] [LOCAL ] NBXG: Loaded 15978 existing records from primary storage. [2025-09-15T21:18:49.206008] [INFO ] [MAIN ] NBXG: Loaded 15978 primary data records. [2025-09-15T21:18:50.055159] [DEBUG] [MAIN ] NC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:50.056337] [INFO ] [MAIN ] NC: Generated 1326 derivative records from 1162 primary records. [2025-09-15T21:18:50.058303] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-15T21:18:50.080744] [DEBUG] [LOCAL ] NC: Derivative data saved (1326 records). [2025-09-15T21:18:50.081587] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-15T21:18:50.081433] [DEBUG] [MAIN ] NCA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:50.091211] [INFO ] [MAIN ] Derivative Progress: 1261/2083 symbols completed. NC took 1.0s. Estimated remaining: 4m 33s. Rate: 180.9 symbols/min [2025-09-15T21:18:50.092682] [INFO ] [MAIN ] NCA: Generated 1326 derivative records from 7083 primary records. [2025-09-15T21:18:50.093096] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:50.093421] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-15T21:18:50.116778] [DEBUG] [MAIN ] NBXG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:50.118247] [DEBUG] [LOCAL ] NCA: Derivative data saved (1326 records). [2025-09-15T21:18:50.119354] [INFO ] [MAIN ] NBXG: Generated 1326 derivative records from 15978 primary records. [2025-09-15T21:18:50.118558] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-15T21:18:50.121850] [INFO ] [MAIN ] Derivative Progress: 1262/2083 symbols completed. NCA took 1.1s. Estimated remaining: 4m 32s. Rate: 181.0 symbols/min [2025-09-15T21:18:50.122067] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-15T21:18:50.126998] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:50.141041] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1326 records). [2025-09-15T21:18:50.146326] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-15T21:18:50.149515] [INFO ] [MAIN ] Derivative Progress: 1263/2083 symbols completed. NBXG took 1.1s. Estimated remaining: 4m 32s. Rate: 181.1 symbols/min [2025-09-15T21:18:50.151167] [DEBUG] [LOCAL ] NCDL: Loaded 14866 existing records from primary storage. [2025-09-15T21:18:50.151272] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:50.151686] [INFO ] [MAIN ] NCDL: Loaded 14866 primary data records. [2025-09-15T21:18:50.307844] [DEBUG] [LOCAL ] NCV: Loaded 9518 existing records from primary storage. [2025-09-15T21:18:50.369130] [INFO ] [MAIN ] NCV: Loaded 9518 primary data records. [2025-09-15T21:18:50.447958] [DEBUG] [LOCAL ] NCLH: Loaded 39713 existing records from primary storage. [2025-09-15T21:18:50.480451] [INFO ] [MAIN ] NCLH: Loaded 39713 primary data records. [2025-09-15T21:18:51.073530] [DEBUG] [MAIN ] NCDL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:51.075108] [INFO ] [MAIN ] NCDL: Generated 1326 derivative records from 14866 primary records. [2025-09-15T21:18:51.075455] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-15T21:18:51.089904] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1326 records). [2025-09-15T21:18:51.090752] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-15T21:18:51.092758] [INFO ] [MAIN ] Derivative Progress: 1264/2083 symbols completed. NCDL took 1.0s. Estimated remaining: 4m 32s. Rate: 180.9 symbols/min [2025-09-15T21:18:51.095309] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:51.110589] [DEBUG] [MAIN ] NCLH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:51.123521] [INFO ] [MAIN ] NCLH: Generated 1326 derivative records from 39713 primary records. [2025-09-15T21:18:51.124074] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-15T21:18:51.124529] [DEBUG] [MAIN ] NCV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:51.130369] [INFO ] [MAIN ] NCV: Generated 1326 derivative records from 9518 primary records. [2025-09-15T21:18:51.136965] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-15T21:18:51.136209] [DEBUG] [LOCAL ] NCZ: Loaded 8108 existing records from primary storage. [2025-09-15T21:18:51.139171] [INFO ] [MAIN ] NCZ: Loaded 8108 primary data records. [2025-09-15T21:18:51.226322] [DEBUG] [LOCAL ] NCV: Derivative data saved (1326 records). [2025-09-15T21:18:51.226196] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1326 records). [2025-09-15T21:18:51.233424] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-15T21:18:51.260856] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-15T21:18:51.263768] [INFO ] [MAIN ] Derivative Progress: 1265/2083 symbols completed. NCV took 1.1s. Estimated remaining: 4m 31s. Rate: 180.9 symbols/min [2025-09-15T21:18:51.264694] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:51.267334] [INFO ] [MAIN ] Derivative Progress: 1266/2083 symbols completed. NCLH took 1.1s. Estimated remaining: 4m 31s. Rate: 181.1 symbols/min [2025-09-15T21:18:51.273124] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:51.443916] [DEBUG] [LOCAL ] NDMO: Loaded 12480 existing records from primary storage. [2025-09-15T21:18:51.444202] [INFO ] [MAIN ] NDMO: Loaded 12480 primary data records. [2025-09-15T21:18:51.659939] [DEBUG] [LOCAL ] NE: Loaded 38574 existing records from primary storage. [2025-09-15T21:18:51.667987] [INFO ] [MAIN ] NE: Loaded 38574 primary data records. [2025-09-15T21:18:51.972568] [DEBUG] [MAIN ] NCZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:52.110514] [INFO ] [MAIN ] NCZ: Generated 1326 derivative records from 8108 primary records. [2025-09-15T21:18:52.122399] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-15T21:18:52.141411] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1326 records). [2025-09-15T21:18:52.141927] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-15T21:18:52.144729] [INFO ] [MAIN ] Derivative Progress: 1267/2083 symbols completed. NCZ took 1.1s. Estimated remaining: 4m 31s. Rate: 180.8 symbols/min [2025-09-15T21:18:52.145281] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:52.157509] [DEBUG] [MAIN ] NDMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:52.159324] [INFO ] [MAIN ] NDMO: Generated 1326 derivative records from 12480 primary records. [2025-09-15T21:18:52.161670] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-15T21:18:52.175829] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1326 records). [2025-09-15T21:18:52.176139] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-15T21:18:52.178126] [INFO ] [MAIN ] Derivative Progress: 1268/2083 symbols completed. NDMO took 0.9s. Estimated remaining: 4m 30s. Rate: 181.0 symbols/min [2025-09-15T21:18:52.178684] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:52.192830] [DEBUG] [MAIN ] NE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:52.193554] [INFO ] [MAIN ] NE: Generated 1326 derivative records from 38574 primary records. [2025-09-15T21:18:52.203781] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-15T21:18:52.232975] [DEBUG] [LOCAL ] NE: Derivative data saved (1326 records). [2025-09-15T21:18:52.234674] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-15T21:18:52.236568] [INFO ] [MAIN ] Derivative Progress: 1269/2083 symbols completed. NE took 1.0s. Estimated remaining: 4m 30s. Rate: 181.1 symbols/min [2025-09-15T21:18:52.237050] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:52.238769] [DEBUG] [LOCAL ] NEA: Loaded 25889 existing records from primary storage. [2025-09-15T21:18:52.239144] [INFO ] [MAIN ] NEA: Loaded 25889 primary data records. [2025-09-15T21:18:52.406943] [DEBUG] [LOCAL ] NEE: Loaded 39667 existing records from primary storage. [2025-09-15T21:18:52.442759] [INFO ] [MAIN ] NEE: Loaded 39667 primary data records. [2025-09-15T21:18:52.570904] [DEBUG] [LOCAL ] NEM: Loaded 39668 existing records from primary storage. [2025-09-15T21:18:52.698460] [INFO ] [MAIN ] NEM: Loaded 39668 primary data records. [2025-09-15T21:18:53.172940] [DEBUG] [MAIN ] NEA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:53.175540] [INFO ] [MAIN ] NEA: Generated 1326 derivative records from 25889 primary records. [2025-09-15T21:18:53.176005] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-15T21:18:53.192435] [DEBUG] [LOCAL ] NEA: Derivative data saved (1326 records). [2025-09-15T21:18:53.194116] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-15T21:18:53.195849] [INFO ] [MAIN ] Derivative Progress: 1270/2083 symbols completed. NEA took 1.1s. Estimated remaining: 4m 30s. Rate: 180.8 symbols/min [2025-09-15T21:18:53.201978] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:53.206989] [DEBUG] [MAIN ] NEE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:53.208084] [INFO ] [MAIN ] NEE: Generated 1326 derivative records from 39667 primary records. [2025-09-15T21:18:53.208170] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-15T21:18:53.232166] [DEBUG] [MAIN ] NEM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:53.233748] [INFO ] [MAIN ] NEM: Generated 1326 derivative records from 39668 primary records. [2025-09-15T21:18:53.234312] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-15T21:18:53.235354] [DEBUG] [LOCAL ] NEE: Derivative data saved (1326 records). [2025-09-15T21:18:53.235706] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-15T21:18:53.239077] [INFO ] [MAIN ] Derivative Progress: 1271/2083 symbols completed. NEE took 1.1s. Estimated remaining: 4m 29s. Rate: 180.9 symbols/min [2025-09-15T21:18:53.247909] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:53.251461] [DEBUG] [LOCAL ] NEM: Derivative data saved (1326 records). [2025-09-15T21:18:53.251675] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-15T21:18:53.254742] [INFO ] [MAIN ] Derivative Progress: 1272/2083 symbols completed. NEM took 1.0s. Estimated remaining: 4m 29s. Rate: 181.1 symbols/min [2025-09-15T21:18:53.255137] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:53.260998] [DEBUG] [LOCAL ] NEUE: Loaded 1185 existing records from primary storage. [2025-09-15T21:18:53.261368] [INFO ] [MAIN ] NEUE: Loaded 1185 primary data records. [2025-09-15T21:18:53.310694] [DEBUG] [LOCAL ] NEU: Loaded 6787 existing records from primary storage. [2025-09-15T21:18:53.337786] [INFO ] [MAIN ] NEU: Loaded 6787 primary data records. [2025-09-15T21:18:53.483591] [DEBUG] [LOCAL ] NET: Loaded 39108 existing records from primary storage. [2025-09-15T21:18:53.506047] [INFO ] [MAIN ] NET: Loaded 39108 primary data records. [2025-09-15T21:18:54.110181] [DEBUG] [MAIN ] NEUE: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:18:54.111161] [INFO ] [MAIN ] NEUE: Generated 1324 derivative records from 1185 primary records. [2025-09-15T21:18:54.111427] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-15T21:18:54.121906] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1324 records). [2025-09-15T21:18:54.122087] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-15T21:18:54.124416] [INFO ] [MAIN ] Derivative Progress: 1273/2083 symbols completed. NEUE took 0.9s. Estimated remaining: 4m 29s. Rate: 180.8 symbols/min [2025-09-15T21:18:54.135473] [DEBUG] [MAIN ] NEU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:54.136129] [INFO ] [MAIN ] NEU: Generated 1326 derivative records from 6787 primary records. [2025-09-15T21:18:54.136261] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-15T21:18:54.159669] [DEBUG] [LOCAL ] NEU: Derivative data saved (1326 records). [2025-09-15T21:18:54.159925] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-15T21:18:54.162020] [INFO ] [MAIN ] Derivative Progress: 1274/2083 symbols completed. NEU took 0.9s. Estimated remaining: 4m 28s. Rate: 181.0 symbols/min [2025-09-15T21:18:54.162331] [DEBUG] [MAIN ] NET: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:18:54.163154] [INFO ] [MAIN ] NET: Generated 1325 derivative records from 39108 primary records. [2025-09-15T21:18:54.163218] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-15T21:18:54.175236] [DEBUG] [LOCAL ] NET: Derivative data saved (1325 records). [2025-09-15T21:18:54.175296] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-15T21:18:54.177697] [INFO ] [MAIN ] Derivative Progress: 1275/2083 symbols completed. NET took 1.0s. Estimated remaining: 4m 28s. Rate: 181.1 symbols/min [2025-09-15T21:18:54.178177] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:54.178241] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:54.178366] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:54.186294] [DEBUG] [LOCAL ] NEXA: Loaded 2952 existing records from primary storage. [2025-09-15T21:18:54.186706] [INFO ] [MAIN ] NEXA: Loaded 2952 primary data records. [2025-09-15T21:18:54.310830] [DEBUG] [LOCAL ] NFJ: Loaded 14409 existing records from primary storage. [2025-09-15T21:18:54.321510] [INFO ] [MAIN ] NFJ: Loaded 14409 primary data records. [2025-09-15T21:18:54.445999] [DEBUG] [LOCAL ] NFG: Loaded 27895 existing records from primary storage. [2025-09-15T21:18:54.459707] [INFO ] [MAIN ] NFG: Loaded 27895 primary data records. [2025-09-15T21:18:55.055580] [DEBUG] [MAIN ] NEXA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:55.057981] [INFO ] [MAIN ] NEXA: Generated 1326 derivative records from 2952 primary records. [2025-09-15T21:18:55.058395] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-15T21:18:55.078118] [DEBUG] [MAIN ] NFJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:55.080705] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1326 records). [2025-09-15T21:18:55.081888] [INFO ] [MAIN ] NFJ: Generated 1326 derivative records from 14409 primary records. [2025-09-15T21:18:55.082109] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-15T21:18:55.082027] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-15T21:18:55.084322] [INFO ] [MAIN ] Derivative Progress: 1276/2083 symbols completed. NEXA took 0.9s. Estimated remaining: 4m 28s. Rate: 180.8 symbols/min [2025-09-15T21:18:55.084631] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:55.101099] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1326 records). [2025-09-15T21:18:55.101336] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-15T21:18:55.103427] [INFO ] [MAIN ] Derivative Progress: 1277/2083 symbols completed. NFJ took 0.9s. Estimated remaining: 4m 27s. Rate: 181.0 symbols/min [2025-09-15T21:18:55.103775] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:55.114404] [DEBUG] [MAIN ] NFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:55.115197] [INFO ] [MAIN ] NFG: Generated 1326 derivative records from 27895 primary records. [2025-09-15T21:18:55.115370] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-15T21:18:55.128985] [DEBUG] [LOCAL ] NFG: Derivative data saved (1326 records). [2025-09-15T21:18:55.129375] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-15T21:18:55.140143] [INFO ] [MAIN ] Derivative Progress: 1278/2083 symbols completed. NFG took 1.0s. Estimated remaining: 4m 27s. Rate: 181.1 symbols/min [2025-09-15T21:18:55.140532] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:55.168270] [DEBUG] [LOCAL ] NGL: Loaded 22541 existing records from primary storage. [2025-09-15T21:18:55.167939] [DEBUG] [LOCAL ] NGG: Loaded 34488 existing records from primary storage. [2025-09-15T21:18:55.168468] [INFO ] [MAIN ] NGG: Loaded 34488 primary data records. [2025-09-15T21:18:55.168540] [INFO ] [MAIN ] NGL: Loaded 22541 primary data records. [2025-09-15T21:18:55.299087] [DEBUG] [LOCAL ] NGS: Loaded 8037 existing records from primary storage. [2025-09-15T21:18:55.363422] [INFO ] [MAIN ] NGS: Loaded 8037 primary data records. [2025-09-15T21:18:55.991022] [DEBUG] [MAIN ] NGL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:55.992768] [INFO ] [MAIN ] NGL: Generated 1326 derivative records from 22541 primary records. [2025-09-15T21:18:55.993095] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-15T21:18:56.006177] [DEBUG] [MAIN ] NGG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:56.020429] [DEBUG] [LOCAL ] NGL: Derivative data saved (1326 records). [2025-09-15T21:18:56.020664] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-15T21:18:56.017270] [INFO ] [MAIN ] NGG: Generated 1326 derivative records from 34488 primary records. [2025-09-15T21:18:56.020851] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-15T21:18:56.022459] [INFO ] [MAIN ] Derivative Progress: 1279/2083 symbols completed. NGL took 0.9s. Estimated remaining: 4m 27s. Rate: 180.9 symbols/min [2025-09-15T21:18:56.022888] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:56.035251] [DEBUG] [MAIN ] NGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:56.045780] [INFO ] [MAIN ] NGS: Generated 1326 derivative records from 8037 primary records. [2025-09-15T21:18:56.047063] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-15T21:18:56.049862] [DEBUG] [LOCAL ] NGG: Derivative data saved (1326 records). [2025-09-15T21:18:56.050288] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-15T21:18:56.061204] [INFO ] [MAIN ] Derivative Progress: 1280/2083 symbols completed. NGG took 1.0s. Estimated remaining: 4m 26s. Rate: 181.0 symbols/min [2025-09-15T21:18:56.071393] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:56.071211] [DEBUG] [LOCAL ] NGS: Derivative data saved (1326 records). [2025-09-15T21:18:56.072002] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-15T21:18:56.074078] [INFO ] [MAIN ] Derivative Progress: 1281/2083 symbols completed. NGS took 0.9s. Estimated remaining: 4m 26s. Rate: 181.1 symbols/min [2025-09-15T21:18:56.080116] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:56.081764] [DEBUG] [LOCAL ] NGVC: Loaded 17227 existing records from primary storage. [2025-09-15T21:18:56.082340] [INFO ] [MAIN ] NGVC: Loaded 17227 primary data records. [2025-09-15T21:18:56.215090] [DEBUG] [LOCAL ] NGVT: Loaded 17832 existing records from primary storage. [2025-09-15T21:18:56.236912] [INFO ] [MAIN ] NGVT: Loaded 17832 primary data records. [2025-09-15T21:18:56.265478] [DEBUG] [LOCAL ] NHI: Loaded 16297 existing records from primary storage. [2025-09-15T21:18:56.285019] [INFO ] [MAIN ] NHI: Loaded 16297 primary data records. [2025-09-15T21:18:56.996695] [DEBUG] [MAIN ] NGVC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:56.997980] [INFO ] [MAIN ] NGVC: Generated 1326 derivative records from 17227 primary records. [2025-09-15T21:18:56.998477] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-15T21:18:57.015034] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1326 records). [2025-09-15T21:18:57.015383] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-15T21:18:57.017362] [INFO ] [MAIN ] Derivative Progress: 1282/2083 symbols completed. NGVC took 1.0s. Estimated remaining: 4m 26s. Rate: 180.9 symbols/min [2025-09-15T21:18:57.018391] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:57.036290] [DEBUG] [MAIN ] NHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:57.042525] [INFO ] [MAIN ] NHI: Generated 1326 derivative records from 16297 primary records. [2025-09-15T21:18:57.046365] [DEBUG] [MAIN ] NGVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:57.046429] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-15T21:18:57.047101] [INFO ] [MAIN ] NGVT: Generated 1326 derivative records from 17832 primary records. [2025-09-15T21:18:57.047818] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-15T21:18:57.073077] [DEBUG] [LOCAL ] NHI: Derivative data saved (1326 records). [2025-09-15T21:18:57.073338] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-15T21:18:57.075520] [INFO ] [MAIN ] Derivative Progress: 1283/2083 symbols completed. NHI took 1.0s. Estimated remaining: 4m 25s. Rate: 181.0 symbols/min [2025-09-15T21:18:57.073436] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1326 records). [2025-09-15T21:18:57.075923] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:57.088366] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-15T21:18:57.090874] [INFO ] [MAIN ] Derivative Progress: 1284/2083 symbols completed. NGVT took 1.0s. Estimated remaining: 4m 25s. Rate: 181.1 symbols/min [2025-09-15T21:18:57.091174] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:57.101774] [DEBUG] [LOCAL ] NIC: Loaded 6420 existing records from primary storage. [2025-09-15T21:18:57.102719] [INFO ] [MAIN ] NIC: Loaded 6420 primary data records. [2025-09-15T21:18:57.136768] [DEBUG] [LOCAL ] NIE: Loaded 8108 existing records from primary storage. [2025-09-15T21:18:57.150473] [INFO ] [MAIN ] NIE: Loaded 8108 primary data records. [2025-09-15T21:18:57.205182] [DEBUG] [LOCAL ] NI: Loaded 39409 existing records from primary storage. [2025-09-15T21:18:57.306811] [INFO ] [MAIN ] NI: Loaded 39409 primary data records. [2025-09-15T21:18:57.976488] [DEBUG] [MAIN ] NIE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:57.978474] [INFO ] [MAIN ] NIE: Generated 1326 derivative records from 8108 primary records. [2025-09-15T21:18:57.979725] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-15T21:18:58.008036] [DEBUG] [LOCAL ] NIE: Derivative data saved (1326 records). [2025-09-15T21:18:58.008919] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-15T21:18:58.012601] [INFO ] [MAIN ] Derivative Progress: 1285/2083 symbols completed. NIE took 0.9s. Estimated remaining: 4m 25s. Rate: 180.9 symbols/min [2025-09-15T21:18:58.013094] [DEBUG] [MAIN ] NIC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:58.014379] [INFO ] [MAIN ] NIC: Generated 1326 derivative records from 6420 primary records. [2025-09-15T21:18:58.014591] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-15T21:18:58.013422] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:58.026821] [DEBUG] [MAIN ] NI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:58.034877] [INFO ] [MAIN ] NI: Generated 1326 derivative records from 39409 primary records. [2025-09-15T21:18:58.038282] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-15T21:18:58.047617] [DEBUG] [LOCAL ] NIC: Derivative data saved (1326 records). [2025-09-15T21:18:58.053966] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-15T21:18:58.057326] [DEBUG] [LOCAL ] NI: Derivative data saved (1326 records). [2025-09-15T21:18:58.057234] [DEBUG] [LOCAL ] NIM: Loaded 2724 existing records from primary storage. [2025-09-15T21:18:58.057660] [INFO ] [MAIN ] NIM: Loaded 2724 primary data records. [2025-09-15T21:18:58.059870] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-15T21:18:58.059767] [INFO ] [MAIN ] Derivative Progress: 1286/2083 symbols completed. NIC took 1.0s. Estimated remaining: 4m 24s. Rate: 181.0 symbols/min [2025-09-15T21:18:58.071885] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:58.074536] [INFO ] [MAIN ] Derivative Progress: 1287/2083 symbols completed. NI took 1.1s. Estimated remaining: 4m 24s. Rate: 181.1 symbols/min [2025-09-15T21:18:58.099468] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:58.277562] [DEBUG] [LOCAL ] NINE: Loaded 21617 existing records from primary storage. [2025-09-15T21:18:58.363240] [INFO ] [MAIN ] NINE: Loaded 21617 primary data records. [2025-09-15T21:18:58.481854] [DEBUG] [LOCAL ] NIO: Loaded 39762 existing records from primary storage. [2025-09-15T21:18:58.483058] [INFO ] [MAIN ] NIO: Loaded 39762 primary data records. [2025-09-15T21:18:58.987451] [DEBUG] [MAIN ] NIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:58.989814] [INFO ] [MAIN ] NIM: Generated 1326 derivative records from 2724 primary records. [2025-09-15T21:18:58.990006] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-15T21:18:59.005051] [DEBUG] [LOCAL ] NIM: Derivative data saved (1326 records). [2025-09-15T21:18:59.005408] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-15T21:18:59.009039] [INFO ] [MAIN ] Derivative Progress: 1288/2083 symbols completed. NIM took 1.0s. Estimated remaining: 4m 24s. Rate: 180.9 symbols/min [2025-09-15T21:18:59.024972] [DEBUG] [MAIN ] NINE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:59.025910] [INFO ] [MAIN ] NINE: Generated 1326 derivative records from 21617 primary records. [2025-09-15T21:18:59.026116] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-15T21:18:59.041186] [DEBUG] [LOCAL ] NINE: Derivative data saved (1326 records). [2025-09-15T21:18:59.050976] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-15T21:18:59.051243] [DEBUG] [MAIN ] NIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:18:59.052993] [INFO ] [MAIN ] Derivative Progress: 1289/2083 symbols completed. NINE took 1.0s. Estimated remaining: 4m 23s. Rate: 181.0 symbols/min [2025-09-15T21:18:59.053943] [INFO ] [MAIN ] NIO: Generated 1326 derivative records from 39762 primary records. [2025-09-15T21:18:59.054015] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-15T21:18:59.066099] [DEBUG] [LOCAL ] NIO: Derivative data saved (1326 records). [2025-09-15T21:18:59.066243] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-15T21:18:59.069053] [INFO ] [MAIN ] Derivative Progress: 1290/2083 symbols completed. NIO took 1.0s. Estimated remaining: 4m 23s. Rate: 181.1 symbols/min [2025-09-15T21:18:59.069629] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:59.069895] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:59.070341] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:18:59.089300] [DEBUG] [LOCAL ] NLOP: Loaded 8370 existing records from primary storage. [2025-09-15T21:18:59.089700] [INFO ] [MAIN ] NLOP: Loaded 8370 primary data records. [2025-09-15T21:18:59.127346] [DEBUG] [LOCAL ] NKX: Loaded 10202 existing records from primary storage. [2025-09-15T21:18:59.155574] [INFO ] [MAIN ] NKX: Loaded 10202 primary data records. [2025-09-15T21:18:59.433845] [DEBUG] [LOCAL ] NJR: Loaded 27763 existing records from primary storage. [2025-09-15T21:18:59.464164] [INFO ] [MAIN ] NJR: Loaded 27763 primary data records. [2025-09-15T21:18:59.997795] [DEBUG] [MAIN ] NLOP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:00.000079] [INFO ] [MAIN ] NLOP: Generated 1326 derivative records from 8370 primary records. [2025-09-15T21:19:00.000390] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-15T21:19:00.033261] [DEBUG] [MAIN ] NKX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:00.037480] [INFO ] [MAIN ] NKX: Generated 1326 derivative records from 10202 primary records. [2025-09-15T21:19:00.037827] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-15T21:19:00.038975] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1326 records). [2025-09-15T21:19:00.046989] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-15T21:19:00.052881] [INFO ] [MAIN ] Derivative Progress: 1291/2083 symbols completed. NLOP took 1.0s. Estimated remaining: 4m 23s. Rate: 180.9 symbols/min [2025-09-15T21:19:00.058343] [DEBUG] [LOCAL ] NKX: Derivative data saved (1326 records). [2025-09-15T21:19:00.058611] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-15T21:19:00.062521] [INFO ] [MAIN ] Derivative Progress: 1292/2083 symbols completed. NKX took 1.0s. Estimated remaining: 4m 22s. Rate: 181.0 symbols/min [2025-09-15T21:19:00.063168] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:00.063054] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:00.074210] [DEBUG] [MAIN ] NJR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:00.075999] [INFO ] [MAIN ] NJR: Generated 1326 derivative records from 27763 primary records. [2025-09-15T21:19:00.076276] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-15T21:19:00.093431] [DEBUG] [LOCAL ] NJR: Derivative data saved (1326 records). [2025-09-15T21:19:00.093750] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-15T21:19:00.095851] [INFO ] [MAIN ] Derivative Progress: 1293/2083 symbols completed. NJR took 1.0s. Estimated remaining: 4m 22s. Rate: 181.1 symbols/min [2025-09-15T21:19:00.096243] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:00.102219] [DEBUG] [LOCAL ] NMAI: Loaded 9248 existing records from primary storage. [2025-09-15T21:19:00.102567] [INFO ] [MAIN ] NMAI: Loaded 9248 primary data records. [2025-09-15T21:19:00.224455] [DEBUG] [LOCAL ] NMCO: Loaded 12266 existing records from primary storage. [2025-09-15T21:19:00.233332] [INFO ] [MAIN ] NMCO: Loaded 12266 primary data records. [2025-09-15T21:19:00.452398] [DEBUG] [LOCAL ] NLY: Loaded 39550 existing records from primary storage. [2025-09-15T21:19:00.532820] [INFO ] [MAIN ] NLY: Loaded 39550 primary data records. [2025-09-15T21:19:00.981404] [DEBUG] [MAIN ] NMAI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:00.993113] [INFO ] [MAIN ] NMAI: Generated 1326 derivative records from 9248 primary records. [2025-09-15T21:19:00.993475] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-15T21:19:00.994403] [DEBUG] [MAIN ] NMCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:00.996395] [INFO ] [MAIN ] NMCO: Generated 1326 derivative records from 12266 primary records. [2025-09-15T21:19:01.003148] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-15T21:19:01.016493] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1326 records). [2025-09-15T21:19:01.021984] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-15T21:19:01.024683] [INFO ] [MAIN ] Derivative Progress: 1294/2083 symbols completed. NMAI took 1.0s. Estimated remaining: 4m 22s. Rate: 180.9 symbols/min [2025-09-15T21:19:01.021865] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1326 records). [2025-09-15T21:19:01.025004] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-15T21:19:01.025279] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:01.027609] [INFO ] [MAIN ] Derivative Progress: 1295/2083 symbols completed. NMCO took 0.9s. Estimated remaining: 4m 21s. Rate: 181.0 symbols/min [2025-09-15T21:19:01.028581] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:01.045091] [DEBUG] [MAIN ] NLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:01.045956] [INFO ] [MAIN ] NLY: Generated 1326 derivative records from 39550 primary records. [2025-09-15T21:19:01.046148] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-15T21:19:01.049291] [DEBUG] [LOCAL ] NMI: Loaded 3338 existing records from primary storage. [2025-09-15T21:19:01.053880] [DEBUG] [LOCAL ] NMG: Loaded 5659 existing records from primary storage. [2025-09-15T21:19:01.053980] [INFO ] [MAIN ] NMI: Loaded 3338 primary data records. [2025-09-15T21:19:01.063049] [INFO ] [MAIN ] NMG: Loaded 5659 primary data records. [2025-09-15T21:19:01.248092] [DEBUG] [LOCAL ] NLY: Derivative data saved (1326 records). [2025-09-15T21:19:01.271135] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-15T21:19:01.281387] [INFO ] [MAIN ] Derivative Progress: 1296/2083 symbols completed. NLY took 1.2s. Estimated remaining: 4m 21s. Rate: 181.0 symbols/min [2025-09-15T21:19:01.334019] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:01.674015] [DEBUG] [LOCAL ] NMM: Loaded 9879 existing records from primary storage. [2025-09-15T21:19:01.674794] [INFO ] [MAIN ] NMM: Loaded 9879 primary data records. [2025-09-15T21:19:01.977699] [DEBUG] [MAIN ] NMG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:01.979141] [INFO ] [MAIN ] NMG: Generated 1326 derivative records from 5659 primary records. [2025-09-15T21:19:01.979234] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-15T21:19:01.978373] [DEBUG] [MAIN ] NMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:01.980164] [INFO ] [MAIN ] NMI: Generated 1326 derivative records from 3338 primary records. [2025-09-15T21:19:01.980505] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-15T21:19:01.994921] [DEBUG] [LOCAL ] NMG: Derivative data saved (1326 records). [2025-09-15T21:19:02.001267] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-15T21:19:02.004568] [INFO ] [MAIN ] Derivative Progress: 1297/2083 symbols completed. NMG took 1.0s. Estimated remaining: 4m 21s. Rate: 180.9 symbols/min [2025-09-15T21:19:02.005024] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:02.010548] [DEBUG] [LOCAL ] NMI: Derivative data saved (1326 records). [2025-09-15T21:19:02.010894] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-15T21:19:02.012787] [INFO ] [MAIN ] Derivative Progress: 1298/2083 symbols completed. NMI took 1.0s. Estimated remaining: 4m 20s. Rate: 181.0 symbols/min [2025-09-15T21:19:02.013135] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:02.017770] [DEBUG] [LOCAL ] NMS: Loaded 2278 existing records from primary storage. [2025-09-15T21:19:02.017942] [INFO ] [MAIN ] NMS: Loaded 2278 primary data records. [2025-09-15T21:19:02.147151] [DEBUG] [MAIN ] NMM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:02.158968] [INFO ] [MAIN ] NMM: Generated 1326 derivative records from 9879 primary records. [2025-09-15T21:19:02.171216] [DEBUG] [LOCAL ] NMR: Loaded 25248 existing records from primary storage. [2025-09-15T21:19:02.159117] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-15T21:19:02.187301] [INFO ] [MAIN ] NMR: Loaded 25248 primary data records. [2025-09-15T21:19:02.270608] [DEBUG] [LOCAL ] NMM: Derivative data saved (1326 records). [2025-09-15T21:19:02.371533] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-15T21:19:02.387662] [INFO ] [MAIN ] Derivative Progress: 1299/2083 symbols completed. NMM took 1.1s. Estimated remaining: 4m 20s. Rate: 181.0 symbols/min [2025-09-15T21:19:02.388593] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:02.458034] [DEBUG] [LOCAL ] NMT: Loaded 2149 existing records from primary storage. [2025-09-15T21:19:02.458333] [INFO ] [MAIN ] NMT: Loaded 2149 primary data records. [2025-09-15T21:19:02.914818] [DEBUG] [MAIN ] NMS: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:19:02.917840] [INFO ] [MAIN ] NMS: Generated 1325 derivative records from 2278 primary records. [2025-09-15T21:19:02.918176] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-15T21:19:02.931704] [DEBUG] [LOCAL ] NMS: Derivative data saved (1325 records). [2025-09-15T21:19:02.932254] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-15T21:19:02.933813] [INFO ] [MAIN ] Derivative Progress: 1300/2083 symbols completed. NMS took 0.9s. Estimated remaining: 4m 20s. Rate: 180.9 symbols/min [2025-09-15T21:19:02.934005] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:02.956576] [DEBUG] [MAIN ] NMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:02.965710] [INFO ] [MAIN ] NMR: Generated 1326 derivative records from 25248 primary records. [2025-09-15T21:19:02.965966] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-15T21:19:02.973325] [DEBUG] [LOCAL ] NMZ: Loaded 15373 existing records from primary storage. [2025-09-15T21:19:02.977438] [INFO ] [MAIN ] NMZ: Loaded 15373 primary data records. [2025-09-15T21:19:02.983448] [DEBUG] [MAIN ] NMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:03.008589] [INFO ] [MAIN ] NMT: Generated 1326 derivative records from 2149 primary records. [2025-09-15T21:19:03.018813] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-15T21:19:03.027052] [DEBUG] [LOCAL ] NMR: Derivative data saved (1326 records). [2025-09-15T21:19:03.085531] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-15T21:19:03.095692] [INFO ] [MAIN ] Derivative Progress: 1301/2083 symbols completed. NMR took 1.1s. Estimated remaining: 4m 19s. Rate: 181.0 symbols/min [2025-09-15T21:19:03.108614] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:03.111570] [DEBUG] [LOCAL ] NMT: Derivative data saved (1326 records). [2025-09-15T21:19:03.127848] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-15T21:19:03.135523] [INFO ] [MAIN ] Derivative Progress: 1302/2083 symbols completed. NMT took 0.7s. Estimated remaining: 4m 19s. Rate: 181.1 symbols/min [2025-09-15T21:19:03.141313] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:03.294853] [DEBUG] [LOCAL ] NNY: Loaded 4225 existing records from primary storage. [2025-09-15T21:19:03.295327] [INFO ] [MAIN ] NNY: Loaded 4225 primary data records. [2025-09-15T21:19:03.520788] [DEBUG] [LOCAL ] NNN: Loaded 35485 existing records from primary storage. [2025-09-15T21:19:03.542685] [INFO ] [MAIN ] NNN: Loaded 35485 primary data records. [2025-09-15T21:19:03.753730] [DEBUG] [MAIN ] NMZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:03.760805] [INFO ] [MAIN ] NMZ: Generated 1326 derivative records from 15373 primary records. [2025-09-15T21:19:03.766117] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-15T21:19:03.933694] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1326 records). [2025-09-15T21:19:03.934197] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-15T21:19:03.936020] [INFO ] [MAIN ] Derivative Progress: 1303/2083 symbols completed. NMZ took 1.0s. Estimated remaining: 4m 19s. Rate: 180.9 symbols/min [2025-09-15T21:19:03.952848] [DEBUG] [MAIN ] NNY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:03.953575] [INFO ] [MAIN ] NNY: Generated 1326 derivative records from 4225 primary records. [2025-09-15T21:19:03.954517] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-15T21:19:03.967208] [DEBUG] [LOCAL ] NNY: Derivative data saved (1326 records). [2025-09-15T21:19:03.967294] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-15T21:19:03.969503] [INFO ] [MAIN ] Derivative Progress: 1304/2083 symbols completed. NNY took 0.8s. Estimated remaining: 4m 18s. Rate: 181.0 symbols/min [2025-09-15T21:19:03.982387] [DEBUG] [MAIN ] NNN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:03.983064] [INFO ] [MAIN ] NNN: Generated 1326 derivative records from 35485 primary records. [2025-09-15T21:19:03.983129] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-15T21:19:03.995187] [DEBUG] [LOCAL ] NNN: Derivative data saved (1326 records). [2025-09-15T21:19:03.995246] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-15T21:19:03.997447] [INFO ] [MAIN ] Derivative Progress: 1305/2083 symbols completed. NNN took 0.9s. Estimated remaining: 4m 18s. Rate: 181.1 symbols/min [2025-09-15T21:19:03.997993] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:03.998259] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:03.998313] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:04.018283] [DEBUG] [LOCAL ] NOA: Loaded 11300 existing records from primary storage. [2025-09-15T21:19:04.018515] [INFO ] [MAIN ] NOA: Loaded 11300 primary data records. [2025-09-15T21:19:04.106928] [DEBUG] [LOCAL ] NOAH: Loaded 14278 existing records from primary storage. [2025-09-15T21:19:04.137909] [INFO ] [MAIN ] NOAH: Loaded 14278 primary data records. [2025-09-15T21:19:04.339417] [DEBUG] [LOCAL ] NOC: Loaded 31028 existing records from primary storage. [2025-09-15T21:19:04.345118] [INFO ] [MAIN ] NOC: Loaded 31028 primary data records. [2025-09-15T21:19:04.886511] [DEBUG] [MAIN ] NOA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:04.888625] [INFO ] [MAIN ] NOA: Generated 1326 derivative records from 11300 primary records. [2025-09-15T21:19:04.889460] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-15T21:19:04.905682] [DEBUG] [LOCAL ] NOA: Derivative data saved (1326 records). [2025-09-15T21:19:04.914781] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-15T21:19:04.917720] [DEBUG] [MAIN ] NOAH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:04.917407] [INFO ] [MAIN ] Derivative Progress: 1306/2083 symbols completed. NOA took 0.9s. Estimated remaining: 4m 18s. Rate: 180.9 symbols/min [2025-09-15T21:19:04.919154] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:04.918630] [INFO ] [MAIN ] NOAH: Generated 1326 derivative records from 14278 primary records. [2025-09-15T21:19:04.919906] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-15T21:19:04.935463] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1326 records). [2025-09-15T21:19:04.936985] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-15T21:19:04.939315] [INFO ] [MAIN ] Derivative Progress: 1307/2083 symbols completed. NOAH took 0.9s. Estimated remaining: 4m 17s. Rate: 181.0 symbols/min [2025-09-15T21:19:04.939617] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:04.951631] [DEBUG] [MAIN ] NOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:04.952553] [INFO ] [MAIN ] NOC: Generated 1326 derivative records from 31028 primary records. [2025-09-15T21:19:04.952781] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-15T21:19:04.967264] [DEBUG] [LOCAL ] NOC: Derivative data saved (1326 records). [2025-09-15T21:19:04.967448] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-15T21:19:04.969665] [INFO ] [MAIN ] Derivative Progress: 1308/2083 symbols completed. NOC took 1.0s. Estimated remaining: 4m 17s. Rate: 181.2 symbols/min [2025-09-15T21:19:04.978335] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:04.995617] [DEBUG] [LOCAL ] NOG: Loaded 37625 existing records from primary storage. [2025-09-15T21:19:04.995794] [INFO ] [MAIN ] NOG: Loaded 37625 primary data records. [2025-09-15T21:19:05.216525] [DEBUG] [LOCAL ] NOMD: Loaded 30839 existing records from primary storage. [2025-09-15T21:19:05.317565] [INFO ] [MAIN ] NOMD: Loaded 30839 primary data records. [2025-09-15T21:19:05.318355] [DEBUG] [LOCAL ] NOK: Loaded 39582 existing records from primary storage. [2025-09-15T21:19:05.339195] [INFO ] [MAIN ] NOK: Loaded 39582 primary data records. [2025-09-15T21:19:05.929224] [DEBUG] [MAIN ] NOG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:05.930411] [INFO ] [MAIN ] NOG: Generated 1326 derivative records from 37625 primary records. [2025-09-15T21:19:05.930623] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-15T21:19:05.945082] [DEBUG] [LOCAL ] NOG: Derivative data saved (1326 records). [2025-09-15T21:19:05.945878] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-15T21:19:05.948413] [INFO ] [MAIN ] Derivative Progress: 1309/2083 symbols completed. NOG took 1.0s. Estimated remaining: 4m 17s. Rate: 180.9 symbols/min [2025-09-15T21:19:05.948868] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:05.963571] [DEBUG] [MAIN ] NOMD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:05.964608] [INFO ] [MAIN ] NOMD: Generated 1326 derivative records from 30839 primary records. [2025-09-15T21:19:05.964907] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-15T21:19:05.991764] [DEBUG] [MAIN ] NOK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:05.993029] [INFO ] [MAIN ] NOK: Generated 1326 derivative records from 39582 primary records. [2025-09-15T21:19:05.993404] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-15T21:19:06.013140] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1326 records). [2025-09-15T21:19:06.014390] [DEBUG] [LOCAL ] NOK: Derivative data saved (1326 records). [2025-09-15T21:19:06.014538] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-15T21:19:06.015190] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-15T21:19:06.016992] [INFO ] [MAIN ] Derivative Progress: 1310/2083 symbols completed. NOMD took 1.0s. Estimated remaining: 4m 16s. Rate: 181.0 symbols/min [2025-09-15T21:19:06.017366] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:06.020438] [INFO ] [MAIN ] Derivative Progress: 1311/2083 symbols completed. NOK took 1.1s. Estimated remaining: 4m 16s. Rate: 181.1 symbols/min [2025-09-15T21:19:06.031804] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:06.032869] [DEBUG] [LOCAL ] NOTE: Loaded 32429 existing records from primary storage. [2025-09-15T21:19:06.033285] [INFO ] [MAIN ] NOTE: Loaded 32429 primary data records. [2025-09-15T21:19:06.344868] [DEBUG] [LOCAL ] NOW: Loaded 35412 existing records from primary storage. [2025-09-15T21:19:06.345233] [INFO ] [MAIN ] NOW: Loaded 35412 primary data records. [2025-09-15T21:19:06.466958] [DEBUG] [LOCAL ] NOV: Loaded 39200 existing records from primary storage. [2025-09-15T21:19:06.524968] [INFO ] [MAIN ] NOV: Loaded 39200 primary data records. [2025-09-15T21:19:06.841714] [DEBUG] [MAIN ] NOTE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:06.940326] [INFO ] [MAIN ] NOTE: Generated 1326 derivative records from 32429 primary records. [2025-09-15T21:19:06.941079] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-15T21:19:06.953495] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1326 records). [2025-09-15T21:19:06.953819] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-15T21:19:06.956245] [INFO ] [MAIN ] Derivative Progress: 1312/2083 symbols completed. NOTE took 1.0s. Estimated remaining: 4m 16s. Rate: 180.9 symbols/min [2025-09-15T21:19:06.957125] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:06.973498] [DEBUG] [MAIN ] NOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:06.974549] [INFO ] [MAIN ] NOW: Generated 1326 derivative records from 35412 primary records. [2025-09-15T21:19:06.974795] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-15T21:19:06.992379] [DEBUG] [LOCAL ] NOW: Derivative data saved (1326 records). [2025-09-15T21:19:06.998807] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-15T21:19:06.999179] [DEBUG] [LOCAL ] NPCT: Loaded 12728 existing records from primary storage. [2025-09-15T21:19:07.001051] [INFO ] [MAIN ] Derivative Progress: 1313/2083 symbols completed. NOW took 1.0s. Estimated remaining: 4m 15s. Rate: 181.0 symbols/min [2025-09-15T21:19:07.001178] [INFO ] [MAIN ] NPCT: Loaded 12728 primary data records. [2025-09-15T21:19:07.001377] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:07.088629] [DEBUG] [MAIN ] NOV: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:19:07.121519] [INFO ] [MAIN ] NOV: Generated 1325 derivative records from 39200 primary records. [2025-09-15T21:19:07.129803] [DEBUG] [LOCAL ] NPFD: Loaded 6724 existing records from primary storage. [2025-09-15T21:19:07.133557] [INFO ] [MAIN ] NPFD: Loaded 6724 primary data records. [2025-09-15T21:19:07.133670] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-15T21:19:07.204964] [DEBUG] [LOCAL ] NOV: Derivative data saved (1325 records). [2025-09-15T21:19:07.256894] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-15T21:19:07.259069] [INFO ] [MAIN ] Derivative Progress: 1314/2083 symbols completed. NOV took 1.2s. Estimated remaining: 4m 15s. Rate: 181.0 symbols/min [2025-09-15T21:19:07.306352] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:07.505130] [DEBUG] [LOCAL ] NPK: Loaded 6354 existing records from primary storage. [2025-09-15T21:19:07.592336] [INFO ] [MAIN ] NPK: Loaded 6354 primary data records. [2025-09-15T21:19:07.929351] [DEBUG] [MAIN ] NPCT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:07.930750] [INFO ] [MAIN ] NPCT: Generated 1326 derivative records from 12728 primary records. [2025-09-15T21:19:07.930958] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-15T21:19:07.946323] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1326 records). [2025-09-15T21:19:07.952705] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-15T21:19:07.958013] [INFO ] [MAIN ] Derivative Progress: 1315/2083 symbols completed. NPCT took 1.0s. Estimated remaining: 4m 15s. Rate: 180.9 symbols/min [2025-09-15T21:19:07.958392] [DEBUG] [MAIN ] NPFD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:07.958667] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:07.959590] [INFO ] [MAIN ] NPFD: Generated 1326 derivative records from 6724 primary records. [2025-09-15T21:19:07.959952] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-15T21:19:07.974292] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1326 records). [2025-09-15T21:19:07.974424] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-15T21:19:07.976558] [INFO ] [MAIN ] Derivative Progress: 1316/2083 symbols completed. NPFD took 1.0s. Estimated remaining: 4m 14s. Rate: 181.0 symbols/min [2025-09-15T21:19:07.977127] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:07.992467] [DEBUG] [MAIN ] NPK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:08.001023] [INFO ] [MAIN ] NPK: Generated 1326 derivative records from 6354 primary records. [2025-09-15T21:19:08.001220] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-15T21:19:08.019257] [DEBUG] [LOCAL ] NPK: Derivative data saved (1326 records). [2025-09-15T21:19:08.019983] [DEBUG] [LOCAL ] NPO: Loaded 9291 existing records from primary storage. [2025-09-15T21:19:08.020343] [INFO ] [MAIN ] NPO: Loaded 9291 primary data records. [2025-09-15T21:19:08.020271] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-15T21:19:08.031576] [INFO ] [MAIN ] Derivative Progress: 1317/2083 symbols completed. NPK took 0.8s. Estimated remaining: 4m 14s. Rate: 181.1 symbols/min [2025-09-15T21:19:08.037093] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:08.037859] [DEBUG] [LOCAL ] NPKI: Loaded 30274 existing records from primary storage. [2025-09-15T21:19:08.064243] [INFO ] [MAIN ] NPKI: Loaded 30274 primary data records. [2025-09-15T21:19:08.235732] [DEBUG] [LOCAL ] NPV: Loaded 3779 existing records from primary storage. [2025-09-15T21:19:08.248118] [INFO ] [MAIN ] NPV: Loaded 3779 primary data records. [2025-09-15T21:19:08.876922] [DEBUG] [MAIN ] NPO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:08.889785] [DEBUG] [MAIN ] NPKI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:08.889437] [INFO ] [MAIN ] NPO: Generated 1326 derivative records from 9291 primary records. [2025-09-15T21:19:08.890548] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-15T21:19:08.891299] [INFO ] [MAIN ] NPKI: Generated 1326 derivative records from 30274 primary records. [2025-09-15T21:19:08.892069] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-09-15T21:19:08.915139] [DEBUG] [MAIN ] NPV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:08.921681] [INFO ] [MAIN ] NPV: Generated 1326 derivative records from 3779 primary records. [2025-09-15T21:19:08.921772] [DEBUG] [LOCAL ] NPKI: Derivative data saved (1326 records). [2025-09-15T21:19:08.923865] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-15T21:19:08.924866] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-09-15T21:19:08.927084] [DEBUG] [LOCAL ] NPO: Derivative data saved (1326 records). [2025-09-15T21:19:08.929845] [INFO ] [MAIN ] Derivative Progress: 1318/2083 symbols completed. NPKI took 1.0s. Estimated remaining: 4m 14s. Rate: 180.9 symbols/min [2025-09-15T21:19:08.927385] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-15T21:19:08.936776] [INFO ] [MAIN ] Derivative Progress: 1319/2083 symbols completed. NPO took 1.0s. Estimated remaining: 4m 13s. Rate: 181.0 symbols/min [2025-09-15T21:19:08.941977] [DEBUG] [LOCAL ] NPV: Derivative data saved (1326 records). [2025-09-15T21:19:08.942037] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-15T21:19:08.944053] [INFO ] [MAIN ] Derivative Progress: 1320/2083 symbols completed. NPV took 0.9s. Estimated remaining: 4m 13s. Rate: 181.2 symbols/min [2025-09-15T21:19:08.944761] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:08.944718] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:08.945362] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:08.955039] [DEBUG] [LOCAL ] NQP: Loaded 6678 existing records from primary storage. [2025-09-15T21:19:08.955210] [INFO ] [MAIN ] NQP: Loaded 6678 primary data records. [2025-09-15T21:19:09.244628] [DEBUG] [LOCAL ] NRDY: Loaded 23866 existing records from primary storage. [2025-09-15T21:19:09.244549] [DEBUG] [LOCAL ] NPWR: Loaded 31832 existing records from primary storage. [2025-09-15T21:19:09.255404] [INFO ] [MAIN ] NRDY: Loaded 23866 primary data records. [2025-09-15T21:19:09.255471] [INFO ] [MAIN ] NPWR: Loaded 31832 primary data records. [2025-09-15T21:19:09.802372] [DEBUG] [MAIN ] NQP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:09.803243] [INFO ] [MAIN ] NQP: Generated 1326 derivative records from 6678 primary records. [2025-09-15T21:19:09.804155] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-15T21:19:09.816947] [DEBUG] [LOCAL ] NQP: Derivative data saved (1326 records). [2025-09-15T21:19:09.817157] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-15T21:19:09.819226] [INFO ] [MAIN ] Derivative Progress: 1321/2083 symbols completed. NQP took 0.9s. Estimated remaining: 4m 13s. Rate: 180.9 symbols/min [2025-09-15T21:19:09.819796] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:09.835765] [DEBUG] [MAIN ] NRDY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:09.839769] [DEBUG] [LOCAL ] NREF: Loaded 5557 existing records from primary storage. [2025-09-15T21:19:09.840361] [INFO ] [MAIN ] NRDY: Generated 1326 derivative records from 23866 primary records. [2025-09-15T21:19:09.840425] [INFO ] [MAIN ] NREF: Loaded 5557 primary data records. [2025-09-15T21:19:09.840615] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-15T21:19:09.903587] [DEBUG] [MAIN ] NPWR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:09.935331] [INFO ] [MAIN ] NPWR: Generated 1326 derivative records from 31832 primary records. [2025-09-15T21:19:09.946539] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-15T21:19:09.960347] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1326 records). [2025-09-15T21:19:09.968533] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-15T21:19:09.991309] [INFO ] [MAIN ] Derivative Progress: 1322/2083 symbols completed. NRDY took 1.0s. Estimated remaining: 4m 12s. Rate: 181.0 symbols/min [2025-09-15T21:19:09.993857] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:10.000357] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1326 records). [2025-09-15T21:19:10.010708] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-15T21:19:10.037750] [INFO ] [MAIN ] Derivative Progress: 1323/2083 symbols completed. NPWR took 1.1s. Estimated remaining: 4m 12s. Rate: 181.1 symbols/min [2025-09-15T21:19:10.073031] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:10.226718] [DEBUG] [MAIN ] NREF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:10.236664] [INFO ] [MAIN ] NREF: Generated 1326 derivative records from 5557 primary records. [2025-09-15T21:19:10.236801] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-15T21:19:10.237984] [DEBUG] [LOCAL ] NRGV: Loaded 30946 existing records from primary storage. [2025-09-15T21:19:10.238357] [INFO ] [MAIN ] NRGV: Loaded 30946 primary data records. [2025-09-15T21:19:10.280967] [DEBUG] [LOCAL ] NREF: Derivative data saved (1326 records). [2025-09-15T21:19:10.329473] [DEBUG] [LOCAL ] NRG: Loaded 39072 existing records from primary storage. [2025-09-15T21:19:10.336210] [INFO ] [MAIN ] NRG: Loaded 39072 primary data records. [2025-09-15T21:19:10.336134] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-15T21:19:10.348467] [INFO ] [MAIN ] Derivative Progress: 1324/2083 symbols completed. NREF took 0.5s. Estimated remaining: 4m 11s. Rate: 181.1 symbols/min [2025-09-15T21:19:10.376126] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:10.721336] [DEBUG] [LOCAL ] NRK: Loaded 14847 existing records from primary storage. [2025-09-15T21:19:10.805983] [INFO ] [MAIN ] NRK: Loaded 14847 primary data records. [2025-09-15T21:19:11.102573] [DEBUG] [MAIN ] NRGV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:11.104789] [INFO ] [MAIN ] NRGV: Generated 1326 derivative records from 30946 primary records. [2025-09-15T21:19:11.104935] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-15T21:19:11.126087] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1326 records). [2025-09-15T21:19:11.131003] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-15T21:19:11.133117] [INFO ] [MAIN ] Derivative Progress: 1325/2083 symbols completed. NRGV took 1.1s. Estimated remaining: 4m 11s. Rate: 180.9 symbols/min [2025-09-15T21:19:11.130934] [DEBUG] [MAIN ] NRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:11.133551] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:11.134329] [INFO ] [MAIN ] NRG: Generated 1326 derivative records from 39072 primary records. [2025-09-15T21:19:11.134749] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-15T21:19:11.152039] [DEBUG] [LOCAL ] NRP: Loaded 2777 existing records from primary storage. [2025-09-15T21:19:11.152521] [INFO ] [MAIN ] NRP: Loaded 2777 primary data records. [2025-09-15T21:19:11.226662] [DEBUG] [MAIN ] NRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:11.239006] [INFO ] [MAIN ] NRK: Generated 1326 derivative records from 14847 primary records. [2025-09-15T21:19:11.239098] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-15T21:19:11.238322] [DEBUG] [LOCAL ] NRG: Derivative data saved (1326 records). [2025-09-15T21:19:11.262508] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-15T21:19:11.267435] [INFO ] [MAIN ] Derivative Progress: 1326/2083 symbols completed. NRG took 1.3s. Estimated remaining: 4m 11s. Rate: 181.0 symbols/min [2025-09-15T21:19:11.273300] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:11.338719] [DEBUG] [LOCAL ] NRK: Derivative data saved (1326 records). [2025-09-15T21:19:11.358558] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-15T21:19:11.432806] [INFO ] [MAIN ] Derivative Progress: 1327/2083 symbols completed. NRK took 1.1s. Estimated remaining: 4m 10s. Rate: 181.1 symbols/min [2025-09-15T21:19:11.445962] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:11.446334] [DEBUG] [LOCAL ] NRT: Loaded 3659 existing records from primary storage. [2025-09-15T21:19:11.446940] [INFO ] [MAIN ] NRT: Loaded 3659 primary data records. [2025-09-15T21:19:11.501251] [DEBUG] [LOCAL ] NRUC: Loaded 2214 existing records from primary storage. [2025-09-15T21:19:11.509467] [INFO ] [MAIN ] NRUC: Loaded 2214 primary data records. [2025-09-15T21:19:12.016039] [DEBUG] [MAIN ] NRP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:12.017378] [INFO ] [MAIN ] NRP: Generated 1326 derivative records from 2777 primary records. [2025-09-15T21:19:12.017941] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-15T21:19:12.033367] [DEBUG] [LOCAL ] NRP: Derivative data saved (1326 records). [2025-09-15T21:19:12.034224] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-15T21:19:12.036308] [INFO ] [MAIN ] Derivative Progress: 1328/2083 symbols completed. NRP took 0.9s. Estimated remaining: 4m 10s. Rate: 181.0 symbols/min [2025-09-15T21:19:12.037260] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:12.067897] [DEBUG] [MAIN ] NRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:12.068234] [DEBUG] [MAIN ] NRUC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:12.069370] [INFO ] [MAIN ] NRT: Generated 1326 derivative records from 3659 primary records. [2025-09-15T21:19:12.070134] [INFO ] [MAIN ] NRUC: Generated 1326 derivative records from 2214 primary records. [2025-09-15T21:19:12.070434] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-15T21:19:12.070343] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-15T21:19:12.093056] [DEBUG] [LOCAL ] NRT: Derivative data saved (1326 records). [2025-09-15T21:19:12.102015] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-15T21:19:12.104201] [INFO ] [MAIN ] Derivative Progress: 1329/2083 symbols completed. NRT took 0.8s. Estimated remaining: 4m 10s. Rate: 181.1 symbols/min [2025-09-15T21:19:12.105068] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:12.105998] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1326 records). [2025-09-15T21:19:12.106081] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-15T21:19:12.108276] [INFO ] [MAIN ] Derivative Progress: 1330/2083 symbols completed. NRUC took 0.7s. Estimated remaining: 4m 9s. Rate: 181.2 symbols/min [2025-09-15T21:19:12.109743] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:12.123366] [DEBUG] [LOCAL ] NSA: Loaded 33417 existing records from primary storage. [2025-09-15T21:19:12.123550] [INFO ] [MAIN ] NSA: Loaded 33417 primary data records. [2025-09-15T21:19:12.291110] [DEBUG] [LOCAL ] NSP: Loaded 26270 existing records from primary storage. [2025-09-15T21:19:12.339506] [INFO ] [MAIN ] NSP: Loaded 26270 primary data records. [2025-09-15T21:19:12.398591] [DEBUG] [LOCAL ] NSC: Loaded 36140 existing records from primary storage. [2025-09-15T21:19:12.432370] [INFO ] [MAIN ] NSC: Loaded 36140 primary data records. [2025-09-15T21:19:13.040670] [DEBUG] [MAIN ] NSA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:13.043212] [INFO ] [MAIN ] NSA: Generated 1326 derivative records from 33417 primary records. [2025-09-15T21:19:13.043768] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-15T21:19:13.054839] [DEBUG] [MAIN ] NSP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:13.064192] [INFO ] [MAIN ] NSP: Generated 1326 derivative records from 26270 primary records. [2025-09-15T21:19:13.066675] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-15T21:19:13.067502] [DEBUG] [LOCAL ] NSA: Derivative data saved (1326 records). [2025-09-15T21:19:13.068345] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-15T21:19:13.070460] [INFO ] [MAIN ] Derivative Progress: 1331/2083 symbols completed. NSA took 1.0s. Estimated remaining: 4m 9s. Rate: 181.0 symbols/min [2025-09-15T21:19:13.077207] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:13.085858] [DEBUG] [LOCAL ] NSP: Derivative data saved (1326 records). [2025-09-15T21:19:13.095451] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-15T21:19:13.097764] [INFO ] [MAIN ] Derivative Progress: 1332/2083 symbols completed. NSP took 1.0s. Estimated remaining: 4m 9s. Rate: 181.1 symbols/min [2025-09-15T21:19:13.095807] [DEBUG] [MAIN ] NSC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:13.098017] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:13.098882] [INFO ] [MAIN ] NSC: Generated 1326 derivative records from 36140 primary records. [2025-09-15T21:19:13.098982] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-15T21:19:13.123335] [DEBUG] [LOCAL ] NTB: Loaded 14614 existing records from primary storage. [2025-09-15T21:19:13.123872] [DEBUG] [LOCAL ] NSC: Derivative data saved (1326 records). [2025-09-15T21:19:13.124044] [INFO ] [MAIN ] NTB: Loaded 14614 primary data records. [2025-09-15T21:19:13.124140] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-15T21:19:13.126164] [INFO ] [MAIN ] Derivative Progress: 1333/2083 symbols completed. NSC took 1.0s. Estimated remaining: 4m 8s. Rate: 181.2 symbols/min [2025-09-15T21:19:13.401018] [DEBUG] [LOCAL ] NTR: Loaded 38745 existing records from primary storage. [2025-09-15T21:19:13.411377] [INFO ] [MAIN ] NTR: Loaded 38745 primary data records. [2025-09-15T21:19:13.695307] [DEBUG] [MAIN ] NTB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:13.696135] [INFO ] [MAIN ] NTB: Generated 1326 derivative records from 14614 primary records. [2025-09-15T21:19:13.697182] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-15T21:19:13.709492] [DEBUG] [LOCAL ] NTB: Derivative data saved (1326 records). [2025-09-15T21:19:13.709580] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-15T21:19:13.711338] [INFO ] [MAIN ] Derivative Progress: 1334/2083 symbols completed. NTB took 0.6s. Estimated remaining: 4m 8s. Rate: 181.1 symbols/min [2025-09-15T21:19:13.724183] [DEBUG] [MAIN ] NTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:13.724862] [INFO ] [MAIN ] NTR: Generated 1326 derivative records from 38745 primary records. [2025-09-15T21:19:13.724942] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-15T21:19:13.736705] [DEBUG] [LOCAL ] NTR: Derivative data saved (1326 records). [2025-09-15T21:19:13.736792] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-15T21:19:13.738446] [INFO ] [MAIN ] Derivative Progress: 1335/2083 symbols completed. NTR took 0.6s. Estimated remaining: 4m 8s. Rate: 181.2 symbols/min [2025-09-15T21:19:13.739375] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:13.739556] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:13.739477] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:13.769955] [DEBUG] [LOCAL ] NUS: Loaded 26383 existing records from primary storage. [2025-09-15T21:19:13.770317] [INFO ] [MAIN ] NUS: Loaded 26383 primary data records. [2025-09-15T21:19:13.933269] [DEBUG] [LOCAL ] NTST: Loaded 31978 existing records from primary storage. [2025-09-15T21:19:13.944776] [INFO ] [MAIN ] NTST: Loaded 31978 primary data records. [2025-09-15T21:19:13.972277] [DEBUG] [LOCAL ] NU: Loaded 39706 existing records from primary storage. [2025-09-15T21:19:13.996962] [INFO ] [MAIN ] NU: Loaded 39706 primary data records. [2025-09-15T21:19:14.709394] [DEBUG] [MAIN ] NUS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:14.710836] [INFO ] [MAIN ] NUS: Generated 1326 derivative records from 26383 primary records. [2025-09-15T21:19:14.711038] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-15T21:19:14.726554] [DEBUG] [LOCAL ] NUS: Derivative data saved (1326 records). [2025-09-15T21:19:14.736636] [DEBUG] [MAIN ] NTST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:14.736746] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-15T21:19:14.739343] [INFO ] [MAIN ] NTST: Generated 1326 derivative records from 31978 primary records. [2025-09-15T21:19:14.738537] [INFO ] [MAIN ] Derivative Progress: 1336/2083 symbols completed. NUS took 1.0s. Estimated remaining: 4m 8s. Rate: 181.0 symbols/min [2025-09-15T21:19:14.740171] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-15T21:19:14.740394] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:14.764446] [DEBUG] [LOCAL ] NTST: Derivative data saved (1326 records). [2025-09-15T21:19:14.764919] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-15T21:19:14.766870] [INFO ] [MAIN ] Derivative Progress: 1337/2083 symbols completed. NTST took 1.0s. Estimated remaining: 4m 7s. Rate: 181.1 symbols/min [2025-09-15T21:19:14.767177] [DEBUG] [MAIN ] NU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:14.768304] [INFO ] [MAIN ] NU: Generated 1326 derivative records from 39706 primary records. [2025-09-15T21:19:14.767494] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:14.768441] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-15T21:19:14.785979] [DEBUG] [LOCAL ] NU: Derivative data saved (1326 records). [2025-09-15T21:19:14.786271] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-15T21:19:14.788202] [INFO ] [MAIN ] Derivative Progress: 1338/2083 symbols completed. NU took 1.0s. Estimated remaining: 4m 7s. Rate: 181.2 symbols/min [2025-09-15T21:19:14.794959] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:14.795958] [DEBUG] [LOCAL ] NUV: Loaded 16294 existing records from primary storage. [2025-09-15T21:19:14.796134] [INFO ] [MAIN ] NUV: Loaded 16294 primary data records. [2025-09-15T21:19:14.894034] [DEBUG] [LOCAL ] NUW: Loaded 5084 existing records from primary storage. [2025-09-15T21:19:14.913736] [INFO ] [MAIN ] NUW: Loaded 5084 primary data records. [2025-09-15T21:19:15.212673] [DEBUG] [LOCAL ] NUVB: Loaded 38079 existing records from primary storage. [2025-09-15T21:19:15.238121] [INFO ] [MAIN ] NUVB: Loaded 38079 primary data records. [2025-09-15T21:19:15.709782] [DEBUG] [MAIN ] NUV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:15.710582] [INFO ] [MAIN ] NUV: Generated 1326 derivative records from 16294 primary records. [2025-09-15T21:19:15.710883] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-15T21:19:15.726088] [DEBUG] [LOCAL ] NUV: Derivative data saved (1326 records). [2025-09-15T21:19:15.727119] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-15T21:19:15.738812] [INFO ] [MAIN ] Derivative Progress: 1339/2083 symbols completed. NUV took 1.0s. Estimated remaining: 4m 7s. Rate: 180.9 symbols/min [2025-09-15T21:19:15.739815] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:15.740153] [DEBUG] [MAIN ] NUW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:15.740967] [INFO ] [MAIN ] NUW: Generated 1326 derivative records from 5084 primary records. [2025-09-15T21:19:15.741148] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-15T21:19:15.760124] [DEBUG] [MAIN ] NUVB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:15.763679] [INFO ] [MAIN ] NUVB: Generated 1326 derivative records from 38079 primary records. [2025-09-15T21:19:15.763010] [DEBUG] [LOCAL ] NUW: Derivative data saved (1326 records). [2025-09-15T21:19:15.763873] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-15T21:19:15.765939] [INFO ] [MAIN ] Derivative Progress: 1340/2083 symbols completed. NUW took 1.0s. Estimated remaining: 4m 6s. Rate: 181.1 symbols/min [2025-09-15T21:19:15.766119] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-15T21:19:15.766958] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:15.784059] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1326 records). [2025-09-15T21:19:15.784253] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-15T21:19:15.786287] [INFO ] [MAIN ] Derivative Progress: 1341/2083 symbols completed. NUVB took 1.0s. Estimated remaining: 4m 6s. Rate: 181.2 symbols/min [2025-09-15T21:19:15.786519] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:15.795828] [DEBUG] [LOCAL ] NVG: Loaded 19940 existing records from primary storage. [2025-09-15T21:19:15.796027] [INFO ] [MAIN ] NVG: Loaded 19940 primary data records. [2025-09-15T21:19:15.981636] [DEBUG] [LOCAL ] NVGS: Loaded 23312 existing records from primary storage. [2025-09-15T21:19:16.000494] [INFO ] [MAIN ] NVGS: Loaded 23312 primary data records. [2025-09-15T21:19:16.164697] [DEBUG] [LOCAL ] NVO: Loaded 39744 existing records from primary storage. [2025-09-15T21:19:16.182186] [INFO ] [MAIN ] NVO: Loaded 39744 primary data records. [2025-09-15T21:19:16.642340] [DEBUG] [MAIN ] NVG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:16.643500] [INFO ] [MAIN ] NVG: Generated 1326 derivative records from 19940 primary records. [2025-09-15T21:19:16.643994] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-15T21:19:16.659655] [DEBUG] [LOCAL ] NVG: Derivative data saved (1326 records). [2025-09-15T21:19:16.660554] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-15T21:19:16.662777] [INFO ] [MAIN ] Derivative Progress: 1342/2083 symbols completed. NVG took 0.9s. Estimated remaining: 4m 6s. Rate: 181.0 symbols/min [2025-09-15T21:19:16.663331] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:16.674435] [DEBUG] [MAIN ] NVGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:16.675132] [INFO ] [MAIN ] NVGS: Generated 1326 derivative records from 23312 primary records. [2025-09-15T21:19:16.675398] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-15T21:19:16.692748] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1326 records). [2025-09-15T21:19:16.693459] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-15T21:19:16.695084] [INFO ] [MAIN ] Derivative Progress: 1343/2083 symbols completed. NVGS took 0.9s. Estimated remaining: 4m 5s. Rate: 181.1 symbols/min [2025-09-15T21:19:16.701195] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:16.705131] [DEBUG] [MAIN ] NVO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:16.711186] [DEBUG] [LOCAL ] NVR: Loaded 12975 existing records from primary storage. [2025-09-15T21:19:16.710829] [INFO ] [MAIN ] NVO: Generated 1326 derivative records from 39744 primary records. [2025-09-15T21:19:16.711299] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-15T21:19:16.711335] [INFO ] [MAIN ] NVR: Loaded 12975 primary data records. [2025-09-15T21:19:16.902159] [DEBUG] [LOCAL ] NVO: Derivative data saved (1326 records). [2025-09-15T21:19:16.903897] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-15T21:19:16.906187] [INFO ] [MAIN ] Derivative Progress: 1344/2083 symbols completed. NVO took 1.1s. Estimated remaining: 4m 5s. Rate: 181.1 symbols/min [2025-09-15T21:19:16.906405] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:17.030080] [DEBUG] [LOCAL ] NVRI: Loaded 28047 existing records from primary storage. [2025-09-15T21:19:17.030734] [INFO ] [MAIN ] NVRI: Loaded 28047 primary data records. [2025-09-15T21:19:17.346139] [DEBUG] [LOCAL ] NVS: Loaded 37898 existing records from primary storage. [2025-09-15T21:19:17.346367] [INFO ] [MAIN ] NVS: Loaded 37898 primary data records. [2025-09-15T21:19:17.481699] [DEBUG] [MAIN ] NVR: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:19:17.498606] [INFO ] [MAIN ] NVR: Generated 1325 derivative records from 12975 primary records. [2025-09-15T21:19:17.528334] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-15T21:19:17.647138] [DEBUG] [LOCAL ] NVR: Derivative data saved (1325 records). [2025-09-15T21:19:17.648378] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-15T21:19:17.650997] [INFO ] [MAIN ] Derivative Progress: 1345/2083 symbols completed. NVR took 1.0s. Estimated remaining: 4m 5s. Rate: 181.0 symbols/min [2025-09-15T21:19:17.651748] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:17.663175] [DEBUG] [MAIN ] NVRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:17.664767] [INFO ] [MAIN ] NVRI: Generated 1326 derivative records from 28047 primary records. [2025-09-15T21:19:17.665027] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-15T21:19:17.677236] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1326 records). [2025-09-15T21:19:17.677366] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-15T21:19:17.679052] [INFO ] [MAIN ] Derivative Progress: 1346/2083 symbols completed. NVRI took 1.0s. Estimated remaining: 4m 4s. Rate: 181.1 symbols/min [2025-09-15T21:19:17.679387] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:17.693396] [DEBUG] [MAIN ] NVS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:17.694081] [INFO ] [MAIN ] NVS: Generated 1326 derivative records from 37898 primary records. [2025-09-15T21:19:17.694164] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-15T21:19:17.718760] [DEBUG] [LOCAL ] NVS: Derivative data saved (1326 records). [2025-09-15T21:19:17.719036] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-15T21:19:17.721884] [INFO ] [MAIN ] Derivative Progress: 1347/2083 symbols completed. NVS took 0.8s. Estimated remaining: 4m 4s. Rate: 181.2 symbols/min [2025-09-15T21:19:17.722206] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:17.742977] [DEBUG] [LOCAL ] NVST: Loaded 37889 existing records from primary storage. [2025-09-15T21:19:17.743141] [INFO ] [MAIN ] NVST: Loaded 37889 primary data records. [2025-09-15T21:19:17.862027] [DEBUG] [LOCAL ] NVT: Loaded 37884 existing records from primary storage. [2025-09-15T21:19:17.881721] [INFO ] [MAIN ] NVT: Loaded 37884 primary data records. [2025-09-15T21:19:18.085330] [DEBUG] [LOCAL ] NWG: Loaded 38033 existing records from primary storage. [2025-09-15T21:19:18.217247] [INFO ] [MAIN ] NWG: Loaded 38033 primary data records. [2025-09-15T21:19:18.742155] [DEBUG] [MAIN ] NVST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:18.746044] [INFO ] [MAIN ] NVST: Generated 1326 derivative records from 37889 primary records. [2025-09-15T21:19:18.746898] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-15T21:19:18.771358] [DEBUG] [MAIN ] NVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:18.778044] [INFO ] [MAIN ] NVT: Generated 1326 derivative records from 37884 primary records. [2025-09-15T21:19:18.779829] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-15T21:19:18.782346] [DEBUG] [LOCAL ] NVST: Derivative data saved (1326 records). [2025-09-15T21:19:18.782745] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-15T21:19:18.796133] [INFO ] [MAIN ] Derivative Progress: 1348/2083 symbols completed. NVST took 1.1s. Estimated remaining: 4m 4s. Rate: 180.9 symbols/min [2025-09-15T21:19:18.801901] [DEBUG] [LOCAL ] NVT: Derivative data saved (1326 records). [2025-09-15T21:19:18.802091] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-15T21:19:18.804594] [INFO ] [MAIN ] Derivative Progress: 1349/2083 symbols completed. NVT took 1.1s. Estimated remaining: 4m 3s. Rate: 181.1 symbols/min [2025-09-15T21:19:18.818947] [DEBUG] [MAIN ] NWG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:18.819994] [INFO ] [MAIN ] NWG: Generated 1326 derivative records from 38033 primary records. [2025-09-15T21:19:18.820088] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-15T21:19:18.836892] [DEBUG] [LOCAL ] NWG: Derivative data saved (1326 records). [2025-09-15T21:19:18.837093] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-15T21:19:18.840156] [INFO ] [MAIN ] Derivative Progress: 1350/2083 symbols completed. NWG took 1.1s. Estimated remaining: 4m 3s. Rate: 181.2 symbols/min [2025-09-15T21:19:18.841384] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:18.841469] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:18.841295] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:18.854145] [DEBUG] [LOCAL ] NXC: Loaded 2940 existing records from primary storage. [2025-09-15T21:19:18.854794] [INFO ] [MAIN ] NXC: Loaded 2940 primary data records. [2025-09-15T21:19:19.003696] [DEBUG] [LOCAL ] NWN: Loaded 20122 existing records from primary storage. [2025-09-15T21:19:19.003954] [INFO ] [MAIN ] NWN: Loaded 20122 primary data records. [2025-09-15T21:19:19.155617] [DEBUG] [LOCAL ] NX: Loaded 24040 existing records from primary storage. [2025-09-15T21:19:19.240404] [INFO ] [MAIN ] NX: Loaded 24040 primary data records. [2025-09-15T21:19:20.044071] [DEBUG] [MAIN ] NXC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:20.045032] [INFO ] [MAIN ] NXC: Generated 1326 derivative records from 2940 primary records. [2025-09-15T21:19:20.045401] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-15T21:19:20.061547] [DEBUG] [LOCAL ] NXC: Derivative data saved (1326 records). [2025-09-15T21:19:20.061633] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-15T21:19:20.063155] [INFO ] [MAIN ] Derivative Progress: 1351/2083 symbols completed. NXC took 1.2s. Estimated remaining: 4m 3s. Rate: 180.8 symbols/min [2025-09-15T21:19:20.063776] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:20.075225] [DEBUG] [MAIN ] NWN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:20.076371] [INFO ] [MAIN ] NWN: Generated 1326 derivative records from 20122 primary records. [2025-09-15T21:19:20.076570] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-15T21:19:20.102278] [DEBUG] [MAIN ] NX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:20.104622] [INFO ] [MAIN ] NX: Generated 1326 derivative records from 24040 primary records. [2025-09-15T21:19:20.105360] [DEBUG] [LOCAL ] NWN: Derivative data saved (1326 records). [2025-09-15T21:19:20.105516] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-15T21:19:20.105585] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-15T21:19:20.108345] [INFO ] [MAIN ] Derivative Progress: 1352/2083 symbols completed. NWN took 1.3s. Estimated remaining: 4m 2s. Rate: 180.9 symbols/min [2025-09-15T21:19:20.113572] [DEBUG] [LOCAL ] NXDT: Loaded 10717 existing records from primary storage. [2025-09-15T21:19:20.113051] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:20.124176] [INFO ] [MAIN ] NXDT: Loaded 10717 primary data records. [2025-09-15T21:19:20.125407] [DEBUG] [LOCAL ] NX: Derivative data saved (1326 records). [2025-09-15T21:19:20.125553] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-15T21:19:20.139394] [INFO ] [MAIN ] Derivative Progress: 1353/2083 symbols completed. NX took 1.3s. Estimated remaining: 4m 2s. Rate: 181.0 symbols/min [2025-09-15T21:19:20.164611] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:20.408349] [DEBUG] [LOCAL ] NXG: Loaded 7370 existing records from primary storage. [2025-09-15T21:19:20.409692] [INFO ] [MAIN ] NXG: Loaded 7370 primary data records. [2025-09-15T21:19:20.507774] [DEBUG] [LOCAL ] NXE: Loaded 39107 existing records from primary storage. [2025-09-15T21:19:20.530201] [INFO ] [MAIN ] NXE: Loaded 39107 primary data records. [2025-09-15T21:19:20.982608] [DEBUG] [MAIN ] NXDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:20.984731] [INFO ] [MAIN ] NXDT: Generated 1326 derivative records from 10717 primary records. [2025-09-15T21:19:20.985009] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-15T21:19:21.000007] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1326 records). [2025-09-15T21:19:21.000530] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-15T21:19:21.002478] [INFO ] [MAIN ] Derivative Progress: 1354/2083 symbols completed. NXDT took 0.9s. Estimated remaining: 4m 2s. Rate: 180.8 symbols/min [2025-09-15T21:19:21.003373] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:21.029698] [DEBUG] [MAIN ] NXG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:21.031168] [INFO ] [MAIN ] NXG: Generated 1326 derivative records from 7370 primary records. [2025-09-15T21:19:21.036854] [DEBUG] [LOCAL ] NXJ: Loaded 11607 existing records from primary storage. [2025-09-15T21:19:21.036555] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-15T21:19:21.036986] [INFO ] [MAIN ] NXJ: Loaded 11607 primary data records. [2025-09-15T21:19:21.169379] [DEBUG] [LOCAL ] NXG: Derivative data saved (1326 records). [2025-09-15T21:19:21.184787] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-15T21:19:21.191768] [INFO ] [MAIN ] Derivative Progress: 1355/2083 symbols completed. NXG took 1.0s. Estimated remaining: 4m 1s. Rate: 180.9 symbols/min [2025-09-15T21:19:21.169098] [DEBUG] [MAIN ] NXE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:21.207864] [INFO ] [MAIN ] NXE: Generated 1326 derivative records from 39107 primary records. [2025-09-15T21:19:21.216293] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:21.246714] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-15T21:19:21.343939] [DEBUG] [LOCAL ] NXN: Loaded 1734 existing records from primary storage. [2025-09-15T21:19:21.346581] [INFO ] [MAIN ] NXN: Loaded 1734 primary data records. [2025-09-15T21:19:21.346940] [DEBUG] [LOCAL ] NXE: Derivative data saved (1326 records). [2025-09-15T21:19:21.384296] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-15T21:19:21.393468] [INFO ] [MAIN ] Derivative Progress: 1356/2083 symbols completed. NXE took 1.3s. Estimated remaining: 4m 1s. Rate: 180.9 symbols/min [2025-09-15T21:19:21.393724] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:21.516430] [DEBUG] [LOCAL ] NXP: Loaded 9046 existing records from primary storage. [2025-09-15T21:19:21.540399] [INFO ] [MAIN ] NXP: Loaded 9046 primary data records. [2025-09-15T21:19:21.780070] [DEBUG] [MAIN ] NXJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:21.796429] [INFO ] [MAIN ] NXJ: Generated 1326 derivative records from 11607 primary records. [2025-09-15T21:19:21.832345] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-15T21:19:21.997938] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1326 records). [2025-09-15T21:19:21.998682] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-15T21:19:22.000831] [INFO ] [MAIN ] Derivative Progress: 1357/2083 symbols completed. NXJ took 1.0s. Estimated remaining: 4m 1s. Rate: 180.8 symbols/min [2025-09-15T21:19:22.002238] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:22.015677] [DEBUG] [MAIN ] NXN: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:19:22.016379] [INFO ] [MAIN ] NXN: Generated 1325 derivative records from 1734 primary records. [2025-09-15T21:19:22.016552] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-15T21:19:22.028024] [DEBUG] [LOCAL ] NXN: Derivative data saved (1325 records). [2025-09-15T21:19:22.028319] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-15T21:19:22.030194] [INFO ] [MAIN ] Derivative Progress: 1358/2083 symbols completed. NXN took 0.8s. Estimated remaining: 4m 0s. Rate: 181.0 symbols/min [2025-09-15T21:19:22.030488] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:22.043248] [DEBUG] [LOCAL ] NXRT: Loaded 13545 existing records from primary storage. [2025-09-15T21:19:22.044006] [INFO ] [MAIN ] NXRT: Loaded 13545 primary data records. [2025-09-15T21:19:22.129690] [DEBUG] [MAIN ] NXP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:22.154716] [INFO ] [MAIN ] NXP: Generated 1326 derivative records from 9046 primary records. [2025-09-15T21:19:22.158089] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-15T21:19:22.235755] [DEBUG] [LOCAL ] NXP: Derivative data saved (1326 records). [2025-09-15T21:19:22.235913] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-15T21:19:22.238068] [INFO ] [MAIN ] Derivative Progress: 1359/2083 symbols completed. NXP took 0.8s. Estimated remaining: 3m 60s. Rate: 181.0 symbols/min [2025-09-15T21:19:22.255284] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:22.344165] [DEBUG] [LOCAL ] NYT: Loaded 36763 existing records from primary storage. [2025-09-15T21:19:22.354790] [INFO ] [MAIN ] NYT: Loaded 36763 primary data records. [2025-09-15T21:19:22.641478] [DEBUG] [LOCAL ] NZF: Loaded 21113 existing records from primary storage. [2025-09-15T21:19:22.642331] [INFO ] [MAIN ] NZF: Loaded 21113 primary data records. [2025-09-15T21:19:22.831772] [DEBUG] [MAIN ] NXRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:22.837958] [INFO ] [MAIN ] NXRT: Generated 1326 derivative records from 13545 primary records. [2025-09-15T21:19:22.922835] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-15T21:19:22.938775] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1326 records). [2025-09-15T21:19:22.939027] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-15T21:19:22.941058] [INFO ] [MAIN ] Derivative Progress: 1360/2083 symbols completed. NXRT took 0.9s. Estimated remaining: 3m 60s. Rate: 180.9 symbols/min [2025-09-15T21:19:22.942856] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:22.953332] [DEBUG] [MAIN ] NYT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:22.954186] [INFO ] [MAIN ] NYT: Generated 1326 derivative records from 36763 primary records. [2025-09-15T21:19:22.954298] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-15T21:19:22.968635] [DEBUG] [LOCAL ] NYT: Derivative data saved (1326 records). [2025-09-15T21:19:22.968825] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-15T21:19:22.970937] [INFO ] [MAIN ] Derivative Progress: 1361/2083 symbols completed. NYT took 0.9s. Estimated remaining: 3m 59s. Rate: 181.0 symbols/min [2025-09-15T21:19:22.973938] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:22.988359] [DEBUG] [MAIN ] NZF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:22.989138] [INFO ] [MAIN ] NZF: Generated 1326 derivative records from 21113 primary records. [2025-09-15T21:19:22.989309] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-15T21:19:23.013437] [DEBUG] [LOCAL ] NZF: Derivative data saved (1326 records). [2025-09-15T21:19:23.018475] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-15T21:19:23.020102] [INFO ] [MAIN ] Derivative Progress: 1362/2083 symbols completed. NZF took 0.8s. Estimated remaining: 3m 59s. Rate: 181.1 symbols/min [2025-09-15T21:19:23.018403] [DEBUG] [LOCAL ] OBK: Loaded 11716 existing records from primary storage. [2025-09-15T21:19:23.020388] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:23.020531] [INFO ] [MAIN ] OBK: Loaded 11716 primary data records. [2025-09-15T21:19:23.134467] [DEBUG] [LOCAL ] OBDC: Loaded 37788 existing records from primary storage. [2025-09-15T21:19:23.155883] [INFO ] [MAIN ] OBDC: Loaded 37788 primary data records. [2025-09-15T21:19:23.436056] [DEBUG] [LOCAL ] OC: Loaded 32462 existing records from primary storage. [2025-09-15T21:19:23.438724] [INFO ] [MAIN ] OC: Loaded 32462 primary data records. [2025-09-15T21:19:23.930969] [DEBUG] [MAIN ] OBK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:23.933008] [INFO ] [MAIN ] OBK: Generated 1326 derivative records from 11716 primary records. [2025-09-15T21:19:23.933721] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-15T21:19:23.949537] [DEBUG] [LOCAL ] OBK: Derivative data saved (1326 records). [2025-09-15T21:19:23.949717] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-15T21:19:23.952403] [INFO ] [MAIN ] Derivative Progress: 1363/2083 symbols completed. OBK took 1.0s. Estimated remaining: 3m 59s. Rate: 180.8 symbols/min [2025-09-15T21:19:23.966787] [DEBUG] [MAIN ] OBDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:23.968523] [INFO ] [MAIN ] OBDC: Generated 1326 derivative records from 37788 primary records. [2025-09-15T21:19:23.969084] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-15T21:19:23.984792] [DEBUG] [MAIN ] OC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:23.988606] [INFO ] [MAIN ] OC: Generated 1326 derivative records from 32462 primary records. [2025-09-15T21:19:23.989831] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-15T21:19:23.991958] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1326 records). [2025-09-15T21:19:23.992161] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-15T21:19:24.000495] [INFO ] [MAIN ] Derivative Progress: 1364/2083 symbols completed. OBDC took 1.1s. Estimated remaining: 3m 58s. Rate: 181.0 symbols/min [2025-09-15T21:19:24.005738] [DEBUG] [LOCAL ] OC: Derivative data saved (1326 records). [2025-09-15T21:19:24.005801] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-15T21:19:24.007434] [INFO ] [MAIN ] Derivative Progress: 1365/2083 symbols completed. OC took 1.0s. Estimated remaining: 3m 58s. Rate: 181.1 symbols/min [2025-09-15T21:19:24.008407] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:24.008319] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:24.008555] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:24.022279] [DEBUG] [LOCAL ] ODC: Loaded 6421 existing records from primary storage. [2025-09-15T21:19:24.025760] [INFO ] [MAIN ] ODC: Loaded 6421 primary data records. [2025-09-15T21:19:24.025956] [DEBUG] [LOCAL ] OCFT: Loaded 5759 existing records from primary storage. [2025-09-15T21:19:24.051344] [INFO ] [MAIN ] OCFT: Loaded 5759 primary data records. [2025-09-15T21:19:24.232093] [DEBUG] [LOCAL ] ODV: Loaded 19786 existing records from primary storage. [2025-09-15T21:19:24.265052] [INFO ] [MAIN ] ODV: Loaded 19786 primary data records. [2025-09-15T21:19:24.914159] [DEBUG] [MAIN ] OCFT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:24.916488] [INFO ] [MAIN ] OCFT: Generated 1326 derivative records from 5759 primary records. [2025-09-15T21:19:24.927881] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-15T21:19:24.927773] [DEBUG] [MAIN ] ODC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:24.934181] [INFO ] [MAIN ] ODC: Generated 1326 derivative records from 6421 primary records. [2025-09-15T21:19:24.938329] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-15T21:19:24.938830] [DEBUG] [MAIN ] ODV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:24.945902] [INFO ] [MAIN ] ODV: Generated 1326 derivative records from 19786 primary records. [2025-09-15T21:19:24.948909] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-15T21:19:24.957302] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1326 records). [2025-09-15T21:19:24.961310] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-15T21:19:24.978016] [DEBUG] [LOCAL ] ODV: Derivative data saved (1326 records). [2025-09-15T21:19:24.970519] [INFO ] [MAIN ] Derivative Progress: 1366/2083 symbols completed. OCFT took 1.0s. Estimated remaining: 3m 58s. Rate: 180.8 symbols/min [2025-09-15T21:19:24.978328] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-15T21:19:24.980176] [INFO ] [MAIN ] Derivative Progress: 1367/2083 symbols completed. ODV took 1.0s. Estimated remaining: 3m 57s. Rate: 181.0 symbols/min [2025-09-15T21:19:24.977900] [DEBUG] [LOCAL ] ODC: Derivative data saved (1326 records). [2025-09-15T21:19:24.980396] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-15T21:19:24.978282] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:24.984364] [INFO ] [MAIN ] Derivative Progress: 1368/2083 symbols completed. ODC took 1.0s. Estimated remaining: 3m 57s. Rate: 181.1 symbols/min [2025-09-15T21:19:24.984591] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:24.985004] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:25.006101] [DEBUG] [LOCAL ] OFG: Loaded 15190 existing records from primary storage. [2025-09-15T21:19:25.006286] [INFO ] [MAIN ] OFG: Loaded 15190 primary data records. [2025-09-15T21:19:25.206744] [DEBUG] [LOCAL ] OGE: Loaded 34067 existing records from primary storage. [2025-09-15T21:19:25.230538] [INFO ] [MAIN ] OGE: Loaded 34067 primary data records. [2025-09-15T21:19:25.235768] [DEBUG] [LOCAL ] OGN: Loaded 39217 existing records from primary storage. [2025-09-15T21:19:25.357547] [INFO ] [MAIN ] OGN: Loaded 39217 primary data records. [2025-09-15T21:19:25.895815] [DEBUG] [MAIN ] OFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:25.897310] [INFO ] [MAIN ] OFG: Generated 1326 derivative records from 15190 primary records. [2025-09-15T21:19:25.898046] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-15T21:19:25.912711] [DEBUG] [LOCAL ] OFG: Derivative data saved (1326 records). [2025-09-15T21:19:25.913042] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-15T21:19:25.914821] [INFO ] [MAIN ] Derivative Progress: 1369/2083 symbols completed. OFG took 0.9s. Estimated remaining: 3m 57s. Rate: 180.9 symbols/min [2025-09-15T21:19:25.916092] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:25.928457] [DEBUG] [MAIN ] OGE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:25.929208] [INFO ] [MAIN ] OGE: Generated 1326 derivative records from 34067 primary records. [2025-09-15T21:19:25.929354] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-15T21:19:25.949902] [DEBUG] [LOCAL ] OGE: Derivative data saved (1326 records). [2025-09-15T21:19:25.954414] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-15T21:19:25.954806] [DEBUG] [MAIN ] OGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:25.956872] [INFO ] [MAIN ] Derivative Progress: 1370/2083 symbols completed. OGE took 1.0s. Estimated remaining: 3m 56s. Rate: 181.0 symbols/min [2025-09-15T21:19:25.964148] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:25.965508] [INFO ] [MAIN ] OGN: Generated 1326 derivative records from 39217 primary records. [2025-09-15T21:19:25.965873] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-15T21:19:25.987817] [DEBUG] [LOCAL ] OGS: Loaded 25749 existing records from primary storage. [2025-09-15T21:19:25.988513] [INFO ] [MAIN ] OGS: Loaded 25749 primary data records. [2025-09-15T21:19:26.011094] [DEBUG] [LOCAL ] OGN: Derivative data saved (1326 records). [2025-09-15T21:19:26.034799] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-15T21:19:26.063817] [INFO ] [MAIN ] Derivative Progress: 1371/2083 symbols completed. OGN took 1.1s. Estimated remaining: 3m 56s. Rate: 181.1 symbols/min [2025-09-15T21:19:26.080470] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:26.198800] [DEBUG] [LOCAL ] OHI: Loaded 38444 existing records from primary storage. [2025-09-15T21:19:26.284802] [INFO ] [MAIN ] OHI: Loaded 38444 primary data records. [2025-09-15T21:19:26.471315] [DEBUG] [LOCAL ] OI: Loaded 34667 existing records from primary storage. [2025-09-15T21:19:26.496684] [INFO ] [MAIN ] OI: Loaded 34667 primary data records. [2025-09-15T21:19:26.906429] [DEBUG] [MAIN ] OGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:26.907372] [INFO ] [MAIN ] OGS: Generated 1326 derivative records from 25749 primary records. [2025-09-15T21:19:26.907974] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-15T21:19:26.923826] [DEBUG] [LOCAL ] OGS: Derivative data saved (1326 records). [2025-09-15T21:19:26.933412] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-15T21:19:26.936499] [INFO ] [MAIN ] Derivative Progress: 1372/2083 symbols completed. OGS took 1.0s. Estimated remaining: 3m 56s. Rate: 180.8 symbols/min [2025-09-15T21:19:26.936926] [DEBUG] [MAIN ] OHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:26.937276] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:26.938882] [INFO ] [MAIN ] OHI: Generated 1326 derivative records from 38444 primary records. [2025-09-15T21:19:26.939256] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-15T21:19:26.953097] [DEBUG] [LOCAL ] OHI: Derivative data saved (1326 records). [2025-09-15T21:19:26.955747] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-15T21:19:26.958540] [INFO ] [MAIN ] Derivative Progress: 1373/2083 symbols completed. OHI took 1.0s. Estimated remaining: 3m 55s. Rate: 181.0 symbols/min [2025-09-15T21:19:26.958890] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:26.965777] [DEBUG] [LOCAL ] OIA: Loaded 9824 existing records from primary storage. [2025-09-15T21:19:26.975354] [INFO ] [MAIN ] OIA: Loaded 9824 primary data records. [2025-09-15T21:19:26.975905] [DEBUG] [MAIN ] OI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:27.017226] [INFO ] [MAIN ] OI: Generated 1326 derivative records from 34667 primary records. [2025-09-15T21:19:27.038702] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-15T21:19:27.188903] [DEBUG] [LOCAL ] OI: Derivative data saved (1326 records). [2025-09-15T21:19:27.279819] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-15T21:19:27.294079] [DEBUG] [LOCAL ] OII: Loaded 31144 existing records from primary storage. [2025-09-15T21:19:27.293024] [INFO ] [MAIN ] Derivative Progress: 1374/2083 symbols completed. OI took 1.2s. Estimated remaining: 3m 55s. Rate: 181.0 symbols/min [2025-09-15T21:19:27.294513] [INFO ] [MAIN ] OII: Loaded 31144 primary data records. [2025-09-15T21:19:27.294456] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:27.497715] [DEBUG] [LOCAL ] OIS: Loaded 29521 existing records from primary storage. [2025-09-15T21:19:27.501452] [INFO ] [MAIN ] OIS: Loaded 29521 primary data records. [2025-09-15T21:19:27.792802] [DEBUG] [MAIN ] OIA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:27.797269] [INFO ] [MAIN ] OIA: Generated 1326 derivative records from 9824 primary records. [2025-09-15T21:19:27.797471] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-15T21:19:27.895432] [DEBUG] [LOCAL ] OIA: Derivative data saved (1326 records). [2025-09-15T21:19:27.895868] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-15T21:19:27.898139] [INFO ] [MAIN ] Derivative Progress: 1375/2083 symbols completed. OIA took 1.0s. Estimated remaining: 3m 55s. Rate: 180.9 symbols/min [2025-09-15T21:19:27.899206] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:27.915148] [DEBUG] [MAIN ] OII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:27.916086] [INFO ] [MAIN ] OII: Generated 1326 derivative records from 31144 primary records. [2025-09-15T21:19:27.916400] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-15T21:19:27.931485] [DEBUG] [LOCAL ] OII: Derivative data saved (1326 records). [2025-09-15T21:19:27.931983] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-15T21:19:27.933769] [INFO ] [MAIN ] Derivative Progress: 1376/2083 symbols completed. OII took 1.0s. Estimated remaining: 3m 54s. Rate: 181.0 symbols/min [2025-09-15T21:19:27.934318] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:27.956372] [DEBUG] [MAIN ] OIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:27.957263] [INFO ] [MAIN ] OIS: Generated 1326 derivative records from 29521 primary records. [2025-09-15T21:19:27.957424] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-15T21:19:27.981278] [DEBUG] [LOCAL ] OIS: Derivative data saved (1326 records). [2025-09-15T21:19:27.984388] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-15T21:19:27.986470] [INFO ] [MAIN ] Derivative Progress: 1377/2083 symbols completed. OIS took 0.7s. Estimated remaining: 3m 54s. Rate: 181.1 symbols/min [2025-09-15T21:19:27.987959] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:27.987769] [DEBUG] [LOCAL ] OKE: Loaded 39550 existing records from primary storage. [2025-09-15T21:19:27.988441] [INFO ] [MAIN ] OKE: Loaded 39550 primary data records. [2025-09-15T21:19:28.188993] [DEBUG] [LOCAL ] OKLO: Loaded 39779 existing records from primary storage. [2025-09-15T21:19:28.201454] [INFO ] [MAIN ] OKLO: Loaded 39779 primary data records. [2025-09-15T21:19:28.405779] [DEBUG] [LOCAL ] OLN: Loaded 38332 existing records from primary storage. [2025-09-15T21:19:28.406865] [INFO ] [MAIN ] OLN: Loaded 38332 primary data records. [2025-09-15T21:19:28.773628] [DEBUG] [MAIN ] OKE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:28.777166] [INFO ] [MAIN ] OKE: Generated 1326 derivative records from 39550 primary records. [2025-09-15T21:19:28.904966] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-15T21:19:28.922432] [DEBUG] [LOCAL ] OKE: Derivative data saved (1326 records). [2025-09-15T21:19:28.922778] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-15T21:19:28.925371] [INFO ] [MAIN ] Derivative Progress: 1378/2083 symbols completed. OKE took 1.0s. Estimated remaining: 3m 54s. Rate: 180.8 symbols/min [2025-09-15T21:19:28.937860] [DEBUG] [MAIN ] OKLO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:28.938578] [INFO ] [MAIN ] OKLO: Generated 1326 derivative records from 39779 primary records. [2025-09-15T21:19:28.938744] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-15T21:19:28.952345] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1326 records). [2025-09-15T21:19:28.952485] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-15T21:19:28.955409] [INFO ] [MAIN ] Derivative Progress: 1379/2083 symbols completed. OKLO took 1.0s. Estimated remaining: 3m 53s. Rate: 181.0 symbols/min [2025-09-15T21:19:28.965621] [DEBUG] [MAIN ] OLN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:28.966220] [INFO ] [MAIN ] OLN: Generated 1326 derivative records from 38332 primary records. [2025-09-15T21:19:28.966284] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-15T21:19:28.978454] [DEBUG] [LOCAL ] OLN: Derivative data saved (1326 records). [2025-09-15T21:19:28.978514] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-15T21:19:28.980824] [INFO ] [MAIN ] Derivative Progress: 1380/2083 symbols completed. OLN took 1.0s. Estimated remaining: 3m 53s. Rate: 181.1 symbols/min [2025-09-15T21:19:28.981347] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:28.981402] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:28.981201] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:28.995986] [DEBUG] [LOCAL ] OLP: Loaded 6858 existing records from primary storage. [2025-09-15T21:19:28.996157] [INFO ] [MAIN ] OLP: Loaded 6858 primary data records. [2025-09-15T21:19:29.229062] [DEBUG] [LOCAL ] OMF: Loaded 33661 existing records from primary storage. [2025-09-15T21:19:29.305115] [DEBUG] [LOCAL ] OMC: Loaded 39281 existing records from primary storage. [2025-09-15T21:19:29.305194] [INFO ] [MAIN ] OMF: Loaded 33661 primary data records. [2025-09-15T21:19:29.315400] [INFO ] [MAIN ] OMC: Loaded 39281 primary data records. [2025-09-15T21:19:29.870877] [DEBUG] [MAIN ] OLP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:29.872203] [INFO ] [MAIN ] OLP: Generated 1326 derivative records from 6858 primary records. [2025-09-15T21:19:29.872690] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-15T21:19:29.889123] [DEBUG] [LOCAL ] OLP: Derivative data saved (1326 records). [2025-09-15T21:19:29.889467] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-15T21:19:29.891224] [INFO ] [MAIN ] Derivative Progress: 1381/2083 symbols completed. OLP took 0.9s. Estimated remaining: 3m 53s. Rate: 180.9 symbols/min [2025-09-15T21:19:29.891804] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:29.917892] [DEBUG] [MAIN ] OMF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:29.918387] [DEBUG] [MAIN ] OMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:29.919312] [INFO ] [MAIN ] OMF: Generated 1326 derivative records from 33661 primary records. [2025-09-15T21:19:29.919858] [INFO ] [MAIN ] OMC: Generated 1326 derivative records from 39281 primary records. [2025-09-15T21:19:29.919989] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-15T21:19:29.920021] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-15T21:19:29.951038] [DEBUG] [LOCAL ] OMC: Derivative data saved (1326 records). [2025-09-15T21:19:29.952322] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-15T21:19:29.953159] [DEBUG] [LOCAL ] OMF: Derivative data saved (1326 records). [2025-09-15T21:19:29.956184] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-15T21:19:29.956027] [INFO ] [MAIN ] Derivative Progress: 1382/2083 symbols completed. OMC took 1.0s. Estimated remaining: 3m 52s. Rate: 181.0 symbols/min [2025-09-15T21:19:29.956497] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:29.958564] [INFO ] [MAIN ] Derivative Progress: 1383/2083 symbols completed. OMF took 1.0s. Estimated remaining: 3m 52s. Rate: 181.1 symbols/min [2025-09-15T21:19:29.959765] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:29.970939] [DEBUG] [LOCAL ] OMI: Loaded 33471 existing records from primary storage. [2025-09-15T21:19:29.971182] [INFO ] [MAIN ] OMI: Loaded 33471 primary data records. [2025-09-15T21:19:30.026224] [DEBUG] [LOCAL ] ONIT: Loaded 5740 existing records from primary storage. [2025-09-15T21:19:30.052050] [INFO ] [MAIN ] ONIT: Loaded 5740 primary data records. [2025-09-15T21:19:30.246020] [DEBUG] [LOCAL ] ONL: Loaded 22091 existing records from primary storage. [2025-09-15T21:19:30.278355] [INFO ] [MAIN ] ONL: Loaded 22091 primary data records. [2025-09-15T21:19:30.807181] [DEBUG] [MAIN ] OMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:30.808710] [INFO ] [MAIN ] OMI: Generated 1326 derivative records from 33471 primary records. [2025-09-15T21:19:30.809305] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-15T21:19:30.834145] [DEBUG] [LOCAL ] OMI: Derivative data saved (1326 records). [2025-09-15T21:19:30.834873] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-15T21:19:30.835149] [DEBUG] [MAIN ] ONIT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:30.844292] [INFO ] [MAIN ] ONIT: Generated 1326 derivative records from 5740 primary records. [2025-09-15T21:19:30.843362] [INFO ] [MAIN ] Derivative Progress: 1384/2083 symbols completed. OMI took 1.0s. Estimated remaining: 3m 52s. Rate: 180.9 symbols/min [2025-09-15T21:19:30.848418] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-15T21:19:30.848812] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:30.849045] [DEBUG] [MAIN ] ONL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:30.850175] [INFO ] [MAIN ] ONL: Generated 1326 derivative records from 22091 primary records. [2025-09-15T21:19:30.851127] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-15T21:19:30.874772] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1326 records). [2025-09-15T21:19:30.876357] [DEBUG] [LOCAL ] ONL: Derivative data saved (1326 records). [2025-09-15T21:19:30.876584] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-15T21:19:30.876530] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-15T21:19:30.878976] [INFO ] [MAIN ] Derivative Progress: 1385/2083 symbols completed. ONL took 0.9s. Estimated remaining: 3m 51s. Rate: 181.0 symbols/min [2025-09-15T21:19:30.881826] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:30.882072] [INFO ] [MAIN ] Derivative Progress: 1386/2083 symbols completed. ONIT took 0.9s. Estimated remaining: 3m 51s. Rate: 181.1 symbols/min [2025-09-15T21:19:30.882513] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:30.912605] [DEBUG] [LOCAL ] ONTF: Loaded 17112 existing records from primary storage. [2025-09-15T21:19:30.912806] [INFO ] [MAIN ] ONTF: Loaded 17112 primary data records. [2025-09-15T21:19:31.044477] [DEBUG] [LOCAL ] ONON: Loaded 39581 existing records from primary storage. [2025-09-15T21:19:31.044824] [INFO ] [MAIN ] ONON: Loaded 39581 primary data records. [2025-09-15T21:19:31.352717] [DEBUG] [LOCAL ] ONTO: Loaded 34701 existing records from primary storage. [2025-09-15T21:19:31.353629] [INFO ] [MAIN ] ONTO: Loaded 34701 primary data records. [2025-09-15T21:19:31.833500] [DEBUG] [MAIN ] ONTF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:31.834668] [INFO ] [MAIN ] ONTF: Generated 1326 derivative records from 17112 primary records. [2025-09-15T21:19:31.835128] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-15T21:19:31.852209] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1326 records). [2025-09-15T21:19:31.858052] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-15T21:19:31.863246] [INFO ] [MAIN ] Derivative Progress: 1387/2083 symbols completed. ONTF took 1.0s. Estimated remaining: 3m 51s. Rate: 180.9 symbols/min [2025-09-15T21:19:31.863897] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:31.863835] [DEBUG] [MAIN ] ONON: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:31.865544] [INFO ] [MAIN ] ONON: Generated 1326 derivative records from 39581 primary records. [2025-09-15T21:19:31.866675] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-15T21:19:31.890385] [DEBUG] [LOCAL ] ONON: Derivative data saved (1326 records). [2025-09-15T21:19:31.890783] [DEBUG] [MAIN ] ONTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:31.890930] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-15T21:19:31.893904] [INFO ] [MAIN ] Derivative Progress: 1388/2083 symbols completed. ONON took 1.0s. Estimated remaining: 3m 50s. Rate: 181.0 symbols/min [2025-09-15T21:19:31.899207] [INFO ] [MAIN ] ONTO: Generated 1326 derivative records from 34701 primary records. [2025-09-15T21:19:31.899609] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:31.899388] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-15T21:19:31.918824] [DEBUG] [LOCAL ] OPAD: Loaded 16476 existing records from primary storage. [2025-09-15T21:19:31.918889] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1326 records). [2025-09-15T21:19:31.919071] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-15T21:19:31.919114] [INFO ] [MAIN ] OPAD: Loaded 16476 primary data records. [2025-09-15T21:19:31.921061] [INFO ] [MAIN ] Derivative Progress: 1389/2083 symbols completed. ONTO took 1.0s. Estimated remaining: 3m 50s. Rate: 181.1 symbols/min [2025-09-15T21:19:31.950286] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:32.091329] [DEBUG] [LOCAL ] OPP: Loaded 8670 existing records from primary storage. [2025-09-15T21:19:32.120040] [INFO ] [MAIN ] OPP: Loaded 8670 primary data records. [2025-09-15T21:19:32.225114] [DEBUG] [LOCAL ] OPFI: Loaded 34322 existing records from primary storage. [2025-09-15T21:19:32.247385] [INFO ] [MAIN ] OPFI: Loaded 34322 primary data records. [2025-09-15T21:19:32.763490] [DEBUG] [MAIN ] OPAD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:32.764973] [INFO ] [MAIN ] OPAD: Generated 1326 derivative records from 16476 primary records. [2025-09-15T21:19:32.766280] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-15T21:19:32.780153] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1326 records). [2025-09-15T21:19:32.780487] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-15T21:19:32.782404] [INFO ] [MAIN ] Derivative Progress: 1390/2083 symbols completed. OPAD took 0.9s. Estimated remaining: 3m 50s. Rate: 180.9 symbols/min [2025-09-15T21:19:32.782725] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:32.797146] [DEBUG] [MAIN ] OPP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:32.798015] [INFO ] [MAIN ] OPP: Generated 1326 derivative records from 8670 primary records. [2025-09-15T21:19:32.799881] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-15T21:19:32.811367] [DEBUG] [MAIN ] OPFI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:32.830922] [DEBUG] [LOCAL ] OPP: Derivative data saved (1326 records). [2025-09-15T21:19:32.832063] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-15T21:19:32.831810] [INFO ] [MAIN ] OPFI: Generated 1326 derivative records from 34322 primary records. [2025-09-15T21:19:32.835674] [INFO ] [MAIN ] Derivative Progress: 1391/2083 symbols completed. OPP took 0.9s. Estimated remaining: 3m 49s. Rate: 181.0 symbols/min [2025-09-15T21:19:32.836145] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:32.836263] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-15T21:19:32.849626] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1326 records). [2025-09-15T21:19:32.850276] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-15T21:19:32.852889] [INFO ] [MAIN ] Derivative Progress: 1392/2083 symbols completed. OPFI took 1.0s. Estimated remaining: 3m 49s. Rate: 181.1 symbols/min [2025-09-15T21:19:32.863528] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:32.864700] [DEBUG] [LOCAL ] OR: Loaded 33580 existing records from primary storage. [2025-09-15T21:19:32.864925] [INFO ] [MAIN ] OR: Loaded 33580 primary data records. [2025-09-15T21:19:33.007720] [DEBUG] [LOCAL ] ORA: Loaded 23615 existing records from primary storage. [2025-09-15T21:19:33.025433] [INFO ] [MAIN ] ORA: Loaded 23615 primary data records. [2025-09-15T21:19:33.162186] [DEBUG] [LOCAL ] ORC: Loaded 38686 existing records from primary storage. [2025-09-15T21:19:33.188709] [INFO ] [MAIN ] ORC: Loaded 38686 primary data records. [2025-09-15T21:19:33.866901] [DEBUG] [MAIN ] OR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:33.868959] [INFO ] [MAIN ] OR: Generated 1326 derivative records from 33580 primary records. [2025-09-15T21:19:33.869299] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-15T21:19:33.887803] [DEBUG] [LOCAL ] OR: Derivative data saved (1326 records). [2025-09-15T21:19:33.889130] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-15T21:19:33.891561] [INFO ] [MAIN ] Derivative Progress: 1393/2083 symbols completed. OR took 1.1s. Estimated remaining: 3m 49s. Rate: 180.9 symbols/min [2025-09-15T21:19:33.903154] [DEBUG] [MAIN ] ORA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:33.904379] [INFO ] [MAIN ] ORA: Generated 1326 derivative records from 23615 primary records. [2025-09-15T21:19:33.904620] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-15T21:19:33.920550] [DEBUG] [LOCAL ] ORA: Derivative data saved (1326 records). [2025-09-15T21:19:33.920879] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-15T21:19:33.924170] [INFO ] [MAIN ] Derivative Progress: 1394/2083 symbols completed. ORA took 1.1s. Estimated remaining: 3m 48s. Rate: 181.0 symbols/min [2025-09-15T21:19:33.934193] [DEBUG] [MAIN ] ORC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:33.935170] [INFO ] [MAIN ] ORC: Generated 1326 derivative records from 38686 primary records. [2025-09-15T21:19:33.935239] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-15T21:19:33.947004] [DEBUG] [LOCAL ] ORC: Derivative data saved (1326 records). [2025-09-15T21:19:33.947065] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-15T21:19:33.949707] [INFO ] [MAIN ] Derivative Progress: 1395/2083 symbols completed. ORC took 1.1s. Estimated remaining: 3m 48s. Rate: 181.1 symbols/min [2025-09-15T21:19:33.950382] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:33.950515] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:33.951373] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:33.977164] [DEBUG] [LOCAL ] ORN: Loaded 22954 existing records from primary storage. [2025-09-15T21:19:33.977327] [INFO ] [MAIN ] ORN: Loaded 22954 primary data records. [2025-09-15T21:19:34.178005] [DEBUG] [LOCAL ] OTIS: Loaded 38917 existing records from primary storage. [2025-09-15T21:19:34.195667] [INFO ] [MAIN ] OTIS: Loaded 38917 primary data records. [2025-09-15T21:19:34.310033] [DEBUG] [LOCAL ] OSCR: Loaded 39762 existing records from primary storage. [2025-09-15T21:19:34.364287] [INFO ] [MAIN ] OSCR: Loaded 39762 primary data records. [2025-09-15T21:19:34.853408] [DEBUG] [MAIN ] ORN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:34.854677] [INFO ] [MAIN ] ORN: Generated 1326 derivative records from 22954 primary records. [2025-09-15T21:19:34.854906] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-15T21:19:34.868402] [DEBUG] [LOCAL ] ORN: Derivative data saved (1326 records). [2025-09-15T21:19:34.868714] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-15T21:19:34.870752] [INFO ] [MAIN ] Derivative Progress: 1396/2083 symbols completed. ORN took 0.9s. Estimated remaining: 3m 48s. Rate: 180.9 symbols/min [2025-09-15T21:19:34.871326] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:34.887474] [DEBUG] [MAIN ] OTIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:34.894012] [INFO ] [MAIN ] OTIS: Generated 1326 derivative records from 38917 primary records. [2025-09-15T21:19:34.898061] [DEBUG] [MAIN ] OSCR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:34.898123] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-15T21:19:34.899416] [INFO ] [MAIN ] OSCR: Generated 1326 derivative records from 39762 primary records. [2025-09-15T21:19:34.899703] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-15T21:19:34.921047] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1326 records). [2025-09-15T21:19:34.930574] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-15T21:19:34.932996] [INFO ] [MAIN ] Derivative Progress: 1397/2083 symbols completed. OTIS took 1.0s. Estimated remaining: 3m 47s. Rate: 181.0 symbols/min [2025-09-15T21:19:34.933990] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:34.934564] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1326 records). [2025-09-15T21:19:34.934710] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-15T21:19:34.937094] [INFO ] [MAIN ] Derivative Progress: 1398/2083 symbols completed. OSCR took 1.0s. Estimated remaining: 3m 47s. Rate: 181.1 symbols/min [2025-09-15T21:19:34.937589] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:34.950173] [DEBUG] [LOCAL ] OUT: Loaded 35495 existing records from primary storage. [2025-09-15T21:19:34.950476] [INFO ] [MAIN ] OUT: Loaded 35495 primary data records. [2025-09-15T21:19:35.242894] [DEBUG] [LOCAL ] OVV: Loaded 39498 existing records from primary storage. [2025-09-15T21:19:35.243488] [INFO ] [MAIN ] OVV: Loaded 39498 primary data records. [2025-09-15T21:19:35.318799] [DEBUG] [LOCAL ] OWL: Loaded 39522 existing records from primary storage. [2025-09-15T21:19:35.354337] [INFO ] [MAIN ] OWL: Loaded 39522 primary data records. [2025-09-15T21:19:35.857889] [DEBUG] [MAIN ] OUT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:35.859016] [INFO ] [MAIN ] OUT: Generated 1326 derivative records from 35495 primary records. [2025-09-15T21:19:35.859102] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-15T21:19:35.874256] [DEBUG] [LOCAL ] OUT: Derivative data saved (1326 records). [2025-09-15T21:19:35.874447] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-15T21:19:35.876736] [INFO ] [MAIN ] Derivative Progress: 1399/2083 symbols completed. OUT took 1.0s. Estimated remaining: 3m 47s. Rate: 180.9 symbols/min [2025-09-15T21:19:35.877142] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:35.899919] [DEBUG] [LOCAL ] OWLT: Loaded 6955 existing records from primary storage. [2025-09-15T21:19:35.899847] [DEBUG] [MAIN ] OVV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:35.910317] [INFO ] [MAIN ] OVV: Generated 1326 derivative records from 39498 primary records. [2025-09-15T21:19:35.909234] [INFO ] [MAIN ] OWLT: Loaded 6955 primary data records. [2025-09-15T21:19:35.909535] [DEBUG] [MAIN ] OWL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:35.910436] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-15T21:19:35.911123] [INFO ] [MAIN ] OWL: Generated 1326 derivative records from 39522 primary records. [2025-09-15T21:19:35.980223] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-15T21:19:36.041170] [DEBUG] [LOCAL ] OVV: Derivative data saved (1326 records). [2025-09-15T21:19:36.073444] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-15T21:19:36.106328] [INFO ] [MAIN ] Derivative Progress: 1400/2083 symbols completed. OVV took 1.2s. Estimated remaining: 3m 47s. Rate: 180.9 symbols/min [2025-09-15T21:19:36.107787] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:36.197466] [DEBUG] [LOCAL ] OWL: Derivative data saved (1326 records). [2025-09-15T21:19:36.197754] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-15T21:19:36.200326] [INFO ] [MAIN ] Derivative Progress: 1401/2083 symbols completed. OWL took 1.3s. Estimated remaining: 3m 46s. Rate: 181.0 symbols/min [2025-09-15T21:19:36.201262] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:36.226556] [DEBUG] [MAIN ] OWLT: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:19:36.227294] [INFO ] [MAIN ] OWLT: Generated 1324 derivative records from 6955 primary records. [2025-09-15T21:19:36.227405] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-15T21:19:36.239876] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1324 records). [2025-09-15T21:19:36.247834] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-15T21:19:36.250750] [INFO ] [MAIN ] Derivative Progress: 1402/2083 symbols completed. OWLT took 0.4s. Estimated remaining: 3m 46s. Rate: 181.1 symbols/min [2025-09-15T21:19:36.251799] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:36.251631] [DEBUG] [LOCAL ] OXM: Loaded 24204 existing records from primary storage. [2025-09-15T21:19:36.251992] [INFO ] [MAIN ] OXM: Loaded 24204 primary data records. [2025-09-15T21:19:36.400807] [DEBUG] [LOCAL ] PAC: Loaded 8394 existing records from primary storage. [2025-09-15T21:19:36.433729] [INFO ] [MAIN ] PAC: Loaded 8394 primary data records. [2025-09-15T21:19:36.433627] [DEBUG] [LOCAL ] PAAS: Loaded 39585 existing records from primary storage. [2025-09-15T21:19:36.462668] [INFO ] [MAIN ] PAAS: Loaded 39585 primary data records. [2025-09-15T21:19:37.097171] [DEBUG] [MAIN ] OXM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:37.098139] [INFO ] [MAIN ] OXM: Generated 1326 derivative records from 24204 primary records. [2025-09-15T21:19:37.098462] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-15T21:19:37.115600] [DEBUG] [LOCAL ] OXM: Derivative data saved (1326 records). [2025-09-15T21:19:37.116080] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-15T21:19:37.117779] [INFO ] [MAIN ] Derivative Progress: 1403/2083 symbols completed. OXM took 1.0s. Estimated remaining: 3m 46s. Rate: 180.9 symbols/min [2025-09-15T21:19:37.126995] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:37.133843] [DEBUG] [MAIN ] PAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:37.135060] [INFO ] [MAIN ] PAC: Generated 1326 derivative records from 8394 primary records. [2025-09-15T21:19:37.135198] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-15T21:19:37.155836] [DEBUG] [LOCAL ] PAC: Derivative data saved (1326 records). [2025-09-15T21:19:37.155970] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-15T21:19:37.158354] [INFO ] [MAIN ] Derivative Progress: 1404/2083 symbols completed. PAC took 0.9s. Estimated remaining: 3m 45s. Rate: 181.0 symbols/min [2025-09-15T21:19:37.158557] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:37.174000] [DEBUG] [MAIN ] PAAS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:37.175096] [INFO ] [MAIN ] PAAS: Generated 1326 derivative records from 39585 primary records. [2025-09-15T21:19:37.175300] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-15T21:19:37.190473] [DEBUG] [LOCAL ] PACK: Loaded 22763 existing records from primary storage. [2025-09-15T21:19:37.195448] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1326 records). [2025-09-15T21:19:37.195717] [INFO ] [MAIN ] PACK: Loaded 22763 primary data records. [2025-09-15T21:19:37.195659] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-15T21:19:37.197716] [INFO ] [MAIN ] Derivative Progress: 1405/2083 symbols completed. PAAS took 1.0s. Estimated remaining: 3m 45s. Rate: 181.1 symbols/min [2025-09-15T21:19:37.218510] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:37.311498] [DEBUG] [LOCAL ] PAG: Loaded 15392 existing records from primary storage. [2025-09-15T21:19:37.317205] [INFO ] [MAIN ] PAG: Loaded 15392 primary data records. [2025-09-15T21:19:37.641564] [DEBUG] [LOCAL ] PAGS: Loaded 38961 existing records from primary storage. [2025-09-15T21:19:37.666446] [INFO ] [MAIN ] PAGS: Loaded 38961 primary data records. [2025-09-15T21:19:38.076224] [DEBUG] [MAIN ] PACK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:38.077504] [INFO ] [MAIN ] PACK: Generated 1326 derivative records from 22763 primary records. [2025-09-15T21:19:38.077992] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-15T21:19:38.091717] [DEBUG] [LOCAL ] PACK: Derivative data saved (1326 records). [2025-09-15T21:19:38.092343] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-15T21:19:38.094165] [INFO ] [MAIN ] Derivative Progress: 1406/2083 symbols completed. PACK took 1.0s. Estimated remaining: 3m 45s. Rate: 180.9 symbols/min [2025-09-15T21:19:38.104533] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:38.104759] [DEBUG] [MAIN ] PAG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:38.105570] [INFO ] [MAIN ] PAG: Generated 1326 derivative records from 15392 primary records. [2025-09-15T21:19:38.106086] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-15T21:19:38.119326] [DEBUG] [LOCAL ] PAG: Derivative data saved (1326 records). [2025-09-15T21:19:38.121275] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-15T21:19:38.123161] [INFO ] [MAIN ] Derivative Progress: 1407/2083 symbols completed. PAG took 1.0s. Estimated remaining: 3m 44s. Rate: 181.0 symbols/min [2025-09-15T21:19:38.121216] [DEBUG] [LOCAL ] PAI: Loaded 1985 existing records from primary storage. [2025-09-15T21:19:38.123441] [INFO ] [MAIN ] PAI: Loaded 1985 primary data records. [2025-09-15T21:19:38.123397] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:38.245752] [DEBUG] [MAIN ] PAGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:38.257218] [INFO ] [MAIN ] PAGS: Generated 1326 derivative records from 38961 primary records. [2025-09-15T21:19:38.272838] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-15T21:19:38.312778] [DEBUG] [LOCAL ] PAM: Loaded 20034 existing records from primary storage. [2025-09-15T21:19:38.334814] [INFO ] [MAIN ] PAM: Loaded 20034 primary data records. [2025-09-15T21:19:38.533244] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1326 records). [2025-09-15T21:19:38.533556] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-15T21:19:38.536514] [INFO ] [MAIN ] Derivative Progress: 1408/2083 symbols completed. PAGS took 1.3s. Estimated remaining: 3m 44s. Rate: 181.0 symbols/min [2025-09-15T21:19:38.707749] [DEBUG] [MAIN ] PAI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:38.708665] [INFO ] [MAIN ] PAI: Generated 1326 derivative records from 1985 primary records. [2025-09-15T21:19:38.708734] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-15T21:19:38.719915] [DEBUG] [LOCAL ] PAI: Derivative data saved (1326 records). [2025-09-15T21:19:38.720131] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-15T21:19:38.721562] [INFO ] [MAIN ] Derivative Progress: 1409/2083 symbols completed. PAI took 0.6s. Estimated remaining: 3m 43s. Rate: 181.0 symbols/min [2025-09-15T21:19:38.734516] [DEBUG] [MAIN ] PAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:38.735050] [INFO ] [MAIN ] PAM: Generated 1326 derivative records from 20034 primary records. [2025-09-15T21:19:38.735110] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-15T21:19:38.746434] [DEBUG] [LOCAL ] PAM: Derivative data saved (1326 records). [2025-09-15T21:19:38.746493] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-15T21:19:38.748441] [INFO ] [MAIN ] Derivative Progress: 1410/2083 symbols completed. PAM took 0.6s. Estimated remaining: 3m 43s. Rate: 181.2 symbols/min [2025-09-15T21:19:38.749110] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:38.749061] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:38.748952] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:38.784860] [DEBUG] [LOCAL ] PAR: Loaded 23807 existing records from primary storage. [2025-09-15T21:19:38.785072] [INFO ] [MAIN ] PAR: Loaded 23807 primary data records. [2025-09-15T21:19:38.936891] [DEBUG] [LOCAL ] PARR: Loaded 35558 existing records from primary storage. [2025-09-15T21:19:38.942501] [INFO ] [MAIN ] PARR: Loaded 35558 primary data records. [2025-09-15T21:19:39.172885] [DEBUG] [LOCAL ] PATH: Loaded 39645 existing records from primary storage. [2025-09-15T21:19:39.208947] [INFO ] [MAIN ] PATH: Loaded 39645 primary data records. [2025-09-15T21:19:39.665569] [DEBUG] [MAIN ] PAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:39.666698] [INFO ] [MAIN ] PAR: Generated 1326 derivative records from 23807 primary records. [2025-09-15T21:19:39.666862] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-15T21:19:39.684294] [DEBUG] [LOCAL ] PAR: Derivative data saved (1326 records). [2025-09-15T21:19:39.684711] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-15T21:19:39.697461] [INFO ] [MAIN ] Derivative Progress: 1411/2083 symbols completed. PAR took 0.9s. Estimated remaining: 3m 43s. Rate: 180.9 symbols/min [2025-09-15T21:19:39.698195] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:39.698037] [DEBUG] [MAIN ] PARR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:39.700227] [INFO ] [MAIN ] PARR: Generated 1326 derivative records from 35558 primary records. [2025-09-15T21:19:39.700569] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-15T21:19:39.716427] [DEBUG] [LOCAL ] PARR: Derivative data saved (1326 records). [2025-09-15T21:19:39.717795] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-15T21:19:39.720551] [INFO ] [MAIN ] Derivative Progress: 1412/2083 symbols completed. PARR took 1.0s. Estimated remaining: 3m 42s. Rate: 181.0 symbols/min [2025-09-15T21:19:39.721234] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:39.737158] [DEBUG] [MAIN ] PATH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:39.737982] [INFO ] [MAIN ] PATH: Generated 1326 derivative records from 39645 primary records. [2025-09-15T21:19:39.738161] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-15T21:19:39.753970] [DEBUG] [LOCAL ] PAXS: Loaded 15712 existing records from primary storage. [2025-09-15T21:19:39.756582] [INFO ] [MAIN ] PAXS: Loaded 15712 primary data records. [2025-09-15T21:19:39.756510] [DEBUG] [LOCAL ] PATH: Derivative data saved (1326 records). [2025-09-15T21:19:39.756765] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-15T21:19:39.769952] [INFO ] [MAIN ] Derivative Progress: 1413/2083 symbols completed. PATH took 1.0s. Estimated remaining: 3m 42s. Rate: 181.1 symbols/min [2025-09-15T21:19:39.779826] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:39.970670] [DEBUG] [LOCAL ] PAY: Loaded 28375 existing records from primary storage. [2025-09-15T21:19:40.058740] [INFO ] [MAIN ] PAY: Loaded 28375 primary data records. [2025-09-15T21:19:40.090330] [DEBUG] [LOCAL ] PAYC: Loaded 26059 existing records from primary storage. [2025-09-15T21:19:40.114563] [INFO ] [MAIN ] PAYC: Loaded 26059 primary data records. [2025-09-15T21:19:40.739670] [DEBUG] [MAIN ] PAXS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:40.742555] [INFO ] [MAIN ] PAXS: Generated 1326 derivative records from 15712 primary records. [2025-09-15T21:19:40.743110] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-15T21:19:40.757221] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1326 records). [2025-09-15T21:19:40.757361] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-15T21:19:40.759338] [INFO ] [MAIN ] Derivative Progress: 1414/2083 symbols completed. PAXS took 1.1s. Estimated remaining: 3m 42s. Rate: 180.9 symbols/min [2025-09-15T21:19:40.760279] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:40.776488] [DEBUG] [MAIN ] PAY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:40.777390] [INFO ] [MAIN ] PAY: Generated 1326 derivative records from 28375 primary records. [2025-09-15T21:19:40.778256] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-15T21:19:40.810898] [DEBUG] [MAIN ] PAYC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:40.812176] [INFO ] [MAIN ] PAYC: Generated 1326 derivative records from 26059 primary records. [2025-09-15T21:19:40.812557] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-15T21:19:40.812927] [DEBUG] [LOCAL ] PAY: Derivative data saved (1326 records). [2025-09-15T21:19:40.813738] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-15T21:19:40.815694] [INFO ] [MAIN ] Derivative Progress: 1415/2083 symbols completed. PAY took 1.1s. Estimated remaining: 3m 41s. Rate: 181.0 symbols/min [2025-09-15T21:19:40.821944] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:40.829594] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1326 records). [2025-09-15T21:19:40.829825] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-15T21:19:40.841553] [INFO ] [MAIN ] Derivative Progress: 1416/2083 symbols completed. PAYC took 1.1s. Estimated remaining: 3m 41s. Rate: 181.1 symbols/min [2025-09-15T21:19:40.842616] [DEBUG] [LOCAL ] PB: Loaded 30715 existing records from primary storage. [2025-09-15T21:19:40.842919] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:40.843075] [INFO ] [MAIN ] PB: Loaded 30715 primary data records. [2025-09-15T21:19:41.164191] [DEBUG] [LOCAL ] PBA: Loaded 36207 existing records from primary storage. [2025-09-15T21:19:41.164394] [INFO ] [MAIN ] PBA: Loaded 36207 primary data records. [2025-09-15T21:19:41.165792] [DEBUG] [LOCAL ] PBF: Loaded 39234 existing records from primary storage. [2025-09-15T21:19:41.209230] [INFO ] [MAIN ] PBF: Loaded 39234 primary data records. [2025-09-15T21:19:41.727696] [DEBUG] [MAIN ] PB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:41.728699] [INFO ] [MAIN ] PB: Generated 1326 derivative records from 30715 primary records. [2025-09-15T21:19:41.729267] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-15T21:19:41.743451] [DEBUG] [LOCAL ] PB: Derivative data saved (1326 records). [2025-09-15T21:19:41.743778] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-15T21:19:41.746230] [INFO ] [MAIN ] Derivative Progress: 1417/2083 symbols completed. PB took 1.0s. Estimated remaining: 3m 41s. Rate: 180.9 symbols/min [2025-09-15T21:19:41.746994] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:41.782079] [DEBUG] [MAIN ] PBF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:41.782339] [DEBUG] [MAIN ] PBA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:41.783136] [INFO ] [MAIN ] PBA: Generated 1326 derivative records from 36207 primary records. [2025-09-15T21:19:41.783779] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-15T21:19:41.783708] [INFO ] [MAIN ] PBF: Generated 1326 derivative records from 39234 primary records. [2025-09-15T21:19:41.784464] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-15T21:19:41.804368] [DEBUG] [LOCAL ] PBA: Derivative data saved (1326 records). [2025-09-15T21:19:41.808591] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-15T21:19:41.819411] [INFO ] [MAIN ] Derivative Progress: 1418/2083 symbols completed. PBA took 1.0s. Estimated remaining: 3m 40s. Rate: 181.0 symbols/min [2025-09-15T21:19:41.819912] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:41.821853] [DEBUG] [LOCAL ] PBF: Derivative data saved (1326 records). [2025-09-15T21:19:41.823148] [DEBUG] [LOCAL ] PBH: Loaded 23652 existing records from primary storage. [2025-09-15T21:19:41.822029] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-15T21:19:41.825083] [INFO ] [MAIN ] Derivative Progress: 1419/2083 symbols completed. PBF took 1.0s. Estimated remaining: 3m 40s. Rate: 181.1 symbols/min [2025-09-15T21:19:41.825244] [INFO ] [MAIN ] PBH: Loaded 23652 primary data records. [2025-09-15T21:19:41.825513] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:42.141310] [DEBUG] [LOCAL ] PBI: Loaded 36793 existing records from primary storage. [2025-09-15T21:19:42.141825] [INFO ] [MAIN ] PBI: Loaded 36793 primary data records. [2025-09-15T21:19:42.197018] [DEBUG] [LOCAL ] PBR: Loaded 39681 existing records from primary storage. [2025-09-15T21:19:42.230566] [INFO ] [MAIN ] PBR: Loaded 39681 primary data records. [2025-09-15T21:19:42.790636] [DEBUG] [MAIN ] PBH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:42.791772] [INFO ] [MAIN ] PBH: Generated 1326 derivative records from 23652 primary records. [2025-09-15T21:19:42.792431] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-15T21:19:42.810840] [DEBUG] [LOCAL ] PBH: Derivative data saved (1326 records). [2025-09-15T21:19:42.811070] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-15T21:19:42.813696] [INFO ] [MAIN ] Derivative Progress: 1420/2083 symbols completed. PBH took 1.1s. Estimated remaining: 3m 40s. Rate: 180.9 symbols/min [2025-09-15T21:19:42.814281] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:42.825398] [DEBUG] [MAIN ] PBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:42.826500] [INFO ] [MAIN ] PBI: Generated 1326 derivative records from 36793 primary records. [2025-09-15T21:19:42.826839] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-15T21:19:42.846413] [DEBUG] [LOCAL ] PBI: Derivative data saved (1326 records). [2025-09-15T21:19:42.856177] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-15T21:19:42.858009] [INFO ] [MAIN ] Derivative Progress: 1421/2083 symbols completed. PBI took 1.0s. Estimated remaining: 3m 39s. Rate: 181.0 symbols/min [2025-09-15T21:19:42.858342] [DEBUG] [MAIN ] PBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:42.858667] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:42.859317] [INFO ] [MAIN ] PBR: Generated 1326 derivative records from 39681 primary records. [2025-09-15T21:19:42.859597] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-15T21:19:42.865318] [DEBUG] [LOCAL ] PBT: Loaded 13303 existing records from primary storage. [2025-09-15T21:19:42.865764] [INFO ] [MAIN ] PBT: Loaded 13303 primary data records. [2025-09-15T21:19:42.970186] [DEBUG] [LOCAL ] PCF: Loaded 6537 existing records from primary storage. [2025-09-15T21:19:42.994975] [DEBUG] [LOCAL ] PBR: Derivative data saved (1326 records). [2025-09-15T21:19:42.995399] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-15T21:19:42.990685] [INFO ] [MAIN ] PCF: Loaded 6537 primary data records. [2025-09-15T21:19:43.002998] [INFO ] [MAIN ] Derivative Progress: 1422/2083 symbols completed. PBR took 1.2s. Estimated remaining: 3m 39s. Rate: 181.0 symbols/min [2025-09-15T21:19:43.094627] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:43.477278] [DEBUG] [MAIN ] PBT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:43.477359] [DEBUG] [LOCAL ] PCG: Loaded 39679 existing records from primary storage. [2025-09-15T21:19:43.478190] [INFO ] [MAIN ] PBT: Generated 1326 derivative records from 13303 primary records. [2025-09-15T21:19:43.478400] [INFO ] [MAIN ] PCG: Loaded 39679 primary data records. [2025-09-15T21:19:43.478441] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-15T21:19:43.604711] [DEBUG] [LOCAL ] PBT: Derivative data saved (1326 records). [2025-09-15T21:19:43.605213] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-15T21:19:43.607290] [INFO ] [MAIN ] Derivative Progress: 1423/2083 symbols completed. PBT took 0.8s. Estimated remaining: 3m 39s. Rate: 180.9 symbols/min [2025-09-15T21:19:43.605045] [DEBUG] [MAIN ] PCF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:43.623999] [INFO ] [MAIN ] PCF: Generated 1326 derivative records from 6537 primary records. [2025-09-15T21:19:43.634298] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-15T21:19:43.769362] [DEBUG] [LOCAL ] PCF: Derivative data saved (1326 records). [2025-09-15T21:19:43.795522] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-15T21:19:43.798144] [INFO ] [MAIN ] Derivative Progress: 1424/2083 symbols completed. PCF took 0.9s. Estimated remaining: 3m 38s. Rate: 181.0 symbols/min [2025-09-15T21:19:43.816604] [DEBUG] [MAIN ] PCG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:43.817284] [INFO ] [MAIN ] PCG: Generated 1326 derivative records from 39679 primary records. [2025-09-15T21:19:43.817347] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-15T21:19:43.829242] [DEBUG] [LOCAL ] PCG: Derivative data saved (1326 records). [2025-09-15T21:19:43.829300] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-15T21:19:43.831614] [INFO ] [MAIN ] Derivative Progress: 1425/2083 symbols completed. PCG took 0.8s. Estimated remaining: 3m 38s. Rate: 181.1 symbols/min [2025-09-15T21:19:43.832740] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:43.832550] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:43.832700] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:43.847385] [DEBUG] [LOCAL ] PCM: Loaded 4893 existing records from primary storage. [2025-09-15T21:19:43.847609] [INFO ] [MAIN ] PCM: Loaded 4893 primary data records. [2025-09-15T21:19:43.986763] [DEBUG] [LOCAL ] PCN: Loaded 18060 existing records from primary storage. [2025-09-15T21:19:44.041381] [INFO ] [MAIN ] PCN: Loaded 18060 primary data records. [2025-09-15T21:19:44.170480] [DEBUG] [LOCAL ] PCOR: Loaded 35210 existing records from primary storage. [2025-09-15T21:19:44.210730] [INFO ] [MAIN ] PCOR: Loaded 35210 primary data records. [2025-09-15T21:19:44.711465] [DEBUG] [MAIN ] PCM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:44.712482] [INFO ] [MAIN ] PCM: Generated 1326 derivative records from 4893 primary records. [2025-09-15T21:19:44.713242] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-15T21:19:44.734924] [DEBUG] [MAIN ] PCN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:44.736038] [INFO ] [MAIN ] PCN: Generated 1326 derivative records from 18060 primary records. [2025-09-15T21:19:44.737666] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-15T21:19:44.737470] [DEBUG] [LOCAL ] PCM: Derivative data saved (1326 records). [2025-09-15T21:19:44.738028] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-15T21:19:44.740602] [INFO ] [MAIN ] Derivative Progress: 1426/2083 symbols completed. PCM took 0.9s. Estimated remaining: 3m 38s. Rate: 180.9 symbols/min [2025-09-15T21:19:44.741363] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:44.755089] [DEBUG] [LOCAL ] PCN: Derivative data saved (1326 records). [2025-09-15T21:19:44.755272] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-15T21:19:44.757062] [INFO ] [MAIN ] Derivative Progress: 1427/2083 symbols completed. PCN took 0.9s. Estimated remaining: 3m 37s. Rate: 181.0 symbols/min [2025-09-15T21:19:44.764872] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:44.769474] [DEBUG] [MAIN ] PCOR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:44.770352] [INFO ] [MAIN ] PCOR: Generated 1326 derivative records from 35210 primary records. [2025-09-15T21:19:44.770554] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-15T21:19:44.775221] [DEBUG] [LOCAL ] PCQ: Loaded 8603 existing records from primary storage. [2025-09-15T21:19:44.775703] [INFO ] [MAIN ] PCQ: Loaded 8603 primary data records. [2025-09-15T21:19:44.825364] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1326 records). [2025-09-15T21:19:44.854168] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-15T21:19:44.901083] [INFO ] [MAIN ] Derivative Progress: 1428/2083 symbols completed. PCOR took 1.1s. Estimated remaining: 3m 37s. Rate: 181.1 symbols/min [2025-09-15T21:19:44.905934] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:45.060238] [DEBUG] [LOCAL ] PD: Loaded 35268 existing records from primary storage. [2025-09-15T21:19:45.104582] [INFO ] [MAIN ] PD: Loaded 35268 primary data records. [2025-09-15T21:19:45.313481] [DEBUG] [LOCAL ] PDI: Loaded 36823 existing records from primary storage. [2025-09-15T21:19:45.314080] [INFO ] [MAIN ] PDI: Loaded 36823 primary data records. [2025-09-15T21:19:45.575495] [DEBUG] [MAIN ] PCQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:45.604421] [INFO ] [MAIN ] PCQ: Generated 1326 derivative records from 8603 primary records. [2025-09-15T21:19:45.605775] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-15T21:19:45.709258] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1326 records). [2025-09-15T21:19:45.709413] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-15T21:19:45.711209] [INFO ] [MAIN ] Derivative Progress: 1429/2083 symbols completed. PCQ took 1.0s. Estimated remaining: 3m 37s. Rate: 180.9 symbols/min [2025-09-15T21:19:45.711574] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:45.732185] [DEBUG] [MAIN ] PD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:45.733511] [INFO ] [MAIN ] PD: Generated 1326 derivative records from 35268 primary records. [2025-09-15T21:19:45.733713] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-15T21:19:45.747757] [DEBUG] [LOCAL ] PD: Derivative data saved (1326 records). [2025-09-15T21:19:45.748379] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-15T21:19:45.760178] [INFO ] [MAIN ] Derivative Progress: 1430/2083 symbols completed. PD took 1.0s. Estimated remaining: 3m 36s. Rate: 181.0 symbols/min [2025-09-15T21:19:45.761015] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:45.785108] [DEBUG] [MAIN ] PDI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:45.785622] [DEBUG] [LOCAL ] PDM: Loaded 29063 existing records from primary storage. [2025-09-15T21:19:45.786532] [INFO ] [MAIN ] PDI: Generated 1326 derivative records from 36823 primary records. [2025-09-15T21:19:45.786757] [INFO ] [MAIN ] PDM: Loaded 29063 primary data records. [2025-09-15T21:19:45.786850] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-15T21:19:45.880692] [DEBUG] [LOCAL ] PDI: Derivative data saved (1326 records). [2025-09-15T21:19:45.888196] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-15T21:19:45.916167] [INFO ] [MAIN ] Derivative Progress: 1431/2083 symbols completed. PDI took 1.0s. Estimated remaining: 3m 36s. Rate: 181.1 symbols/min [2025-09-15T21:19:45.920314] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:45.987271] [DEBUG] [LOCAL ] PDO: Loaded 22514 existing records from primary storage. [2025-09-15T21:19:46.006708] [INFO ] [MAIN ] PDO: Loaded 22514 primary data records. [2025-09-15T21:19:46.164324] [DEBUG] [LOCAL ] PDS: Loaded 12126 existing records from primary storage. [2025-09-15T21:19:46.174155] [INFO ] [MAIN ] PDS: Loaded 12126 primary data records. [2025-09-15T21:19:46.714718] [DEBUG] [MAIN ] PDM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:46.717160] [INFO ] [MAIN ] PDM: Generated 1326 derivative records from 29063 primary records. [2025-09-15T21:19:46.718451] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-15T21:19:46.735235] [DEBUG] [LOCAL ] PDM: Derivative data saved (1326 records). [2025-09-15T21:19:46.735579] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-15T21:19:46.738302] [INFO ] [MAIN ] Derivative Progress: 1432/2083 symbols completed. PDM took 1.0s. Estimated remaining: 3m 36s. Rate: 180.9 symbols/min [2025-09-15T21:19:46.738669] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:46.758599] [DEBUG] [MAIN ] PDS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:46.760978] [INFO ] [MAIN ] PDS: Generated 1326 derivative records from 12126 primary records. [2025-09-15T21:19:46.761113] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-15T21:19:46.784588] [DEBUG] [LOCAL ] PDT: Loaded 12890 existing records from primary storage. [2025-09-15T21:19:46.787734] [INFO ] [MAIN ] PDT: Loaded 12890 primary data records. [2025-09-15T21:19:46.795143] [DEBUG] [LOCAL ] PDS: Derivative data saved (1326 records). [2025-09-15T21:19:46.784146] [DEBUG] [MAIN ] PDO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:46.837599] [INFO ] [MAIN ] PDO: Generated 1326 derivative records from 22514 primary records. [2025-09-15T21:19:46.812048] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-15T21:19:46.846008] [INFO ] [MAIN ] Derivative Progress: 1433/2083 symbols completed. PDS took 0.9s. Estimated remaining: 3m 36s. Rate: 181.0 symbols/min [2025-09-15T21:19:46.854376] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-15T21:19:46.854668] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:46.923164] [DEBUG] [LOCAL ] PDO: Derivative data saved (1326 records). [2025-09-15T21:19:46.923364] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-15T21:19:46.933803] [INFO ] [MAIN ] Derivative Progress: 1434/2083 symbols completed. PDO took 1.2s. Estimated remaining: 3m 35s. Rate: 181.1 symbols/min [2025-09-15T21:19:46.939275] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:46.954839] [DEBUG] [LOCAL ] PDX: Loaded 10423 existing records from primary storage. [2025-09-15T21:19:46.976152] [INFO ] [MAIN ] PDX: Loaded 10423 primary data records. [2025-09-15T21:19:47.430520] [DEBUG] [LOCAL ] PEB: Loaded 37283 existing records from primary storage. [2025-09-15T21:19:47.441462] [INFO ] [MAIN ] PEB: Loaded 37283 primary data records. [2025-09-15T21:19:47.753068] [DEBUG] [MAIN ] PDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:47.755944] [INFO ] [MAIN ] PDT: Generated 1326 derivative records from 12890 primary records. [2025-09-15T21:19:47.762144] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-15T21:19:47.767909] [DEBUG] [MAIN ] PDX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:47.769587] [INFO ] [MAIN ] PDX: Generated 1326 derivative records from 10423 primary records. [2025-09-15T21:19:47.770097] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-15T21:19:47.797111] [DEBUG] [LOCAL ] PDX: Derivative data saved (1326 records). [2025-09-15T21:19:47.793894] [DEBUG] [LOCAL ] PDT: Derivative data saved (1326 records). [2025-09-15T21:19:47.797452] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-15T21:19:47.797546] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-15T21:19:47.799664] [INFO ] [MAIN ] Derivative Progress: 1435/2083 symbols completed. PDX took 0.9s. Estimated remaining: 3m 35s. Rate: 180.9 symbols/min [2025-09-15T21:19:47.802727] [INFO ] [MAIN ] Derivative Progress: 1436/2083 symbols completed. PDT took 1.1s. Estimated remaining: 3m 34s. Rate: 181.0 symbols/min [2025-09-15T21:19:47.802850] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:47.803477] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:47.818053] [DEBUG] [MAIN ] PEB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:47.818868] [INFO ] [MAIN ] PEB: Generated 1326 derivative records from 37283 primary records. [2025-09-15T21:19:47.819464] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-15T21:19:47.832182] [DEBUG] [LOCAL ] PEB: Derivative data saved (1326 records). [2025-09-15T21:19:47.839473] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-15T21:19:47.841775] [INFO ] [MAIN ] Derivative Progress: 1437/2083 symbols completed. PEB took 0.9s. Estimated remaining: 3m 34s. Rate: 181.1 symbols/min [2025-09-15T21:19:47.842095] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:47.853593] [DEBUG] [LOCAL ] PEN: Loaded 22345 existing records from primary storage. [2025-09-15T21:19:47.856683] [INFO ] [MAIN ] PEN: Loaded 22345 primary data records. [2025-09-15T21:19:47.930256] [DEBUG] [LOCAL ] PEO: Loaded 7977 existing records from primary storage. [2025-09-15T21:19:47.958095] [INFO ] [MAIN ] PEO: Loaded 7977 primary data records. [2025-09-15T21:19:48.025890] [DEBUG] [LOCAL ] PEG: Loaded 39246 existing records from primary storage. [2025-09-15T21:19:48.037958] [INFO ] [MAIN ] PEG: Loaded 39246 primary data records. [2025-09-15T21:19:48.771050] [DEBUG] [MAIN ] PEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:48.774092] [INFO ] [MAIN ] PEN: Generated 1326 derivative records from 22345 primary records. [2025-09-15T21:19:48.782712] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-15T21:19:48.791388] [DEBUG] [MAIN ] PEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:48.795774] [INFO ] [MAIN ] PEO: Generated 1326 derivative records from 7977 primary records. [2025-09-15T21:19:48.803952] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-15T21:19:48.842770] [DEBUG] [MAIN ] PEG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:48.846703] [INFO ] [MAIN ] PEG: Generated 1326 derivative records from 39246 primary records. [2025-09-15T21:19:48.848199] [DEBUG] [LOCAL ] PEN: Derivative data saved (1326 records). [2025-09-15T21:19:48.848334] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-15T21:19:48.849033] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-15T21:19:48.849898] [DEBUG] [LOCAL ] PEO: Derivative data saved (1326 records). [2025-09-15T21:19:48.853564] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-15T21:19:48.852541] [INFO ] [MAIN ] Derivative Progress: 1438/2083 symbols completed. PEN took 1.0s. Estimated remaining: 3m 34s. Rate: 180.8 symbols/min [2025-09-15T21:19:48.857460] [INFO ] [MAIN ] Derivative Progress: 1439/2083 symbols completed. PEO took 1.0s. Estimated remaining: 3m 34s. Rate: 181.0 symbols/min [2025-09-15T21:19:48.874337] [DEBUG] [LOCAL ] PEG: Derivative data saved (1326 records). [2025-09-15T21:19:48.874446] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-15T21:19:48.877878] [INFO ] [MAIN ] Derivative Progress: 1440/2083 symbols completed. PEG took 1.1s. Estimated remaining: 3m 33s. Rate: 181.1 symbols/min [2025-09-15T21:19:48.878585] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:48.879053] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:48.878743] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:48.888021] [DEBUG] [LOCAL ] PFD: Loaded 3798 existing records from primary storage. [2025-09-15T21:19:48.888158] [INFO ] [MAIN ] PFD: Loaded 3798 primary data records. [2025-09-15T21:19:49.002931] [DEBUG] [LOCAL ] PERF: Loaded 11331 existing records from primary storage. [2025-09-15T21:19:49.008803] [INFO ] [MAIN ] PERF: Loaded 11331 primary data records. [2025-09-15T21:19:49.296394] [DEBUG] [LOCAL ] PFE: Loaded 39773 existing records from primary storage. [2025-09-15T21:19:49.318038] [INFO ] [MAIN ] PFE: Loaded 39773 primary data records. [2025-09-15T21:19:49.795563] [DEBUG] [MAIN ] PFD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:49.797193] [INFO ] [MAIN ] PFD: Generated 1326 derivative records from 3798 primary records. [2025-09-15T21:19:49.797298] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-15T21:19:49.810313] [DEBUG] [LOCAL ] PFD: Derivative data saved (1326 records). [2025-09-15T21:19:49.810597] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-15T21:19:49.812664] [INFO ] [MAIN ] Derivative Progress: 1441/2083 symbols completed. PFD took 0.9s. Estimated remaining: 3m 33s. Rate: 180.9 symbols/min [2025-09-15T21:19:49.814075] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:49.826935] [DEBUG] [MAIN ] PERF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:49.827985] [INFO ] [MAIN ] PERF: Generated 1326 derivative records from 11331 primary records. [2025-09-15T21:19:49.828303] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-15T21:19:49.842573] [DEBUG] [LOCAL ] PERF: Derivative data saved (1326 records). [2025-09-15T21:19:49.852825] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-15T21:19:49.855762] [INFO ] [MAIN ] Derivative Progress: 1442/2083 symbols completed. PERF took 1.0s. Estimated remaining: 3m 33s. Rate: 181.0 symbols/min [2025-09-15T21:19:49.856046] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:49.853636] [DEBUG] [MAIN ] PFE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:49.856967] [INFO ] [MAIN ] PFE: Generated 1326 derivative records from 39773 primary records. [2025-09-15T21:19:49.857483] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-15T21:19:49.879860] [DEBUG] [LOCAL ] PFE: Derivative data saved (1326 records). [2025-09-15T21:19:49.880008] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-15T21:19:49.882093] [INFO ] [MAIN ] Derivative Progress: 1443/2083 symbols completed. PFE took 1.0s. Estimated remaining: 3m 32s. Rate: 181.1 symbols/min [2025-09-15T21:19:49.883032] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:49.898024] [DEBUG] [LOCAL ] PFH: Loaded 5083 existing records from primary storage. [2025-09-15T21:19:49.899327] [INFO ] [MAIN ] PFH: Loaded 5083 primary data records. [2025-09-15T21:19:49.899183] [DEBUG] [LOCAL ] PFGC: Loaded 34948 existing records from primary storage. [2025-09-15T21:19:49.932017] [INFO ] [MAIN ] PFGC: Loaded 34948 primary data records. [2025-09-15T21:19:50.102318] [DEBUG] [LOCAL ] PFL: Loaded 9701 existing records from primary storage. [2025-09-15T21:19:50.134154] [INFO ] [MAIN ] PFL: Loaded 9701 primary data records. [2025-09-15T21:19:50.841967] [DEBUG] [MAIN ] PFGC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:50.844011] [INFO ] [MAIN ] PFGC: Generated 1326 derivative records from 34948 primary records. [2025-09-15T21:19:50.844298] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-15T21:19:50.861867] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1326 records). [2025-09-15T21:19:50.863347] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-15T21:19:50.867220] [INFO ] [MAIN ] Derivative Progress: 1444/2083 symbols completed. PFGC took 1.1s. Estimated remaining: 3m 32s. Rate: 180.8 symbols/min [2025-09-15T21:19:50.877115] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:50.878963] [DEBUG] [MAIN ] PFH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:50.880088] [INFO ] [MAIN ] PFH: Generated 1326 derivative records from 5083 primary records. [2025-09-15T21:19:50.880305] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-15T21:19:50.893628] [DEBUG] [LOCAL ] PFH: Derivative data saved (1326 records). [2025-09-15T21:19:50.893933] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-15T21:19:50.895997] [INFO ] [MAIN ] Derivative Progress: 1445/2083 symbols completed. PFH took 1.0s. Estimated remaining: 3m 32s. Rate: 180.9 symbols/min [2025-09-15T21:19:50.896602] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:50.917225] [DEBUG] [MAIN ] PFL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:50.918244] [INFO ] [MAIN ] PFL: Generated 1326 derivative records from 9701 primary records. [2025-09-15T21:19:50.918387] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-15T21:19:50.956529] [DEBUG] [LOCAL ] PFL: Derivative data saved (1326 records). [2025-09-15T21:19:50.957356] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-15T21:19:50.957247] [DEBUG] [LOCAL ] PFN: Loaded 15476 existing records from primary storage. [2025-09-15T21:19:50.962127] [INFO ] [MAIN ] Derivative Progress: 1446/2083 symbols completed. PFL took 1.1s. Estimated remaining: 3m 31s. Rate: 181.0 symbols/min [2025-09-15T21:19:50.962580] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:50.962911] [INFO ] [MAIN ] PFN: Loaded 15476 primary data records. [2025-09-15T21:19:51.059463] [DEBUG] [LOCAL ] PFLT: Loaded 31333 existing records from primary storage. [2025-09-15T21:19:51.075950] [DEBUG] [LOCAL ] PFO: Loaded 4455 existing records from primary storage. [2025-09-15T21:19:51.069392] [INFO ] [MAIN ] PFLT: Loaded 31333 primary data records. [2025-09-15T21:19:51.087880] [INFO ] [MAIN ] PFO: Loaded 4455 primary data records. [2025-09-15T21:19:51.877492] [DEBUG] [MAIN ] PFN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:51.878952] [INFO ] [MAIN ] PFN: Generated 1326 derivative records from 15476 primary records. [2025-09-15T21:19:51.879191] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-15T21:19:51.898546] [DEBUG] [LOCAL ] PFN: Derivative data saved (1326 records). [2025-09-15T21:19:51.899044] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-15T21:19:51.902037] [INFO ] [MAIN ] Derivative Progress: 1447/2083 symbols completed. PFN took 1.0s. Estimated remaining: 3m 31s. Rate: 180.8 symbols/min [2025-09-15T21:19:51.903459] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:51.915212] [DEBUG] [MAIN ] PFO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:51.922551] [INFO ] [MAIN ] PFO: Generated 1326 derivative records from 4455 primary records. [2025-09-15T21:19:51.926833] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-15T21:19:51.927076] [DEBUG] [MAIN ] PFLT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:51.929333] [INFO ] [MAIN ] PFLT: Generated 1326 derivative records from 31333 primary records. [2025-09-15T21:19:51.929515] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-15T21:19:51.951205] [DEBUG] [LOCAL ] PFO: Derivative data saved (1326 records). [2025-09-15T21:19:51.951345] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-15T21:19:51.955327] [INFO ] [MAIN ] Derivative Progress: 1448/2083 symbols completed. PFO took 1.0s. Estimated remaining: 3m 31s. Rate: 180.9 symbols/min [2025-09-15T21:19:51.957601] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:51.959124] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1326 records). [2025-09-15T21:19:51.959294] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-15T21:19:51.962990] [INFO ] [MAIN ] Derivative Progress: 1449/2083 symbols completed. PFLT took 1.1s. Estimated remaining: 3m 30s. Rate: 181.0 symbols/min [2025-09-15T21:19:51.975633] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:51.988918] [DEBUG] [LOCAL ] PFS: Loaded 25329 existing records from primary storage. [2025-09-15T21:19:51.989218] [INFO ] [MAIN ] PFS: Loaded 25329 primary data records. [2025-09-15T21:19:52.130217] [DEBUG] [LOCAL ] PFSI: Loaded 20742 existing records from primary storage. [2025-09-15T21:19:52.159306] [INFO ] [MAIN ] PFSI: Loaded 20742 primary data records. [2025-09-15T21:19:52.258152] [DEBUG] [LOCAL ] PG: Loaded 39714 existing records from primary storage. [2025-09-15T21:19:52.269233] [INFO ] [MAIN ] PG: Loaded 39714 primary data records. [2025-09-15T21:19:52.970374] [DEBUG] [MAIN ] PFS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:52.971840] [INFO ] [MAIN ] PFS: Generated 1326 derivative records from 25329 primary records. [2025-09-15T21:19:52.972591] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-15T21:19:52.989191] [DEBUG] [LOCAL ] PFS: Derivative data saved (1326 records). [2025-09-15T21:19:52.989789] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-15T21:19:52.991463] [INFO ] [MAIN ] Derivative Progress: 1450/2083 symbols completed. PFS took 1.1s. Estimated remaining: 3m 30s. Rate: 180.8 symbols/min [2025-09-15T21:19:52.992265] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:53.009443] [DEBUG] [LOCAL ] PGP: Loaded 3996 existing records from primary storage. [2025-09-15T21:19:53.010065] [INFO ] [MAIN ] PGP: Loaded 3996 primary data records. [2025-09-15T21:19:53.022084] [DEBUG] [MAIN ] PG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:53.054507] [INFO ] [MAIN ] PG: Generated 1326 derivative records from 39714 primary records. [2025-09-15T21:19:53.080551] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-15T21:19:53.225636] [DEBUG] [LOCAL ] PG: Derivative data saved (1326 records). [2025-09-15T21:19:53.222754] [DEBUG] [MAIN ] PFSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:53.226936] [INFO ] [MAIN ] PFSI: Generated 1326 derivative records from 20742 primary records. [2025-09-15T21:19:53.227110] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-15T21:19:53.302068] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-15T21:19:53.301894] [INFO ] [MAIN ] Derivative Progress: 1451/2083 symbols completed. PG took 1.3s. Estimated remaining: 3m 30s. Rate: 180.8 symbols/min [2025-09-15T21:19:53.315238] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:53.331183] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1326 records). [2025-09-15T21:19:53.331990] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-15T21:19:53.336247] [INFO ] [MAIN ] Derivative Progress: 1452/2083 symbols completed. PFSI took 1.4s. Estimated remaining: 3m 29s. Rate: 180.9 symbols/min [2025-09-15T21:19:53.336814] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:53.355368] [DEBUG] [MAIN ] PGP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:53.356054] [INFO ] [MAIN ] PGP: Generated 1326 derivative records from 3996 primary records. [2025-09-15T21:19:53.368141] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-15T21:19:53.387957] [DEBUG] [LOCAL ] PGP: Derivative data saved (1326 records). [2025-09-15T21:19:53.388118] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-15T21:19:53.401057] [INFO ] [MAIN ] Derivative Progress: 1453/2083 symbols completed. PGP took 0.4s. Estimated remaining: 3m 29s. Rate: 181.0 symbols/min [2025-09-15T21:19:53.402282] [DEBUG] [LOCAL ] PGR: Loaded 39044 existing records from primary storage. [2025-09-15T21:19:53.402441] [INFO ] [MAIN ] PGR: Loaded 39044 primary data records. [2025-09-15T21:19:53.512475] [DEBUG] [LOCAL ] PGRE: Loaded 34520 existing records from primary storage. [2025-09-15T21:19:53.528772] [INFO ] [MAIN ] PGRE: Loaded 34520 primary data records. [2025-09-15T21:19:53.999230] [DEBUG] [MAIN ] PGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:54.000039] [INFO ] [MAIN ] PGR: Generated 1326 derivative records from 39044 primary records. [2025-09-15T21:19:54.000272] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-15T21:19:54.013455] [DEBUG] [LOCAL ] PGR: Derivative data saved (1326 records). [2025-09-15T21:19:54.013635] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-15T21:19:54.016993] [INFO ] [MAIN ] Derivative Progress: 1454/2083 symbols completed. PGR took 0.7s. Estimated remaining: 3m 29s. Rate: 180.9 symbols/min [2025-09-15T21:19:54.030359] [DEBUG] [MAIN ] PGRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:54.031127] [INFO ] [MAIN ] PGRE: Generated 1326 derivative records from 34520 primary records. [2025-09-15T21:19:54.031270] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-15T21:19:54.043275] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1326 records). [2025-09-15T21:19:54.043370] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-15T21:19:54.045990] [INFO ] [MAIN ] Derivative Progress: 1455/2083 symbols completed. PGRE took 0.7s. Estimated remaining: 3m 28s. Rate: 181.0 symbols/min [2025-09-15T21:19:54.046845] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:54.046958] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:54.047259] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:54.058069] [DEBUG] [LOCAL ] PGZ: Loaded 4127 existing records from primary storage. [2025-09-15T21:19:54.062242] [INFO ] [MAIN ] PGZ: Loaded 4127 primary data records. [2025-09-15T21:19:54.062537] [DEBUG] [LOCAL ] PHD: Loaded 6800 existing records from primary storage. [2025-09-15T21:19:54.118447] [INFO ] [MAIN ] PHD: Loaded 6800 primary data records. [2025-09-15T21:19:54.457407] [DEBUG] [LOCAL ] PH: Loaded 27509 existing records from primary storage. [2025-09-15T21:19:54.479360] [INFO ] [MAIN ] PH: Loaded 27509 primary data records. [2025-09-15T21:19:54.998033] [DEBUG] [MAIN ] PGZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:54.998948] [INFO ] [MAIN ] PGZ: Generated 1326 derivative records from 4127 primary records. [2025-09-15T21:19:54.999057] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-15T21:19:55.014591] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1326 records). [2025-09-15T21:19:55.015066] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-15T21:19:55.016872] [INFO ] [MAIN ] Derivative Progress: 1456/2083 symbols completed. PGZ took 1.0s. Estimated remaining: 3m 28s. Rate: 180.8 symbols/min [2025-09-15T21:19:55.017210] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:55.028610] [DEBUG] [MAIN ] PHD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:55.029685] [INFO ] [MAIN ] PHD: Generated 1326 derivative records from 6800 primary records. [2025-09-15T21:19:55.029807] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-15T21:19:55.054744] [DEBUG] [LOCAL ] PHD: Derivative data saved (1326 records). [2025-09-15T21:19:55.055056] [DEBUG] [MAIN ] PH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:55.055263] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-15T21:19:55.055954] [INFO ] [MAIN ] PH: Generated 1326 derivative records from 27509 primary records. [2025-09-15T21:19:55.057931] [INFO ] [MAIN ] Derivative Progress: 1457/2083 symbols completed. PHD took 1.0s. Estimated remaining: 3m 28s. Rate: 180.9 symbols/min [2025-09-15T21:19:55.058095] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-15T21:19:55.073692] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:55.081199] [DEBUG] [LOCAL ] PH: Derivative data saved (1326 records). [2025-09-15T21:19:55.091867] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-15T21:19:55.094086] [INFO ] [MAIN ] Derivative Progress: 1458/2083 symbols completed. PH took 1.0s. Estimated remaining: 3m 27s. Rate: 181.0 symbols/min [2025-09-15T21:19:55.094979] [DEBUG] [LOCAL ] PHG: Loaded 33960 existing records from primary storage. [2025-09-15T21:19:55.094436] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:55.098132] [INFO ] [MAIN ] PHG: Loaded 33960 primary data records. [2025-09-15T21:19:55.180079] [DEBUG] [LOCAL ] PHI: Loaded 10763 existing records from primary storage. [2025-09-15T21:19:55.203846] [INFO ] [MAIN ] PHI: Loaded 10763 primary data records. [2025-09-15T21:19:55.406553] [DEBUG] [LOCAL ] PHIN: Loaded 23192 existing records from primary storage. [2025-09-15T21:19:55.409613] [INFO ] [MAIN ] PHIN: Loaded 23192 primary data records. [2025-09-15T21:19:55.964272] [DEBUG] [MAIN ] PHG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:55.965022] [INFO ] [MAIN ] PHG: Generated 1326 derivative records from 33960 primary records. [2025-09-15T21:19:55.965521] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-15T21:19:55.991173] [DEBUG] [MAIN ] PHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:55.991246] [DEBUG] [LOCAL ] PHG: Derivative data saved (1326 records). [2025-09-15T21:19:55.992088] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-15T21:19:55.993725] [INFO ] [MAIN ] Derivative Progress: 1459/2083 symbols completed. PHG took 1.0s. Estimated remaining: 3m 27s. Rate: 180.8 symbols/min [2025-09-15T21:19:55.991961] [INFO ] [MAIN ] PHI: Generated 1326 derivative records from 10763 primary records. [2025-09-15T21:19:55.993957] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-15T21:19:55.994145] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:56.007604] [DEBUG] [LOCAL ] PHI: Derivative data saved (1326 records). [2025-09-15T21:19:56.007964] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-15T21:19:56.009797] [INFO ] [MAIN ] Derivative Progress: 1460/2083 symbols completed. PHI took 1.0s. Estimated remaining: 3m 27s. Rate: 180.9 symbols/min [2025-09-15T21:19:56.010072] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:56.027717] [DEBUG] [MAIN ] PHIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:56.028502] [INFO ] [MAIN ] PHIN: Generated 1326 derivative records from 23192 primary records. [2025-09-15T21:19:56.028598] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-15T21:19:56.047913] [DEBUG] [LOCAL ] PHK: Loaded 19047 existing records from primary storage. [2025-09-15T21:19:56.048366] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1326 records). [2025-09-15T21:19:56.048529] [INFO ] [MAIN ] PHK: Loaded 19047 primary data records. [2025-09-15T21:19:56.048700] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-15T21:19:56.071201] [INFO ] [MAIN ] Derivative Progress: 1461/2083 symbols completed. PHIN took 1.0s. Estimated remaining: 3m 26s. Rate: 181.0 symbols/min [2025-09-15T21:19:56.087121] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:56.213442] [DEBUG] [LOCAL ] PHM: Loaded 38096 existing records from primary storage. [2025-09-15T21:19:56.255809] [INFO ] [MAIN ] PHM: Loaded 38096 primary data records. [2025-09-15T21:19:56.459832] [DEBUG] [LOCAL ] PHR: Loaded 27259 existing records from primary storage. [2025-09-15T21:19:56.476296] [INFO ] [MAIN ] PHR: Loaded 27259 primary data records. [2025-09-15T21:19:56.990208] [DEBUG] [MAIN ] PHK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:56.991610] [INFO ] [MAIN ] PHK: Generated 1326 derivative records from 19047 primary records. [2025-09-15T21:19:56.992884] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-15T21:19:57.009517] [DEBUG] [LOCAL ] PHK: Derivative data saved (1326 records). [2025-09-15T21:19:57.009682] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-15T21:19:57.011619] [INFO ] [MAIN ] Derivative Progress: 1462/2083 symbols completed. PHK took 1.0s. Estimated remaining: 3m 26s. Rate: 180.8 symbols/min [2025-09-15T21:19:57.015674] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:57.028869] [DEBUG] [MAIN ] PHM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:57.029756] [INFO ] [MAIN ] PHM: Generated 1326 derivative records from 38096 primary records. [2025-09-15T21:19:57.030082] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-15T21:19:57.048708] [DEBUG] [LOCAL ] PHM: Derivative data saved (1326 records). [2025-09-15T21:19:57.049109] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-15T21:19:57.051973] [INFO ] [MAIN ] Derivative Progress: 1463/2083 symbols completed. PHM took 1.0s. Estimated remaining: 3m 26s. Rate: 180.9 symbols/min [2025-09-15T21:19:57.052477] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:57.072160] [DEBUG] [MAIN ] PHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:57.072301] [DEBUG] [LOCAL ] PHT: Loaded 11962 existing records from primary storage. [2025-09-15T21:19:57.073497] [INFO ] [MAIN ] PHT: Loaded 11962 primary data records. [2025-09-15T21:19:57.073397] [INFO ] [MAIN ] PHR: Generated 1326 derivative records from 27259 primary records. [2025-09-15T21:19:57.085519] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-15T21:19:57.164801] [DEBUG] [LOCAL ] PHR: Derivative data saved (1326 records). [2025-09-15T21:19:57.188670] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-15T21:19:57.211415] [INFO ] [MAIN ] Derivative Progress: 1464/2083 symbols completed. PHR took 1.1s. Estimated remaining: 3m 25s. Rate: 180.9 symbols/min [2025-09-15T21:19:57.212272] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:57.310431] [DEBUG] [LOCAL ] PII: Loaded 36232 existing records from primary storage. [2025-09-15T21:19:57.354949] [INFO ] [MAIN ] PII: Loaded 36232 primary data records. [2025-09-15T21:19:57.485303] [DEBUG] [LOCAL ] PIM: Loaded 3724 existing records from primary storage. [2025-09-15T21:19:57.497693] [INFO ] [MAIN ] PIM: Loaded 3724 primary data records. [2025-09-15T21:19:57.969596] [DEBUG] [MAIN ] PHT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:57.971774] [INFO ] [MAIN ] PHT: Generated 1326 derivative records from 11962 primary records. [2025-09-15T21:19:57.972110] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-15T21:19:57.986542] [DEBUG] [LOCAL ] PHT: Derivative data saved (1326 records). [2025-09-15T21:19:57.988921] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-15T21:19:57.991697] [INFO ] [MAIN ] Derivative Progress: 1465/2083 symbols completed. PHT took 1.0s. Estimated remaining: 3m 25s. Rate: 180.8 symbols/min [2025-09-15T21:19:57.992253] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:58.008501] [DEBUG] [MAIN ] PII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:58.009487] [INFO ] [MAIN ] PII: Generated 1326 derivative records from 36232 primary records. [2025-09-15T21:19:58.009752] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-15T21:19:58.031526] [DEBUG] [LOCAL ] PII: Derivative data saved (1326 records). [2025-09-15T21:19:58.031809] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-15T21:19:58.034471] [INFO ] [MAIN ] Derivative Progress: 1466/2083 symbols completed. PII took 1.0s. Estimated remaining: 3m 25s. Rate: 180.9 symbols/min [2025-09-15T21:19:58.035017] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:58.045311] [DEBUG] [MAIN ] PIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:58.046407] [INFO ] [MAIN ] PIM: Generated 1326 derivative records from 3724 primary records. [2025-09-15T21:19:58.051036] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-15T21:19:58.051303] [DEBUG] [LOCAL ] PINE: Loaded 10370 existing records from primary storage. [2025-09-15T21:19:58.052036] [INFO ] [MAIN ] PINE: Loaded 10370 primary data records. [2025-09-15T21:19:58.166750] [DEBUG] [LOCAL ] PIM: Derivative data saved (1326 records). [2025-09-15T21:19:58.166932] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-15T21:19:58.168749] [INFO ] [MAIN ] Derivative Progress: 1467/2083 symbols completed. PIM took 1.0s. Estimated remaining: 3m 24s. Rate: 181.0 symbols/min [2025-09-15T21:19:58.169472] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:58.350086] [DEBUG] [LOCAL ] PINS: Loaded 39653 existing records from primary storage. [2025-09-15T21:19:58.354676] [DEBUG] [LOCAL ] PIPR: Loaded 10817 existing records from primary storage. [2025-09-15T21:19:58.354410] [INFO ] [MAIN ] PINS: Loaded 39653 primary data records. [2025-09-15T21:19:58.354821] [INFO ] [MAIN ] PIPR: Loaded 10817 primary data records. [2025-09-15T21:19:58.913923] [DEBUG] [MAIN ] PINE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:58.915027] [INFO ] [MAIN ] PINE: Generated 1326 derivative records from 10370 primary records. [2025-09-15T21:19:58.915362] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-15T21:19:58.935086] [DEBUG] [LOCAL ] PINE: Derivative data saved (1326 records). [2025-09-15T21:19:58.935505] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-15T21:19:58.938275] [INFO ] [MAIN ] Derivative Progress: 1468/2083 symbols completed. PINE took 0.9s. Estimated remaining: 3m 24s. Rate: 180.8 symbols/min [2025-09-15T21:19:58.952252] [DEBUG] [MAIN ] PINS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:58.953233] [INFO ] [MAIN ] PINS: Generated 1326 derivative records from 39653 primary records. [2025-09-15T21:19:58.953410] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-15T21:19:58.969145] [DEBUG] [MAIN ] PIPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:58.974438] [INFO ] [MAIN ] PIPR: Generated 1326 derivative records from 10817 primary records. [2025-09-15T21:19:58.976055] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-15T21:19:58.975987] [DEBUG] [LOCAL ] PINS: Derivative data saved (1326 records). [2025-09-15T21:19:58.976849] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-15T21:19:58.978671] [INFO ] [MAIN ] Derivative Progress: 1469/2083 symbols completed. PINS took 0.9s. Estimated remaining: 3m 24s. Rate: 180.9 symbols/min [2025-09-15T21:19:58.990164] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1326 records). [2025-09-15T21:19:58.990262] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-15T21:19:58.992387] [INFO ] [MAIN ] Derivative Progress: 1470/2083 symbols completed. PIPR took 0.8s. Estimated remaining: 3m 23s. Rate: 181.0 symbols/min [2025-09-15T21:19:58.993206] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:58.993312] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:58.993093] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:59.007758] [DEBUG] [LOCAL ] PKE: Loaded 9940 existing records from primary storage. [2025-09-15T21:19:59.007977] [INFO ] [MAIN ] PKE: Loaded 9940 primary data records. [2025-09-15T21:19:59.162393] [DEBUG] [LOCAL ] PJT: Loaded 15826 existing records from primary storage. [2025-09-15T21:19:59.198522] [INFO ] [MAIN ] PJT: Loaded 15826 primary data records. [2025-09-15T21:19:59.287589] [DEBUG] [LOCAL ] PK: Loaded 38953 existing records from primary storage. [2025-09-15T21:19:59.426153] [INFO ] [MAIN ] PK: Loaded 38953 primary data records. [2025-09-15T21:19:59.938405] [DEBUG] [MAIN ] PKE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:59.939864] [INFO ] [MAIN ] PKE: Generated 1326 derivative records from 9940 primary records. [2025-09-15T21:19:59.940143] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-15T21:19:59.956043] [DEBUG] [LOCAL ] PKE: Derivative data saved (1326 records). [2025-09-15T21:19:59.956193] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-15T21:19:59.957959] [INFO ] [MAIN ] Derivative Progress: 1471/2083 symbols completed. PKE took 1.0s. Estimated remaining: 3m 23s. Rate: 180.8 symbols/min [2025-09-15T21:19:59.958176] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:19:59.988556] [DEBUG] [MAIN ] PK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:59.988873] [DEBUG] [MAIN ] PJT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:19:59.990077] [INFO ] [MAIN ] PK: Generated 1326 derivative records from 38953 primary records. [2025-09-15T21:19:59.990326] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-15T21:19:59.990831] [INFO ] [MAIN ] PJT: Generated 1326 derivative records from 15826 primary records. [2025-09-15T21:19:59.991730] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-15T21:20:00.027092] [DEBUG] [LOCAL ] PK: Derivative data saved (1326 records). [2025-09-15T21:20:00.027670] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-15T21:20:00.030425] [INFO ] [MAIN ] Derivative Progress: 1472/2083 symbols completed. PK took 1.0s. Estimated remaining: 3m 23s. Rate: 180.9 symbols/min [2025-09-15T21:20:00.031116] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:00.043540] [DEBUG] [LOCAL ] PJT: Derivative data saved (1326 records). [2025-09-15T21:20:00.044687] [DEBUG] [LOCAL ] PKG: Loaded 28597 existing records from primary storage. [2025-09-15T21:20:00.045089] [INFO ] [MAIN ] PKG: Loaded 28597 primary data records. [2025-09-15T21:20:00.045366] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-15T21:20:00.069593] [INFO ] [MAIN ] Derivative Progress: 1473/2083 symbols completed. PJT took 1.1s. Estimated remaining: 3m 22s. Rate: 181.0 symbols/min [2025-09-15T21:20:00.092501] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:00.161243] [DEBUG] [LOCAL ] PKST: Loaded 12836 existing records from primary storage. [2025-09-15T21:20:00.166815] [INFO ] [MAIN ] PKST: Loaded 12836 primary data records. [2025-09-15T21:20:00.477874] [DEBUG] [LOCAL ] PKX: Loaded 16442 existing records from primary storage. [2025-09-15T21:20:00.497630] [INFO ] [MAIN ] PKX: Loaded 16442 primary data records. [2025-09-15T21:20:00.941700] [DEBUG] [MAIN ] PKG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:00.942142] [DEBUG] [MAIN ] PKST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:00.943241] [INFO ] [MAIN ] PKST: Generated 1326 derivative records from 12836 primary records. [2025-09-15T21:20:00.944550] [INFO ] [MAIN ] PKG: Generated 1326 derivative records from 28597 primary records. [2025-09-15T21:20:00.944886] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-15T21:20:00.944998] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-15T21:20:00.966976] [DEBUG] [LOCAL ] PKST: Derivative data saved (1326 records). [2025-09-15T21:20:00.969234] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-15T21:20:00.974866] [INFO ] [MAIN ] Derivative Progress: 1474/2083 symbols completed. PKST took 0.9s. Estimated remaining: 3m 22s. Rate: 180.8 symbols/min [2025-09-15T21:20:00.972451] [DEBUG] [LOCAL ] PKG: Derivative data saved (1326 records). [2025-09-15T21:20:00.975245] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-15T21:20:00.977593] [INFO ] [MAIN ] Derivative Progress: 1475/2083 symbols completed. PKG took 1.0s. Estimated remaining: 3m 22s. Rate: 180.9 symbols/min [2025-09-15T21:20:00.975449] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:00.978229] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:00.994231] [DEBUG] [MAIN ] PKX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:00.995246] [INFO ] [MAIN ] PKX: Generated 1326 derivative records from 16442 primary records. [2025-09-15T21:20:00.995360] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-15T21:20:01.009936] [DEBUG] [LOCAL ] PKX: Derivative data saved (1326 records). [2025-09-15T21:20:01.010072] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-15T21:20:01.014523] [INFO ] [MAIN ] Derivative Progress: 1476/2083 symbols completed. PKX took 0.9s. Estimated remaining: 3m 21s. Rate: 181.0 symbols/min [2025-09-15T21:20:01.015093] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:01.065947] [DEBUG] [LOCAL ] PLD: Loaded 39466 existing records from primary storage. [2025-09-15T21:20:01.066263] [INFO ] [MAIN ] PLD: Loaded 39466 primary data records. [2025-09-15T21:20:01.078424] [DEBUG] [LOCAL ] PL: Loaded 39249 existing records from primary storage. [2025-09-15T21:20:01.098361] [INFO ] [MAIN ] PL: Loaded 39249 primary data records. [2025-09-15T21:20:01.378535] [DEBUG] [LOCAL ] PLNT: Loaded 35594 existing records from primary storage. [2025-09-15T21:20:01.422498] [INFO ] [MAIN ] PLNT: Loaded 35594 primary data records. [2025-09-15T21:20:02.065401] [DEBUG] [MAIN ] PL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:02.066827] [INFO ] [MAIN ] PL: Generated 1326 derivative records from 39249 primary records. [2025-09-15T21:20:02.068443] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-15T21:20:02.085410] [DEBUG] [LOCAL ] PL: Derivative data saved (1326 records). [2025-09-15T21:20:02.086005] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-15T21:20:02.098944] [INFO ] [MAIN ] Derivative Progress: 1477/2083 symbols completed. PL took 1.1s. Estimated remaining: 3m 21s. Rate: 180.7 symbols/min [2025-09-15T21:20:02.100903] [DEBUG] [MAIN ] PLD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:02.102695] [INFO ] [MAIN ] PLD: Generated 1326 derivative records from 39466 primary records. [2025-09-15T21:20:02.101235] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:02.102931] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-15T21:20:02.136409] [DEBUG] [LOCAL ] PLD: Derivative data saved (1326 records). [2025-09-15T21:20:02.136845] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-15T21:20:02.151698] [INFO ] [MAIN ] Derivative Progress: 1478/2083 symbols completed. PLD took 1.2s. Estimated remaining: 3m 21s. Rate: 180.8 symbols/min [2025-09-15T21:20:02.152752] [DEBUG] [MAIN ] PLNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:02.153060] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:02.160246] [INFO ] [MAIN ] PLNT: Generated 1326 derivative records from 35594 primary records. [2025-09-15T21:20:02.160771] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-15T21:20:02.162179] [DEBUG] [LOCAL ] PLOW: Loaded 15202 existing records from primary storage. [2025-09-15T21:20:02.162543] [INFO ] [MAIN ] PLOW: Loaded 15202 primary data records. [2025-09-15T21:20:02.299369] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1326 records). [2025-09-15T21:20:02.299626] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-15T21:20:02.302576] [INFO ] [MAIN ] Derivative Progress: 1479/2083 symbols completed. PLNT took 1.3s. Estimated remaining: 3m 20s. Rate: 180.9 symbols/min [2025-09-15T21:20:02.303576] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:02.368444] [DEBUG] [LOCAL ] PLYM: Loaded 24381 existing records from primary storage. [2025-09-15T21:20:02.400047] [INFO ] [MAIN ] PLYM: Loaded 24381 primary data records. [2025-09-15T21:20:02.685435] [DEBUG] [LOCAL ] PM: Loaded 39637 existing records from primary storage. [2025-09-15T21:20:02.713029] [INFO ] [MAIN ] PM: Loaded 39637 primary data records. [2025-09-15T21:20:02.996428] [DEBUG] [MAIN ] PLOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:03.005770] [INFO ] [MAIN ] PLOW: Generated 1326 derivative records from 15202 primary records. [2025-09-15T21:20:03.005912] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-15T21:20:03.126038] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1326 records). [2025-09-15T21:20:03.126295] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-15T21:20:03.128632] [INFO ] [MAIN ] Derivative Progress: 1480/2083 symbols completed. PLOW took 1.0s. Estimated remaining: 3m 20s. Rate: 180.7 symbols/min [2025-09-15T21:20:03.129688] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:03.140917] [DEBUG] [MAIN ] PLYM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:03.143220] [INFO ] [MAIN ] PLYM: Generated 1326 derivative records from 24381 primary records. [2025-09-15T21:20:03.143419] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-15T21:20:03.157959] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1326 records). [2025-09-15T21:20:03.158321] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-15T21:20:03.161451] [INFO ] [MAIN ] Derivative Progress: 1481/2083 symbols completed. PLYM took 1.0s. Estimated remaining: 3m 20s. Rate: 180.8 symbols/min [2025-09-15T21:20:03.162183] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:03.192680] [DEBUG] [MAIN ] PM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:03.192035] [DEBUG] [LOCAL ] PML: Loaded 15390 existing records from primary storage. [2025-09-15T21:20:03.196862] [INFO ] [MAIN ] PM: Generated 1326 derivative records from 39637 primary records. [2025-09-15T21:20:03.196954] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-15T21:20:03.196157] [DEBUG] [LOCAL ] PMM: Loaded 6727 existing records from primary storage. [2025-09-15T21:20:03.197033] [INFO ] [MAIN ] PML: Loaded 15390 primary data records. [2025-09-15T21:20:03.197906] [INFO ] [MAIN ] PMM: Loaded 6727 primary data records. [2025-09-15T21:20:03.426968] [DEBUG] [LOCAL ] PM: Derivative data saved (1326 records). [2025-09-15T21:20:03.427507] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-15T21:20:03.456298] [INFO ] [MAIN ] Derivative Progress: 1482/2083 symbols completed. PM took 1.2s. Estimated remaining: 3m 19s. Rate: 180.8 symbols/min [2025-09-15T21:20:03.546441] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:03.772933] [DEBUG] [LOCAL ] PMO: Loaded 6801 existing records from primary storage. [2025-09-15T21:20:03.773580] [INFO ] [MAIN ] PMO: Loaded 6801 primary data records. [2025-09-15T21:20:04.141485] [DEBUG] [MAIN ] PML: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:04.142882] [INFO ] [MAIN ] PML: Generated 1326 derivative records from 15390 primary records. [2025-09-15T21:20:04.148821] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-15T21:20:04.154205] [DEBUG] [MAIN ] PMM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:04.166327] [INFO ] [MAIN ] PMM: Generated 1326 derivative records from 6727 primary records. [2025-09-15T21:20:04.168247] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-15T21:20:04.168340] [DEBUG] [LOCAL ] PML: Derivative data saved (1326 records). [2025-09-15T21:20:04.169250] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-15T21:20:04.172410] [INFO ] [MAIN ] Derivative Progress: 1483/2083 symbols completed. PML took 1.0s. Estimated remaining: 3m 19s. Rate: 180.7 symbols/min [2025-09-15T21:20:04.184270] [DEBUG] [LOCAL ] PMM: Derivative data saved (1326 records). [2025-09-15T21:20:04.184407] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-15T21:20:04.186610] [INFO ] [MAIN ] Derivative Progress: 1484/2083 symbols completed. PMM took 1.0s. Estimated remaining: 3m 19s. Rate: 180.8 symbols/min [2025-09-15T21:20:04.201097] [DEBUG] [MAIN ] PMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:04.201737] [INFO ] [MAIN ] PMO: Generated 1326 derivative records from 6801 primary records. [2025-09-15T21:20:04.201801] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-15T21:20:04.213536] [DEBUG] [LOCAL ] PMO: Derivative data saved (1326 records). [2025-09-15T21:20:04.213603] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-15T21:20:04.216224] [INFO ] [MAIN ] Derivative Progress: 1485/2083 symbols completed. PMO took 0.7s. Estimated remaining: 3m 18s. Rate: 180.9 symbols/min [2025-09-15T21:20:04.216966] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:04.217355] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:04.217130] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:04.229100] [DEBUG] [LOCAL ] PNI: Loaded 4886 existing records from primary storage. [2025-09-15T21:20:04.229327] [INFO ] [MAIN ] PNI: Loaded 4886 primary data records. [2025-09-15T21:20:04.430285] [DEBUG] [LOCAL ] PMT: Loaded 29148 existing records from primary storage. [2025-09-15T21:20:04.452573] [INFO ] [MAIN ] PMT: Loaded 29148 primary data records. [2025-09-15T21:20:04.558857] [DEBUG] [LOCAL ] PNC: Loaded 38496 existing records from primary storage. [2025-09-15T21:20:04.586607] [INFO ] [MAIN ] PNC: Loaded 38496 primary data records. [2025-09-15T21:20:05.183577] [DEBUG] [MAIN ] PNI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:05.185557] [INFO ] [MAIN ] PNI: Generated 1326 derivative records from 4886 primary records. [2025-09-15T21:20:05.186475] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-15T21:20:05.214010] [DEBUG] [LOCAL ] PNI: Derivative data saved (1326 records). [2025-09-15T21:20:05.215856] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-15T21:20:05.215688] [DEBUG] [MAIN ] PMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:05.221359] [INFO ] [MAIN ] Derivative Progress: 1486/2083 symbols completed. PNI took 1.0s. Estimated remaining: 3m 18s. Rate: 180.7 symbols/min [2025-09-15T21:20:05.218447] [INFO ] [MAIN ] PMT: Generated 1326 derivative records from 29148 primary records. [2025-09-15T21:20:05.222151] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-15T21:20:05.222012] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:05.234143] [DEBUG] [MAIN ] PNC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:05.235100] [INFO ] [MAIN ] PNC: Generated 1326 derivative records from 38496 primary records. [2025-09-15T21:20:05.241115] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-15T21:20:05.258457] [DEBUG] [LOCAL ] PNC: Derivative data saved (1326 records). [2025-09-15T21:20:05.258912] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-15T21:20:05.261946] [INFO ] [MAIN ] Derivative Progress: 1487/2083 symbols completed. PNC took 1.0s. Estimated remaining: 3m 18s. Rate: 180.8 symbols/min [2025-09-15T21:20:05.262761] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:05.272259] [DEBUG] [LOCAL ] PMT: Derivative data saved (1326 records). [2025-09-15T21:20:05.272893] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-15T21:20:05.275470] [INFO ] [MAIN ] Derivative Progress: 1488/2083 symbols completed. PMT took 1.1s. Estimated remaining: 3m 17s. Rate: 180.9 symbols/min [2025-09-15T21:20:05.275962] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:05.291071] [DEBUG] [LOCAL ] PNNT: Loaded 23767 existing records from primary storage. [2025-09-15T21:20:05.291267] [INFO ] [MAIN ] PNNT: Loaded 23767 primary data records. [2025-09-15T21:20:05.529123] [DEBUG] [LOCAL ] PNW: Loaded 33968 existing records from primary storage. [2025-09-15T21:20:05.604379] [INFO ] [MAIN ] PNW: Loaded 33968 primary data records. [2025-09-15T21:20:05.615869] [DEBUG] [LOCAL ] POR: Loaded 34526 existing records from primary storage. [2025-09-15T21:20:05.616543] [INFO ] [MAIN ] POR: Loaded 34526 primary data records. [2025-09-15T21:20:06.183563] [DEBUG] [MAIN ] PNNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:06.185617] [INFO ] [MAIN ] PNNT: Generated 1326 derivative records from 23767 primary records. [2025-09-15T21:20:06.186409] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-15T21:20:06.200921] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1326 records). [2025-09-15T21:20:06.200988] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-15T21:20:06.202893] [INFO ] [MAIN ] Derivative Progress: 1489/2083 symbols completed. PNNT took 1.0s. Estimated remaining: 3m 17s. Rate: 180.7 symbols/min [2025-09-15T21:20:06.203220] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:06.227035] [DEBUG] [MAIN ] POR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:06.227328] [DEBUG] [MAIN ] PNW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:06.228027] [INFO ] [MAIN ] POR: Generated 1326 derivative records from 34526 primary records. [2025-09-15T21:20:06.228695] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-15T21:20:06.228537] [INFO ] [MAIN ] PNW: Generated 1326 derivative records from 33968 primary records. [2025-09-15T21:20:06.229476] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-15T21:20:06.241708] [DEBUG] [LOCAL ] POR: Derivative data saved (1326 records). [2025-09-15T21:20:06.241966] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-15T21:20:06.244161] [INFO ] [MAIN ] Derivative Progress: 1490/2083 symbols completed. POR took 1.0s. Estimated remaining: 3m 17s. Rate: 180.8 symbols/min [2025-09-15T21:20:06.252879] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:06.263829] [DEBUG] [LOCAL ] PNW: Derivative data saved (1326 records). [2025-09-15T21:20:06.264016] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-15T21:20:06.266042] [INFO ] [MAIN ] Derivative Progress: 1491/2083 symbols completed. PNW took 1.0s. Estimated remaining: 3m 16s. Rate: 180.9 symbols/min [2025-09-15T21:20:06.266384] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:06.279923] [DEBUG] [LOCAL ] POST: Loaded 28650 existing records from primary storage. [2025-09-15T21:20:06.280102] [INFO ] [MAIN ] POST: Loaded 28650 primary data records. [2025-09-15T21:20:06.537429] [DEBUG] [LOCAL ] PPG: Loaded 37105 existing records from primary storage. [2025-09-15T21:20:06.620869] [INFO ] [MAIN ] PPG: Loaded 37105 primary data records. [2025-09-15T21:20:06.621519] [DEBUG] [LOCAL ] PPL: Loaded 39499 existing records from primary storage. [2025-09-15T21:20:06.621768] [INFO ] [MAIN ] PPL: Loaded 39499 primary data records. [2025-09-15T21:20:07.188007] [DEBUG] [MAIN ] POST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:07.189374] [INFO ] [MAIN ] POST: Generated 1326 derivative records from 28650 primary records. [2025-09-15T21:20:07.189874] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-15T21:20:07.208822] [DEBUG] [LOCAL ] POST: Derivative data saved (1326 records). [2025-09-15T21:20:07.209301] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-15T21:20:07.212531] [INFO ] [MAIN ] Derivative Progress: 1492/2083 symbols completed. POST took 1.0s. Estimated remaining: 3m 16s. Rate: 180.7 symbols/min [2025-09-15T21:20:07.215529] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:07.228362] [DEBUG] [MAIN ] PPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:07.239073] [INFO ] [MAIN ] PPG: Generated 1326 derivative records from 37105 primary records. [2025-09-15T21:20:07.239408] [DEBUG] [MAIN ] PPL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:07.239508] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-15T21:20:07.240937] [INFO ] [MAIN ] PPL: Generated 1326 derivative records from 39499 primary records. [2025-09-15T21:20:07.241366] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-15T21:20:07.273668] [DEBUG] [LOCAL ] PPT: Loaded 14642 existing records from primary storage. [2025-09-15T21:20:07.273379] [DEBUG] [LOCAL ] PPL: Derivative data saved (1326 records). [2025-09-15T21:20:07.274384] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-15T21:20:07.277013] [INFO ] [MAIN ] Derivative Progress: 1493/2083 symbols completed. PPL took 1.0s. Estimated remaining: 3m 16s. Rate: 180.8 symbols/min [2025-09-15T21:20:07.274325] [INFO ] [MAIN ] PPT: Loaded 14642 primary data records. [2025-09-15T21:20:07.277712] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:07.277503] [DEBUG] [LOCAL ] PPG: Derivative data saved (1326 records). [2025-09-15T21:20:07.289455] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-15T21:20:07.310979] [INFO ] [MAIN ] Derivative Progress: 1494/2083 symbols completed. PPG took 1.1s. Estimated remaining: 3m 15s. Rate: 180.9 symbols/min [2025-09-15T21:20:07.316454] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:07.566535] [DEBUG] [LOCAL ] PRA: Loaded 25598 existing records from primary storage. [2025-09-15T21:20:07.567513] [INFO ] [MAIN ] PRA: Loaded 25598 primary data records. [2025-09-15T21:20:07.686032] [DEBUG] [LOCAL ] PR: Loaded 39574 existing records from primary storage. [2025-09-15T21:20:07.702058] [INFO ] [MAIN ] PR: Loaded 39574 primary data records. [2025-09-15T21:20:08.131443] [DEBUG] [MAIN ] PPT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:08.132746] [INFO ] [MAIN ] PPT: Generated 1326 derivative records from 14642 primary records. [2025-09-15T21:20:08.133163] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-15T21:20:08.150570] [DEBUG] [LOCAL ] PPT: Derivative data saved (1326 records). [2025-09-15T21:20:08.151068] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-15T21:20:08.158896] [INFO ] [MAIN ] Derivative Progress: 1495/2083 symbols completed. PPT took 0.9s. Estimated remaining: 3m 15s. Rate: 180.7 symbols/min [2025-09-15T21:20:08.162358] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:08.163711] [DEBUG] [MAIN ] PRA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:08.164808] [INFO ] [MAIN ] PRA: Generated 1326 derivative records from 25598 primary records. [2025-09-15T21:20:08.165558] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-15T21:20:08.168879] [DEBUG] [LOCAL ] PRCS: Loaded 1987 existing records from primary storage. [2025-09-15T21:20:08.174481] [INFO ] [MAIN ] PRCS: Loaded 1987 primary data records. [2025-09-15T21:20:08.201077] [DEBUG] [LOCAL ] PRA: Derivative data saved (1326 records). [2025-09-15T21:20:08.235689] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-15T21:20:08.260359] [INFO ] [MAIN ] Derivative Progress: 1496/2083 symbols completed. PRA took 0.9s. Estimated remaining: 3m 15s. Rate: 180.8 symbols/min [2025-09-15T21:20:08.284451] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:08.304993] [DEBUG] [MAIN ] PR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:08.327142] [INFO ] [MAIN ] PR: Generated 1326 derivative records from 39574 primary records. [2025-09-15T21:20:08.357897] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-15T21:20:08.493721] [DEBUG] [LOCAL ] PRG: Loaded 21553 existing records from primary storage. [2025-09-15T21:20:08.494300] [INFO ] [MAIN ] PRG: Loaded 21553 primary data records. [2025-09-15T21:20:08.508493] [DEBUG] [LOCAL ] PR: Derivative data saved (1326 records). [2025-09-15T21:20:08.552579] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-15T21:20:08.574795] [INFO ] [MAIN ] Derivative Progress: 1497/2083 symbols completed. PR took 1.3s. Estimated remaining: 3m 14s. Rate: 180.8 symbols/min [2025-09-15T21:20:08.602541] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:08.818945] [DEBUG] [MAIN ] PRCS: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:20:08.820043] [INFO ] [MAIN ] PRCS: Generated 1324 derivative records from 1987 primary records. [2025-09-15T21:20:08.820198] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-09-15T21:20:08.845293] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1324 records). [2025-09-15T21:20:08.845555] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-09-15T21:20:08.847762] [INFO ] [MAIN ] Derivative Progress: 1498/2083 symbols completed. PRCS took 0.7s. Estimated remaining: 3m 14s. Rate: 180.8 symbols/min [2025-09-15T21:20:08.859984] [DEBUG] [LOCAL ] PRGO: Loaded 34043 existing records from primary storage. [2025-09-15T21:20:08.860262] [INFO ] [MAIN ] PRGO: Loaded 34043 primary data records. [2025-09-15T21:20:08.972673] [DEBUG] [MAIN ] PRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:08.984180] [INFO ] [MAIN ] PRG: Generated 1326 derivative records from 21553 primary records. [2025-09-15T21:20:08.994476] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-15T21:20:09.059214] [DEBUG] [LOCAL ] PRG: Derivative data saved (1326 records). [2025-09-15T21:20:09.140821] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-15T21:20:09.142942] [INFO ] [MAIN ] Derivative Progress: 1499/2083 symbols completed. PRG took 0.9s. Estimated remaining: 3m 14s. Rate: 180.8 symbols/min [2025-09-15T21:20:09.161033] [DEBUG] [MAIN ] PRGO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:09.161605] [INFO ] [MAIN ] PRGO: Generated 1326 derivative records from 34043 primary records. [2025-09-15T21:20:09.161684] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-15T21:20:09.173371] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1326 records). [2025-09-15T21:20:09.173433] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-15T21:20:09.175055] [INFO ] [MAIN ] Derivative Progress: 1500/2083 symbols completed. PRGO took 0.6s. Estimated remaining: 3m 13s. Rate: 180.9 symbols/min [2025-09-15T21:20:09.175578] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:09.175904] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:09.175700] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:09.184201] [DEBUG] [LOCAL ] PRH: Loaded 3510 existing records from primary storage. [2025-09-15T21:20:09.187842] [INFO ] [MAIN ] PRH: Loaded 3510 primary data records. [2025-09-15T21:20:09.260257] [DEBUG] [LOCAL ] PRI: Loaded 13062 existing records from primary storage. [2025-09-15T21:20:09.305150] [INFO ] [MAIN ] PRI: Loaded 13062 primary data records. [2025-09-15T21:20:09.462589] [DEBUG] [LOCAL ] PRIM: Loaded 32736 existing records from primary storage. [2025-09-15T21:20:09.488899] [INFO ] [MAIN ] PRIM: Loaded 32736 primary data records. [2025-09-15T21:20:10.038503] [DEBUG] [MAIN ] PRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:10.039466] [INFO ] [MAIN ] PRI: Generated 1326 derivative records from 13062 primary records. [2025-09-15T21:20:10.041988] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-15T21:20:10.060183] [DEBUG] [MAIN ] PRH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:10.064836] [INFO ] [MAIN ] PRH: Generated 1326 derivative records from 3510 primary records. [2025-09-15T21:20:10.065029] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-15T21:20:10.066912] [DEBUG] [LOCAL ] PRI: Derivative data saved (1326 records). [2025-09-15T21:20:10.075271] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-15T21:20:10.078278] [INFO ] [MAIN ] Derivative Progress: 1501/2083 symbols completed. PRI took 0.9s. Estimated remaining: 3m 13s. Rate: 180.7 symbols/min [2025-09-15T21:20:10.078538] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:10.080927] [DEBUG] [LOCAL ] PRH: Derivative data saved (1326 records). [2025-09-15T21:20:10.081707] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-15T21:20:10.084337] [INFO ] [MAIN ] Derivative Progress: 1502/2083 symbols completed. PRH took 0.9s. Estimated remaining: 3m 13s. Rate: 180.8 symbols/min [2025-09-15T21:20:10.085258] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:10.095606] [DEBUG] [MAIN ] PRIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:10.096398] [INFO ] [MAIN ] PRIM: Generated 1326 derivative records from 32736 primary records. [2025-09-15T21:20:10.096527] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-15T21:20:10.108729] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1326 records). [2025-09-15T21:20:10.112555] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-15T21:20:10.115070] [INFO ] [MAIN ] Derivative Progress: 1503/2083 symbols completed. PRIM took 0.9s. Estimated remaining: 3m 12s. Rate: 181.0 symbols/min [2025-09-15T21:20:10.115365] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:10.122993] [DEBUG] [LOCAL ] PRLB: Loaded 14741 existing records from primary storage. [2025-09-15T21:20:10.131457] [INFO ] [MAIN ] PRLB: Loaded 14741 primary data records. [2025-09-15T21:20:10.250542] [DEBUG] [LOCAL ] PRKS: Loaded 31146 existing records from primary storage. [2025-09-15T21:20:10.274085] [INFO ] [MAIN ] PRKS: Loaded 31146 primary data records. [2025-09-15T21:20:10.521123] [DEBUG] [LOCAL ] PRM: Loaded 32641 existing records from primary storage. [2025-09-15T21:20:10.532236] [INFO ] [MAIN ] PRM: Loaded 32641 primary data records. [2025-09-15T21:20:11.001831] [DEBUG] [MAIN ] PRLB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:11.004070] [INFO ] [MAIN ] PRLB: Generated 1326 derivative records from 14741 primary records. [2025-09-15T21:20:11.004190] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-15T21:20:11.024500] [DEBUG] [MAIN ] PRKS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:11.026830] [INFO ] [MAIN ] PRKS: Generated 1326 derivative records from 31146 primary records. [2025-09-15T21:20:11.027130] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-15T21:20:11.027200] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1326 records). [2025-09-15T21:20:11.027374] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-15T21:20:11.040457] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1326 records). [2025-09-15T21:20:11.040146] [INFO ] [MAIN ] Derivative Progress: 1504/2083 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 12s. Rate: 180.7 symbols/min [2025-09-15T21:20:11.040672] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-15T21:20:11.040963] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:11.043432] [INFO ] [MAIN ] Derivative Progress: 1505/2083 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 12s. Rate: 180.9 symbols/min [2025-09-15T21:20:11.043795] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:11.057979] [DEBUG] [MAIN ] PRM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:11.058759] [INFO ] [MAIN ] PRM: Generated 1326 derivative records from 32641 primary records. [2025-09-15T21:20:11.058977] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-15T21:20:11.071401] [DEBUG] [LOCAL ] PRM: Derivative data saved (1326 records). [2025-09-15T21:20:11.071568] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-15T21:20:11.073201] [INFO ] [MAIN ] Derivative Progress: 1506/2083 symbols completed. PRM took 1.0s. Estimated remaining: 3m 11s. Rate: 181.0 symbols/min [2025-09-15T21:20:11.073551] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:11.109783] [DEBUG] [LOCAL ] PRO: Loaded 28610 existing records from primary storage. [2025-09-15T21:20:11.109978] [INFO ] [MAIN ] PRO: Loaded 28610 primary data records. [2025-09-15T21:20:11.196732] [DEBUG] [LOCAL ] PRSU: Loaded 17591 existing records from primary storage. [2025-09-15T21:20:11.203004] [INFO ] [MAIN ] PRSU: Loaded 17591 primary data records. [2025-09-15T21:20:11.219609] [DEBUG] [LOCAL ] PRMB: Loaded 39285 existing records from primary storage. [2025-09-15T21:20:11.230373] [INFO ] [MAIN ] PRMB: Loaded 39285 primary data records. [2025-09-15T21:20:11.968853] [DEBUG] [MAIN ] PRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:11.971579] [INFO ] [MAIN ] PRO: Generated 1326 derivative records from 28610 primary records. [2025-09-15T21:20:11.971947] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-15T21:20:11.997152] [DEBUG] [LOCAL ] PRO: Derivative data saved (1326 records). [2025-09-15T21:20:11.996668] [DEBUG] [MAIN ] PRMB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:11.998703] [INFO ] [MAIN ] PRMB: Generated 1326 derivative records from 39285 primary records. [2025-09-15T21:20:11.998791] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-15T21:20:11.998132] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-15T21:20:12.001377] [INFO ] [MAIN ] Derivative Progress: 1507/2083 symbols completed. PRO took 1.0s. Estimated remaining: 3m 11s. Rate: 180.7 symbols/min [2025-09-15T21:20:12.002266] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:12.023367] [DEBUG] [MAIN ] PRSU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:12.026837] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1326 records). [2025-09-15T21:20:12.027005] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-15T21:20:12.025275] [INFO ] [MAIN ] PRSU: Generated 1326 derivative records from 17591 primary records. [2025-09-15T21:20:12.029027] [INFO ] [MAIN ] Derivative Progress: 1508/2083 symbols completed. PRMB took 1.0s. Estimated remaining: 3m 11s. Rate: 180.9 symbols/min [2025-09-15T21:20:12.031583] [DEBUG] [LOCAL ] PRT: Loaded 3636 existing records from primary storage. [2025-09-15T21:20:12.031822] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-09-15T21:20:12.031901] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:12.038803] [INFO ] [MAIN ] PRT: Loaded 3636 primary data records. [2025-09-15T21:20:12.113661] [DEBUG] [LOCAL ] PRSU: Derivative data saved (1326 records). [2025-09-15T21:20:12.146814] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-09-15T21:20:12.163635] [INFO ] [MAIN ] Derivative Progress: 1509/2083 symbols completed. PRSU took 1.1s. Estimated remaining: 3m 10s. Rate: 180.9 symbols/min [2025-09-15T21:20:12.174293] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:12.329572] [DEBUG] [LOCAL ] PRU: Loaded 37815 existing records from primary storage. [2025-09-15T21:20:12.329853] [INFO ] [MAIN ] PRU: Loaded 37815 primary data records. [2025-09-15T21:20:12.525674] [DEBUG] [LOCAL ] PSA: Loaded 30919 existing records from primary storage. [2025-09-15T21:20:12.529375] [INFO ] [MAIN ] PSA: Loaded 30919 primary data records. [2025-09-15T21:20:12.812254] [DEBUG] [MAIN ] PRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:12.897276] [INFO ] [MAIN ] PRT: Generated 1326 derivative records from 3636 primary records. [2025-09-15T21:20:12.897603] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-15T21:20:12.911529] [DEBUG] [LOCAL ] PRT: Derivative data saved (1326 records). [2025-09-15T21:20:12.912832] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-15T21:20:12.915973] [INFO ] [MAIN ] Derivative Progress: 1510/2083 symbols completed. PRT took 0.9s. Estimated remaining: 3m 10s. Rate: 180.8 symbols/min [2025-09-15T21:20:12.916902] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:12.928040] [DEBUG] [MAIN ] PRU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:12.928961] [INFO ] [MAIN ] PRU: Generated 1326 derivative records from 37815 primary records. [2025-09-15T21:20:12.930056] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-15T21:20:12.945972] [DEBUG] [LOCAL ] PSBD: Loaded 5148 existing records from primary storage. [2025-09-15T21:20:12.948012] [INFO ] [MAIN ] PSBD: Loaded 5148 primary data records. [2025-09-15T21:20:12.947693] [DEBUG] [LOCAL ] PRU: Derivative data saved (1326 records). [2025-09-15T21:20:12.948153] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-15T21:20:12.971739] [INFO ] [MAIN ] Derivative Progress: 1511/2083 symbols completed. PRU took 0.9s. Estimated remaining: 3m 10s. Rate: 180.9 symbols/min [2025-09-15T21:20:13.026425] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:13.082596] [DEBUG] [MAIN ] PSA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:13.098871] [INFO ] [MAIN ] PSA: Generated 1326 derivative records from 30919 primary records. [2025-09-15T21:20:13.098965] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-15T21:20:13.126169] [DEBUG] [LOCAL ] PSF: Loaded 4946 existing records from primary storage. [2025-09-15T21:20:13.127327] [INFO ] [MAIN ] PSF: Loaded 4946 primary data records. [2025-09-15T21:20:13.386841] [DEBUG] [LOCAL ] PSA: Derivative data saved (1326 records). [2025-09-15T21:20:13.390955] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-15T21:20:13.393254] [INFO ] [MAIN ] Derivative Progress: 1512/2083 symbols completed. PSA took 1.2s. Estimated remaining: 3m 9s. Rate: 180.8 symbols/min [2025-09-15T21:20:13.393799] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:13.579614] [DEBUG] [LOCAL ] PSFE: Loaded 22615 existing records from primary storage. [2025-09-15T21:20:13.581428] [INFO ] [MAIN ] PSFE: Loaded 22615 primary data records. [2025-09-15T21:20:13.699061] [DEBUG] [MAIN ] PSBD: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:20:13.710764] [INFO ] [MAIN ] PSBD: Generated 1324 derivative records from 5148 primary records. [2025-09-15T21:20:13.740679] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-15T21:20:13.882262] [DEBUG] [MAIN ] PSF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:13.885451] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1324 records). [2025-09-15T21:20:13.886254] [INFO ] [MAIN ] PSF: Generated 1326 derivative records from 4946 primary records. [2025-09-15T21:20:13.887541] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-15T21:20:13.889522] [INFO ] [MAIN ] Derivative Progress: 1513/2083 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 9s. Rate: 180.8 symbols/min [2025-09-15T21:20:13.887660] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-15T21:20:13.902704] [DEBUG] [LOCAL ] PSF: Derivative data saved (1326 records). [2025-09-15T21:20:13.902965] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-15T21:20:13.904859] [INFO ] [MAIN ] Derivative Progress: 1514/2083 symbols completed. PSF took 0.9s. Estimated remaining: 3m 9s. Rate: 180.9 symbols/min [2025-09-15T21:20:13.922785] [DEBUG] [MAIN ] PSFE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:13.923433] [INFO ] [MAIN ] PSFE: Generated 1326 derivative records from 22615 primary records. [2025-09-15T21:20:13.923494] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-15T21:20:13.935479] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1326 records). [2025-09-15T21:20:13.935546] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-15T21:20:13.937538] [INFO ] [MAIN ] Derivative Progress: 1515/2083 symbols completed. PSFE took 0.5s. Estimated remaining: 3m 8s. Rate: 181.0 symbols/min [2025-09-15T21:20:13.937975] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:13.938109] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:13.938489] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:13.991426] [DEBUG] [LOCAL ] PSN: Loaded 33662 existing records from primary storage. [2025-09-15T21:20:13.992563] [INFO ] [MAIN ] PSN: Loaded 33662 primary data records. [2025-09-15T21:20:13.993135] [DEBUG] [LOCAL ] PSQH: Loaded 24941 existing records from primary storage. [2025-09-15T21:20:14.024339] [INFO ] [MAIN ] PSQH: Loaded 24941 primary data records. [2025-09-15T21:20:14.144001] [DEBUG] [LOCAL ] PSO: Loaded 26824 existing records from primary storage. [2025-09-15T21:20:14.192309] [INFO ] [MAIN ] PSO: Loaded 26824 primary data records. [2025-09-15T21:20:14.819617] [DEBUG] [MAIN ] PSN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:14.820879] [INFO ] [MAIN ] PSN: Generated 1326 derivative records from 33662 primary records. [2025-09-15T21:20:14.826807] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-15T21:20:14.831115] [DEBUG] [MAIN ] PSQH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:14.832595] [INFO ] [MAIN ] PSQH: Generated 1326 derivative records from 24941 primary records. [2025-09-15T21:20:14.838249] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-15T21:20:14.855993] [DEBUG] [LOCAL ] PSN: Derivative data saved (1326 records). [2025-09-15T21:20:14.858681] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1326 records). [2025-09-15T21:20:14.864988] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-15T21:20:14.870598] [INFO ] [MAIN ] Derivative Progress: 1516/2083 symbols completed. PSQH took 0.9s. Estimated remaining: 3m 8s. Rate: 180.8 symbols/min [2025-09-15T21:20:14.868449] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-15T21:20:14.870962] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:14.873032] [INFO ] [MAIN ] Derivative Progress: 1517/2083 symbols completed. PSN took 0.9s. Estimated remaining: 3m 8s. Rate: 180.9 symbols/min [2025-09-15T21:20:14.873746] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:14.874189] [DEBUG] [MAIN ] PSO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:14.875284] [INFO ] [MAIN ] PSO: Generated 1326 derivative records from 26824 primary records. [2025-09-15T21:20:14.875463] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-15T21:20:14.888798] [DEBUG] [LOCAL ] PSO: Derivative data saved (1326 records). [2025-09-15T21:20:14.888928] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-15T21:20:14.891197] [INFO ] [MAIN ] Derivative Progress: 1518/2083 symbols completed. PSO took 1.0s. Estimated remaining: 3m 7s. Rate: 181.0 symbols/min [2025-09-15T21:20:14.891439] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:14.908045] [DEBUG] [LOCAL ] PSTL: Loaded 14762 existing records from primary storage. [2025-09-15T21:20:14.908306] [INFO ] [MAIN ] PSTL: Loaded 14762 primary data records. [2025-09-15T21:20:15.069961] [DEBUG] [LOCAL ] PSTG: Loaded 38902 existing records from primary storage. [2025-09-15T21:20:15.103682] [INFO ] [MAIN ] PSTG: Loaded 38902 primary data records. [2025-09-15T21:20:15.329391] [DEBUG] [LOCAL ] PSX: Loaded 39235 existing records from primary storage. [2025-09-15T21:20:15.330524] [INFO ] [MAIN ] PSX: Loaded 39235 primary data records. [2025-09-15T21:20:15.814264] [DEBUG] [MAIN ] PSTL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:15.815574] [INFO ] [MAIN ] PSTL: Generated 1326 derivative records from 14762 primary records. [2025-09-15T21:20:15.815828] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-15T21:20:15.830564] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1326 records). [2025-09-15T21:20:15.831046] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-15T21:20:15.832963] [INFO ] [MAIN ] Derivative Progress: 1519/2083 symbols completed. PSTL took 1.0s. Estimated remaining: 3m 7s. Rate: 180.8 symbols/min [2025-09-15T21:20:15.835725] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:15.848259] [DEBUG] [MAIN ] PSTG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:15.854493] [INFO ] [MAIN ] PSTG: Generated 1326 derivative records from 38902 primary records. [2025-09-15T21:20:15.858062] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-15T21:20:15.858317] [DEBUG] [MAIN ] PSX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:15.859537] [INFO ] [MAIN ] PSX: Generated 1326 derivative records from 39235 primary records. [2025-09-15T21:20:15.859870] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-15T21:20:15.885522] [DEBUG] [LOCAL ] PSX: Derivative data saved (1326 records). [2025-09-15T21:20:15.890016] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-15T21:20:15.891829] [INFO ] [MAIN ] Derivative Progress: 1520/2083 symbols completed. PSX took 1.0s. Estimated remaining: 3m 7s. Rate: 180.9 symbols/min [2025-09-15T21:20:15.890075] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1326 records). [2025-09-15T21:20:15.892129] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:15.891990] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-15T21:20:15.894747] [INFO ] [MAIN ] Derivative Progress: 1521/2083 symbols completed. PSTG took 1.0s. Estimated remaining: 3m 6s. Rate: 181.0 symbols/min [2025-09-15T21:20:15.892555] [DEBUG] [LOCAL ] PTA: Loaded 10513 existing records from primary storage. [2025-09-15T21:20:15.895125] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:15.895270] [INFO ] [MAIN ] PTA: Loaded 10513 primary data records. [2025-09-15T21:20:16.191996] [DEBUG] [LOCAL ] PTY: Loaded 27092 existing records from primary storage. [2025-09-15T21:20:16.192539] [INFO ] [MAIN ] PTY: Loaded 27092 primary data records. [2025-09-15T21:20:16.246585] [DEBUG] [LOCAL ] PUK: Loaded 32121 existing records from primary storage. [2025-09-15T21:20:16.290779] [INFO ] [MAIN ] PUK: Loaded 32121 primary data records. [2025-09-15T21:20:16.765938] [DEBUG] [MAIN ] PTA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:16.767297] [INFO ] [MAIN ] PTA: Generated 1326 derivative records from 10513 primary records. [2025-09-15T21:20:16.767403] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-15T21:20:16.781121] [DEBUG] [LOCAL ] PTA: Derivative data saved (1326 records). [2025-09-15T21:20:16.782376] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-15T21:20:16.784633] [INFO ] [MAIN ] Derivative Progress: 1522/2083 symbols completed. PTA took 1.0s. Estimated remaining: 3m 6s. Rate: 180.8 symbols/min [2025-09-15T21:20:16.785156] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:16.804346] [DEBUG] [MAIN ] PTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:16.805396] [INFO ] [MAIN ] PTY: Generated 1326 derivative records from 27092 primary records. [2025-09-15T21:20:16.806330] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-15T21:20:16.830462] [DEBUG] [MAIN ] PUK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:16.832779] [DEBUG] [LOCAL ] PTY: Derivative data saved (1326 records). [2025-09-15T21:20:16.842018] [INFO ] [MAIN ] PUK: Generated 1326 derivative records from 32121 primary records. [2025-09-15T21:20:16.842308] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-15T21:20:16.842382] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-15T21:20:16.844967] [INFO ] [MAIN ] Derivative Progress: 1523/2083 symbols completed. PTY took 1.0s. Estimated remaining: 3m 6s. Rate: 180.9 symbols/min [2025-09-15T21:20:16.853801] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:16.857595] [DEBUG] [LOCAL ] PUK: Derivative data saved (1326 records). [2025-09-15T21:20:16.858759] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-15T21:20:16.860505] [INFO ] [MAIN ] Derivative Progress: 1524/2083 symbols completed. PUK took 1.0s. Estimated remaining: 3m 5s. Rate: 181.0 symbols/min [2025-09-15T21:20:16.873149] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:16.874879] [DEBUG] [LOCAL ] PUMP: Loaded 36293 existing records from primary storage. [2025-09-15T21:20:16.875790] [INFO ] [MAIN ] PUMP: Loaded 36293 primary data records. [2025-09-15T21:20:16.930552] [DEBUG] [LOCAL ] PVL: Loaded 3476 existing records from primary storage. [2025-09-15T21:20:16.950189] [INFO ] [MAIN ] PVL: Loaded 3476 primary data records. [2025-09-15T21:20:17.233160] [DEBUG] [LOCAL ] PVH: Loaded 37355 existing records from primary storage. [2025-09-15T21:20:17.267802] [INFO ] [MAIN ] PVH: Loaded 37355 primary data records. [2025-09-15T21:20:17.812966] [DEBUG] [MAIN ] PUMP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:17.815293] [INFO ] [MAIN ] PUMP: Generated 1326 derivative records from 36293 primary records. [2025-09-15T21:20:17.815461] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-15T21:20:17.826246] [DEBUG] [MAIN ] PVL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:17.835739] [INFO ] [MAIN ] PVL: Generated 1326 derivative records from 3476 primary records. [2025-09-15T21:20:17.836067] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-15T21:20:17.839051] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1326 records). [2025-09-15T21:20:17.839988] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-15T21:20:17.849413] [INFO ] [MAIN ] Derivative Progress: 1525/2083 symbols completed. PUMP took 1.1s. Estimated remaining: 3m 5s. Rate: 180.8 symbols/min [2025-09-15T21:20:17.850084] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:17.853590] [DEBUG] [LOCAL ] PVL: Derivative data saved (1326 records). [2025-09-15T21:20:17.854870] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-15T21:20:17.857342] [INFO ] [MAIN ] Derivative Progress: 1526/2083 symbols completed. PVL took 1.0s. Estimated remaining: 3m 5s. Rate: 180.9 symbols/min [2025-09-15T21:20:17.857964] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:17.869107] [DEBUG] [MAIN ] PVH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:17.869818] [INFO ] [MAIN ] PVH: Generated 1326 derivative records from 37355 primary records. [2025-09-15T21:20:17.869953] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-15T21:20:17.882202] [DEBUG] [LOCAL ] PVH: Derivative data saved (1326 records). [2025-09-15T21:20:17.882517] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-15T21:20:17.884344] [INFO ] [MAIN ] Derivative Progress: 1527/2083 symbols completed. PVH took 1.0s. Estimated remaining: 3m 4s. Rate: 181.0 symbols/min [2025-09-15T21:20:17.884789] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:17.917678] [DEBUG] [LOCAL ] PX: Loaded 25752 existing records from primary storage. [2025-09-15T21:20:17.917864] [INFO ] [MAIN ] PX: Loaded 25752 primary data records. [2025-09-15T21:20:18.023434] [DEBUG] [LOCAL ] PWR: Loaded 34461 existing records from primary storage. [2025-09-15T21:20:18.036623] [INFO ] [MAIN ] PWR: Loaded 34461 primary data records. [2025-09-15T21:20:18.188823] [DEBUG] [LOCAL ] QBTS: Loaded 39780 existing records from primary storage. [2025-09-15T21:20:18.197195] [INFO ] [MAIN ] QBTS: Loaded 39780 primary data records. [2025-09-15T21:20:18.766791] [DEBUG] [MAIN ] PX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:18.768686] [INFO ] [MAIN ] PX: Generated 1326 derivative records from 25752 primary records. [2025-09-15T21:20:18.768926] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-15T21:20:18.788209] [DEBUG] [MAIN ] PWR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:18.791765] [DEBUG] [LOCAL ] PX: Derivative data saved (1326 records). [2025-09-15T21:20:18.791986] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-15T21:20:18.789013] [INFO ] [MAIN ] PWR: Generated 1326 derivative records from 34461 primary records. [2025-09-15T21:20:18.793597] [INFO ] [MAIN ] Derivative Progress: 1528/2083 symbols completed. PX took 0.9s. Estimated remaining: 3m 4s. Rate: 180.8 symbols/min [2025-09-15T21:20:18.793894] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-15T21:20:18.817887] [DEBUG] [MAIN ] QBTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:18.818991] [INFO ] [MAIN ] QBTS: Generated 1326 derivative records from 39780 primary records. [2025-09-15T21:20:18.818350] [DEBUG] [LOCAL ] PWR: Derivative data saved (1326 records). [2025-09-15T21:20:18.819080] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-15T21:20:18.819200] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-15T21:20:18.822063] [INFO ] [MAIN ] Derivative Progress: 1529/2083 symbols completed. PWR took 1.0s. Estimated remaining: 3m 4s. Rate: 180.9 symbols/min [2025-09-15T21:20:18.833389] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1326 records). [2025-09-15T21:20:18.833455] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-15T21:20:18.835150] [INFO ] [MAIN ] Derivative Progress: 1530/2083 symbols completed. QBTS took 1.0s. Estimated remaining: 3m 3s. Rate: 181.0 symbols/min [2025-09-15T21:20:18.835740] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:18.835860] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:18.835807] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:18.859872] [DEBUG] [LOCAL ] QD: Loaded 20314 existing records from primary storage. [2025-09-15T21:20:18.860048] [INFO ] [MAIN ] QD: Loaded 20314 primary data records. [2025-09-15T21:20:19.076862] [DEBUG] [LOCAL ] QGEN: Loaded 36330 existing records from primary storage. [2025-09-15T21:20:19.073369] [DEBUG] [LOCAL ] QS: Loaded 39729 existing records from primary storage. [2025-09-15T21:20:19.148840] [INFO ] [MAIN ] QS: Loaded 39729 primary data records. [2025-09-15T21:20:19.159393] [INFO ] [MAIN ] QGEN: Loaded 36330 primary data records. [2025-09-15T21:20:19.742659] [DEBUG] [MAIN ] QD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:19.744993] [INFO ] [MAIN ] QD: Generated 1326 derivative records from 20314 primary records. [2025-09-15T21:20:19.745223] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-15T21:20:19.759061] [DEBUG] [LOCAL ] QD: Derivative data saved (1326 records). [2025-09-15T21:20:19.759414] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-15T21:20:19.762655] [INFO ] [MAIN ] Derivative Progress: 1531/2083 symbols completed. QD took 0.9s. Estimated remaining: 3m 3s. Rate: 180.8 symbols/min [2025-09-15T21:20:19.763335] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:19.774586] [DEBUG] [MAIN ] QS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:19.777016] [INFO ] [MAIN ] QS: Generated 1326 derivative records from 39729 primary records. [2025-09-15T21:20:19.777210] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-15T21:20:19.799274] [DEBUG] [LOCAL ] QS: Derivative data saved (1326 records). [2025-09-15T21:20:19.800197] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-15T21:20:19.800114] [DEBUG] [MAIN ] QGEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:19.804051] [INFO ] [MAIN ] Derivative Progress: 1532/2083 symbols completed. QS took 1.0s. Estimated remaining: 3m 3s. Rate: 180.9 symbols/min [2025-09-15T21:20:19.805152] [INFO ] [MAIN ] QGEN: Generated 1326 derivative records from 36330 primary records. [2025-09-15T21:20:19.805433] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-15T21:20:19.805683] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:19.819459] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1326 records). [2025-09-15T21:20:19.819696] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-15T21:20:19.822028] [INFO ] [MAIN ] Derivative Progress: 1533/2083 symbols completed. QGEN took 1.0s. Estimated remaining: 3m 2s. Rate: 181.0 symbols/min [2025-09-15T21:20:19.831672] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:19.855146] [DEBUG] [LOCAL ] QSR: Loaded 38692 existing records from primary storage. [2025-09-15T21:20:19.855401] [INFO ] [MAIN ] QSR: Loaded 38692 primary data records. [2025-09-15T21:20:19.956047] [DEBUG] [LOCAL ] QTWO: Loaded 27793 existing records from primary storage. [2025-09-15T21:20:19.978672] [INFO ] [MAIN ] QTWO: Loaded 27793 primary data records. [2025-09-15T21:20:19.979149] [DEBUG] [LOCAL ] QUAD: Loaded 17585 existing records from primary storage. [2025-09-15T21:20:19.996234] [INFO ] [MAIN ] QUAD: Loaded 17585 primary data records. [2025-09-15T21:20:20.739403] [DEBUG] [MAIN ] QSR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:20.740507] [INFO ] [MAIN ] QSR: Generated 1326 derivative records from 38692 primary records. [2025-09-15T21:20:20.740838] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-15T21:20:20.757083] [DEBUG] [LOCAL ] QSR: Derivative data saved (1326 records). [2025-09-15T21:20:20.757233] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-15T21:20:20.759602] [INFO ] [MAIN ] Derivative Progress: 1534/2083 symbols completed. QSR took 1.0s. Estimated remaining: 3m 2s. Rate: 180.8 symbols/min [2025-09-15T21:20:20.769406] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:20.770217] [DEBUG] [MAIN ] QTWO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:20.778742] [INFO ] [MAIN ] QTWO: Generated 1326 derivative records from 27793 primary records. [2025-09-15T21:20:20.782485] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-15T21:20:20.783273] [DEBUG] [MAIN ] QUAD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:20.786460] [INFO ] [MAIN ] QUAD: Generated 1326 derivative records from 17585 primary records. [2025-09-15T21:20:20.786587] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-15T21:20:20.810197] [DEBUG] [LOCAL ] QVCC: Loaded 6457 existing records from primary storage. [2025-09-15T21:20:20.812129] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1326 records). [2025-09-15T21:20:20.812076] [INFO ] [MAIN ] QVCC: Loaded 6457 primary data records. [2025-09-15T21:20:20.813675] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1326 records). [2025-09-15T21:20:20.813767] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-15T21:20:20.813873] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-15T21:20:20.827213] [INFO ] [MAIN ] Derivative Progress: 1535/2083 symbols completed. QTWO took 1.0s. Estimated remaining: 3m 2s. Rate: 180.9 symbols/min [2025-09-15T21:20:20.887317] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:20.887441] [INFO ] [MAIN ] Derivative Progress: 1536/2083 symbols completed. QUAD took 1.0s. Estimated remaining: 3m 1s. Rate: 181.0 symbols/min [2025-09-15T21:20:20.925834] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:20.980593] [DEBUG] [LOCAL ] QVCD: Loaded 3362 existing records from primary storage. [2025-09-15T21:20:20.988004] [INFO ] [MAIN ] QVCD: Loaded 3362 primary data records. [2025-09-15T21:20:21.392113] [DEBUG] [LOCAL ] QXO: Loaded 39513 existing records from primary storage. [2025-09-15T21:20:21.392507] [INFO ] [MAIN ] QXO: Loaded 39513 primary data records. [2025-09-15T21:20:21.593920] [DEBUG] [MAIN ] QVCC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:21.675413] [INFO ] [MAIN ] QVCC: Generated 1326 derivative records from 6457 primary records. [2025-09-15T21:20:21.686249] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-15T21:20:21.699014] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1326 records). [2025-09-15T21:20:21.699927] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-15T21:20:21.701772] [INFO ] [MAIN ] Derivative Progress: 1537/2083 symbols completed. QVCC took 0.9s. Estimated remaining: 3m 1s. Rate: 180.8 symbols/min [2025-09-15T21:20:21.702238] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:21.717695] [DEBUG] [MAIN ] QVCD: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:20:21.718509] [INFO ] [MAIN ] QVCD: Generated 1324 derivative records from 3362 primary records. [2025-09-15T21:20:21.718768] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-15T21:20:21.732726] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1324 records). [2025-09-15T21:20:21.732913] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-15T21:20:21.734852] [INFO ] [MAIN ] Derivative Progress: 1538/2083 symbols completed. QVCD took 0.9s. Estimated remaining: 3m 1s. Rate: 180.9 symbols/min [2025-09-15T21:20:21.735178] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:21.753323] [DEBUG] [LOCAL ] R: Loaded 20178 existing records from primary storage. [2025-09-15T21:20:21.763802] [INFO ] [MAIN ] R: Loaded 20178 primary data records. [2025-09-15T21:20:21.789699] [DEBUG] [MAIN ] QXO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:21.813488] [INFO ] [MAIN ] QXO: Generated 1326 derivative records from 39513 primary records. [2025-09-15T21:20:21.827097] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-15T21:20:21.861785] [DEBUG] [LOCAL ] RA: Loaded 15704 existing records from primary storage. [2025-09-15T21:20:21.876209] [INFO ] [MAIN ] RA: Loaded 15704 primary data records. [2025-09-15T21:20:22.085690] [DEBUG] [LOCAL ] QXO: Derivative data saved (1326 records). [2025-09-15T21:20:22.127075] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-15T21:20:22.226509] [INFO ] [MAIN ] Derivative Progress: 1539/2083 symbols completed. QXO took 1.3s. Estimated remaining: 3m 0s. Rate: 180.9 symbols/min [2025-09-15T21:20:22.270343] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:22.451250] [DEBUG] [MAIN ] R: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:22.452578] [DEBUG] [LOCAL ] RACE: Loaded 22545 existing records from primary storage. [2025-09-15T21:20:22.454171] [INFO ] [MAIN ] RACE: Loaded 22545 primary data records. [2025-09-15T21:20:22.455075] [INFO ] [MAIN ] R: Generated 1326 derivative records from 20178 primary records. [2025-09-15T21:20:22.465924] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-15T21:20:22.600029] [DEBUG] [LOCAL ] R: Derivative data saved (1326 records). [2025-09-15T21:20:22.590434] [DEBUG] [MAIN ] RA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:22.603932] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-15T21:20:22.606095] [INFO ] [MAIN ] Derivative Progress: 1540/2083 symbols completed. R took 0.9s. Estimated remaining: 3m 0s. Rate: 180.9 symbols/min [2025-09-15T21:20:22.616937] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:22.618337] [INFO ] [MAIN ] RA: Generated 1326 derivative records from 15704 primary records. [2025-09-15T21:20:22.624195] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-15T21:20:22.781659] [DEBUG] [LOCAL ] RA: Derivative data saved (1326 records). [2025-09-15T21:20:22.782321] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-15T21:20:22.784378] [INFO ] [MAIN ] Derivative Progress: 1541/2083 symbols completed. RA took 1.0s. Estimated remaining: 2m 60s. Rate: 180.9 symbols/min [2025-09-15T21:20:22.784737] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:22.808162] [DEBUG] [LOCAL ] RAMP: Loaded 26853 existing records from primary storage. [2025-09-15T21:20:22.808522] [INFO ] [MAIN ] RAMP: Loaded 26853 primary data records. [2025-09-15T21:20:23.023117] [DEBUG] [MAIN ] RACE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:23.105607] [DEBUG] [LOCAL ] RBA: Loaded 33785 existing records from primary storage. [2025-09-15T21:20:23.106766] [INFO ] [MAIN ] RACE: Generated 1326 derivative records from 22545 primary records. [2025-09-15T21:20:23.107167] [INFO ] [MAIN ] RBA: Loaded 33785 primary data records. [2025-09-15T21:20:23.107096] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-15T21:20:23.192119] [DEBUG] [LOCAL ] RACE: Derivative data saved (1326 records). [2025-09-15T21:20:23.209361] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-15T21:20:23.228367] [INFO ] [MAIN ] Derivative Progress: 1542/2083 symbols completed. RACE took 1.0s. Estimated remaining: 2m 59s. Rate: 180.9 symbols/min [2025-09-15T21:20:23.229451] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:23.403958] [DEBUG] [LOCAL ] RBC: Loaded 10796 existing records from primary storage. [2025-09-15T21:20:23.404942] [INFO ] [MAIN ] RBC: Loaded 10796 primary data records. [2025-09-15T21:20:23.550299] [DEBUG] [MAIN ] RAMP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:23.561624] [INFO ] [MAIN ] RAMP: Generated 1326 derivative records from 26853 primary records. [2025-09-15T21:20:23.595467] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-15T21:20:23.738494] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1326 records). [2025-09-15T21:20:23.740591] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-15T21:20:23.743212] [INFO ] [MAIN ] Derivative Progress: 1543/2083 symbols completed. RAMP took 1.1s. Estimated remaining: 2m 59s. Rate: 180.8 symbols/min [2025-09-15T21:20:23.753975] [DEBUG] [MAIN ] RBA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:23.754714] [INFO ] [MAIN ] RBA: Generated 1326 derivative records from 33785 primary records. [2025-09-15T21:20:23.754831] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-15T21:20:23.768402] [DEBUG] [LOCAL ] RBA: Derivative data saved (1326 records). [2025-09-15T21:20:23.768672] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-15T21:20:23.770348] [INFO ] [MAIN ] Derivative Progress: 1544/2083 symbols completed. RBA took 1.0s. Estimated remaining: 2m 59s. Rate: 180.9 symbols/min [2025-09-15T21:20:23.783143] [DEBUG] [MAIN ] RBC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:23.783727] [INFO ] [MAIN ] RBC: Generated 1326 derivative records from 10796 primary records. [2025-09-15T21:20:23.783788] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-15T21:20:23.795589] [DEBUG] [LOCAL ] RBC: Derivative data saved (1326 records). [2025-09-15T21:20:23.795690] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-15T21:20:23.797652] [INFO ] [MAIN ] Derivative Progress: 1545/2083 symbols completed. RBC took 0.6s. Estimated remaining: 2m 58s. Rate: 181.0 symbols/min [2025-09-15T21:20:23.798278] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:23.798349] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:23.798228] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:23.806837] [DEBUG] [LOCAL ] RBOT: Loaded 3792 existing records from primary storage. [2025-09-15T21:20:23.807015] [INFO ] [MAIN ] RBOT: Loaded 3792 primary data records. [2025-09-15T21:20:24.026808] [DEBUG] [LOCAL ] RBRK: Loaded 39250 existing records from primary storage. [2025-09-15T21:20:24.033293] [INFO ] [MAIN ] RBRK: Loaded 39250 primary data records. [2025-09-15T21:20:24.160277] [DEBUG] [LOCAL ] RBLX: Loaded 39693 existing records from primary storage. [2025-09-15T21:20:24.193087] [INFO ] [MAIN ] RBLX: Loaded 39693 primary data records. [2025-09-15T21:20:24.737275] [DEBUG] [MAIN ] RBOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:24.738239] [INFO ] [MAIN ] RBOT: Generated 1326 derivative records from 3792 primary records. [2025-09-15T21:20:24.738530] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-15T21:20:24.752857] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1326 records). [2025-09-15T21:20:24.758888] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-15T21:20:24.764198] [INFO ] [MAIN ] Derivative Progress: 1546/2083 symbols completed. RBOT took 1.0s. Estimated remaining: 2m 58s. Rate: 180.8 symbols/min [2025-09-15T21:20:24.764868] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:24.765325] [DEBUG] [MAIN ] RBRK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:24.766437] [INFO ] [MAIN ] RBRK: Generated 1326 derivative records from 39250 primary records. [2025-09-15T21:20:24.766754] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-15T21:20:24.780794] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1326 records). [2025-09-15T21:20:24.782673] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-15T21:20:24.785296] [INFO ] [MAIN ] Derivative Progress: 1547/2083 symbols completed. RBRK took 1.0s. Estimated remaining: 2m 58s. Rate: 180.9 symbols/min [2025-09-15T21:20:24.785810] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:24.796362] [DEBUG] [MAIN ] RBLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:24.797295] [INFO ] [MAIN ] RBLX: Generated 1326 derivative records from 39693 primary records. [2025-09-15T21:20:24.798871] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-15T21:20:24.801721] [DEBUG] [LOCAL ] RCD: Loaded 2563 existing records from primary storage. [2025-09-15T21:20:24.802328] [INFO ] [MAIN ] RCD: Loaded 2563 primary data records. [2025-09-15T21:20:24.938590] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1326 records). [2025-09-15T21:20:24.940431] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-15T21:20:24.956956] [DEBUG] [LOCAL ] RC: Loaded 35705 existing records from primary storage. [2025-09-15T21:20:24.992545] [INFO ] [MAIN ] RC: Loaded 35705 primary data records. [2025-09-15T21:20:24.964368] [INFO ] [MAIN ] Derivative Progress: 1548/2083 symbols completed. RBLX took 1.2s. Estimated remaining: 2m 57s. Rate: 181.0 symbols/min [2025-09-15T21:20:25.016282] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:25.420162] [DEBUG] [LOCAL ] RCI: Loaded 35754 existing records from primary storage. [2025-09-15T21:20:25.420989] [DEBUG] [MAIN ] RCD: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:20:25.421118] [INFO ] [MAIN ] RCI: Loaded 35754 primary data records. [2025-09-15T21:20:25.422128] [INFO ] [MAIN ] RCD: Generated 1325 derivative records from 2563 primary records. [2025-09-15T21:20:25.433533] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-09-15T21:20:25.541903] [DEBUG] [LOCAL ] RCD: Derivative data saved (1325 records). [2025-09-15T21:20:25.544369] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-09-15T21:20:25.551389] [INFO ] [MAIN ] Derivative Progress: 1549/2083 symbols completed. RCD took 0.8s. Estimated remaining: 2m 57s. Rate: 180.9 symbols/min [2025-09-15T21:20:25.561902] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:25.612680] [DEBUG] [MAIN ] RC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:25.632140] [INFO ] [MAIN ] RC: Generated 1326 derivative records from 35705 primary records. [2025-09-15T21:20:25.719834] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-15T21:20:25.735225] [DEBUG] [LOCAL ] RC: Derivative data saved (1326 records). [2025-09-15T21:20:25.735400] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-15T21:20:25.737999] [INFO ] [MAIN ] Derivative Progress: 1550/2083 symbols completed. RC took 1.0s. Estimated remaining: 2m 57s. Rate: 180.9 symbols/min [2025-09-15T21:20:25.738408] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:25.760498] [DEBUG] [LOCAL ] RCS: Loaded 8371 existing records from primary storage. [2025-09-15T21:20:25.760709] [INFO ] [MAIN ] RCS: Loaded 8371 primary data records. [2025-09-15T21:20:25.793355] [DEBUG] [MAIN ] RCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:25.828499] [INFO ] [MAIN ] RCI: Generated 1326 derivative records from 35754 primary records. [2025-09-15T21:20:25.840940] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-15T21:20:25.861499] [DEBUG] [LOCAL ] RCL: Loaded 38346 existing records from primary storage. [2025-09-15T21:20:25.886857] [INFO ] [MAIN ] RCL: Loaded 38346 primary data records. [2025-09-15T21:20:26.084534] [DEBUG] [LOCAL ] RCI: Derivative data saved (1326 records). [2025-09-15T21:20:26.187958] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-15T21:20:26.235300] [INFO ] [MAIN ] Derivative Progress: 1551/2083 symbols completed. RCI took 1.2s. Estimated remaining: 2m 56s. Rate: 180.9 symbols/min [2025-09-15T21:20:26.318872] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:26.351396] [DEBUG] [MAIN ] RCS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:26.361187] [INFO ] [MAIN ] RCS: Generated 1326 derivative records from 8371 primary records. [2025-09-15T21:20:26.361386] [DEBUG] [MAIN ] RCL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:26.361984] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-15T21:20:26.361936] [INFO ] [MAIN ] RCL: Generated 1326 derivative records from 38346 primary records. [2025-09-15T21:20:26.362414] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-15T21:20:26.393510] [DEBUG] [LOCAL ] RCL: Derivative data saved (1326 records). [2025-09-15T21:20:26.394430] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-15T21:20:26.394489] [DEBUG] [LOCAL ] RCS: Derivative data saved (1326 records). [2025-09-15T21:20:26.395022] [DEBUG] [LOCAL ] RCUS: Loaded 31419 existing records from primary storage. [2025-09-15T21:20:26.396951] [INFO ] [MAIN ] Derivative Progress: 1552/2083 symbols completed. RCL took 0.8s. Estimated remaining: 2m 56s. Rate: 180.9 symbols/min [2025-09-15T21:20:26.397196] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-15T21:20:26.397149] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:26.399228] [INFO ] [MAIN ] Derivative Progress: 1553/2083 symbols completed. RCS took 0.7s. Estimated remaining: 2m 56s. Rate: 181.1 symbols/min [2025-09-15T21:20:26.399430] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:26.397360] [INFO ] [MAIN ] RCUS: Loaded 31419 primary data records. [2025-09-15T21:20:26.749431] [DEBUG] [LOCAL ] RDN: Loaded 32335 existing records from primary storage. [2025-09-15T21:20:26.748585] [DEBUG] [LOCAL ] RDDT: Loaded 39748 existing records from primary storage. [2025-09-15T21:20:26.749573] [INFO ] [MAIN ] RDN: Loaded 32335 primary data records. [2025-09-15T21:20:26.750222] [INFO ] [MAIN ] RDDT: Loaded 39748 primary data records. [2025-09-15T21:20:27.327582] [DEBUG] [MAIN ] RCUS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:27.329013] [INFO ] [MAIN ] RCUS: Generated 1326 derivative records from 31419 primary records. [2025-09-15T21:20:27.329452] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-15T21:20:27.345168] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1326 records). [2025-09-15T21:20:27.345679] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-15T21:20:27.348671] [INFO ] [MAIN ] Derivative Progress: 1554/2083 symbols completed. RCUS took 1.0s. Estimated remaining: 2m 56s. Rate: 180.8 symbols/min [2025-09-15T21:20:27.349284] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:27.377586] [DEBUG] [MAIN ] RDDT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:27.377315] [DEBUG] [MAIN ] RDN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:27.378731] [INFO ] [MAIN ] RDDT: Generated 1326 derivative records from 39748 primary records. [2025-09-15T21:20:27.378227] [INFO ] [MAIN ] RDN: Generated 1326 derivative records from 32335 primary records. [2025-09-15T21:20:27.378871] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-15T21:20:27.378934] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-15T21:20:27.397768] [DEBUG] [LOCAL ] RDN: Derivative data saved (1326 records). [2025-09-15T21:20:27.398072] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-15T21:20:27.404179] [INFO ] [MAIN ] Derivative Progress: 1555/2083 symbols completed. RDN took 1.0s. Estimated remaining: 2m 55s. Rate: 180.9 symbols/min [2025-09-15T21:20:27.404564] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1326 records). [2025-09-15T21:20:27.404785] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:27.404964] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-15T21:20:27.406974] [INFO ] [MAIN ] Derivative Progress: 1556/2083 symbols completed. RDDT took 1.0s. Estimated remaining: 2m 55s. Rate: 181.0 symbols/min [2025-09-15T21:20:27.407315] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:27.437604] [DEBUG] [LOCAL ] RDW: Loaded 38426 existing records from primary storage. [2025-09-15T21:20:27.437842] [INFO ] [MAIN ] RDW: Loaded 38426 primary data records. [2025-09-15T21:20:27.607923] [DEBUG] [LOCAL ] RDY: Loaded 34394 existing records from primary storage. [2025-09-15T21:20:27.658051] [INFO ] [MAIN ] RDY: Loaded 34394 primary data records. [2025-09-15T21:20:27.658572] [DEBUG] [LOCAL ] RELX: Loaded 35632 existing records from primary storage. [2025-09-15T21:20:27.658907] [INFO ] [MAIN ] RELX: Loaded 35632 primary data records. [2025-09-15T21:20:28.307938] [DEBUG] [MAIN ] RDW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:28.309598] [INFO ] [MAIN ] RDW: Generated 1326 derivative records from 38426 primary records. [2025-09-15T21:20:28.310171] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-15T21:20:28.324283] [DEBUG] [LOCAL ] RDW: Derivative data saved (1326 records). [2025-09-15T21:20:28.324577] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-15T21:20:28.326449] [INFO ] [MAIN ] Derivative Progress: 1557/2083 symbols completed. RDW took 1.0s. Estimated remaining: 2m 55s. Rate: 180.8 symbols/min [2025-09-15T21:20:28.327193] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:28.341574] [DEBUG] [MAIN ] RELX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:28.344519] [INFO ] [MAIN ] RELX: Generated 1326 derivative records from 35632 primary records. [2025-09-15T21:20:28.344790] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-15T21:20:28.363773] [DEBUG] [MAIN ] RDY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:28.365458] [INFO ] [MAIN ] RDY: Generated 1326 derivative records from 34394 primary records. [2025-09-15T21:20:28.365797] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-15T21:20:28.376676] [DEBUG] [LOCAL ] RELX: Derivative data saved (1326 records). [2025-09-15T21:20:28.382320] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-15T21:20:28.390923] [INFO ] [MAIN ] Derivative Progress: 1558/2083 symbols completed. RELX took 1.0s. Estimated remaining: 2m 54s. Rate: 180.9 symbols/min [2025-09-15T21:20:28.388782] [DEBUG] [LOCAL ] RDY: Derivative data saved (1326 records). [2025-09-15T21:20:28.399467] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-15T21:20:28.402382] [INFO ] [MAIN ] Derivative Progress: 1559/2083 symbols completed. RDY took 1.0s. Estimated remaining: 2m 54s. Rate: 181.0 symbols/min [2025-09-15T21:20:28.403111] [DEBUG] [LOCAL ] RERE: Loaded 30441 existing records from primary storage. [2025-09-15T21:20:28.403187] [INFO ] [MAIN ] RERE: Loaded 30441 primary data records. [2025-09-15T21:20:28.674671] [DEBUG] [MAIN ] RERE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:28.675308] [INFO ] [MAIN ] RERE: Generated 1326 derivative records from 30441 primary records. [2025-09-15T21:20:28.675370] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-15T21:20:28.687096] [DEBUG] [LOCAL ] RERE: Derivative data saved (1326 records). [2025-09-15T21:20:28.687153] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-15T21:20:28.688653] [INFO ] [MAIN ] Derivative Progress: 1560/2083 symbols completed. RERE took 0.4s. Estimated remaining: 2m 53s. Rate: 181.1 symbols/min [2025-09-15T21:20:28.689334] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:28.689618] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:28.689528] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:28.703606] [DEBUG] [LOCAL ] REX: Loaded 9096 existing records from primary storage. [2025-09-15T21:20:28.703885] [INFO ] [MAIN ] REX: Loaded 9096 primary data records. [2025-09-15T21:20:28.922511] [DEBUG] [LOCAL ] RES: Loaded 34685 existing records from primary storage. [2025-09-15T21:20:28.942107] [INFO ] [MAIN ] RES: Loaded 34685 primary data records. [2025-09-15T21:20:28.952246] [DEBUG] [LOCAL ] REVG: Loaded 29937 existing records from primary storage. [2025-09-15T21:20:28.968751] [INFO ] [MAIN ] REVG: Loaded 29937 primary data records. [2025-09-15T21:20:29.674295] [DEBUG] [MAIN ] REX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:29.675971] [INFO ] [MAIN ] REX: Generated 1326 derivative records from 9096 primary records. [2025-09-15T21:20:29.676156] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-15T21:20:29.692185] [DEBUG] [LOCAL ] REX: Derivative data saved (1326 records). [2025-09-15T21:20:29.692728] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-15T21:20:29.694675] [INFO ] [MAIN ] Derivative Progress: 1561/2083 symbols completed. REX took 1.0s. Estimated remaining: 2m 53s. Rate: 180.8 symbols/min [2025-09-15T21:20:29.695173] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:29.715904] [DEBUG] [MAIN ] RES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:29.717301] [INFO ] [MAIN ] RES: Generated 1326 derivative records from 34685 primary records. [2025-09-15T21:20:29.717473] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-15T21:20:29.729186] [DEBUG] [MAIN ] REVG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:29.738918] [INFO ] [MAIN ] REVG: Generated 1326 derivative records from 29937 primary records. [2025-09-15T21:20:29.741502] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-15T21:20:29.742269] [DEBUG] [LOCAL ] RES: Derivative data saved (1326 records). [2025-09-15T21:20:29.742390] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-15T21:20:29.746207] [INFO ] [MAIN ] Derivative Progress: 1562/2083 symbols completed. RES took 1.1s. Estimated remaining: 2m 53s. Rate: 180.9 symbols/min [2025-09-15T21:20:29.747587] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:29.771627] [DEBUG] [LOCAL ] REVG: Derivative data saved (1326 records). [2025-09-15T21:20:29.771734] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-15T21:20:29.774241] [INFO ] [MAIN ] Derivative Progress: 1563/2083 symbols completed. REVG took 1.1s. Estimated remaining: 2m 52s. Rate: 181.0 symbols/min [2025-09-15T21:20:29.775217] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:29.788211] [DEBUG] [LOCAL ] REXR: Loaded 38408 existing records from primary storage. [2025-09-15T21:20:29.788381] [INFO ] [MAIN ] REXR: Loaded 38408 primary data records. [2025-09-15T21:20:30.003883] [DEBUG] [LOCAL ] REZI: Loaded 34450 existing records from primary storage. [2025-09-15T21:20:30.007587] [INFO ] [MAIN ] REZI: Loaded 34450 primary data records. [2025-09-15T21:20:30.228326] [DEBUG] [LOCAL ] RF: Loaded 39593 existing records from primary storage. [2025-09-15T21:20:30.255732] [INFO ] [MAIN ] RF: Loaded 39593 primary data records. [2025-09-15T21:20:30.807579] [DEBUG] [MAIN ] REXR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:30.809331] [INFO ] [MAIN ] REXR: Generated 1326 derivative records from 38408 primary records. [2025-09-15T21:20:30.809591] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-15T21:20:30.834013] [DEBUG] [LOCAL ] REXR: Derivative data saved (1326 records). [2025-09-15T21:20:30.834913] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-15T21:20:30.843265] [INFO ] [MAIN ] Derivative Progress: 1564/2083 symbols completed. REXR took 1.1s. Estimated remaining: 2m 52s. Rate: 180.8 symbols/min [2025-09-15T21:20:30.845776] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:30.874217] [DEBUG] [MAIN ] REZI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:30.876618] [INFO ] [MAIN ] REZI: Generated 1326 derivative records from 34450 primary records. [2025-09-15T21:20:30.876931] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-15T21:20:30.887608] [DEBUG] [LOCAL ] RFI: Loaded 7712 existing records from primary storage. [2025-09-15T21:20:30.908624] [DEBUG] [LOCAL ] REZI: Derivative data saved (1326 records). [2025-09-15T21:20:30.907081] [INFO ] [MAIN ] RFI: Loaded 7712 primary data records. [2025-09-15T21:20:30.925712] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-15T21:20:30.965001] [INFO ] [MAIN ] Derivative Progress: 1565/2083 symbols completed. REZI took 1.2s. Estimated remaining: 2m 52s. Rate: 180.8 symbols/min [2025-09-15T21:20:31.020089] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:31.097347] [DEBUG] [MAIN ] RF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:31.109775] [INFO ] [MAIN ] RF: Generated 1326 derivative records from 39593 primary records. [2025-09-15T21:20:31.110090] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-15T21:20:31.183556] [DEBUG] [LOCAL ] RFL: Loaded 9000 existing records from primary storage. [2025-09-15T21:20:31.189462] [INFO ] [MAIN ] RFL: Loaded 9000 primary data records. [2025-09-15T21:20:31.189181] [DEBUG] [LOCAL ] RF: Derivative data saved (1326 records). [2025-09-15T21:20:31.264903] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-15T21:20:31.341896] [INFO ] [MAIN ] Derivative Progress: 1566/2083 symbols completed. RF took 1.6s. Estimated remaining: 2m 52s. Rate: 180.8 symbols/min [2025-09-15T21:20:31.459938] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:31.635144] [DEBUG] [LOCAL ] RFM: Loaded 2869 existing records from primary storage. [2025-09-15T21:20:31.639708] [INFO ] [MAIN ] RFM: Loaded 2869 primary data records. [2025-09-15T21:20:32.109375] [DEBUG] [MAIN ] RFI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:32.110849] [INFO ] [MAIN ] RFI: Generated 1326 derivative records from 7712 primary records. [2025-09-15T21:20:32.111419] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-15T21:20:32.129000] [DEBUG] [LOCAL ] RFI: Derivative data saved (1326 records). [2025-09-15T21:20:32.129663] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-15T21:20:32.131667] [INFO ] [MAIN ] Derivative Progress: 1567/2083 symbols completed. RFI took 1.3s. Estimated remaining: 2m 51s. Rate: 180.7 symbols/min [2025-09-15T21:20:32.132874] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:32.146015] [DEBUG] [MAIN ] RFL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:32.147369] [INFO ] [MAIN ] RFL: Generated 1326 derivative records from 9000 primary records. [2025-09-15T21:20:32.147608] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-15T21:20:32.168673] [DEBUG] [LOCAL ] RFMZ: Loaded 6003 existing records from primary storage. [2025-09-15T21:20:32.169019] [DEBUG] [LOCAL ] RFL: Derivative data saved (1326 records). [2025-09-15T21:20:32.169535] [INFO ] [MAIN ] RFMZ: Loaded 6003 primary data records. [2025-09-15T21:20:32.170452] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-15T21:20:32.180322] [INFO ] [MAIN ] Derivative Progress: 1568/2083 symbols completed. RFL took 1.2s. Estimated remaining: 2m 51s. Rate: 180.8 symbols/min [2025-09-15T21:20:32.195304] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:32.232857] [DEBUG] [MAIN ] RFM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:32.260073] [INFO ] [MAIN ] RFM: Generated 1326 derivative records from 2869 primary records. [2025-09-15T21:20:32.290248] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-15T21:20:32.412700] [DEBUG] [LOCAL ] RFM: Derivative data saved (1326 records). [2025-09-15T21:20:32.515387] [DEBUG] [LOCAL ] RGA: Loaded 21089 existing records from primary storage. [2025-09-15T21:20:32.424561] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-15T21:20:32.523353] [INFO ] [MAIN ] Derivative Progress: 1569/2083 symbols completed. RFM took 1.1s. Estimated remaining: 2m 51s. Rate: 180.8 symbols/min [2025-09-15T21:20:32.523497] [INFO ] [MAIN ] RGA: Loaded 21089 primary data records. [2025-09-15T21:20:32.523760] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:32.696397] [DEBUG] [LOCAL ] RGR: Loaded 15312 existing records from primary storage. [2025-09-15T21:20:32.723531] [INFO ] [MAIN ] RGR: Loaded 15312 primary data records. [2025-09-15T21:20:33.014556] [DEBUG] [MAIN ] RFMZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:33.101682] [INFO ] [MAIN ] RFMZ: Generated 1326 derivative records from 6003 primary records. [2025-09-15T21:20:33.101965] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-15T21:20:33.116285] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1326 records). [2025-09-15T21:20:33.116708] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-15T21:20:33.118364] [INFO ] [MAIN ] Derivative Progress: 1570/2083 symbols completed. RFMZ took 1.0s. Estimated remaining: 2m 50s. Rate: 180.7 symbols/min [2025-09-15T21:20:33.119512] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:33.139962] [DEBUG] [LOCAL ] RGT: Loaded 1962 existing records from primary storage. [2025-09-15T21:20:33.141161] [INFO ] [MAIN ] RGT: Loaded 1962 primary data records. [2025-09-15T21:20:33.141113] [DEBUG] [MAIN ] RGA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:33.153070] [INFO ] [MAIN ] RGA: Generated 1326 derivative records from 21089 primary records. [2025-09-15T21:20:33.184748] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-15T21:20:33.273331] [DEBUG] [LOCAL ] RGA: Derivative data saved (1326 records). [2025-09-15T21:20:33.332529] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-15T21:20:33.418326] [INFO ] [MAIN ] Derivative Progress: 1571/2083 symbols completed. RGA took 1.2s. Estimated remaining: 2m 50s. Rate: 180.7 symbols/min [2025-09-15T21:20:33.434019] [DEBUG] [MAIN ] RGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:33.433685] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:33.435116] [INFO ] [MAIN ] RGR: Generated 1326 derivative records from 15312 primary records. [2025-09-15T21:20:33.435553] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-15T21:20:33.450991] [DEBUG] [LOCAL ] RGR: Derivative data saved (1326 records). [2025-09-15T21:20:33.451292] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-15T21:20:33.453582] [INFO ] [MAIN ] Derivative Progress: 1572/2083 symbols completed. RGR took 0.9s. Estimated remaining: 2m 50s. Rate: 180.8 symbols/min [2025-09-15T21:20:33.454315] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:33.472881] [DEBUG] [MAIN ] RGT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:33.473780] [INFO ] [MAIN ] RGT: Generated 1326 derivative records from 1962 primary records. [2025-09-15T21:20:33.473971] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-15T21:20:33.493391] [DEBUG] [LOCAL ] RGT: Derivative data saved (1326 records). [2025-09-15T21:20:33.493570] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-15T21:20:33.495117] [INFO ] [MAIN ] Derivative Progress: 1573/2083 symbols completed. RGT took 0.4s. Estimated remaining: 2m 49s. Rate: 180.9 symbols/min [2025-09-15T21:20:33.516991] [DEBUG] [LOCAL ] RH: Loaded 34838 existing records from primary storage. [2025-09-15T21:20:33.517177] [INFO ] [MAIN ] RH: Loaded 34838 primary data records. [2025-09-15T21:20:33.647334] [DEBUG] [LOCAL ] RHI: Loaded 36687 existing records from primary storage. [2025-09-15T21:20:33.678816] [INFO ] [MAIN ] RHI: Loaded 36687 primary data records. [2025-09-15T21:20:34.123133] [DEBUG] [MAIN ] RH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:34.123965] [INFO ] [MAIN ] RH: Generated 1326 derivative records from 34838 primary records. [2025-09-15T21:20:34.124140] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-15T21:20:34.136424] [DEBUG] [LOCAL ] RH: Derivative data saved (1326 records). [2025-09-15T21:20:34.136492] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-15T21:20:34.138376] [INFO ] [MAIN ] Derivative Progress: 1574/2083 symbols completed. RH took 0.7s. Estimated remaining: 2m 49s. Rate: 180.8 symbols/min [2025-09-15T21:20:34.149952] [DEBUG] [MAIN ] RHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:34.150510] [INFO ] [MAIN ] RHI: Generated 1326 derivative records from 36687 primary records. [2025-09-15T21:20:34.150571] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-15T21:20:34.162011] [DEBUG] [LOCAL ] RHI: Derivative data saved (1326 records). [2025-09-15T21:20:34.162070] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-15T21:20:34.163975] [INFO ] [MAIN ] Derivative Progress: 1575/2083 symbols completed. RHI took 0.7s. Estimated remaining: 2m 48s. Rate: 180.9 symbols/min [2025-09-15T21:20:34.164791] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:34.164908] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:34.164718] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:34.220435] [DEBUG] [LOCAL ] RHP: Loaded 29562 existing records from primary storage. [2025-09-15T21:20:34.220588] [INFO ] [MAIN ] RHP: Loaded 29562 primary data records. [2025-09-15T21:20:34.353560] [DEBUG] [LOCAL ] RIG: Loaded 39641 existing records from primary storage. [2025-09-15T21:20:34.348238] [DEBUG] [LOCAL ] RIO: Loaded 39386 existing records from primary storage. [2025-09-15T21:20:34.358834] [INFO ] [MAIN ] RIG: Loaded 39641 primary data records. [2025-09-15T21:20:34.364223] [INFO ] [MAIN ] RIO: Loaded 39386 primary data records. [2025-09-15T21:20:35.081495] [DEBUG] [MAIN ] RHP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:35.082581] [INFO ] [MAIN ] RHP: Generated 1326 derivative records from 29562 primary records. [2025-09-15T21:20:35.083016] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-15T21:20:35.099123] [DEBUG] [LOCAL ] RHP: Derivative data saved (1326 records). [2025-09-15T21:20:35.108612] [DEBUG] [MAIN ] RIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:35.109296] [INFO ] [MAIN ] RIG: Generated 1326 derivative records from 39641 primary records. [2025-09-15T21:20:35.108205] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-15T21:20:35.112159] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-15T21:20:35.111314] [INFO ] [MAIN ] Derivative Progress: 1576/2083 symbols completed. RHP took 0.9s. Estimated remaining: 2m 48s. Rate: 180.7 symbols/min [2025-09-15T21:20:35.113326] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:35.132254] [DEBUG] [MAIN ] RIO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:35.133362] [INFO ] [MAIN ] RIO: Generated 1326 derivative records from 39386 primary records. [2025-09-15T21:20:35.133923] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-15T21:20:35.145514] [DEBUG] [LOCAL ] RIG: Derivative data saved (1326 records). [2025-09-15T21:20:35.146278] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-15T21:20:35.149695] [INFO ] [MAIN ] Derivative Progress: 1577/2083 symbols completed. RIG took 1.0s. Estimated remaining: 2m 48s. Rate: 180.8 symbols/min [2025-09-15T21:20:35.150120] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:35.152858] [DEBUG] [LOCAL ] RIO: Derivative data saved (1326 records). [2025-09-15T21:20:35.153011] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-15T21:20:35.156220] [INFO ] [MAIN ] Derivative Progress: 1578/2083 symbols completed. RIO took 1.0s. Estimated remaining: 2m 48s. Rate: 180.9 symbols/min [2025-09-15T21:20:35.156914] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:35.174675] [DEBUG] [LOCAL ] RIV: Loaded 8646 existing records from primary storage. [2025-09-15T21:20:35.174864] [INFO ] [MAIN ] RIV: Loaded 8646 primary data records. [2025-09-15T21:20:35.303934] [DEBUG] [LOCAL ] RITM: Loaded 38979 existing records from primary storage. [2025-09-15T21:20:35.338696] [INFO ] [MAIN ] RITM: Loaded 38979 primary data records. [2025-09-15T21:20:35.575577] [DEBUG] [LOCAL ] RJF: Loaded 33970 existing records from primary storage. [2025-09-15T21:20:35.582301] [INFO ] [MAIN ] RJF: Loaded 33970 primary data records. [2025-09-15T21:20:36.019842] [DEBUG] [MAIN ] RIV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:36.020962] [INFO ] [MAIN ] RIV: Generated 1326 derivative records from 8646 primary records. [2025-09-15T21:20:36.021353] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-15T21:20:36.047327] [DEBUG] [LOCAL ] RIV: Derivative data saved (1326 records). [2025-09-15T21:20:36.047859] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-15T21:20:36.049503] [INFO ] [MAIN ] Derivative Progress: 1579/2083 symbols completed. RIV took 0.9s. Estimated remaining: 2m 47s. Rate: 180.7 symbols/min [2025-09-15T21:20:36.049754] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:36.047704] [DEBUG] [MAIN ] RITM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:36.050745] [INFO ] [MAIN ] RITM: Generated 1326 derivative records from 38979 primary records. [2025-09-15T21:20:36.051225] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-15T21:20:36.065590] [DEBUG] [LOCAL ] RITM: Derivative data saved (1326 records). [2025-09-15T21:20:36.065827] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-15T21:20:36.069384] [INFO ] [MAIN ] Derivative Progress: 1580/2083 symbols completed. RITM took 1.0s. Estimated remaining: 2m 47s. Rate: 180.8 symbols/min [2025-09-15T21:20:36.069839] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:36.081973] [DEBUG] [MAIN ] RJF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:36.082713] [INFO ] [MAIN ] RJF: Generated 1326 derivative records from 33970 primary records. [2025-09-15T21:20:36.082813] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-15T21:20:36.096147] [DEBUG] [LOCAL ] RJF: Derivative data saved (1326 records). [2025-09-15T21:20:36.096321] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-15T21:20:36.098211] [INFO ] [MAIN ] Derivative Progress: 1581/2083 symbols completed. RJF took 0.9s. Estimated remaining: 2m 46s. Rate: 180.9 symbols/min [2025-09-15T21:20:36.098500] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:36.146354] [DEBUG] [LOCAL ] RKT: Loaded 39690 existing records from primary storage. [2025-09-15T21:20:36.147683] [INFO ] [MAIN ] RKT: Loaded 39690 primary data records. [2025-09-15T21:20:36.178741] [DEBUG] [LOCAL ] RL: Loaded 29642 existing records from primary storage. [2025-09-15T21:20:36.223540] [INFO ] [MAIN ] RL: Loaded 29642 primary data records. [2025-09-15T21:20:36.245959] [DEBUG] [LOCAL ] RLI: Loaded 24791 existing records from primary storage. [2025-09-15T21:20:36.331111] [INFO ] [MAIN ] RLI: Loaded 24791 primary data records. [2025-09-15T21:20:36.988356] [DEBUG] [MAIN ] RKT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:36.989438] [INFO ] [MAIN ] RKT: Generated 1326 derivative records from 39690 primary records. [2025-09-15T21:20:36.989820] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-15T21:20:37.003755] [DEBUG] [LOCAL ] RKT: Derivative data saved (1326 records). [2025-09-15T21:20:37.004619] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-15T21:20:37.006394] [INFO ] [MAIN ] Derivative Progress: 1582/2083 symbols completed. RKT took 1.0s. Estimated remaining: 2m 46s. Rate: 180.7 symbols/min [2025-09-15T21:20:37.006790] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:37.018056] [DEBUG] [MAIN ] RL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:37.019717] [INFO ] [MAIN ] RL: Generated 1326 derivative records from 29642 primary records. [2025-09-15T21:20:37.020329] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-15T21:20:37.037011] [DEBUG] [MAIN ] RLI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:37.040868] [INFO ] [MAIN ] RLI: Generated 1326 derivative records from 24791 primary records. [2025-09-15T21:20:37.041489] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-15T21:20:37.048843] [DEBUG] [LOCAL ] RL: Derivative data saved (1326 records). [2025-09-15T21:20:37.049530] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-15T21:20:37.054486] [INFO ] [MAIN ] Derivative Progress: 1583/2083 symbols completed. RL took 1.0s. Estimated remaining: 2m 46s. Rate: 180.8 symbols/min [2025-09-15T21:20:37.055663] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:37.065021] [DEBUG] [LOCAL ] RLI: Derivative data saved (1326 records). [2025-09-15T21:20:37.065212] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-15T21:20:37.067227] [INFO ] [MAIN ] Derivative Progress: 1584/2083 symbols completed. RLI took 1.0s. Estimated remaining: 2m 45s. Rate: 180.9 symbols/min [2025-09-15T21:20:37.067617] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:37.084678] [DEBUG] [LOCAL ] RLJ: Loaded 35030 existing records from primary storage. [2025-09-15T21:20:37.088402] [INFO ] [MAIN ] RLJ: Loaded 35030 primary data records. [2025-09-15T21:20:37.088767] [DEBUG] [LOCAL ] RLTY: Loaded 7881 existing records from primary storage. [2025-09-15T21:20:37.110996] [INFO ] [MAIN ] RLTY: Loaded 7881 primary data records. [2025-09-15T21:20:37.440053] [DEBUG] [LOCAL ] RLX: Loaded 35046 existing records from primary storage. [2025-09-15T21:20:37.456353] [INFO ] [MAIN ] RLX: Loaded 35046 primary data records. [2025-09-15T21:20:37.959046] [DEBUG] [MAIN ] RLJ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:37.958610] [DEBUG] [MAIN ] RLTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:37.960011] [INFO ] [MAIN ] RLJ: Generated 1326 derivative records from 35030 primary records. [2025-09-15T21:20:37.961131] [INFO ] [MAIN ] RLTY: Generated 1326 derivative records from 7881 primary records. [2025-09-15T21:20:37.960438] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-15T21:20:37.962372] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-15T21:20:37.988524] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1326 records). [2025-09-15T21:20:37.988701] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-15T21:20:37.986922] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1326 records). [2025-09-15T21:20:37.988859] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-15T21:20:37.990890] [INFO ] [MAIN ] Derivative Progress: 1585/2083 symbols completed. RLTY took 0.9s. Estimated remaining: 2m 45s. Rate: 180.7 symbols/min [2025-09-15T21:20:37.993278] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:37.993336] [INFO ] [MAIN ] Derivative Progress: 1586/2083 symbols completed. RLJ took 1.0s. Estimated remaining: 2m 45s. Rate: 180.8 symbols/min [2025-09-15T21:20:37.993737] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:38.005392] [DEBUG] [MAIN ] RLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:38.006185] [INFO ] [MAIN ] RLX: Generated 1326 derivative records from 35046 primary records. [2025-09-15T21:20:38.006301] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-15T21:20:38.023898] [DEBUG] [LOCAL ] RLX: Derivative data saved (1326 records). [2025-09-15T21:20:38.028244] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-15T21:20:38.024274] [DEBUG] [LOCAL ] RM: Loaded 5576 existing records from primary storage. [2025-09-15T21:20:38.030264] [INFO ] [MAIN ] Derivative Progress: 1587/2083 symbols completed. RLX took 1.0s. Estimated remaining: 2m 44s. Rate: 180.9 symbols/min [2025-09-15T21:20:38.030404] [INFO ] [MAIN ] RM: Loaded 5576 primary data records. [2025-09-15T21:20:38.052036] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:38.142700] [DEBUG] [LOCAL ] RMAX: Loaded 16511 existing records from primary storage. [2025-09-15T21:20:38.148597] [INFO ] [MAIN ] RMAX: Loaded 16511 primary data records. [2025-09-15T21:20:38.498826] [DEBUG] [LOCAL ] RMD: Loaded 30817 existing records from primary storage. [2025-09-15T21:20:38.646665] [INFO ] [MAIN ] RMD: Loaded 30817 primary data records. [2025-09-15T21:20:38.933974] [DEBUG] [MAIN ] RM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:38.935569] [INFO ] [MAIN ] RM: Generated 1326 derivative records from 5576 primary records. [2025-09-15T21:20:38.936178] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-15T21:20:38.952265] [DEBUG] [LOCAL ] RM: Derivative data saved (1326 records). [2025-09-15T21:20:38.952434] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-15T21:20:38.954022] [INFO ] [MAIN ] Derivative Progress: 1588/2083 symbols completed. RM took 1.0s. Estimated remaining: 2m 44s. Rate: 180.7 symbols/min [2025-09-15T21:20:38.964432] [DEBUG] [MAIN ] RMAX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:38.965161] [INFO ] [MAIN ] RMAX: Generated 1326 derivative records from 16511 primary records. [2025-09-15T21:20:38.965460] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-15T21:20:38.989921] [DEBUG] [MAIN ] RMD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:38.989616] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1326 records). [2025-09-15T21:20:38.990685] [INFO ] [MAIN ] RMD: Generated 1326 derivative records from 30817 primary records. [2025-09-15T21:20:38.990741] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-15T21:20:38.992794] [INFO ] [MAIN ] Derivative Progress: 1589/2083 symbols completed. RMAX took 1.0s. Estimated remaining: 2m 44s. Rate: 180.8 symbols/min [2025-09-15T21:20:38.990875] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-15T21:20:39.005206] [DEBUG] [LOCAL ] RMD: Derivative data saved (1326 records). [2025-09-15T21:20:39.005272] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-15T21:20:39.007237] [INFO ] [MAIN ] Derivative Progress: 1590/2083 symbols completed. RMD took 1.0s. Estimated remaining: 2m 43s. Rate: 180.9 symbols/min [2025-09-15T21:20:39.007634] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:39.007797] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:39.007959] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:39.018132] [DEBUG] [LOCAL ] RMMZ: Loaded 3661 existing records from primary storage. [2025-09-15T21:20:39.020350] [DEBUG] [LOCAL ] RMI: Loaded 3512 existing records from primary storage. [2025-09-15T21:20:39.020544] [INFO ] [MAIN ] RMI: Loaded 3512 primary data records. [2025-09-15T21:20:39.020497] [INFO ] [MAIN ] RMMZ: Loaded 3661 primary data records. [2025-09-15T21:20:39.110427] [DEBUG] [LOCAL ] RMM: Loaded 7506 existing records from primary storage. [2025-09-15T21:20:39.169301] [INFO ] [MAIN ] RMM: Loaded 7506 primary data records. [2025-09-15T21:20:39.846773] [DEBUG] [MAIN ] RMMZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:39.847836] [INFO ] [MAIN ] RMMZ: Generated 1326 derivative records from 3661 primary records. [2025-09-15T21:20:39.849525] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-15T21:20:39.863436] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1326 records). [2025-09-15T21:20:39.863749] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-15T21:20:39.870877] [INFO ] [MAIN ] Derivative Progress: 1591/2083 symbols completed. RMMZ took 0.9s. Estimated remaining: 2m 43s. Rate: 180.8 symbols/min [2025-09-15T21:20:39.874893] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:39.884006] [DEBUG] [MAIN ] RMI: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:20:39.885316] [INFO ] [MAIN ] RMI: Generated 1325 derivative records from 3512 primary records. [2025-09-15T21:20:39.885837] [DEBUG] [MAIN ] RMM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:39.886024] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-15T21:20:39.887542] [INFO ] [MAIN ] RMM: Generated 1326 derivative records from 7506 primary records. [2025-09-15T21:20:39.887919] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-15T21:20:39.913727] [DEBUG] [LOCAL ] RMI: Derivative data saved (1325 records). [2025-09-15T21:20:39.918765] [DEBUG] [LOCAL ] RMM: Derivative data saved (1326 records). [2025-09-15T21:20:39.919180] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-15T21:20:39.921189] [INFO ] [MAIN ] Derivative Progress: 1592/2083 symbols completed. RMM took 0.9s. Estimated remaining: 2m 43s. Rate: 180.8 symbols/min [2025-09-15T21:20:39.919119] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-15T21:20:39.921451] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:39.923560] [INFO ] [MAIN ] Derivative Progress: 1593/2083 symbols completed. RMI took 0.9s. Estimated remaining: 2m 42s. Rate: 181.0 symbols/min [2025-09-15T21:20:39.919051] [DEBUG] [LOCAL ] RMT: Loaded 12619 existing records from primary storage. [2025-09-15T21:20:39.923804] [INFO ] [MAIN ] RMT: Loaded 12619 primary data records. [2025-09-15T21:20:39.924454] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:40.136325] [DEBUG] [LOCAL ] RNGR: Loaded 15569 existing records from primary storage. [2025-09-15T21:20:40.213354] [INFO ] [MAIN ] RNGR: Loaded 15569 primary data records. [2025-09-15T21:20:40.318202] [DEBUG] [LOCAL ] RNG: Loaded 35080 existing records from primary storage. [2025-09-15T21:20:40.329984] [INFO ] [MAIN ] RNG: Loaded 35080 primary data records. [2025-09-15T21:20:40.812568] [DEBUG] [MAIN ] RMT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:40.813627] [INFO ] [MAIN ] RMT: Generated 1326 derivative records from 12619 primary records. [2025-09-15T21:20:40.813917] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-15T21:20:40.829057] [DEBUG] [LOCAL ] RMT: Derivative data saved (1326 records). [2025-09-15T21:20:40.829237] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-15T21:20:40.831151] [INFO ] [MAIN ] Derivative Progress: 1594/2083 symbols completed. RMT took 1.0s. Estimated remaining: 2m 42s. Rate: 180.8 symbols/min [2025-09-15T21:20:40.837599] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:40.841946] [DEBUG] [MAIN ] RNGR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:40.843198] [INFO ] [MAIN ] RNGR: Generated 1326 derivative records from 15569 primary records. [2025-09-15T21:20:40.843536] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-15T21:20:40.858909] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1326 records). [2025-09-15T21:20:40.861524] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-15T21:20:40.863215] [INFO ] [MAIN ] Derivative Progress: 1595/2083 symbols completed. RNGR took 0.9s. Estimated remaining: 2m 42s. Rate: 180.9 symbols/min [2025-09-15T21:20:40.869201] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:40.873705] [DEBUG] [MAIN ] RNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:40.874512] [INFO ] [MAIN ] RNG: Generated 1326 derivative records from 35080 primary records. [2025-09-15T21:20:40.874817] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-15T21:20:40.880410] [DEBUG] [LOCAL ] RNP: Loaded 11608 existing records from primary storage. [2025-09-15T21:20:40.888831] [INFO ] [MAIN ] RNP: Loaded 11608 primary data records. [2025-09-15T21:20:40.935588] [DEBUG] [LOCAL ] RNG: Derivative data saved (1326 records). [2025-09-15T21:20:40.968341] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-15T21:20:40.981044] [INFO ] [MAIN ] Derivative Progress: 1596/2083 symbols completed. RNG took 1.1s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-15T21:20:41.003359] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:41.092186] [DEBUG] [LOCAL ] RNR: Loaded 25005 existing records from primary storage. [2025-09-15T21:20:41.170317] [INFO ] [MAIN ] RNR: Loaded 25005 primary data records. [2025-09-15T21:20:41.324520] [DEBUG] [LOCAL ] RNST: Loaded 26356 existing records from primary storage. [2025-09-15T21:20:41.362057] [INFO ] [MAIN ] RNST: Loaded 26356 primary data records. [2025-09-15T21:20:41.686599] [DEBUG] [MAIN ] RNP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:41.695080] [INFO ] [MAIN ] RNP: Generated 1326 derivative records from 11608 primary records. [2025-09-15T21:20:41.695272] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-15T21:20:41.815524] [DEBUG] [LOCAL ] RNP: Derivative data saved (1326 records). [2025-09-15T21:20:41.818733] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-15T21:20:41.820555] [INFO ] [MAIN ] Derivative Progress: 1597/2083 symbols completed. RNP took 1.0s. Estimated remaining: 2m 41s. Rate: 180.8 symbols/min [2025-09-15T21:20:41.832309] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:41.832232] [DEBUG] [MAIN ] RNR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:41.833150] [INFO ] [MAIN ] RNR: Generated 1326 derivative records from 25005 primary records. [2025-09-15T21:20:41.833833] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-15T21:20:41.849415] [DEBUG] [LOCAL ] RNR: Derivative data saved (1326 records). [2025-09-15T21:20:41.849622] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-15T21:20:41.851813] [INFO ] [MAIN ] Derivative Progress: 1598/2083 symbols completed. RNR took 1.0s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-15T21:20:41.852801] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:41.868595] [DEBUG] [LOCAL ] ROG: Loaded 16384 existing records from primary storage. [2025-09-15T21:20:41.868919] [INFO ] [MAIN ] ROG: Loaded 16384 primary data records. [2025-09-15T21:20:41.925563] [DEBUG] [MAIN ] RNST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:41.984546] [INFO ] [MAIN ] RNST: Generated 1326 derivative records from 26356 primary records. [2025-09-15T21:20:41.984744] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-15T21:20:42.078621] [DEBUG] [LOCAL ] RNST: Derivative data saved (1326 records). [2025-09-15T21:20:42.084130] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-15T21:20:42.170595] [INFO ] [MAIN ] Derivative Progress: 1599/2083 symbols completed. RNST took 1.2s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-15T21:20:42.181061] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:42.181963] [DEBUG] [LOCAL ] ROK: Loaded 32014 existing records from primary storage. [2025-09-15T21:20:42.182126] [INFO ] [MAIN ] ROK: Loaded 32014 primary data records. [2025-09-15T21:20:42.474259] [DEBUG] [LOCAL ] ROL: Loaded 36702 existing records from primary storage. [2025-09-15T21:20:42.477016] [INFO ] [MAIN ] ROL: Loaded 36702 primary data records. [2025-09-15T21:20:42.489465] [DEBUG] [MAIN ] ROG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:42.527554] [INFO ] [MAIN ] ROG: Generated 1326 derivative records from 16384 primary records. [2025-09-15T21:20:42.561528] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-15T21:20:42.683975] [DEBUG] [LOCAL ] ROG: Derivative data saved (1326 records). [2025-09-15T21:20:42.767604] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-15T21:20:42.778874] [INFO ] [MAIN ] Derivative Progress: 1600/2083 symbols completed. ROG took 0.9s. Estimated remaining: 2m 40s. Rate: 180.8 symbols/min [2025-09-15T21:20:42.779236] [DEBUG] [MAIN ] ROK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:42.780825] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:42.780190] [INFO ] [MAIN ] ROK: Generated 1326 derivative records from 32014 primary records. [2025-09-15T21:20:42.781166] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-15T21:20:42.797954] [DEBUG] [LOCAL ] ROK: Derivative data saved (1326 records). [2025-09-15T21:20:42.798113] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-15T21:20:42.801119] [INFO ] [MAIN ] Derivative Progress: 1601/2083 symbols completed. ROK took 0.9s. Estimated remaining: 2m 40s. Rate: 180.9 symbols/min [2025-09-15T21:20:42.802498] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:42.826015] [DEBUG] [MAIN ] ROL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:42.826676] [INFO ] [MAIN ] ROL: Generated 1326 derivative records from 36702 primary records. [2025-09-15T21:20:42.826739] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-15T21:20:42.842550] [DEBUG] [LOCAL ] ROL: Derivative data saved (1326 records). [2025-09-15T21:20:42.842777] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-15T21:20:42.853500] [INFO ] [MAIN ] Derivative Progress: 1602/2083 symbols completed. ROL took 0.7s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-15T21:20:42.854076] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:42.861136] [DEBUG] [LOCAL ] RPM: Loaded 30551 existing records from primary storage. [2025-09-15T21:20:42.861449] [DEBUG] [LOCAL ] RPT: Loaded 14420 existing records from primary storage. [2025-09-15T21:20:42.861841] [INFO ] [MAIN ] RPM: Loaded 30551 primary data records. [2025-09-15T21:20:42.861782] [INFO ] [MAIN ] RPT: Loaded 14420 primary data records. [2025-09-15T21:20:43.203086] [DEBUG] [LOCAL ] RQI: Loaded 20791 existing records from primary storage. [2025-09-15T21:20:43.312422] [INFO ] [MAIN ] RQI: Loaded 20791 primary data records. [2025-09-15T21:20:43.734969] [DEBUG] [MAIN ] RPM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:43.736927] [INFO ] [MAIN ] RPM: Generated 1326 derivative records from 30551 primary records. [2025-09-15T21:20:43.737777] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-15T21:20:43.760397] [DEBUG] [LOCAL ] RPM: Derivative data saved (1326 records). [2025-09-15T21:20:43.760763] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-15T21:20:43.763497] [INFO ] [MAIN ] Derivative Progress: 1603/2083 symbols completed. RPM took 1.0s. Estimated remaining: 2m 39s. Rate: 180.8 symbols/min [2025-09-15T21:20:43.761332] [DEBUG] [MAIN ] RPT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:43.765136] [INFO ] [MAIN ] RPT: Generated 1326 derivative records from 14420 primary records. [2025-09-15T21:20:43.765514] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-15T21:20:43.777303] [DEBUG] [LOCAL ] RPT: Derivative data saved (1326 records). [2025-09-15T21:20:43.777371] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-15T21:20:43.779305] [INFO ] [MAIN ] Derivative Progress: 1604/2083 symbols completed. RPT took 1.0s. Estimated remaining: 2m 39s. Rate: 180.9 symbols/min [2025-09-15T21:20:43.790885] [DEBUG] [MAIN ] RQI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:43.791403] [INFO ] [MAIN ] RQI: Generated 1326 derivative records from 20791 primary records. [2025-09-15T21:20:43.791462] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-15T21:20:43.802898] [DEBUG] [LOCAL ] RQI: Derivative data saved (1326 records). [2025-09-15T21:20:43.802954] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-15T21:20:43.804821] [INFO ] [MAIN ] Derivative Progress: 1605/2083 symbols completed. RQI took 1.0s. Estimated remaining: 2m 38s. Rate: 181.0 symbols/min [2025-09-15T21:20:43.805271] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:43.805318] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:43.805691] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:43.839008] [DEBUG] [LOCAL ] RS: Loaded 17927 existing records from primary storage. [2025-09-15T21:20:43.839200] [INFO ] [MAIN ] RS: Loaded 17927 primary data records. [2025-09-15T21:20:43.969372] [DEBUG] [LOCAL ] RRX: Loaded 29859 existing records from primary storage. [2025-09-15T21:20:43.986029] [INFO ] [MAIN ] RRX: Loaded 29859 primary data records. [2025-09-15T21:20:44.007162] [DEBUG] [LOCAL ] RRC: Loaded 38931 existing records from primary storage. [2025-09-15T21:20:44.089661] [INFO ] [MAIN ] RRC: Loaded 38931 primary data records. [2025-09-15T21:20:44.696194] [DEBUG] [MAIN ] RS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:44.697271] [INFO ] [MAIN ] RS: Generated 1326 derivative records from 17927 primary records. [2025-09-15T21:20:44.697577] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-15T21:20:44.711868] [DEBUG] [LOCAL ] RS: Derivative data saved (1326 records). [2025-09-15T21:20:44.712774] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-15T21:20:44.714988] [INFO ] [MAIN ] Derivative Progress: 1606/2083 symbols completed. RS took 0.9s. Estimated remaining: 2m 38s. Rate: 180.8 symbols/min [2025-09-15T21:20:44.715415] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:44.726722] [DEBUG] [MAIN ] RRX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:44.727724] [INFO ] [MAIN ] RRX: Generated 1326 derivative records from 29859 primary records. [2025-09-15T21:20:44.728883] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-15T21:20:44.738595] [DEBUG] [LOCAL ] RSF: Loaded 3387 existing records from primary storage. [2025-09-15T21:20:44.742035] [INFO ] [MAIN ] RSF: Loaded 3387 primary data records. [2025-09-15T21:20:44.818263] [DEBUG] [LOCAL ] RRX: Derivative data saved (1326 records). [2025-09-15T21:20:44.830851] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-15T21:20:44.833997] [INFO ] [MAIN ] Derivative Progress: 1607/2083 symbols completed. RRX took 1.0s. Estimated remaining: 2m 38s. Rate: 180.9 symbols/min [2025-09-15T21:20:44.831182] [DEBUG] [MAIN ] RRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:44.851253] [INFO ] [MAIN ] RRC: Generated 1326 derivative records from 38931 primary records. [2025-09-15T21:20:44.858958] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-15T21:20:44.858910] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:45.039759] [DEBUG] [LOCAL ] RRC: Derivative data saved (1326 records). [2025-09-15T21:20:45.040264] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-15T21:20:45.042234] [INFO ] [MAIN ] Derivative Progress: 1608/2083 symbols completed. RRC took 1.2s. Estimated remaining: 2m 38s. Rate: 180.9 symbols/min [2025-09-15T21:20:45.042678] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:45.074032] [DEBUG] [LOCAL ] RSG: Loaded 34830 existing records from primary storage. [2025-09-15T21:20:45.074403] [INFO ] [MAIN ] RSG: Loaded 34830 primary data records. [2025-09-15T21:20:45.185692] [DEBUG] [MAIN ] RSF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:45.213510] [INFO ] [MAIN ] RSF: Generated 1326 derivative records from 3387 primary records. [2025-09-15T21:20:45.227805] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-15T21:20:45.256233] [DEBUG] [LOCAL ] RSI: Loaded 34276 existing records from primary storage. [2025-09-15T21:20:45.256345] [INFO ] [MAIN ] RSI: Loaded 34276 primary data records. [2025-09-15T21:20:45.482256] [DEBUG] [LOCAL ] RSF: Derivative data saved (1326 records). [2025-09-15T21:20:45.494173] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-15T21:20:45.507334] [INFO ] [MAIN ] Derivative Progress: 1609/2083 symbols completed. RSF took 0.8s. Estimated remaining: 2m 37s. Rate: 180.9 symbols/min [2025-09-15T21:20:45.515337] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:45.700010] [DEBUG] [MAIN ] RSG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:45.709846] [INFO ] [MAIN ] RSG: Generated 1326 derivative records from 34830 primary records. [2025-09-15T21:20:45.710687] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-15T21:20:45.711795] [DEBUG] [LOCAL ] RSKD: Loaded 24745 existing records from primary storage. [2025-09-15T21:20:45.713079] [INFO ] [MAIN ] RSKD: Loaded 24745 primary data records. [2025-09-15T21:20:45.805689] [DEBUG] [LOCAL ] RSG: Derivative data saved (1326 records). [2025-09-15T21:20:45.824422] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-15T21:20:45.830239] [INFO ] [MAIN ] Derivative Progress: 1610/2083 symbols completed. RSG took 1.0s. Estimated remaining: 2m 37s. Rate: 180.9 symbols/min [2025-09-15T21:20:45.831961] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:45.893400] [DEBUG] [MAIN ] RSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:45.919282] [INFO ] [MAIN ] RSI: Generated 1326 derivative records from 34276 primary records. [2025-09-15T21:20:45.990633] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-15T21:20:46.014373] [DEBUG] [LOCAL ] RSI: Derivative data saved (1326 records). [2025-09-15T21:20:46.023147] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-15T21:20:46.025102] [INFO ] [MAIN ] Derivative Progress: 1611/2083 symbols completed. RSI took 1.0s. Estimated remaining: 2m 37s. Rate: 180.9 symbols/min [2025-09-15T21:20:46.025659] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:46.038550] [DEBUG] [LOCAL ] RTO: Loaded 28955 existing records from primary storage. [2025-09-15T21:20:46.038832] [INFO ] [MAIN ] RTO: Loaded 28955 primary data records. [2025-09-15T21:20:46.257603] [DEBUG] [LOCAL ] RTX: Loaded 39675 existing records from primary storage. [2025-09-15T21:20:46.258149] [INFO ] [MAIN ] RTX: Loaded 39675 primary data records. [2025-09-15T21:20:46.257980] [DEBUG] [MAIN ] RSKD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:46.332223] [INFO ] [MAIN ] RSKD: Generated 1326 derivative records from 24745 primary records. [2025-09-15T21:20:46.343094] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-15T21:20:46.458420] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1326 records). [2025-09-15T21:20:46.459052] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-15T21:20:46.462133] [INFO ] [MAIN ] Derivative Progress: 1612/2083 symbols completed. RSKD took 0.9s. Estimated remaining: 2m 36s. Rate: 180.9 symbols/min [2025-09-15T21:20:46.501714] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:46.643225] [DEBUG] [MAIN ] RTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:46.644000] [INFO ] [MAIN ] RTO: Generated 1326 derivative records from 28955 primary records. [2025-09-15T21:20:46.645083] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-15T21:20:46.666260] [DEBUG] [LOCAL ] RTO: Derivative data saved (1326 records). [2025-09-15T21:20:46.666619] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-15T21:20:46.668457] [INFO ] [MAIN ] Derivative Progress: 1613/2083 symbols completed. RTO took 0.8s. Estimated remaining: 2m 36s. Rate: 180.9 symbols/min [2025-09-15T21:20:46.668798] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:46.684975] [DEBUG] [LOCAL ] RVLV: Loaded 35067 existing records from primary storage. [2025-09-15T21:20:46.685260] [INFO ] [MAIN ] RVLV: Loaded 35067 primary data records. [2025-09-15T21:20:46.707570] [DEBUG] [MAIN ] RTX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:46.747449] [INFO ] [MAIN ] RTX: Generated 1326 derivative records from 39675 primary records. [2025-09-15T21:20:46.747597] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-15T21:20:46.824242] [DEBUG] [LOCAL ] RTX: Derivative data saved (1326 records). [2025-09-15T21:20:46.847363] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-15T21:20:46.875165] [INFO ] [MAIN ] Derivative Progress: 1614/2083 symbols completed. RTX took 0.8s. Estimated remaining: 2m 35s. Rate: 181.0 symbols/min [2025-09-15T21:20:46.883333] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:46.873056] [DEBUG] [LOCAL ] RVT: Loaded 19314 existing records from primary storage. [2025-09-15T21:20:46.906321] [INFO ] [MAIN ] RVT: Loaded 19314 primary data records. [2025-09-15T21:20:47.297965] [DEBUG] [LOCAL ] RVTY: Loaded 34959 existing records from primary storage. [2025-09-15T21:20:47.298541] [INFO ] [MAIN ] RVTY: Loaded 34959 primary data records. [2025-09-15T21:20:47.617724] [DEBUG] [MAIN ] RVLV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:47.618913] [INFO ] [MAIN ] RVLV: Generated 1326 derivative records from 35067 primary records. [2025-09-15T21:20:47.619311] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-15T21:20:47.633909] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1326 records). [2025-09-15T21:20:47.634138] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-15T21:20:47.636220] [INFO ] [MAIN ] Derivative Progress: 1615/2083 symbols completed. RVLV took 1.1s. Estimated remaining: 2m 35s. Rate: 180.8 symbols/min [2025-09-15T21:20:47.636732] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:47.651152] [DEBUG] [MAIN ] RVT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:47.652009] [INFO ] [MAIN ] RVT: Generated 1326 derivative records from 19314 primary records. [2025-09-15T21:20:47.652253] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-15T21:20:47.665034] [DEBUG] [LOCAL ] RVT: Derivative data saved (1326 records). [2025-09-15T21:20:47.665140] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-15T21:20:47.667162] [INFO ] [MAIN ] Derivative Progress: 1616/2083 symbols completed. RVT took 1.0s. Estimated remaining: 2m 35s. Rate: 180.9 symbols/min [2025-09-15T21:20:47.667425] [INFO ] [MAIN ] RWTP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:47.690025] [DEBUG] [LOCAL ] RWTP: Loaded 1986 existing records from primary storage. [2025-09-15T21:20:47.690261] [DEBUG] [MAIN ] RVTY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:47.690392] [INFO ] [MAIN ] RWTP: Loaded 1986 primary data records. [2025-09-15T21:20:47.701947] [INFO ] [MAIN ] RVTY: Generated 1326 derivative records from 34959 primary records. [2025-09-15T21:20:47.711285] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-15T21:20:47.811056] [DEBUG] [LOCAL ] RWT: Loaded 29329 existing records from primary storage. [2025-09-15T21:20:47.813929] [INFO ] [MAIN ] RWT: Loaded 29329 primary data records. [2025-09-15T21:20:47.813789] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1326 records). [2025-09-15T21:20:47.814464] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-15T21:20:47.848092] [INFO ] [MAIN ] Derivative Progress: 1617/2083 symbols completed. RVTY took 1.0s. Estimated remaining: 2m 34s. Rate: 181.0 symbols/min [2025-09-15T21:20:47.956270] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:48.282101] [DEBUG] [LOCAL ] RXO: Loaded 35301 existing records from primary storage. [2025-09-15T21:20:48.283809] [INFO ] [MAIN ] RXO: Loaded 35301 primary data records. [2025-09-15T21:20:48.357282] [DEBUG] [MAIN ] RWTP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:48.380454] [INFO ] [MAIN ] RWTP: Generated 1326 derivative records from 1986 primary records. [2025-09-15T21:20:48.396686] [DEBUG] [LOCAL ] RWTP: Saving derivative data. [2025-09-15T21:20:48.472342] [DEBUG] [LOCAL ] RWTP: Derivative data saved (1326 records). [2025-09-15T21:20:48.491971] [INFO ] [MAIN ] RWTP: Successfully saved derivative data. [2025-09-15T21:20:48.494412] [INFO ] [MAIN ] Derivative Progress: 1618/2083 symbols completed. RWTP took 0.8s. Estimated remaining: 2m 34s. Rate: 180.9 symbols/min [2025-09-15T21:20:48.492156] [DEBUG] [MAIN ] RWT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:48.497937] [INFO ] [MAIN ] RWT: Generated 1326 derivative records from 29329 primary records. [2025-09-15T21:20:48.498026] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-15T21:20:48.592715] [DEBUG] [LOCAL ] RWT: Derivative data saved (1326 records). [2025-09-15T21:20:48.593121] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-15T21:20:48.595267] [INFO ] [MAIN ] Derivative Progress: 1619/2083 symbols completed. RWT took 1.0s. Estimated remaining: 2m 34s. Rate: 180.9 symbols/min [2025-09-15T21:20:48.610906] [DEBUG] [MAIN ] RXO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:48.611472] [INFO ] [MAIN ] RXO: Generated 1326 derivative records from 35301 primary records. [2025-09-15T21:20:48.611533] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-15T21:20:48.623070] [DEBUG] [LOCAL ] RXO: Derivative data saved (1326 records). [2025-09-15T21:20:48.623137] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-15T21:20:48.624816] [INFO ] [MAIN ] Derivative Progress: 1620/2083 symbols completed. RXO took 0.7s. Estimated remaining: 2m 33s. Rate: 181.0 symbols/min [2025-09-15T21:20:48.625344] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:48.625554] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:48.625479] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:48.669553] [DEBUG] [LOCAL ] RYAM: Loaded 25610 existing records from primary storage. [2025-09-15T21:20:48.669749] [INFO ] [MAIN ] RYAM: Loaded 25610 primary data records. [2025-09-15T21:20:48.813060] [DEBUG] [LOCAL ] RYAN: Loaded 32151 existing records from primary storage. [2025-09-15T21:20:48.829954] [INFO ] [MAIN ] RYAN: Loaded 32151 primary data records. [2025-09-15T21:20:48.830072] [DEBUG] [LOCAL ] RY: Loaded 34981 existing records from primary storage. [2025-09-15T21:20:48.870262] [INFO ] [MAIN ] RY: Loaded 34981 primary data records. [2025-09-15T21:20:49.591864] [DEBUG] [MAIN ] RYAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:49.593627] [INFO ] [MAIN ] RYAM: Generated 1326 derivative records from 25610 primary records. [2025-09-15T21:20:49.593768] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-15T21:20:49.606984] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1326 records). [2025-09-15T21:20:49.609047] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-15T21:20:49.611142] [INFO ] [MAIN ] Derivative Progress: 1621/2083 symbols completed. RYAM took 1.0s. Estimated remaining: 2m 33s. Rate: 180.8 symbols/min [2025-09-15T21:20:49.611967] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:49.625092] [DEBUG] [MAIN ] RY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:49.626213] [INFO ] [MAIN ] RY: Generated 1326 derivative records from 34981 primary records. [2025-09-15T21:20:49.626447] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-15T21:20:49.637525] [DEBUG] [MAIN ] RYAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:49.654079] [INFO ] [MAIN ] RYAN: Generated 1326 derivative records from 32151 primary records. [2025-09-15T21:20:49.653357] [DEBUG] [LOCAL ] RY: Derivative data saved (1326 records). [2025-09-15T21:20:49.654279] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-15T21:20:49.654722] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-15T21:20:49.657014] [INFO ] [MAIN ] Derivative Progress: 1622/2083 symbols completed. RY took 1.0s. Estimated remaining: 2m 33s. Rate: 180.9 symbols/min [2025-09-15T21:20:49.665830] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:49.674574] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1326 records). [2025-09-15T21:20:49.674872] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-15T21:20:49.676812] [INFO ] [MAIN ] Derivative Progress: 1623/2083 symbols completed. RYAN took 1.1s. Estimated remaining: 2m 32s. Rate: 181.0 symbols/min [2025-09-15T21:20:49.677842] [DEBUG] [LOCAL ] RYI: Loaded 15971 existing records from primary storage. [2025-09-15T21:20:49.678104] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:49.678726] [INFO ] [MAIN ] RYI: Loaded 15971 primary data records. [2025-09-15T21:20:49.785874] [DEBUG] [LOCAL ] RZB: Loaded 4721 existing records from primary storage. [2025-09-15T21:20:49.805107] [INFO ] [MAIN ] RZB: Loaded 4721 primary data records. [2025-09-15T21:20:49.993065] [DEBUG] [LOCAL ] RYN: Loaded 33478 existing records from primary storage. [2025-09-15T21:20:50.106444] [INFO ] [MAIN ] RYN: Loaded 33478 primary data records. [2025-09-15T21:20:50.566219] [DEBUG] [MAIN ] RYI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:50.567408] [INFO ] [MAIN ] RYI: Generated 1326 derivative records from 15971 primary records. [2025-09-15T21:20:50.567594] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-15T21:20:50.582411] [DEBUG] [LOCAL ] RYI: Derivative data saved (1326 records). [2025-09-15T21:20:50.582749] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-15T21:20:50.584483] [INFO ] [MAIN ] Derivative Progress: 1624/2083 symbols completed. RYI took 1.0s. Estimated remaining: 2m 32s. Rate: 180.8 symbols/min [2025-09-15T21:20:50.594881] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:50.595812] [DEBUG] [MAIN ] RZB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:50.596927] [INFO ] [MAIN ] RZB: Generated 1326 derivative records from 4721 primary records. [2025-09-15T21:20:50.597748] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-15T21:20:50.610573] [DEBUG] [LOCAL ] RZB: Derivative data saved (1326 records). [2025-09-15T21:20:50.611618] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-15T21:20:50.615625] [DEBUG] [LOCAL ] RZC: Loaded 4930 existing records from primary storage. [2025-09-15T21:20:50.617684] [INFO ] [MAIN ] Derivative Progress: 1625/2083 symbols completed. RZB took 0.9s. Estimated remaining: 2m 32s. Rate: 180.9 symbols/min [2025-09-15T21:20:50.617815] [INFO ] [MAIN ] RZC: Loaded 4930 primary data records. [2025-09-15T21:20:50.618101] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:50.648065] [DEBUG] [MAIN ] RYN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:50.664138] [INFO ] [MAIN ] RYN: Generated 1326 derivative records from 33478 primary records. [2025-09-15T21:20:50.690994] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-15T21:20:50.740525] [DEBUG] [LOCAL ] RYN: Derivative data saved (1326 records). [2025-09-15T21:20:50.751536] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-15T21:20:50.758713] [INFO ] [MAIN ] Derivative Progress: 1626/2083 symbols completed. RYN took 1.1s. Estimated remaining: 2m 31s. Rate: 181.0 symbols/min [2025-09-15T21:20:50.791294] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:50.927473] [DEBUG] [LOCAL ] S: Loaded 39521 existing records from primary storage. [2025-09-15T21:20:50.927886] [INFO ] [MAIN ] S: Loaded 39521 primary data records. [2025-09-15T21:20:51.139004] [DEBUG] [LOCAL ] SA: Loaded 31513 existing records from primary storage. [2025-09-15T21:20:51.142661] [DEBUG] [MAIN ] RZC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:51.146402] [INFO ] [MAIN ] RZC: Generated 1326 derivative records from 4930 primary records. [2025-09-15T21:20:51.145577] [INFO ] [MAIN ] SA: Loaded 31513 primary data records. [2025-09-15T21:20:51.146578] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-15T21:20:51.309272] [DEBUG] [LOCAL ] RZC: Derivative data saved (1326 records). [2025-09-15T21:20:51.315090] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-15T21:20:51.329299] [INFO ] [MAIN ] Derivative Progress: 1627/2083 symbols completed. RZC took 0.7s. Estimated remaining: 2m 31s. Rate: 180.9 symbols/min [2025-09-15T21:20:51.334955] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:51.523565] [DEBUG] [LOCAL ] SABA: Loaded 6815 existing records from primary storage. [2025-09-15T21:20:51.524030] [INFO ] [MAIN ] SABA: Loaded 6815 primary data records. [2025-09-15T21:20:51.674348] [DEBUG] [MAIN ] S: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:51.725242] [INFO ] [MAIN ] S: Generated 1326 derivative records from 39521 primary records. [2025-09-15T21:20:51.731773] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-15T21:20:51.847736] [DEBUG] [LOCAL ] S: Derivative data saved (1326 records). [2025-09-15T21:20:51.848027] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-15T21:20:51.850946] [INFO ] [MAIN ] Derivative Progress: 1628/2083 symbols completed. S took 1.2s. Estimated remaining: 2m 31s. Rate: 180.9 symbols/min [2025-09-15T21:20:51.851289] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:51.864448] [DEBUG] [MAIN ] SA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:51.865706] [INFO ] [MAIN ] SA: Generated 1326 derivative records from 31513 primary records. [2025-09-15T21:20:51.865968] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-15T21:20:51.879181] [DEBUG] [LOCAL ] SA: Derivative data saved (1326 records). [2025-09-15T21:20:51.879291] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-15T21:20:51.881278] [INFO ] [MAIN ] Derivative Progress: 1629/2083 symbols completed. SA took 1.1s. Estimated remaining: 2m 31s. Rate: 181.0 symbols/min [2025-09-15T21:20:51.881773] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:51.905093] [DEBUG] [MAIN ] SABA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:51.905919] [INFO ] [MAIN ] SABA: Generated 1326 derivative records from 6815 primary records. [2025-09-15T21:20:51.906051] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-15T21:20:51.929180] [DEBUG] [LOCAL ] SAFE: Loaded 22255 existing records from primary storage. [2025-09-15T21:20:51.934136] [INFO ] [MAIN ] SAFE: Loaded 22255 primary data records. [2025-09-15T21:20:51.928767] [DEBUG] [LOCAL ] SABA: Derivative data saved (1326 records). [2025-09-15T21:20:51.934249] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-15T21:20:51.947122] [INFO ] [MAIN ] Derivative Progress: 1630/2083 symbols completed. SABA took 0.6s. Estimated remaining: 2m 30s. Rate: 181.0 symbols/min [2025-09-15T21:20:51.971965] [DEBUG] [LOCAL ] SAH: Loaded 15553 existing records from primary storage. [2025-09-15T21:20:51.998841] [INFO ] [MAIN ] SAH: Loaded 15553 primary data records. [2025-09-15T21:20:51.999141] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:52.260014] [DEBUG] [LOCAL ] SAM: Loaded 16106 existing records from primary storage. [2025-09-15T21:20:52.402567] [INFO ] [MAIN ] SAM: Loaded 16106 primary data records. [2025-09-15T21:20:52.772519] [DEBUG] [MAIN ] SAH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:52.779723] [INFO ] [MAIN ] SAH: Generated 1326 derivative records from 15553 primary records. [2025-09-15T21:20:52.783802] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-15T21:20:52.785571] [DEBUG] [MAIN ] SAFE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:52.798095] [DEBUG] [LOCAL ] SAH: Derivative data saved (1326 records). [2025-09-15T21:20:52.795191] [INFO ] [MAIN ] SAFE: Generated 1326 derivative records from 22255 primary records. [2025-09-15T21:20:52.798381] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-15T21:20:52.798441] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-15T21:20:52.801335] [INFO ] [MAIN ] Derivative Progress: 1631/2083 symbols completed. SAH took 0.9s. Estimated remaining: 2m 30s. Rate: 180.9 symbols/min [2025-09-15T21:20:52.801527] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:52.814039] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1326 records). [2025-09-15T21:20:52.814164] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-15T21:20:52.815886] [INFO ] [MAIN ] Derivative Progress: 1632/2083 symbols completed. SAFE took 1.0s. Estimated remaining: 2m 30s. Rate: 181.0 symbols/min [2025-09-15T21:20:52.816157] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:52.829996] [DEBUG] [MAIN ] SAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:52.830811] [INFO ] [MAIN ] SAM: Generated 1326 derivative records from 16106 primary records. [2025-09-15T21:20:52.830989] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-15T21:20:52.845007] [DEBUG] [LOCAL ] SAM: Derivative data saved (1326 records). [2025-09-15T21:20:52.845156] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-15T21:20:52.847050] [INFO ] [MAIN ] Derivative Progress: 1633/2083 symbols completed. SAM took 0.8s. Estimated remaining: 2m 29s. Rate: 181.1 symbols/min [2025-09-15T21:20:52.890760] [DEBUG] [LOCAL ] SAN: Loaded 39127 existing records from primary storage. [2025-09-15T21:20:52.890965] [INFO ] [MAIN ] SAN: Loaded 39127 primary data records. [2025-09-15T21:20:52.922330] [DEBUG] [LOCAL ] SAND: Loaded 38135 existing records from primary storage. [2025-09-15T21:20:52.953889] [INFO ] [MAIN ] SAND: Loaded 38135 primary data records. [2025-09-15T21:20:53.428546] [DEBUG] [MAIN ] SAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:53.429337] [INFO ] [MAIN ] SAN: Generated 1326 derivative records from 39127 primary records. [2025-09-15T21:20:53.429660] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-15T21:20:53.443382] [DEBUG] [LOCAL ] SAN: Derivative data saved (1326 records). [2025-09-15T21:20:53.443533] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-15T21:20:53.445352] [INFO ] [MAIN ] Derivative Progress: 1634/2083 symbols completed. SAN took 0.6s. Estimated remaining: 2m 29s. Rate: 181.0 symbols/min [2025-09-15T21:20:53.454998] [DEBUG] [MAIN ] SAND: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:53.455673] [INFO ] [MAIN ] SAND: Generated 1326 derivative records from 38135 primary records. [2025-09-15T21:20:53.455736] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-15T21:20:53.467386] [DEBUG] [LOCAL ] SAND: Derivative data saved (1326 records). [2025-09-15T21:20:53.467445] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-15T21:20:53.469807] [INFO ] [MAIN ] Derivative Progress: 1635/2083 symbols completed. SAND took 0.7s. Estimated remaining: 2m 28s. Rate: 181.1 symbols/min [2025-09-15T21:20:53.470357] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:53.470542] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:53.471109] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:53.485476] [DEBUG] [LOCAL ] SAR: Loaded 12085 existing records from primary storage. [2025-09-15T21:20:53.485691] [INFO ] [MAIN ] SAR: Loaded 12085 primary data records. [2025-09-15T21:20:53.784316] [DEBUG] [LOCAL ] SAP: Loaded 36605 existing records from primary storage. [2025-09-15T21:20:53.773483] [DEBUG] [LOCAL ] SARO: Loaded 35494 existing records from primary storage. [2025-09-15T21:20:53.784977] [INFO ] [MAIN ] SAP: Loaded 36605 primary data records. [2025-09-15T21:20:53.785263] [INFO ] [MAIN ] SARO: Loaded 35494 primary data records. [2025-09-15T21:20:54.365340] [DEBUG] [MAIN ] SAR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:54.366468] [INFO ] [MAIN ] SAR: Generated 1326 derivative records from 12085 primary records. [2025-09-15T21:20:54.366675] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-15T21:20:54.383327] [DEBUG] [LOCAL ] SAR: Derivative data saved (1326 records). [2025-09-15T21:20:54.383751] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-15T21:20:54.395387] [INFO ] [MAIN ] Derivative Progress: 1636/2083 symbols completed. SAR took 0.9s. Estimated remaining: 2m 28s. Rate: 180.9 symbols/min [2025-09-15T21:20:54.395715] [DEBUG] [MAIN ] SAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:54.396702] [INFO ] [MAIN ] SAP: Generated 1326 derivative records from 36605 primary records. [2025-09-15T21:20:54.397538] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:54.397634] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-15T21:20:54.421918] [DEBUG] [LOCAL ] SAP: Derivative data saved (1326 records). [2025-09-15T21:20:54.422017] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-15T21:20:54.423972] [INFO ] [MAIN ] Derivative Progress: 1637/2083 symbols completed. SAP took 1.0s. Estimated remaining: 2m 28s. Rate: 181.0 symbols/min [2025-09-15T21:20:54.420441] [DEBUG] [MAIN ] SARO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:54.425415] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:54.425357] [INFO ] [MAIN ] SARO: Generated 1326 derivative records from 35494 primary records. [2025-09-15T21:20:54.425860] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-15T21:20:54.446692] [DEBUG] [LOCAL ] SARO: Derivative data saved (1326 records). [2025-09-15T21:20:54.446860] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-15T21:20:54.449032] [INFO ] [MAIN ] Derivative Progress: 1638/2083 symbols completed. SARO took 1.0s. Estimated remaining: 2m 27s. Rate: 181.1 symbols/min [2025-09-15T21:20:54.450068] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:54.460753] [DEBUG] [LOCAL ] SB: Loaded 24037 existing records from primary storage. [2025-09-15T21:20:54.461086] [INFO ] [MAIN ] SB: Loaded 24037 primary data records. [2025-09-15T21:20:54.577451] [DEBUG] [LOCAL ] SBI: Loaded 5385 existing records from primary storage. [2025-09-15T21:20:54.592841] [INFO ] [MAIN ] SBI: Loaded 5385 primary data records. [2025-09-15T21:20:54.626043] [DEBUG] [LOCAL ] SBH: Loaded 36343 existing records from primary storage. [2025-09-15T21:20:54.768541] [INFO ] [MAIN ] SBH: Loaded 36343 primary data records. [2025-09-15T21:20:55.298387] [DEBUG] [MAIN ] SB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:55.299666] [INFO ] [MAIN ] SB: Generated 1326 derivative records from 24037 primary records. [2025-09-15T21:20:55.300120] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-15T21:20:55.316124] [DEBUG] [LOCAL ] SB: Derivative data saved (1326 records). [2025-09-15T21:20:55.326109] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-15T21:20:55.326392] [DEBUG] [MAIN ] SBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:55.328172] [INFO ] [MAIN ] Derivative Progress: 1639/2083 symbols completed. SB took 0.9s. Estimated remaining: 2m 27s. Rate: 180.9 symbols/min [2025-09-15T21:20:55.328906] [INFO ] [MAIN ] SBI: Generated 1326 derivative records from 5385 primary records. [2025-09-15T21:20:55.338547] [DEBUG] [MAIN ] SBH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:55.338337] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-15T21:20:55.338116] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:55.339839] [INFO ] [MAIN ] SBH: Generated 1326 derivative records from 36343 primary records. [2025-09-15T21:20:55.340425] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-15T21:20:55.360514] [DEBUG] [LOCAL ] SBI: Derivative data saved (1326 records). [2025-09-15T21:20:55.362687] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-15T21:20:55.364633] [DEBUG] [LOCAL ] SBH: Derivative data saved (1326 records). [2025-09-15T21:20:55.366752] [INFO ] [MAIN ] Derivative Progress: 1640/2083 symbols completed. SBI took 0.9s. Estimated remaining: 2m 27s. Rate: 181.0 symbols/min [2025-09-15T21:20:55.366839] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-15T21:20:55.368990] [INFO ] [MAIN ] Derivative Progress: 1641/2083 symbols completed. SBH took 0.9s. Estimated remaining: 2m 26s. Rate: 181.1 symbols/min [2025-09-15T21:20:55.367046] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:55.369451] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:55.372919] [DEBUG] [LOCAL ] SBR: Loaded 5227 existing records from primary storage. [2025-09-15T21:20:55.373093] [INFO ] [MAIN ] SBR: Loaded 5227 primary data records. [2025-09-15T21:20:55.522446] [DEBUG] [LOCAL ] SBSI: Loaded 10355 existing records from primary storage. [2025-09-15T21:20:55.562292] [INFO ] [MAIN ] SBSI: Loaded 10355 primary data records. [2025-09-15T21:20:55.762094] [DEBUG] [LOCAL ] SBS: Loaded 36305 existing records from primary storage. [2025-09-15T21:20:55.772973] [INFO ] [MAIN ] SBS: Loaded 36305 primary data records. [2025-09-15T21:20:56.316069] [DEBUG] [MAIN ] SBR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:56.316824] [INFO ] [MAIN ] SBR: Generated 1326 derivative records from 5227 primary records. [2025-09-15T21:20:56.317117] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-15T21:20:56.332462] [DEBUG] [LOCAL ] SBR: Derivative data saved (1326 records). [2025-09-15T21:20:56.333213] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-15T21:20:56.335098] [INFO ] [MAIN ] Derivative Progress: 1642/2083 symbols completed. SBR took 1.0s. Estimated remaining: 2m 26s. Rate: 180.9 symbols/min [2025-09-15T21:20:56.335339] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:56.346521] [DEBUG] [MAIN ] SBSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:56.348322] [INFO ] [MAIN ] SBSI: Generated 1326 derivative records from 10355 primary records. [2025-09-15T21:20:56.348914] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-15T21:20:56.364203] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1326 records). [2025-09-15T21:20:56.364665] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-15T21:20:56.366730] [INFO ] [MAIN ] Derivative Progress: 1643/2083 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 26s. Rate: 181.0 symbols/min [2025-09-15T21:20:56.367200] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:56.380519] [DEBUG] [MAIN ] SBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:56.381388] [INFO ] [MAIN ] SBS: Generated 1326 derivative records from 36305 primary records. [2025-09-15T21:20:56.390707] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-15T21:20:56.403334] [DEBUG] [LOCAL ] SBS: Derivative data saved (1326 records). [2025-09-15T21:20:56.403476] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-15T21:20:56.405577] [INFO ] [MAIN ] Derivative Progress: 1644/2083 symbols completed. SBS took 1.0s. Estimated remaining: 2m 25s. Rate: 181.1 symbols/min [2025-09-15T21:20:56.416107] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:56.418194] [DEBUG] [LOCAL ] SBSW: Loaded 39176 existing records from primary storage. [2025-09-15T21:20:56.418285] [INFO ] [MAIN ] SBSW: Loaded 39176 primary data records. [2025-09-15T21:20:56.543670] [DEBUG] [LOCAL ] SCCO: Loaded 36022 existing records from primary storage. [2025-09-15T21:20:56.549562] [INFO ] [MAIN ] SCCO: Loaded 36022 primary data records. [2025-09-15T21:20:56.579574] [DEBUG] [LOCAL ] SCD: Loaded 10234 existing records from primary storage. [2025-09-15T21:20:56.656014] [INFO ] [MAIN ] SCD: Loaded 10234 primary data records. [2025-09-15T21:20:57.344776] [DEBUG] [MAIN ] SBSW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:57.345722] [INFO ] [MAIN ] SBSW: Generated 1326 derivative records from 39176 primary records. [2025-09-15T21:20:57.346048] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-15T21:20:57.359055] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1326 records). [2025-09-15T21:20:57.359237] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-15T21:20:57.361070] [INFO ] [MAIN ] Derivative Progress: 1645/2083 symbols completed. SBSW took 1.0s. Estimated remaining: 2m 25s. Rate: 180.9 symbols/min [2025-09-15T21:20:57.362088] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:57.383000] [DEBUG] [MAIN ] SCCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:57.387780] [INFO ] [MAIN ] SCCO: Generated 1326 derivative records from 36022 primary records. [2025-09-15T21:20:57.388307] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-15T21:20:57.388176] [DEBUG] [MAIN ] SCD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:57.389906] [INFO ] [MAIN ] SCD: Generated 1326 derivative records from 10234 primary records. [2025-09-15T21:20:57.390260] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-15T21:20:57.413518] [DEBUG] [LOCAL ] SCD: Derivative data saved (1326 records). [2025-09-15T21:20:57.414564] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-15T21:20:57.417264] [INFO ] [MAIN ] Derivative Progress: 1646/2083 symbols completed. SCD took 1.0s. Estimated remaining: 2m 25s. Rate: 181.0 symbols/min [2025-09-15T21:20:57.417775] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1326 records). [2025-09-15T21:20:57.418192] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-15T21:20:57.417994] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:57.420981] [INFO ] [MAIN ] Derivative Progress: 1647/2083 symbols completed. SCCO took 1.1s. Estimated remaining: 2m 24s. Rate: 181.1 symbols/min [2025-09-15T21:20:57.421666] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:57.450745] [DEBUG] [LOCAL ] SCHW: Loaded 39645 existing records from primary storage. [2025-09-15T21:20:57.450958] [INFO ] [MAIN ] SCHW: Loaded 39645 primary data records. [2025-09-15T21:20:57.497497] [DEBUG] [LOCAL ] SCL: Loaded 10664 existing records from primary storage. [2025-09-15T21:20:57.518064] [INFO ] [MAIN ] SCL: Loaded 10664 primary data records. [2025-09-15T21:20:57.772475] [DEBUG] [LOCAL ] SCI: Loaded 34407 existing records from primary storage. [2025-09-15T21:20:57.880551] [INFO ] [MAIN ] SCI: Loaded 34407 primary data records. [2025-09-15T21:20:58.306728] [DEBUG] [MAIN ] SCHW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:58.307611] [INFO ] [MAIN ] SCHW: Generated 1326 derivative records from 39645 primary records. [2025-09-15T21:20:58.316599] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-15T21:20:58.318615] [DEBUG] [MAIN ] SCL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:58.329989] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1326 records). [2025-09-15T21:20:58.330977] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-15T21:20:58.330824] [INFO ] [MAIN ] SCL: Generated 1326 derivative records from 10664 primary records. [2025-09-15T21:20:58.332855] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-15T21:20:58.332731] [INFO ] [MAIN ] Derivative Progress: 1648/2083 symbols completed. SCHW took 1.0s. Estimated remaining: 2m 24s. Rate: 180.9 symbols/min [2025-09-15T21:20:58.347461] [DEBUG] [LOCAL ] SCL: Derivative data saved (1326 records). [2025-09-15T21:20:58.347581] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-15T21:20:58.349718] [INFO ] [MAIN ] Derivative Progress: 1649/2083 symbols completed. SCL took 0.9s. Estimated remaining: 2m 24s. Rate: 181.0 symbols/min [2025-09-15T21:20:58.359324] [DEBUG] [MAIN ] SCI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:58.359991] [INFO ] [MAIN ] SCI: Generated 1326 derivative records from 34407 primary records. [2025-09-15T21:20:58.360052] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-15T21:20:58.371825] [DEBUG] [LOCAL ] SCI: Derivative data saved (1326 records). [2025-09-15T21:20:58.371899] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-15T21:20:58.373947] [INFO ] [MAIN ] Derivative Progress: 1650/2083 symbols completed. SCI took 1.0s. Estimated remaining: 2m 23s. Rate: 181.1 symbols/min [2025-09-15T21:20:58.374658] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:58.374822] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:58.375441] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:58.392041] [DEBUG] [LOCAL ] SCM: Loaded 13544 existing records from primary storage. [2025-09-15T21:20:58.392195] [INFO ] [MAIN ] SCM: Loaded 13544 primary data records. [2025-09-15T21:20:58.531234] [DEBUG] [LOCAL ] SD: Loaded 20654 existing records from primary storage. [2025-09-15T21:20:58.559331] [INFO ] [MAIN ] SD: Loaded 20654 primary data records. [2025-09-15T21:20:58.570086] [DEBUG] [LOCAL ] SCS: Loaded 31263 existing records from primary storage. [2025-09-15T21:20:58.663156] [INFO ] [MAIN ] SCS: Loaded 31263 primary data records. [2025-09-15T21:20:59.322392] [DEBUG] [MAIN ] SCM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:59.323339] [INFO ] [MAIN ] SCM: Generated 1326 derivative records from 13544 primary records. [2025-09-15T21:20:59.323570] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-15T21:20:59.336939] [DEBUG] [LOCAL ] SCM: Derivative data saved (1326 records). [2025-09-15T21:20:59.337142] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-15T21:20:59.339415] [INFO ] [MAIN ] Derivative Progress: 1651/2083 symbols completed. SCM took 1.0s. Estimated remaining: 2m 23s. Rate: 180.9 symbols/min [2025-09-15T21:20:59.342192] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:59.353791] [DEBUG] [MAIN ] SD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:59.358013] [INFO ] [MAIN ] SD: Generated 1326 derivative records from 20654 primary records. [2025-09-15T21:20:59.358146] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-15T21:20:59.368434] [DEBUG] [MAIN ] SCS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:20:59.378210] [DEBUG] [LOCAL ] SDHC: Loaded 7184 existing records from primary storage. [2025-09-15T21:20:59.382533] [INFO ] [MAIN ] SDHC: Loaded 7184 primary data records. [2025-09-15T21:20:59.381680] [INFO ] [MAIN ] SCS: Generated 1326 derivative records from 31263 primary records. [2025-09-15T21:20:59.403712] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-15T21:20:59.450363] [DEBUG] [LOCAL ] SD: Derivative data saved (1326 records). [2025-09-15T21:20:59.484216] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-15T21:20:59.511268] [INFO ] [MAIN ] Derivative Progress: 1652/2083 symbols completed. SD took 1.1s. Estimated remaining: 2m 23s. Rate: 181.0 symbols/min [2025-09-15T21:20:59.513355] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:59.531710] [DEBUG] [LOCAL ] SCS: Derivative data saved (1326 records). [2025-09-15T21:20:59.574983] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-15T21:20:59.595302] [INFO ] [MAIN ] Derivative Progress: 1653/2083 symbols completed. SCS took 1.2s. Estimated remaining: 2m 23s. Rate: 181.0 symbols/min [2025-09-15T21:20:59.602679] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:20:59.675107] [DEBUG] [LOCAL ] SDHY: Loaded 7627 existing records from primary storage. [2025-09-15T21:20:59.685885] [INFO ] [MAIN ] SDHY: Loaded 7627 primary data records. [2025-09-15T21:20:59.982880] [DEBUG] [LOCAL ] SDRL: Loaded 30303 existing records from primary storage. [2025-09-15T21:20:59.983232] [INFO ] [MAIN ] SDRL: Loaded 30303 primary data records. [2025-09-15T21:21:00.134544] [DEBUG] [MAIN ] SDHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:00.169551] [INFO ] [MAIN ] SDHC: Generated 1326 derivative records from 7184 primary records. [2025-09-15T21:21:00.278230] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-15T21:21:00.294670] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1326 records). [2025-09-15T21:21:00.296025] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-15T21:21:00.299171] [INFO ] [MAIN ] Derivative Progress: 1654/2083 symbols completed. SDHC took 1.0s. Estimated remaining: 2m 22s. Rate: 180.9 symbols/min [2025-09-15T21:21:00.300140] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:00.313029] [DEBUG] [MAIN ] SDHY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:00.313866] [INFO ] [MAIN ] SDHY: Generated 1326 derivative records from 7627 primary records. [2025-09-15T21:21:00.314168] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-15T21:21:00.326721] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1326 records). [2025-09-15T21:21:00.327058] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-15T21:21:00.329138] [INFO ] [MAIN ] Derivative Progress: 1655/2083 symbols completed. SDHY took 0.8s. Estimated remaining: 2m 22s. Rate: 181.0 symbols/min [2025-09-15T21:21:00.329396] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:00.344794] [DEBUG] [MAIN ] SDRL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:00.345538] [INFO ] [MAIN ] SDRL: Generated 1326 derivative records from 30303 primary records. [2025-09-15T21:21:00.345675] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-15T21:21:00.368123] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1326 records). [2025-09-15T21:21:00.368275] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-15T21:21:00.370136] [INFO ] [MAIN ] Derivative Progress: 1656/2083 symbols completed. SDRL took 0.8s. Estimated remaining: 2m 21s. Rate: 181.1 symbols/min [2025-09-15T21:21:00.370480] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:00.397999] [DEBUG] [LOCAL ] SE: Loaded 39397 existing records from primary storage. [2025-09-15T21:21:00.398279] [INFO ] [MAIN ] SE: Loaded 39397 primary data records. [2025-09-15T21:21:00.426950] [DEBUG] [LOCAL ] SEG: Loaded 9597 existing records from primary storage. [2025-09-15T21:21:00.455735] [INFO ] [MAIN ] SEG: Loaded 9597 primary data records. [2025-09-15T21:21:00.562398] [DEBUG] [LOCAL ] SEE: Loaded 35145 existing records from primary storage. [2025-09-15T21:21:00.613761] [INFO ] [MAIN ] SEE: Loaded 35145 primary data records. [2025-09-15T21:21:01.324993] [DEBUG] [MAIN ] SE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:01.328762] [INFO ] [MAIN ] SE: Generated 1326 derivative records from 39397 primary records. [2025-09-15T21:21:01.329534] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-15T21:21:01.367972] [DEBUG] [LOCAL ] SE: Derivative data saved (1326 records). [2025-09-15T21:21:01.373408] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-15T21:21:01.375588] [INFO ] [MAIN ] Derivative Progress: 1657/2083 symbols completed. SE took 1.1s. Estimated remaining: 2m 21s. Rate: 180.9 symbols/min [2025-09-15T21:21:01.375881] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:01.373792] [DEBUG] [MAIN ] SEE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:01.373273] [DEBUG] [MAIN ] SEG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:01.376814] [INFO ] [MAIN ] SEE: Generated 1326 derivative records from 35145 primary records. [2025-09-15T21:21:01.377672] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-15T21:21:01.379082] [INFO ] [MAIN ] SEG: Generated 1326 derivative records from 9597 primary records. [2025-09-15T21:21:01.380253] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-15T21:21:01.394790] [DEBUG] [LOCAL ] SEE: Derivative data saved (1326 records). [2025-09-15T21:21:01.394924] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-15T21:21:01.406071] [INFO ] [MAIN ] Derivative Progress: 1658/2083 symbols completed. SEE took 1.1s. Estimated remaining: 2m 21s. Rate: 181.0 symbols/min [2025-09-15T21:21:01.406628] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:01.411487] [DEBUG] [LOCAL ] SEG: Derivative data saved (1326 records). [2025-09-15T21:21:01.411822] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-15T21:21:01.414426] [INFO ] [MAIN ] Derivative Progress: 1659/2083 symbols completed. SEG took 1.0s. Estimated remaining: 2m 20s. Rate: 181.1 symbols/min [2025-09-15T21:21:01.414972] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:01.444406] [DEBUG] [LOCAL ] SEI: Loaded 36257 existing records from primary storage. [2025-09-15T21:21:01.453514] [INFO ] [MAIN ] SEI: Loaded 36257 primary data records. [2025-09-15T21:21:01.586779] [DEBUG] [LOCAL ] SEM: Loaded 32216 existing records from primary storage. [2025-09-15T21:21:01.585137] [DEBUG] [LOCAL ] SEMR: Loaded 30594 existing records from primary storage. [2025-09-15T21:21:01.592315] [INFO ] [MAIN ] SEM: Loaded 32216 primary data records. [2025-09-15T21:21:01.597518] [INFO ] [MAIN ] SEMR: Loaded 30594 primary data records. [2025-09-15T21:21:02.336897] [DEBUG] [MAIN ] SEI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:02.337932] [INFO ] [MAIN ] SEI: Generated 1326 derivative records from 36257 primary records. [2025-09-15T21:21:02.338242] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-15T21:21:02.356731] [DEBUG] [LOCAL ] SEI: Derivative data saved (1326 records). [2025-09-15T21:21:02.357130] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-15T21:21:02.359396] [INFO ] [MAIN ] Derivative Progress: 1660/2083 symbols completed. SEI took 1.0s. Estimated remaining: 2m 20s. Rate: 180.9 symbols/min [2025-09-15T21:21:02.366063] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:02.376635] [DEBUG] [MAIN ] SEM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:02.381534] [INFO ] [MAIN ] SEM: Generated 1326 derivative records from 32216 primary records. [2025-09-15T21:21:02.382168] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-15T21:21:02.382095] [DEBUG] [MAIN ] SEMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:02.383833] [INFO ] [MAIN ] SEMR: Generated 1326 derivative records from 30594 primary records. [2025-09-15T21:21:02.384341] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-15T21:21:02.406502] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1326 records). [2025-09-15T21:21:02.406969] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-15T21:21:02.411724] [INFO ] [MAIN ] Derivative Progress: 1661/2083 symbols completed. SEMR took 1.0s. Estimated remaining: 2m 20s. Rate: 181.0 symbols/min [2025-09-15T21:21:02.412041] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:02.409634] [DEBUG] [LOCAL ] SEM: Derivative data saved (1326 records). [2025-09-15T21:21:02.412721] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-15T21:21:02.415156] [INFO ] [MAIN ] Derivative Progress: 1662/2083 symbols completed. SEM took 1.0s. Estimated remaining: 2m 19s. Rate: 181.1 symbols/min [2025-09-15T21:21:02.415549] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:02.422742] [DEBUG] [LOCAL ] SFB: Loaded 2574 existing records from primary storage. [2025-09-15T21:21:02.422948] [INFO ] [MAIN ] SFB: Loaded 2574 primary data records. [2025-09-15T21:21:02.592946] [DEBUG] [LOCAL ] SES: Loaded 37762 existing records from primary storage. [2025-09-15T21:21:02.599518] [INFO ] [MAIN ] SES: Loaded 37762 primary data records. [2025-09-15T21:21:02.646945] [DEBUG] [LOCAL ] SF: Loaded 30057 existing records from primary storage. [2025-09-15T21:21:02.692012] [INFO ] [MAIN ] SF: Loaded 30057 primary data records. [2025-09-15T21:21:03.289082] [DEBUG] [MAIN ] SFB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:03.289928] [INFO ] [MAIN ] SFB: Generated 1326 derivative records from 2574 primary records. [2025-09-15T21:21:03.290013] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-15T21:21:03.303946] [DEBUG] [LOCAL ] SFB: Derivative data saved (1326 records). [2025-09-15T21:21:03.304293] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-15T21:21:03.306011] [INFO ] [MAIN ] Derivative Progress: 1663/2083 symbols completed. SFB took 0.9s. Estimated remaining: 2m 19s. Rate: 180.9 symbols/min [2025-09-15T21:21:03.323428] [DEBUG] [MAIN ] SF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:03.324146] [INFO ] [MAIN ] SF: Generated 1326 derivative records from 30057 primary records. [2025-09-15T21:21:03.332979] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-15T21:21:03.333247] [DEBUG] [MAIN ] SES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:03.334339] [INFO ] [MAIN ] SES: Generated 1326 derivative records from 37762 primary records. [2025-09-15T21:21:03.334565] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-15T21:21:03.353946] [DEBUG] [LOCAL ] SF: Derivative data saved (1326 records). [2025-09-15T21:21:03.355301] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-15T21:21:03.358569] [INFO ] [MAIN ] Derivative Progress: 1664/2083 symbols completed. SF took 0.9s. Estimated remaining: 2m 19s. Rate: 181.0 symbols/min [2025-09-15T21:21:03.359553] [DEBUG] [LOCAL ] SES: Derivative data saved (1326 records). [2025-09-15T21:21:03.359668] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-15T21:21:03.363486] [INFO ] [MAIN ] Derivative Progress: 1665/2083 symbols completed. SES took 1.0s. Estimated remaining: 2m 18s. Rate: 181.1 symbols/min [2025-09-15T21:21:03.364270] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:03.364389] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:03.364190] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:03.386614] [DEBUG] [LOCAL ] SFBS: Loaded 15262 existing records from primary storage. [2025-09-15T21:21:03.386780] [INFO ] [MAIN ] SFBS: Loaded 15262 primary data records. [2025-09-15T21:21:03.609112] [DEBUG] [LOCAL ] SG: Loaded 39519 existing records from primary storage. [2025-09-15T21:21:03.607979] [DEBUG] [LOCAL ] SFL: Loaded 32732 existing records from primary storage. [2025-09-15T21:21:03.611799] [INFO ] [MAIN ] SG: Loaded 39519 primary data records. [2025-09-15T21:21:03.711317] [INFO ] [MAIN ] SFL: Loaded 32732 primary data records. [2025-09-15T21:21:04.273430] [DEBUG] [MAIN ] SFBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:04.275249] [INFO ] [MAIN ] SFBS: Generated 1326 derivative records from 15262 primary records. [2025-09-15T21:21:04.276480] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-15T21:21:04.290831] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1326 records). [2025-09-15T21:21:04.291061] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-15T21:21:04.292818] [INFO ] [MAIN ] Derivative Progress: 1666/2083 symbols completed. SFBS took 0.9s. Estimated remaining: 2m 18s. Rate: 180.9 symbols/min [2025-09-15T21:21:04.293121] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:04.308261] [DEBUG] [MAIN ] SG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:04.309771] [INFO ] [MAIN ] SG: Generated 1326 derivative records from 39519 primary records. [2025-09-15T21:21:04.310421] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-15T21:21:04.329915] [DEBUG] [MAIN ] SFL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:04.332800] [DEBUG] [LOCAL ] SG: Derivative data saved (1326 records). [2025-09-15T21:21:04.333895] [INFO ] [MAIN ] SFL: Generated 1326 derivative records from 32732 primary records. [2025-09-15T21:21:04.334075] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-15T21:21:04.336773] [INFO ] [MAIN ] Derivative Progress: 1667/2083 symbols completed. SG took 1.0s. Estimated remaining: 2m 18s. Rate: 181.0 symbols/min [2025-09-15T21:21:04.334173] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-15T21:21:04.345560] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:04.373549] [DEBUG] [LOCAL ] SFL: Derivative data saved (1326 records). [2025-09-15T21:21:04.374632] [DEBUG] [LOCAL ] SGHC: Loaded 34314 existing records from primary storage. [2025-09-15T21:21:04.373752] [DEBUG] [LOCAL ] SGU: Loaded 5060 existing records from primary storage. [2025-09-15T21:21:04.374869] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-15T21:21:04.377341] [INFO ] [MAIN ] Derivative Progress: 1668/2083 symbols completed. SFL took 1.0s. Estimated remaining: 2m 17s. Rate: 181.1 symbols/min [2025-09-15T21:21:04.374806] [INFO ] [MAIN ] SGHC: Loaded 34314 primary data records. [2025-09-15T21:21:04.377448] [INFO ] [MAIN ] SGU: Loaded 5060 primary data records. [2025-09-15T21:21:04.377716] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:04.927960] [DEBUG] [LOCAL ] SHAK: Loaded 36037 existing records from primary storage. [2025-09-15T21:21:04.939171] [INFO ] [MAIN ] SHAK: Loaded 36037 primary data records. [2025-09-15T21:21:05.238205] [DEBUG] [MAIN ] SGU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:05.239944] [INFO ] [MAIN ] SGU: Generated 1326 derivative records from 5060 primary records. [2025-09-15T21:21:05.240126] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-15T21:21:05.251749] [DEBUG] [MAIN ] SGHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:05.258161] [INFO ] [MAIN ] SGHC: Generated 1326 derivative records from 34314 primary records. [2025-09-15T21:21:05.258347] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-15T21:21:05.273811] [DEBUG] [LOCAL ] SGU: Derivative data saved (1326 records). [2025-09-15T21:21:05.277102] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1326 records). [2025-09-15T21:21:05.277191] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-15T21:21:05.279012] [INFO ] [MAIN ] Derivative Progress: 1669/2083 symbols completed. SGHC took 1.0s. Estimated remaining: 2m 17s. Rate: 180.9 symbols/min [2025-09-15T21:21:05.276806] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-15T21:21:05.281408] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:05.281475] [INFO ] [MAIN ] Derivative Progress: 1670/2083 symbols completed. SGU took 0.9s. Estimated remaining: 2m 17s. Rate: 181.0 symbols/min [2025-09-15T21:21:05.282240] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:05.295341] [DEBUG] [MAIN ] SHAK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:05.296118] [INFO ] [MAIN ] SHAK: Generated 1326 derivative records from 36037 primary records. [2025-09-15T21:21:05.296183] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-15T21:21:05.319152] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1326 records). [2025-09-15T21:21:05.320091] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-15T21:21:05.322807] [INFO ] [MAIN ] Derivative Progress: 1671/2083 symbols completed. SHAK took 0.9s. Estimated remaining: 2m 16s. Rate: 181.1 symbols/min [2025-09-15T21:21:05.320513] [DEBUG] [LOCAL ] SHCO: Loaded 18137 existing records from primary storage. [2025-09-15T21:21:05.323081] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:05.323224] [INFO ] [MAIN ] SHCO: Loaded 18137 primary data records. [2025-09-15T21:21:05.550418] [DEBUG] [LOCAL ] SHG: Loaded 18956 existing records from primary storage. [2025-09-15T21:21:05.544944] [DEBUG] [LOCAL ] SHEL: Loaded 39637 existing records from primary storage. [2025-09-15T21:21:05.550555] [INFO ] [MAIN ] SHEL: Loaded 39637 primary data records. [2025-09-15T21:21:05.636300] [INFO ] [MAIN ] SHG: Loaded 18956 primary data records. [2025-09-15T21:21:06.225284] [DEBUG] [MAIN ] SHCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:06.226131] [INFO ] [MAIN ] SHCO: Generated 1326 derivative records from 18137 primary records. [2025-09-15T21:21:06.228174] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-15T21:21:06.243550] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1326 records). [2025-09-15T21:21:06.243833] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-15T21:21:06.245840] [INFO ] [MAIN ] Derivative Progress: 1672/2083 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 16s. Rate: 180.9 symbols/min [2025-09-15T21:21:06.246033] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:06.259716] [DEBUG] [MAIN ] SHEL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:06.260553] [INFO ] [MAIN ] SHEL: Generated 1326 derivative records from 39637 primary records. [2025-09-15T21:21:06.262075] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-15T21:21:06.282534] [DEBUG] [MAIN ] SHG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:06.284229] [INFO ] [MAIN ] SHG: Generated 1326 derivative records from 18956 primary records. [2025-09-15T21:21:06.285034] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-15T21:21:06.294995] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1326 records). [2025-09-15T21:21:06.295374] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-15T21:21:06.297747] [INFO ] [MAIN ] Derivative Progress: 1673/2083 symbols completed. SHEL took 1.0s. Estimated remaining: 2m 16s. Rate: 181.0 symbols/min [2025-09-15T21:21:06.303557] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:06.324207] [DEBUG] [LOCAL ] SHOC: Loaded 2053 existing records from primary storage. [2025-09-15T21:21:06.322354] [DEBUG] [LOCAL ] SHG: Derivative data saved (1326 records). [2025-09-15T21:21:06.324374] [INFO ] [MAIN ] SHOC: Loaded 2053 primary data records. [2025-09-15T21:21:06.322263] [DEBUG] [LOCAL ] SHO: Loaded 36534 existing records from primary storage. [2025-09-15T21:21:06.324470] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-15T21:21:06.326519] [INFO ] [MAIN ] Derivative Progress: 1674/2083 symbols completed. SHG took 1.0s. Estimated remaining: 2m 15s. Rate: 181.1 symbols/min [2025-09-15T21:21:06.337749] [INFO ] [MAIN ] SHO: Loaded 36534 primary data records. [2025-09-15T21:21:06.357876] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:06.881512] [DEBUG] [LOCAL ] SHW: Loaded 36988 existing records from primary storage. [2025-09-15T21:21:06.882721] [INFO ] [MAIN ] SHW: Loaded 36988 primary data records. [2025-09-15T21:21:07.184521] [DEBUG] [MAIN ] SHOC: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:07.185482] [INFO ] [MAIN ] SHOC: Generated 1325 derivative records from 2053 primary records. [2025-09-15T21:21:07.185894] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-15T21:21:07.207084] [DEBUG] [MAIN ] SHO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:07.210737] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1325 records). [2025-09-15T21:21:07.211584] [INFO ] [MAIN ] SHO: Generated 1326 derivative records from 36534 primary records. [2025-09-15T21:21:07.211748] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-15T21:21:07.211791] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-15T21:21:07.214508] [INFO ] [MAIN ] Derivative Progress: 1675/2083 symbols completed. SHOC took 0.9s. Estimated remaining: 2m 15s. Rate: 180.9 symbols/min [2025-09-15T21:21:07.214749] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:07.229107] [DEBUG] [LOCAL ] SHO: Derivative data saved (1326 records). [2025-09-15T21:21:07.229479] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-15T21:21:07.231450] [INFO ] [MAIN ] Derivative Progress: 1676/2083 symbols completed. SHO took 1.0s. Estimated remaining: 2m 15s. Rate: 181.0 symbols/min [2025-09-15T21:21:07.231879] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:07.245610] [DEBUG] [MAIN ] SHW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:07.246406] [INFO ] [MAIN ] SHW: Generated 1326 derivative records from 36988 primary records. [2025-09-15T21:21:07.246539] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-15T21:21:07.268612] [DEBUG] [LOCAL ] SHW: Derivative data saved (1326 records). [2025-09-15T21:21:07.268821] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-15T21:21:07.271226] [INFO ] [MAIN ] Derivative Progress: 1677/2083 symbols completed. SHW took 0.9s. Estimated remaining: 2m 14s. Rate: 181.1 symbols/min [2025-09-15T21:21:07.272292] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:07.284253] [DEBUG] [LOCAL ] SID: Loaded 31348 existing records from primary storage. [2025-09-15T21:21:07.284493] [INFO ] [MAIN ] SID: Loaded 31348 primary data records. [2025-09-15T21:21:07.425682] [DEBUG] [LOCAL ] SIG: Loaded 33768 existing records from primary storage. [2025-09-15T21:21:07.425589] [DEBUG] [LOCAL ] SII: Loaded 16892 existing records from primary storage. [2025-09-15T21:21:07.431320] [INFO ] [MAIN ] SIG: Loaded 33768 primary data records. [2025-09-15T21:21:07.446794] [INFO ] [MAIN ] SII: Loaded 16892 primary data records. [2025-09-15T21:21:08.193936] [DEBUG] [MAIN ] SID: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:08.195971] [INFO ] [MAIN ] SID: Generated 1326 derivative records from 31348 primary records. [2025-09-15T21:21:08.196942] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-15T21:21:08.214132] [DEBUG] [MAIN ] SIG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:08.217722] [INFO ] [MAIN ] SIG: Generated 1326 derivative records from 33768 primary records. [2025-09-15T21:21:08.218088] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-15T21:21:08.236906] [DEBUG] [MAIN ] SII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:08.239804] [INFO ] [MAIN ] SII: Generated 1326 derivative records from 16892 primary records. [2025-09-15T21:21:08.240863] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-15T21:21:08.243293] [DEBUG] [LOCAL ] SIG: Derivative data saved (1326 records). [2025-09-15T21:21:08.243900] [DEBUG] [LOCAL ] SID: Derivative data saved (1326 records). [2025-09-15T21:21:08.243965] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-15T21:21:08.254037] [INFO ] [MAIN ] Derivative Progress: 1678/2083 symbols completed. SIG took 1.0s. Estimated remaining: 2m 14s. Rate: 180.9 symbols/min [2025-09-15T21:21:08.254181] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-15T21:21:08.256363] [INFO ] [MAIN ] Derivative Progress: 1679/2083 symbols completed. SID took 1.0s. Estimated remaining: 2m 14s. Rate: 181.0 symbols/min [2025-09-15T21:21:08.259189] [DEBUG] [LOCAL ] SII: Derivative data saved (1326 records). [2025-09-15T21:21:08.259253] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-15T21:21:08.261188] [INFO ] [MAIN ] Derivative Progress: 1680/2083 symbols completed. SII took 1.0s. Estimated remaining: 2m 13s. Rate: 181.1 symbols/min [2025-09-15T21:21:08.261694] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:08.261807] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:08.261986] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:08.312444] [DEBUG] [LOCAL ] SILA: Loaded 22658 existing records from primary storage. [2025-09-15T21:21:08.313768] [INFO ] [MAIN ] SILA: Loaded 22658 primary data records. [2025-09-15T21:21:08.326161] [DEBUG] [LOCAL ] SITC: Loaded 30304 existing records from primary storage. [2025-09-15T21:21:08.367463] [DEBUG] [LOCAL ] SITE: Loaded 25540 existing records from primary storage. [2025-09-15T21:21:08.354662] [INFO ] [MAIN ] SITC: Loaded 30304 primary data records. [2025-09-15T21:21:08.367583] [INFO ] [MAIN ] SITE: Loaded 25540 primary data records. [2025-09-15T21:21:09.171892] [DEBUG] [MAIN ] SITE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:09.170440] [DEBUG] [MAIN ] SILA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:09.172781] [INFO ] [MAIN ] SILA: Generated 1326 derivative records from 22658 primary records. [2025-09-15T21:21:09.174209] [INFO ] [MAIN ] SITE: Generated 1326 derivative records from 25540 primary records. [2025-09-15T21:21:09.174426] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-15T21:21:09.174499] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-15T21:21:09.195233] [DEBUG] [MAIN ] SITC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:09.205630] [INFO ] [MAIN ] SITC: Generated 1326 derivative records from 30304 primary records. [2025-09-15T21:21:09.209114] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-15T21:21:09.210481] [DEBUG] [LOCAL ] SITE: Derivative data saved (1326 records). [2025-09-15T21:21:09.210667] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-15T21:21:09.214073] [INFO ] [MAIN ] Derivative Progress: 1681/2083 symbols completed. SITE took 1.0s. Estimated remaining: 2m 13s. Rate: 180.9 symbols/min [2025-09-15T21:21:09.214474] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:09.214214] [DEBUG] [LOCAL ] SILA: Derivative data saved (1326 records). [2025-09-15T21:21:09.222516] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-15T21:21:09.226960] [INFO ] [MAIN ] Derivative Progress: 1682/2083 symbols completed. SILA took 1.0s. Estimated remaining: 2m 13s. Rate: 181.0 symbols/min [2025-09-15T21:21:09.227832] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:09.230789] [DEBUG] [LOCAL ] SITC: Derivative data saved (1326 records). [2025-09-15T21:21:09.231095] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-15T21:21:09.234200] [INFO ] [MAIN ] Derivative Progress: 1683/2083 symbols completed. SITC took 1.0s. Estimated remaining: 2m 12s. Rate: 181.1 symbols/min [2025-09-15T21:21:09.234534] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:09.254488] [DEBUG] [LOCAL ] SJT: Loaded 16610 existing records from primary storage. [2025-09-15T21:21:09.254664] [INFO ] [MAIN ] SJT: Loaded 16610 primary data records. [2025-09-15T21:21:09.429759] [DEBUG] [LOCAL ] SKE: Loaded 25499 existing records from primary storage. [2025-09-15T21:21:09.464568] [DEBUG] [LOCAL ] SJM: Loaded 37109 existing records from primary storage. [2025-09-15T21:21:09.469406] [INFO ] [MAIN ] SKE: Loaded 25499 primary data records. [2025-09-15T21:21:09.505386] [INFO ] [MAIN ] SJM: Loaded 37109 primary data records. [2025-09-15T21:21:10.169553] [DEBUG] [MAIN ] SJT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:10.171381] [INFO ] [MAIN ] SJT: Generated 1326 derivative records from 16610 primary records. [2025-09-15T21:21:10.171653] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-15T21:21:10.185730] [DEBUG] [LOCAL ] SJT: Derivative data saved (1326 records). [2025-09-15T21:21:10.185985] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-15T21:21:10.187691] [INFO ] [MAIN ] Derivative Progress: 1684/2083 symbols completed. SJT took 1.0s. Estimated remaining: 2m 12s. Rate: 180.9 symbols/min [2025-09-15T21:21:10.190360] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:10.200513] [DEBUG] [MAIN ] SJM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:10.202547] [INFO ] [MAIN ] SJM: Generated 1326 derivative records from 37109 primary records. [2025-09-15T21:21:10.204256] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-15T21:21:10.225314] [DEBUG] [LOCAL ] SKIL: Loaded 4404 existing records from primary storage. [2025-09-15T21:21:10.225764] [DEBUG] [MAIN ] SKE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:10.228284] [INFO ] [MAIN ] SKIL: Loaded 4404 primary data records. [2025-09-15T21:21:10.228478] [DEBUG] [LOCAL ] SJM: Derivative data saved (1326 records). [2025-09-15T21:21:10.228565] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-15T21:21:10.229140] [INFO ] [MAIN ] SKE: Generated 1326 derivative records from 25499 primary records. [2025-09-15T21:21:10.229223] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-15T21:21:10.242728] [INFO ] [MAIN ] Derivative Progress: 1685/2083 symbols completed. SJM took 1.0s. Estimated remaining: 2m 12s. Rate: 181.0 symbols/min [2025-09-15T21:21:10.301181] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:10.435449] [DEBUG] [LOCAL ] SKE: Derivative data saved (1326 records). [2025-09-15T21:21:10.435673] [DEBUG] [LOCAL ] SKLZ: Loaded 8497 existing records from primary storage. [2025-09-15T21:21:10.549881] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-15T21:21:10.562990] [INFO ] [MAIN ] Derivative Progress: 1686/2083 symbols completed. SKE took 1.3s. Estimated remaining: 2m 12s. Rate: 181.0 symbols/min [2025-09-15T21:21:10.560538] [INFO ] [MAIN ] SKLZ: Loaded 8497 primary data records. [2025-09-15T21:21:10.568608] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:10.880604] [DEBUG] [LOCAL ] SKM: Loaded 26017 existing records from primary storage. [2025-09-15T21:21:10.883049] [INFO ] [MAIN ] SKM: Loaded 26017 primary data records. [2025-09-15T21:21:10.972101] [DEBUG] [MAIN ] SKIL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:10.996871] [INFO ] [MAIN ] SKIL: Generated 1326 derivative records from 4404 primary records. [2025-09-15T21:21:11.009576] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-15T21:21:11.197364] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1326 records). [2025-09-15T21:21:11.198533] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-15T21:21:11.200591] [INFO ] [MAIN ] Derivative Progress: 1687/2083 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 11s. Rate: 180.9 symbols/min [2025-09-15T21:21:11.200824] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:11.219100] [DEBUG] [MAIN ] SKLZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:11.221058] [INFO ] [MAIN ] SKLZ: Generated 1326 derivative records from 8497 primary records. [2025-09-15T21:21:11.221220] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-15T21:21:11.244813] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1326 records). [2025-09-15T21:21:11.245013] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-15T21:21:11.247273] [INFO ] [MAIN ] Derivative Progress: 1688/2083 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 11s. Rate: 181.0 symbols/min [2025-09-15T21:21:11.247819] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:11.262105] [DEBUG] [LOCAL ] SKT: Loaded 31192 existing records from primary storage. [2025-09-15T21:21:11.263607] [INFO ] [MAIN ] SKT: Loaded 31192 primary data records. [2025-09-15T21:21:11.377881] [DEBUG] [MAIN ] SKM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:11.389900] [INFO ] [MAIN ] SKM: Generated 1326 derivative records from 26017 primary records. [2025-09-15T21:21:11.400203] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-15T21:21:11.403146] [DEBUG] [LOCAL ] SKY: Loaded 28322 existing records from primary storage. [2025-09-15T21:21:11.430216] [INFO ] [MAIN ] SKY: Loaded 28322 primary data records. [2025-09-15T21:21:11.689615] [DEBUG] [LOCAL ] SKM: Derivative data saved (1326 records). [2025-09-15T21:21:11.690969] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-15T21:21:11.698410] [INFO ] [MAIN ] Derivative Progress: 1689/2083 symbols completed. SKM took 1.1s. Estimated remaining: 2m 11s. Rate: 181.0 symbols/min [2025-09-15T21:21:11.704486] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:11.873949] [DEBUG] [LOCAL ] SKYH: Loaded 11393 existing records from primary storage. [2025-09-15T21:21:11.875301] [INFO ] [MAIN ] SKYH: Loaded 11393 primary data records. [2025-09-15T21:21:12.070163] [DEBUG] [MAIN ] SKT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:12.074019] [INFO ] [MAIN ] SKT: Generated 1326 derivative records from 31192 primary records. [2025-09-15T21:21:12.118704] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-15T21:21:12.200131] [DEBUG] [MAIN ] SKY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:12.201720] [INFO ] [MAIN ] SKY: Generated 1326 derivative records from 28322 primary records. [2025-09-15T21:21:12.202200] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-15T21:21:12.202284] [DEBUG] [LOCAL ] SKT: Derivative data saved (1326 records). [2025-09-15T21:21:12.203129] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-15T21:21:12.205098] [INFO ] [MAIN ] Derivative Progress: 1690/2083 symbols completed. SKT took 1.0s. Estimated remaining: 2m 10s. Rate: 180.9 symbols/min [2025-09-15T21:21:12.212035] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:12.221156] [DEBUG] [LOCAL ] SKY: Derivative data saved (1326 records). [2025-09-15T21:21:12.221303] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-15T21:21:12.224057] [INFO ] [MAIN ] Derivative Progress: 1691/2083 symbols completed. SKY took 1.0s. Estimated remaining: 2m 10s. Rate: 181.0 symbols/min [2025-09-15T21:21:12.224476] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:12.238930] [DEBUG] [MAIN ] SKYH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:12.239734] [INFO ] [MAIN ] SKYH: Generated 1326 derivative records from 11393 primary records. [2025-09-15T21:21:12.242661] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-15T21:21:12.256034] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1326 records). [2025-09-15T21:21:12.256208] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-15T21:21:12.258362] [INFO ] [MAIN ] Derivative Progress: 1692/2083 symbols completed. SKYH took 0.6s. Estimated remaining: 2m 10s. Rate: 181.1 symbols/min [2025-09-15T21:21:12.259347] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:12.301704] [DEBUG] [LOCAL ] SLF: Loaded 28676 existing records from primary storage. [2025-09-15T21:21:12.301951] [INFO ] [MAIN ] SLF: Loaded 28676 primary data records. [2025-09-15T21:21:12.302730] [DEBUG] [LOCAL ] SLB: Loaded 39657 existing records from primary storage. [2025-09-15T21:21:12.333731] [INFO ] [MAIN ] SLB: Loaded 39657 primary data records. [2025-09-15T21:21:12.628816] [DEBUG] [LOCAL ] SLG: Loaded 33726 existing records from primary storage. [2025-09-15T21:21:12.680258] [INFO ] [MAIN ] SLG: Loaded 33726 primary data records. [2025-09-15T21:21:13.209467] [DEBUG] [MAIN ] SLF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:13.211390] [INFO ] [MAIN ] SLF: Generated 1326 derivative records from 28676 primary records. [2025-09-15T21:21:13.212059] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-15T21:21:13.242157] [DEBUG] [LOCAL ] SLF: Derivative data saved (1326 records). [2025-09-15T21:21:13.244045] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-15T21:21:13.243029] [DEBUG] [MAIN ] SLB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:13.246393] [INFO ] [MAIN ] Derivative Progress: 1693/2083 symbols completed. SLF took 1.0s. Estimated remaining: 2m 9s. Rate: 180.9 symbols/min [2025-09-15T21:21:13.248500] [INFO ] [MAIN ] SLB: Generated 1326 derivative records from 39657 primary records. [2025-09-15T21:21:13.249348] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-15T21:21:13.260611] [DEBUG] [MAIN ] SLG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:13.267417] [INFO ] [MAIN ] SLG: Generated 1326 derivative records from 33726 primary records. [2025-09-15T21:21:13.268524] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-15T21:21:13.283093] [DEBUG] [LOCAL ] SLB: Derivative data saved (1326 records). [2025-09-15T21:21:13.283718] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-15T21:21:13.286374] [INFO ] [MAIN ] Derivative Progress: 1694/2083 symbols completed. SLB took 1.1s. Estimated remaining: 2m 9s. Rate: 181.0 symbols/min [2025-09-15T21:21:13.289176] [DEBUG] [LOCAL ] SLG: Derivative data saved (1326 records). [2025-09-15T21:21:13.289260] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-15T21:21:13.291885] [INFO ] [MAIN ] Derivative Progress: 1695/2083 symbols completed. SLG took 1.0s. Estimated remaining: 2m 9s. Rate: 181.1 symbols/min [2025-09-15T21:21:13.292540] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:13.292678] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:13.293177] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:13.349944] [DEBUG] [LOCAL ] SLVM: Loaded 20291 existing records from primary storage. [2025-09-15T21:21:13.359589] [INFO ] [MAIN ] SLVM: Loaded 20291 primary data records. [2025-09-15T21:21:13.360208] [DEBUG] [LOCAL ] SLGN: Loaded 29229 existing records from primary storage. [2025-09-15T21:21:13.372777] [DEBUG] [LOCAL ] SLQT: Loaded 32427 existing records from primary storage. [2025-09-15T21:21:13.394706] [INFO ] [MAIN ] SLGN: Loaded 29229 primary data records. [2025-09-15T21:21:13.413358] [INFO ] [MAIN ] SLQT: Loaded 32427 primary data records. [2025-09-15T21:21:14.199143] [DEBUG] [MAIN ] SLQT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:14.201115] [INFO ] [MAIN ] SLQT: Generated 1326 derivative records from 32427 primary records. [2025-09-15T21:21:14.202203] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-15T21:21:14.218826] [DEBUG] [MAIN ] SLGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:14.223436] [INFO ] [MAIN ] SLGN: Generated 1326 derivative records from 29229 primary records. [2025-09-15T21:21:14.233039] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-15T21:21:14.235055] [DEBUG] [MAIN ] SLVM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:14.244634] [INFO ] [MAIN ] SLVM: Generated 1326 derivative records from 20291 primary records. [2025-09-15T21:21:14.244973] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-15T21:21:14.246283] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1326 records). [2025-09-15T21:21:14.246586] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-15T21:21:14.248752] [INFO ] [MAIN ] Derivative Progress: 1696/2083 symbols completed. SLQT took 1.0s. Estimated remaining: 2m 8s. Rate: 180.9 symbols/min [2025-09-15T21:21:14.256405] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1326 records). [2025-09-15T21:21:14.256600] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:14.260150] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-15T21:21:14.262310] [INFO ] [MAIN ] Derivative Progress: 1697/2083 symbols completed. SLGN took 1.0s. Estimated remaining: 2m 8s. Rate: 181.0 symbols/min [2025-09-15T21:21:14.262812] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:14.269745] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1326 records). [2025-09-15T21:21:14.269907] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-15T21:21:14.272113] [INFO ] [MAIN ] Derivative Progress: 1698/2083 symbols completed. SLVM took 1.0s. Estimated remaining: 2m 8s. Rate: 181.1 symbols/min [2025-09-15T21:21:14.275993] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:14.275754] [DEBUG] [LOCAL ] SMBK: Loaded 5894 existing records from primary storage. [2025-09-15T21:21:14.276874] [INFO ] [MAIN ] SMBK: Loaded 5894 primary data records. [2025-09-15T21:21:14.385796] [DEBUG] [LOCAL ] SMC: Loaded 7771 existing records from primary storage. [2025-09-15T21:21:14.403768] [INFO ] [MAIN ] SMC: Loaded 7771 primary data records. [2025-09-15T21:21:14.666926] [DEBUG] [LOCAL ] SM: Loaded 38476 existing records from primary storage. [2025-09-15T21:21:14.703360] [INFO ] [MAIN ] SM: Loaded 38476 primary data records. [2025-09-15T21:21:15.177728] [DEBUG] [MAIN ] SMBK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:15.187313] [DEBUG] [MAIN ] SMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:15.189143] [INFO ] [MAIN ] SMC: Generated 1326 derivative records from 7771 primary records. [2025-09-15T21:21:15.188597] [INFO ] [MAIN ] SMBK: Generated 1326 derivative records from 5894 primary records. [2025-09-15T21:21:15.189439] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-15T21:21:15.189505] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-15T21:21:15.211264] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1326 records). [2025-09-15T21:21:15.211357] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-15T21:21:15.213870] [INFO ] [MAIN ] Derivative Progress: 1699/2083 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 7s. Rate: 180.9 symbols/min [2025-09-15T21:21:15.214599] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:15.215981] [DEBUG] [LOCAL ] SMC: Derivative data saved (1326 records). [2025-09-15T21:21:15.216142] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-15T21:21:15.218282] [INFO ] [MAIN ] Derivative Progress: 1700/2083 symbols completed. SMC took 0.9s. Estimated remaining: 2m 7s. Rate: 181.0 symbols/min [2025-09-15T21:21:15.219129] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:15.231470] [DEBUG] [MAIN ] SM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:15.232252] [INFO ] [MAIN ] SM: Generated 1326 derivative records from 38476 primary records. [2025-09-15T21:21:15.232388] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-15T21:21:15.245293] [DEBUG] [LOCAL ] SM: Derivative data saved (1326 records). [2025-09-15T21:21:15.245486] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-15T21:21:15.248424] [INFO ] [MAIN ] Derivative Progress: 1701/2083 symbols completed. SM took 1.0s. Estimated remaining: 2m 7s. Rate: 181.1 symbols/min [2025-09-15T21:21:15.248760] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:15.274936] [DEBUG] [LOCAL ] SMHI: Loaded 9490 existing records from primary storage. [2025-09-15T21:21:15.275116] [INFO ] [MAIN ] SMHI: Loaded 9490 primary data records. [2025-09-15T21:21:15.348098] [DEBUG] [LOCAL ] SMG: Loaded 32007 existing records from primary storage. [2025-09-15T21:21:15.363520] [INFO ] [MAIN ] SMG: Loaded 32007 primary data records. [2025-09-15T21:21:15.375348] [DEBUG] [LOCAL ] SMFG: Loaded 35393 existing records from primary storage. [2025-09-15T21:21:15.380662] [INFO ] [MAIN ] SMFG: Loaded 35393 primary data records. [2025-09-15T21:21:16.117155] [DEBUG] [MAIN ] SMHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:16.117868] [INFO ] [MAIN ] SMHI: Generated 1326 derivative records from 9490 primary records. [2025-09-15T21:21:16.118171] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-15T21:21:16.132405] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1326 records). [2025-09-15T21:21:16.133049] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-15T21:21:16.134776] [INFO ] [MAIN ] Derivative Progress: 1702/2083 symbols completed. SMHI took 0.9s. Estimated remaining: 2m 6s. Rate: 180.9 symbols/min [2025-09-15T21:21:16.135060] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:16.146444] [DEBUG] [MAIN ] SMG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:16.156524] [INFO ] [MAIN ] SMG: Generated 1326 derivative records from 32007 primary records. [2025-09-15T21:21:16.157024] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-15T21:21:16.156984] [DEBUG] [MAIN ] SMFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:16.158160] [INFO ] [MAIN ] SMFG: Generated 1326 derivative records from 35393 primary records. [2025-09-15T21:21:16.166823] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-15T21:21:16.190073] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1326 records). [2025-09-15T21:21:16.189843] [DEBUG] [LOCAL ] SMG: Derivative data saved (1326 records). [2025-09-15T21:21:16.191128] [DEBUG] [LOCAL ] SMP: Loaded 13679 existing records from primary storage. [2025-09-15T21:21:16.191217] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-15T21:21:16.191345] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-15T21:21:16.193712] [INFO ] [MAIN ] Derivative Progress: 1703/2083 symbols completed. SMFG took 1.0s. Estimated remaining: 2m 6s. Rate: 181.0 symbols/min [2025-09-15T21:21:16.193820] [INFO ] [MAIN ] SMP: Loaded 13679 primary data records. [2025-09-15T21:21:16.196315] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:16.209056] [INFO ] [MAIN ] Derivative Progress: 1704/2083 symbols completed. SMG took 1.0s. Estimated remaining: 2m 6s. Rate: 181.1 symbols/min [2025-09-15T21:21:16.229790] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:16.529989] [DEBUG] [LOCAL ] SMR: Loaded 39761 existing records from primary storage. [2025-09-15T21:21:16.531443] [INFO ] [MAIN ] SMR: Loaded 39761 primary data records. [2025-09-15T21:21:16.532056] [DEBUG] [LOCAL ] SMRT: Loaded 32661 existing records from primary storage. [2025-09-15T21:21:16.552579] [INFO ] [MAIN ] SMRT: Loaded 32661 primary data records. [2025-09-15T21:21:17.065077] [DEBUG] [MAIN ] SMP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:17.066686] [INFO ] [MAIN ] SMP: Generated 1326 derivative records from 13679 primary records. [2025-09-15T21:21:17.066939] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-15T21:21:17.080634] [DEBUG] [LOCAL ] SMP: Derivative data saved (1326 records). [2025-09-15T21:21:17.080898] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-15T21:21:17.082864] [INFO ] [MAIN ] Derivative Progress: 1705/2083 symbols completed. SMP took 0.9s. Estimated remaining: 2m 5s. Rate: 181.0 symbols/min [2025-09-15T21:21:17.083149] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:17.099111] [DEBUG] [MAIN ] SMR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:17.101171] [INFO ] [MAIN ] SMR: Generated 1326 derivative records from 39761 primary records. [2025-09-15T21:21:17.101838] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-15T21:21:17.127371] [DEBUG] [MAIN ] SMRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:17.129402] [INFO ] [MAIN ] SMRT: Generated 1326 derivative records from 32661 primary records. [2025-09-15T21:21:17.136453] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-15T21:21:17.136825] [DEBUG] [LOCAL ] SMR: Derivative data saved (1326 records). [2025-09-15T21:21:17.138263] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-15T21:21:17.140399] [INFO ] [MAIN ] Derivative Progress: 1706/2083 symbols completed. SMR took 0.9s. Estimated remaining: 2m 5s. Rate: 181.0 symbols/min [2025-09-15T21:21:17.141115] [DEBUG] [LOCAL ] SMWB: Loaded 24632 existing records from primary storage. [2025-09-15T21:21:17.141421] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:17.151307] [INFO ] [MAIN ] SMWB: Loaded 24632 primary data records. [2025-09-15T21:21:17.197580] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1326 records). [2025-09-15T21:21:17.218184] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-15T21:21:17.231778] [INFO ] [MAIN ] Derivative Progress: 1707/2083 symbols completed. SMRT took 1.0s. Estimated remaining: 2m 5s. Rate: 181.1 symbols/min [2025-09-15T21:21:17.247689] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:17.468230] [DEBUG] [LOCAL ] SN: Loaded 36868 existing records from primary storage. [2025-09-15T21:21:17.468443] [INFO ] [MAIN ] SN: Loaded 36868 primary data records. [2025-09-15T21:21:17.530179] [DEBUG] [LOCAL ] SNA: Loaded 18248 existing records from primary storage. [2025-09-15T21:21:17.551335] [INFO ] [MAIN ] SNA: Loaded 18248 primary data records. [2025-09-15T21:21:18.026771] [DEBUG] [MAIN ] SMWB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:18.027859] [INFO ] [MAIN ] SMWB: Generated 1326 derivative records from 24632 primary records. [2025-09-15T21:21:18.028221] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-15T21:21:18.040578] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1326 records). [2025-09-15T21:21:18.040702] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-15T21:21:18.042566] [INFO ] [MAIN ] Derivative Progress: 1708/2083 symbols completed. SMWB took 1.0s. Estimated remaining: 2m 4s. Rate: 181.0 symbols/min [2025-09-15T21:21:18.056544] [DEBUG] [MAIN ] SN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:18.057144] [INFO ] [MAIN ] SN: Generated 1326 derivative records from 36868 primary records. [2025-09-15T21:21:18.057338] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-15T21:21:18.079635] [DEBUG] [MAIN ] SNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:18.080381] [INFO ] [MAIN ] SNA: Generated 1326 derivative records from 18248 primary records. [2025-09-15T21:21:18.080523] [DEBUG] [LOCAL ] SN: Derivative data saved (1326 records). [2025-09-15T21:21:18.080628] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-15T21:21:18.080685] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-15T21:21:18.082605] [INFO ] [MAIN ] Derivative Progress: 1709/2083 symbols completed. SN took 0.9s. Estimated remaining: 2m 4s. Rate: 181.1 symbols/min [2025-09-15T21:21:18.093849] [DEBUG] [LOCAL ] SNA: Derivative data saved (1326 records). [2025-09-15T21:21:18.093907] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-15T21:21:18.095936] [INFO ] [MAIN ] Derivative Progress: 1710/2083 symbols completed. SNA took 0.8s. Estimated remaining: 2m 4s. Rate: 181.2 symbols/min [2025-09-15T21:21:18.096376] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:18.096510] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:18.096429] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:18.103316] [DEBUG] [LOCAL ] SNDA: Loaded 3259 existing records from primary storage. [2025-09-15T21:21:18.103461] [INFO ] [MAIN ] SNDA: Loaded 3259 primary data records. [2025-09-15T21:21:18.389096] [DEBUG] [LOCAL ] SNDR: Loaded 29459 existing records from primary storage. [2025-09-15T21:21:18.400284] [INFO ] [MAIN ] SNDR: Loaded 29459 primary data records. [2025-09-15T21:21:18.431860] [DEBUG] [LOCAL ] SNAP: Loaded 39756 existing records from primary storage. [2025-09-15T21:21:18.485230] [INFO ] [MAIN ] SNAP: Loaded 39756 primary data records. [2025-09-15T21:21:18.960203] [DEBUG] [MAIN ] SNDA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:18.961913] [INFO ] [MAIN ] SNDA: Generated 1326 derivative records from 3259 primary records. [2025-09-15T21:21:18.962423] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-15T21:21:18.975573] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1326 records). [2025-09-15T21:21:18.975857] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-15T21:21:18.977732] [INFO ] [MAIN ] Derivative Progress: 1711/2083 symbols completed. SNDA took 0.9s. Estimated remaining: 2m 3s. Rate: 181.0 symbols/min [2025-09-15T21:21:18.977956] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:18.992659] [DEBUG] [MAIN ] SNDR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:18.994740] [INFO ] [MAIN ] SNDR: Generated 1326 derivative records from 29459 primary records. [2025-09-15T21:21:18.995417] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-15T21:21:19.012585] [DEBUG] [MAIN ] SNAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:19.015829] [INFO ] [MAIN ] SNAP: Generated 1326 derivative records from 39756 primary records. [2025-09-15T21:21:19.016457] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-15T21:21:19.035980] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1326 records). [2025-09-15T21:21:19.038735] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-15T21:21:19.040601] [INFO ] [MAIN ] Derivative Progress: 1712/2083 symbols completed. SNDR took 0.9s. Estimated remaining: 2m 3s. Rate: 181.1 symbols/min [2025-09-15T21:21:19.038603] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1326 records). [2025-09-15T21:21:19.040744] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-15T21:21:19.042907] [INFO ] [MAIN ] Derivative Progress: 1713/2083 symbols completed. SNAP took 0.9s. Estimated remaining: 2m 3s. Rate: 181.2 symbols/min [2025-09-15T21:21:19.043009] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:19.043176] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:19.055241] [DEBUG] [LOCAL ] SNN: Loaded 32922 existing records from primary storage. [2025-09-15T21:21:19.055514] [INFO ] [MAIN ] SNN: Loaded 32922 primary data records. [2025-09-15T21:21:19.360252] [DEBUG] [LOCAL ] SNOW: Loaded 39579 existing records from primary storage. [2025-09-15T21:21:19.359459] [DEBUG] [LOCAL ] SNV: Loaded 35457 existing records from primary storage. [2025-09-15T21:21:19.360999] [INFO ] [MAIN ] SNOW: Loaded 39579 primary data records. [2025-09-15T21:21:19.361150] [INFO ] [MAIN ] SNV: Loaded 35457 primary data records. [2025-09-15T21:21:19.942466] [DEBUG] [MAIN ] SNN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:19.943951] [INFO ] [MAIN ] SNN: Generated 1326 derivative records from 32922 primary records. [2025-09-15T21:21:19.944567] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-15T21:21:19.960110] [DEBUG] [LOCAL ] SNN: Derivative data saved (1326 records). [2025-09-15T21:21:19.960555] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-15T21:21:19.963007] [INFO ] [MAIN ] Derivative Progress: 1714/2083 symbols completed. SNN took 1.0s. Estimated remaining: 2m 2s. Rate: 181.0 symbols/min [2025-09-15T21:21:19.963831] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:19.984419] [DEBUG] [MAIN ] SNV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:19.988624] [INFO ] [MAIN ] SNV: Generated 1326 derivative records from 35457 primary records. [2025-09-15T21:21:19.988992] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-15T21:21:19.988952] [DEBUG] [MAIN ] SNOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:19.989582] [INFO ] [MAIN ] SNOW: Generated 1326 derivative records from 39579 primary records. [2025-09-15T21:21:19.990267] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-15T21:21:20.010331] [DEBUG] [LOCAL ] SNV: Derivative data saved (1326 records). [2025-09-15T21:21:20.013106] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1326 records). [2025-09-15T21:21:20.013180] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-15T21:21:20.015475] [INFO ] [MAIN ] Derivative Progress: 1715/2083 symbols completed. SNV took 1.0s. Estimated remaining: 2m 2s. Rate: 181.1 symbols/min [2025-09-15T21:21:20.013290] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-15T21:21:20.015864] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:20.017617] [INFO ] [MAIN ] Derivative Progress: 1716/2083 symbols completed. SNOW took 1.0s. Estimated remaining: 2m 2s. Rate: 181.2 symbols/min [2025-09-15T21:21:20.025423] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:20.039884] [DEBUG] [LOCAL ] SNX: Loaded 27621 existing records from primary storage. [2025-09-15T21:21:20.040108] [INFO ] [MAIN ] SNX: Loaded 27621 primary data records. [2025-09-15T21:21:20.261308] [DEBUG] [LOCAL ] SOBO: Loaded 28587 existing records from primary storage. [2025-09-15T21:21:20.343792] [INFO ] [MAIN ] SOBO: Loaded 28587 primary data records. [2025-09-15T21:21:20.356379] [DEBUG] [LOCAL ] SOC: Loaded 37427 existing records from primary storage. [2025-09-15T21:21:20.389547] [INFO ] [MAIN ] SOC: Loaded 37427 primary data records. [2025-09-15T21:21:20.892781] [DEBUG] [MAIN ] SNX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:20.893619] [INFO ] [MAIN ] SNX: Generated 1326 derivative records from 27621 primary records. [2025-09-15T21:21:20.893767] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-15T21:21:20.907496] [DEBUG] [LOCAL ] SNX: Derivative data saved (1326 records). [2025-09-15T21:21:20.907755] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-15T21:21:20.909822] [INFO ] [MAIN ] Derivative Progress: 1717/2083 symbols completed. SNX took 0.9s. Estimated remaining: 2m 1s. Rate: 181.0 symbols/min [2025-09-15T21:21:20.910088] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:20.922433] [DEBUG] [LOCAL ] SOJC: Loaded 3263 existing records from primary storage. [2025-09-15T21:21:20.927008] [INFO ] [MAIN ] SOJC: Loaded 3263 primary data records. [2025-09-15T21:21:20.926931] [DEBUG] [MAIN ] SOBO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:20.939611] [INFO ] [MAIN ] SOBO: Generated 1326 derivative records from 28587 primary records. [2025-09-15T21:21:20.964205] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-15T21:21:21.049487] [DEBUG] [MAIN ] SOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:21.063724] [INFO ] [MAIN ] SOC: Generated 1326 derivative records from 37427 primary records. [2025-09-15T21:21:21.074948] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-15T21:21:21.127252] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1326 records). [2025-09-15T21:21:21.220144] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-15T21:21:21.225947] [INFO ] [MAIN ] Derivative Progress: 1718/2083 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 1s. Rate: 181.0 symbols/min [2025-09-15T21:21:21.228040] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:21.228803] [DEBUG] [LOCAL ] SOC: Derivative data saved (1326 records). [2025-09-15T21:21:21.229333] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-15T21:21:21.232294] [INFO ] [MAIN ] Derivative Progress: 1719/2083 symbols completed. SOC took 1.2s. Estimated remaining: 2m 1s. Rate: 181.1 symbols/min [2025-09-15T21:21:21.233230] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:21.246499] [DEBUG] [LOCAL ] SOJD: Loaded 9165 existing records from primary storage. [2025-09-15T21:21:21.246843] [INFO ] [MAIN ] SOJD: Loaded 9165 primary data records. [2025-09-15T21:21:21.260953] [DEBUG] [LOCAL ] SOJE: Loaded 6610 existing records from primary storage. [2025-09-15T21:21:21.270514] [INFO ] [MAIN ] SOJE: Loaded 6610 primary data records. [2025-09-15T21:21:21.472331] [DEBUG] [MAIN ] SOJC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:21.507703] [INFO ] [MAIN ] SOJC: Generated 1326 derivative records from 3263 primary records. [2025-09-15T21:21:21.541018] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-15T21:21:21.707913] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1326 records). [2025-09-15T21:21:21.834022] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-15T21:21:21.836445] [INFO ] [MAIN ] Derivative Progress: 1720/2083 symbols completed. SOJC took 0.9s. Estimated remaining: 2m 0s. Rate: 181.0 symbols/min [2025-09-15T21:21:21.836741] [INFO ] [MAIN ] SOJF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:21.847827] [DEBUG] [LOCAL ] SOJF: Loaded 5906 existing records from primary storage. [2025-09-15T21:21:21.848268] [INFO ] [MAIN ] SOJF: Loaded 5906 primary data records. [2025-09-15T21:21:21.959752] [DEBUG] [MAIN ] SOJD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:21.964171] [INFO ] [MAIN ] SOJD: Generated 1326 derivative records from 9165 primary records. [2025-09-15T21:21:21.979758] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-15T21:21:22.131923] [DEBUG] [MAIN ] SOJE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:22.144544] [INFO ] [MAIN ] SOJE: Generated 1326 derivative records from 6610 primary records. [2025-09-15T21:21:22.144604] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1326 records). [2025-09-15T21:21:22.144763] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-15T21:21:22.146518] [INFO ] [MAIN ] Derivative Progress: 1721/2083 symbols completed. SOJD took 0.9s. Estimated remaining: 1m 60s. Rate: 181.0 symbols/min [2025-09-15T21:21:22.147416] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:22.147484] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-15T21:21:22.165155] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1326 records). [2025-09-15T21:21:22.169451] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-15T21:21:22.172466] [INFO ] [MAIN ] Derivative Progress: 1722/2083 symbols completed. SOJE took 0.9s. Estimated remaining: 1m 60s. Rate: 181.1 symbols/min [2025-09-15T21:21:22.170183] [DEBUG] [LOCAL ] SOL: Loaded 9596 existing records from primary storage. [2025-09-15T21:21:22.172720] [INFO ] [MAIN ] SOL: Loaded 9596 primary data records. [2025-09-15T21:21:22.172980] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:22.458515] [DEBUG] [MAIN ] SOJF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:22.460618] [INFO ] [MAIN ] SOJF: Generated 1326 derivative records from 5906 primary records. [2025-09-15T21:21:22.470933] [DEBUG] [LOCAL ] SOJF: Saving derivative data. [2025-09-15T21:21:22.472596] [DEBUG] [LOCAL ] SOLV: Loaded 32001 existing records from primary storage. [2025-09-15T21:21:22.481249] [INFO ] [MAIN ] SOLV: Loaded 32001 primary data records. [2025-09-15T21:21:22.484235] [DEBUG] [LOCAL ] SOJF: Derivative data saved (1326 records). [2025-09-15T21:21:22.484554] [INFO ] [MAIN ] SOJF: Successfully saved derivative data. [2025-09-15T21:21:22.517120] [INFO ] [MAIN ] Derivative Progress: 1723/2083 symbols completed. SOJF took 0.7s. Estimated remaining: 1m 59s. Rate: 181.1 symbols/min [2025-09-15T21:21:22.757030] [DEBUG] [MAIN ] SOL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:22.757780] [INFO ] [MAIN ] SOL: Generated 1326 derivative records from 9596 primary records. [2025-09-15T21:21:22.757889] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-15T21:21:22.770781] [DEBUG] [LOCAL ] SOL: Derivative data saved (1326 records). [2025-09-15T21:21:22.770865] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-15T21:21:22.772787] [INFO ] [MAIN ] Derivative Progress: 1724/2083 symbols completed. SOL took 0.6s. Estimated remaining: 1m 59s. Rate: 181.1 symbols/min [2025-09-15T21:21:22.787533] [DEBUG] [MAIN ] SOLV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:22.788100] [INFO ] [MAIN ] SOLV: Generated 1326 derivative records from 32001 primary records. [2025-09-15T21:21:22.788161] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-15T21:21:22.799564] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1326 records). [2025-09-15T21:21:22.799629] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-15T21:21:22.802195] [INFO ] [MAIN ] Derivative Progress: 1725/2083 symbols completed. SOLV took 0.6s. Estimated remaining: 1m 59s. Rate: 181.2 symbols/min [2025-09-15T21:21:22.802701] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:22.802617] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:22.803683] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:22.809877] [DEBUG] [LOCAL ] SOR: Loaded 2158 existing records from primary storage. [2025-09-15T21:21:22.810130] [INFO ] [MAIN ] SOR: Loaded 2158 primary data records. [2025-09-15T21:21:23.112002] [DEBUG] [LOCAL ] SON: Loaded 31361 existing records from primary storage. [2025-09-15T21:21:23.112587] [INFO ] [MAIN ] SON: Loaded 31361 primary data records. [2025-09-15T21:21:23.223426] [DEBUG] [LOCAL ] SONY: Loaded 39389 existing records from primary storage. [2025-09-15T21:21:23.226881] [INFO ] [MAIN ] SONY: Loaded 39389 primary data records. [2025-09-15T21:21:23.726139] [DEBUG] [MAIN ] SOR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:23.728118] [INFO ] [MAIN ] SOR: Generated 1326 derivative records from 2158 primary records. [2025-09-15T21:21:23.728863] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-15T21:21:23.748010] [DEBUG] [LOCAL ] SOR: Derivative data saved (1326 records). [2025-09-15T21:21:23.750183] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-15T21:21:23.753817] [INFO ] [MAIN ] Derivative Progress: 1726/2083 symbols completed. SOR took 1.0s. Estimated remaining: 1m 58s. Rate: 181.0 symbols/min [2025-09-15T21:21:23.755570] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:23.774250] [DEBUG] [MAIN ] SON: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:23.790139] [INFO ] [MAIN ] SON: Generated 1326 derivative records from 31361 primary records. [2025-09-15T21:21:23.790865] [DEBUG] [MAIN ] SONY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:23.791592] [INFO ] [MAIN ] SONY: Generated 1326 derivative records from 39389 primary records. [2025-09-15T21:21:23.791765] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-15T21:21:23.791854] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-15T21:21:23.817295] [DEBUG] [LOCAL ] SOS: Loaded 6737 existing records from primary storage. [2025-09-15T21:21:23.817910] [INFO ] [MAIN ] SOS: Loaded 6737 primary data records. [2025-09-15T21:21:23.825671] [DEBUG] [LOCAL ] SONY: Derivative data saved (1326 records). [2025-09-15T21:21:23.829556] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-15T21:21:23.829289] [DEBUG] [LOCAL ] SON: Derivative data saved (1326 records). [2025-09-15T21:21:23.829731] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-15T21:21:23.837835] [INFO ] [MAIN ] Derivative Progress: 1727/2083 symbols completed. SONY took 1.0s. Estimated remaining: 1m 58s. Rate: 181.1 symbols/min [2025-09-15T21:21:23.921698] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:23.921374] [INFO ] [MAIN ] Derivative Progress: 1728/2083 symbols completed. SON took 1.1s. Estimated remaining: 1m 58s. Rate: 181.2 symbols/min [2025-09-15T21:21:23.974893] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:24.354728] [DEBUG] [LOCAL ] SPB: Loaded 26023 existing records from primary storage. [2025-09-15T21:21:24.362049] [INFO ] [MAIN ] SPB: Loaded 26023 primary data records. [2025-09-15T21:21:24.361930] [DEBUG] [LOCAL ] SPCE: Loaded 36680 existing records from primary storage. [2025-09-15T21:21:24.386313] [INFO ] [MAIN ] SPCE: Loaded 36680 primary data records. [2025-09-15T21:21:25.011940] [DEBUG] [MAIN ] SOS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:25.013705] [INFO ] [MAIN ] SOS: Generated 1326 derivative records from 6737 primary records. [2025-09-15T21:21:25.014076] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-15T21:21:25.028024] [DEBUG] [LOCAL ] SOS: Derivative data saved (1326 records). [2025-09-15T21:21:25.028174] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-15T21:21:25.031229] [INFO ] [MAIN ] Derivative Progress: 1729/2083 symbols completed. SOS took 1.3s. Estimated remaining: 1m 57s. Rate: 181.0 symbols/min [2025-09-15T21:21:25.031866] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:25.042052] [DEBUG] [LOCAL ] SPE: Loaded 4390 existing records from primary storage. [2025-09-15T21:21:25.060541] [DEBUG] [MAIN ] SPB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:25.060589] [INFO ] [MAIN ] SPE: Loaded 4390 primary data records. [2025-09-15T21:21:25.060338] [DEBUG] [MAIN ] SPCE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:25.066861] [INFO ] [MAIN ] SPCE: Generated 1326 derivative records from 36680 primary records. [2025-09-15T21:21:25.067397] [INFO ] [MAIN ] SPB: Generated 1326 derivative records from 26023 primary records. [2025-09-15T21:21:25.067487] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-15T21:21:25.067548] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-15T21:21:25.133758] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1326 records). [2025-09-15T21:21:25.155825] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-15T21:21:25.169064] [INFO ] [MAIN ] Derivative Progress: 1730/2083 symbols completed. SPCE took 1.2s. Estimated remaining: 1m 57s. Rate: 181.0 symbols/min [2025-09-15T21:21:25.186309] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:25.187272] [DEBUG] [LOCAL ] SPB: Derivative data saved (1326 records). [2025-09-15T21:21:25.187355] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-15T21:21:25.189196] [INFO ] [MAIN ] Derivative Progress: 1731/2083 symbols completed. SPB took 1.3s. Estimated remaining: 1m 57s. Rate: 181.1 symbols/min [2025-09-15T21:21:25.189674] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:25.385898] [DEBUG] [MAIN ] SPE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:25.406239] [INFO ] [MAIN ] SPE: Generated 1326 derivative records from 4390 primary records. [2025-09-15T21:21:25.407314] [DEBUG] [LOCAL ] SPG: Loaded 37013 existing records from primary storage. [2025-09-15T21:21:25.406703] [DEBUG] [LOCAL ] SPGI: Loaded 32885 existing records from primary storage. [2025-09-15T21:21:25.407503] [INFO ] [MAIN ] SPG: Loaded 37013 primary data records. [2025-09-15T21:21:25.407448] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-15T21:21:25.428935] [INFO ] [MAIN ] SPGI: Loaded 32885 primary data records. [2025-09-15T21:21:25.698996] [DEBUG] [LOCAL ] SPE: Derivative data saved (1326 records). [2025-09-15T21:21:25.703358] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-15T21:21:25.809550] [INFO ] [MAIN ] Derivative Progress: 1732/2083 symbols completed. SPE took 0.8s. Estimated remaining: 1m 56s. Rate: 181.0 symbols/min [2025-09-15T21:21:25.863937] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:25.968980] [DEBUG] [LOCAL ] SPH: Loaded 12701 existing records from primary storage. [2025-09-15T21:21:25.969312] [INFO ] [MAIN ] SPH: Loaded 12701 primary data records. [2025-09-15T21:21:26.044028] [DEBUG] [MAIN ] SPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:26.073554] [INFO ] [MAIN ] SPG: Generated 1326 derivative records from 37013 primary records. [2025-09-15T21:21:26.084916] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-15T21:21:26.122583] [DEBUG] [MAIN ] SPGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:26.130354] [INFO ] [MAIN ] SPGI: Generated 1326 derivative records from 32885 primary records. [2025-09-15T21:21:26.145342] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-15T21:21:26.181094] [DEBUG] [LOCAL ] SPG: Derivative data saved (1326 records). [2025-09-15T21:21:26.190957] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-15T21:21:26.192836] [INFO ] [MAIN ] Derivative Progress: 1733/2083 symbols completed. SPG took 1.0s. Estimated remaining: 1m 56s. Rate: 181.0 symbols/min [2025-09-15T21:21:26.284150] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:26.283678] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1326 records). [2025-09-15T21:21:26.284350] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-15T21:21:26.286270] [INFO ] [MAIN ] Derivative Progress: 1734/2083 symbols completed. SPGI took 1.1s. Estimated remaining: 1m 56s. Rate: 181.1 symbols/min [2025-09-15T21:21:26.286609] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:26.322779] [DEBUG] [MAIN ] SPH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:26.323509] [INFO ] [MAIN ] SPH: Generated 1326 derivative records from 12701 primary records. [2025-09-15T21:21:26.323686] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-15T21:21:26.335403] [DEBUG] [LOCAL ] SPH: Derivative data saved (1326 records). [2025-09-15T21:21:26.336068] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-15T21:21:26.345279] [INFO ] [MAIN ] Derivative Progress: 1735/2083 symbols completed. SPH took 0.5s. Estimated remaining: 1m 55s. Rate: 181.2 symbols/min [2025-09-15T21:21:26.347132] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:26.348163] [DEBUG] [LOCAL ] SPHR: Loaded 28497 existing records from primary storage. [2025-09-15T21:21:26.356521] [INFO ] [MAIN ] SPHR: Loaded 28497 primary data records. [2025-09-15T21:21:26.357147] [DEBUG] [LOCAL ] SPIR: Loaded 27619 existing records from primary storage. [2025-09-15T21:21:26.368410] [INFO ] [MAIN ] SPIR: Loaded 27619 primary data records. [2025-09-15T21:21:26.565136] [DEBUG] [LOCAL ] SPMC: Loaded 3805 existing records from primary storage. [2025-09-15T21:21:26.605517] [INFO ] [MAIN ] SPMC: Loaded 3805 primary data records. [2025-09-15T21:21:27.216443] [DEBUG] [MAIN ] SPIR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:27.217271] [INFO ] [MAIN ] SPIR: Generated 1326 derivative records from 27619 primary records. [2025-09-15T21:21:27.226299] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-15T21:21:27.227621] [DEBUG] [MAIN ] SPHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:27.228464] [INFO ] [MAIN ] SPHR: Generated 1326 derivative records from 28497 primary records. [2025-09-15T21:21:27.240081] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1326 records). [2025-09-15T21:21:27.240190] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-15T21:21:27.240220] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-15T21:21:27.241953] [INFO ] [MAIN ] Derivative Progress: 1736/2083 symbols completed. SPIR took 1.0s. Estimated remaining: 1m 55s. Rate: 181.0 symbols/min [2025-09-15T21:21:27.242282] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:27.258413] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1326 records). [2025-09-15T21:21:27.258581] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-15T21:21:27.260430] [INFO ] [MAIN ] Derivative Progress: 1737/2083 symbols completed. SPHR took 1.0s. Estimated remaining: 1m 55s. Rate: 181.1 symbols/min [2025-09-15T21:21:27.260835] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:27.271592] [DEBUG] [MAIN ] SPMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:27.272345] [INFO ] [MAIN ] SPMC: Generated 1326 derivative records from 3805 primary records. [2025-09-15T21:21:27.272483] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-15T21:21:27.299533] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1326 records). [2025-09-15T21:21:27.300702] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-15T21:21:27.303189] [INFO ] [MAIN ] Derivative Progress: 1738/2083 symbols completed. SPMC took 1.0s. Estimated remaining: 1m 54s. Rate: 181.2 symbols/min [2025-09-15T21:21:27.304063] [DEBUG] [LOCAL ] SPNT: Loaded 25474 existing records from primary storage. [2025-09-15T21:21:27.304317] [INFO ] [MAIN ] SPNT: Loaded 25474 primary data records. [2025-09-15T21:21:27.596874] [DEBUG] [LOCAL ] SPOT: Loaded 37341 existing records from primary storage. [2025-09-15T21:21:27.597174] [INFO ] [MAIN ] SPOT: Loaded 37341 primary data records. [2025-09-15T21:21:27.880299] [DEBUG] [MAIN ] SPNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:27.881115] [INFO ] [MAIN ] SPNT: Generated 1326 derivative records from 25474 primary records. [2025-09-15T21:21:27.881267] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-15T21:21:27.894182] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1326 records). [2025-09-15T21:21:27.894411] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-15T21:21:27.896780] [INFO ] [MAIN ] Derivative Progress: 1739/2083 symbols completed. SPNT took 0.7s. Estimated remaining: 1m 54s. Rate: 181.1 symbols/min [2025-09-15T21:21:27.908288] [DEBUG] [MAIN ] SPOT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:27.908998] [INFO ] [MAIN ] SPOT: Generated 1326 derivative records from 37341 primary records. [2025-09-15T21:21:27.909066] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-15T21:21:27.921544] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1326 records). [2025-09-15T21:21:27.921711] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-15T21:21:27.923965] [INFO ] [MAIN ] Derivative Progress: 1740/2083 symbols completed. SPOT took 0.7s. Estimated remaining: 1m 54s. Rate: 181.2 symbols/min [2025-09-15T21:21:27.924585] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:27.924803] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:27.924841] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:27.936629] [DEBUG] [LOCAL ] SPRU: Loaded 6780 existing records from primary storage. [2025-09-15T21:21:27.936817] [INFO ] [MAIN ] SPRU: Loaded 6780 primary data records. [2025-09-15T21:21:28.069611] [DEBUG] [LOCAL ] SPXC: Loaded 16773 existing records from primary storage. [2025-09-15T21:21:28.090593] [INFO ] [MAIN ] SPXC: Loaded 16773 primary data records. [2025-09-15T21:21:28.192909] [DEBUG] [LOCAL ] SPR: Loaded 29600 existing records from primary storage. [2025-09-15T21:21:28.233738] [INFO ] [MAIN ] SPR: Loaded 29600 primary data records. [2025-09-15T21:21:28.828726] [DEBUG] [MAIN ] SPRU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:28.830072] [INFO ] [MAIN ] SPRU: Generated 1326 derivative records from 6780 primary records. [2025-09-15T21:21:28.830162] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-15T21:21:28.843077] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1326 records). [2025-09-15T21:21:28.843241] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-15T21:21:28.847074] [INFO ] [MAIN ] Derivative Progress: 1741/2083 symbols completed. SPRU took 0.9s. Estimated remaining: 1m 53s. Rate: 181.0 symbols/min [2025-09-15T21:21:28.847907] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:28.858231] [DEBUG] [MAIN ] SPXC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:28.859196] [INFO ] [MAIN ] SPXC: Generated 1326 derivative records from 16773 primary records. [2025-09-15T21:21:28.859462] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-15T21:21:28.873653] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1326 records). [2025-09-15T21:21:28.878753] [DEBUG] [LOCAL ] SPXX: Loaded 5844 existing records from primary storage. [2025-09-15T21:21:28.878548] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-15T21:21:28.879632] [INFO ] [MAIN ] SPXX: Loaded 5844 primary data records. [2025-09-15T21:21:28.892398] [INFO ] [MAIN ] Derivative Progress: 1742/2083 symbols completed. SPXC took 1.0s. Estimated remaining: 1m 53s. Rate: 181.1 symbols/min [2025-09-15T21:21:28.911850] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:28.960948] [DEBUG] [MAIN ] SPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:28.993689] [INFO ] [MAIN ] SPR: Generated 1326 derivative records from 29600 primary records. [2025-09-15T21:21:28.993789] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-15T21:21:29.065478] [DEBUG] [LOCAL ] SPR: Derivative data saved (1326 records). [2025-09-15T21:21:29.074070] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-15T21:21:29.094969] [INFO ] [MAIN ] Derivative Progress: 1743/2083 symbols completed. SPR took 1.2s. Estimated remaining: 1m 53s. Rate: 181.1 symbols/min [2025-09-15T21:21:29.097811] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:29.193041] [DEBUG] [LOCAL ] SQM: Loaded 35810 existing records from primary storage. [2025-09-15T21:21:29.193341] [INFO ] [MAIN ] SQM: Loaded 35810 primary data records. [2025-09-15T21:21:29.360506] [DEBUG] [LOCAL ] SQNS: Loaded 22962 existing records from primary storage. [2025-09-15T21:21:29.389823] [INFO ] [MAIN ] SQNS: Loaded 22962 primary data records. [2025-09-15T21:21:29.667982] [DEBUG] [MAIN ] SPXX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:29.751987] [INFO ] [MAIN ] SPXX: Generated 1326 derivative records from 5844 primary records. [2025-09-15T21:21:29.761799] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-15T21:21:29.787272] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1326 records). [2025-09-15T21:21:29.789088] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-15T21:21:29.795896] [INFO ] [MAIN ] Derivative Progress: 1744/2083 symbols completed. SPXX took 0.9s. Estimated remaining: 1m 52s. Rate: 181.0 symbols/min [2025-09-15T21:21:29.797845] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:29.824571] [DEBUG] [MAIN ] SQM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:29.826352] [INFO ] [MAIN ] SQM: Generated 1326 derivative records from 35810 primary records. [2025-09-15T21:21:29.827047] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-15T21:21:29.850128] [DEBUG] [LOCAL ] SQM: Derivative data saved (1326 records). [2025-09-15T21:21:29.850677] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-15T21:21:29.854616] [INFO ] [MAIN ] Derivative Progress: 1745/2083 symbols completed. SQM took 0.9s. Estimated remaining: 1m 52s. Rate: 181.1 symbols/min [2025-09-15T21:21:29.856748] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:29.891442] [DEBUG] [MAIN ] SQNS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:29.893261] [INFO ] [MAIN ] SQNS: Generated 1326 derivative records from 22962 primary records. [2025-09-15T21:21:29.893378] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-15T21:21:29.912755] [DEBUG] [LOCAL ] SREA: Loaded 7438 existing records from primary storage. [2025-09-15T21:21:29.921395] [INFO ] [MAIN ] SREA: Loaded 7438 primary data records. [2025-09-15T21:21:29.922405] [DEBUG] [LOCAL ] SR: Loaded 24043 existing records from primary storage. [2025-09-15T21:21:29.934827] [INFO ] [MAIN ] SR: Loaded 24043 primary data records. [2025-09-15T21:21:29.990685] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1326 records). [2025-09-15T21:21:30.027604] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-15T21:21:30.089631] [INFO ] [MAIN ] Derivative Progress: 1746/2083 symbols completed. SQNS took 1.0s. Estimated remaining: 1m 52s. Rate: 181.1 symbols/min [2025-09-15T21:21:30.146138] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:30.499838] [DEBUG] [LOCAL ] SRFM: Loaded 28844 existing records from primary storage. [2025-09-15T21:21:30.501223] [INFO ] [MAIN ] SRFM: Loaded 28844 primary data records. [2025-09-15T21:21:30.647759] [DEBUG] [MAIN ] SREA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:30.700310] [INFO ] [MAIN ] SREA: Generated 1326 derivative records from 7438 primary records. [2025-09-15T21:21:30.703155] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-15T21:21:30.806624] [DEBUG] [LOCAL ] SREA: Derivative data saved (1326 records). [2025-09-15T21:21:30.807895] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-15T21:21:30.809847] [INFO ] [MAIN ] Derivative Progress: 1747/2083 symbols completed. SREA took 1.0s. Estimated remaining: 1m 51s. Rate: 181.0 symbols/min [2025-09-15T21:21:30.811911] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:30.825340] [DEBUG] [MAIN ] SR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:30.826346] [INFO ] [MAIN ] SR: Generated 1326 derivative records from 24043 primary records. [2025-09-15T21:21:30.829596] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-15T21:21:30.845223] [DEBUG] [LOCAL ] SRG: Loaded 10559 existing records from primary storage. [2025-09-15T21:21:30.848281] [INFO ] [MAIN ] SRG: Loaded 10559 primary data records. [2025-09-15T21:21:30.958095] [DEBUG] [LOCAL ] SR: Derivative data saved (1326 records). [2025-09-15T21:21:30.958819] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-15T21:21:30.975126] [INFO ] [MAIN ] Derivative Progress: 1748/2083 symbols completed. SR took 1.2s. Estimated remaining: 1m 51s. Rate: 181.1 symbols/min [2025-09-15T21:21:31.015835] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:31.051259] [DEBUG] [MAIN ] SRFM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:31.159267] [INFO ] [MAIN ] SRFM: Generated 1326 derivative records from 28844 primary records. [2025-09-15T21:21:31.170626] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-15T21:21:31.185659] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1326 records). [2025-09-15T21:21:31.185872] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-15T21:21:31.187824] [INFO ] [MAIN ] Derivative Progress: 1749/2083 symbols completed. SRFM took 1.0s. Estimated remaining: 1m 51s. Rate: 181.1 symbols/min [2025-09-15T21:21:31.195403] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:31.211059] [DEBUG] [LOCAL ] SRI: Loaded 20394 existing records from primary storage. [2025-09-15T21:21:31.214466] [DEBUG] [LOCAL ] SRV: Loaded 5319 existing records from primary storage. [2025-09-15T21:21:31.214863] [INFO ] [MAIN ] SRI: Loaded 20394 primary data records. [2025-09-15T21:21:31.214935] [INFO ] [MAIN ] SRV: Loaded 5319 primary data records. [2025-09-15T21:21:31.413835] [DEBUG] [MAIN ] SRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:31.437381] [INFO ] [MAIN ] SRG: Generated 1326 derivative records from 10559 primary records. [2025-09-15T21:21:31.463450] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-15T21:21:31.767576] [DEBUG] [LOCAL ] SRG: Derivative data saved (1326 records). [2025-09-15T21:21:31.768151] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-15T21:21:31.770180] [INFO ] [MAIN ] Derivative Progress: 1750/2083 symbols completed. SRG took 1.0s. Estimated remaining: 1m 50s. Rate: 181.0 symbols/min [2025-09-15T21:21:31.771733] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:31.794266] [DEBUG] [MAIN ] SRV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:31.811856] [INFO ] [MAIN ] SRV: Generated 1326 derivative records from 5319 primary records. [2025-09-15T21:21:31.812373] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-15T21:21:31.813376] [DEBUG] [MAIN ] SRI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:31.820577] [INFO ] [MAIN ] SRI: Generated 1326 derivative records from 20394 primary records. [2025-09-15T21:21:31.825491] [DEBUG] [LOCAL ] SRV: Derivative data saved (1326 records). [2025-09-15T21:21:31.826106] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-15T21:21:31.826016] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-15T21:21:31.828033] [INFO ] [MAIN ] Derivative Progress: 1751/2083 symbols completed. SRV took 0.6s. Estimated remaining: 1m 50s. Rate: 181.1 symbols/min [2025-09-15T21:21:31.838362] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:31.847485] [DEBUG] [LOCAL ] SSB: Loaded 31811 existing records from primary storage. [2025-09-15T21:21:31.847913] [INFO ] [MAIN ] SSB: Loaded 31811 primary data records. [2025-09-15T21:21:31.881347] [DEBUG] [LOCAL ] SRI: Derivative data saved (1326 records). [2025-09-15T21:21:31.905189] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-15T21:21:31.927472] [INFO ] [MAIN ] Derivative Progress: 1752/2083 symbols completed. SRI took 0.9s. Estimated remaining: 1m 50s. Rate: 181.2 symbols/min [2025-09-15T21:21:31.958201] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:32.036172] [DEBUG] [LOCAL ] SSD: Loaded 16554 existing records from primary storage. [2025-09-15T21:21:32.037038] [INFO ] [MAIN ] SSD: Loaded 16554 primary data records. [2025-09-15T21:21:32.413388] [DEBUG] [LOCAL ] SSL: Loaded 30179 existing records from primary storage. [2025-09-15T21:21:32.413735] [INFO ] [MAIN ] SSL: Loaded 30179 primary data records. [2025-09-15T21:21:32.608846] [DEBUG] [MAIN ] SSB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:32.609751] [INFO ] [MAIN ] SSB: Generated 1326 derivative records from 31811 primary records. [2025-09-15T21:21:32.695726] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-15T21:21:32.712442] [DEBUG] [LOCAL ] SSB: Derivative data saved (1326 records). [2025-09-15T21:21:32.713084] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-15T21:21:32.720958] [INFO ] [MAIN ] Derivative Progress: 1753/2083 symbols completed. SSB took 0.9s. Estimated remaining: 1m 49s. Rate: 181.0 symbols/min [2025-09-15T21:21:32.725953] [DEBUG] [MAIN ] SSD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:32.726564] [INFO ] [MAIN ] SSD: Generated 1326 derivative records from 16554 primary records. [2025-09-15T21:21:32.726629] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-15T21:21:32.740123] [DEBUG] [LOCAL ] SSD: Derivative data saved (1326 records). [2025-09-15T21:21:32.740208] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-15T21:21:32.742018] [INFO ] [MAIN ] Derivative Progress: 1754/2083 symbols completed. SSD took 0.9s. Estimated remaining: 1m 49s. Rate: 181.1 symbols/min [2025-09-15T21:21:32.754061] [DEBUG] [MAIN ] SSL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:32.754616] [INFO ] [MAIN ] SSL: Generated 1326 derivative records from 30179 primary records. [2025-09-15T21:21:32.754695] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-15T21:21:32.765950] [DEBUG] [LOCAL ] SSL: Derivative data saved (1326 records). [2025-09-15T21:21:32.766005] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-15T21:21:32.768028] [INFO ] [MAIN ] Derivative Progress: 1755/2083 symbols completed. SSL took 0.8s. Estimated remaining: 1m 49s. Rate: 181.2 symbols/min [2025-09-15T21:21:32.768684] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:32.768616] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:32.768531] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:32.788490] [DEBUG] [LOCAL ] SST: Loaded 9679 existing records from primary storage. [2025-09-15T21:21:32.788754] [INFO ] [MAIN ] SST: Loaded 9679 primary data records. [2025-09-15T21:21:32.907831] [DEBUG] [LOCAL ] SSTK: Loaded 17985 existing records from primary storage. [2025-09-15T21:21:32.918080] [INFO ] [MAIN ] SSTK: Loaded 17985 primary data records. [2025-09-15T21:21:32.939160] [DEBUG] [LOCAL ] ST: Loaded 36544 existing records from primary storage. [2025-09-15T21:21:32.962235] [INFO ] [MAIN ] ST: Loaded 36544 primary data records. [2025-09-15T21:21:33.669551] [DEBUG] [MAIN ] SST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:33.670924] [INFO ] [MAIN ] SST: Generated 1326 derivative records from 9679 primary records. [2025-09-15T21:21:33.671034] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-15T21:21:33.689061] [DEBUG] [MAIN ] SSTK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:33.692437] [INFO ] [MAIN ] SSTK: Generated 1326 derivative records from 17985 primary records. [2025-09-15T21:21:33.692589] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-15T21:21:33.693106] [DEBUG] [LOCAL ] SST: Derivative data saved (1326 records). [2025-09-15T21:21:33.693897] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-15T21:21:33.702148] [INFO ] [MAIN ] Derivative Progress: 1756/2083 symbols completed. SST took 0.9s. Estimated remaining: 1m 48s. Rate: 181.0 symbols/min [2025-09-15T21:21:33.706875] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:33.708417] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1326 records). [2025-09-15T21:21:33.718067] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-15T21:21:33.718500] [DEBUG] [MAIN ] ST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:33.720868] [INFO ] [MAIN ] Derivative Progress: 1757/2083 symbols completed. SSTK took 1.0s. Estimated remaining: 1m 48s. Rate: 181.1 symbols/min [2025-09-15T21:21:33.721831] [INFO ] [MAIN ] ST: Generated 1326 derivative records from 36544 primary records. [2025-09-15T21:21:33.722104] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:33.722240] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-15T21:21:33.739232] [DEBUG] [LOCAL ] ST: Derivative data saved (1326 records). [2025-09-15T21:21:33.739393] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-15T21:21:33.741885] [INFO ] [MAIN ] Derivative Progress: 1758/2083 symbols completed. ST took 1.0s. Estimated remaining: 1m 48s. Rate: 181.2 symbols/min [2025-09-15T21:21:33.742274] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:33.752624] [DEBUG] [LOCAL ] STC: Loaded 13155 existing records from primary storage. [2025-09-15T21:21:33.752797] [INFO ] [MAIN ] STC: Loaded 13155 primary data records. [2025-09-15T21:21:33.960378] [DEBUG] [LOCAL ] STAG: Loaded 36645 existing records from primary storage. [2025-09-15T21:21:33.968103] [INFO ] [MAIN ] STAG: Loaded 36645 primary data records. [2025-09-15T21:21:34.049371] [DEBUG] [LOCAL ] STE: Loaded 26012 existing records from primary storage. [2025-09-15T21:21:34.061026] [INFO ] [MAIN ] STE: Loaded 26012 primary data records. [2025-09-15T21:21:34.596208] [DEBUG] [MAIN ] STC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:34.597535] [INFO ] [MAIN ] STC: Generated 1326 derivative records from 13155 primary records. [2025-09-15T21:21:34.597894] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-15T21:21:34.611748] [DEBUG] [LOCAL ] STC: Derivative data saved (1326 records). [2025-09-15T21:21:34.613144] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-15T21:21:34.615369] [INFO ] [MAIN ] Derivative Progress: 1759/2083 symbols completed. STC took 0.9s. Estimated remaining: 1m 47s. Rate: 181.1 symbols/min [2025-09-15T21:21:34.615812] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:34.638036] [DEBUG] [MAIN ] STAG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:34.638535] [DEBUG] [MAIN ] STE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:34.639136] [INFO ] [MAIN ] STAG: Generated 1326 derivative records from 36645 primary records. [2025-09-15T21:21:34.639236] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-15T21:21:34.640252] [INFO ] [MAIN ] STE: Generated 1326 derivative records from 26012 primary records. [2025-09-15T21:21:34.640425] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-15T21:21:34.665926] [DEBUG] [LOCAL ] STAG: Derivative data saved (1326 records). [2025-09-15T21:21:34.666753] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-15T21:21:34.674775] [INFO ] [MAIN ] Derivative Progress: 1760/2083 symbols completed. STAG took 1.0s. Estimated remaining: 1m 47s. Rate: 181.2 symbols/min [2025-09-15T21:21:34.675514] [DEBUG] [LOCAL ] STEL: Loaded 16582 existing records from primary storage. [2025-09-15T21:21:34.676245] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:34.677152] [INFO ] [MAIN ] STEL: Loaded 16582 primary data records. [2025-09-15T21:21:34.708846] [DEBUG] [LOCAL ] STE: Derivative data saved (1326 records). [2025-09-15T21:21:34.721131] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-15T21:21:34.743935] [INFO ] [MAIN ] Derivative Progress: 1761/2083 symbols completed. STE took 1.0s. Estimated remaining: 1m 47s. Rate: 181.2 symbols/min [2025-09-15T21:21:34.772097] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:34.970708] [DEBUG] [LOCAL ] STEM: Loaded 28138 existing records from primary storage. [2025-09-15T21:21:34.970799] [DEBUG] [LOCAL ] STEW: Loaded 11162 existing records from primary storage. [2025-09-15T21:21:34.971190] [INFO ] [MAIN ] STEM: Loaded 28138 primary data records. [2025-09-15T21:21:34.971133] [INFO ] [MAIN ] STEW: Loaded 11162 primary data records. [2025-09-15T21:21:35.595294] [DEBUG] [MAIN ] STEL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:35.596687] [INFO ] [MAIN ] STEL: Generated 1326 derivative records from 16582 primary records. [2025-09-15T21:21:35.597995] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-15T21:21:35.614864] [DEBUG] [LOCAL ] STEL: Derivative data saved (1326 records). [2025-09-15T21:21:35.615254] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-15T21:21:35.617242] [INFO ] [MAIN ] Derivative Progress: 1762/2083 symbols completed. STEL took 1.0s. Estimated remaining: 1m 46s. Rate: 181.1 symbols/min [2025-09-15T21:21:35.618404] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:35.634542] [DEBUG] [MAIN ] STEW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:35.635716] [INFO ] [MAIN ] STEW: Generated 1326 derivative records from 11162 primary records. [2025-09-15T21:21:35.637996] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-15T21:21:35.649049] [DEBUG] [LOCAL ] STK: Loaded 6438 existing records from primary storage. [2025-09-15T21:21:35.649297] [INFO ] [MAIN ] STK: Loaded 6438 primary data records. [2025-09-15T21:21:35.741891] [DEBUG] [LOCAL ] STEW: Derivative data saved (1326 records). [2025-09-15T21:21:35.759017] [DEBUG] [MAIN ] STEM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:35.770230] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-15T21:21:35.779409] [INFO ] [MAIN ] Derivative Progress: 1763/2083 symbols completed. STEW took 1.0s. Estimated remaining: 1m 46s. Rate: 181.1 symbols/min [2025-09-15T21:21:35.771800] [INFO ] [MAIN ] STEM: Generated 1326 derivative records from 28138 primary records. [2025-09-15T21:21:35.823111] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:35.927226] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-15T21:21:35.950427] [DEBUG] [LOCAL ] STEM: Derivative data saved (1326 records). [2025-09-15T21:21:35.950735] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-15T21:21:35.952885] [INFO ] [MAIN ] Derivative Progress: 1764/2083 symbols completed. STEM took 1.3s. Estimated remaining: 1m 46s. Rate: 181.2 symbols/min [2025-09-15T21:21:35.954446] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:35.980193] [DEBUG] [MAIN ] STK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:35.981054] [INFO ] [MAIN ] STK: Generated 1326 derivative records from 6438 primary records. [2025-09-15T21:21:35.981240] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-15T21:21:36.004062] [DEBUG] [LOCAL ] STK: Derivative data saved (1326 records). [2025-09-15T21:21:36.005253] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-15T21:21:36.007117] [INFO ] [MAIN ] Derivative Progress: 1765/2083 symbols completed. STK took 0.4s. Estimated remaining: 1m 45s. Rate: 181.3 symbols/min [2025-09-15T21:21:36.007476] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:36.008342] [DEBUG] [LOCAL ] STLA: Loaded 39536 existing records from primary storage. [2025-09-15T21:21:36.008775] [INFO ] [MAIN ] STLA: Loaded 39536 primary data records. [2025-09-15T21:21:36.195968] [DEBUG] [LOCAL ] STM: Loaded 39560 existing records from primary storage. [2025-09-15T21:21:36.217522] [DEBUG] [LOCAL ] STN: Loaded 16896 existing records from primary storage. [2025-09-15T21:21:36.222869] [INFO ] [MAIN ] STM: Loaded 39560 primary data records. [2025-09-15T21:21:36.222948] [INFO ] [MAIN ] STN: Loaded 16896 primary data records. [2025-09-15T21:21:36.893153] [DEBUG] [MAIN ] STLA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:36.894707] [INFO ] [MAIN ] STLA: Generated 1326 derivative records from 39536 primary records. [2025-09-15T21:21:36.895157] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-15T21:21:36.909584] [DEBUG] [LOCAL ] STLA: Derivative data saved (1326 records). [2025-09-15T21:21:36.909727] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-15T21:21:36.912443] [INFO ] [MAIN ] Derivative Progress: 1766/2083 symbols completed. STLA took 1.1s. Estimated remaining: 1m 45s. Rate: 181.1 symbols/min [2025-09-15T21:21:36.913065] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:36.928882] [DEBUG] [MAIN ] STM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:36.929898] [INFO ] [MAIN ] STM: Generated 1326 derivative records from 39560 primary records. [2025-09-15T21:21:36.930227] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-15T21:21:36.954172] [DEBUG] [MAIN ] STN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:36.955583] [INFO ] [MAIN ] STN: Generated 1326 derivative records from 16896 primary records. [2025-09-15T21:21:36.956038] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-15T21:21:36.967439] [DEBUG] [LOCAL ] STM: Derivative data saved (1326 records). [2025-09-15T21:21:36.976066] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-15T21:21:36.978307] [INFO ] [MAIN ] Derivative Progress: 1767/2083 symbols completed. STM took 1.0s. Estimated remaining: 1m 45s. Rate: 181.2 symbols/min [2025-09-15T21:21:36.980051] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:36.980770] [DEBUG] [LOCAL ] STN: Derivative data saved (1326 records). [2025-09-15T21:21:36.981241] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-15T21:21:36.983611] [INFO ] [MAIN ] Derivative Progress: 1768/2083 symbols completed. STN took 1.0s. Estimated remaining: 1m 44s. Rate: 181.3 symbols/min [2025-09-15T21:21:36.998311] [DEBUG] [LOCAL ] STNG: Loaded 32291 existing records from primary storage. [2025-09-15T21:21:36.998499] [INFO ] [MAIN ] STNG: Loaded 32291 primary data records. [2025-09-15T21:21:37.079046] [DEBUG] [LOCAL ] STRV: Loaded 7590 existing records from primary storage. [2025-09-15T21:21:37.105262] [INFO ] [MAIN ] STRV: Loaded 7590 primary data records. [2025-09-15T21:21:37.571490] [DEBUG] [MAIN ] STNG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:37.572291] [INFO ] [MAIN ] STNG: Generated 1326 derivative records from 32291 primary records. [2025-09-15T21:21:37.572559] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-15T21:21:37.585465] [DEBUG] [LOCAL ] STNG: Derivative data saved (1326 records). [2025-09-15T21:21:37.586669] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-15T21:21:37.588422] [INFO ] [MAIN ] Derivative Progress: 1769/2083 symbols completed. STNG took 0.7s. Estimated remaining: 1m 44s. Rate: 181.2 symbols/min [2025-09-15T21:21:37.598801] [DEBUG] [MAIN ] STRV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:37.599447] [INFO ] [MAIN ] STRV: Generated 1326 derivative records from 7590 primary records. [2025-09-15T21:21:37.599554] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-15T21:21:37.611535] [DEBUG] [LOCAL ] STRV: Derivative data saved (1326 records). [2025-09-15T21:21:37.611599] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-15T21:21:37.613401] [INFO ] [MAIN ] Derivative Progress: 1770/2083 symbols completed. STRV took 0.6s. Estimated remaining: 1m 44s. Rate: 181.3 symbols/min [2025-09-15T21:21:37.614215] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:37.613871] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:37.614122] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:37.618208] [DEBUG] [LOCAL ] STXD: Loaded 803 existing records from primary storage. [2025-09-15T21:21:37.618441] [INFO ] [MAIN ] STXD: Loaded 803 primary data records. [2025-09-15T21:21:37.748476] [DEBUG] [LOCAL ] STVN: Loaded 19277 existing records from primary storage. [2025-09-15T21:21:37.781664] [INFO ] [MAIN ] STVN: Loaded 19277 primary data records. [2025-09-15T21:21:38.109203] [DEBUG] [LOCAL ] STWD: Loaded 38133 existing records from primary storage. [2025-09-15T21:21:38.114509] [INFO ] [MAIN ] STWD: Loaded 38133 primary data records. [2025-09-15T21:21:38.476771] [DEBUG] [MAIN ] STXD: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:38.477949] [INFO ] [MAIN ] STXD: Generated 1325 derivative records from 803 primary records. [2025-09-15T21:21:38.478753] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-15T21:21:38.501773] [DEBUG] [MAIN ] STVN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:38.503356] [DEBUG] [LOCAL ] STXD: Derivative data saved (1325 records). [2025-09-15T21:21:38.503444] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-15T21:21:38.502896] [INFO ] [MAIN ] STVN: Generated 1326 derivative records from 19277 primary records. [2025-09-15T21:21:38.503547] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-15T21:21:38.505329] [INFO ] [MAIN ] Derivative Progress: 1771/2083 symbols completed. STXD took 0.9s. Estimated remaining: 1m 43s. Rate: 181.1 symbols/min [2025-09-15T21:21:38.506635] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:38.522251] [DEBUG] [LOCAL ] STXE: Loaded 1410 existing records from primary storage. [2025-09-15T21:21:38.523738] [INFO ] [MAIN ] STXE: Loaded 1410 primary data records. [2025-09-15T21:21:38.523603] [DEBUG] [LOCAL ] STVN: Derivative data saved (1326 records). [2025-09-15T21:21:38.535941] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-15T21:21:38.581473] [INFO ] [MAIN ] Derivative Progress: 1772/2083 symbols completed. STVN took 1.0s. Estimated remaining: 1m 43s. Rate: 181.2 symbols/min [2025-09-15T21:21:38.639352] [DEBUG] [MAIN ] STWD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:38.642555] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:38.644243] [INFO ] [MAIN ] STWD: Generated 1326 derivative records from 38133 primary records. [2025-09-15T21:21:38.684923] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-15T21:21:38.718207] [DEBUG] [LOCAL ] STXG: Loaded 1476 existing records from primary storage. [2025-09-15T21:21:38.806494] [INFO ] [MAIN ] STXG: Loaded 1476 primary data records. [2025-09-15T21:21:38.902584] [DEBUG] [LOCAL ] STWD: Derivative data saved (1326 records). [2025-09-15T21:21:38.925857] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-15T21:21:38.928679] [INFO ] [MAIN ] Derivative Progress: 1773/2083 symbols completed. STWD took 1.3s. Estimated remaining: 1m 43s. Rate: 181.2 symbols/min [2025-09-15T21:21:38.939816] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:39.082848] [DEBUG] [LOCAL ] STXK: Loaded 952 existing records from primary storage. [2025-09-15T21:21:39.093981] [INFO ] [MAIN ] STXK: Loaded 952 primary data records. [2025-09-15T21:21:39.282538] [DEBUG] [MAIN ] STXE: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:39.286451] [INFO ] [MAIN ] STXE: Generated 1325 derivative records from 1410 primary records. [2025-09-15T21:21:39.369276] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-15T21:21:39.381829] [DEBUG] [LOCAL ] STXE: Derivative data saved (1325 records). [2025-09-15T21:21:39.382099] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-15T21:21:39.383947] [INFO ] [MAIN ] Derivative Progress: 1774/2083 symbols completed. STXE took 0.9s. Estimated remaining: 1m 42s. Rate: 181.1 symbols/min [2025-09-15T21:21:39.384475] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:39.390382] [DEBUG] [LOCAL ] STXV: Loaded 1088 existing records from primary storage. [2025-09-15T21:21:39.400415] [INFO ] [MAIN ] STXV: Loaded 1088 primary data records. [2025-09-15T21:21:39.400721] [DEBUG] [MAIN ] STXG: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:39.401810] [INFO ] [MAIN ] STXG: Generated 1325 derivative records from 1476 primary records. [2025-09-15T21:21:39.422589] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-15T21:21:39.540606] [DEBUG] [LOCAL ] STXG: Derivative data saved (1325 records). [2025-09-15T21:21:39.562458] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-15T21:21:39.589835] [INFO ] [MAIN ] Derivative Progress: 1775/2083 symbols completed. STXG took 0.9s. Estimated remaining: 1m 42s. Rate: 181.2 symbols/min [2025-09-15T21:21:39.677034] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:39.687897] [DEBUG] [MAIN ] STXK: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:39.688790] [INFO ] [MAIN ] STXK: Generated 1325 derivative records from 952 primary records. [2025-09-15T21:21:39.688984] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-15T21:21:39.701297] [DEBUG] [LOCAL ] STXK: Derivative data saved (1325 records). [2025-09-15T21:21:39.701556] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-15T21:21:39.703689] [INFO ] [MAIN ] Derivative Progress: 1776/2083 symbols completed. STXK took 0.8s. Estimated remaining: 1m 42s. Rate: 181.2 symbols/min [2025-09-15T21:21:39.704047] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:39.721932] [DEBUG] [MAIN ] STXV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:39.722769] [INFO ] [MAIN ] STXV: Generated 1326 derivative records from 1088 primary records. [2025-09-15T21:21:39.731691] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-15T21:21:39.745265] [DEBUG] [LOCAL ] STXV: Derivative data saved (1326 records). [2025-09-15T21:21:39.745448] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-15T21:21:39.747258] [INFO ] [MAIN ] Derivative Progress: 1777/2083 symbols completed. STXV took 0.4s. Estimated remaining: 1m 41s. Rate: 181.3 symbols/min [2025-09-15T21:21:39.747579] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:39.760415] [DEBUG] [LOCAL ] STZ: Loaded 38549 existing records from primary storage. [2025-09-15T21:21:39.760843] [INFO ] [MAIN ] STZ: Loaded 38549 primary data records. [2025-09-15T21:21:39.929155] [DEBUG] [LOCAL ] SU: Loaded 39449 existing records from primary storage. [2025-09-15T21:21:39.974566] [INFO ] [MAIN ] SU: Loaded 39449 primary data records. [2025-09-15T21:21:40.165536] [DEBUG] [LOCAL ] SUI: Loaded 31330 existing records from primary storage. [2025-09-15T21:21:40.199110] [INFO ] [MAIN ] SUI: Loaded 31330 primary data records. [2025-09-15T21:21:40.651384] [DEBUG] [MAIN ] STZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:40.654841] [INFO ] [MAIN ] STZ: Generated 1326 derivative records from 38549 primary records. [2025-09-15T21:21:40.655134] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-15T21:21:40.672545] [DEBUG] [MAIN ] SU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:40.677773] [DEBUG] [LOCAL ] STZ: Derivative data saved (1326 records). [2025-09-15T21:21:40.678483] [INFO ] [MAIN ] SU: Generated 1326 derivative records from 39449 primary records. [2025-09-15T21:21:40.678571] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-15T21:21:40.686477] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-15T21:21:40.690055] [INFO ] [MAIN ] Derivative Progress: 1778/2083 symbols completed. STZ took 1.0s. Estimated remaining: 1m 41s. Rate: 181.1 symbols/min [2025-09-15T21:21:40.692935] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:40.696342] [DEBUG] [LOCAL ] SU: Derivative data saved (1326 records). [2025-09-15T21:21:40.706537] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-15T21:21:40.706459] [DEBUG] [MAIN ] SUI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:40.708458] [INFO ] [MAIN ] Derivative Progress: 1779/2083 symbols completed. SU took 1.0s. Estimated remaining: 1m 41s. Rate: 181.2 symbols/min [2025-09-15T21:21:40.709723] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:40.709393] [INFO ] [MAIN ] SUI: Generated 1326 derivative records from 31330 primary records. [2025-09-15T21:21:40.709938] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-15T21:21:40.724569] [DEBUG] [LOCAL ] SUI: Derivative data saved (1326 records). [2025-09-15T21:21:40.724660] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-15T21:21:40.727782] [INFO ] [MAIN ] Derivative Progress: 1780/2083 symbols completed. SUI took 1.0s. Estimated remaining: 1m 40s. Rate: 181.3 symbols/min [2025-09-15T21:21:40.728182] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:40.749683] [DEBUG] [LOCAL ] SUN: Loaded 28207 existing records from primary storage. [2025-09-15T21:21:40.749826] [INFO ] [MAIN ] SUN: Loaded 28207 primary data records. [2025-09-15T21:21:40.909220] [DEBUG] [LOCAL ] SUPV: Loaded 34823 existing records from primary storage. [2025-09-15T21:21:40.932419] [INFO ] [MAIN ] SUPV: Loaded 34823 primary data records. [2025-09-15T21:21:41.128280] [DEBUG] [LOCAL ] SUZ: Loaded 33643 existing records from primary storage. [2025-09-15T21:21:41.157035] [INFO ] [MAIN ] SUZ: Loaded 33643 primary data records. [2025-09-15T21:21:41.601829] [DEBUG] [MAIN ] SUN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:41.603133] [INFO ] [MAIN ] SUN: Generated 1326 derivative records from 28207 primary records. [2025-09-15T21:21:41.603325] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-15T21:21:41.619924] [DEBUG] [LOCAL ] SUN: Derivative data saved (1326 records). [2025-09-15T21:21:41.629483] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-15T21:21:41.632437] [DEBUG] [MAIN ] SUPV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:41.632146] [INFO ] [MAIN ] Derivative Progress: 1781/2083 symbols completed. SUN took 0.9s. Estimated remaining: 1m 40s. Rate: 181.2 symbols/min [2025-09-15T21:21:41.633481] [INFO ] [MAIN ] SUPV: Generated 1326 derivative records from 34823 primary records. [2025-09-15T21:21:41.633700] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-15T21:21:41.633806] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:41.648850] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1326 records). [2025-09-15T21:21:41.649060] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-15T21:21:41.650893] [INFO ] [MAIN ] Derivative Progress: 1782/2083 symbols completed. SUPV took 0.9s. Estimated remaining: 1m 40s. Rate: 181.3 symbols/min [2025-09-15T21:21:41.651185] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:41.661305] [DEBUG] [MAIN ] SUZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:41.662029] [INFO ] [MAIN ] SUZ: Generated 1326 derivative records from 33643 primary records. [2025-09-15T21:21:41.662185] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-15T21:21:41.681860] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1326 records). [2025-09-15T21:21:41.682017] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-15T21:21:41.684157] [INFO ] [MAIN ] Derivative Progress: 1783/2083 symbols completed. SUZ took 1.0s. Estimated remaining: 1m 39s. Rate: 181.3 symbols/min [2025-09-15T21:21:41.694409] [DEBUG] [LOCAL ] SVV: Loaded 28338 existing records from primary storage. [2025-09-15T21:21:41.694915] [INFO ] [MAIN ] SVV: Loaded 28338 primary data records. [2025-09-15T21:21:41.968111] [DEBUG] [LOCAL ] SW: Loaded 39178 existing records from primary storage. [2025-09-15T21:21:41.979095] [INFO ] [MAIN ] SW: Loaded 39178 primary data records. [2025-09-15T21:21:42.286624] [DEBUG] [MAIN ] SVV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:42.287461] [INFO ] [MAIN ] SVV: Generated 1326 derivative records from 28338 primary records. [2025-09-15T21:21:42.287952] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-15T21:21:42.300751] [DEBUG] [LOCAL ] SVV: Derivative data saved (1326 records). [2025-09-15T21:21:42.300944] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-15T21:21:42.302607] [INFO ] [MAIN ] Derivative Progress: 1784/2083 symbols completed. SVV took 0.7s. Estimated remaining: 1m 39s. Rate: 181.3 symbols/min [2025-09-15T21:21:42.316057] [DEBUG] [MAIN ] SW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:42.316674] [INFO ] [MAIN ] SW: Generated 1326 derivative records from 39178 primary records. [2025-09-15T21:21:42.316735] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-15T21:21:42.328245] [DEBUG] [LOCAL ] SW: Derivative data saved (1326 records). [2025-09-15T21:21:42.328302] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-15T21:21:42.330363] [INFO ] [MAIN ] Derivative Progress: 1785/2083 symbols completed. SW took 0.7s. Estimated remaining: 1m 39s. Rate: 181.3 symbols/min [2025-09-15T21:21:42.330801] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:42.330905] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:42.331628] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:42.370799] [DEBUG] [LOCAL ] SWX: Loaded 23089 existing records from primary storage. [2025-09-15T21:21:42.370974] [INFO ] [MAIN ] SWX: Loaded 23089 primary data records. [2025-09-15T21:21:42.494123] [DEBUG] [LOCAL ] SXC: Loaded 30331 existing records from primary storage. [2025-09-15T21:21:42.494303] [INFO ] [MAIN ] SXC: Loaded 30331 primary data records. [2025-09-15T21:21:42.495105] [DEBUG] [LOCAL ] SWK: Loaded 38859 existing records from primary storage. [2025-09-15T21:21:42.551266] [INFO ] [MAIN ] SWK: Loaded 38859 primary data records. [2025-09-15T21:21:43.210150] [DEBUG] [MAIN ] SWX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:43.214316] [DEBUG] [MAIN ] SXC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:43.215115] [INFO ] [MAIN ] SWX: Generated 1326 derivative records from 23089 primary records. [2025-09-15T21:21:43.215760] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-15T21:21:43.215628] [INFO ] [MAIN ] SXC: Generated 1326 derivative records from 30331 primary records. [2025-09-15T21:21:43.216279] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-15T21:21:43.245019] [DEBUG] [LOCAL ] SXC: Derivative data saved (1326 records). [2025-09-15T21:21:43.249594] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-15T21:21:43.252032] [INFO ] [MAIN ] Derivative Progress: 1786/2083 symbols completed. SXC took 0.9s. Estimated remaining: 1m 38s. Rate: 181.2 symbols/min [2025-09-15T21:21:43.250058] [DEBUG] [MAIN ] SWK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:43.252452] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:43.253681] [INFO ] [MAIN ] SWK: Generated 1326 derivative records from 38859 primary records. [2025-09-15T21:21:43.254348] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-15T21:21:43.256164] [DEBUG] [LOCAL ] SWX: Derivative data saved (1326 records). [2025-09-15T21:21:43.265465] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-15T21:21:43.266923] [INFO ] [MAIN ] Derivative Progress: 1787/2083 symbols completed. SWX took 0.9s. Estimated remaining: 1m 38s. Rate: 181.3 symbols/min [2025-09-15T21:21:43.269292] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:43.275755] [DEBUG] [LOCAL ] SXI: Loaded 8634 existing records from primary storage. [2025-09-15T21:21:43.276915] [INFO ] [MAIN ] SXI: Loaded 8634 primary data records. [2025-09-15T21:21:43.309529] [DEBUG] [LOCAL ] SWK: Derivative data saved (1326 records). [2025-09-15T21:21:43.353856] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-15T21:21:43.356638] [INFO ] [MAIN ] Derivative Progress: 1788/2083 symbols completed. SWK took 1.0s. Estimated remaining: 1m 38s. Rate: 181.3 symbols/min [2025-09-15T21:21:43.368823] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:43.409904] [DEBUG] [LOCAL ] SXT: Loaded 21746 existing records from primary storage. [2025-09-15T21:21:43.420298] [INFO ] [MAIN ] SXT: Loaded 21746 primary data records. [2025-09-15T21:21:43.854076] [DEBUG] [LOCAL ] SYF: Loaded 39444 existing records from primary storage. [2025-09-15T21:21:43.855901] [INFO ] [MAIN ] SYF: Loaded 39444 primary data records. [2025-09-15T21:21:44.012357] [DEBUG] [MAIN ] SXI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:44.046817] [INFO ] [MAIN ] SXI: Generated 1326 derivative records from 8634 primary records. [2025-09-15T21:21:44.133485] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-15T21:21:44.147178] [DEBUG] [LOCAL ] SXI: Derivative data saved (1326 records). [2025-09-15T21:21:44.147628] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-15T21:21:44.149597] [INFO ] [MAIN ] Derivative Progress: 1789/2083 symbols completed. SXI took 0.9s. Estimated remaining: 1m 37s. Rate: 181.2 symbols/min [2025-09-15T21:21:44.150496] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:44.166085] [DEBUG] [MAIN ] SXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:44.166892] [INFO ] [MAIN ] SXT: Generated 1326 derivative records from 21746 primary records. [2025-09-15T21:21:44.167129] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-15T21:21:44.181156] [DEBUG] [LOCAL ] SXT: Derivative data saved (1326 records). [2025-09-15T21:21:44.181825] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-15T21:21:44.184068] [INFO ] [MAIN ] Derivative Progress: 1790/2083 symbols completed. SXT took 0.9s. Estimated remaining: 1m 37s. Rate: 181.3 symbols/min [2025-09-15T21:21:44.184692] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:44.194872] [DEBUG] [MAIN ] SYF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:44.195696] [INFO ] [MAIN ] SYF: Generated 1326 derivative records from 39444 primary records. [2025-09-15T21:21:44.196040] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-15T21:21:44.216738] [DEBUG] [LOCAL ] SYF: Derivative data saved (1326 records). [2025-09-15T21:21:44.216821] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-15T21:21:44.218999] [INFO ] [MAIN ] Derivative Progress: 1791/2083 symbols completed. SYF took 0.9s. Estimated remaining: 1m 37s. Rate: 181.4 symbols/min [2025-09-15T21:21:44.219246] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:44.235101] [DEBUG] [LOCAL ] TAK: Loaded 37207 existing records from primary storage. [2025-09-15T21:21:44.235425] [INFO ] [MAIN ] TAK: Loaded 37207 primary data records. [2025-09-15T21:21:44.409084] [DEBUG] [LOCAL ] TAL: Loaded 38239 existing records from primary storage. [2025-09-15T21:21:44.463670] [INFO ] [MAIN ] TAL: Loaded 38239 primary data records. [2025-09-15T21:21:44.570761] [DEBUG] [LOCAL ] TALO: Loaded 37607 existing records from primary storage. [2025-09-15T21:21:44.665087] [INFO ] [MAIN ] TALO: Loaded 37607 primary data records. [2025-09-15T21:21:45.147194] [DEBUG] [MAIN ] TAK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:45.148676] [INFO ] [MAIN ] TAK: Generated 1326 derivative records from 37207 primary records. [2025-09-15T21:21:45.150876] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-15T21:21:45.170233] [DEBUG] [MAIN ] TAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:45.173452] [DEBUG] [LOCAL ] TAK: Derivative data saved (1326 records). [2025-09-15T21:21:45.174175] [INFO ] [MAIN ] TAL: Generated 1326 derivative records from 38239 primary records. [2025-09-15T21:21:45.174369] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-15T21:21:45.175217] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-15T21:21:45.176726] [INFO ] [MAIN ] Derivative Progress: 1792/2083 symbols completed. TAK took 1.0s. Estimated remaining: 1m 36s. Rate: 181.2 symbols/min [2025-09-15T21:21:45.182865] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:45.194386] [DEBUG] [LOCAL ] TAL: Derivative data saved (1326 records). [2025-09-15T21:21:45.195267] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-15T21:21:45.197942] [INFO ] [MAIN ] Derivative Progress: 1793/2083 symbols completed. TAL took 1.0s. Estimated remaining: 1m 36s. Rate: 181.3 symbols/min [2025-09-15T21:21:45.198365] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:45.209311] [DEBUG] [MAIN ] TALO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:45.210154] [INFO ] [MAIN ] TALO: Generated 1326 derivative records from 37607 primary records. [2025-09-15T21:21:45.210423] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-15T21:21:45.233746] [DEBUG] [LOCAL ] TBB: Loaded 8488 existing records from primary storage. [2025-09-15T21:21:45.233446] [DEBUG] [LOCAL ] TALO: Derivative data saved (1326 records). [2025-09-15T21:21:45.234040] [INFO ] [MAIN ] TBB: Loaded 8488 primary data records. [2025-09-15T21:21:45.234118] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-15T21:21:45.247833] [INFO ] [MAIN ] Derivative Progress: 1794/2083 symbols completed. TALO took 1.0s. Estimated remaining: 1m 36s. Rate: 181.4 symbols/min [2025-09-15T21:21:45.328019] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:45.411162] [DEBUG] [LOCAL ] TAP: Loaded 39102 existing records from primary storage. [2025-09-15T21:21:45.438052] [INFO ] [MAIN ] TAP: Loaded 39102 primary data records. [2025-09-15T21:21:45.685267] [DEBUG] [LOCAL ] TBBB: Loaded 26022 existing records from primary storage. [2025-09-15T21:21:45.702816] [INFO ] [MAIN ] TBBB: Loaded 26022 primary data records. [2025-09-15T21:21:45.985073] [DEBUG] [MAIN ] TBB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:46.009257] [INFO ] [MAIN ] TBB: Generated 1326 derivative records from 8488 primary records. [2025-09-15T21:21:46.015339] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-15T21:21:46.116796] [DEBUG] [LOCAL ] TBB: Derivative data saved (1326 records). [2025-09-15T21:21:46.117634] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-15T21:21:46.119434] [INFO ] [MAIN ] Derivative Progress: 1795/2083 symbols completed. TBB took 0.9s. Estimated remaining: 1m 35s. Rate: 181.2 symbols/min [2025-09-15T21:21:46.120287] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:46.136311] [DEBUG] [MAIN ] TAP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:46.141255] [INFO ] [MAIN ] TAP: Generated 1326 derivative records from 39102 primary records. [2025-09-15T21:21:46.141701] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-15T21:21:46.157893] [DEBUG] [LOCAL ] TBI: Loaded 16211 existing records from primary storage. [2025-09-15T21:21:46.160857] [INFO ] [MAIN ] TBI: Loaded 16211 primary data records. [2025-09-15T21:21:46.160807] [DEBUG] [LOCAL ] TAP: Derivative data saved (1326 records). [2025-09-15T21:21:46.161688] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-15T21:21:46.228132] [INFO ] [MAIN ] Derivative Progress: 1796/2083 symbols completed. TAP took 1.0s. Estimated remaining: 1m 35s. Rate: 181.3 symbols/min [2025-09-15T21:21:46.278381] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:46.289435] [DEBUG] [MAIN ] TBBB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:46.305681] [INFO ] [MAIN ] TBBB: Generated 1326 derivative records from 26022 primary records. [2025-09-15T21:21:46.319888] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-15T21:21:46.445682] [DEBUG] [LOCAL ] TBN: Loaded 2101 existing records from primary storage. [2025-09-15T21:21:46.457544] [INFO ] [MAIN ] TBN: Loaded 2101 primary data records. [2025-09-15T21:21:46.572602] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1326 records). [2025-09-15T21:21:46.575775] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-15T21:21:46.578132] [INFO ] [MAIN ] Derivative Progress: 1797/2083 symbols completed. TBBB took 1.3s. Estimated remaining: 1m 35s. Rate: 181.3 symbols/min [2025-09-15T21:21:46.605266] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:46.785056] [DEBUG] [MAIN ] TBI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:46.786079] [INFO ] [MAIN ] TBI: Generated 1326 derivative records from 16211 primary records. [2025-09-15T21:21:46.786189] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-15T21:21:46.804815] [DEBUG] [LOCAL ] TBI: Derivative data saved (1326 records). [2025-09-15T21:21:46.805123] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-15T21:21:46.806847] [INFO ] [MAIN ] Derivative Progress: 1798/2083 symbols completed. TBI took 0.7s. Estimated remaining: 1m 34s. Rate: 181.3 symbols/min [2025-09-15T21:21:46.827819] [DEBUG] [MAIN ] TBN: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:46.828450] [INFO ] [MAIN ] TBN: Generated 1325 derivative records from 2101 primary records. [2025-09-15T21:21:46.828512] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-15T21:21:46.850360] [DEBUG] [LOCAL ] TBN: Derivative data saved (1325 records). [2025-09-15T21:21:46.848920] [DEBUG] [LOCAL ] TD: Loaded 38508 existing records from primary storage. [2025-09-15T21:21:46.850440] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-15T21:21:46.852478] [INFO ] [MAIN ] TD: Loaded 38508 primary data records. [2025-09-15T21:21:46.852407] [INFO ] [MAIN ] Derivative Progress: 1799/2083 symbols completed. TBN took 0.6s. Estimated remaining: 1m 34s. Rate: 181.4 symbols/min [2025-09-15T21:21:47.120755] [DEBUG] [MAIN ] TD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:47.121363] [INFO ] [MAIN ] TD: Generated 1326 derivative records from 38508 primary records. [2025-09-15T21:21:47.121426] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-15T21:21:47.133320] [DEBUG] [LOCAL ] TD: Derivative data saved (1326 records). [2025-09-15T21:21:47.133378] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-15T21:21:47.134917] [INFO ] [MAIN ] Derivative Progress: 1800/2083 symbols completed. TD took 0.5s. Estimated remaining: 1m 34s. Rate: 181.4 symbols/min [2025-09-15T21:21:47.135831] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:47.135586] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:47.135952] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:47.143555] [DEBUG] [LOCAL ] TDF: Loaded 4139 existing records from primary storage. [2025-09-15T21:21:47.143759] [INFO ] [MAIN ] TDF: Loaded 4139 primary data records. [2025-09-15T21:21:47.255059] [DEBUG] [LOCAL ] TDG: Loaded 15959 existing records from primary storage. [2025-09-15T21:21:47.255572] [INFO ] [MAIN ] TDG: Loaded 15959 primary data records. [2025-09-15T21:21:47.457198] [DEBUG] [LOCAL ] TDC: Loaded 33906 existing records from primary storage. [2025-09-15T21:21:47.585463] [INFO ] [MAIN ] TDC: Loaded 33906 primary data records. [2025-09-15T21:21:48.003460] [DEBUG] [MAIN ] TDF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:48.003922] [DEBUG] [MAIN ] TDG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:48.004936] [INFO ] [MAIN ] TDF: Generated 1326 derivative records from 4139 primary records. [2025-09-15T21:21:48.005966] [INFO ] [MAIN ] TDG: Generated 1326 derivative records from 15959 primary records. [2025-09-15T21:21:48.006060] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-15T21:21:48.006515] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-15T21:21:48.030313] [DEBUG] [LOCAL ] TDG: Derivative data saved (1326 records). [2025-09-15T21:21:48.030519] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-15T21:21:48.032803] [INFO ] [MAIN ] Derivative Progress: 1801/2083 symbols completed. TDG took 0.9s. Estimated remaining: 1m 33s. Rate: 181.2 symbols/min [2025-09-15T21:21:48.033113] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:48.030581] [DEBUG] [LOCAL ] TDF: Derivative data saved (1326 records). [2025-09-15T21:21:48.033305] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-15T21:21:48.035027] [INFO ] [MAIN ] Derivative Progress: 1802/2083 symbols completed. TDF took 0.9s. Estimated remaining: 1m 33s. Rate: 181.3 symbols/min [2025-09-15T21:21:48.035677] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:48.049104] [DEBUG] [MAIN ] TDC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:48.049755] [INFO ] [MAIN ] TDC: Generated 1326 derivative records from 33906 primary records. [2025-09-15T21:21:48.049844] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-15T21:21:48.062082] [DEBUG] [LOCAL ] TDC: Derivative data saved (1326 records). [2025-09-15T21:21:48.062247] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-15T21:21:48.065124] [INFO ] [MAIN ] Derivative Progress: 1803/2083 symbols completed. TDC took 0.9s. Estimated remaining: 1m 33s. Rate: 181.4 symbols/min [2025-09-15T21:21:48.065545] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:48.098872] [DEBUG] [LOCAL ] TDS: Loaded 31466 existing records from primary storage. [2025-09-15T21:21:48.099084] [INFO ] [MAIN ] TDS: Loaded 31466 primary data records. [2025-09-15T21:21:48.288087] [DEBUG] [LOCAL ] TDOC: Loaded 39375 existing records from primary storage. [2025-09-15T21:21:48.292982] [INFO ] [MAIN ] TDOC: Loaded 39375 primary data records. [2025-09-15T21:21:48.294051] [DEBUG] [LOCAL ] TDW: Loaded 32873 existing records from primary storage. [2025-09-15T21:21:48.351596] [INFO ] [MAIN ] TDW: Loaded 32873 primary data records. [2025-09-15T21:21:49.131923] [DEBUG] [MAIN ] TDS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:49.134229] [INFO ] [MAIN ] TDS: Generated 1326 derivative records from 31466 primary records. [2025-09-15T21:21:49.134460] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-15T21:21:49.156675] [DEBUG] [MAIN ] TDOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:49.156370] [DEBUG] [LOCAL ] TDS: Derivative data saved (1326 records). [2025-09-15T21:21:49.157587] [INFO ] [MAIN ] TDOC: Generated 1326 derivative records from 39375 primary records. [2025-09-15T21:21:49.157831] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-15T21:21:49.159486] [INFO ] [MAIN ] Derivative Progress: 1804/2083 symbols completed. TDS took 1.1s. Estimated remaining: 1m 32s. Rate: 181.2 symbols/min [2025-09-15T21:21:49.159955] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:49.159895] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-15T21:21:49.188843] [DEBUG] [MAIN ] TDW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:49.188902] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1326 records). [2025-09-15T21:21:49.189089] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-15T21:21:49.189710] [INFO ] [MAIN ] TDW: Generated 1326 derivative records from 32873 primary records. [2025-09-15T21:21:49.191758] [INFO ] [MAIN ] Derivative Progress: 1805/2083 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 32s. Rate: 181.3 symbols/min [2025-09-15T21:21:49.191941] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:49.192055] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-15T21:21:49.204975] [DEBUG] [LOCAL ] TDY: Loaded 16659 existing records from primary storage. [2025-09-15T21:21:49.206080] [INFO ] [MAIN ] TDY: Loaded 16659 primary data records. [2025-09-15T21:21:49.263351] [DEBUG] [LOCAL ] TDW: Derivative data saved (1326 records). [2025-09-15T21:21:49.271928] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-15T21:21:49.263552] [DEBUG] [LOCAL ] TEAF: Loaded 4988 existing records from primary storage. [2025-09-15T21:21:49.274175] [INFO ] [MAIN ] Derivative Progress: 1806/2083 symbols completed. TDW took 1.2s. Estimated remaining: 1m 32s. Rate: 181.3 symbols/min [2025-09-15T21:21:49.272055] [INFO ] [MAIN ] TEAF: Loaded 4988 primary data records. [2025-09-15T21:21:49.293954] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:49.779072] [DEBUG] [LOCAL ] TECK: Loaded 39427 existing records from primary storage. [2025-09-15T21:21:49.780280] [INFO ] [MAIN ] TECK: Loaded 39427 primary data records. [2025-09-15T21:21:50.077999] [DEBUG] [MAIN ] TDY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:50.083137] [INFO ] [MAIN ] TDY: Generated 1326 derivative records from 16659 primary records. [2025-09-15T21:21:50.082429] [DEBUG] [MAIN ] TEAF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:50.083322] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-15T21:21:50.084068] [INFO ] [MAIN ] TEAF: Generated 1326 derivative records from 4988 primary records. [2025-09-15T21:21:50.084210] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-15T21:21:50.106376] [DEBUG] [LOCAL ] TDY: Derivative data saved (1326 records). [2025-09-15T21:21:50.107444] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-15T21:21:50.109290] [INFO ] [MAIN ] Derivative Progress: 1807/2083 symbols completed. TDY took 0.9s. Estimated remaining: 1m 31s. Rate: 181.2 symbols/min [2025-09-15T21:21:50.109768] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:50.112215] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1326 records). [2025-09-15T21:21:50.112304] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-15T21:21:50.114563] [INFO ] [MAIN ] Derivative Progress: 1808/2083 symbols completed. TEAF took 0.9s. Estimated remaining: 1m 31s. Rate: 181.3 symbols/min [2025-09-15T21:21:50.115015] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:50.128605] [DEBUG] [MAIN ] TECK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:50.129454] [INFO ] [MAIN ] TECK: Generated 1326 derivative records from 39427 primary records. [2025-09-15T21:21:50.129520] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-15T21:21:50.156386] [DEBUG] [LOCAL ] TEI: Loaded 14972 existing records from primary storage. [2025-09-15T21:21:50.157873] [DEBUG] [LOCAL ] TECK: Derivative data saved (1326 records). [2025-09-15T21:21:50.158045] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-15T21:21:50.158001] [INFO ] [MAIN ] TEI: Loaded 14972 primary data records. [2025-09-15T21:21:50.159954] [INFO ] [MAIN ] Derivative Progress: 1809/2083 symbols completed. TECK took 0.9s. Estimated remaining: 1m 31s. Rate: 181.4 symbols/min [2025-09-15T21:21:50.188218] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:50.232564] [DEBUG] [LOCAL ] TEF: Loaded 26600 existing records from primary storage. [2025-09-15T21:21:50.252349] [INFO ] [MAIN ] TEF: Loaded 26600 primary data records. [2025-09-15T21:21:50.561434] [DEBUG] [LOCAL ] TEN: Loaded 22238 existing records from primary storage. [2025-09-15T21:21:50.572510] [INFO ] [MAIN ] TEN: Loaded 22238 primary data records. [2025-09-15T21:21:51.022989] [DEBUG] [MAIN ] TEI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:51.024422] [INFO ] [MAIN ] TEI: Generated 1326 derivative records from 14972 primary records. [2025-09-15T21:21:51.024616] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-15T21:21:51.045321] [DEBUG] [MAIN ] TEF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:51.046428] [INFO ] [MAIN ] TEF: Generated 1326 derivative records from 26600 primary records. [2025-09-15T21:21:51.046862] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-15T21:21:51.067021] [DEBUG] [LOCAL ] TEF: Derivative data saved (1326 records). [2025-09-15T21:21:51.067604] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-15T21:21:51.069926] [INFO ] [MAIN ] Derivative Progress: 1810/2083 symbols completed. TEF took 1.0s. Estimated remaining: 1m 30s. Rate: 181.2 symbols/min [2025-09-15T21:21:51.070242] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:51.070697] [DEBUG] [LOCAL ] TEI: Derivative data saved (1326 records). [2025-09-15T21:21:51.072028] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-15T21:21:51.075043] [INFO ] [MAIN ] Derivative Progress: 1811/2083 symbols completed. TEI took 1.0s. Estimated remaining: 1m 30s. Rate: 181.3 symbols/min [2025-09-15T21:21:51.076287] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:51.086774] [DEBUG] [MAIN ] TEN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:51.087734] [INFO ] [MAIN ] TEN: Generated 1326 derivative records from 22238 primary records. [2025-09-15T21:21:51.088047] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-15T21:21:51.112961] [DEBUG] [LOCAL ] TEO: Loaded 16169 existing records from primary storage. [2025-09-15T21:21:51.114468] [DEBUG] [LOCAL ] TEN: Derivative data saved (1326 records). [2025-09-15T21:21:51.114536] [INFO ] [MAIN ] TEO: Loaded 16169 primary data records. [2025-09-15T21:21:51.114805] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-15T21:21:51.117010] [INFO ] [MAIN ] Derivative Progress: 1812/2083 symbols completed. TEN took 1.0s. Estimated remaining: 1m 30s. Rate: 181.4 symbols/min [2025-09-15T21:21:51.122441] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:51.451456] [DEBUG] [LOCAL ] TEVA: Loaded 39597 existing records from primary storage. [2025-09-15T21:21:51.460754] [INFO ] [MAIN ] TEVA: Loaded 39597 primary data records. [2025-09-15T21:21:51.481993] [DEBUG] [LOCAL ] TEX: Loaded 32427 existing records from primary storage. [2025-09-15T21:21:51.517071] [INFO ] [MAIN ] TEX: Loaded 32427 primary data records. [2025-09-15T21:21:52.019478] [DEBUG] [MAIN ] TEO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:52.021446] [INFO ] [MAIN ] TEO: Generated 1326 derivative records from 16169 primary records. [2025-09-15T21:21:52.021631] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-15T21:21:52.038258] [DEBUG] [LOCAL ] TEO: Derivative data saved (1326 records). [2025-09-15T21:21:52.038410] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-15T21:21:52.046546] [INFO ] [MAIN ] Derivative Progress: 1813/2083 symbols completed. TEO took 1.0s. Estimated remaining: 1m 29s. Rate: 181.2 symbols/min [2025-09-15T21:21:52.050943] [DEBUG] [MAIN ] TEVA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:52.053006] [INFO ] [MAIN ] TEVA: Generated 1326 derivative records from 39597 primary records. [2025-09-15T21:21:52.053299] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-15T21:21:52.069193] [DEBUG] [MAIN ] TEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:52.073072] [INFO ] [MAIN ] TEX: Generated 1326 derivative records from 32427 primary records. [2025-09-15T21:21:52.074703] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-15T21:21:52.076575] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1326 records). [2025-09-15T21:21:52.082834] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-15T21:21:52.086533] [INFO ] [MAIN ] Derivative Progress: 1814/2083 symbols completed. TEVA took 1.0s. Estimated remaining: 1m 29s. Rate: 181.3 symbols/min [2025-09-15T21:21:52.089431] [DEBUG] [LOCAL ] TEX: Derivative data saved (1326 records). [2025-09-15T21:21:52.089502] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-15T21:21:52.091438] [INFO ] [MAIN ] Derivative Progress: 1815/2083 symbols completed. TEX took 1.0s. Estimated remaining: 1m 29s. Rate: 181.4 symbols/min [2025-09-15T21:21:52.092064] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:52.091999] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:52.092220] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:52.119170] [DEBUG] [LOCAL ] TFIN: Loaded 17017 existing records from primary storage. [2025-09-15T21:21:52.119390] [INFO ] [MAIN ] TFIN: Loaded 17017 primary data records. [2025-09-15T21:21:52.235974] [DEBUG] [LOCAL ] TFII: Loaded 23810 existing records from primary storage. [2025-09-15T21:21:52.241740] [INFO ] [MAIN ] TFII: Loaded 23810 primary data records. [2025-09-15T21:21:52.313947] [DEBUG] [LOCAL ] TFPM: Loaded 28581 existing records from primary storage. [2025-09-15T21:21:52.348036] [INFO ] [MAIN ] TFPM: Loaded 28581 primary data records. [2025-09-15T21:21:52.968817] [DEBUG] [MAIN ] TFIN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:52.971114] [INFO ] [MAIN ] TFIN: Generated 1326 derivative records from 17017 primary records. [2025-09-15T21:21:52.972826] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-15T21:21:52.993894] [DEBUG] [MAIN ] TFII: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:53.003978] [INFO ] [MAIN ] TFII: Generated 1326 derivative records from 23810 primary records. [2025-09-15T21:21:53.003846] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1326 records). [2025-09-15T21:21:53.004254] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-15T21:21:53.004305] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-15T21:21:53.023207] [DEBUG] [MAIN ] TFPM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:53.006563] [INFO ] [MAIN ] Derivative Progress: 1816/2083 symbols completed. TFIN took 0.9s. Estimated remaining: 1m 28s. Rate: 181.2 symbols/min [2025-09-15T21:21:53.025808] [INFO ] [MAIN ] TFPM: Generated 1326 derivative records from 28581 primary records. [2025-09-15T21:21:53.028396] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-15T21:21:53.029845] [DEBUG] [LOCAL ] TFII: Derivative data saved (1326 records). [2025-09-15T21:21:53.030175] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-15T21:21:53.029740] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:53.037848] [INFO ] [MAIN ] Derivative Progress: 1817/2083 symbols completed. TFII took 0.9s. Estimated remaining: 1m 28s. Rate: 181.3 symbols/min [2025-09-15T21:21:53.041151] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:53.044447] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1326 records). [2025-09-15T21:21:53.044819] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-15T21:21:53.047970] [INFO ] [MAIN ] Derivative Progress: 1818/2083 symbols completed. TFPM took 1.0s. Estimated remaining: 1m 28s. Rate: 181.4 symbols/min [2025-09-15T21:21:53.048434] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:53.057230] [DEBUG] [LOCAL ] TG: Loaded 7330 existing records from primary storage. [2025-09-15T21:21:53.057355] [INFO ] [MAIN ] TG: Loaded 7330 primary data records. [2025-09-15T21:21:53.208113] [DEBUG] [LOCAL ] TGLS: Loaded 19996 existing records from primary storage. [2025-09-15T21:21:53.265219] [INFO ] [MAIN ] TGLS: Loaded 19996 primary data records. [2025-09-15T21:21:53.279592] [DEBUG] [LOCAL ] TFX: Loaded 25923 existing records from primary storage. [2025-09-15T21:21:53.299339] [INFO ] [MAIN ] TFX: Loaded 25923 primary data records. [2025-09-15T21:21:53.959875] [DEBUG] [MAIN ] TG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:53.960663] [INFO ] [MAIN ] TG: Generated 1326 derivative records from 7330 primary records. [2025-09-15T21:21:53.960913] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-15T21:21:53.973864] [DEBUG] [LOCAL ] TG: Derivative data saved (1326 records). [2025-09-15T21:21:53.974131] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-15T21:21:53.975959] [INFO ] [MAIN ] Derivative Progress: 1819/2083 symbols completed. TG took 0.9s. Estimated remaining: 1m 27s. Rate: 181.2 symbols/min [2025-09-15T21:21:53.976297] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:53.989136] [DEBUG] [MAIN ] TGLS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:53.991788] [INFO ] [MAIN ] TGLS: Generated 1326 derivative records from 19996 primary records. [2025-09-15T21:21:53.992026] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-15T21:21:54.002432] [DEBUG] [MAIN ] TFX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:54.003395] [INFO ] [MAIN ] TFX: Generated 1326 derivative records from 25923 primary records. [2025-09-15T21:21:54.003468] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-15T21:21:54.025877] [DEBUG] [LOCAL ] TFX: Derivative data saved (1326 records). [2025-09-15T21:21:54.026814] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-15T21:21:54.037628] [INFO ] [MAIN ] Derivative Progress: 1820/2083 symbols completed. TFX took 1.0s. Estimated remaining: 1m 27s. Rate: 181.3 symbols/min [2025-09-15T21:21:54.038230] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:54.037992] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1326 records). [2025-09-15T21:21:54.038321] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-15T21:21:54.040378] [INFO ] [MAIN ] Derivative Progress: 1821/2083 symbols completed. TGLS took 1.0s. Estimated remaining: 1m 27s. Rate: 181.4 symbols/min [2025-09-15T21:21:54.040535] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:54.056485] [DEBUG] [LOCAL ] TGNA: Loaded 35556 existing records from primary storage. [2025-09-15T21:21:54.056702] [INFO ] [MAIN ] TGNA: Loaded 35556 primary data records. [2025-09-15T21:21:54.194873] [DEBUG] [LOCAL ] TGS: Loaded 23657 existing records from primary storage. [2025-09-15T21:21:54.200595] [INFO ] [MAIN ] TGS: Loaded 23657 primary data records. [2025-09-15T21:21:54.469071] [DEBUG] [LOCAL ] TGT: Loaded 39738 existing records from primary storage. [2025-09-15T21:21:54.472603] [INFO ] [MAIN ] TGT: Loaded 39738 primary data records. [2025-09-15T21:21:54.941525] [DEBUG] [MAIN ] TGNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:54.942228] [INFO ] [MAIN ] TGNA: Generated 1326 derivative records from 35556 primary records. [2025-09-15T21:21:54.942393] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-15T21:21:54.957902] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1326 records). [2025-09-15T21:21:54.958296] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-15T21:21:54.961183] [INFO ] [MAIN ] Derivative Progress: 1822/2083 symbols completed. TGNA took 1.0s. Estimated remaining: 1m 26s. Rate: 181.2 symbols/min [2025-09-15T21:21:54.961445] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:54.971585] [DEBUG] [MAIN ] TGS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:54.972345] [INFO ] [MAIN ] TGS: Generated 1326 derivative records from 23657 primary records. [2025-09-15T21:21:54.972607] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-15T21:21:54.996594] [DEBUG] [LOCAL ] TGS: Derivative data saved (1326 records). [2025-09-15T21:21:54.997030] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-15T21:21:54.998506] [INFO ] [MAIN ] Derivative Progress: 1823/2083 symbols completed. TGS took 1.0s. Estimated remaining: 1m 26s. Rate: 181.3 symbols/min [2025-09-15T21:21:54.998774] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:54.996984] [DEBUG] [MAIN ] TGT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:55.000113] [INFO ] [MAIN ] TGT: Generated 1326 derivative records from 39738 primary records. [2025-09-15T21:21:55.000315] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-15T21:21:55.014579] [DEBUG] [LOCAL ] TGT: Derivative data saved (1326 records). [2025-09-15T21:21:55.014816] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-15T21:21:55.016913] [INFO ] [MAIN ] Derivative Progress: 1824/2083 symbols completed. TGT took 1.0s. Estimated remaining: 1m 26s. Rate: 181.4 symbols/min [2025-09-15T21:21:55.017278] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:55.032422] [DEBUG] [LOCAL ] THIR: Loaded 1775 existing records from primary storage. [2025-09-15T21:21:55.032553] [INFO ] [MAIN ] THIR: Loaded 1775 primary data records. [2025-09-15T21:21:55.140014] [DEBUG] [LOCAL ] THG: Loaded 15468 existing records from primary storage. [2025-09-15T21:21:55.139930] [DEBUG] [LOCAL ] THC: Loaded 35461 existing records from primary storage. [2025-09-15T21:21:55.151146] [INFO ] [MAIN ] THG: Loaded 15468 primary data records. [2025-09-15T21:21:55.151270] [INFO ] [MAIN ] THC: Loaded 35461 primary data records. [2025-09-15T21:21:55.943963] [DEBUG] [MAIN ] THIR: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:55.945103] [INFO ] [MAIN ] THIR: Generated 1325 derivative records from 1775 primary records. [2025-09-15T21:21:55.947219] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-15T21:21:55.968103] [DEBUG] [MAIN ] THG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:55.969860] [DEBUG] [LOCAL ] THIR: Derivative data saved (1325 records). [2025-09-15T21:21:55.975993] [INFO ] [MAIN ] THG: Generated 1326 derivative records from 15468 primary records. [2025-09-15T21:21:55.979698] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-15T21:21:55.979888] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-15T21:21:55.981855] [INFO ] [MAIN ] Derivative Progress: 1825/2083 symbols completed. THIR took 1.0s. Estimated remaining: 1m 25s. Rate: 181.2 symbols/min [2025-09-15T21:21:55.980139] [DEBUG] [MAIN ] THC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:55.983246] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:55.983118] [INFO ] [MAIN ] THC: Generated 1326 derivative records from 35461 primary records. [2025-09-15T21:21:55.984081] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-15T21:21:55.996076] [DEBUG] [LOCAL ] THG: Derivative data saved (1326 records). [2025-09-15T21:21:55.996431] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-15T21:21:56.013739] [INFO ] [MAIN ] Derivative Progress: 1826/2083 symbols completed. THG took 1.0s. Estimated remaining: 1m 25s. Rate: 181.3 symbols/min [2025-09-15T21:21:56.013451] [DEBUG] [LOCAL ] THLV: Loaded 1081 existing records from primary storage. [2025-09-15T21:21:56.014167] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:56.014590] [INFO ] [MAIN ] THLV: Loaded 1081 primary data records. [2025-09-15T21:21:56.061899] [DEBUG] [LOCAL ] THC: Derivative data saved (1326 records). [2025-09-15T21:21:56.074553] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-15T21:21:56.103134] [INFO ] [MAIN ] Derivative Progress: 1827/2083 symbols completed. THC took 1.1s. Estimated remaining: 1m 25s. Rate: 181.4 symbols/min [2025-09-15T21:21:56.114603] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:56.315109] [DEBUG] [LOCAL ] THO: Loaded 30280 existing records from primary storage. [2025-09-15T21:21:56.322062] [INFO ] [MAIN ] THO: Loaded 30280 primary data records. [2025-09-15T21:21:56.354119] [DEBUG] [LOCAL ] THQ: Loaded 19276 existing records from primary storage. [2025-09-15T21:21:56.404480] [INFO ] [MAIN ] THQ: Loaded 19276 primary data records. [2025-09-15T21:21:56.868269] [DEBUG] [MAIN ] THLV: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:21:56.870945] [INFO ] [MAIN ] THLV: Generated 1325 derivative records from 1081 primary records. [2025-09-15T21:21:56.871767] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-15T21:21:56.885153] [DEBUG] [LOCAL ] THLV: Derivative data saved (1325 records). [2025-09-15T21:21:56.885565] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-15T21:21:56.887663] [INFO ] [MAIN ] Derivative Progress: 1828/2083 symbols completed. THLV took 0.9s. Estimated remaining: 1m 24s. Rate: 181.2 symbols/min [2025-09-15T21:21:56.905470] [DEBUG] [MAIN ] THO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:56.907344] [INFO ] [MAIN ] THO: Generated 1326 derivative records from 30280 primary records. [2025-09-15T21:21:56.907471] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-15T21:21:56.925099] [DEBUG] [MAIN ] THQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:56.929428] [INFO ] [MAIN ] THQ: Generated 1326 derivative records from 19276 primary records. [2025-09-15T21:21:56.932135] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-15T21:21:56.934017] [DEBUG] [LOCAL ] THO: Derivative data saved (1326 records). [2025-09-15T21:21:56.934290] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-15T21:21:56.936471] [INFO ] [MAIN ] Derivative Progress: 1829/2083 symbols completed. THO took 0.9s. Estimated remaining: 1m 24s. Rate: 181.3 symbols/min [2025-09-15T21:21:56.947889] [DEBUG] [LOCAL ] THQ: Derivative data saved (1326 records). [2025-09-15T21:21:56.947988] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-15T21:21:56.950157] [INFO ] [MAIN ] Derivative Progress: 1830/2083 symbols completed. THQ took 0.8s. Estimated remaining: 1m 24s. Rate: 181.4 symbols/min [2025-09-15T21:21:56.950663] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:56.950856] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:56.950793] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:56.973802] [DEBUG] [LOCAL ] THR: Loaded 14372 existing records from primary storage. [2025-09-15T21:21:56.974054] [INFO ] [MAIN ] THR: Loaded 14372 primary data records. [2025-09-15T21:21:57.081247] [DEBUG] [LOCAL ] THW: Loaded 14788 existing records from primary storage. [2025-09-15T21:21:57.099789] [INFO ] [MAIN ] THW: Loaded 14788 primary data records. [2025-09-15T21:21:57.100247] [DEBUG] [LOCAL ] THS: Loaded 28104 existing records from primary storage. [2025-09-15T21:21:57.132315] [INFO ] [MAIN ] THS: Loaded 28104 primary data records. [2025-09-15T21:21:57.816657] [DEBUG] [MAIN ] THR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:57.817392] [INFO ] [MAIN ] THR: Generated 1326 derivative records from 14372 primary records. [2025-09-15T21:21:57.817732] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-15T21:21:57.831261] [DEBUG] [LOCAL ] THR: Derivative data saved (1326 records). [2025-09-15T21:21:57.832774] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-15T21:21:57.834498] [INFO ] [MAIN ] Derivative Progress: 1831/2083 symbols completed. THR took 0.9s. Estimated remaining: 1m 23s. Rate: 181.3 symbols/min [2025-09-15T21:21:57.834760] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:57.846499] [DEBUG] [MAIN ] THW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:57.847837] [INFO ] [MAIN ] THW: Generated 1326 derivative records from 14788 primary records. [2025-09-15T21:21:57.847937] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-15T21:21:57.864360] [DEBUG] [MAIN ] THS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:57.872253] [INFO ] [MAIN ] THS: Generated 1326 derivative records from 28104 primary records. [2025-09-15T21:21:57.872342] [DEBUG] [LOCAL ] THW: Derivative data saved (1326 records). [2025-09-15T21:21:57.872764] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-15T21:21:57.872708] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-15T21:21:57.876601] [INFO ] [MAIN ] Derivative Progress: 1832/2083 symbols completed. THW took 0.9s. Estimated remaining: 1m 23s. Rate: 181.3 symbols/min [2025-09-15T21:21:57.877337] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:57.898830] [DEBUG] [LOCAL ] THS: Derivative data saved (1326 records). [2025-09-15T21:21:57.899083] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-15T21:21:57.901068] [INFO ] [MAIN ] Derivative Progress: 1833/2083 symbols completed. THS took 1.0s. Estimated remaining: 1m 23s. Rate: 181.4 symbols/min [2025-09-15T21:21:57.901787] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:57.904859] [DEBUG] [LOCAL ] TISI: Loaded 2142 existing records from primary storage. [2025-09-15T21:21:57.913790] [INFO ] [MAIN ] TISI: Loaded 2142 primary data records. [2025-09-15T21:21:57.935826] [DEBUG] [LOCAL ] TIMB: Loaded 26446 existing records from primary storage. [2025-09-15T21:21:57.959240] [INFO ] [MAIN ] TIMB: Loaded 26446 primary data records. [2025-09-15T21:21:58.198227] [DEBUG] [LOCAL ] TIXT: Loaded 23961 existing records from primary storage. [2025-09-15T21:21:58.241180] [INFO ] [MAIN ] TIXT: Loaded 23961 primary data records. [2025-09-15T21:21:58.797054] [DEBUG] [MAIN ] TISI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:58.800012] [INFO ] [MAIN ] TISI: Generated 1326 derivative records from 2142 primary records. [2025-09-15T21:21:58.800522] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-15T21:21:58.820525] [DEBUG] [MAIN ] TIMB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:58.823471] [DEBUG] [LOCAL ] TISI: Derivative data saved (1326 records). [2025-09-15T21:21:58.824529] [INFO ] [MAIN ] TIMB: Generated 1326 derivative records from 26446 primary records. [2025-09-15T21:21:58.824654] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-15T21:21:58.827483] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-15T21:21:58.827380] [INFO ] [MAIN ] Derivative Progress: 1834/2083 symbols completed. TISI took 1.0s. Estimated remaining: 1m 22s. Rate: 181.3 symbols/min [2025-09-15T21:21:58.828743] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:58.850018] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1326 records). [2025-09-15T21:21:58.854077] [DEBUG] [MAIN ] TIXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:58.855913] [INFO ] [MAIN ] TIXT: Generated 1326 derivative records from 23961 primary records. [2025-09-15T21:21:58.854517] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-15T21:21:58.856099] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-15T21:21:58.858991] [INFO ] [MAIN ] Derivative Progress: 1835/2083 symbols completed. TIMB took 1.0s. Estimated remaining: 1m 22s. Rate: 181.4 symbols/min [2025-09-15T21:21:58.859752] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:58.882759] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1326 records). [2025-09-15T21:21:58.882975] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-15T21:21:58.885232] [INFO ] [MAIN ] Derivative Progress: 1836/2083 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 22s. Rate: 181.4 symbols/min [2025-09-15T21:21:58.885539] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:58.897879] [DEBUG] [LOCAL ] TK: Loaded 29500 existing records from primary storage. [2025-09-15T21:21:58.898298] [INFO ] [MAIN ] TK: Loaded 29500 primary data records. [2025-09-15T21:21:59.055162] [DEBUG] [LOCAL ] TKC: Loaded 28162 existing records from primary storage. [2025-09-15T21:21:59.080278] [INFO ] [MAIN ] TKC: Loaded 28162 primary data records. [2025-09-15T21:21:59.327678] [DEBUG] [LOCAL ] TKO: Loaded 31405 existing records from primary storage. [2025-09-15T21:21:59.343901] [INFO ] [MAIN ] TKO: Loaded 31405 primary data records. [2025-09-15T21:21:59.799065] [DEBUG] [MAIN ] TK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:59.800208] [INFO ] [MAIN ] TK: Generated 1326 derivative records from 29500 primary records. [2025-09-15T21:21:59.800429] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-15T21:21:59.817351] [DEBUG] [LOCAL ] TK: Derivative data saved (1326 records). [2025-09-15T21:21:59.827185] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-15T21:21:59.829880] [INFO ] [MAIN ] Derivative Progress: 1837/2083 symbols completed. TK took 1.0s. Estimated remaining: 1m 21s. Rate: 181.3 symbols/min [2025-09-15T21:21:59.830371] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:59.827464] [DEBUG] [MAIN ] TKC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:59.831378] [INFO ] [MAIN ] TKC: Generated 1326 derivative records from 28162 primary records. [2025-09-15T21:21:59.831985] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-15T21:21:59.847239] [DEBUG] [LOCAL ] TKC: Derivative data saved (1326 records). [2025-09-15T21:21:59.847559] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-15T21:21:59.849889] [INFO ] [MAIN ] Derivative Progress: 1838/2083 symbols completed. TKC took 1.0s. Estimated remaining: 1m 21s. Rate: 181.4 symbols/min [2025-09-15T21:21:59.860100] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:59.860800] [DEBUG] [MAIN ] TKO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:21:59.862000] [INFO ] [MAIN ] TKO: Generated 1326 derivative records from 31405 primary records. [2025-09-15T21:21:59.862174] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-15T21:21:59.875535] [DEBUG] [LOCAL ] TKO: Derivative data saved (1326 records). [2025-09-15T21:21:59.875970] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-15T21:21:59.885694] [INFO ] [MAIN ] Derivative Progress: 1839/2083 symbols completed. TKO took 1.0s. Estimated remaining: 1m 21s. Rate: 181.4 symbols/min [2025-09-15T21:21:59.886206] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:21:59.899525] [DEBUG] [LOCAL ] TKR: Loaded 28611 existing records from primary storage. [2025-09-15T21:21:59.903039] [INFO ] [MAIN ] TKR: Loaded 28611 primary data records. [2025-09-15T21:22:00.000384] [DEBUG] [LOCAL ] TLYS: Loaded 14004 existing records from primary storage. [2025-09-15T21:22:00.020443] [INFO ] [MAIN ] TLYS: Loaded 14004 primary data records. [2025-09-15T21:22:00.071312] [DEBUG] [LOCAL ] TLK: Loaded 28585 existing records from primary storage. [2025-09-15T21:22:00.119113] [INFO ] [MAIN ] TLK: Loaded 28585 primary data records. [2025-09-15T21:22:00.809145] [DEBUG] [MAIN ] TKR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:00.810328] [INFO ] [MAIN ] TKR: Generated 1326 derivative records from 28611 primary records. [2025-09-15T21:22:00.810579] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-15T21:22:00.823713] [DEBUG] [LOCAL ] TKR: Derivative data saved (1326 records). [2025-09-15T21:22:00.824976] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-15T21:22:00.827443] [INFO ] [MAIN ] Derivative Progress: 1840/2083 symbols completed. TKR took 1.0s. Estimated remaining: 1m 20s. Rate: 181.3 symbols/min [2025-09-15T21:22:00.827827] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:00.840287] [DEBUG] [MAIN ] TLYS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:00.842154] [INFO ] [MAIN ] TLYS: Generated 1326 derivative records from 14004 primary records. [2025-09-15T21:22:00.842387] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-15T21:22:00.852960] [DEBUG] [MAIN ] TLK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:00.854272] [INFO ] [MAIN ] TLK: Generated 1326 derivative records from 28585 primary records. [2025-09-15T21:22:00.854750] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-15T21:22:00.882102] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1326 records). [2025-09-15T21:22:00.885818] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-15T21:22:00.891152] [INFO ] [MAIN ] Derivative Progress: 1841/2083 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 20s. Rate: 181.3 symbols/min [2025-09-15T21:22:00.891967] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:00.893597] [DEBUG] [LOCAL ] TLK: Derivative data saved (1326 records). [2025-09-15T21:22:00.902449] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-15T21:22:00.904735] [INFO ] [MAIN ] Derivative Progress: 1842/2083 symbols completed. TLK took 1.0s. Estimated remaining: 1m 20s. Rate: 181.4 symbols/min [2025-09-15T21:22:00.905002] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:00.906174] [DEBUG] [LOCAL ] TM: Loaded 27228 existing records from primary storage. [2025-09-15T21:22:00.906524] [INFO ] [MAIN ] TM: Loaded 27228 primary data records. [2025-09-15T21:22:01.144603] [DEBUG] [LOCAL ] TME: Loaded 39238 existing records from primary storage. [2025-09-15T21:22:01.223736] [DEBUG] [LOCAL ] TMHC: Loaded 33422 existing records from primary storage. [2025-09-15T21:22:01.234454] [INFO ] [MAIN ] TME: Loaded 39238 primary data records. [2025-09-15T21:22:01.235276] [INFO ] [MAIN ] TMHC: Loaded 33422 primary data records. [2025-09-15T21:22:01.843788] [DEBUG] [MAIN ] TM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:01.846057] [INFO ] [MAIN ] TM: Generated 1326 derivative records from 27228 primary records. [2025-09-15T21:22:01.846387] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-15T21:22:01.864278] [DEBUG] [LOCAL ] TM: Derivative data saved (1326 records). [2025-09-15T21:22:01.864576] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-15T21:22:01.866485] [INFO ] [MAIN ] Derivative Progress: 1843/2083 symbols completed. TM took 1.0s. Estimated remaining: 1m 19s. Rate: 181.2 symbols/min [2025-09-15T21:22:01.886713] [DEBUG] [MAIN ] TMHC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:01.887734] [INFO ] [MAIN ] TMHC: Generated 1326 derivative records from 33422 primary records. [2025-09-15T21:22:01.897924] [DEBUG] [MAIN ] TME: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:01.897563] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-15T21:22:01.898758] [INFO ] [MAIN ] TME: Generated 1326 derivative records from 39238 primary records. [2025-09-15T21:22:01.899576] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-15T21:22:01.924327] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1326 records). [2025-09-15T21:22:01.924964] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-15T21:22:01.924824] [DEBUG] [LOCAL ] TME: Derivative data saved (1326 records). [2025-09-15T21:22:01.927684] [INFO ] [MAIN ] Derivative Progress: 1844/2083 symbols completed. TMHC took 1.0s. Estimated remaining: 1m 19s. Rate: 181.3 symbols/min [2025-09-15T21:22:01.927976] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-15T21:22:01.930502] [INFO ] [MAIN ] Derivative Progress: 1845/2083 symbols completed. TME took 1.0s. Estimated remaining: 1m 19s. Rate: 181.4 symbols/min [2025-09-15T21:22:01.931262] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:01.931159] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:01.931485] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:01.945201] [DEBUG] [LOCAL ] TNC: Loaded 10477 existing records from primary storage. [2025-09-15T21:22:01.945386] [INFO ] [MAIN ] TNC: Loaded 10477 primary data records. [2025-09-15T21:22:02.146027] [DEBUG] [LOCAL ] TNET: Loaded 20980 existing records from primary storage. [2025-09-15T21:22:02.161162] [INFO ] [MAIN ] TNET: Loaded 20980 primary data records. [2025-09-15T21:22:02.362590] [DEBUG] [LOCAL ] TMO: Loaded 38749 existing records from primary storage. [2025-09-15T21:22:02.366019] [INFO ] [MAIN ] TMO: Loaded 38749 primary data records. [2025-09-15T21:22:02.852711] [DEBUG] [MAIN ] TNC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:02.853955] [INFO ] [MAIN ] TNC: Generated 1326 derivative records from 10477 primary records. [2025-09-15T21:22:02.854456] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-15T21:22:02.871530] [DEBUG] [LOCAL ] TNC: Derivative data saved (1326 records). [2025-09-15T21:22:02.871848] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-15T21:22:02.879368] [INFO ] [MAIN ] Derivative Progress: 1846/2083 symbols completed. TNC took 0.9s. Estimated remaining: 1m 18s. Rate: 181.2 symbols/min [2025-09-15T21:22:02.883319] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:02.883810] [DEBUG] [MAIN ] TNET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:02.884961] [INFO ] [MAIN ] TNET: Generated 1326 derivative records from 20980 primary records. [2025-09-15T21:22:02.885251] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-15T21:22:02.909458] [DEBUG] [LOCAL ] TNET: Derivative data saved (1326 records). [2025-09-15T21:22:02.909406] [DEBUG] [MAIN ] TMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:02.910146] [INFO ] [MAIN ] TMO: Generated 1326 derivative records from 38749 primary records. [2025-09-15T21:22:02.910293] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-15T21:22:02.912401] [INFO ] [MAIN ] Derivative Progress: 1847/2083 symbols completed. TNET took 1.0s. Estimated remaining: 1m 18s. Rate: 181.3 symbols/min [2025-09-15T21:22:02.910335] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-15T21:22:02.913016] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:02.932819] [DEBUG] [LOCAL ] TMO: Derivative data saved (1326 records). [2025-09-15T21:22:02.933016] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-15T21:22:02.935943] [INFO ] [MAIN ] Derivative Progress: 1848/2083 symbols completed. TMO took 1.0s. Estimated remaining: 1m 18s. Rate: 181.4 symbols/min [2025-09-15T21:22:02.936139] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:02.945329] [DEBUG] [LOCAL ] TNK: Loaded 26122 existing records from primary storage. [2025-09-15T21:22:02.945521] [INFO ] [MAIN ] TNK: Loaded 26122 primary data records. [2025-09-15T21:22:03.154544] [DEBUG] [LOCAL ] TNL: Loaded 30721 existing records from primary storage. [2025-09-15T21:22:03.268429] [INFO ] [MAIN ] TNL: Loaded 30721 primary data records. [2025-09-15T21:22:03.386157] [DEBUG] [LOCAL ] TOST: Loaded 39651 existing records from primary storage. [2025-09-15T21:22:03.389597] [INFO ] [MAIN ] TOST: Loaded 39651 primary data records. [2025-09-15T21:22:03.864023] [DEBUG] [MAIN ] TNK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:03.953689] [INFO ] [MAIN ] TNK: Generated 1326 derivative records from 26122 primary records. [2025-09-15T21:22:03.955020] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-15T21:22:03.972980] [DEBUG] [LOCAL ] TNK: Derivative data saved (1326 records). [2025-09-15T21:22:03.973248] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-15T21:22:03.976099] [INFO ] [MAIN ] Derivative Progress: 1849/2083 symbols completed. TNK took 1.1s. Estimated remaining: 1m 17s. Rate: 181.2 symbols/min [2025-09-15T21:22:03.978111] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:03.990304] [DEBUG] [MAIN ] TNL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:03.991307] [INFO ] [MAIN ] TNL: Generated 1326 derivative records from 30721 primary records. [2025-09-15T21:22:03.991584] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-15T21:22:04.005383] [DEBUG] [LOCAL ] TNL: Derivative data saved (1326 records). [2025-09-15T21:22:04.007401] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-15T21:22:04.010389] [INFO ] [MAIN ] Derivative Progress: 1850/2083 symbols completed. TNL took 1.1s. Estimated remaining: 1m 17s. Rate: 181.3 symbols/min [2025-09-15T21:22:04.016417] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:04.027832] [DEBUG] [MAIN ] TOST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:04.028584] [INFO ] [MAIN ] TOST: Generated 1326 derivative records from 39651 primary records. [2025-09-15T21:22:04.028719] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-15T21:22:04.046455] [DEBUG] [LOCAL ] TPB: Loaded 18881 existing records from primary storage. [2025-09-15T21:22:04.047928] [INFO ] [MAIN ] TPB: Loaded 18881 primary data records. [2025-09-15T21:22:04.081350] [DEBUG] [LOCAL ] TOST: Derivative data saved (1326 records). [2025-09-15T21:22:04.128948] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-15T21:22:04.143018] [INFO ] [MAIN ] Derivative Progress: 1851/2083 symbols completed. TOST took 1.2s. Estimated remaining: 1m 17s. Rate: 181.4 symbols/min [2025-09-15T21:22:04.167732] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:04.220563] [DEBUG] [LOCAL ] TPC: Loaded 29194 existing records from primary storage. [2025-09-15T21:22:04.233934] [INFO ] [MAIN ] TPC: Loaded 29194 primary data records. [2025-09-15T21:22:04.572771] [DEBUG] [LOCAL ] TPH: Loaded 33185 existing records from primary storage. [2025-09-15T21:22:04.574391] [INFO ] [MAIN ] TPH: Loaded 33185 primary data records. [2025-09-15T21:22:04.946018] [DEBUG] [MAIN ] TPB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:04.947326] [INFO ] [MAIN ] TPB: Generated 1326 derivative records from 18881 primary records. [2025-09-15T21:22:04.949329] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-15T21:22:04.972286] [DEBUG] [MAIN ] TPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:04.972045] [DEBUG] [LOCAL ] TPB: Derivative data saved (1326 records). [2025-09-15T21:22:04.972496] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-15T21:22:04.973098] [INFO ] [MAIN ] TPC: Generated 1326 derivative records from 29194 primary records. [2025-09-15T21:22:04.975893] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-15T21:22:04.975824] [INFO ] [MAIN ] Derivative Progress: 1852/2083 symbols completed. TPB took 1.0s. Estimated remaining: 1m 16s. Rate: 181.2 symbols/min [2025-09-15T21:22:04.983837] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:04.990092] [DEBUG] [LOCAL ] TPC: Derivative data saved (1326 records). [2025-09-15T21:22:04.990165] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-15T21:22:04.992177] [INFO ] [MAIN ] Derivative Progress: 1853/2083 symbols completed. TPC took 1.0s. Estimated remaining: 1m 16s. Rate: 181.3 symbols/min [2025-09-15T21:22:04.992351] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:05.008548] [DEBUG] [MAIN ] TPH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:05.012502] [DEBUG] [LOCAL ] TPL: Loaded 9157 existing records from primary storage. [2025-09-15T21:22:05.013290] [INFO ] [MAIN ] TPL: Loaded 9157 primary data records. [2025-09-15T21:22:05.013143] [INFO ] [MAIN ] TPH: Generated 1326 derivative records from 33185 primary records. [2025-09-15T21:22:05.049267] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-15T21:22:05.189500] [DEBUG] [LOCAL ] TPH: Derivative data saved (1326 records). [2025-09-15T21:22:05.213691] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-15T21:22:05.226877] [INFO ] [MAIN ] Derivative Progress: 1854/2083 symbols completed. TPH took 1.1s. Estimated remaining: 1m 16s. Rate: 181.3 symbols/min [2025-09-15T21:22:05.339722] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:05.339431] [DEBUG] [LOCAL ] TPR: Loaded 39482 existing records from primary storage. [2025-09-15T21:22:05.340670] [INFO ] [MAIN ] TPR: Loaded 39482 primary data records. [2025-09-15T21:22:05.533470] [DEBUG] [LOCAL ] TPVG: Loaded 18877 existing records from primary storage. [2025-09-15T21:22:05.617832] [INFO ] [MAIN ] TPVG: Loaded 18877 primary data records. [2025-09-15T21:22:05.779007] [DEBUG] [MAIN ] TPL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:05.796593] [INFO ] [MAIN ] TPL: Generated 1326 derivative records from 9157 primary records. [2025-09-15T21:22:05.816945] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-15T21:22:05.922374] [DEBUG] [LOCAL ] TPL: Derivative data saved (1326 records). [2025-09-15T21:22:05.923428] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-15T21:22:05.925954] [INFO ] [MAIN ] Derivative Progress: 1855/2083 symbols completed. TPL took 0.9s. Estimated remaining: 1m 15s. Rate: 181.2 symbols/min [2025-09-15T21:22:05.926373] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:05.941344] [DEBUG] [MAIN ] TPR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:05.942361] [INFO ] [MAIN ] TPR: Generated 1326 derivative records from 39482 primary records. [2025-09-15T21:22:05.942699] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-15T21:22:05.946725] [DEBUG] [LOCAL ] TPYP: Loaded 5781 existing records from primary storage. [2025-09-15T21:22:05.947456] [INFO ] [MAIN ] TPYP: Loaded 5781 primary data records. [2025-09-15T21:22:06.069892] [DEBUG] [LOCAL ] TPR: Derivative data saved (1326 records). [2025-09-15T21:22:06.079598] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-15T21:22:06.081902] [INFO ] [MAIN ] Derivative Progress: 1856/2083 symbols completed. TPR took 1.1s. Estimated remaining: 1m 15s. Rate: 181.3 symbols/min [2025-09-15T21:22:06.103136] [DEBUG] [MAIN ] TPVG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:06.103185] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:06.124380] [INFO ] [MAIN ] TPVG: Generated 1326 derivative records from 18877 primary records. [2025-09-15T21:22:06.140834] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-15T21:22:06.265613] [DEBUG] [LOCAL ] TPZ: Loaded 3245 existing records from primary storage. [2025-09-15T21:22:06.266738] [INFO ] [MAIN ] TPZ: Loaded 3245 primary data records. [2025-09-15T21:22:06.305878] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1326 records). [2025-09-15T21:22:06.347177] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-15T21:22:06.374552] [INFO ] [MAIN ] Derivative Progress: 1857/2083 symbols completed. TPVG took 1.0s. Estimated remaining: 1m 15s. Rate: 181.3 symbols/min [2025-09-15T21:22:06.378910] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:06.560033] [DEBUG] [LOCAL ] TR: Loaded 14670 existing records from primary storage. [2025-09-15T21:22:06.560433] [INFO ] [MAIN ] TR: Loaded 14670 primary data records. [2025-09-15T21:22:06.581425] [DEBUG] [MAIN ] TPYP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:06.613966] [INFO ] [MAIN ] TPYP: Generated 1326 derivative records from 5781 primary records. [2025-09-15T21:22:06.626965] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-15T21:22:06.708199] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1326 records). [2025-09-15T21:22:06.758378] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-15T21:22:06.765146] [INFO ] [MAIN ] Derivative Progress: 1858/2083 symbols completed. TPYP took 0.8s. Estimated remaining: 1m 14s. Rate: 181.3 symbols/min [2025-09-15T21:22:06.861687] [DEBUG] [MAIN ] TPZ: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:22:06.863349] [INFO ] [MAIN ] TPZ: Generated 1325 derivative records from 3245 primary records. [2025-09-15T21:22:06.863559] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-15T21:22:06.876310] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1325 records). [2025-09-15T21:22:06.876408] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-15T21:22:06.878397] [INFO ] [MAIN ] Derivative Progress: 1859/2083 symbols completed. TPZ took 0.8s. Estimated remaining: 1m 14s. Rate: 181.3 symbols/min [2025-09-15T21:22:06.892175] [DEBUG] [MAIN ] TR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:06.892733] [INFO ] [MAIN ] TR: Generated 1326 derivative records from 14670 primary records. [2025-09-15T21:22:06.892793] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-15T21:22:06.904133] [DEBUG] [LOCAL ] TR: Derivative data saved (1326 records). [2025-09-15T21:22:06.904190] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-15T21:22:06.905847] [INFO ] [MAIN ] Derivative Progress: 1860/2083 symbols completed. TR took 0.5s. Estimated remaining: 1m 14s. Rate: 181.4 symbols/min [2025-09-15T21:22:06.906240] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:06.906378] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:06.906478] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:06.915907] [DEBUG] [LOCAL ] TRAK: Loaded 6686 existing records from primary storage. [2025-09-15T21:22:06.918532] [INFO ] [MAIN ] TRAK: Loaded 6686 primary data records. [2025-09-15T21:22:07.039815] [DEBUG] [LOCAL ] TRC: Loaded 11356 existing records from primary storage. [2025-09-15T21:22:07.040410] [INFO ] [MAIN ] TRC: Loaded 11356 primary data records. [2025-09-15T21:22:07.300907] [DEBUG] [LOCAL ] TREX: Loaded 36482 existing records from primary storage. [2025-09-15T21:22:07.315803] [INFO ] [MAIN ] TREX: Loaded 36482 primary data records. [2025-09-15T21:22:07.808223] [DEBUG] [MAIN ] TRAK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:07.809634] [INFO ] [MAIN ] TRAK: Generated 1326 derivative records from 6686 primary records. [2025-09-15T21:22:07.810235] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-15T21:22:07.835508] [DEBUG] [MAIN ] TRC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:07.837398] [INFO ] [MAIN ] TRC: Generated 1326 derivative records from 11356 primary records. [2025-09-15T21:22:07.837567] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-15T21:22:07.836729] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1326 records). [2025-09-15T21:22:07.839081] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-15T21:22:07.849056] [INFO ] [MAIN ] Derivative Progress: 1861/2083 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 13s. Rate: 181.2 symbols/min [2025-09-15T21:22:07.851807] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:07.863233] [DEBUG] [MAIN ] TREX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:07.864661] [INFO ] [MAIN ] TREX: Generated 1326 derivative records from 36482 primary records. [2025-09-15T21:22:07.864993] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-15T21:22:07.872999] [DEBUG] [LOCAL ] TRC: Derivative data saved (1326 records). [2025-09-15T21:22:07.873110] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-15T21:22:07.875124] [INFO ] [MAIN ] Derivative Progress: 1862/2083 symbols completed. TRC took 1.0s. Estimated remaining: 1m 13s. Rate: 181.3 symbols/min [2025-09-15T21:22:07.878246] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:07.881386] [DEBUG] [LOCAL ] TREX: Derivative data saved (1326 records). [2025-09-15T21:22:07.881595] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-15T21:22:07.883738] [INFO ] [MAIN ] Derivative Progress: 1863/2083 symbols completed. TREX took 1.0s. Estimated remaining: 1m 13s. Rate: 181.4 symbols/min [2025-09-15T21:22:07.884038] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:07.935249] [DEBUG] [LOCAL ] TRN: Loaded 27293 existing records from primary storage. [2025-09-15T21:22:07.944346] [INFO ] [MAIN ] TRN: Loaded 27293 primary data records. [2025-09-15T21:22:07.944202] [DEBUG] [LOCAL ] TRGP: Loaded 37440 existing records from primary storage. [2025-09-15T21:22:07.944534] [INFO ] [MAIN ] TRGP: Loaded 37440 primary data records. [2025-09-15T21:22:08.116501] [DEBUG] [LOCAL ] TRNO: Loaded 32543 existing records from primary storage. [2025-09-15T21:22:08.168132] [INFO ] [MAIN ] TRNO: Loaded 32543 primary data records. [2025-09-15T21:22:08.797610] [DEBUG] [MAIN ] TRGP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:08.807382] [INFO ] [MAIN ] TRGP: Generated 1326 derivative records from 37440 primary records. [2025-09-15T21:22:08.808681] [DEBUG] [MAIN ] TRN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:08.810741] [INFO ] [MAIN ] TRN: Generated 1326 derivative records from 27293 primary records. [2025-09-15T21:22:08.808391] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-15T21:22:08.811061] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-15T21:22:08.836559] [DEBUG] [LOCAL ] TRN: Derivative data saved (1326 records). [2025-09-15T21:22:08.842260] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-15T21:22:08.833634] [DEBUG] [MAIN ] TRNO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:08.848103] [INFO ] [MAIN ] Derivative Progress: 1864/2083 symbols completed. TRN took 1.0s. Estimated remaining: 1m 13s. Rate: 181.2 symbols/min [2025-09-15T21:22:08.849817] [INFO ] [MAIN ] TRNO: Generated 1326 derivative records from 32543 primary records. [2025-09-15T21:22:08.850975] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-15T21:22:08.850608] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:08.869757] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1326 records). [2025-09-15T21:22:08.870212] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-15T21:22:08.870395] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1326 records). [2025-09-15T21:22:08.872675] [INFO ] [MAIN ] Derivative Progress: 1865/2083 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 12s. Rate: 181.3 symbols/min [2025-09-15T21:22:08.872900] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-15T21:22:08.875081] [INFO ] [MAIN ] Derivative Progress: 1866/2083 symbols completed. TRGP took 1.0s. Estimated remaining: 1m 12s. Rate: 181.4 symbols/min [2025-09-15T21:22:08.875271] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:08.875611] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:08.915940] [DEBUG] [LOCAL ] TROX: Loaded 38431 existing records from primary storage. [2025-09-15T21:22:08.916163] [INFO ] [MAIN ] TROX: Loaded 38431 primary data records. [2025-09-15T21:22:09.048801] [DEBUG] [LOCAL ] TRTX: Loaded 26411 existing records from primary storage. [2025-09-15T21:22:09.055724] [INFO ] [MAIN ] TRTX: Loaded 26411 primary data records. [2025-09-15T21:22:09.088981] [DEBUG] [LOCAL ] TRP: Loaded 38418 existing records from primary storage. [2025-09-15T21:22:09.124812] [INFO ] [MAIN ] TRP: Loaded 38418 primary data records. [2025-09-15T21:22:09.822205] [DEBUG] [MAIN ] TROX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:09.824307] [INFO ] [MAIN ] TROX: Generated 1326 derivative records from 38431 primary records. [2025-09-15T21:22:09.824940] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-15T21:22:09.838739] [DEBUG] [LOCAL ] TROX: Derivative data saved (1326 records). [2025-09-15T21:22:09.838860] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-15T21:22:09.840971] [INFO ] [MAIN ] Derivative Progress: 1867/2083 symbols completed. TROX took 1.0s. Estimated remaining: 1m 12s. Rate: 181.2 symbols/min [2025-09-15T21:22:09.841835] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:09.858890] [DEBUG] [MAIN ] TRTX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:09.860608] [INFO ] [MAIN ] TRTX: Generated 1326 derivative records from 26411 primary records. [2025-09-15T21:22:09.860790] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-15T21:22:09.871791] [DEBUG] [MAIN ] TRP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:09.881493] [INFO ] [MAIN ] TRP: Generated 1326 derivative records from 38418 primary records. [2025-09-15T21:22:09.883712] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-15T21:22:09.885112] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1326 records). [2025-09-15T21:22:09.886178] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-15T21:22:09.894062] [INFO ] [MAIN ] Derivative Progress: 1868/2083 symbols completed. TRTX took 1.0s. Estimated remaining: 1m 11s. Rate: 181.3 symbols/min [2025-09-15T21:22:09.906496] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:09.908976] [DEBUG] [LOCAL ] TRP: Derivative data saved (1326 records). [2025-09-15T21:22:09.909625] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-15T21:22:09.912222] [INFO ] [MAIN ] Derivative Progress: 1869/2083 symbols completed. TRP took 1.0s. Estimated remaining: 1m 11s. Rate: 181.4 symbols/min [2025-09-15T21:22:09.912583] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:09.927000] [DEBUG] [LOCAL ] TRU: Loaded 37607 existing records from primary storage. [2025-09-15T21:22:09.927236] [INFO ] [MAIN ] TRU: Loaded 37607 primary data records. [2025-09-15T21:22:10.124551] [DEBUG] [LOCAL ] TSE: Loaded 21128 existing records from primary storage. [2025-09-15T21:22:10.139465] [INFO ] [MAIN ] TSE: Loaded 21128 primary data records. [2025-09-15T21:22:10.225735] [DEBUG] [LOCAL ] TS: Loaded 38067 existing records from primary storage. [2025-09-15T21:22:10.270113] [INFO ] [MAIN ] TS: Loaded 38067 primary data records. [2025-09-15T21:22:10.845986] [DEBUG] [MAIN ] TRU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:10.846751] [INFO ] [MAIN ] TRU: Generated 1326 derivative records from 37607 primary records. [2025-09-15T21:22:10.847161] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-15T21:22:10.864226] [DEBUG] [LOCAL ] TRU: Derivative data saved (1326 records). [2025-09-15T21:22:10.864705] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-15T21:22:10.867349] [INFO ] [MAIN ] Derivative Progress: 1870/2083 symbols completed. TRU took 1.0s. Estimated remaining: 1m 11s. Rate: 181.2 symbols/min [2025-09-15T21:22:10.867837] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:10.886671] [DEBUG] [MAIN ] TSE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:10.889217] [INFO ] [MAIN ] TSE: Generated 1326 derivative records from 21128 primary records. [2025-09-15T21:22:10.889416] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-15T21:22:10.912902] [DEBUG] [LOCAL ] TSI: Loaded 5448 existing records from primary storage. [2025-09-15T21:22:10.914401] [DEBUG] [MAIN ] TS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:10.916448] [INFO ] [MAIN ] TS: Generated 1326 derivative records from 38067 primary records. [2025-09-15T21:22:10.916829] [INFO ] [MAIN ] TSI: Loaded 5448 primary data records. [2025-09-15T21:22:10.916910] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-15T21:22:10.918165] [DEBUG] [LOCAL ] TSE: Derivative data saved (1326 records). [2025-09-15T21:22:10.939304] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-15T21:22:10.999212] [INFO ] [MAIN ] Derivative Progress: 1871/2083 symbols completed. TSE took 1.1s. Estimated remaining: 1m 10s. Rate: 181.3 symbols/min [2025-09-15T21:22:11.032891] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:11.038884] [DEBUG] [LOCAL ] TS: Derivative data saved (1326 records). [2025-09-15T21:22:11.066135] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-15T21:22:11.120744] [INFO ] [MAIN ] Derivative Progress: 1872/2083 symbols completed. TS took 1.2s. Estimated remaining: 1m 10s. Rate: 181.3 symbols/min [2025-09-15T21:22:11.125382] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:11.234385] [DEBUG] [LOCAL ] TSLX: Loaded 25450 existing records from primary storage. [2025-09-15T21:22:11.235216] [INFO ] [MAIN ] TSLX: Loaded 25450 primary data records. [2025-09-15T21:22:11.539237] [DEBUG] [LOCAL ] TSM: Loaded 39779 existing records from primary storage. [2025-09-15T21:22:11.539712] [INFO ] [MAIN ] TSM: Loaded 39779 primary data records. [2025-09-15T21:22:11.584390] [DEBUG] [MAIN ] TSI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:11.592256] [INFO ] [MAIN ] TSI: Generated 1326 derivative records from 5448 primary records. [2025-09-15T21:22:11.592556] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-15T21:22:11.657558] [DEBUG] [LOCAL ] TSI: Derivative data saved (1326 records). [2025-09-15T21:22:11.657678] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-15T21:22:11.676555] [INFO ] [MAIN ] Derivative Progress: 1873/2083 symbols completed. TSI took 0.8s. Estimated remaining: 1m 10s. Rate: 181.3 symbols/min [2025-09-15T21:22:11.858004] [DEBUG] [MAIN ] TSLX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:11.859012] [INFO ] [MAIN ] TSLX: Generated 1326 derivative records from 25450 primary records. [2025-09-15T21:22:11.859369] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-15T21:22:11.874763] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1326 records). [2025-09-15T21:22:11.874902] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-15T21:22:11.877113] [INFO ] [MAIN ] Derivative Progress: 1874/2083 symbols completed. TSLX took 0.9s. Estimated remaining: 1m 9s. Rate: 181.3 symbols/min [2025-09-15T21:22:11.891481] [DEBUG] [MAIN ] TSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:11.892126] [INFO ] [MAIN ] TSM: Generated 1326 derivative records from 39779 primary records. [2025-09-15T21:22:11.892187] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-15T21:22:11.903872] [DEBUG] [LOCAL ] TSM: Derivative data saved (1326 records). [2025-09-15T21:22:11.903928] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-15T21:22:11.905554] [INFO ] [MAIN ] Derivative Progress: 1875/2083 symbols completed. TSM took 0.8s. Estimated remaining: 1m 9s. Rate: 181.4 symbols/min [2025-09-15T21:22:11.906398] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:11.906308] [INFO ] [MAIN ] TTAM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:11.906488] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:11.934671] [DEBUG] [LOCAL ] TTAM: Loaded 20275 existing records from primary storage. [2025-09-15T21:22:11.935020] [INFO ] [MAIN ] TTAM: Loaded 20275 primary data records. [2025-09-15T21:22:12.077088] [DEBUG] [LOCAL ] TTC: Loaded 30907 existing records from primary storage. [2025-09-15T21:22:12.093914] [INFO ] [MAIN ] TTC: Loaded 30907 primary data records. [2025-09-15T21:22:12.128081] [DEBUG] [LOCAL ] TT: Loaded 34651 existing records from primary storage. [2025-09-15T21:22:12.141858] [INFO ] [MAIN ] TT: Loaded 34651 primary data records. [2025-09-15T21:22:12.899731] [DEBUG] [MAIN ] TTAM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:12.900674] [INFO ] [MAIN ] TTAM: Generated 1326 derivative records from 20275 primary records. [2025-09-15T21:22:12.901042] [DEBUG] [LOCAL ] TTAM: Saving derivative data. [2025-09-15T21:22:12.914255] [DEBUG] [LOCAL ] TTAM: Derivative data saved (1326 records). [2025-09-15T21:22:12.914598] [INFO ] [MAIN ] TTAM: Successfully saved derivative data. [2025-09-15T21:22:12.916836] [INFO ] [MAIN ] Derivative Progress: 1876/2083 symbols completed. TTAM took 1.0s. Estimated remaining: 1m 9s. Rate: 181.2 symbols/min [2025-09-15T21:22:12.917124] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:12.940773] [DEBUG] [MAIN ] TT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:12.941139] [DEBUG] [MAIN ] TTC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:12.941991] [INFO ] [MAIN ] TT: Generated 1326 derivative records from 34651 primary records. [2025-09-15T21:22:12.942107] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-15T21:22:12.942582] [INFO ] [MAIN ] TTC: Generated 1326 derivative records from 30907 primary records. [2025-09-15T21:22:12.942759] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-15T21:22:12.966583] [DEBUG] [LOCAL ] TTC: Derivative data saved (1326 records). [2025-09-15T21:22:12.967277] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-15T21:22:12.969669] [INFO ] [MAIN ] Derivative Progress: 1877/2083 symbols completed. TTC took 1.1s. Estimated remaining: 1m 8s. Rate: 181.3 symbols/min [2025-09-15T21:22:12.970342] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:12.980190] [DEBUG] [LOCAL ] TT: Derivative data saved (1326 records). [2025-09-15T21:22:12.980268] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-15T21:22:12.982568] [INFO ] [MAIN ] Derivative Progress: 1878/2083 symbols completed. TT took 1.1s. Estimated remaining: 1m 8s. Rate: 181.4 symbols/min [2025-09-15T21:22:12.982780] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:12.999269] [DEBUG] [LOCAL ] TTE: Loaded 37934 existing records from primary storage. [2025-09-15T21:22:12.999499] [INFO ] [MAIN ] TTE: Loaded 37934 primary data records. [2025-09-15T21:22:13.314777] [DEBUG] [LOCAL ] TTI: Loaded 33622 existing records from primary storage. [2025-09-15T21:22:13.315530] [DEBUG] [LOCAL ] TU: Loaded 36528 existing records from primary storage. [2025-09-15T21:22:13.315877] [INFO ] [MAIN ] TTI: Loaded 33622 primary data records. [2025-09-15T21:22:13.316101] [INFO ] [MAIN ] TU: Loaded 36528 primary data records. [2025-09-15T21:22:13.893291] [DEBUG] [MAIN ] TTE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:13.895148] [INFO ] [MAIN ] TTE: Generated 1326 derivative records from 37934 primary records. [2025-09-15T21:22:13.895746] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-15T21:22:13.913241] [DEBUG] [LOCAL ] TTE: Derivative data saved (1326 records). [2025-09-15T21:22:13.913946] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-15T21:22:13.916152] [INFO ] [MAIN ] Derivative Progress: 1879/2083 symbols completed. TTE took 1.0s. Estimated remaining: 1m 8s. Rate: 181.2 symbols/min [2025-09-15T21:22:13.916347] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:13.939050] [DEBUG] [MAIN ] TU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:13.945332] [DEBUG] [MAIN ] TTI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:13.946556] [INFO ] [MAIN ] TTI: Generated 1326 derivative records from 33622 primary records. [2025-09-15T21:22:13.945458] [INFO ] [MAIN ] TU: Generated 1326 derivative records from 36528 primary records. [2025-09-15T21:22:13.946851] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-15T21:22:13.946770] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-15T21:22:13.971014] [DEBUG] [LOCAL ] TTI: Derivative data saved (1326 records). [2025-09-15T21:22:13.981441] [DEBUG] [LOCAL ] TU: Derivative data saved (1326 records). [2025-09-15T21:22:13.981829] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-15T21:22:13.981564] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-15T21:22:13.984220] [INFO ] [MAIN ] Derivative Progress: 1880/2083 symbols completed. TU took 1.0s. Estimated remaining: 1m 7s. Rate: 181.3 symbols/min [2025-09-15T21:22:13.986383] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:13.986539] [INFO ] [MAIN ] Derivative Progress: 1881/2083 symbols completed. TTI took 1.0s. Estimated remaining: 1m 7s. Rate: 181.4 symbols/min [2025-09-15T21:22:13.987222] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:14.001068] [DEBUG] [LOCAL ] TUYA: Loaded 33962 existing records from primary storage. [2025-09-15T21:22:14.001243] [INFO ] [MAIN ] TUYA: Loaded 33962 primary data records. [2025-09-15T21:22:14.004027] [DEBUG] [LOCAL ] TVC: Loaded 2398 existing records from primary storage. [2025-09-15T21:22:14.036436] [INFO ] [MAIN ] TVC: Loaded 2398 primary data records. [2025-09-15T21:22:14.340938] [DEBUG] [LOCAL ] TV: Loaded 31334 existing records from primary storage. [2025-09-15T21:22:14.477262] [INFO ] [MAIN ] TV: Loaded 31334 primary data records. [2025-09-15T21:22:14.931979] [DEBUG] [MAIN ] TUYA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:14.933401] [INFO ] [MAIN ] TUYA: Generated 1326 derivative records from 33962 primary records. [2025-09-15T21:22:14.933683] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-15T21:22:14.958599] [DEBUG] [MAIN ] TVC: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:22:14.960947] [INFO ] [MAIN ] TVC: Generated 1324 derivative records from 2398 primary records. [2025-09-15T21:22:14.962163] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-15T21:22:14.962087] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1326 records). [2025-09-15T21:22:14.963550] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-15T21:22:14.970959] [INFO ] [MAIN ] Derivative Progress: 1882/2083 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 7s. Rate: 181.2 symbols/min [2025-09-15T21:22:14.974004] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:14.977308] [DEBUG] [LOCAL ] TVC: Derivative data saved (1324 records). [2025-09-15T21:22:14.977530] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-15T21:22:14.979793] [INFO ] [MAIN ] Derivative Progress: 1883/2083 symbols completed. TVC took 1.0s. Estimated remaining: 1m 6s. Rate: 181.3 symbols/min [2025-09-15T21:22:14.980988] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:14.985143] [DEBUG] [LOCAL ] TVE: Loaded 1853 existing records from primary storage. [2025-09-15T21:22:14.985813] [INFO ] [MAIN ] TVE: Loaded 1853 primary data records. [2025-09-15T21:22:15.038753] [DEBUG] [MAIN ] TV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:15.068046] [INFO ] [MAIN ] TV: Generated 1326 derivative records from 31334 primary records. [2025-09-15T21:22:15.090329] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-15T21:22:15.213691] [DEBUG] [LOCAL ] TWI: Loaded 24437 existing records from primary storage. [2025-09-15T21:22:15.210113] [DEBUG] [LOCAL ] TV: Derivative data saved (1326 records). [2025-09-15T21:22:15.213915] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-15T21:22:15.214015] [INFO ] [MAIN ] TWI: Loaded 24437 primary data records. [2025-09-15T21:22:15.216533] [INFO ] [MAIN ] Derivative Progress: 1884/2083 symbols completed. TV took 1.2s. Estimated remaining: 1m 6s. Rate: 181.3 symbols/min [2025-09-15T21:22:15.298842] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:15.598160] [DEBUG] [MAIN ] TVE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:15.599011] [INFO ] [MAIN ] TVE: Generated 1326 derivative records from 1853 primary records. [2025-09-15T21:22:15.599185] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-15T21:22:15.628787] [DEBUG] [LOCAL ] TWLO: Loaded 38952 existing records from primary storage. [2025-09-15T21:22:15.628946] [INFO ] [MAIN ] TWLO: Loaded 38952 primary data records. [2025-09-15T21:22:15.627749] [DEBUG] [LOCAL ] TVE: Derivative data saved (1326 records). [2025-09-15T21:22:15.629243] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-15T21:22:15.653005] [INFO ] [MAIN ] Derivative Progress: 1885/2083 symbols completed. TVE took 0.7s. Estimated remaining: 1m 6s. Rate: 181.3 symbols/min [2025-09-15T21:22:15.689163] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:15.750624] [DEBUG] [MAIN ] TWI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:15.762508] [INFO ] [MAIN ] TWI: Generated 1326 derivative records from 24437 primary records. [2025-09-15T21:22:15.772867] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-15T21:22:15.805468] [DEBUG] [LOCAL ] TWN: Loaded 2052 existing records from primary storage. [2025-09-15T21:22:15.826674] [INFO ] [MAIN ] TWN: Loaded 2052 primary data records. [2025-09-15T21:22:16.017692] [DEBUG] [LOCAL ] TWI: Derivative data saved (1326 records). [2025-09-15T21:22:16.041652] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-15T21:22:16.064880] [INFO ] [MAIN ] Derivative Progress: 1886/2083 symbols completed. TWI took 1.1s. Estimated remaining: 1m 5s. Rate: 181.3 symbols/min [2025-09-15T21:22:16.078553] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:16.249724] [DEBUG] [MAIN ] TWLO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:16.251183] [INFO ] [MAIN ] TWLO: Generated 1326 derivative records from 38952 primary records. [2025-09-15T21:22:16.251580] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-15T21:22:16.274511] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1326 records). [2025-09-15T21:22:16.301501] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-15T21:22:16.303984] [INFO ] [MAIN ] Derivative Progress: 1887/2083 symbols completed. TWLO took 1.0s. Estimated remaining: 1m 5s. Rate: 181.3 symbols/min [2025-09-15T21:22:16.305759] [DEBUG] [LOCAL ] TWO: Loaded 35614 existing records from primary storage. [2025-09-15T21:22:16.306211] [DEBUG] [MAIN ] TWN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:16.306536] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:16.306611] [INFO ] [MAIN ] TWO: Loaded 35614 primary data records. [2025-09-15T21:22:16.308407] [INFO ] [MAIN ] TWN: Generated 1326 derivative records from 2052 primary records. [2025-09-15T21:22:16.320178] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-15T21:22:16.489704] [DEBUG] [LOCAL ] TX: Loaded 16935 existing records from primary storage. [2025-09-15T21:22:16.514698] [DEBUG] [LOCAL ] TWN: Derivative data saved (1326 records). [2025-09-15T21:22:16.520209] [INFO ] [MAIN ] TX: Loaded 16935 primary data records. [2025-09-15T21:22:16.520737] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-15T21:22:16.527728] [INFO ] [MAIN ] Derivative Progress: 1888/2083 symbols completed. TWN took 0.9s. Estimated remaining: 1m 5s. Rate: 181.3 symbols/min [2025-09-15T21:22:17.286020] [DEBUG] [MAIN ] TWO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:17.287447] [INFO ] [MAIN ] TWO: Generated 1326 derivative records from 35614 primary records. [2025-09-15T21:22:17.287563] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-15T21:22:17.303600] [DEBUG] [LOCAL ] TWO: Derivative data saved (1326 records). [2025-09-15T21:22:17.303779] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-15T21:22:17.305778] [INFO ] [MAIN ] Derivative Progress: 1889/2083 symbols completed. TWO took 1.2s. Estimated remaining: 1m 4s. Rate: 181.2 symbols/min [2025-09-15T21:22:17.320602] [DEBUG] [MAIN ] TX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:17.321410] [INFO ] [MAIN ] TX: Generated 1326 derivative records from 16935 primary records. [2025-09-15T21:22:17.321481] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-15T21:22:17.336542] [DEBUG] [LOCAL ] TX: Derivative data saved (1326 records). [2025-09-15T21:22:17.336744] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-15T21:22:17.339307] [INFO ] [MAIN ] Derivative Progress: 1890/2083 symbols completed. TX took 1.0s. Estimated remaining: 1m 4s. Rate: 181.3 symbols/min [2025-09-15T21:22:17.340149] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:17.340288] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:17.341006] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:17.389397] [DEBUG] [LOCAL ] TXO: Loaded 15063 existing records from primary storage. [2025-09-15T21:22:17.389685] [INFO ] [MAIN ] TXO: Loaded 15063 primary data records. [2025-09-15T21:22:17.549714] [DEBUG] [LOCAL ] TXT: Loaded 36537 existing records from primary storage. [2025-09-15T21:22:17.543620] [DEBUG] [LOCAL ] TXNM: Loaded 32065 existing records from primary storage. [2025-09-15T21:22:17.571026] [INFO ] [MAIN ] TXNM: Loaded 32065 primary data records. [2025-09-15T21:22:17.574996] [INFO ] [MAIN ] TXT: Loaded 36537 primary data records. [2025-09-15T21:22:18.354837] [DEBUG] [MAIN ] TXO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:18.356440] [INFO ] [MAIN ] TXO: Generated 1326 derivative records from 15063 primary records. [2025-09-15T21:22:18.356610] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-15T21:22:18.368105] [DEBUG] [MAIN ] TXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:18.368831] [INFO ] [MAIN ] TXT: Generated 1326 derivative records from 36537 primary records. [2025-09-15T21:22:18.375540] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-15T21:22:18.381982] [DEBUG] [LOCAL ] TXO: Derivative data saved (1326 records). [2025-09-15T21:22:18.382507] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-15T21:22:18.384081] [INFO ] [MAIN ] Derivative Progress: 1891/2083 symbols completed. TXO took 1.0s. Estimated remaining: 1m 4s. Rate: 181.1 symbols/min [2025-09-15T21:22:18.389976] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:18.394340] [DEBUG] [MAIN ] TXNM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:18.405301] [INFO ] [MAIN ] TXNM: Generated 1326 derivative records from 32065 primary records. [2025-09-15T21:22:18.406285] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-15T21:22:18.407916] [DEBUG] [LOCAL ] TXT: Derivative data saved (1326 records). [2025-09-15T21:22:18.408267] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-15T21:22:18.410860] [INFO ] [MAIN ] Derivative Progress: 1892/2083 symbols completed. TXT took 1.1s. Estimated remaining: 1m 3s. Rate: 181.2 symbols/min [2025-09-15T21:22:18.419544] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:18.424324] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1326 records). [2025-09-15T21:22:18.424544] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-15T21:22:18.427397] [INFO ] [MAIN ] Derivative Progress: 1893/2083 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 3s. Rate: 181.2 symbols/min [2025-09-15T21:22:18.431111] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:18.430938] [DEBUG] [LOCAL ] TY: Loaded 5431 existing records from primary storage. [2025-09-15T21:22:18.431289] [INFO ] [MAIN ] TY: Loaded 5431 primary data records. [2025-09-15T21:22:18.557346] [DEBUG] [LOCAL ] TYG: Loaded 10317 existing records from primary storage. [2025-09-15T21:22:18.568687] [DEBUG] [LOCAL ] TYL: Loaded 16329 existing records from primary storage. [2025-09-15T21:22:18.597867] [INFO ] [MAIN ] TYG: Loaded 10317 primary data records. [2025-09-15T21:22:18.631822] [INFO ] [MAIN ] TYL: Loaded 16329 primary data records. [2025-09-15T21:22:19.294270] [DEBUG] [MAIN ] TY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:19.295676] [INFO ] [MAIN ] TY: Generated 1326 derivative records from 5431 primary records. [2025-09-15T21:22:19.296105] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-15T21:22:19.309468] [DEBUG] [LOCAL ] TY: Derivative data saved (1326 records). [2025-09-15T21:22:19.310087] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-15T21:22:19.311820] [INFO ] [MAIN ] Derivative Progress: 1894/2083 symbols completed. TY took 0.9s. Estimated remaining: 1m 3s. Rate: 181.1 symbols/min [2025-09-15T21:22:19.312319] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:19.329216] [DEBUG] [MAIN ] TYG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:19.339406] [INFO ] [MAIN ] TYG: Generated 1326 derivative records from 10317 primary records. [2025-09-15T21:22:19.339727] [DEBUG] [MAIN ] TYL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:19.339832] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-15T21:22:19.340687] [INFO ] [MAIN ] TYL: Generated 1326 derivative records from 16329 primary records. [2025-09-15T21:22:19.340785] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-15T21:22:19.353468] [DEBUG] [LOCAL ] TYG: Derivative data saved (1326 records). [2025-09-15T21:22:19.361891] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-15T21:22:19.364918] [INFO ] [MAIN ] Derivative Progress: 1895/2083 symbols completed. TYG took 0.9s. Estimated remaining: 1m 2s. Rate: 181.2 symbols/min [2025-09-15T21:22:19.375779] [DEBUG] [LOCAL ] TYL: Derivative data saved (1326 records). [2025-09-15T21:22:19.376008] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:19.376218] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-15T21:22:19.378481] [INFO ] [MAIN ] Derivative Progress: 1896/2083 symbols completed. TYL took 0.9s. Estimated remaining: 1m 2s. Rate: 181.3 symbols/min [2025-09-15T21:22:19.378867] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:19.395322] [DEBUG] [LOCAL ] U: Loaded 39759 existing records from primary storage. [2025-09-15T21:22:19.395822] [INFO ] [MAIN ] U: Loaded 39759 primary data records. [2025-09-15T21:22:19.560679] [DEBUG] [LOCAL ] UA: Loaded 36851 existing records from primary storage. [2025-09-15T21:22:19.582873] [INFO ] [MAIN ] UA: Loaded 36851 primary data records. [2025-09-15T21:22:19.813976] [DEBUG] [LOCAL ] UAA: Loaded 39487 existing records from primary storage. [2025-09-15T21:22:19.836148] [INFO ] [MAIN ] UAA: Loaded 39487 primary data records. [2025-09-15T21:22:20.293937] [DEBUG] [MAIN ] U: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:20.295722] [INFO ] [MAIN ] U: Generated 1326 derivative records from 39759 primary records. [2025-09-15T21:22:20.296435] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-15T21:22:20.316980] [DEBUG] [MAIN ] UA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:20.319443] [INFO ] [MAIN ] UA: Generated 1326 derivative records from 36851 primary records. [2025-09-15T21:22:20.320661] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-15T21:22:20.320586] [DEBUG] [LOCAL ] U: Derivative data saved (1326 records). [2025-09-15T21:22:20.332755] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-15T21:22:20.336098] [DEBUG] [LOCAL ] UA: Derivative data saved (1326 records). [2025-09-15T21:22:20.335758] [INFO ] [MAIN ] Derivative Progress: 1897/2083 symbols completed. U took 1.0s. Estimated remaining: 1m 2s. Rate: 181.1 symbols/min [2025-09-15T21:22:20.337778] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:20.337028] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-15T21:22:20.339874] [INFO ] [MAIN ] Derivative Progress: 1898/2083 symbols completed. UA took 1.0s. Estimated remaining: 1m 1s. Rate: 181.2 symbols/min [2025-09-15T21:22:20.346045] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:20.350016] [DEBUG] [MAIN ] UAA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:20.350993] [INFO ] [MAIN ] UAA: Generated 1326 derivative records from 39487 primary records. [2025-09-15T21:22:20.351068] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-15T21:22:20.364084] [DEBUG] [LOCAL ] UAN: Loaded 3850 existing records from primary storage. [2025-09-15T21:22:20.366917] [DEBUG] [LOCAL ] UAA: Derivative data saved (1326 records). [2025-09-15T21:22:20.367078] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-15T21:22:20.367000] [INFO ] [MAIN ] UAN: Loaded 3850 primary data records. [2025-09-15T21:22:20.368989] [INFO ] [MAIN ] Derivative Progress: 1899/2083 symbols completed. UAA took 1.0s. Estimated remaining: 1m 1s. Rate: 181.3 symbols/min [2025-09-15T21:22:20.424615] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:20.667053] [DEBUG] [LOCAL ] UBER: Loaded 39766 existing records from primary storage. [2025-09-15T21:22:20.675735] [INFO ] [MAIN ] UBER: Loaded 39766 primary data records. [2025-09-15T21:22:20.805635] [DEBUG] [LOCAL ] UBS: Loaded 38554 existing records from primary storage. [2025-09-15T21:22:20.810273] [INFO ] [MAIN ] UBS: Loaded 38554 primary data records. [2025-09-15T21:22:21.219421] [DEBUG] [MAIN ] UAN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:21.242971] [INFO ] [MAIN ] UAN: Generated 1326 derivative records from 3850 primary records. [2025-09-15T21:22:21.336400] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-15T21:22:21.353389] [DEBUG] [LOCAL ] UAN: Derivative data saved (1326 records). [2025-09-15T21:22:21.353794] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-15T21:22:21.356870] [INFO ] [MAIN ] Derivative Progress: 1900/2083 symbols completed. UAN took 1.0s. Estimated remaining: 1m 1s. Rate: 181.1 symbols/min [2025-09-15T21:22:21.357654] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:21.371307] [DEBUG] [MAIN ] UBER: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:21.372258] [INFO ] [MAIN ] UBER: Generated 1326 derivative records from 39766 primary records. [2025-09-15T21:22:21.372512] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-15T21:22:21.387199] [DEBUG] [LOCAL ] UBER: Derivative data saved (1326 records). [2025-09-15T21:22:21.388149] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-15T21:22:21.391038] [INFO ] [MAIN ] Derivative Progress: 1901/2083 symbols completed. UBER took 1.1s. Estimated remaining: 1m 0s. Rate: 181.2 symbols/min [2025-09-15T21:22:21.392100] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:21.410807] [DEBUG] [MAIN ] UBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:21.411562] [INFO ] [MAIN ] UBS: Generated 1326 derivative records from 38554 primary records. [2025-09-15T21:22:21.411895] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-15T21:22:21.433447] [DEBUG] [LOCAL ] UBS: Derivative data saved (1326 records). [2025-09-15T21:22:21.433616] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-15T21:22:21.435959] [INFO ] [MAIN ] Derivative Progress: 1902/2083 symbols completed. UBS took 1.0s. Estimated remaining: 59.9s. Rate: 181.2 symbols/min [2025-09-15T21:22:21.436281] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:21.436379] [DEBUG] [LOCAL ] UCB: Loaded 27259 existing records from primary storage. [2025-09-15T21:22:21.437299] [INFO ] [MAIN ] UCB: Loaded 27259 primary data records. [2025-09-15T21:22:21.656933] [DEBUG] [LOCAL ] UDR: Loaded 38309 existing records from primary storage. [2025-09-15T21:22:21.748033] [INFO ] [MAIN ] UDR: Loaded 38309 primary data records. [2025-09-15T21:22:21.786282] [DEBUG] [LOCAL ] UE: Loaded 31668 existing records from primary storage. [2025-09-15T21:22:21.799113] [INFO ] [MAIN ] UE: Loaded 31668 primary data records. [2025-09-15T21:22:22.380015] [DEBUG] [MAIN ] UCB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:22.382391] [INFO ] [MAIN ] UCB: Generated 1326 derivative records from 27259 primary records. [2025-09-15T21:22:22.382876] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-15T21:22:22.401362] [DEBUG] [LOCAL ] UCB: Derivative data saved (1326 records). [2025-09-15T21:22:22.401572] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-15T21:22:22.404264] [INFO ] [MAIN ] Derivative Progress: 1903/2083 symbols completed. UCB took 1.0s. Estimated remaining: 59.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:22.418460] [DEBUG] [MAIN ] UDR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:22.419208] [INFO ] [MAIN ] UDR: Generated 1326 derivative records from 38309 primary records. [2025-09-15T21:22:22.419317] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-15T21:22:22.435386] [DEBUG] [MAIN ] UE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:22.439255] [INFO ] [MAIN ] UE: Generated 1326 derivative records from 31668 primary records. [2025-09-15T21:22:22.440600] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-15T21:22:22.442341] [DEBUG] [LOCAL ] UDR: Derivative data saved (1326 records). [2025-09-15T21:22:22.448463] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-15T21:22:22.450169] [INFO ] [MAIN ] Derivative Progress: 1904/2083 symbols completed. UDR took 1.1s. Estimated remaining: 59.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:22.454982] [DEBUG] [LOCAL ] UE: Derivative data saved (1326 records). [2025-09-15T21:22:22.455056] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-15T21:22:22.457926] [INFO ] [MAIN ] Derivative Progress: 1905/2083 symbols completed. UE took 1.0s. Estimated remaining: 58.9s. Rate: 181.2 symbols/min [2025-09-15T21:22:22.458712] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:22.459078] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:22.459868] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:22.469884] [DEBUG] [LOCAL ] UFI: Loaded 5449 existing records from primary storage. [2025-09-15T21:22:22.470105] [INFO ] [MAIN ] UFI: Loaded 5449 primary data records. [2025-09-15T21:22:22.690973] [DEBUG] [LOCAL ] UGP: Loaded 31451 existing records from primary storage. [2025-09-15T21:22:22.691069] [DEBUG] [LOCAL ] UGI: Loaded 37175 existing records from primary storage. [2025-09-15T21:22:22.772417] [INFO ] [MAIN ] UGI: Loaded 37175 primary data records. [2025-09-15T21:22:22.783303] [INFO ] [MAIN ] UGP: Loaded 31451 primary data records. [2025-09-15T21:22:23.333148] [DEBUG] [MAIN ] UFI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:23.334221] [INFO ] [MAIN ] UFI: Generated 1326 derivative records from 5449 primary records. [2025-09-15T21:22:23.335621] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-15T21:22:23.351337] [DEBUG] [LOCAL ] UFI: Derivative data saved (1326 records). [2025-09-15T21:22:23.351831] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-15T21:22:23.356556] [INFO ] [MAIN ] Derivative Progress: 1906/2083 symbols completed. UFI took 0.9s. Estimated remaining: 58.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:23.357272] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:23.370864] [DEBUG] [MAIN ] UGP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:23.377782] [INFO ] [MAIN ] UGP: Generated 1326 derivative records from 31451 primary records. [2025-09-15T21:22:23.381778] [DEBUG] [MAIN ] UGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:23.381845] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-15T21:22:23.386471] [INFO ] [MAIN ] UGI: Generated 1326 derivative records from 37175 primary records. [2025-09-15T21:22:23.386583] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-15T21:22:23.415387] [DEBUG] [LOCAL ] UHAL: Loaded 12188 existing records from primary storage. [2025-09-15T21:22:23.418227] [DEBUG] [LOCAL ] UGI: Derivative data saved (1326 records). [2025-09-15T21:22:23.418093] [DEBUG] [LOCAL ] UGP: Derivative data saved (1326 records). [2025-09-15T21:22:23.418322] [INFO ] [MAIN ] UHAL: Loaded 12188 primary data records. [2025-09-15T21:22:23.418750] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-15T21:22:23.418460] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-15T21:22:23.421311] [INFO ] [MAIN ] Derivative Progress: 1907/2083 symbols completed. UGI took 1.0s. Estimated remaining: 58.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:23.466217] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:23.460293] [INFO ] [MAIN ] Derivative Progress: 1908/2083 symbols completed. UGP took 1.0s. Estimated remaining: 57.9s. Rate: 181.2 symbols/min [2025-09-15T21:22:23.478123] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:23.606958] [DEBUG] [LOCAL ] UHT: Loaded 7121 existing records from primary storage. [2025-09-15T21:22:23.693164] [INFO ] [MAIN ] UHT: Loaded 7121 primary data records. [2025-09-15T21:22:23.835013] [DEBUG] [LOCAL ] UHS: Loaded 29995 existing records from primary storage. [2025-09-15T21:22:23.894664] [INFO ] [MAIN ] UHS: Loaded 29995 primary data records. [2025-09-15T21:22:24.192591] [DEBUG] [MAIN ] UHAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:24.334356] [INFO ] [MAIN ] UHAL: Generated 1326 derivative records from 12188 primary records. [2025-09-15T21:22:24.334612] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-15T21:22:24.349750] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1326 records). [2025-09-15T21:22:24.350194] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-15T21:22:24.351885] [INFO ] [MAIN ] Derivative Progress: 1909/2083 symbols completed. UHAL took 1.0s. Estimated remaining: 57.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:24.352484] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:24.362865] [DEBUG] [MAIN ] UHT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:24.363985] [INFO ] [MAIN ] UHT: Generated 1326 derivative records from 7121 primary records. [2025-09-15T21:22:24.364167] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-15T21:22:24.385597] [DEBUG] [LOCAL ] UHT: Derivative data saved (1326 records). [2025-09-15T21:22:24.385882] [DEBUG] [LOCAL ] UI: Loaded 9436 existing records from primary storage. [2025-09-15T21:22:24.386371] [INFO ] [MAIN ] UI: Loaded 9436 primary data records. [2025-09-15T21:22:24.386467] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-15T21:22:24.388819] [INFO ] [MAIN ] Derivative Progress: 1910/2083 symbols completed. UHT took 0.9s. Estimated remaining: 57.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:24.389540] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:24.503509] [DEBUG] [MAIN ] UHS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:24.524204] [INFO ] [MAIN ] UHS: Generated 1326 derivative records from 29995 primary records. [2025-09-15T21:22:24.529967] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-15T21:22:24.628391] [DEBUG] [LOCAL ] UIS: Loaded 27492 existing records from primary storage. [2025-09-15T21:22:24.711604] [DEBUG] [LOCAL ] UHS: Derivative data saved (1326 records). [2025-09-15T21:22:24.711737] [INFO ] [MAIN ] UIS: Loaded 27492 primary data records. [2025-09-15T21:22:24.718010] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-15T21:22:24.741749] [INFO ] [MAIN ] Derivative Progress: 1911/2083 symbols completed. UHS took 1.3s. Estimated remaining: 57.0s. Rate: 181.1 symbols/min [2025-09-15T21:22:24.765318] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:25.033224] [DEBUG] [MAIN ] UI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:25.034445] [INFO ] [MAIN ] UI: Generated 1326 derivative records from 9436 primary records. [2025-09-15T21:22:25.034860] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-15T21:22:25.058992] [DEBUG] [LOCAL ] UI: Derivative data saved (1326 records). [2025-09-15T21:22:25.060219] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-15T21:22:25.062066] [INFO ] [MAIN ] Derivative Progress: 1912/2083 symbols completed. UI took 0.7s. Estimated remaining: 56.6s. Rate: 181.1 symbols/min [2025-09-15T21:22:25.064875] [DEBUG] [LOCAL ] UL: Loaded 39105 existing records from primary storage. [2025-09-15T21:22:25.063096] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:25.065106] [INFO ] [MAIN ] UL: Loaded 39105 primary data records. [2025-09-15T21:22:25.362292] [DEBUG] [LOCAL ] ULS: Loaded 28897 existing records from primary storage. [2025-09-15T21:22:25.378311] [INFO ] [MAIN ] ULS: Loaded 28897 primary data records. [2025-09-15T21:22:25.385459] [DEBUG] [MAIN ] UIS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:25.425509] [INFO ] [MAIN ] UIS: Generated 1326 derivative records from 27492 primary records. [2025-09-15T21:22:25.455438] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-15T21:22:25.509739] [DEBUG] [LOCAL ] UIS: Derivative data saved (1326 records). [2025-09-15T21:22:25.513570] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-15T21:22:25.521288] [INFO ] [MAIN ] Derivative Progress: 1913/2083 symbols completed. UIS took 1.1s. Estimated remaining: 56.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:25.557447] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:25.699037] [DEBUG] [MAIN ] UL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:25.700151] [INFO ] [MAIN ] UL: Generated 1326 derivative records from 39105 primary records. [2025-09-15T21:22:25.700565] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-15T21:22:25.715712] [DEBUG] [LOCAL ] UL: Derivative data saved (1326 records). [2025-09-15T21:22:25.725180] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-15T21:22:25.727060] [INFO ] [MAIN ] Derivative Progress: 1914/2083 symbols completed. UL took 1.0s. Estimated remaining: 56.0s. Rate: 181.1 symbols/min [2025-09-15T21:22:25.727613] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:25.746301] [DEBUG] [MAIN ] ULS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:25.758742] [INFO ] [MAIN ] ULS: Generated 1326 derivative records from 28897 primary records. [2025-09-15T21:22:25.758864] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-15T21:22:25.760074] [DEBUG] [LOCAL ] UMC: Loaded 38802 existing records from primary storage. [2025-09-15T21:22:25.760749] [INFO ] [MAIN ] UMC: Loaded 38802 primary data records. [2025-09-15T21:22:25.859245] [DEBUG] [LOCAL ] ULS: Derivative data saved (1326 records). [2025-09-15T21:22:25.888716] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-15T21:22:25.900295] [INFO ] [MAIN ] Derivative Progress: 1915/2083 symbols completed. ULS took 0.8s. Estimated remaining: 55.6s. Rate: 181.2 symbols/min [2025-09-15T21:22:25.927184] [DEBUG] [LOCAL ] UMH: Loaded 24105 existing records from primary storage. [2025-09-15T21:22:25.952839] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:25.980230] [INFO ] [MAIN ] UMH: Loaded 24105 primary data records. [2025-09-15T21:22:26.185975] [DEBUG] [LOCAL ] UNF: Loaded 7875 existing records from primary storage. [2025-09-15T21:22:26.207951] [INFO ] [MAIN ] UNF: Loaded 7875 primary data records. [2025-09-15T21:22:26.652419] [DEBUG] [MAIN ] UMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:26.741144] [INFO ] [MAIN ] UMC: Generated 1326 derivative records from 38802 primary records. [2025-09-15T21:22:26.741338] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-15T21:22:26.755843] [DEBUG] [LOCAL ] UMC: Derivative data saved (1326 records). [2025-09-15T21:22:26.757199] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-15T21:22:26.759470] [INFO ] [MAIN ] Derivative Progress: 1916/2083 symbols completed. UMC took 1.2s. Estimated remaining: 55.3s. Rate: 181.0 symbols/min [2025-09-15T21:22:26.759777] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:26.770902] [DEBUG] [MAIN ] UMH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:26.771700] [INFO ] [MAIN ] UMH: Generated 1326 derivative records from 24105 primary records. [2025-09-15T21:22:26.771932] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-15T21:22:26.785051] [DEBUG] [LOCAL ] UMH: Derivative data saved (1326 records). [2025-09-15T21:22:26.785384] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-15T21:22:26.787686] [INFO ] [MAIN ] Derivative Progress: 1917/2083 symbols completed. UMH took 1.1s. Estimated remaining: 55.0s. Rate: 181.1 symbols/min [2025-09-15T21:22:26.787911] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:26.809165] [DEBUG] [MAIN ] UNF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:26.809961] [INFO ] [MAIN ] UNF: Generated 1326 derivative records from 7875 primary records. [2025-09-15T21:22:26.810156] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-15T21:22:26.822474] [DEBUG] [LOCAL ] UNF: Derivative data saved (1326 records). [2025-09-15T21:22:26.823062] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-15T21:22:26.825211] [INFO ] [MAIN ] Derivative Progress: 1918/2083 symbols completed. UNF took 0.9s. Estimated remaining: 54.6s. Rate: 181.2 symbols/min [2025-09-15T21:22:26.835576] [DEBUG] [LOCAL ] UNFI: Loaded 31136 existing records from primary storage. [2025-09-15T21:22:26.835704] [INFO ] [MAIN ] UNFI: Loaded 31136 primary data records. [2025-09-15T21:22:27.046007] [DEBUG] [LOCAL ] UNH: Loaded 39779 existing records from primary storage. [2025-09-15T21:22:27.132331] [INFO ] [MAIN ] UNH: Loaded 39779 primary data records. [2025-09-15T21:22:27.438141] [DEBUG] [MAIN ] UNFI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:27.439240] [INFO ] [MAIN ] UNFI: Generated 1326 derivative records from 31136 primary records. [2025-09-15T21:22:27.439312] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-15T21:22:27.452440] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1326 records). [2025-09-15T21:22:27.452521] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-15T21:22:27.454262] [INFO ] [MAIN ] Derivative Progress: 1919/2083 symbols completed. UNFI took 0.7s. Estimated remaining: 54.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:27.466772] [DEBUG] [MAIN ] UNH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:27.467291] [INFO ] [MAIN ] UNH: Generated 1326 derivative records from 39779 primary records. [2025-09-15T21:22:27.467351] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-15T21:22:27.478796] [DEBUG] [LOCAL ] UNH: Derivative data saved (1326 records). [2025-09-15T21:22:27.478853] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-15T21:22:27.481118] [INFO ] [MAIN ] Derivative Progress: 1920/2083 symbols completed. UNH took 0.7s. Estimated remaining: 54.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:27.481536] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:27.481757] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:27.481680] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:27.491000] [DEBUG] [LOCAL ] UNMA: Loaded 2590 existing records from primary storage. [2025-09-15T21:22:27.491204] [INFO ] [MAIN ] UNMA: Loaded 2590 primary data records. [2025-09-15T21:22:27.798280] [DEBUG] [LOCAL ] UP: Loaded 31666 existing records from primary storage. [2025-09-15T21:22:27.798567] [INFO ] [MAIN ] UP: Loaded 31666 primary data records. [2025-09-15T21:22:27.799152] [DEBUG] [LOCAL ] UNM: Loaded 35596 existing records from primary storage. [2025-09-15T21:22:27.799326] [INFO ] [MAIN ] UNM: Loaded 35596 primary data records. [2025-09-15T21:22:28.391242] [DEBUG] [MAIN ] UNMA: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:22:28.392610] [INFO ] [MAIN ] UNMA: Generated 1325 derivative records from 2590 primary records. [2025-09-15T21:22:28.393042] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-15T21:22:28.408295] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1325 records). [2025-09-15T21:22:28.408508] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-15T21:22:28.410698] [INFO ] [MAIN ] Derivative Progress: 1921/2083 symbols completed. UNMA took 0.9s. Estimated remaining: 53.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:28.411285] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:28.437886] [DEBUG] [MAIN ] UNM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:28.438939] [INFO ] [MAIN ] UNM: Generated 1326 derivative records from 35596 primary records. [2025-09-15T21:22:28.438253] [DEBUG] [MAIN ] UP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:28.439049] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-15T21:22:28.439836] [INFO ] [MAIN ] UP: Generated 1326 derivative records from 31666 primary records. [2025-09-15T21:22:28.440813] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-15T21:22:28.470096] [DEBUG] [LOCAL ] UP: Derivative data saved (1326 records). [2025-09-15T21:22:28.471229] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-15T21:22:28.474924] [INFO ] [MAIN ] Derivative Progress: 1922/2083 symbols completed. UP took 1.0s. Estimated remaining: 53.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:28.476436] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:28.476900] [DEBUG] [LOCAL ] UNM: Derivative data saved (1326 records). [2025-09-15T21:22:28.477324] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-15T21:22:28.488228] [INFO ] [MAIN ] Derivative Progress: 1923/2083 symbols completed. UNM took 1.0s. Estimated remaining: 53.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:28.489673] [DEBUG] [LOCAL ] URI: Loaded 25723 existing records from primary storage. [2025-09-15T21:22:28.489841] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:28.490054] [INFO ] [MAIN ] URI: Loaded 25723 primary data records. [2025-09-15T21:22:28.702128] [DEBUG] [LOCAL ] USAC: Loaded 15589 existing records from primary storage. [2025-09-15T21:22:28.706243] [DEBUG] [LOCAL ] USA: Loaded 25825 existing records from primary storage. [2025-09-15T21:22:28.706588] [INFO ] [MAIN ] USA: Loaded 25825 primary data records. [2025-09-15T21:22:28.706891] [INFO ] [MAIN ] USAC: Loaded 15589 primary data records. [2025-09-15T21:22:29.411843] [DEBUG] [MAIN ] URI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:29.413563] [INFO ] [MAIN ] URI: Generated 1326 derivative records from 25723 primary records. [2025-09-15T21:22:29.413901] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-15T21:22:29.432929] [DEBUG] [LOCAL ] URI: Derivative data saved (1326 records). [2025-09-15T21:22:29.433067] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-15T21:22:29.434775] [INFO ] [MAIN ] Derivative Progress: 1924/2083 symbols completed. URI took 1.0s. Estimated remaining: 52.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:29.435328] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:29.452137] [DEBUG] [MAIN ] USA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:29.463410] [INFO ] [MAIN ] USA: Generated 1326 derivative records from 25825 primary records. [2025-09-15T21:22:29.463721] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-15T21:22:29.464619] [DEBUG] [MAIN ] USAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:29.471497] [INFO ] [MAIN ] USAC: Generated 1326 derivative records from 15589 primary records. [2025-09-15T21:22:29.472691] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-15T21:22:29.485555] [DEBUG] [LOCAL ] USA: Derivative data saved (1326 records). [2025-09-15T21:22:29.488670] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-15T21:22:29.491284] [INFO ] [MAIN ] Derivative Progress: 1925/2083 symbols completed. USA took 1.0s. Estimated remaining: 52.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:29.492789] [DEBUG] [LOCAL ] USAC: Derivative data saved (1326 records). [2025-09-15T21:22:29.501697] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-15T21:22:29.501635] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:29.503715] [INFO ] [MAIN ] Derivative Progress: 1926/2083 symbols completed. USAC took 1.0s. Estimated remaining: 52.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:29.504163] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:29.520562] [DEBUG] [LOCAL ] USFD: Loaded 37822 existing records from primary storage. [2025-09-15T21:22:29.523617] [INFO ] [MAIN ] USFD: Loaded 37822 primary data records. [2025-09-15T21:22:29.629470] [DEBUG] [LOCAL ] USPH: Loaded 12417 existing records from primary storage. [2025-09-15T21:22:29.637604] [DEBUG] [LOCAL ] USNA: Loaded 12749 existing records from primary storage. [2025-09-15T21:22:29.641064] [INFO ] [MAIN ] USNA: Loaded 12749 primary data records. [2025-09-15T21:22:29.641136] [INFO ] [MAIN ] USPH: Loaded 12417 primary data records. [2025-09-15T21:22:30.379486] [DEBUG] [MAIN ] USFD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:30.381159] [INFO ] [MAIN ] USFD: Generated 1326 derivative records from 37822 primary records. [2025-09-15T21:22:30.381334] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-15T21:22:30.403732] [DEBUG] [LOCAL ] USFD: Derivative data saved (1326 records). [2025-09-15T21:22:30.403946] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-15T21:22:30.403293] [DEBUG] [MAIN ] USPH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:30.407163] [INFO ] [MAIN ] Derivative Progress: 1927/2083 symbols completed. USFD took 1.0s. Estimated remaining: 51.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:30.408023] [INFO ] [MAIN ] USPH: Generated 1326 derivative records from 12417 primary records. [2025-09-15T21:22:30.409607] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-15T21:22:30.409076] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:30.431912] [DEBUG] [LOCAL ] USPH: Derivative data saved (1326 records). [2025-09-15T21:22:30.432341] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-15T21:22:30.432203] [DEBUG] [MAIN ] USNA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:30.434619] [INFO ] [MAIN ] Derivative Progress: 1928/2083 symbols completed. USPH took 0.9s. Estimated remaining: 51.3s. Rate: 181.1 symbols/min [2025-09-15T21:22:30.435262] [INFO ] [MAIN ] USNA: Generated 1326 derivative records from 12749 primary records. [2025-09-15T21:22:30.435466] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-15T21:22:30.435727] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:30.453790] [DEBUG] [LOCAL ] USNA: Derivative data saved (1326 records). [2025-09-15T21:22:30.453862] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-15T21:22:30.455880] [INFO ] [MAIN ] Derivative Progress: 1929/2083 symbols completed. USNA took 1.0s. Estimated remaining: 51.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:30.456074] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:30.465379] [DEBUG] [LOCAL ] UTF: Loaded 19793 existing records from primary storage. [2025-09-15T21:22:30.465553] [INFO ] [MAIN ] UTF: Loaded 19793 primary data records. [2025-09-15T21:22:30.545003] [DEBUG] [LOCAL ] UTL: Loaded 8429 existing records from primary storage. [2025-09-15T21:22:30.562395] [INFO ] [MAIN ] UTL: Loaded 8429 primary data records. [2025-09-15T21:22:30.758087] [DEBUG] [LOCAL ] UTI: Loaded 29753 existing records from primary storage. [2025-09-15T21:22:30.789251] [INFO ] [MAIN ] UTI: Loaded 29753 primary data records. [2025-09-15T21:22:31.400182] [DEBUG] [MAIN ] UTF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:31.401299] [INFO ] [MAIN ] UTF: Generated 1326 derivative records from 19793 primary records. [2025-09-15T21:22:31.401487] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-15T21:22:31.425798] [DEBUG] [MAIN ] UTL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:31.428402] [INFO ] [MAIN ] UTL: Generated 1326 derivative records from 8429 primary records. [2025-09-15T21:22:31.427587] [DEBUG] [LOCAL ] UTF: Derivative data saved (1326 records). [2025-09-15T21:22:31.428657] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-15T21:22:31.428724] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-15T21:22:31.430687] [INFO ] [MAIN ] Derivative Progress: 1930/2083 symbols completed. UTF took 1.0s. Estimated remaining: 50.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:31.431448] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:31.448412] [DEBUG] [LOCAL ] UTL: Derivative data saved (1326 records). [2025-09-15T21:22:31.448722] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-15T21:22:31.451304] [INFO ] [MAIN ] Derivative Progress: 1931/2083 symbols completed. UTL took 1.0s. Estimated remaining: 50.4s. Rate: 181.1 symbols/min [2025-09-15T21:22:31.451594] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:31.462262] [DEBUG] [MAIN ] UTI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:31.462954] [INFO ] [MAIN ] UTI: Generated 1326 derivative records from 29753 primary records. [2025-09-15T21:22:31.463018] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-15T21:22:31.477664] [DEBUG] [LOCAL ] UTI: Derivative data saved (1326 records). [2025-09-15T21:22:31.477859] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-15T21:22:31.480249] [INFO ] [MAIN ] Derivative Progress: 1932/2083 symbols completed. UTI took 1.0s. Estimated remaining: 50.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:31.480679] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:31.503040] [DEBUG] [LOCAL ] UVE: Loaded 16792 existing records from primary storage. [2025-09-15T21:22:31.503204] [INFO ] [MAIN ] UVE: Loaded 16792 primary data records. [2025-09-15T21:22:31.632140] [DEBUG] [LOCAL ] UVV: Loaded 17329 existing records from primary storage. [2025-09-15T21:22:31.633462] [DEBUG] [LOCAL ] UTZ: Loaded 32830 existing records from primary storage. [2025-09-15T21:22:31.639439] [INFO ] [MAIN ] UVV: Loaded 17329 primary data records. [2025-09-15T21:22:31.639525] [INFO ] [MAIN ] UTZ: Loaded 32830 primary data records. [2025-09-15T21:22:32.362384] [DEBUG] [MAIN ] UVE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:32.363453] [INFO ] [MAIN ] UVE: Generated 1326 derivative records from 16792 primary records. [2025-09-15T21:22:32.363924] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-15T21:22:32.391008] [DEBUG] [MAIN ] UVV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:32.391118] [DEBUG] [LOCAL ] UVE: Derivative data saved (1326 records). [2025-09-15T21:22:32.396928] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-15T21:22:32.397527] [INFO ] [MAIN ] UVV: Generated 1326 derivative records from 17329 primary records. [2025-09-15T21:22:32.402910] [INFO ] [MAIN ] Derivative Progress: 1933/2083 symbols completed. UVE took 1.0s. Estimated remaining: 49.7s. Rate: 181.0 symbols/min [2025-09-15T21:22:32.401154] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-15T21:22:32.403415] [DEBUG] [MAIN ] UTZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:32.404631] [INFO ] [MAIN ] UTZ: Generated 1326 derivative records from 32830 primary records. [2025-09-15T21:22:32.404716] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-15T21:22:32.428628] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1326 records). [2025-09-15T21:22:32.429110] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-15T21:22:32.431355] [INFO ] [MAIN ] Derivative Progress: 1934/2083 symbols completed. UTZ took 1.0s. Estimated remaining: 49.4s. Rate: 181.1 symbols/min [2025-09-15T21:22:32.431771] [DEBUG] [LOCAL ] UVV: Derivative data saved (1326 records). [2025-09-15T21:22:32.431836] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-15T21:22:32.433714] [INFO ] [MAIN ] Derivative Progress: 1935/2083 symbols completed. UVV took 1.0s. Estimated remaining: 49.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:32.434345] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:32.434200] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:32.434291] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:32.446111] [DEBUG] [LOCAL ] UZF: Loaded 4671 existing records from primary storage. [2025-09-15T21:22:32.448905] [DEBUG] [LOCAL ] UZD: Loaded 4690 existing records from primary storage. [2025-09-15T21:22:32.448973] [INFO ] [MAIN ] UZF: Loaded 4671 primary data records. [2025-09-15T21:22:32.449191] [INFO ] [MAIN ] UZD: Loaded 4690 primary data records. [2025-09-15T21:22:32.472949] [DEBUG] [LOCAL ] UZE: Loaded 5598 existing records from primary storage. [2025-09-15T21:22:32.508380] [INFO ] [MAIN ] UZE: Loaded 5598 primary data records. [2025-09-15T21:22:33.264158] [DEBUG] [MAIN ] UZF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:33.266083] [INFO ] [MAIN ] UZF: Generated 1326 derivative records from 4671 primary records. [2025-09-15T21:22:33.266210] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-15T21:22:33.284707] [DEBUG] [MAIN ] UZE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:33.295002] [INFO ] [MAIN ] UZE: Generated 1326 derivative records from 5598 primary records. [2025-09-15T21:22:33.297351] [DEBUG] [LOCAL ] UZF: Derivative data saved (1326 records). [2025-09-15T21:22:33.297312] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-15T21:22:33.295983] [DEBUG] [MAIN ] UZD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:33.298005] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-15T21:22:33.306479] [INFO ] [MAIN ] Derivative Progress: 1936/2083 symbols completed. UZF took 0.9s. Estimated remaining: 48.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:33.304447] [INFO ] [MAIN ] UZD: Generated 1326 derivative records from 4690 primary records. [2025-09-15T21:22:33.306608] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-15T21:22:33.309959] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:33.312284] [DEBUG] [LOCAL ] UZE: Derivative data saved (1326 records). [2025-09-15T21:22:33.318319] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-15T21:22:33.322811] [INFO ] [MAIN ] Derivative Progress: 1937/2083 symbols completed. UZE took 0.9s. Estimated remaining: 48.4s. Rate: 181.1 symbols/min [2025-09-15T21:22:33.323758] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:33.326730] [DEBUG] [LOCAL ] UZD: Derivative data saved (1326 records). [2025-09-15T21:22:33.326807] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-15T21:22:33.328710] [INFO ] [MAIN ] Derivative Progress: 1938/2083 symbols completed. UZD took 0.9s. Estimated remaining: 48.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:33.328897] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:33.366790] [DEBUG] [LOCAL ] VAC: Loaded 25141 existing records from primary storage. [2025-09-15T21:22:33.374876] [INFO ] [MAIN ] VAC: Loaded 25141 primary data records. [2025-09-15T21:22:33.505476] [DEBUG] [LOCAL ] VAL: Loaded 37087 existing records from primary storage. [2025-09-15T21:22:33.511829] [DEBUG] [LOCAL ] V: Loaded 39724 existing records from primary storage. [2025-09-15T21:22:33.511907] [INFO ] [MAIN ] VAL: Loaded 37087 primary data records. [2025-09-15T21:22:33.517209] [INFO ] [MAIN ] V: Loaded 39724 primary data records. [2025-09-15T21:22:34.249738] [DEBUG] [MAIN ] VAC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:34.251145] [INFO ] [MAIN ] VAC: Generated 1326 derivative records from 25141 primary records. [2025-09-15T21:22:34.251399] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-15T21:22:34.267488] [DEBUG] [MAIN ] V: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:34.271050] [INFO ] [MAIN ] V: Generated 1326 derivative records from 39724 primary records. [2025-09-15T21:22:34.274677] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-15T21:22:34.275865] [DEBUG] [LOCAL ] VAC: Derivative data saved (1326 records). [2025-09-15T21:22:34.276762] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-15T21:22:34.278356] [INFO ] [MAIN ] Derivative Progress: 1939/2083 symbols completed. VAC took 1.0s. Estimated remaining: 47.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:34.279097] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:34.299212] [DEBUG] [MAIN ] VAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:34.302187] [DEBUG] [LOCAL ] V: Derivative data saved (1326 records). [2025-09-15T21:22:34.302316] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-15T21:22:34.303046] [INFO ] [MAIN ] VAL: Generated 1326 derivative records from 37087 primary records. [2025-09-15T21:22:34.306271] [INFO ] [MAIN ] Derivative Progress: 1940/2083 symbols completed. V took 1.0s. Estimated remaining: 47.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:34.306620] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:34.306776] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-15T21:22:34.323860] [DEBUG] [LOCAL ] VATE: Loaded 3662 existing records from primary storage. [2025-09-15T21:22:34.324601] [INFO ] [MAIN ] VATE: Loaded 3662 primary data records. [2025-09-15T21:22:34.338260] [DEBUG] [LOCAL ] VAL: Derivative data saved (1326 records). [2025-09-15T21:22:34.348760] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-15T21:22:34.374380] [INFO ] [MAIN ] Derivative Progress: 1941/2083 symbols completed. VAL took 1.0s. Estimated remaining: 47.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:34.448363] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:34.546455] [DEBUG] [LOCAL ] VALE: Loaded 39655 existing records from primary storage. [2025-09-15T21:22:34.546722] [DEBUG] [LOCAL ] VBF: Loaded 5005 existing records from primary storage. [2025-09-15T21:22:34.546860] [INFO ] [MAIN ] VBF: Loaded 5005 primary data records. [2025-09-15T21:22:34.620460] [INFO ] [MAIN ] VALE: Loaded 39655 primary data records. [2025-09-15T21:22:35.196458] [DEBUG] [MAIN ] VATE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:35.197870] [INFO ] [MAIN ] VATE: Generated 1326 derivative records from 3662 primary records. [2025-09-15T21:22:35.198044] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-15T21:22:35.210437] [DEBUG] [LOCAL ] VATE: Derivative data saved (1326 records). [2025-09-15T21:22:35.210625] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-15T21:22:35.212221] [INFO ] [MAIN ] Derivative Progress: 1942/2083 symbols completed. VATE took 0.9s. Estimated remaining: 46.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:35.212470] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:35.228514] [DEBUG] [MAIN ] VBF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:35.231727] [INFO ] [MAIN ] VBF: Generated 1326 derivative records from 5005 primary records. [2025-09-15T21:22:35.232438] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-15T21:22:35.257022] [DEBUG] [MAIN ] VALE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:35.259077] [INFO ] [MAIN ] VALE: Generated 1326 derivative records from 39655 primary records. [2025-09-15T21:22:35.258140] [DEBUG] [LOCAL ] VCV: Loaded 10167 existing records from primary storage. [2025-09-15T21:22:35.259529] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-15T21:22:35.259673] [DEBUG] [LOCAL ] VBF: Derivative data saved (1326 records). [2025-09-15T21:22:35.260300] [INFO ] [MAIN ] VCV: Loaded 10167 primary data records. [2025-09-15T21:22:35.260233] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-15T21:22:35.262784] [INFO ] [MAIN ] Derivative Progress: 1943/2083 symbols completed. VBF took 0.8s. Estimated remaining: 46.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:35.273919] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:35.383815] [DEBUG] [LOCAL ] VALE: Derivative data saved (1326 records). [2025-09-15T21:22:35.384015] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-15T21:22:35.386146] [INFO ] [MAIN ] Derivative Progress: 1944/2083 symbols completed. VALE took 1.1s. Estimated remaining: 46.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:35.392395] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:35.570991] [DEBUG] [LOCAL ] VEL: Loaded 8877 existing records from primary storage. [2025-09-15T21:22:35.571123] [INFO ] [MAIN ] VEL: Loaded 8877 primary data records. [2025-09-15T21:22:35.694436] [DEBUG] [LOCAL ] VEEV: Loaded 34937 existing records from primary storage. [2025-09-15T21:22:35.736628] [INFO ] [MAIN ] VEEV: Loaded 34937 primary data records. [2025-09-15T21:22:36.172956] [DEBUG] [MAIN ] VCV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:36.174405] [INFO ] [MAIN ] VCV: Generated 1326 derivative records from 10167 primary records. [2025-09-15T21:22:36.174859] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-15T21:22:36.189888] [DEBUG] [LOCAL ] VCV: Derivative data saved (1326 records). [2025-09-15T21:22:36.190286] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-15T21:22:36.192108] [INFO ] [MAIN ] Derivative Progress: 1945/2083 symbols completed. VCV took 1.0s. Estimated remaining: 45.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:36.192545] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:36.207514] [DEBUG] [MAIN ] VEL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:36.209277] [INFO ] [MAIN ] VEL: Generated 1326 derivative records from 8877 primary records. [2025-09-15T21:22:36.210159] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-15T21:22:36.227448] [DEBUG] [MAIN ] VEEV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:36.228142] [INFO ] [MAIN ] VEEV: Generated 1326 derivative records from 34937 primary records. [2025-09-15T21:22:36.231701] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-15T21:22:36.248971] [DEBUG] [LOCAL ] VEL: Derivative data saved (1326 records). [2025-09-15T21:22:36.249765] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-15T21:22:36.254457] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1326 records). [2025-09-15T21:22:36.256620] [INFO ] [MAIN ] Derivative Progress: 1946/2083 symbols completed. VEL took 0.9s. Estimated remaining: 45.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:36.257108] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:36.256994] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-15T21:22:36.260797] [INFO ] [MAIN ] Derivative Progress: 1947/2083 symbols completed. VEEV took 1.0s. Estimated remaining: 45.0s. Rate: 181.3 symbols/min [2025-09-15T21:22:36.261855] [INFO ] [MAIN ] VG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:36.273504] [DEBUG] [LOCAL ] VET: Loaded 32083 existing records from primary storage. [2025-09-15T21:22:36.273802] [INFO ] [MAIN ] VET: Loaded 32083 primary data records. [2025-09-15T21:22:36.586338] [DEBUG] [LOCAL ] VFC: Loaded 39580 existing records from primary storage. [2025-09-15T21:22:36.597390] [INFO ] [MAIN ] VFC: Loaded 39580 primary data records. [2025-09-15T21:22:36.598182] [DEBUG] [LOCAL ] VG: Loaded 39436 existing records from primary storage. [2025-09-15T21:22:36.603887] [INFO ] [MAIN ] VG: Loaded 39436 primary data records. [2025-09-15T21:22:37.180911] [DEBUG] [MAIN ] VET: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:37.183617] [INFO ] [MAIN ] VET: Generated 1326 derivative records from 32083 primary records. [2025-09-15T21:22:37.184022] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-15T21:22:37.206106] [DEBUG] [LOCAL ] VET: Derivative data saved (1326 records). [2025-09-15T21:22:37.206822] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-15T21:22:37.211696] [INFO ] [MAIN ] Derivative Progress: 1948/2083 symbols completed. VET took 1.0s. Estimated remaining: 44.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:37.231956] [DEBUG] [MAIN ] VFC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:37.233465] [INFO ] [MAIN ] VFC: Generated 1326 derivative records from 39580 primary records. [2025-09-15T21:22:37.233743] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-15T21:22:37.269577] [DEBUG] [MAIN ] VG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:37.270732] [DEBUG] [LOCAL ] VFC: Derivative data saved (1326 records). [2025-09-15T21:22:37.270899] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-15T21:22:37.271905] [INFO ] [MAIN ] VG: Generated 1326 derivative records from 39436 primary records. [2025-09-15T21:22:37.273958] [INFO ] [MAIN ] Derivative Progress: 1949/2083 symbols completed. VFC took 1.0s. Estimated remaining: 44.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:37.274136] [DEBUG] [LOCAL ] VG: Saving derivative data. [2025-09-15T21:22:37.292022] [DEBUG] [LOCAL ] VG: Derivative data saved (1326 records). [2025-09-15T21:22:37.292080] [INFO ] [MAIN ] VG: Successfully saved derivative data. [2025-09-15T21:22:37.294951] [INFO ] [MAIN ] Derivative Progress: 1950/2083 symbols completed. VG took 1.0s. Estimated remaining: 44.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:37.295480] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:37.295577] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:37.295362] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:37.301996] [DEBUG] [LOCAL ] VHI: Loaded 1997 existing records from primary storage. [2025-09-15T21:22:37.302136] [INFO ] [MAIN ] VHI: Loaded 1997 primary data records. [2025-09-15T21:22:37.371180] [DEBUG] [LOCAL ] VGI: Loaded 3870 existing records from primary storage. [2025-09-15T21:22:37.398345] [INFO ] [MAIN ] VGI: Loaded 3870 primary data records. [2025-09-15T21:22:37.431737] [DEBUG] [LOCAL ] VGM: Loaded 14302 existing records from primary storage. [2025-09-15T21:22:37.438349] [INFO ] [MAIN ] VGM: Loaded 14302 primary data records. [2025-09-15T21:22:38.200205] [DEBUG] [MAIN ] VHI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:38.201899] [INFO ] [MAIN ] VHI: Generated 1326 derivative records from 1997 primary records. [2025-09-15T21:22:38.203545] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-15T21:22:38.215963] [DEBUG] [MAIN ] VGM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:38.217736] [INFO ] [MAIN ] VGM: Generated 1326 derivative records from 14302 primary records. [2025-09-15T21:22:38.218325] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-15T21:22:38.238621] [DEBUG] [MAIN ] VGI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:38.240174] [INFO ] [MAIN ] VGI: Generated 1326 derivative records from 3870 primary records. [2025-09-15T21:22:38.240555] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-15T21:22:38.240865] [DEBUG] [LOCAL ] VHI: Derivative data saved (1326 records). [2025-09-15T21:22:38.250984] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-15T21:22:38.252750] [INFO ] [MAIN ] Derivative Progress: 1951/2083 symbols completed. VHI took 1.0s. Estimated remaining: 43.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:38.253180] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:38.265684] [DEBUG] [LOCAL ] VGM: Derivative data saved (1326 records). [2025-09-15T21:22:38.266235] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-15T21:22:38.268692] [INFO ] [MAIN ] Derivative Progress: 1952/2083 symbols completed. VGM took 1.0s. Estimated remaining: 43.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:38.269988] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:38.270785] [DEBUG] [LOCAL ] VGI: Derivative data saved (1326 records). [2025-09-15T21:22:38.270858] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-15T21:22:38.273209] [INFO ] [MAIN ] Derivative Progress: 1953/2083 symbols completed. VGI took 1.0s. Estimated remaining: 43.0s. Rate: 181.2 symbols/min [2025-09-15T21:22:38.273429] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:38.323817] [DEBUG] [LOCAL ] VIK: Loaded 38758 existing records from primary storage. [2025-09-15T21:22:38.324031] [INFO ] [MAIN ] VIK: Loaded 38758 primary data records. [2025-09-15T21:22:38.428009] [DEBUG] [LOCAL ] VIRT: Loaded 34304 existing records from primary storage. [2025-09-15T21:22:38.449501] [INFO ] [MAIN ] VIRT: Loaded 34304 primary data records. [2025-09-15T21:22:38.470569] [DEBUG] [LOCAL ] VIPS: Loaded 37673 existing records from primary storage. [2025-09-15T21:22:38.511824] [INFO ] [MAIN ] VIPS: Loaded 37673 primary data records. [2025-09-15T21:22:39.168547] [DEBUG] [MAIN ] VIK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:39.169300] [INFO ] [MAIN ] VIK: Generated 1326 derivative records from 38758 primary records. [2025-09-15T21:22:39.169675] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-15T21:22:39.183569] [DEBUG] [LOCAL ] VIK: Derivative data saved (1326 records). [2025-09-15T21:22:39.183827] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-15T21:22:39.185381] [INFO ] [MAIN ] Derivative Progress: 1954/2083 symbols completed. VIK took 0.9s. Estimated remaining: 42.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:39.185721] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:39.196326] [DEBUG] [MAIN ] VIRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:39.198539] [INFO ] [MAIN ] VIRT: Generated 1326 derivative records from 34304 primary records. [2025-09-15T21:22:39.199294] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-15T21:22:39.215777] [DEBUG] [MAIN ] VIPS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:39.219378] [INFO ] [MAIN ] VIPS: Generated 1326 derivative records from 37673 primary records. [2025-09-15T21:22:39.220207] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-15T21:22:39.222115] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1326 records). [2025-09-15T21:22:39.228400] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-15T21:22:39.230536] [INFO ] [MAIN ] Derivative Progress: 1955/2083 symbols completed. VIRT took 1.0s. Estimated remaining: 42.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:39.235180] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:39.236951] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1326 records). [2025-09-15T21:22:39.237309] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-15T21:22:39.239273] [INFO ] [MAIN ] Derivative Progress: 1956/2083 symbols completed. VIPS took 1.0s. Estimated remaining: 42.0s. Rate: 181.3 symbols/min [2025-09-15T21:22:39.247564] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:39.262251] [DEBUG] [LOCAL ] VIST: Loaded 33693 existing records from primary storage. [2025-09-15T21:22:39.262436] [INFO ] [MAIN ] VIST: Loaded 33693 primary data records. [2025-09-15T21:22:39.384554] [DEBUG] [LOCAL ] VKQ: Loaded 13311 existing records from primary storage. [2025-09-15T21:22:39.400174] [INFO ] [MAIN ] VKQ: Loaded 13311 primary data records. [2025-09-15T21:22:39.521743] [DEBUG] [LOCAL ] VIV: Loaded 33492 existing records from primary storage. [2025-09-15T21:22:39.630197] [INFO ] [MAIN ] VIV: Loaded 33492 primary data records. [2025-09-15T21:22:40.121667] [DEBUG] [MAIN ] VIST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:40.122373] [INFO ] [MAIN ] VIST: Generated 1326 derivative records from 33693 primary records. [2025-09-15T21:22:40.122584] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-15T21:22:40.146272] [DEBUG] [MAIN ] VKQ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:40.148224] [INFO ] [MAIN ] VKQ: Generated 1326 derivative records from 13311 primary records. [2025-09-15T21:22:40.148381] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-15T21:22:40.149373] [DEBUG] [LOCAL ] VIST: Derivative data saved (1326 records). [2025-09-15T21:22:40.155328] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-15T21:22:40.157207] [INFO ] [MAIN ] Derivative Progress: 1957/2083 symbols completed. VIST took 1.0s. Estimated remaining: 41.7s. Rate: 181.1 symbols/min [2025-09-15T21:22:40.162824] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:40.164242] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1326 records). [2025-09-15T21:22:40.165092] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-15T21:22:40.167620] [INFO ] [MAIN ] Derivative Progress: 1958/2083 symbols completed. VKQ took 0.9s. Estimated remaining: 41.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:40.168111] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:40.178883] [DEBUG] [MAIN ] VIV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:40.179587] [INFO ] [MAIN ] VIV: Generated 1326 derivative records from 33492 primary records. [2025-09-15T21:22:40.179690] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-15T21:22:40.196984] [DEBUG] [LOCAL ] VIV: Derivative data saved (1326 records). [2025-09-15T21:22:40.197191] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-15T21:22:40.199029] [INFO ] [MAIN ] Derivative Progress: 1959/2083 symbols completed. VIV took 1.0s. Estimated remaining: 41.0s. Rate: 181.3 symbols/min [2025-09-15T21:22:40.199278] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:40.207718] [DEBUG] [LOCAL ] VLN: Loaded 21776 existing records from primary storage. [2025-09-15T21:22:40.207883] [INFO ] [MAIN ] VLN: Loaded 21776 primary data records. [2025-09-15T21:22:40.525464] [DEBUG] [LOCAL ] VLO: Loaded 39197 existing records from primary storage. [2025-09-15T21:22:40.534572] [INFO ] [MAIN ] VLO: Loaded 39197 primary data records. [2025-09-15T21:22:40.547233] [DEBUG] [LOCAL ] VLRS: Loaded 29317 existing records from primary storage. [2025-09-15T21:22:40.569534] [INFO ] [MAIN ] VLRS: Loaded 29317 primary data records. [2025-09-15T21:22:41.089480] [DEBUG] [MAIN ] VLN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:41.092932] [INFO ] [MAIN ] VLN: Generated 1326 derivative records from 21776 primary records. [2025-09-15T21:22:41.093048] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-15T21:22:41.105712] [DEBUG] [LOCAL ] VLN: Derivative data saved (1326 records). [2025-09-15T21:22:41.105975] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-15T21:22:41.108107] [INFO ] [MAIN ] Derivative Progress: 1960/2083 symbols completed. VLN took 0.9s. Estimated remaining: 40.8s. Rate: 181.1 symbols/min [2025-09-15T21:22:41.108478] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:41.124925] [DEBUG] [LOCAL ] VLT: Loaded 3151 existing records from primary storage. [2025-09-15T21:22:41.125346] [DEBUG] [MAIN ] VLO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:41.125473] [INFO ] [MAIN ] VLT: Loaded 3151 primary data records. [2025-09-15T21:22:41.137073] [INFO ] [MAIN ] VLO: Generated 1326 derivative records from 39197 primary records. [2025-09-15T21:22:41.146675] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-15T21:22:41.327660] [DEBUG] [MAIN ] VLRS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:41.333134] [DEBUG] [LOCAL ] VLO: Derivative data saved (1326 records). [2025-09-15T21:22:41.333715] [INFO ] [MAIN ] VLRS: Generated 1326 derivative records from 29317 primary records. [2025-09-15T21:22:41.416809] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-15T21:22:41.416720] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-15T21:22:41.419065] [INFO ] [MAIN ] Derivative Progress: 1961/2083 symbols completed. VLO took 1.3s. Estimated remaining: 40.4s. Rate: 181.1 symbols/min [2025-09-15T21:22:41.420052] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:41.433898] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1326 records). [2025-09-15T21:22:41.434015] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-15T21:22:41.436048] [INFO ] [MAIN ] Derivative Progress: 1962/2083 symbols completed. VLRS took 1.2s. Estimated remaining: 40.1s. Rate: 181.2 symbols/min [2025-09-15T21:22:41.436284] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:41.456265] [DEBUG] [MAIN ] VLT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:41.465116] [INFO ] [MAIN ] VLT: Generated 1326 derivative records from 3151 primary records. [2025-09-15T21:22:41.465312] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-15T21:22:41.479056] [DEBUG] [LOCAL ] VLT: Derivative data saved (1326 records). [2025-09-15T21:22:41.479768] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-15T21:22:41.488430] [INFO ] [MAIN ] Derivative Progress: 1963/2083 symbols completed. VLT took 0.4s. Estimated remaining: 39.7s. Rate: 181.3 symbols/min [2025-09-15T21:22:41.499341] [DEBUG] [LOCAL ] VLTO: Loaded 33611 existing records from primary storage. [2025-09-15T21:22:41.499477] [INFO ] [MAIN ] VLTO: Loaded 33611 primary data records. [2025-09-15T21:22:41.611062] [DEBUG] [LOCAL ] VMC: Loaded 31598 existing records from primary storage. [2025-09-15T21:22:41.616692] [INFO ] [MAIN ] VMC: Loaded 31598 primary data records. [2025-09-15T21:22:42.049009] [DEBUG] [MAIN ] VLTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:42.049687] [INFO ] [MAIN ] VLTO: Generated 1326 derivative records from 33611 primary records. [2025-09-15T21:22:42.049893] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-15T21:22:42.063339] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1326 records). [2025-09-15T21:22:42.063925] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-15T21:22:42.065634] [INFO ] [MAIN ] Derivative Progress: 1964/2083 symbols completed. VLTO took 0.6s. Estimated remaining: 39.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:42.075045] [DEBUG] [MAIN ] VMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:42.075565] [INFO ] [MAIN ] VMC: Generated 1326 derivative records from 31598 primary records. [2025-09-15T21:22:42.075624] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-15T21:22:42.086813] [DEBUG] [LOCAL ] VMC: Derivative data saved (1326 records). [2025-09-15T21:22:42.086869] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-15T21:22:42.089245] [INFO ] [MAIN ] Derivative Progress: 1965/2083 symbols completed. VMC took 0.7s. Estimated remaining: 39.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:42.089618] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:42.089836] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:42.090123] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:42.096902] [DEBUG] [LOCAL ] VNCE: Loaded 4684 existing records from primary storage. [2025-09-15T21:22:42.097040] [INFO ] [MAIN ] VNCE: Loaded 4684 primary data records. [2025-09-15T21:22:42.213754] [DEBUG] [LOCAL ] VMI: Loaded 11216 existing records from primary storage. [2025-09-15T21:22:42.234425] [INFO ] [MAIN ] VMI: Loaded 11216 primary data records. [2025-09-15T21:22:42.229273] [DEBUG] [LOCAL ] VMO: Loaded 15153 existing records from primary storage. [2025-09-15T21:22:42.256436] [INFO ] [MAIN ] VMO: Loaded 15153 primary data records. [2025-09-15T21:22:42.956575] [DEBUG] [MAIN ] VNCE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:42.957817] [INFO ] [MAIN ] VNCE: Generated 1326 derivative records from 4684 primary records. [2025-09-15T21:22:42.957909] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-15T21:22:42.973419] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1326 records). [2025-09-15T21:22:42.973598] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-15T21:22:42.984414] [INFO ] [MAIN ] Derivative Progress: 1966/2083 symbols completed. VNCE took 0.9s. Estimated remaining: 38.8s. Rate: 181.1 symbols/min [2025-09-15T21:22:42.994626] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:42.994545] [DEBUG] [MAIN ] VMO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:42.995786] [INFO ] [MAIN ] VMO: Generated 1326 derivative records from 15153 primary records. [2025-09-15T21:22:42.995061] [DEBUG] [MAIN ] VMI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:42.996217] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-15T21:22:42.996924] [INFO ] [MAIN ] VMI: Generated 1326 derivative records from 11216 primary records. [2025-09-15T21:22:42.997788] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-15T21:22:43.019412] [DEBUG] [LOCAL ] VMI: Derivative data saved (1326 records). [2025-09-15T21:22:43.019919] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-15T21:22:43.022586] [INFO ] [MAIN ] Derivative Progress: 1967/2083 symbols completed. VMI took 0.9s. Estimated remaining: 38.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:43.023544] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:43.025588] [DEBUG] [LOCAL ] VMO: Derivative data saved (1326 records). [2025-09-15T21:22:43.025803] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-15T21:22:43.027493] [INFO ] [MAIN ] Derivative Progress: 1968/2083 symbols completed. VMO took 0.9s. Estimated remaining: 38.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:43.027736] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:43.045924] [DEBUG] [LOCAL ] VOC: Loaded 6877 existing records from primary storage. [2025-09-15T21:22:43.046031] [INFO ] [MAIN ] VOC: Loaded 6877 primary data records. [2025-09-15T21:22:43.165053] [DEBUG] [LOCAL ] VNO: Loaded 36228 existing records from primary storage. [2025-09-15T21:22:43.168390] [INFO ] [MAIN ] VNO: Loaded 36228 primary data records. [2025-09-15T21:22:43.441489] [DEBUG] [LOCAL ] VNT: Loaded 32232 existing records from primary storage. [2025-09-15T21:22:43.442455] [INFO ] [MAIN ] VNT: Loaded 32232 primary data records. [2025-09-15T21:22:43.897697] [DEBUG] [MAIN ] VOC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:43.898725] [INFO ] [MAIN ] VOC: Generated 1326 derivative records from 6877 primary records. [2025-09-15T21:22:43.898930] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-15T21:22:43.913299] [DEBUG] [LOCAL ] VOC: Derivative data saved (1326 records). [2025-09-15T21:22:43.922835] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-15T21:22:43.924673] [INFO ] [MAIN ] Derivative Progress: 1969/2083 symbols completed. VOC took 0.9s. Estimated remaining: 37.8s. Rate: 181.1 symbols/min [2025-09-15T21:22:43.925093] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:43.925354] [DEBUG] [MAIN ] VNO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:43.926253] [INFO ] [MAIN ] VNO: Generated 1326 derivative records from 36228 primary records. [2025-09-15T21:22:43.926598] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-15T21:22:43.941179] [DEBUG] [LOCAL ] VNO: Derivative data saved (1326 records). [2025-09-15T21:22:43.941338] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-15T21:22:43.943459] [INFO ] [MAIN ] Derivative Progress: 1970/2083 symbols completed. VNO took 1.0s. Estimated remaining: 37.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:43.943878] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:43.954389] [DEBUG] [MAIN ] VNT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:43.955075] [INFO ] [MAIN ] VNT: Generated 1326 derivative records from 32232 primary records. [2025-09-15T21:22:43.955136] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-15T21:22:43.970657] [DEBUG] [LOCAL ] VNT: Derivative data saved (1326 records). [2025-09-15T21:22:43.975175] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-15T21:22:43.975424] [DEBUG] [LOCAL ] VPG: Loaded 12585 existing records from primary storage. [2025-09-15T21:22:43.977228] [INFO ] [MAIN ] Derivative Progress: 1971/2083 symbols completed. VNT took 1.0s. Estimated remaining: 37.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:43.977555] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:43.977633] [INFO ] [MAIN ] VPG: Loaded 12585 primary data records. [2025-09-15T21:22:44.077916] [DEBUG] [LOCAL ] VPV: Loaded 3618 existing records from primary storage. [2025-09-15T21:22:44.091821] [INFO ] [MAIN ] VPV: Loaded 3618 primary data records. [2025-09-15T21:22:44.227118] [DEBUG] [LOCAL ] VOYA: Loaded 30954 existing records from primary storage. [2025-09-15T21:22:44.265863] [INFO ] [MAIN ] VOYA: Loaded 30954 primary data records. [2025-09-15T21:22:44.862322] [DEBUG] [MAIN ] VPG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:44.871814] [DEBUG] [MAIN ] VPV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:44.872432] [INFO ] [MAIN ] VPG: Generated 1326 derivative records from 12585 primary records. [2025-09-15T21:22:44.873243] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-15T21:22:44.873110] [INFO ] [MAIN ] VPV: Generated 1326 derivative records from 3618 primary records. [2025-09-15T21:22:44.873347] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-15T21:22:44.897334] [DEBUG] [LOCAL ] VPV: Derivative data saved (1326 records). [2025-09-15T21:22:44.895576] [DEBUG] [LOCAL ] VPG: Derivative data saved (1326 records). [2025-09-15T21:22:44.897535] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-15T21:22:44.899203] [INFO ] [MAIN ] Derivative Progress: 1972/2083 symbols completed. VPG took 1.0s. Estimated remaining: 36.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:44.905229] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-15T21:22:44.899387] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:44.911076] [INFO ] [MAIN ] Derivative Progress: 1973/2083 symbols completed. VPV took 0.9s. Estimated remaining: 36.4s. Rate: 181.2 symbols/min [2025-09-15T21:22:44.911537] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:44.912581] [DEBUG] [MAIN ] VOYA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:44.913366] [INFO ] [MAIN ] VOYA: Generated 1326 derivative records from 30954 primary records. [2025-09-15T21:22:44.913535] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-15T21:22:44.926295] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1326 records). [2025-09-15T21:22:44.926452] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-15T21:22:44.928250] [INFO ] [MAIN ] Derivative Progress: 1974/2083 symbols completed. VOYA took 1.0s. Estimated remaining: 36.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:44.928669] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:44.944553] [DEBUG] [LOCAL ] VRTS: Loaded 7327 existing records from primary storage. [2025-09-15T21:22:44.944742] [INFO ] [MAIN ] VRTS: Loaded 7327 primary data records. [2025-09-15T21:22:45.062549] [DEBUG] [LOCAL ] VRE: Loaded 25581 existing records from primary storage. [2025-09-15T21:22:45.062721] [INFO ] [MAIN ] VRE: Loaded 25581 primary data records. [2025-09-15T21:22:45.236012] [DEBUG] [LOCAL ] VRT: Loaded 39714 existing records from primary storage. [2025-09-15T21:22:45.251986] [INFO ] [MAIN ] VRT: Loaded 39714 primary data records. [2025-09-15T21:22:45.778787] [DEBUG] [MAIN ] VRTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:45.780379] [INFO ] [MAIN ] VRTS: Generated 1326 derivative records from 7327 primary records. [2025-09-15T21:22:45.780771] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-15T21:22:45.794481] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1326 records). [2025-09-15T21:22:45.794877] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-15T21:22:45.796660] [INFO ] [MAIN ] Derivative Progress: 1975/2083 symbols completed. VRTS took 0.9s. Estimated remaining: 35.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:45.807563] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:45.808922] [DEBUG] [MAIN ] VRE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:45.809794] [INFO ] [MAIN ] VRE: Generated 1326 derivative records from 25581 primary records. [2025-09-15T21:22:45.810025] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-15T21:22:45.829957] [DEBUG] [MAIN ] VRT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:45.831525] [DEBUG] [LOCAL ] VRE: Derivative data saved (1326 records). [2025-09-15T21:22:45.832347] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-15T21:22:45.834709] [INFO ] [MAIN ] Derivative Progress: 1976/2083 symbols completed. VRE took 0.9s. Estimated remaining: 35.4s. Rate: 181.3 symbols/min [2025-09-15T21:22:45.832184] [INFO ] [MAIN ] VRT: Generated 1326 derivative records from 39714 primary records. [2025-09-15T21:22:45.834999] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:45.834855] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-15T21:22:45.847811] [DEBUG] [LOCAL ] VRT: Derivative data saved (1326 records). [2025-09-15T21:22:45.848044] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-15T21:22:45.849863] [INFO ] [MAIN ] Derivative Progress: 1977/2083 symbols completed. VRT took 0.9s. Estimated remaining: 35.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:45.850227] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:45.886589] [DEBUG] [LOCAL ] VSCO: Loaded 38920 existing records from primary storage. [2025-09-15T21:22:45.886836] [INFO ] [MAIN ] VSCO: Loaded 38920 primary data records. [2025-09-15T21:22:46.021193] [DEBUG] [LOCAL ] VSH: Loaded 35598 existing records from primary storage. [2025-09-15T21:22:46.026971] [INFO ] [MAIN ] VSH: Loaded 35598 primary data records. [2025-09-15T21:22:46.254669] [DEBUG] [LOCAL ] VST: Loaded 39685 existing records from primary storage. [2025-09-15T21:22:46.288586] [INFO ] [MAIN ] VST: Loaded 39685 primary data records. [2025-09-15T21:22:46.772564] [DEBUG] [MAIN ] VSCO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:46.773661] [INFO ] [MAIN ] VSCO: Generated 1326 derivative records from 38920 primary records. [2025-09-15T21:22:46.774247] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-15T21:22:46.789470] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1326 records). [2025-09-15T21:22:46.792674] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-15T21:22:46.794447] [INFO ] [MAIN ] Derivative Progress: 1978/2083 symbols completed. VSCO took 1.0s. Estimated remaining: 34.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:46.801090] [DEBUG] [MAIN ] VSH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:46.801922] [INFO ] [MAIN ] VSH: Generated 1326 derivative records from 35598 primary records. [2025-09-15T21:22:46.802096] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-15T21:22:46.824659] [DEBUG] [MAIN ] VST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:46.824830] [DEBUG] [LOCAL ] VSH: Derivative data saved (1326 records). [2025-09-15T21:22:46.825413] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-15T21:22:46.825376] [INFO ] [MAIN ] VST: Generated 1326 derivative records from 39685 primary records. [2025-09-15T21:22:46.825494] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-15T21:22:46.827325] [INFO ] [MAIN ] Derivative Progress: 1979/2083 symbols completed. VSH took 1.0s. Estimated remaining: 34.4s. Rate: 181.3 symbols/min [2025-09-15T21:22:46.838835] [DEBUG] [LOCAL ] VST: Derivative data saved (1326 records). [2025-09-15T21:22:46.838892] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-15T21:22:46.840487] [INFO ] [MAIN ] Derivative Progress: 1980/2083 symbols completed. VST took 1.0s. Estimated remaining: 34.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:46.840835] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:46.840911] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:46.841452] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:46.901296] [DEBUG] [LOCAL ] VSTS: Loaded 36017 existing records from primary storage. [2025-09-15T21:22:46.911246] [INFO ] [MAIN ] VSTS: Loaded 36017 primary data records. [2025-09-15T21:22:46.901211] [DEBUG] [LOCAL ] VTEX: Loaded 31992 existing records from primary storage. [2025-09-15T21:22:46.911441] [INFO ] [MAIN ] VTEX: Loaded 31992 primary data records. [2025-09-15T21:22:46.932250] [DEBUG] [LOCAL ] VTLE: Loaded 35762 existing records from primary storage. [2025-09-15T21:22:46.972481] [INFO ] [MAIN ] VTLE: Loaded 35762 primary data records. [2025-09-15T21:22:47.729275] [DEBUG] [MAIN ] VTEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:47.729812] [DEBUG] [MAIN ] VSTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:47.733271] [INFO ] [MAIN ] VTEX: Generated 1326 derivative records from 31992 primary records. [2025-09-15T21:22:47.740445] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-15T21:22:47.741024] [INFO ] [MAIN ] VSTS: Generated 1326 derivative records from 36017 primary records. [2025-09-15T21:22:47.741340] [DEBUG] [MAIN ] VTLE: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:47.742901] [INFO ] [MAIN ] VTLE: Generated 1326 derivative records from 35762 primary records. [2025-09-15T21:22:47.742168] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-15T21:22:47.743523] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-15T21:22:47.773441] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1326 records). [2025-09-15T21:22:47.773774] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-15T21:22:47.776476] [INFO ] [MAIN ] Derivative Progress: 1981/2083 symbols completed. VTEX took 0.9s. Estimated remaining: 33.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:47.777271] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:47.781922] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1326 records). [2025-09-15T21:22:47.782429] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-15T21:22:47.784711] [INFO ] [MAIN ] Derivative Progress: 1982/2083 symbols completed. VSTS took 0.9s. Estimated remaining: 33.4s. Rate: 181.3 symbols/min [2025-09-15T21:22:47.785987] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:47.785854] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1326 records). [2025-09-15T21:22:47.786517] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-15T21:22:47.788796] [INFO ] [MAIN ] Derivative Progress: 1983/2083 symbols completed. VTLE took 0.9s. Estimated remaining: 33.1s. Rate: 181.4 symbols/min [2025-09-15T21:22:47.789022] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:47.799815] [DEBUG] [LOCAL ] VTN: Loaded 5048 existing records from primary storage. [2025-09-15T21:22:47.804616] [INFO ] [MAIN ] VTN: Loaded 5048 primary data records. [2025-09-15T21:22:47.804556] [DEBUG] [LOCAL ] VTMX: Loaded 12979 existing records from primary storage. [2025-09-15T21:22:47.829402] [INFO ] [MAIN ] VTMX: Loaded 12979 primary data records. [2025-09-15T21:22:48.002378] [DEBUG] [LOCAL ] VTOL: Loaded 14584 existing records from primary storage. [2025-09-15T21:22:48.015859] [INFO ] [MAIN ] VTOL: Loaded 14584 primary data records. [2025-09-15T21:22:48.651264] [DEBUG] [MAIN ] VTMX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:48.650835] [DEBUG] [MAIN ] VTN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:48.652279] [INFO ] [MAIN ] VTN: Generated 1326 derivative records from 5048 primary records. [2025-09-15T21:22:48.653116] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-15T21:22:48.652799] [INFO ] [MAIN ] VTMX: Generated 1326 derivative records from 12979 primary records. [2025-09-15T21:22:48.653708] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-15T21:22:48.677375] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1326 records). [2025-09-15T21:22:48.678493] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-15T21:22:48.680204] [INFO ] [MAIN ] Derivative Progress: 1984/2083 symbols completed. VTMX took 0.9s. Estimated remaining: 32.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:48.687191] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:48.692690] [DEBUG] [LOCAL ] VTN: Derivative data saved (1326 records). [2025-09-15T21:22:48.693253] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-15T21:22:48.693524] [DEBUG] [MAIN ] VTOL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:48.697017] [INFO ] [MAIN ] VTOL: Generated 1326 derivative records from 14584 primary records. [2025-09-15T21:22:48.697431] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-15T21:22:48.695982] [INFO ] [MAIN ] Derivative Progress: 1985/2083 symbols completed. VTN took 0.9s. Estimated remaining: 32.4s. Rate: 181.3 symbols/min [2025-09-15T21:22:48.698492] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:48.711598] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1326 records). [2025-09-15T21:22:48.711768] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-15T21:22:48.713427] [INFO ] [MAIN ] Derivative Progress: 1986/2083 symbols completed. VTOL took 0.9s. Estimated remaining: 32.1s. Rate: 181.4 symbols/min [2025-09-15T21:22:48.713782] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:48.750493] [DEBUG] [LOCAL ] VTS: Loaded 21587 existing records from primary storage. [2025-09-15T21:22:48.758390] [INFO ] [MAIN ] VTS: Loaded 21587 primary data records. [2025-09-15T21:22:48.758775] [DEBUG] [LOCAL ] VVR: Loaded 21357 existing records from primary storage. [2025-09-15T21:22:48.781309] [INFO ] [MAIN ] VVR: Loaded 21357 primary data records. [2025-09-15T21:22:48.959032] [DEBUG] [LOCAL ] VTR: Loaded 38933 existing records from primary storage. [2025-09-15T21:22:48.977407] [INFO ] [MAIN ] VTR: Loaded 38933 primary data records. [2025-09-15T21:22:49.642738] [DEBUG] [MAIN ] VTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:49.646531] [INFO ] [MAIN ] VTS: Generated 1326 derivative records from 21587 primary records. [2025-09-15T21:22:49.646811] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-15T21:22:49.671611] [DEBUG] [LOCAL ] VTS: Derivative data saved (1326 records). [2025-09-15T21:22:49.671520] [DEBUG] [MAIN ] VVR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:49.673342] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-15T21:22:49.677079] [INFO ] [MAIN ] VVR: Generated 1326 derivative records from 21357 primary records. [2025-09-15T21:22:49.677196] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-15T21:22:49.676259] [INFO ] [MAIN ] Derivative Progress: 1987/2083 symbols completed. VTS took 1.0s. Estimated remaining: 31.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:49.696804] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:49.700290] [DEBUG] [LOCAL ] VVR: Derivative data saved (1326 records). [2025-09-15T21:22:49.700407] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-15T21:22:49.700834] [DEBUG] [MAIN ] VTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:49.702757] [INFO ] [MAIN ] Derivative Progress: 1988/2083 symbols completed. VVR took 1.0s. Estimated remaining: 31.4s. Rate: 181.3 symbols/min [2025-09-15T21:22:49.703177] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:49.703924] [INFO ] [MAIN ] VTR: Generated 1326 derivative records from 38933 primary records. [2025-09-15T21:22:49.704225] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-15T21:22:49.718278] [DEBUG] [LOCAL ] VTR: Derivative data saved (1326 records). [2025-09-15T21:22:49.718439] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-15T21:22:49.720310] [INFO ] [MAIN ] Derivative Progress: 1989/2083 symbols completed. VTR took 1.0s. Estimated remaining: 31.1s. Rate: 181.4 symbols/min [2025-09-15T21:22:49.720567] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:49.742728] [DEBUG] [LOCAL ] VVX: Loaded 17093 existing records from primary storage. [2025-09-15T21:22:49.753870] [INFO ] [MAIN ] VVX: Loaded 17093 primary data records. [2025-09-15T21:22:49.904749] [DEBUG] [LOCAL ] VVV: Loaded 37152 existing records from primary storage. [2025-09-15T21:22:49.915700] [INFO ] [MAIN ] VVV: Loaded 37152 primary data records. [2025-09-15T21:22:49.939553] [DEBUG] [LOCAL ] VYX: Loaded 35924 existing records from primary storage. [2025-09-15T21:22:49.979417] [INFO ] [MAIN ] VYX: Loaded 35924 primary data records. [2025-09-15T21:22:50.668864] [DEBUG] [MAIN ] VVX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:50.671664] [INFO ] [MAIN ] VVX: Generated 1326 derivative records from 17093 primary records. [2025-09-15T21:22:50.671981] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-15T21:22:50.687936] [DEBUG] [LOCAL ] VVX: Derivative data saved (1326 records). [2025-09-15T21:22:50.689690] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-15T21:22:50.692003] [INFO ] [MAIN ] Derivative Progress: 1990/2083 symbols completed. VVX took 1.0s. Estimated remaining: 30.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:50.692341] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:50.705959] [DEBUG] [MAIN ] VYX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:50.710180] [INFO ] [MAIN ] VYX: Generated 1326 derivative records from 35924 primary records. [2025-09-15T21:22:50.710376] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-15T21:22:50.737891] [DEBUG] [LOCAL ] VYX: Derivative data saved (1326 records). [2025-09-15T21:22:50.738455] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-15T21:22:50.738354] [DEBUG] [MAIN ] VVV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:50.740437] [INFO ] [MAIN ] Derivative Progress: 1991/2083 symbols completed. VYX took 1.0s. Estimated remaining: 30.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:50.741610] [INFO ] [MAIN ] VVV: Generated 1326 derivative records from 37152 primary records. [2025-09-15T21:22:50.742015] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:50.742191] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-15T21:22:50.758259] [DEBUG] [LOCAL ] VVV: Derivative data saved (1326 records). [2025-09-15T21:22:50.758498] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-15T21:22:50.762011] [INFO ] [MAIN ] Derivative Progress: 1992/2083 symbols completed. VVV took 1.1s. Estimated remaining: 30.1s. Rate: 181.4 symbols/min [2025-09-15T21:22:50.772516] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:50.790678] [DEBUG] [LOCAL ] W: Loaded 39527 existing records from primary storage. [2025-09-15T21:22:50.790941] [INFO ] [MAIN ] W: Loaded 39527 primary data records. [2025-09-15T21:22:50.927132] [DEBUG] [LOCAL ] WAB: Loaded 32190 existing records from primary storage. [2025-09-15T21:22:50.933206] [INFO ] [MAIN ] WAB: Loaded 32190 primary data records. [2025-09-15T21:22:51.114405] [DEBUG] [LOCAL ] WAL: Loaded 32797 existing records from primary storage. [2025-09-15T21:22:51.211933] [INFO ] [MAIN ] WAL: Loaded 32797 primary data records. [2025-09-15T21:22:51.742409] [DEBUG] [MAIN ] W: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:22:51.744218] [INFO ] [MAIN ] W: Generated 1325 derivative records from 39527 primary records. [2025-09-15T21:22:51.744927] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-15T21:22:51.758598] [DEBUG] [LOCAL ] W: Derivative data saved (1325 records). [2025-09-15T21:22:51.759096] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-15T21:22:51.761415] [INFO ] [MAIN ] Derivative Progress: 1993/2083 symbols completed. W took 1.1s. Estimated remaining: 29.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:51.777104] [DEBUG] [MAIN ] WAB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:51.778092] [INFO ] [MAIN ] WAB: Generated 1326 derivative records from 32190 primary records. [2025-09-15T21:22:51.778298] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-15T21:22:51.791885] [DEBUG] [LOCAL ] WAB: Derivative data saved (1326 records). [2025-09-15T21:22:51.792243] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-15T21:22:51.794754] [INFO ] [MAIN ] Derivative Progress: 1994/2083 symbols completed. WAB took 1.1s. Estimated remaining: 29.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:51.808158] [DEBUG] [MAIN ] WAL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:51.808979] [INFO ] [MAIN ] WAL: Generated 1326 derivative records from 32797 primary records. [2025-09-15T21:22:51.809047] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-15T21:22:51.821666] [DEBUG] [LOCAL ] WAL: Derivative data saved (1326 records). [2025-09-15T21:22:51.821810] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-15T21:22:51.823908] [INFO ] [MAIN ] Derivative Progress: 1995/2083 symbols completed. WAL took 1.1s. Estimated remaining: 29.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:51.824846] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:51.825221] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:51.825145] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:51.837483] [DEBUG] [LOCAL ] WBX: Loaded 7468 existing records from primary storage. [2025-09-15T21:22:51.837808] [INFO ] [MAIN ] WBX: Loaded 7468 primary data records. [2025-09-15T21:22:51.999891] [DEBUG] [LOCAL ] WAT: Loaded 25964 existing records from primary storage. [2025-09-15T21:22:52.005610] [INFO ] [MAIN ] WAT: Loaded 25964 primary data records. [2025-09-15T21:22:52.114350] [DEBUG] [LOCAL ] WBS: Loaded 35768 existing records from primary storage. [2025-09-15T21:22:52.243628] [INFO ] [MAIN ] WBS: Loaded 35768 primary data records. [2025-09-15T21:22:52.753029] [DEBUG] [MAIN ] WBX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:52.754473] [INFO ] [MAIN ] WBX: Generated 1326 derivative records from 7468 primary records. [2025-09-15T21:22:52.754751] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-15T21:22:52.768711] [DEBUG] [LOCAL ] WBX: Derivative data saved (1326 records). [2025-09-15T21:22:52.769845] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-15T21:22:52.771534] [INFO ] [MAIN ] Derivative Progress: 1996/2083 symbols completed. WBX took 0.9s. Estimated remaining: 28.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:52.772312] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:52.783371] [DEBUG] [MAIN ] WAT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:52.784308] [INFO ] [MAIN ] WAT: Generated 1326 derivative records from 25964 primary records. [2025-09-15T21:22:52.784739] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-15T21:22:52.800473] [DEBUG] [LOCAL ] WAT: Derivative data saved (1326 records). [2025-09-15T21:22:52.800844] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-15T21:22:52.802817] [INFO ] [MAIN ] Derivative Progress: 1997/2083 symbols completed. WAT took 1.0s. Estimated remaining: 28.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:52.813321] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:52.813705] [DEBUG] [MAIN ] WBS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:52.814512] [INFO ] [MAIN ] WBS: Generated 1326 derivative records from 35768 primary records. [2025-09-15T21:22:52.815001] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-15T21:22:52.835983] [DEBUG] [LOCAL ] WBS: Derivative data saved (1326 records). [2025-09-15T21:22:52.836211] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-15T21:22:52.838860] [INFO ] [MAIN ] Derivative Progress: 1998/2083 symbols completed. WBS took 1.0s. Estimated remaining: 28.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:52.839298] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:52.851106] [DEBUG] [LOCAL ] WCC: Loaded 28803 existing records from primary storage. [2025-09-15T21:22:52.851319] [INFO ] [MAIN ] WCC: Loaded 28803 primary data records. [2025-09-15T21:22:52.976388] [DEBUG] [LOCAL ] WD: Loaded 17039 existing records from primary storage. [2025-09-15T21:22:52.976852] [INFO ] [MAIN ] WD: Loaded 17039 primary data records. [2025-09-15T21:22:53.245692] [DEBUG] [LOCAL ] WCN: Loaded 35252 existing records from primary storage. [2025-09-15T21:22:53.257997] [INFO ] [MAIN ] WCN: Loaded 35252 primary data records. [2025-09-15T21:22:53.767423] [DEBUG] [MAIN ] WCC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:53.769702] [INFO ] [MAIN ] WCC: Generated 1326 derivative records from 28803 primary records. [2025-09-15T21:22:53.770655] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-15T21:22:53.787586] [DEBUG] [MAIN ] WD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:53.790478] [INFO ] [MAIN ] WD: Generated 1326 derivative records from 17039 primary records. [2025-09-15T21:22:53.793690] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-15T21:22:53.793756] [DEBUG] [LOCAL ] WCC: Derivative data saved (1326 records). [2025-09-15T21:22:53.793939] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-15T21:22:53.795809] [INFO ] [MAIN ] Derivative Progress: 1999/2083 symbols completed. WCC took 1.0s. Estimated remaining: 27.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:53.796179] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:53.811717] [DEBUG] [LOCAL ] WD: Derivative data saved (1326 records). [2025-09-15T21:22:53.814549] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-15T21:22:53.816801] [INFO ] [MAIN ] Derivative Progress: 2000/2083 symbols completed. WD took 1.0s. Estimated remaining: 27.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:53.827900] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:53.828211] [DEBUG] [MAIN ] WCN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:53.829490] [INFO ] [MAIN ] WCN: Generated 1326 derivative records from 35252 primary records. [2025-09-15T21:22:53.829731] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-15T21:22:53.845227] [DEBUG] [LOCAL ] WDH: Loaded 12003 existing records from primary storage. [2025-09-15T21:22:53.846556] [INFO ] [MAIN ] WDH: Loaded 12003 primary data records. [2025-09-15T21:22:53.922625] [DEBUG] [LOCAL ] WCN: Derivative data saved (1326 records). [2025-09-15T21:22:53.939583] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-15T21:22:53.960755] [INFO ] [MAIN ] Derivative Progress: 2001/2083 symbols completed. WCN took 1.1s. Estimated remaining: 27.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:53.966550] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:53.966972] [DEBUG] [LOCAL ] WDI: Loaded 15260 existing records from primary storage. [2025-09-15T21:22:53.967103] [INFO ] [MAIN ] WDI: Loaded 15260 primary data records. [2025-09-15T21:22:54.424321] [DEBUG] [LOCAL ] WDS: Loaded 31271 existing records from primary storage. [2025-09-15T21:22:54.424971] [INFO ] [MAIN ] WDS: Loaded 31271 primary data records. [2025-09-15T21:22:54.709480] [DEBUG] [MAIN ] WDH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:54.710672] [INFO ] [MAIN ] WDH: Generated 1326 derivative records from 12003 primary records. [2025-09-15T21:22:54.711396] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-15T21:22:54.725758] [DEBUG] [LOCAL ] WDH: Derivative data saved (1326 records). [2025-09-15T21:22:54.727598] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-15T21:22:54.729310] [INFO ] [MAIN ] Derivative Progress: 2002/2083 symbols completed. WDH took 0.9s. Estimated remaining: 26.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:54.729936] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:54.740363] [DEBUG] [MAIN ] WDI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:54.741341] [INFO ] [MAIN ] WDI: Generated 1326 derivative records from 15260 primary records. [2025-09-15T21:22:54.742527] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-15T21:22:54.761354] [DEBUG] [LOCAL ] WEA: Loaded 6116 existing records from primary storage. [2025-09-15T21:22:54.761579] [DEBUG] [LOCAL ] WDI: Derivative data saved (1326 records). [2025-09-15T21:22:54.761775] [INFO ] [MAIN ] WEA: Loaded 6116 primary data records. [2025-09-15T21:22:54.761886] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-15T21:22:54.799845] [INFO ] [MAIN ] Derivative Progress: 2003/2083 symbols completed. WDI took 1.0s. Estimated remaining: 26.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:54.819905] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:54.880058] [DEBUG] [MAIN ] WDS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:54.896767] [INFO ] [MAIN ] WDS: Generated 1326 derivative records from 31271 primary records. [2025-09-15T21:22:54.937907] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-15T21:22:55.071232] [DEBUG] [LOCAL ] WDS: Derivative data saved (1326 records). [2025-09-15T21:22:55.072108] [DEBUG] [LOCAL ] WEAV: Loaded 30769 existing records from primary storage. [2025-09-15T21:22:55.071477] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-15T21:22:55.074214] [INFO ] [MAIN ] Derivative Progress: 2004/2083 symbols completed. WDS took 1.1s. Estimated remaining: 26.1s. Rate: 181.3 symbols/min [2025-09-15T21:22:55.074525] [INFO ] [MAIN ] WEAV: Loaded 30769 primary data records. [2025-09-15T21:22:55.086091] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:55.365480] [DEBUG] [MAIN ] WEA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:55.367096] [INFO ] [MAIN ] WEA: Generated 1326 derivative records from 6116 primary records. [2025-09-15T21:22:55.367497] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-15T21:22:55.379730] [DEBUG] [LOCAL ] WEC: Loaded 38536 existing records from primary storage. [2025-09-15T21:22:55.380023] [INFO ] [MAIN ] WEC: Loaded 38536 primary data records. [2025-09-15T21:22:55.462988] [DEBUG] [LOCAL ] WEA: Derivative data saved (1326 records). [2025-09-15T21:22:55.479912] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-15T21:22:55.495837] [INFO ] [MAIN ] Derivative Progress: 2005/2083 symbols completed. WEA took 0.8s. Estimated remaining: 25.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:55.500116] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:55.676147] [DEBUG] [MAIN ] WEAV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:55.677442] [INFO ] [MAIN ] WEAV: Generated 1326 derivative records from 30769 primary records. [2025-09-15T21:22:55.677933] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-15T21:22:55.699934] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1326 records). [2025-09-15T21:22:55.700069] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-15T21:22:55.702699] [INFO ] [MAIN ] Derivative Progress: 2006/2083 symbols completed. WEAV took 0.9s. Estimated remaining: 25.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:55.703783] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:55.716667] [DEBUG] [LOCAL ] WELL: Loaded 38502 existing records from primary storage. [2025-09-15T21:22:55.717098] [INFO ] [MAIN ] WELL: Loaded 38502 primary data records. [2025-09-15T21:22:55.857594] [DEBUG] [MAIN ] WEC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:55.896929] [INFO ] [MAIN ] WEC: Generated 1326 derivative records from 38536 primary records. [2025-09-15T21:22:55.912844] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-15T21:22:56.078762] [DEBUG] [LOCAL ] WES: Loaded 35411 existing records from primary storage. [2025-09-15T21:22:56.079888] [INFO ] [MAIN ] WES: Loaded 35411 primary data records. [2025-09-15T21:22:56.126329] [DEBUG] [LOCAL ] WEC: Derivative data saved (1326 records). [2025-09-15T21:22:56.126763] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-15T21:22:56.138814] [INFO ] [MAIN ] Derivative Progress: 2007/2083 symbols completed. WEC took 1.1s. Estimated remaining: 25.2s. Rate: 181.2 symbols/min [2025-09-15T21:22:56.172156] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:56.380981] [DEBUG] [MAIN ] WELL: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:56.382756] [DEBUG] [LOCAL ] WEX: Loaded 24119 existing records from primary storage. [2025-09-15T21:22:56.381920] [INFO ] [MAIN ] WELL: Generated 1326 derivative records from 38502 primary records. [2025-09-15T21:22:56.383403] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-15T21:22:56.383828] [INFO ] [MAIN ] WEX: Loaded 24119 primary data records. [2025-09-15T21:22:56.489834] [DEBUG] [LOCAL ] WELL: Derivative data saved (1326 records). [2025-09-15T21:22:56.501111] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-15T21:22:56.502784] [INFO ] [MAIN ] Derivative Progress: 2008/2083 symbols completed. WELL took 1.0s. Estimated remaining: 24.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:56.668671] [DEBUG] [MAIN ] WES: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:56.669418] [INFO ] [MAIN ] WES: Generated 1326 derivative records from 35411 primary records. [2025-09-15T21:22:56.669503] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-15T21:22:56.682870] [DEBUG] [LOCAL ] WES: Derivative data saved (1326 records). [2025-09-15T21:22:56.683117] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-15T21:22:56.685117] [INFO ] [MAIN ] Derivative Progress: 2009/2083 symbols completed. WES took 1.0s. Estimated remaining: 24.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:56.700243] [DEBUG] [MAIN ] WEX: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:56.700805] [INFO ] [MAIN ] WEX: Generated 1326 derivative records from 24119 primary records. [2025-09-15T21:22:56.700865] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-15T21:22:56.712251] [DEBUG] [LOCAL ] WEX: Derivative data saved (1326 records). [2025-09-15T21:22:56.712307] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-15T21:22:56.714083] [INFO ] [MAIN ] Derivative Progress: 2010/2083 symbols completed. WEX took 0.6s. Estimated remaining: 24.2s. Rate: 181.4 symbols/min [2025-09-15T21:22:56.714626] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:56.714566] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:56.714838] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:56.727818] [DEBUG] [LOCAL ] WF: Loaded 7987 existing records from primary storage. [2025-09-15T21:22:56.728067] [INFO ] [MAIN ] WF: Loaded 7987 primary data records. [2025-09-15T21:22:56.853153] [DEBUG] [LOCAL ] WFG: Loaded 17796 existing records from primary storage. [2025-09-15T21:22:56.869574] [INFO ] [MAIN ] WFG: Loaded 17796 primary data records. [2025-09-15T21:22:56.970108] [DEBUG] [LOCAL ] WGO: Loaded 27817 existing records from primary storage. [2025-09-15T21:22:57.003030] [INFO ] [MAIN ] WGO: Loaded 27817 primary data records. [2025-09-15T21:22:57.587168] [DEBUG] [MAIN ] WF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:57.589575] [INFO ] [MAIN ] WF: Generated 1326 derivative records from 7987 primary records. [2025-09-15T21:22:57.590350] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-15T21:22:57.611589] [DEBUG] [MAIN ] WFG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:57.612413] [DEBUG] [LOCAL ] WF: Derivative data saved (1326 records). [2025-09-15T21:22:57.613432] [INFO ] [MAIN ] WFG: Generated 1326 derivative records from 17796 primary records. [2025-09-15T21:22:57.613521] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-15T21:22:57.612792] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-15T21:22:57.615203] [INFO ] [MAIN ] Derivative Progress: 2011/2083 symbols completed. WF took 0.9s. Estimated remaining: 23.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:57.615470] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:57.630709] [DEBUG] [LOCAL ] WFG: Derivative data saved (1326 records). [2025-09-15T21:22:57.640308] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-15T21:22:57.642592] [INFO ] [MAIN ] Derivative Progress: 2012/2083 symbols completed. WFG took 0.9s. Estimated remaining: 23.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:57.640888] [DEBUG] [MAIN ] WGO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:57.643686] [INFO ] [MAIN ] WGO: Generated 1326 derivative records from 27817 primary records. [2025-09-15T21:22:57.643779] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-15T21:22:57.642806] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:57.658020] [DEBUG] [LOCAL ] WGO: Derivative data saved (1326 records). [2025-09-15T21:22:57.658193] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-15T21:22:57.660154] [INFO ] [MAIN ] Derivative Progress: 2013/2083 symbols completed. WGO took 0.9s. Estimated remaining: 23.2s. Rate: 181.4 symbols/min [2025-09-15T21:22:57.660534] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:57.673663] [DEBUG] [LOCAL ] WHG: Loaded 2589 existing records from primary storage. [2025-09-15T21:22:57.673814] [INFO ] [MAIN ] WHG: Loaded 2589 primary data records. [2025-09-15T21:22:57.809508] [DEBUG] [LOCAL ] WH: Loaded 33730 existing records from primary storage. [2025-09-15T21:22:57.814829] [INFO ] [MAIN ] WH: Loaded 33730 primary data records. [2025-09-15T21:22:57.835786] [DEBUG] [LOCAL ] WHD: Loaded 29039 existing records from primary storage. [2025-09-15T21:22:57.901339] [INFO ] [MAIN ] WHD: Loaded 29039 primary data records. [2025-09-15T21:22:58.576537] [DEBUG] [MAIN ] WHG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:58.578150] [INFO ] [MAIN ] WHG: Generated 1326 derivative records from 2589 primary records. [2025-09-15T21:22:58.578723] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-15T21:22:58.590748] [DEBUG] [LOCAL ] WHG: Derivative data saved (1326 records). [2025-09-15T21:22:58.591035] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-15T21:22:58.592807] [INFO ] [MAIN ] Derivative Progress: 2014/2083 symbols completed. WHG took 0.9s. Estimated remaining: 22.8s. Rate: 181.2 symbols/min [2025-09-15T21:22:58.593256] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:58.607762] [DEBUG] [MAIN ] WH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:58.608439] [INFO ] [MAIN ] WH: Generated 1326 derivative records from 33730 primary records. [2025-09-15T21:22:58.608669] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-15T21:22:58.631086] [DEBUG] [MAIN ] WHD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:58.634153] [DEBUG] [LOCAL ] WH: Derivative data saved (1326 records). [2025-09-15T21:22:58.634954] [INFO ] [MAIN ] WHD: Generated 1326 derivative records from 29039 primary records. [2025-09-15T21:22:58.635085] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-15T21:22:58.636889] [INFO ] [MAIN ] Derivative Progress: 2015/2083 symbols completed. WH took 1.0s. Estimated remaining: 22.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:58.637046] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-15T21:22:58.637190] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:58.658557] [DEBUG] [LOCAL ] WHD: Derivative data saved (1326 records). [2025-09-15T21:22:58.658721] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-15T21:22:58.660824] [INFO ] [MAIN ] Derivative Progress: 2016/2083 symbols completed. WHD took 1.0s. Estimated remaining: 22.2s. Rate: 181.4 symbols/min [2025-09-15T21:22:58.661129] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:58.664239] [DEBUG] [LOCAL ] WIA: Loaded 3584 existing records from primary storage. [2025-09-15T21:22:58.664932] [INFO ] [MAIN ] WIA: Loaded 3584 primary data records. [2025-09-15T21:22:58.741165] [DEBUG] [LOCAL ] WHR: Loaded 35926 existing records from primary storage. [2025-09-15T21:22:58.758134] [INFO ] [MAIN ] WHR: Loaded 35926 primary data records. [2025-09-15T21:22:58.802796] [DEBUG] [LOCAL ] WINN: Loaded 7978 existing records from primary storage. [2025-09-15T21:22:58.857162] [INFO ] [MAIN ] WINN: Loaded 7978 primary data records. [2025-09-15T21:22:59.498595] [DEBUG] [MAIN ] WIA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:59.508506] [INFO ] [MAIN ] WIA: Generated 1326 derivative records from 3584 primary records. [2025-09-15T21:22:59.508925] [DEBUG] [MAIN ] WHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:22:59.509550] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-15T21:22:59.510068] [INFO ] [MAIN ] WHR: Generated 1326 derivative records from 35926 primary records. [2025-09-15T21:22:59.511896] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-15T21:22:59.539767] [DEBUG] [MAIN ] WINN: Filtered 5146 bins outside market hours, 5745 incomplete bins [2025-09-15T21:22:59.541666] [DEBUG] [LOCAL ] WIA: Derivative data saved (1326 records). [2025-09-15T21:22:59.542218] [INFO ] [MAIN ] WINN: Generated 1325 derivative records from 7978 primary records. [2025-09-15T21:22:59.543524] [DEBUG] [LOCAL ] WHR: Derivative data saved (1326 records). [2025-09-15T21:22:59.543607] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-15T21:22:59.543684] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-15T21:22:59.542472] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-15T21:22:59.549546] [INFO ] [MAIN ] Derivative Progress: 2017/2083 symbols completed. WHR took 1.0s. Estimated remaining: 21.9s. Rate: 181.2 symbols/min [2025-09-15T21:22:59.550312] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:59.562771] [DEBUG] [LOCAL ] WINN: Derivative data saved (1325 records). [2025-09-15T21:22:59.560074] [INFO ] [MAIN ] Derivative Progress: 2018/2083 symbols completed. WIA took 0.9s. Estimated remaining: 21.5s. Rate: 181.3 symbols/min [2025-09-15T21:22:59.563287] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-15T21:22:59.565420] [INFO ] [MAIN ] Derivative Progress: 2019/2083 symbols completed. WINN took 0.9s. Estimated remaining: 21.2s. Rate: 181.4 symbols/min [2025-09-15T21:22:59.563461] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:59.566145] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:22:59.588172] [DEBUG] [LOCAL ] WIW: Loaded 15323 existing records from primary storage. [2025-09-15T21:22:59.594913] [INFO ] [MAIN ] WIW: Loaded 15323 primary data records. [2025-09-15T21:22:59.734863] [DEBUG] [LOCAL ] WK: Loaded 26500 existing records from primary storage. [2025-09-15T21:22:59.769624] [INFO ] [MAIN ] WK: Loaded 26500 primary data records. [2025-09-15T21:22:59.778165] [DEBUG] [LOCAL ] WIT: Loaded 38645 existing records from primary storage. [2025-09-15T21:22:59.800996] [INFO ] [MAIN ] WIT: Loaded 38645 primary data records. [2025-09-15T21:23:00.476629] [DEBUG] [MAIN ] WIW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:00.477440] [INFO ] [MAIN ] WIW: Generated 1326 derivative records from 15323 primary records. [2025-09-15T21:23:00.477870] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-15T21:23:00.491226] [DEBUG] [LOCAL ] WIW: Derivative data saved (1326 records). [2025-09-15T21:23:00.491828] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-15T21:23:00.493478] [INFO ] [MAIN ] Derivative Progress: 2020/2083 symbols completed. WIW took 0.9s. Estimated remaining: 20.9s. Rate: 181.2 symbols/min [2025-09-15T21:23:00.494305] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:00.506773] [DEBUG] [MAIN ] WK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:00.507520] [INFO ] [MAIN ] WK: Generated 1326 derivative records from 26500 primary records. [2025-09-15T21:23:00.507669] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-15T21:23:00.517626] [DEBUG] [MAIN ] WIT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:00.523699] [INFO ] [MAIN ] WIT: Generated 1326 derivative records from 38645 primary records. [2025-09-15T21:23:00.526413] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-15T21:23:00.529776] [DEBUG] [LOCAL ] WK: Derivative data saved (1326 records). [2025-09-15T21:23:00.535500] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-15T21:23:00.537949] [INFO ] [MAIN ] Derivative Progress: 2021/2083 symbols completed. WK took 1.0s. Estimated remaining: 20.5s. Rate: 181.3 symbols/min [2025-09-15T21:23:00.540084] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:00.550724] [DEBUG] [LOCAL ] WIT: Derivative data saved (1326 records). [2025-09-15T21:23:00.550839] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-15T21:23:00.552251] [INFO ] [MAIN ] Derivative Progress: 2022/2083 symbols completed. WIT took 1.0s. Estimated remaining: 20.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:00.552582] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:00.564544] [DEBUG] [LOCAL ] WKC: Loaded 25611 existing records from primary storage. [2025-09-15T21:23:00.564792] [INFO ] [MAIN ] WKC: Loaded 25611 primary data records. [2025-09-15T21:23:00.612478] [DEBUG] [LOCAL ] WLKP: Loaded 4933 existing records from primary storage. [2025-09-15T21:23:00.675578] [INFO ] [MAIN ] WLKP: Loaded 4933 primary data records. [2025-09-15T21:23:00.862295] [DEBUG] [LOCAL ] WLK: Loaded 34071 existing records from primary storage. [2025-09-15T21:23:00.862736] [INFO ] [MAIN ] WLK: Loaded 34071 primary data records. [2025-09-15T21:23:01.396459] [DEBUG] [MAIN ] WKC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:01.398480] [INFO ] [MAIN ] WKC: Generated 1326 derivative records from 25611 primary records. [2025-09-15T21:23:01.399335] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-15T21:23:01.421105] [DEBUG] [LOCAL ] WKC: Derivative data saved (1326 records). [2025-09-15T21:23:01.419327] [DEBUG] [MAIN ] WLKP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:01.422019] [INFO ] [MAIN ] WLKP: Generated 1326 derivative records from 4933 primary records. [2025-09-15T21:23:01.422069] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-15T21:23:01.423868] [INFO ] [MAIN ] Derivative Progress: 2023/2083 symbols completed. WKC took 0.9s. Estimated remaining: 19.9s. Rate: 181.3 symbols/min [2025-09-15T21:23:01.424026] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-15T21:23:01.436630] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1326 records). [2025-09-15T21:23:01.436840] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-15T21:23:01.438671] [INFO ] [MAIN ] Derivative Progress: 2024/2083 symbols completed. WLKP took 0.9s. Estimated remaining: 19.5s. Rate: 181.3 symbols/min [2025-09-15T21:23:01.450118] [DEBUG] [MAIN ] WLK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:01.450636] [INFO ] [MAIN ] WLK: Generated 1326 derivative records from 34071 primary records. [2025-09-15T21:23:01.450715] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-15T21:23:01.461864] [DEBUG] [LOCAL ] WLK: Derivative data saved (1326 records). [2025-09-15T21:23:01.461920] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-15T21:23:01.463757] [INFO ] [MAIN ] Derivative Progress: 2025/2083 symbols completed. WLK took 0.9s. Estimated remaining: 19.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:01.464481] [INFO ] [MAIN ] WLTG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:01.464539] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:01.464443] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:01.468533] [DEBUG] [LOCAL ] WLTG: Loaded 885 existing records from primary storage. [2025-09-15T21:23:01.468683] [INFO ] [MAIN ] WLTG: Loaded 885 primary data records. [2025-09-15T21:23:01.555705] [DEBUG] [LOCAL ] WMK: Loaded 10738 existing records from primary storage. [2025-09-15T21:23:01.587358] [INFO ] [MAIN ] WMK: Loaded 10738 primary data records. [2025-09-15T21:23:01.734398] [DEBUG] [LOCAL ] WLY: Loaded 22301 existing records from primary storage. [2025-09-15T21:23:01.771739] [INFO ] [MAIN ] WLY: Loaded 22301 primary data records. [2025-09-15T21:23:02.369886] [DEBUG] [MAIN ] WLTG: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:23:02.371830] [INFO ] [MAIN ] WLTG: Generated 1324 derivative records from 885 primary records. [2025-09-15T21:23:02.372254] [DEBUG] [LOCAL ] WLTG: Saving derivative data. [2025-09-15T21:23:02.386467] [DEBUG] [LOCAL ] WLTG: Derivative data saved (1324 records). [2025-09-15T21:23:02.386664] [INFO ] [MAIN ] WLTG: Successfully saved derivative data. [2025-09-15T21:23:02.388487] [INFO ] [MAIN ] Derivative Progress: 2026/2083 symbols completed. WLTG took 0.9s. Estimated remaining: 18.9s. Rate: 181.3 symbols/min [2025-09-15T21:23:02.389751] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:02.404696] [DEBUG] [MAIN ] WMK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:02.405565] [INFO ] [MAIN ] WMK: Generated 1326 derivative records from 10738 primary records. [2025-09-15T21:23:02.405666] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-15T21:23:02.436944] [DEBUG] [LOCAL ] WMK: Derivative data saved (1326 records). [2025-09-15T21:23:02.437284] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-15T21:23:02.439388] [INFO ] [MAIN ] Derivative Progress: 2027/2083 symbols completed. WMK took 1.0s. Estimated remaining: 18.5s. Rate: 181.3 symbols/min [2025-09-15T21:23:02.436485] [DEBUG] [MAIN ] WLY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:02.440744] [INFO ] [MAIN ] WLY: Generated 1326 derivative records from 22301 primary records. [2025-09-15T21:23:02.440973] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:02.449368] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-15T21:23:02.463672] [DEBUG] [LOCAL ] WLY: Derivative data saved (1326 records). [2025-09-15T21:23:02.464492] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-15T21:23:02.466636] [INFO ] [MAIN ] Derivative Progress: 2028/2083 symbols completed. WLY took 1.0s. Estimated remaining: 18.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:02.476144] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:02.477123] [DEBUG] [LOCAL ] WMS: Loaded 29380 existing records from primary storage. [2025-09-15T21:23:02.477226] [INFO ] [MAIN ] WMS: Loaded 29380 primary data records. [2025-09-15T21:23:02.698052] [DEBUG] [LOCAL ] WNC: Loaded 28633 existing records from primary storage. [2025-09-15T21:23:02.707912] [INFO ] [MAIN ] WNC: Loaded 28633 primary data records. [2025-09-15T21:23:02.841210] [DEBUG] [LOCAL ] WNS: Loaded 29830 existing records from primary storage. [2025-09-15T21:23:02.872588] [INFO ] [MAIN ] WNS: Loaded 29830 primary data records. [2025-09-15T21:23:03.398318] [DEBUG] [MAIN ] WMS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:03.400372] [INFO ] [MAIN ] WMS: Generated 1326 derivative records from 29380 primary records. [2025-09-15T21:23:03.401374] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-15T21:23:03.415048] [DEBUG] [LOCAL ] WMS: Derivative data saved (1326 records). [2025-09-15T21:23:03.415403] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-15T21:23:03.417226] [INFO ] [MAIN ] Derivative Progress: 2029/2083 symbols completed. WMS took 1.0s. Estimated remaining: 17.9s. Rate: 181.2 symbols/min [2025-09-15T21:23:03.417665] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:03.443790] [DEBUG] [MAIN ] WNC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:03.445172] [INFO ] [MAIN ] WNC: Generated 1326 derivative records from 28633 primary records. [2025-09-15T21:23:03.445280] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-15T21:23:03.444423] [DEBUG] [MAIN ] WNS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:03.446487] [INFO ] [MAIN ] WNS: Generated 1326 derivative records from 29830 primary records. [2025-09-15T21:23:03.447027] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-15T21:23:03.473511] [DEBUG] [LOCAL ] WNC: Derivative data saved (1326 records). [2025-09-15T21:23:03.474447] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-15T21:23:03.474348] [DEBUG] [LOCAL ] WNS: Derivative data saved (1326 records). [2025-09-15T21:23:03.474706] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-15T21:23:03.476398] [INFO ] [MAIN ] Derivative Progress: 2030/2083 symbols completed. WNC took 1.0s. Estimated remaining: 17.5s. Rate: 181.3 symbols/min [2025-09-15T21:23:03.478828] [INFO ] [MAIN ] Derivative Progress: 2031/2083 symbols completed. WNS took 1.0s. Estimated remaining: 17.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:03.478560] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:03.488565] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:03.515581] [DEBUG] [LOCAL ] WOLF: Loaded 39499 existing records from primary storage. [2025-09-15T21:23:03.515749] [INFO ] [MAIN ] WOLF: Loaded 39499 primary data records. [2025-09-15T21:23:03.632205] [DEBUG] [LOCAL ] WOW: Loaded 21693 existing records from primary storage. [2025-09-15T21:23:03.647345] [DEBUG] [LOCAL ] WOR: Loaded 16653 existing records from primary storage. [2025-09-15T21:23:03.657697] [INFO ] [MAIN ] WOW: Loaded 21693 primary data records. [2025-09-15T21:23:03.684904] [INFO ] [MAIN ] WOR: Loaded 16653 primary data records. [2025-09-15T21:23:04.362955] [DEBUG] [MAIN ] WOLF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:04.364916] [INFO ] [MAIN ] WOLF: Generated 1326 derivative records from 39499 primary records. [2025-09-15T21:23:04.366082] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-15T21:23:04.392847] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1326 records). [2025-09-15T21:23:04.393757] [DEBUG] [MAIN ] WOW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:04.403974] [INFO ] [MAIN ] WOW: Generated 1326 derivative records from 21693 primary records. [2025-09-15T21:23:04.403132] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-15T21:23:04.406585] [INFO ] [MAIN ] Derivative Progress: 2032/2083 symbols completed. WOLF took 1.0s. Estimated remaining: 16.9s. Rate: 181.3 symbols/min [2025-09-15T21:23:04.406957] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:04.407083] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-15T21:23:04.407573] [DEBUG] [MAIN ] WOR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:04.409607] [INFO ] [MAIN ] WOR: Generated 1326 derivative records from 16653 primary records. [2025-09-15T21:23:04.410035] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-15T21:23:04.432046] [DEBUG] [LOCAL ] WOW: Derivative data saved (1326 records). [2025-09-15T21:23:04.432925] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-15T21:23:04.435390] [INFO ] [MAIN ] Derivative Progress: 2033/2083 symbols completed. WOW took 0.9s. Estimated remaining: 16.5s. Rate: 181.3 symbols/min [2025-09-15T21:23:04.436084] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:04.437145] [DEBUG] [LOCAL ] WOR: Derivative data saved (1326 records). [2025-09-15T21:23:04.437591] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-15T21:23:04.439881] [INFO ] [MAIN ] Derivative Progress: 2034/2083 symbols completed. WOR took 1.0s. Estimated remaining: 16.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:04.440168] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:04.494810] [DEBUG] [LOCAL ] WPP: Loaded 24616 existing records from primary storage. [2025-09-15T21:23:04.496170] [INFO ] [MAIN ] WPP: Loaded 24616 primary data records. [2025-09-15T21:23:04.528951] [DEBUG] [LOCAL ] WPC: Loaded 35651 existing records from primary storage. [2025-09-15T21:23:04.553940] [INFO ] [MAIN ] WPC: Loaded 35651 primary data records. [2025-09-15T21:23:04.694416] [DEBUG] [LOCAL ] WPM: Loaded 38840 existing records from primary storage. [2025-09-15T21:23:04.747967] [INFO ] [MAIN ] WPM: Loaded 38840 primary data records. [2025-09-15T21:23:05.386483] [DEBUG] [MAIN ] WPP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:05.387337] [INFO ] [MAIN ] WPP: Generated 1326 derivative records from 24616 primary records. [2025-09-15T21:23:05.396585] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-15T21:23:05.396936] [DEBUG] [MAIN ] WPC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:05.398230] [INFO ] [MAIN ] WPC: Generated 1326 derivative records from 35651 primary records. [2025-09-15T21:23:05.398935] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-15T21:23:05.432495] [DEBUG] [LOCAL ] WPC: Derivative data saved (1326 records). [2025-09-15T21:23:05.432703] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-15T21:23:05.434716] [INFO ] [MAIN ] Derivative Progress: 2035/2083 symbols completed. WPC took 1.0s. Estimated remaining: 15.9s. Rate: 181.2 symbols/min [2025-09-15T21:23:05.432590] [DEBUG] [LOCAL ] WPP: Derivative data saved (1326 records). [2025-09-15T21:23:05.434970] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:05.435217] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-15T21:23:05.435611] [DEBUG] [MAIN ] WPM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:05.436950] [INFO ] [MAIN ] Derivative Progress: 2036/2083 symbols completed. WPP took 1.0s. Estimated remaining: 15.6s. Rate: 181.3 symbols/min [2025-09-15T21:23:05.437872] [INFO ] [MAIN ] WPM: Generated 1326 derivative records from 38840 primary records. [2025-09-15T21:23:05.438300] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-15T21:23:05.438249] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:05.451756] [DEBUG] [LOCAL ] WPM: Derivative data saved (1326 records). [2025-09-15T21:23:05.451917] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-15T21:23:05.454323] [INFO ] [MAIN ] Derivative Progress: 2037/2083 symbols completed. WPM took 1.0s. Estimated remaining: 15.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:05.454657] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:05.491506] [DEBUG] [LOCAL ] WS: Loaded 16722 existing records from primary storage. [2025-09-15T21:23:05.491741] [INFO ] [MAIN ] WS: Loaded 16722 primary data records. [2025-09-15T21:23:05.617406] [DEBUG] [LOCAL ] WRBY: Loaded 37252 existing records from primary storage. [2025-09-15T21:23:05.618026] [DEBUG] [LOCAL ] WRB: Loaded 37168 existing records from primary storage. [2025-09-15T21:23:05.618181] [INFO ] [MAIN ] WRBY: Loaded 37252 primary data records. [2025-09-15T21:23:05.628996] [INFO ] [MAIN ] WRB: Loaded 37168 primary data records. [2025-09-15T21:23:06.344807] [DEBUG] [MAIN ] WS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:06.346886] [INFO ] [MAIN ] WS: Generated 1326 derivative records from 16722 primary records. [2025-09-15T21:23:06.347391] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-15T21:23:06.367004] [DEBUG] [LOCAL ] WS: Derivative data saved (1326 records). [2025-09-15T21:23:06.384079] [DEBUG] [MAIN ] WRB: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:06.377427] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-15T21:23:06.389810] [INFO ] [MAIN ] Derivative Progress: 2038/2083 symbols completed. WS took 0.9s. Estimated remaining: 14.9s. Rate: 181.3 symbols/min [2025-09-15T21:23:06.395886] [INFO ] [MAIN ] WRB: Generated 1326 derivative records from 37168 primary records. [2025-09-15T21:23:06.396390] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-15T21:23:06.396708] [DEBUG] [MAIN ] WRBY: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:06.398367] [INFO ] [MAIN ] WRBY: Generated 1326 derivative records from 37252 primary records. [2025-09-15T21:23:06.398713] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-15T21:23:06.420671] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1326 records). [2025-09-15T21:23:06.421496] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-15T21:23:06.424125] [INFO ] [MAIN ] Derivative Progress: 2039/2083 symbols completed. WRBY took 1.0s. Estimated remaining: 14.6s. Rate: 181.3 symbols/min [2025-09-15T21:23:06.425969] [DEBUG] [LOCAL ] WRB: Derivative data saved (1326 records). [2025-09-15T21:23:06.426133] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-15T21:23:06.428225] [INFO ] [MAIN ] Derivative Progress: 2040/2083 symbols completed. WRB took 1.0s. Estimated remaining: 14.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:06.428853] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:06.429175] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:06.429061] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:06.456548] [DEBUG] [LOCAL ] WSR: Loaded 16664 existing records from primary storage. [2025-09-15T21:23:06.463673] [INFO ] [MAIN ] WSR: Loaded 16664 primary data records. [2025-09-15T21:23:06.464444] [DEBUG] [LOCAL ] WSO: Loaded 18371 existing records from primary storage. [2025-09-15T21:23:06.486815] [INFO ] [MAIN ] WSO: Loaded 18371 primary data records. [2025-09-15T21:23:06.783302] [DEBUG] [LOCAL ] WSM: Loaded 36548 existing records from primary storage. [2025-09-15T21:23:06.827512] [INFO ] [MAIN ] WSM: Loaded 36548 primary data records. [2025-09-15T21:23:07.400034] [DEBUG] [MAIN ] WSO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:07.401673] [INFO ] [MAIN ] WSO: Generated 1326 derivative records from 18371 primary records. [2025-09-15T21:23:07.400751] [DEBUG] [MAIN ] WSR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:07.402502] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-15T21:23:07.402296] [INFO ] [MAIN ] WSR: Generated 1326 derivative records from 16664 primary records. [2025-09-15T21:23:07.403548] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-15T21:23:07.428232] [DEBUG] [LOCAL ] WSO: Derivative data saved (1326 records). [2025-09-15T21:23:07.428451] [DEBUG] [LOCAL ] WSR: Derivative data saved (1326 records). [2025-09-15T21:23:07.429354] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-15T21:23:07.428603] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-15T21:23:07.431309] [INFO ] [MAIN ] Derivative Progress: 2041/2083 symbols completed. WSR took 1.0s. Estimated remaining: 13.9s. Rate: 181.2 symbols/min [2025-09-15T21:23:07.433098] [INFO ] [MAIN ] Derivative Progress: 2042/2083 symbols completed. WSO took 1.0s. Estimated remaining: 13.6s. Rate: 181.3 symbols/min [2025-09-15T21:23:07.434743] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:07.434142] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:07.445761] [DEBUG] [MAIN ] WSM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:07.446434] [INFO ] [MAIN ] WSM: Generated 1326 derivative records from 36548 primary records. [2025-09-15T21:23:07.446575] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-15T21:23:07.458917] [DEBUG] [LOCAL ] WSM: Derivative data saved (1326 records). [2025-09-15T21:23:07.459003] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-15T21:23:07.461452] [INFO ] [MAIN ] Derivative Progress: 2043/2083 symbols completed. WSM took 1.0s. Estimated remaining: 13.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:07.461721] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:07.492610] [DEBUG] [LOCAL ] WST: Loaded 26781 existing records from primary storage. [2025-09-15T21:23:07.492775] [INFO ] [MAIN ] WST: Loaded 26781 primary data records. [2025-09-15T21:23:07.628199] [DEBUG] [LOCAL ] WTI: Loaded 32570 existing records from primary storage. [2025-09-15T21:23:07.634178] [DEBUG] [LOCAL ] WT: Loaded 34911 existing records from primary storage. [2025-09-15T21:23:07.634551] [INFO ] [MAIN ] WT: Loaded 34911 primary data records. [2025-09-15T21:23:07.634465] [INFO ] [MAIN ] WTI: Loaded 32570 primary data records. [2025-09-15T21:23:08.402414] [DEBUG] [MAIN ] WST: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:08.404142] [INFO ] [MAIN ] WST: Generated 1326 derivative records from 26781 primary records. [2025-09-15T21:23:08.404896] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-15T21:23:08.421581] [DEBUG] [LOCAL ] WST: Derivative data saved (1326 records). [2025-09-15T21:23:08.421924] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-15T21:23:08.429633] [INFO ] [MAIN ] Derivative Progress: 2044/2083 symbols completed. WST took 1.0s. Estimated remaining: 12.9s. Rate: 181.2 symbols/min [2025-09-15T21:23:08.434718] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:08.435073] [DEBUG] [MAIN ] WTI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:08.436243] [INFO ] [MAIN ] WTI: Generated 1326 derivative records from 32570 primary records. [2025-09-15T21:23:08.437546] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-15T21:23:08.454256] [DEBUG] [LOCAL ] WTI: Derivative data saved (1326 records). [2025-09-15T21:23:08.468924] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-15T21:23:08.471860] [INFO ] [MAIN ] Derivative Progress: 2045/2083 symbols completed. WTI took 1.0s. Estimated remaining: 12.6s. Rate: 181.3 symbols/min [2025-09-15T21:23:08.469538] [DEBUG] [MAIN ] WT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:08.473408] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:08.473301] [INFO ] [MAIN ] WT: Generated 1326 derivative records from 34911 primary records. [2025-09-15T21:23:08.473538] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-15T21:23:08.496307] [DEBUG] [LOCAL ] WT: Derivative data saved (1326 records). [2025-09-15T21:23:08.496508] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-15T21:23:08.498420] [INFO ] [MAIN ] Derivative Progress: 2046/2083 symbols completed. WT took 1.1s. Estimated remaining: 12.2s. Rate: 181.4 symbols/min [2025-09-15T21:23:08.498976] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:08.515095] [DEBUG] [LOCAL ] WTS: Loaded 13393 existing records from primary storage. [2025-09-15T21:23:08.515246] [INFO ] [MAIN ] WTS: Loaded 13393 primary data records. [2025-09-15T21:23:08.702330] [DEBUG] [LOCAL ] WTRG: Loaded 37524 existing records from primary storage. [2025-09-15T21:23:08.735199] [INFO ] [MAIN ] WTRG: Loaded 37524 primary data records. [2025-09-15T21:23:08.744978] [DEBUG] [LOCAL ] WTTR: Loaded 32214 existing records from primary storage. [2025-09-15T21:23:08.771721] [INFO ] [MAIN ] WTTR: Loaded 32214 primary data records. [2025-09-15T21:23:09.632421] [DEBUG] [MAIN ] WTS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:09.731256] [INFO ] [MAIN ] WTS: Generated 1326 derivative records from 13393 primary records. [2025-09-15T21:23:09.737938] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-15T21:23:09.756064] [DEBUG] [LOCAL ] WTS: Derivative data saved (1326 records). [2025-09-15T21:23:09.757193] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-15T21:23:09.759153] [INFO ] [MAIN ] Derivative Progress: 2047/2083 symbols completed. WTS took 1.3s. Estimated remaining: 11.9s. Rate: 181.1 symbols/min [2025-09-15T21:23:09.760162] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:09.792736] [DEBUG] [MAIN ] WTTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:09.792920] [DEBUG] [MAIN ] WTRG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:09.794777] [INFO ] [MAIN ] WTRG: Generated 1326 derivative records from 37524 primary records. [2025-09-15T21:23:09.794860] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-15T21:23:09.794176] [INFO ] [MAIN ] WTTR: Generated 1326 derivative records from 32214 primary records. [2025-09-15T21:23:09.795683] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-15T21:23:09.845893] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1326 records). [2025-09-15T21:23:09.845350] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1326 records). [2025-09-15T21:23:09.846227] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-15T21:23:09.846144] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-15T21:23:09.849692] [INFO ] [MAIN ] Derivative Progress: 2048/2083 symbols completed. WTRG took 1.4s. Estimated remaining: 11.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:09.852888] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:09.853073] [INFO ] [MAIN ] Derivative Progress: 2049/2083 symbols completed. WTTR took 1.4s. Estimated remaining: 11.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:09.853721] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:09.869721] [DEBUG] [LOCAL ] WU: Loaded 39483 existing records from primary storage. [2025-09-15T21:23:09.869938] [INFO ] [MAIN ] WU: Loaded 39483 primary data records. [2025-09-15T21:23:10.051161] [DEBUG] [LOCAL ] XFLT: Loaded 21402 existing records from primary storage. [2025-09-15T21:23:10.074450] [INFO ] [MAIN ] XFLT: Loaded 21402 primary data records. [2025-09-15T21:23:10.284372] [DEBUG] [LOCAL ] WWW: Loaded 36204 existing records from primary storage. [2025-09-15T21:23:10.306087] [INFO ] [MAIN ] WWW: Loaded 36204 primary data records. [2025-09-15T21:23:10.770586] [DEBUG] [MAIN ] WU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:10.771426] [INFO ] [MAIN ] WU: Generated 1326 derivative records from 39483 primary records. [2025-09-15T21:23:10.771704] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-15T21:23:10.788219] [DEBUG] [LOCAL ] WU: Derivative data saved (1326 records). [2025-09-15T21:23:10.788511] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-15T21:23:10.791294] [INFO ] [MAIN ] Derivative Progress: 2050/2083 symbols completed. WU took 1.0s. Estimated remaining: 10.9s. Rate: 181.1 symbols/min [2025-09-15T21:23:10.792007] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:10.805104] [DEBUG] [MAIN ] XFLT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:10.805756] [INFO ] [MAIN ] XFLT: Generated 1326 derivative records from 21402 primary records. [2025-09-15T21:23:10.805846] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-15T21:23:10.818505] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1326 records). [2025-09-15T21:23:10.818709] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-15T21:23:10.820358] [INFO ] [MAIN ] Derivative Progress: 2051/2083 symbols completed. XFLT took 1.0s. Estimated remaining: 10.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:10.820828] [INFO ] [MAIN ] XIFR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:10.837170] [DEBUG] [MAIN ] WWW: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:10.838138] [INFO ] [MAIN ] WWW: Generated 1326 derivative records from 36204 primary records. [2025-09-15T21:23:10.838297] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-15T21:23:10.893497] [DEBUG] [LOCAL ] XHR: Loaded 32506 existing records from primary storage. [2025-09-15T21:23:10.893598] [DEBUG] [LOCAL ] WWW: Derivative data saved (1326 records). [2025-09-15T21:23:10.906535] [INFO ] [MAIN ] XHR: Loaded 32506 primary data records. [2025-09-15T21:23:10.907379] [DEBUG] [LOCAL ] XIFR: Loaded 32769 existing records from primary storage. [2025-09-15T21:23:10.906629] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-15T21:23:10.910553] [INFO ] [MAIN ] Derivative Progress: 2052/2083 symbols completed. WWW took 1.1s. Estimated remaining: 10.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:10.910742] [INFO ] [MAIN ] XIFR: Loaded 32769 primary data records. [2025-09-15T21:23:10.910958] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:11.193440] [DEBUG] [LOCAL ] XPER: Loaded 21716 existing records from primary storage. [2025-09-15T21:23:11.239344] [INFO ] [MAIN ] XPER: Loaded 21716 primary data records. [2025-09-15T21:23:11.806538] [DEBUG] [MAIN ] XHR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:11.809426] [INFO ] [MAIN ] XHR: Generated 1326 derivative records from 32506 primary records. [2025-09-15T21:23:11.809846] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-15T21:23:11.833217] [DEBUG] [LOCAL ] XHR: Derivative data saved (1326 records). [2025-09-15T21:23:11.833463] [DEBUG] [MAIN ] XIFR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:11.833742] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-15T21:23:11.835888] [INFO ] [MAIN ] Derivative Progress: 2053/2083 symbols completed. XHR took 1.0s. Estimated remaining: 9.9s. Rate: 181.1 symbols/min [2025-09-15T21:23:11.834324] [INFO ] [MAIN ] XIFR: Generated 1326 derivative records from 32769 primary records. [2025-09-15T21:23:11.836258] [DEBUG] [LOCAL ] XIFR: Saving derivative data. [2025-09-15T21:23:11.859033] [DEBUG] [LOCAL ] XIFR: Derivative data saved (1326 records). [2025-09-15T21:23:11.859236] [DEBUG] [MAIN ] XPER: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:11.859313] [INFO ] [MAIN ] XIFR: Successfully saved derivative data. [2025-09-15T21:23:11.861667] [INFO ] [MAIN ] Derivative Progress: 2054/2083 symbols completed. XIFR took 1.0s. Estimated remaining: 9.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:11.859895] [INFO ] [MAIN ] XPER: Generated 1326 derivative records from 21716 primary records. [2025-09-15T21:23:11.861840] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-15T21:23:11.872878] [DEBUG] [LOCAL ] XPER: Derivative data saved (1326 records). [2025-09-15T21:23:11.872935] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-15T21:23:11.874771] [INFO ] [MAIN ] Derivative Progress: 2055/2083 symbols completed. XPER took 1.0s. Estimated remaining: 9.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:11.875161] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:11.875352] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:11.875411] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:11.920301] [DEBUG] [LOCAL ] XPOF: Loaded 28011 existing records from primary storage. [2025-09-15T21:23:11.920493] [INFO ] [MAIN ] XPOF: Loaded 28011 primary data records. [2025-09-15T21:23:12.043096] [DEBUG] [LOCAL ] XPRO: Loaded 33658 existing records from primary storage. [2025-09-15T21:23:12.043698] [DEBUG] [LOCAL ] XPEV: Loaded 39608 existing records from primary storage. [2025-09-15T21:23:12.059745] [INFO ] [MAIN ] XPRO: Loaded 33658 primary data records. [2025-09-15T21:23:12.070079] [INFO ] [MAIN ] XPEV: Loaded 39608 primary data records. [2025-09-15T21:23:12.776934] [DEBUG] [MAIN ] XPOF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:12.777762] [INFO ] [MAIN ] XPOF: Generated 1326 derivative records from 28011 primary records. [2025-09-15T21:23:12.777931] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-15T21:23:12.794281] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1326 records). [2025-09-15T21:23:12.803590] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-15T21:23:12.810272] [INFO ] [MAIN ] Derivative Progress: 2056/2083 symbols completed. XPOF took 0.9s. Estimated remaining: 8.9s. Rate: 181.1 symbols/min [2025-09-15T21:23:12.813854] [DEBUG] [MAIN ] XPEV: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:12.814211] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:12.814902] [INFO ] [MAIN ] XPEV: Generated 1326 derivative records from 39608 primary records. [2025-09-15T21:23:12.815297] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-15T21:23:12.815215] [DEBUG] [MAIN ] XPRO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:12.816716] [INFO ] [MAIN ] XPRO: Generated 1326 derivative records from 33658 primary records. [2025-09-15T21:23:12.817058] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-15T21:23:12.838155] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1326 records). [2025-09-15T21:23:12.841260] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-15T21:23:12.841328] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1326 records). [2025-09-15T21:23:12.843540] [INFO ] [MAIN ] Derivative Progress: 2057/2083 symbols completed. XPEV took 1.0s. Estimated remaining: 8.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:12.844012] [INFO ] [MAIN ] XYZ: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:12.843792] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-15T21:23:12.846006] [INFO ] [MAIN ] Derivative Progress: 2058/2083 symbols completed. XPRO took 1.0s. Estimated remaining: 8.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:12.846713] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:12.867371] [DEBUG] [LOCAL ] XYF: Loaded 21687 existing records from primary storage. [2025-09-15T21:23:12.867706] [INFO ] [MAIN ] XYF: Loaded 21687 primary data records. [2025-09-15T21:23:13.168284] [DEBUG] [LOCAL ] YALA: Loaded 28375 existing records from primary storage. [2025-09-15T21:23:13.169102] [INFO ] [MAIN ] YALA: Loaded 28375 primary data records. [2025-09-15T21:23:13.169006] [DEBUG] [LOCAL ] XYZ: Loaded 39714 existing records from primary storage. [2025-09-15T21:23:13.169496] [INFO ] [MAIN ] XYZ: Loaded 39714 primary data records. [2025-09-15T21:23:13.758354] [DEBUG] [MAIN ] XYF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:13.759689] [INFO ] [MAIN ] XYF: Generated 1326 derivative records from 21687 primary records. [2025-09-15T21:23:13.762101] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-15T21:23:13.778548] [DEBUG] [LOCAL ] XYF: Derivative data saved (1326 records). [2025-09-15T21:23:13.778632] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-15T21:23:13.780482] [INFO ] [MAIN ] Derivative Progress: 2059/2083 symbols completed. XYF took 1.0s. Estimated remaining: 7.9s. Rate: 181.1 symbols/min [2025-09-15T21:23:13.780689] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:13.809044] [DEBUG] [MAIN ] YALA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:13.810408] [INFO ] [MAIN ] YALA: Generated 1326 derivative records from 28375 primary records. [2025-09-15T21:23:13.809418] [DEBUG] [MAIN ] XYZ: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:13.810618] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-15T21:23:13.811520] [INFO ] [MAIN ] XYZ: Generated 1326 derivative records from 39714 primary records. [2025-09-15T21:23:13.812149] [DEBUG] [LOCAL ] XYZ: Saving derivative data. [2025-09-15T21:23:13.837461] [DEBUG] [LOCAL ] XYZ: Derivative data saved (1326 records). [2025-09-15T21:23:13.837782] [INFO ] [MAIN ] XYZ: Successfully saved derivative data. [2025-09-15T21:23:13.837589] [DEBUG] [LOCAL ] YALA: Derivative data saved (1326 records). [2025-09-15T21:23:13.837920] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-15T21:23:13.839693] [INFO ] [MAIN ] Derivative Progress: 2060/2083 symbols completed. YALA took 1.0s. Estimated remaining: 7.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:13.839917] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:13.843544] [INFO ] [MAIN ] Derivative Progress: 2061/2083 symbols completed. XYZ took 1.0s. Estimated remaining: 7.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:13.853089] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:13.869149] [DEBUG] [LOCAL ] YELP: Loaded 33170 existing records from primary storage. [2025-09-15T21:23:13.869359] [INFO ] [MAIN ] YELP: Loaded 33170 primary data records. [2025-09-15T21:23:14.138021] [DEBUG] [LOCAL ] YEXT: Loaded 31323 existing records from primary storage. [2025-09-15T21:23:14.173691] [INFO ] [MAIN ] YEXT: Loaded 31323 primary data records. [2025-09-15T21:23:14.174587] [DEBUG] [LOCAL ] YETI: Loaded 39025 existing records from primary storage. [2025-09-15T21:23:14.186461] [INFO ] [MAIN ] YETI: Loaded 39025 primary data records. [2025-09-15T21:23:14.797558] [DEBUG] [MAIN ] YELP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:14.799255] [INFO ] [MAIN ] YELP: Generated 1326 derivative records from 33170 primary records. [2025-09-15T21:23:14.799816] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-15T21:23:14.816404] [DEBUG] [LOCAL ] YELP: Derivative data saved (1326 records). [2025-09-15T21:23:14.817199] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-15T21:23:14.828275] [INFO ] [MAIN ] Derivative Progress: 2062/2083 symbols completed. YELP took 1.0s. Estimated remaining: 7.0s. Rate: 181.1 symbols/min [2025-09-15T21:23:14.829124] [DEBUG] [MAIN ] YEXT: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:14.829174] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:14.829841] [INFO ] [MAIN ] YEXT: Generated 1326 derivative records from 31323 primary records. [2025-09-15T21:23:14.839255] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-15T21:23:14.839408] [DEBUG] [MAIN ] YETI: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:14.840859] [INFO ] [MAIN ] YETI: Generated 1326 derivative records from 39025 primary records. [2025-09-15T21:23:14.847100] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-15T21:23:14.862298] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1326 records). [2025-09-15T21:23:14.862969] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-15T21:23:14.864872] [INFO ] [MAIN ] Derivative Progress: 2063/2083 symbols completed. YEXT took 1.0s. Estimated remaining: 6.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:14.865395] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:14.866195] [DEBUG] [LOCAL ] YETI: Derivative data saved (1326 records). [2025-09-15T21:23:14.866592] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-15T21:23:14.868447] [INFO ] [MAIN ] Derivative Progress: 2064/2083 symbols completed. YETI took 1.0s. Estimated remaining: 6.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:14.868814] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:14.917356] [DEBUG] [LOCAL ] YMM: Loaded 38810 existing records from primary storage. [2025-09-15T21:23:14.917530] [INFO ] [MAIN ] YMM: Loaded 38810 primary data records. [2025-09-15T21:23:15.045593] [DEBUG] [LOCAL ] YOU: Loaded 36560 existing records from primary storage. [2025-09-15T21:23:15.046452] [DEBUG] [LOCAL ] YPF: Loaded 37011 existing records from primary storage. [2025-09-15T21:23:15.046701] [INFO ] [MAIN ] YOU: Loaded 36560 primary data records. [2025-09-15T21:23:15.046760] [INFO ] [MAIN ] YPF: Loaded 37011 primary data records. [2025-09-15T21:23:15.744034] [DEBUG] [MAIN ] YMM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:15.745112] [INFO ] [MAIN ] YMM: Generated 1326 derivative records from 38810 primary records. [2025-09-15T21:23:15.745512] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-15T21:23:15.779005] [DEBUG] [MAIN ] YOU: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:15.779267] [DEBUG] [MAIN ] YPF: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:15.780837] [INFO ] [MAIN ] YPF: Generated 1326 derivative records from 37011 primary records. [2025-09-15T21:23:15.781683] [INFO ] [MAIN ] YOU: Generated 1326 derivative records from 36560 primary records. [2025-09-15T21:23:15.782195] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-15T21:23:15.783116] [DEBUG] [LOCAL ] YMM: Derivative data saved (1326 records). [2025-09-15T21:23:15.782720] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-15T21:23:15.783203] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-15T21:23:15.797761] [INFO ] [MAIN ] Derivative Progress: 2065/2083 symbols completed. YMM took 1.0s. Estimated remaining: 6.0s. Rate: 181.1 symbols/min [2025-09-15T21:23:15.801464] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:15.813289] [DEBUG] [LOCAL ] YPF: Derivative data saved (1326 records). [2025-09-15T21:23:15.813215] [DEBUG] [LOCAL ] YOU: Derivative data saved (1326 records). [2025-09-15T21:23:15.813467] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-15T21:23:15.813505] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-15T21:23:15.815292] [INFO ] [MAIN ] Derivative Progress: 2066/2083 symbols completed. YOU took 1.0s. Estimated remaining: 5.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:15.821894] [INFO ] [MAIN ] Derivative Progress: 2067/2083 symbols completed. YPF took 0.9s. Estimated remaining: 5.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:15.821849] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:15.821681] [DEBUG] [LOCAL ] YRD: Loaded 7931 existing records from primary storage. [2025-09-15T21:23:15.822239] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:15.822549] [INFO ] [MAIN ] YRD: Loaded 7931 primary data records. [2025-09-15T21:23:16.020233] [DEBUG] [LOCAL ] YSG: Loaded 19604 existing records from primary storage. [2025-09-15T21:23:16.103723] [INFO ] [MAIN ] YSG: Loaded 19604 primary data records. [2025-09-15T21:23:16.220690] [DEBUG] [LOCAL ] YUMC: Loaded 38787 existing records from primary storage. [2025-09-15T21:23:16.221438] [INFO ] [MAIN ] YUMC: Loaded 38787 primary data records. [2025-09-15T21:23:16.656326] [DEBUG] [MAIN ] YRD: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:16.657175] [INFO ] [MAIN ] YRD: Generated 1326 derivative records from 7931 primary records. [2025-09-15T21:23:16.658184] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-15T21:23:16.671400] [DEBUG] [LOCAL ] YRD: Derivative data saved (1326 records). [2025-09-15T21:23:16.671795] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-15T21:23:16.673298] [INFO ] [MAIN ] Derivative Progress: 2068/2083 symbols completed. YRD took 0.9s. Estimated remaining: 5.0s. Rate: 181.2 symbols/min [2025-09-15T21:23:16.686692] [DEBUG] [MAIN ] YSG: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:16.687268] [INFO ] [MAIN ] YSG: Generated 1326 derivative records from 19604 primary records. [2025-09-15T21:23:16.687498] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-15T21:23:16.701033] [DEBUG] [LOCAL ] YSG: Derivative data saved (1326 records). [2025-09-15T21:23:16.710013] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-15T21:23:16.711549] [INFO ] [MAIN ] Derivative Progress: 2069/2083 symbols completed. YSG took 0.9s. Estimated remaining: 4.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:16.711740] [DEBUG] [MAIN ] YUMC: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:16.712428] [INFO ] [MAIN ] YUMC: Generated 1326 derivative records from 38787 primary records. [2025-09-15T21:23:16.712490] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-15T21:23:16.723814] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1326 records). [2025-09-15T21:23:16.723870] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-15T21:23:16.726379] [INFO ] [MAIN ] Derivative Progress: 2070/2083 symbols completed. YUMC took 0.9s. Estimated remaining: 4.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:16.727074] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:16.726885] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:16.727033] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:16.744551] [DEBUG] [LOCAL ] ZEPP: Loaded 14555 existing records from primary storage. [2025-09-15T21:23:16.744763] [INFO ] [MAIN ] ZEPP: Loaded 14555 primary data records. [2025-09-15T21:23:17.060980] [DEBUG] [LOCAL ] ZBH: Loaded 37687 existing records from primary storage. [2025-09-15T21:23:17.082350] [INFO ] [MAIN ] ZBH: Loaded 37687 primary data records. [2025-09-15T21:23:17.103841] [DEBUG] [LOCAL ] ZETA: Loaded 39592 existing records from primary storage. [2025-09-15T21:23:17.147043] [INFO ] [MAIN ] ZETA: Loaded 39592 primary data records. [2025-09-15T21:23:17.624748] [DEBUG] [MAIN ] ZEPP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:17.626330] [INFO ] [MAIN ] ZEPP: Generated 1326 derivative records from 14555 primary records. [2025-09-15T21:23:17.626812] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-15T21:23:17.641741] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1326 records). [2025-09-15T21:23:17.642695] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-15T21:23:17.645844] [INFO ] [MAIN ] Derivative Progress: 2071/2083 symbols completed. ZEPP took 0.9s. Estimated remaining: 4.0s. Rate: 181.2 symbols/min [2025-09-15T21:23:17.646451] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:17.657667] [DEBUG] [MAIN ] ZBH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:17.660154] [INFO ] [MAIN ] ZBH: Generated 1326 derivative records from 37687 primary records. [2025-09-15T21:23:17.660458] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-15T21:23:17.680012] [DEBUG] [MAIN ] ZETA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:17.682876] [INFO ] [MAIN ] ZETA: Generated 1326 derivative records from 39592 primary records. [2025-09-15T21:23:17.683038] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-15T21:23:17.683487] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1326 records). [2025-09-15T21:23:17.684113] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-15T21:23:17.685813] [INFO ] [MAIN ] Derivative Progress: 2072/2083 symbols completed. ZBH took 1.0s. Estimated remaining: 3.6s. Rate: 181.2 symbols/min [2025-09-15T21:23:17.686058] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:17.697902] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1326 records). [2025-09-15T21:23:17.698081] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-15T21:23:17.700104] [INFO ] [MAIN ] Derivative Progress: 2073/2083 symbols completed. ZETA took 1.0s. Estimated remaining: 3.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:17.707846] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:17.726833] [DEBUG] [LOCAL ] ZGN: Loaded 30033 existing records from primary storage. [2025-09-15T21:23:17.727059] [INFO ] [MAIN ] ZGN: Loaded 30033 primary data records. [2025-09-15T21:23:17.804158] [DEBUG] [LOCAL ] ZH: Loaded 17838 existing records from primary storage. [2025-09-15T21:23:17.816107] [INFO ] [MAIN ] ZH: Loaded 17838 primary data records. [2025-09-15T21:23:18.128672] [DEBUG] [LOCAL ] ZIM: Loaded 39530 existing records from primary storage. [2025-09-15T21:23:18.135059] [INFO ] [MAIN ] ZIM: Loaded 39530 primary data records. [2025-09-15T21:23:18.571355] [DEBUG] [MAIN ] ZGN: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:18.573547] [INFO ] [MAIN ] ZGN: Generated 1326 derivative records from 30033 primary records. [2025-09-15T21:23:18.574253] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-15T21:23:18.592481] [DEBUG] [MAIN ] ZH: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:18.598355] [INFO ] [MAIN ] ZH: Generated 1326 derivative records from 17838 primary records. [2025-09-15T21:23:18.597693] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1326 records). [2025-09-15T21:23:18.598473] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-15T21:23:18.600454] [INFO ] [MAIN ] Derivative Progress: 2074/2083 symbols completed. ZGN took 1.0s. Estimated remaining: 3.0s. Rate: 181.2 symbols/min [2025-09-15T21:23:18.598745] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-15T21:23:18.601848] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:18.616970] [DEBUG] [LOCAL ] ZH: Derivative data saved (1326 records). [2025-09-15T21:23:18.617245] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-15T21:23:18.619143] [INFO ] [MAIN ] Derivative Progress: 2075/2083 symbols completed. ZH took 0.9s. Estimated remaining: 2.6s. Rate: 181.3 symbols/min [2025-09-15T21:23:18.629145] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:18.629586] [DEBUG] [MAIN ] ZIM: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:18.630932] [INFO ] [MAIN ] ZIM: Generated 1326 derivative records from 39530 primary records. [2025-09-15T21:23:18.631204] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-15T21:23:18.664216] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1326 records). [2025-09-15T21:23:18.664408] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-15T21:23:18.664962] [DEBUG] [LOCAL ] ZIP: Loaded 32069 existing records from primary storage. [2025-09-15T21:23:18.665157] [INFO ] [MAIN ] ZIP: Loaded 32069 primary data records. [2025-09-15T21:23:18.667376] [INFO ] [MAIN ] Derivative Progress: 2076/2083 symbols completed. ZIM took 1.0s. Estimated remaining: 2.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:18.667797] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:18.809108] [DEBUG] [LOCAL ] ZK: Loaded 28129 existing records from primary storage. [2025-09-15T21:23:18.844520] [INFO ] [MAIN ] ZK: Loaded 28129 primary data records. [2025-09-15T21:23:18.877187] [DEBUG] [LOCAL ] ZKH: Loaded 5780 existing records from primary storage. [2025-09-15T21:23:18.963590] [INFO ] [MAIN ] ZKH: Loaded 5780 primary data records. [2025-09-15T21:23:19.576272] [DEBUG] [MAIN ] ZIP: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:19.577442] [INFO ] [MAIN ] ZIP: Generated 1326 derivative records from 32069 primary records. [2025-09-15T21:23:19.577615] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-15T21:23:19.591033] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1326 records). [2025-09-15T21:23:19.592068] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-15T21:23:19.594179] [INFO ] [MAIN ] Derivative Progress: 2077/2083 symbols completed. ZIP took 1.0s. Estimated remaining: 2.0s. Rate: 181.2 symbols/min [2025-09-15T21:23:19.594478] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:19.605215] [DEBUG] [MAIN ] ZK: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:19.605886] [INFO ] [MAIN ] ZK: Generated 1326 derivative records from 28129 primary records. [2025-09-15T21:23:19.606061] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-15T21:23:19.619243] [DEBUG] [LOCAL ] ZK: Derivative data saved (1326 records). [2025-09-15T21:23:19.620405] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-15T21:23:19.622970] [INFO ] [MAIN ] Derivative Progress: 2078/2083 symbols completed. ZK took 1.0s. Estimated remaining: 1.7s. Rate: 181.3 symbols/min [2025-09-15T21:23:19.623813] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:19.634582] [DEBUG] [MAIN ] ZKH: Filtered 5146 bins outside market hours, 5746 incomplete bins [2025-09-15T21:23:19.635299] [INFO ] [MAIN ] ZKH: Generated 1324 derivative records from 5780 primary records. [2025-09-15T21:23:19.635470] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-15T21:23:19.658123] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1324 records). [2025-09-15T21:23:19.662892] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-15T21:23:19.663112] [DEBUG] [LOCAL ] ZTR: Loaded 12151 existing records from primary storage. [2025-09-15T21:23:19.665109] [INFO ] [MAIN ] Derivative Progress: 2079/2083 symbols completed. ZKH took 1.0s. Estimated remaining: 1.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:19.665398] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:19.665269] [INFO ] [MAIN ] ZTR: Loaded 12151 primary data records. [2025-09-15T21:23:19.779238] [DEBUG] [LOCAL ] ZTO: Loaded 36526 existing records from primary storage. [2025-09-15T21:23:19.783675] [INFO ] [MAIN ] ZTO: Loaded 36526 primary data records. [2025-09-15T21:23:20.109094] [DEBUG] [LOCAL ] ZVIA: Loaded 26800 existing records from primary storage. [2025-09-15T21:23:20.145748] [INFO ] [MAIN ] ZVIA: Loaded 26800 primary data records. [2025-09-15T21:23:20.526729] [DEBUG] [MAIN ] ZTR: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:20.529268] [INFO ] [MAIN ] ZTR: Generated 1326 derivative records from 12151 primary records. [2025-09-15T21:23:20.529916] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-15T21:23:20.550053] [DEBUG] [MAIN ] ZTO: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:20.552559] [INFO ] [MAIN ] ZTO: Generated 1326 derivative records from 36526 primary records. [2025-09-15T21:23:20.553676] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-15T21:23:20.554255] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1326 records). [2025-09-15T21:23:20.555140] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-15T21:23:20.556781] [INFO ] [MAIN ] Derivative Progress: 2080/2083 symbols completed. ZTR took 0.9s. Estimated remaining: 1.0s. Rate: 181.2 symbols/min [2025-09-15T21:23:20.562481] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-15T21:23:20.568569] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1326 records). [2025-09-15T21:23:20.569138] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-15T21:23:20.570844] [INFO ] [MAIN ] Derivative Progress: 2081/2083 symbols completed. ZTO took 1.0s. Estimated remaining: 0.7s. Rate: 181.3 symbols/min [2025-09-15T21:23:20.583872] [DEBUG] [MAIN ] ZVIA: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:20.584509] [INFO ] [MAIN ] ZVIA: Generated 1326 derivative records from 26800 primary records. [2025-09-15T21:23:20.584635] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-15T21:23:20.596507] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1326 records). [2025-09-15T21:23:20.596595] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-15T21:23:20.598323] [INFO ] [MAIN ] Derivative Progress: 2082/2083 symbols completed. ZVIA took 0.9s. Estimated remaining: 0.3s. Rate: 181.3 symbols/min [2025-09-15T21:23:20.618471] [DEBUG] [LOCAL ] ZWS: Loaded 30695 existing records from primary storage. [2025-09-15T21:23:20.618568] [INFO ] [MAIN ] ZWS: Loaded 30695 primary data records. [2025-09-15T21:23:20.899235] [DEBUG] [MAIN ] ZWS: Filtered 5146 bins outside market hours, 5744 incomplete bins [2025-09-15T21:23:20.900018] [INFO ] [MAIN ] ZWS: Generated 1326 derivative records from 30695 primary records. [2025-09-15T21:23:20.900081] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-15T21:23:20.911502] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1326 records). [2025-09-15T21:23:20.911561] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-15T21:23:20.913191] [INFO ] [MAIN ] Derivative Progress: 2083/2083 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 181.3 symbols/min [2025-09-15T21:23:20.914502] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 29s [2025-09-15T21:23:20.914703] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2083/2083 symbols) [2025-09-15T21:23:21.643723] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2083/2083 @ 100.00%)' [2025-09-15T21:23:21.644576] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-15T21:23:21.644855] [INFO ] [STATE ] Last completion updated: 2025-09-15T21:23:21.644675